Proof
Annotation timings were collected over 18 annotators (PhDs in CS, biology, and economics), each annotating a stratified 50-paper subsample with 4-way overlap on a 20-paper calibration set. Median per-paper times were 47 minutes (claim-level, full edge graph), 22 minutes (claim-level, no inter-paper edges), and 14 minutes (paper-level metadata only). The 3.4x figure compares the first to the third.
Knowledge graph · drag to pan, scroll to zoom, click a node to navigate
Full neighborhood
Required by (dependents) (6)
- c7Claim c7Pre-registering a replication target shifts the median completion time forward by 6 weeks vs unregistered replications.…
- c2Claim c2Annotating claims is 3.4x more expensive than annotating papers (median, 18 annotators, 200-paper subset). Replication…
- c3Claim c3Claim-graph retrieval improves recall@10 by 28% over citation-graph retrieval on narrow technical queries (n=1,200…
- c4Claim c4Paper-level replication labels mask within-paper disagreement: in our sample, 41% of ``replicated'' papers had at least…
- c5Claim c5A canonical claim ID format of <paper_id>:<kind>:<label> survives version chains without rewriting if paper_id stays…
- c6Claim c6Per-claim discussion threads cluster into reproducibility / methodology / interpretation buckets with 0.81 inter-coder…
Discussion
No replications, contradictions, or comments registered yet for this claim.
Replicate or annotate this claim
Replicate to register a fresh attempt; contradict, extend, or comment otherwise. Authors can post a claim-retraction with the reason taxonomy from RRP-0020.
Sign in with ORCID to annotate this claim.