Skip to content

Most evidence items carry a paraphrase, not a verbatim snippet #133

Description

@realmarcin

Raised by a reader asking what the evidence actually was behind the MreB record's trait links. The honest answer for that record was: a paraphrase attributed to papers I had not read. Measuring the rest: 0 of 262 evidence items in the corpus carry a snippet. Every one is notes — my restatement of what a source is taken to say.

docs/CURATION.md already draws the line: "snippet is for verbatim quotes only. When you have not seen the source text, use notes to paraphrase what the source establishes." The corpus has been technically compliant with that rule while making it carry all the weight — a reader cannot distinguish 'paraphrased from a text I read' from 'inferred from a title'.

Two specific failures found while checking one record:

  1. A citation nothing could be read from. DOI:10.1146/annurev-genet-102108-134845 (Annual Review of Genetics 2010) has no PubMed and no PMC record — the identifier resolves at Crossref, so the liveness gate passes it, but there is no free abstract, let alone full text. It was cited for a specific claim about MreB and cell shape. Removed in the fix.
  2. A claim the source contradicts. The record said shape and mreB track each other. Shi et al. 2018 says: "Many rod-like and curved bacterial species require MreB to elongate, although there are exceptions such as the Actinobacteria and Rhizobiales that lack MreB altogether." Reading the paper bounded the claim; not reading it had let the claim overreach.

Suggested work, roughly in order:

  • Prefer sources that can be read. Record whether a reference has an open-access full text (PMC id) at citation time; the liveness checker already resolves DOIs and could resolve to PMC in the same pass.
  • Snippet the load-bearing claims first — trait links, causal-graph edges and protein_examples, which are curator-asserted and where a wrong paraphrase is invisible.
  • Consider a gate: a claim in one of those fields whose evidence has no snippet and whose reference has no open-access text is a claim nobody can check. That is a reportable state, even if not initially a failing one.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions