The route
A primary study is published. It is cited, sometimes accurately. It may be included in a systematic review, where it is appraised and weighted. The review may inform a guideline, where judgement about benefits, harms and values is added. The guideline may change practice.
Each step is a filter, and each is a place where the original finding can be strengthened beyond what it supports.
Where distortion happens
Citation drift. A hedged finding is cited slightly more strongly, and that citation is cited more strongly again. After several steps a tentative association is cited as established fact, traceable to a paper that never claimed it.
Citing without reading. Propagated through citation chains, including propagation of errors in the original citation.
Press release amplification. Institutional press releases and reporting routinely strengthen causal language beyond the paper, and the strengthened version is what reaches practitioners and patients.
Guideline lag. A guideline reflects evidence available at its development, which may be years old at the point of use.
Reading defensibly
Go to the primary source for any claim that matters. Check that a citation supports the specific sentence it is attached to. Prefer systematic reviews to individual studies for effect estimates, and check the review’s date and search date. Note the difference between a guideline recommendation and the evidence beneath it.
Writing defensibly
Cite what you have read. Represent the strength of the original claim, including its hedging. Check the press release before it goes out — the author is usually the only person positioned to catch over-claiming in it.
In short
What to take from this.
- Check that each citation supports the sentence it is attached to.
- Preserve the original’s hedging when citing it.
- Review the press release — over-claiming usually enters there.
Sources
- Literature on citation distortion and citation chains
- ICMJE Recommendations, on accurate representation of sources
Related