Contents
Academy · Research Data, Analytics & AI · LEGEND Evidence Grading
LEGEND: Literature Evaluation and Grading of Evidence and Its Relation to GRADE
LEGEND, developed at Cincinnati Children’s Hospital and formally described in a 2009 paper, was designed as a point-of-care evidence evaluation system. It and the more widely adopted GRADE framework represent two distinct approaches to the same problem: the consistent grading of evidence quality. This article examines LEGEND and its relationship to GRADE.
LEGEND, an acronym for Let Evidence Guide Every New Decision, is an evidence evaluation system developed at Cincinnati Children's Hospital Medical Center and described formally in a 2009 paper in the Journal of Evaluation in Clinical Practice by Clark, Burkett, and Stanko-Lopp. It was designed specifically to give point-of-care clinicians and guideline development teams a standardized, repeatable method for appraising the quality of individual studies and bodies of evidence, assessing elements such as study design, sample size, statistical methods, and risk of bias, so that a clinical recommendation can be explicitly linked to the strength of the evidence supporting it.
Learning objectives
- What LEGEND is, who developed it, and the specific name the acronym stands for
- How the evidence-grading problem LEGEND addresses relates to the much more widely known GRADE framework
- The historical development of formal evidence grading, and why it shifted from ranking study designs to assessing the body of evidence as a whole
Common misconceptions
- “A systematic grading tool such as LEGEND or GRADE simply ranks studies by design type, with randomised trials at the top.” The foundational 2008 paper of the GRADE working group explicitly moved away from grading evidence quality solely on the basis of study design, arguing that confidence in a body of evidence should also account for consistency across studies, directness of the evidence to the clinical question, precision of the estimate and risk of publication bias. Both GRADE and LEGEND-style systems share this multi-factor approach rather than ranking by design type alone.
Definition of LEGEND and the meaning of its acronym
Eloise Clark, Kristin Burkett, and Danette Stanko-Lopp published the formal description of LEGEND, whose title identifies it explicitly as “an evidence evaluation system for point-of-care clinicians and guideline development teams,” in the Journal of Evaluation in Clinical Practice in 20091. The tool was developed at Cincinnati Children's Hospital Medical Center, which continues to host and maintain the LEGEND evidence evaluation tools and supporting resources for clinicians and guideline teams using the system2. The paper frames the system's core purpose as supporting evidence-based practice directly at the point of care, giving a clinician or a guideline-writing team a standardized way to assess an individual study's design, sample size, statistical approach, potential sources of bias, and relevance to the specific clinical question at hand, rather than relying on an individual reviewer's informal judgment of a study's trustworthiness1. The paper's framing of the tool as serving both “point-of-care clinicians” and “guideline development teams” is itself informative: it indicates that the tool was designed to scale from a single clinician rapidly appraising one study while making a bedside decision to a full guideline committee systematically grading an entire body of evidence before issuing a formal recommendation, using the same underlying assessment logic in both settings rather than two separate systems for two different scales of use. This dual framing is one reason why institutionally developed tools such as LEGEND persist alongside more internationally dominant frameworks: they are closely tailored to the working practices of a specific institution's clinicians and committees, which can make them easier to adopt locally even where a broader framework such as GRADE has wider recognition elsewhere. For a guideline team outside Cincinnati Children's considering which system to adopt, the practical question concerns less which tool is objectively superior than which one its own committees and reviewers can apply consistently, since a rigorous framework applied inconsistently provides less protection against error than a simpler one applied reliably.
The move beyond study-design hierarchies
Formal evidence grading in medicine has a documented history that predates LEGEND and helps explain why a multi-factor system, rather than a simple rank order of study designs, became the standard approach. Early grading systems largely ranked evidence by study design alone (randomized controlled trials above cohort studies, and cohort studies above case series), an approach that the GRADE working group's 2004 and 2008 papers explicitly argued was too crude, since a well-conducted observational study can sometimes provide more useful evidence for a specific question than a poorly conducted or highly indirect randomized trial34. The GRADE working group's foundational 2008 paper in the BMJ, authored by Gordon Guyatt and a large international group of collaborators, proposed instead that confidence in a body of evidence should be assessed across study design, risk of bias, consistency across studies, directness to the actual question, and precision of the estimate, each evaluated and then combined into an overall grade5. A separate, earlier grading approach from the Scottish Intercollegiate Guidelines Network, described by Harbour and Miller in 2001, had already begun moving in a similar direction for guideline development specifically, reflecting that the shift away from design-only hierarchies was a broader trend across multiple grading systems developed around the same period, not a feature unique to any single tool6.
Relationship of LEGEND to GRADE and other grading systems
LEGEND and GRADE address the same underlying need (a consistent, transparent method of grading evidence quality and connecting that grade to the strength of a resulting recommendation), but they differ in scope and institutional reach. GRADE has become the dominant international standard, formally adopted by the Cochrane Collaboration, the World Health Organization, and a large number of medical societies worldwide, with its own detailed guideline series addressing each component of the assessment in depth, including a dedicated paper on rating the quality of evidence by Holger Balshem and colleagues7. LEGEND, by contrast, was developed and is maintained institutionally at a single pediatric academic medical center, oriented specifically toward that institution's own point-of-care and guideline-development workflow, which the original 2009 paper frames as its specific intended use case rather than a bid to become a universal cross-institutional standard1. The Oxford Centre for Evidence-Based Medicine's own Levels of Evidence framework represents a third distinct approach, organized primarily by question type (treatment benefit, diagnosis, prognosis) and retaining more of a structured hierarchy within each category than GRADE's fully multi-factor approach, illustrating that even among systems addressing the same core problem, substantive methodological differences in structure and emphasis persist8.
Grading of the guideline in addition to the underlying evidence
Grading the quality of the underlying evidence addresses only part of the question; a separate, complementary question is whether the resulting clinical practice guideline itself was developed rigorously, which is a distinct assessment with its own dedicated tool. Melissa Brouwers and a large international collaborative group developed AGREE II specifically to appraise a guideline's development process, covering domains such as the scope and purpose of the guideline, the rigor with which evidence was developed and synthesized, the clarity of its presentation, and its editorial independence from funding sources, independently of the quality of the underlying evidence11. This distinction matters in practice because a guideline can be built on a well-graded, high-confidence body of evidence and still be poorly developed, for instance by lacking a transparent conflict-of-interest process or by failing to link each recommendation clearly to the specific evidence grade that supports it, which is precisely the type of structural weakness AGREE II is designed to identify11. A guideline development team that uses LEGEND or GRADE for evidence grading together with AGREE II for appraising its own development process is addressing two genuinely separate sources of potential weakness in a final clinical recommendation, rather than applying the same check twice.
Requirements for applying a formal grading system
Whichever specific system is used, applying it rigorously requires the same underlying components the Cochrane Handbook's chapter on grading confidence in evidence lays out: an explicit, per-outcome assessment of risk of bias in the contributing studies, a judgment about how consistent effect estimates are across those studies, a judgment about how directly the evidence addresses the actual clinical question being asked, an assessment of how precise the pooled or best-available estimate is, and a check for signs of publication bias, with each of these factors capable of lowering or, in specific circumstances, raising the overall confidence grade assigned9. For a guideline team or an individual clinician using LEGEND specifically, this means that the tool's assessment criteria (study design, sample size, statistical methods, bias, and relevance, as named in the original 2009 description) are not independent checkboxes to be completed quickly but components of a structured judgment that is intended to be transparent and defensible to any subsequent reader of the resulting guideline110. A practical consequence of this transparency requirement is that a well-applied grading system produces a visible audit trail: a clinician or guideline reader should be able to trace any specific recommendation back through its assigned evidence grade to the individual component judgments (risk of bias, consistency, directness, and precision) that produced that grade, rather than encountering a final recommendation with no accessible record of the confidence warranted by the underlying evidence.
Key points
Key points
LEGEND and GRADE both reflect the documented shift in evidence-based medicine away from ranking evidence by study design alone and towards multi-factor grading that accounts jointly for risk of bias, consistency, directness and precision; LEGEND represents one institution’s implementation of this broader principle.
Practical application
Practical application
- Studies should not be graded on the basis of design type alone. Risk of bias, consistency with other evidence, directness to the research question and precision of the estimate should be assessed as separate factors, following the logic shared by LEGEND and GRADE.
- Grading criteria should be explicit and documented, in addition to the final grade. The reasoning behind each component judgement should be recorded so that another reviewer, or a future guideline update, can follow how the grade was reached.
- The grading system should be selected according to institutional context and intended audience. The wide adoption of GRADE makes it the more appropriate default for work intended for a broad or international audience; a point-of-care system such as LEGEND may be better suited to a single institution’s existing guideline workflow.
Frequently asked questions
No. They are separate systems addressing the same underlying evidence-grading problem; GRADE is the more widely adopted international standard, while LEGEND was developed and is maintained specifically at Cincinnati Children's Hospital Medical Center for its own point-of-care and guideline workflow.
Let Evidence Guide Every New Decision, per the title of the system's formal 2009 description by Clark, Burkett, and Stanko-Lopp in the Journal of Evaluation in Clinical Practice.
The GRADE working group's foundational papers argued that study design alone does not capture important differences in risk of bias, consistency, directness, and precision that can make a well-conducted observational study more informative for a specific question than a flawed or highly indirect randomized trial.
In principle, a multi-factor system can grade a very large, consistent effect seen in observational data as more informative than a very small, high-risk-of-bias, or highly indirect randomized trial for a specific question, which is part of why GRADE and GRADE-like systems deliberately moved beyond a strict design-based hierarchy.
References
- Clark E, Burkett K, Stanko-Lopp D. Let evidence guide every new decision (LEGEND): an evidence evaluation system for point-of-care clinicians and guideline development teams. Journal of Evaluation in Clinical Practice. 2009;15(6):1054-1060. read 10 October 2026. View on Journal of Evaluation in Clinical Practice
- Cincinnati Children's Hospital Medical Center. LEGEND Evidence Evaluation Tools & Resources. Anderson Center for Health Systems Excellence. read 10 October 2026. View on Cincinnati Children's
- Atkins D, Best D, Briss PA, et al. Grading quality of evidence and strength of recommendations. BMJ. 2004;328(7454):1490. read 10 October 2026. View on BMJ
- Guyatt GH, Oxman AD, Vist GE, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924-926. read 10 October 2026. View on BMJ
- Guyatt GH, Oxman AD, Schünemann HJ, Tugwell P, Knottnerus A. GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. Journal of Clinical Epidemiology. 2011;64(4):380-382. read 10 October 2026. View on Journal of Clinical Epidemiology
- Harbour R, Miller J. A new system for grading recommendations in evidence based guidelines. BMJ. 2001;323(7308):334-336. read 10 October 2026. View on BMJ
- Balshem H, Helfand M, Schünemann HJ, et al. GRADE guidelines: 3. Rating the quality of evidence. Journal of Clinical Epidemiology. 2011;64(4):401-406. read 10 October 2026. View on Journal of Clinical Epidemiology
- OCEBM Levels of Evidence Working Group. The Oxford Levels of Evidence 2. Oxford Centre for Evidence-Based Medicine. read 10 October 2026. View on CEBM Oxford
- Schünemann H, Higgins JPT, Vist GE, et al. Chapter 14: Completing 'Summary of findings' tables and grading the certainty of the evidence. In: Cochrane Handbook for Systematic Reviews of Interventions version 6.4. read 10 October 2026. View on Cochrane Training
- Guyatt GH, Oxman AD, Kunz R, et al. GRADE guidelines: 1. Introduction - GRADE evidence profiles and summary of findings tables. Journal of Clinical Epidemiology. 2011;64(4):383-394. read 10 October 2026. View on Journal of Clinical Epidemiology
- Brouwers MC, Kho ME, Browman GP, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ. 2010;182(18):E839-E842. read 10 October 2026. View on CMAJ
Every source above is a peer-reviewed article, a publisher’s record of one, or a standard issued by the body that owns it. Each carries the date it was last read. Where a standard moves, this article is revised rather than left up with a note.
How to cite this article
Pick your referencing style and copy it. Your university or target journal may vary the punctuation — check its guide if it has one.
Pubrica Academy. (2026, October 10). LEGEND: Literature Evaluation and Grading of Evidence and Its Relation to GRADE. Pubrica. https://pubrica.com/academy/concepts-definitions/literature-evaluation-and-grading-of-evidence/
Pubrica Academy. “LEGEND: Literature Evaluation and Grading of Evidence and Its Relation to GRADE.” Pubrica, 10 Oct. 2026, pubrica.com/academy/concepts-definitions/literature-evaluation-and-grading-of-evidence/.
Pubrica Academy (2026) LEGEND: Literature Evaluation and Grading of Evidence and Its Relation to GRADE. Pubrica. Available at: https://pubrica.com/academy/concepts-definitions/literature-evaluation-and-grading-of-evidence/ (Accessed: 15 October 2026).
Pubrica Academy. “LEGEND: Literature Evaluation and Grading of Evidence and Its Relation to GRADE.” Pubrica. October 10, 2026. https://pubrica.com/academy/concepts-definitions/literature-evaluation-and-grading-of-evidence/
Pubrica Academy, ‘LEGEND: Literature Evaluation and Grading of Evidence and Its Relation to GRADE’ (Pubrica, 10 October 2026) <https://pubrica.com/academy/concepts-definitions/literature-evaluation-and-grading-of-evidence/> accessed 15 October 2026.
Pubrica Academy. LEGEND: Literature Evaluation and Grading of Evidence and Its Relation to GRADE. [Internet]. Pubrica; 2026 Oct 10 [cited 2026 Oct 15]. Available from: https://pubrica.com/academy/concepts-definitions/literature-evaluation-and-grading-of-evidence/
Pubrica Academy, “LEGEND: Literature Evaluation and Grading of Evidence and Its Relation to GRADE,” Pubrica, Oct. 10, 2026. [Online]. Available: https://pubrica.com/academy/concepts-definitions/literature-evaluation-and-grading-of-evidence/
@misc{/la_legend_literature_evaluation_grading_evidence_2026,
author = {{Pubrica Academy}},
title = {LEGEND: Literature Evaluation and Grading of Evidence and Its Relation to GRADE},
howpublished = {Pubrica},
year = {2026},
month = {oct},
url = {https://pubrica.com/academy/concepts-definitions/literature-evaluation-and-grading-of-evidence/},
note = {Accessed: <span data-cite-acc="iso">2026-10-15</span>}
}This article is written to be learned from. Cite it if you are referring to what it says; if you are using the evidence behind it, cite the sources listed above instead.
Evidence Grading Component Checklist
For use when grading a body of evidence, whether with LEGEND, GRADE, or another multi-factor system.
[ ] Assessed risk of bias in the contributing studies individually [ ] Assessed consistency of effect estimates across the studies [ ] Assessed directness: how closely the evidence matches the actual clinical question [ ] Assessed precision of the pooled or best-available estimate [ ] Checked for signs of publication bias [ ] Documented the reasoning behind each component judgment, not just the final grade [ ] Named which specific grading system was used and why
Pubrica AcademyWritten and maintained by Pubrica’s subject matter experts. Articles are revised when the underlying standards change, and each article states the date on which it was last reviewed.
How Pubrica can help
Pubrica’s evidence synthesis team applies structured, multi-factor grading, whether GRADE, a LEGEND-style system or another named system, documenting each component judgement so that the final evidence grade is transparent and defensible.