Home/Insights/Evidence synthesis/AHRQ Methods Guide for Effectiveness and Comparative Effectiveness Reviews
AHRQ Methods Guide for Effectiveness and Comparative Effectiveness Reviews
The methods manual behind AHRQ’s Evidence-based Practice Center reviews, and the most detailed public guidance on comparative effectiveness questions.
What it is
The Methods Guide for Effectiveness and Comparative Effectiveness Reviews is produced by the Agency for Healthcare Research and Quality for its Evidence-based Practice Center (EPC) programme. It is published as a set of chapters, updated individually, which is why it is sometimes cited chapter by chapter rather than as one document.
Where it differs in emphasis from Cochrane
Cochrane guidance centres on the review of a single intervention against a comparator. The AHRQ guide is built for comparative effectiveness: several interventions, often with no head-to-head evidence between them, assessed for a decision-maker.
It therefore gives more weight to including observational evidence where trials are absent or do not address the question, to assessing applicability to real populations, and to indirect and network comparison.
Its framework for rating a body of evidence — across risk of bias, consistency, directness, precision and reporting bias — is GRADE-concordant and expressed in terms EPC reviews use.
The chapters most often needed
Engaging stakeholders and refining the question. Selecting observational studies for comparative effectiveness. Assessing risk of bias. Quantitative synthesis. Grading strength of evidence. Assessing applicability, which is the chapter most often skipped and most often needed — a result that is internally valid but does not apply to the population in question is of no use to the decision-maker.
In practice
Fix, flag or query.
The distinction that keeps an edit defensible: what an editor may change silently, what must be shown to the author, and what only the author can answer.
- Use for: multiple-comparator questions where head-to-head trials are missing.
- Do not skip: the applicability assessment.
- Cite: the individual chapter and its version, since chapters update separately.
Sources
- Agency for Healthcare Research and Quality, EPC Methods Guide
- GRADE Working Group, on strength-of-evidence domains
Sources are given so each claim can be checked at its origin. Where a tool’s current maintenance status could not be confirmed, the page says to check it rather than asserting it.
Related