Contents
On this page
- Definition of the review question and prospective protocol registration
- Comprehensive searching and assessment of study quality
- Selection and justification of the statistical model
- Quantification of heterogeneity and assessment of publication bias
- Software selection and transparent, reproducible record-keeping
Academy · Research Data, Analytics & AI · Meta-analysis Guidelines
Ten Basic Guidelines for Conducting and Publishing a Meta-Analysis
A defensible meta-analysis rests on a pre-registered protocol, a justified choice between fixed-effect and random-effects models, a quantified and explained heterogeneity statistic, and a documented graphical assessment of publication bias, rather than on the pooling of figures from a database search alone.
A meta-analysis is a statistical method for combining quantitative results from multiple independent studies addressing the same question into a single pooled effect estimate with its own confidence interval, so that evidence dispersed across smaller individual studies can be interpreted as one coherent body. Conducted carelessly, it is also one of the study designs most prone to errors that nonetheless appear authoritative: a pooled number carries an implicit claim of precision that is only as sound as the search, the inclusion criteria, the statistical model and the bias checks behind it. Ten recurring, verifiable practices distinguish a meta-analysis that reviewers and later researchers can trust from one that merely produces a number.
Learning objectives
- The core sequence of decisions required of a defensible meta-analysis, from protocol to statistical model
- The reasons for which the choice between fixed-effect and random-effects models must be justified rather than defaulted
- The methods used to assess heterogeneity and publication bias, and the insufficiency of a single summary score
Common misconceptions
- “Running a meta-analysis is mainly a matter of finding enough studies and averaging their results.” Published guidance on conducting and reporting meta-analyses treats protocol registration, explicit inclusion criteria, a justified statistical model, and documented assessments of heterogeneity and publication bias as prerequisites to be established before pooling, rather than optional refinements added after an average has been calculated.
Definition of the review question and prospective protocol registration
A defensible meta-analysis begins with a specific question built on the PICO (population, intervention, comparator, outcome) framework, together with a check that no existing meta-analysis already answers it, before any search is run1. Registering the protocol in PROSPERO, the international register of systematic review and meta-analysis protocols, before data extraction begins creates a public, time-stamped record of the planned inclusion criteria and analysis methods, which enables readers to distinguish a pre-planned analysis from one whose methods were adjusted after the results were known6. Guidance on observational-study meta-analysis published as the COSMOS-E framework stresses that inclusion criteria require sufficient precision to be reproducible by an independent team, since criteria written too broadly inflate heterogeneity by pooling genuinely different populations or exposures, while criteria written too narrowly make eligible studies difficult to identify; the balance must therefore be struck deliberately rather than by trial and error partway through the search2.
Comprehensive searching and assessment of study quality
A comprehensive search spans multiple databases, commonly PubMed, Embase, Cochrane CENTRAL, Scopus and Web of Science, supplemented by checking the reference lists of included studies and relevant prior reviews, since no single database indexes the entire literature on any given question1. Reporting this search transparently is itself a PRISMA 2020 requirement: the statement expects a full account of every database searched, the exact search strategy used, and a flow diagram showing how many records were identified, screened, and excluded at each stage5. Study-quality assessment should use a validated tool matched to the included study designs (the Cochrane RoB 2 tool for randomized trials and the Newcastle-Ottawa Scale for cohort and case-control studies) rather than an ad hoc or home-built scoring system, and the completed quality assessment should inform the analysis directly, for example through sensitivity analyses that exclude lower-quality studies, rather than being reported separately and left unconnected to the pooled result9.
Selection and justification of the statistical model
A fixed-effect model assumes every included study is estimating the same single true effect, with observed differences attributable only to sampling error, while a random-effects model assumes the true effect itself varies across studies and estimates the distribution of that variation, a distinction first formalized for meta-analysis by DerSimonian and Laird's widely used method for combining results across clinical trials3. Because clinical and methodological differences across real-world studies are the norm rather than the exception, random-effects models are the more defensible default for most meta-analyses outside of a small set of highly standardized trials, and a meta-analysis using a fixed-effect model should explain specifically why its included studies are judged to share one common true effect23. Ten simple rules for carrying out and writing meta-analyses, a widely cited methods paper, recommends reporting the chosen model explicitly alongside the reasoning for it, and conducting a sensitivity analysis comparing fixed- and random-effects results whenever the choice is not evident, since a pooled estimate that shifts substantially between the two models is itself informative about the extent to which the underlying data can support a single summary number4.
Quantification of heterogeneity and assessment of publication bias
Heterogeneity, the variation in true effect across studies, should be quantified using the I² statistic, which expresses the percentage of total variation across studies attributable to heterogeneity rather than chance, alongside Cochran's Q test, since I² alone does not indicate statistical significance and Q alone does not indicate magnitude7. High heterogeneity should prompt subgroup analysis or meta-regression to explore its source rather than merely a note in the limitations section, since an unexplained high I² value undermines the interpretability of a single pooled estimate regardless of how narrow its confidence interval appears4. Publication bias, the tendency for studies with statistically significant or favorable results to be more likely to be published and therefore more likely to be found by a literature search, should be assessed visually with a funnel plot and formally with Egger's regression test for small-study effects, a method that detects funnel-plot asymmetry statistically rather than relying on visual judgment alone8. The final report should interpret the pooled result in light of both heterogeneity and bias findings, name individual studies that drove the result disproportionately, and recommend what further primary research, if any, would resolve remaining uncertainty, following the general reporting structure PRISMA 2020 and the MOOSE statement for observational-study meta-analyses both expect510.
Software selection and transparent, reproducible record-keeping
Meta-analyses are typically conducted in dedicated statistical software, commonly R, Stata, RevMan (the Cochrane Collaboration’s own tool) or a general-purpose platform such as JASP. The choice of software is less important than documenting it precisely: the report should name the exact software and version used, since pooled estimates and heterogeneity statistics can differ slightly across packages depending on default settings for continuity corrections and confidence-interval methods1. Ten simple rules for carrying out and writing meta-analyses recommends keeping a full, dated record of every search string, every screening decision with its reason for exclusion, and every analytical choice made during the project, not only for the methods section of the final manuscript but as a standing audit trail that enables the same team, or an independent one, to re-run the analysis later as new studies appear4. COSMOS-E guidance for observational-study meta-analyses adds that analysis code and, where no licensing or ethical restriction prevents it, the extracted dataset itself should be made available alongside the published report, since reproducibility checks on complex meta-analyses are otherwise limited to re-reading the methods section rather than re-running the analysis2. Supplementary files should include, at minimum, the full search strategy for every database, the PRISMA flow diagram, forest plots for every pooled outcome, the funnel plot and Egger’s test result, and a table summarizing the design, population and quality score of every included study, since this level of supporting detail enables readers and later researchers to verify the conclusions of the review independently rather than accepting the pooled estimate on trust.
Version control is also important: software packages are periodically updated in ways that can change default behavior, for example how a particular continuity correction is applied to studies with zero events in one arm. A meta-analysis that is revised or updated months after its initial analysis should therefore either re-run the full analysis in the current software version or state explicitly that output from an older version is being retained, rather than silently combining results produced under different software defaults1. Teams planning to update a meta-analysis as new studies appear, in effect converting it into a living meta-analysis, should establish this versioning discipline from the first analysis, since reconstructing which software version and settings produced an earlier pooled estimate becomes substantially more difficult the longer it remains undocumented.
Finally, authors should decide and state, before analysis begins, how any discrepancy between the analysis planned in the pre-registered protocol and the final published analysis will be handled and disclosed. Deviations sometimes become necessary when data collection reveals an unanticipated issue, and transparent reporting of what changed and why protects the credibility of the review far more effectively than silently publishing an analysis that differs from the one registered6.
Key points
Key points
A trustworthy meta-analysis registers its protocol and inclusion criteria before pooling, searches comprehensively across multiple databases, justifies the choice of a fixed-effect or random-effects model, and reports both a quantified heterogeneity statistic and a formal assessment of publication bias rather than a pooled estimate alone.
Practical application
Practical application
- The protocol should be registered in PROSPERO before data extraction begins. Registration creates a public, time-stamped record that distinguishes a pre-planned analysis from one adjusted after the results were known.
- The choice of a fixed-effect or random-effects model should be explicitly justified. Authors should state whether the included studies were judged to share one true effect (fixed effect) or to vary meaningfully (random effects), and should conduct both analyses as a sensitivity check when the choice is not evident.
- I², Cochran’s Q and a funnel plot with Egger’s test should be reported together. Heterogeneity and publication-bias findings should be reported as a set, with an explanation of their implications for the degree of confidence that can be placed in the pooled estimate.
Frequently asked questions
A systematic review is the structured process of identifying, screening, and critically appraising studies on a question; a meta-analysis is the optional statistical step of pooling those studies' quantitative results into a single combined estimate, and not every systematic review includes one.
Only when there is a specific, stated reason to believe that the included studies are estimating one common true effect, typically in a small set of highly standardized trials; otherwise, random-effects models are the more defensible default given real-world clinical and methodological variation.
It indicates that a large share of the variation across studies is due to real differences between them rather than chance, which should prompt subgroup analysis or meta-regression to investigate the source rather than merely being noted as a limitation.
No. Funnel-plot asymmetry can be judged visually, but a formal statistical test such as Egger's regression test should accompany it, since visual judgment alone is subjective and can be unreliable with a small number of studies.
No. Registration documents that the methods were planned in advance; it does not in itself assess the quality of the search, the statistical analysis or the included studies, which must still be evaluated separately.
References
- Forero DA, Lopez-Leon S, González-Giraldo Y, Bagos PG. Ten simple rules for carrying out and writing meta-analyses. PLOS Computational Biology. 2019;15(5):e1006922. read 10 October 2026. View on PLOS Computational Biology
- Dekkers OM, Vandenbroucke JP, Cevallos M, Renehan AG, Altman DG, Egger M. COSMOS-E: guidance on conducting systematic reviews and meta-analyses of observational studies of etiology. PLOS Medicine. 2019;16(2):e1002742. read 10 October 2026. View on PLOS Medicine
- DerSimonian R, Laird N. Meta-analysis in clinical trials. Controlled Clinical Trials. 1986;7(3):177-188. read 10 October 2026. View on Controlled Clinical Trials
- Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557-560. read 10 October 2026. View on The BMJ
- Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. read 10 October 2026. View on The BMJ
- Booth A, Clarke M, Dooley G, et al. The nuts and bolts of PROSPERO: an international prospective register of systematic reviews. Systematic Reviews. 2012;1:2. read 10 October 2026. View on Systematic Reviews
- Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629-634. read 10 October 2026. View on The BMJ
- Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. The Lancet. 1999;354(9193):1896-1900. read 10 October 2026. View on The Lancet
- Sterne JAC, Savović J, Page MJ, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366:l4898. read 10 October 2026. View on The BMJ
- Stroup DF, Berlin JA, Morton SC, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting (MOOSE). JAMA. 2000;283(15):2008-2012. read 10 October 2026. View on JAMA
Every source above is a peer-reviewed article, a publisher’s record of one, or a standard issued by the body that owns it. Each carries the date it was last read. Where a standard moves, this article is revised rather than left up with a note.
How to cite this article
Pick your referencing style and copy it. Your university or target journal may vary the punctuation — check its guide if it has one.
Pubrica Academy. (2026, October 10). Ten Basic Guidelines for Conducting and Publishing a Meta-Analysis. Pubrica. https://pubrica.com/academy/meta-analysis/ten-basic-guidelines-for-conducting-and-publishing-a-meta-analysis/
Pubrica Academy. “Ten Basic Guidelines for Conducting and Publishing a Meta-Analysis.” Pubrica, 10 Oct. 2026, pubrica.com/academy/meta-analysis/ten-basic-guidelines-for-conducting-and-publishing-a-meta-analysis/.
Pubrica Academy (2026) Ten Basic Guidelines for Conducting and Publishing a Meta-Analysis. Pubrica. Available at: https://pubrica.com/academy/meta-analysis/ten-basic-guidelines-for-conducting-and-publishing-a-meta-analysis/ (Accessed: 15 October 2026).
Pubrica Academy. “Ten Basic Guidelines for Conducting and Publishing a Meta-Analysis.” Pubrica. October 10, 2026. https://pubrica.com/academy/meta-analysis/ten-basic-guidelines-for-conducting-and-publishing-a-meta-analysis/
Pubrica Academy, ‘Ten Basic Guidelines for Conducting and Publishing a Meta-Analysis’ (Pubrica, 10 October 2026) <https://pubrica.com/academy/meta-analysis/ten-basic-guidelines-for-conducting-and-publishing-a-meta-analysis/> accessed 15 October 2026.
Pubrica Academy. Ten Basic Guidelines for Conducting and Publishing a Meta-Analysis. [Internet]. Pubrica; 2026 Oct 10 [cited 2026 Oct 15]. Available from: https://pubrica.com/academy/meta-analysis/ten-basic-guidelines-for-conducting-and-publishing-a-meta-analysis/
Pubrica Academy, “Ten Basic Guidelines for Conducting and Publishing a Meta-Analysis,” Pubrica, Oct. 10, 2026. [Online]. Available: https://pubrica.com/academy/meta-analysis/ten-basic-guidelines-for-conducting-and-publishing-a-meta-analysis/
@misc{/la_meta_analysis_conducting_publishing_guidelines_2026,
author = {{Pubrica Academy}},
title = {Ten Basic Guidelines for Conducting and Publishing a Meta-Analysis},
howpublished = {Pubrica},
year = {2026},
month = {oct},
url = {https://pubrica.com/academy/meta-analysis/ten-basic-guidelines-for-conducting-and-publishing-a-meta-analysis/},
note = {Accessed: <span data-cite-acc="iso">2026-10-15</span>}
}This article is written to be learned from. Cite it if you are referring to what it says; if you are using the evidence behind it, cite the sources listed above instead.
Meta-analysis Pre-Pooling Checklist
Each of these items should be confirmed before any effect estimate is pooled.
[ ] Registered the protocol in PROSPERO before data extraction [ ] Defined inclusion/exclusion criteria specific enough to be reproducible [ ] Searched at least 3-5 databases plus reference lists of included studies [ ] Assessed study quality with a validated tool matched to study design [ ] Chose and justified a fixed- or random-effects model explicitly [ ] Reported I² and Cochran's Q together, not I² alone [ ] Produced a funnel plot and ran Egger's test for publication bias [ ] Followed PRISMA 2020 or MOOSE reporting structure for the final write-up
Pubrica AcademyWritten and maintained by Pubrica’s subject matter experts. Articles are revised when the underlying standards change, and each article states the date on which it was last reviewed.
How Pubrica can help
Pubrica’s biostatistics team develops meta-analysis protocols, conducts the model-selection and heterogeneity assessments described above, and prepares PRISMA- and MOOSE-compliant reports for journal submission.