Contents
On this page
- Origins of the Registered Reports model
- Effects of two-stage review on the timing and detection of design flaws
- Evidence on the reduction of inflated findings
- Current adoption of the format
- Strengths and unresolved aspects of the efficiency argument
- Comparison of Registered Reports with the standard psychology literature
- Does the format improve study quality as well as outcomes?
- Adoption of Registered Reports in clinical research
- The principal published critique of pre-registration
Academy · Research Publication · Registered Reports and Review Efficiency
Improving the Efficiency of Scientific Grant and Journal Peer Review: The Registered Reports Model
Review of a study’s design before its results exist, the Registered Reports model, is now used by over 300 journals, and the available evidence suggests that it reduces wasted effort for both authors and reviewers. This article examines the model’s origins, adoption and the evidence on its effects.
Most peer review takes place after a study is completed: reviewers evaluate a finished manuscript, including its results, and design flaws are often identified only after months of data collection. Registered Reports reverse this sequence: the introduction, hypotheses and methods are peer-reviewed and provisionally accepted before data are collected, and the completed study is then checked against the pre-approved plan. The format originated as a little-known 1970s policy at a single parapsychology journal and has since been adopted, in some form, by over 300 journals, making it one of the most concrete structural reforms available for reducing wasted review and research effort.
Learning objectives
- How the Registered Reports model restructures peer review into two stages: design review before data collection, and verification review afterwards
- The empirical evidence that Registered Reports are associated with a lower rate of inflated ‘significant result’ findings than standard publication
- How many journals have adopted the format, and how the model originated decades before it reached mainstream science
Common misconceptions
- “Registered Reports are a recent and untested idea.” A prototype version of results-blind, pre-data review ran continuously in the European Journal of Parapsychology from the mid-1970s through the early 1990s, decades before the model reached mainstream psychology journals such as Cortex in 2013.
- “Pre-registration of a study design merely adds a review step and delays research.” The efficiency argument for Registered Reports is that reviewing design flaws before data collection prevents researchers from investing months or years in a study that reviewers would subsequently judge to be flawed; review effort is moved earlier rather than simply increased.
- “Registered Reports are relevant only to small, specialised fields.” Over 300 journals across multiple disciplines now accept the format in some form, according to the Center for Open Science's own tracking, making it one of the more widely adopted structural peer-review reforms in current use.
Origins of the Registered Reports model
A 2019 analysis in PeerJ by Wiseman, Watt, and Kornbrot traced the origins of the Registered Reports model to decades earlier than is commonly assumed1. Parapsychologist Martin Johnson outlined a results-blind, pre-data review approach in a 1974 inaugural address, and the European Journal of Parapsychology ran this policy in every issue from 1976 to 1992, with its final Registered Report appearing in 1992–19931. The modern mainstream revival began when Cortex adopted a version of the format in 2013, following a proposal from psychologist Chris Chambers, and an open letter from Chambers and Marcus Munafò helped spread the model to other journals1.
Effects of two-stage review on the timing and detection of design flaws
In the Registered Reports model, reviewers evaluate the introduction, hypotheses and planned methods (including statistical analysis plans) before any data are collected, and a study that passes this stage receives an in-principle acceptance. The second review stage, after data collection, checks only whether the completed study followed the pre-approved plan, rather than reopening the underlying question or hypothesis1. The original rationale, attributed to Weiss (1989) in the historical record, was explicitly concerned with efficiency: pre-data review was proposed mainly to prevent researchers from investing time in poorly designed studies before the design flaws could be identified1.
Evidence on the reduction of inflated findings
The clearest empirical test of the effect of the model comes from the same European Journal of Parapsychology dataset, because the journal published both Registered Reports and conventional, non-registered studies concurrently for over a decade1. Wiseman, Watt, and Kornbrot found that only 8.4% of hypothesis tests in Registered Reports were statistically significant (11 of 131), compared with 28.4% in non-Registered Reports (66 of 232), a difference the authors describe as highly significant (Fisher’s exact test, p < .0005)1. Neither the topic studied nor the time period explained the gap1. The authors note that the comparison was retrospective and not randomized, so the evidence is circumstantial rather than definitive proof of causation; nevertheless, it remains one of the few datasets in which the same journal, the same field and overlapping time periods allow a direct, before-and-after-style comparison of registered versus unregistered review.
Current adoption of the format
According to the Center for Open Science, which maintains the most complete public tracking of the format, more than 300 journals now offer Registered Reports as a regular submission option or within dedicated special issues, with additional journals offering only some of the format's features2. This represents a substantial expansion, from the 1970s policy of a single specialist journal to a format available across psychology, biomedicine and other fields, within roughly a decade of its mainstream relaunch.
Strengths and unresolved aspects of the efficiency argument
The efficiency case for Registered Reports rests on a specific mechanism: identifying a flawed design before, rather than after, the resources for data collection are spent. The bias-reduction evidence from the parapsychology dataset supports the view that pre-registration changes what is published, but the authors’ own caveats bear repeating: the design was not randomized, and other factors such as study power or methodological quality could plausibly explain part of the difference1. For funders and institutions considering the format, the mechanism is sound and adoption is substantial and growing, but the efficiency gains are better documented for bias reduction than for any precise measure of reviewer time or cost saved.
Comparison of Registered Reports with the standard psychology literature
The most direct modern test of whether Registered Reports change what is published, rather than only how it is reviewed, comes from a 2021 study by Scheel, Schijen, and Lakens in Advances in Methods and Practices in Psychological Science3. The authors compared a random sample of 152 hypothesis-testing studies from the standard psychology literature against all 71 Registered Reports published up to that point, looking specifically at whether each study's first-stated hypothesis was confirmed. In the standard literature, 96% of first hypotheses reported a positive, confirmatory result; among Registered Reports, only 44% did3. This gap is far larger than that observed in the parapsychology dataset, and because the comparison spans ordinary psychological science rather than one specialist field, the authors argue that it is strong evidence that the near-universal positive-result rate of the standard literature reflects publication bias and inflated false-positive rates rather than psychological hypotheses being correct 96% of the time3. A separate analysis covered in Nature Index similarly found a sharp rise in reported null findings once a field's studies moved to a pre-registered format, corroborating the direction, if not the exact magnitude, of the psychology-specific result10.
Does the format improve study quality as well as outcomes?
A separate question is whether Registered Reports are better-conducted studies, not merely studies with different reported outcomes. A 2021 study by Soderberg and colleagues in Nature Human Behaviour addressed this directly by having expert reviewers blindly rate the methodological rigor of published Registered Reports against matched standard articles from the same journals and topics4. The Registered Reports scored higher on nearly every quality dimension assessed, including rigor of methodology and analysis and the overall soundness of conclusions, while scoring similarly on creativity, which directly addresses a common objection that fixing a design before data collection stifles creative or exploratory research4. Separately, a mapping study of adoption by Hardwicke and Ioannidis found that, as of a 2018 snapshot, 91 journals had adopted the format, and a survey of 29 of those journals found 334 Stage 1 protocols submitted, 87 granted in-principle acceptance, and 32 completed Final Reports published or in press, which provides a concrete picture of attrition between submission and final publication under the two-stage model5. A later census of journals publishing the format between 2013 and 2020 found that adoption remains heavily concentrated in psychology, that journals typically take about a year after adopting the format to publish their first Registered Report, and that a substantial share of journals that formally adopt the track have not yet published one; formally offering the format is therefore distinct from using it at scale9.
Adoption of Registered Reports in clinical research
Although the format began in psychology and parapsychology, it has since moved into biomedical publishing. BMC Medicine became the first clinical research journal to accept Registered Reports, extending the design-first review model to intervention and observational clinical studies rather than only laboratory psychology experiments6. The rationale applies equally: a clinical study whose primary endpoint, sample size and analysis plan are peer-reviewed and fixed before enrollment begins is less susceptible to undisclosed reshaping around whichever outcome proves statistically significant, which is the same selective-reporting problem that motivates pre-specified statistical analysis plans in trial methodology more broadly.
The principal published critique of pre-registration
Not all methodologists agree that the benefits of the format are as clear-cut as its advocates suggest. In a widely discussed 2020 paper in Perspectives on Psychological Science, Szollosi and colleagues argued that pre-registration (the core discipline underlying Registered Reports) is, at best, redundant with good theoretical practice, and that the value attributed to pre-registration often reflects the value of a precise, falsifiable theoretical prediction, which a researcher may have or lack irrespective of whether the prediction was formally registered in advance7. The critique does not dispute the empirical findings on reduced positive-result rates described above; it questions whether the registration step itself is responsible for the effect, or whether it is a proxy for theoretical rigor that could in principle be achieved without the two-stage review structure. For research teams deciding whether a specific study suits the format, this debate cautions against treating Registered Reports as a guarantee of quality rather than as one structural tool among several for enforcing it.
Key points
Key points
Registered Reports move peer review earlier in the research process, identifying design flaws before data collection, and the one dataset permitting direct comparison shows a large reduction in inflated significant-result rates, although the evidence remains observational rather than randomised.
Practical application
Practical application
- Authors should check whether a target journal offers a Registered Reports track. The Center for Open Science’s listing of journals accepting Registered Reports should be consulted before a study design is finalised, since over 300 journals now accept the format in some form.
- The statistical analysis plan should be drafted at the design-review stage, not after data collection. Primary hypotheses, sample size justification and analysis methods should be specified in the Stage 1 submission so that in-principle acceptance fixes the plan.
- An in-principle acceptance should be regarded as binding on both parties. Any deviations from the pre-approved plan should be documented explicitly in the Stage 2 submission rather than analyses being adjusted without disclosure after the data are seen.
- The format is best suited to adequately powered confirmatory studies. Registered Reports suit hypothesis-testing designs with analysis plans that can be pre-specified; exploratory or discovery-oriented research may be less suited to the two-stage structure.
Frequently asked questions
A prototype results-blind review policy ran at the European Journal of Parapsychology from the mid-1970s to the early 1990s, well before the mainstream revival that began with Cortex's adoption of the format in 2013.
The Center for Open Science's tracking lists more than 300 journals offering Registered Reports as a regular option or within special issues, with others offering partial support for the format.
The strongest direct comparison, from a 2019 PeerJ analysis of the European Journal of Parapsychology, found a large and statistically significant gap in reported significant-result rates between Registered and non-Registered studies, but the authors themselves describe the evidence as circumstantial because the comparison was retrospective, not randomized.
References
- Wiseman, R., Watt, C., & Kornbrot, D. (2019). "Registered reports: an early example and analysis." PeerJ, 7, e6232. read 10 October 2026. View on PeerJ
- Center for Open Science. "Registered Reports." COS Initiatives. read 10 October 2026. View source
- Scheel AM, Schijen MRMJ, Lakens D. An excess of positive results: comparing the standard psychology literature with Registered Reports. Advances in Methods and Practices in Psychological Science. 2021;4(2). read 10 October 2026. View source
- Soderberg CK, Errington TM, Schiavone SR, et al. Research quality of registered reports compared with the standard publishing model. Nature Human Behaviour. 2021;5:990-997. read 10 October 2026. View source
- Hardwicke TE, Ioannidis JPA. Mapping the universe of Registered Reports. Preprint/dataset summary. read 10 October 2026. View source
- BioMed Central. "BMC Medicine becomes the first clinical research journal to accept Registered Reports." BMC Press Centre. read 10 October 2026. View source
- Chambers CD. Registered Reports: a new publishing initiative at Cortex. Cortex. 2013;49(3):609-610. read 10 October 2026. View source
- Szollosi A, Kellen D, Navarro DJ, et al. Preregistration is redundant, at best. Perspectives on Psychological Science. 2020;15(4):1-19. read 10 October 2026. View source
- Hardwicke TE, et al. Opening the door to Registered Reports: census of journals publishing Registered Reports (2013-2020). Collabra: Psychology. 7(1). read 10 October 2026. View source
- Nature Index. "First analysis of 'pre-registered' studies shows sharp rise in null findings." read 10 October 2026. View source
Every source above is a peer-reviewed article, a publisher’s record of one, or a standard issued by the body that owns it. Each carries the date it was last read. Where a standard moves, this article is revised rather than left up with a note.
How to cite this article
Pick your referencing style and copy it. Your university or target journal may vary the punctuation — check its guide if it has one.
Pubrica Academy. (2026, October 10). Improving the Efficiency of Scientific Grant and Journal Peer Review: The Registered Reports Model. Pubrica. https://pubrica.com/academy/concepts-definitions/improving-the-efficiency-of-scientific-grant-review-and-journal-peer-review/
Pubrica Academy. “Improving the Efficiency of Scientific Grant and Journal Peer Review: The Registered Reports Model.” Pubrica, 10 Oct. 2026, pubrica.com/academy/concepts-definitions/improving-the-efficiency-of-scientific-grant-review-and-journal-peer-review/.
Pubrica Academy (2026) Improving the Efficiency of Scientific Grant and Journal Peer Review: The Registered Reports Model. Pubrica. Available at: https://pubrica.com/academy/concepts-definitions/improving-the-efficiency-of-scientific-grant-review-and-journal-peer-review/ (Accessed: 15 October 2026).
Pubrica Academy. “Improving the Efficiency of Scientific Grant and Journal Peer Review: The Registered Reports Model.” Pubrica. October 10, 2026. https://pubrica.com/academy/concepts-definitions/improving-the-efficiency-of-scientific-grant-review-and-journal-peer-review/
Pubrica Academy, ‘Improving the Efficiency of Scientific Grant and Journal Peer Review: The Registered Reports Model’ (Pubrica, 10 October 2026) <https://pubrica.com/academy/concepts-definitions/improving-the-efficiency-of-scientific-grant-review-and-journal-peer-review/> accessed 15 October 2026.
Pubrica Academy. Improving the Efficiency of Scientific Grant and Journal Peer Review: The Registered Reports Model. [Internet]. Pubrica; 2026 Oct 10 [cited 2026 Oct 15]. Available from: https://pubrica.com/academy/concepts-definitions/improving-the-efficiency-of-scientific-grant-review-and-journal-peer-review/
Pubrica Academy, “Improving the Efficiency of Scientific Grant and Journal Peer Review: The Registered Reports Model,” Pubrica, Oct. 10, 2026. [Online]. Available: https://pubrica.com/academy/concepts-definitions/improving-the-efficiency-of-scientific-grant-review-and-journal-peer-review/
@misc{/la_registered_reports_improving_peer_review_efficiency_2026,
author = {{Pubrica Academy}},
title = {Improving the Efficiency of Scientific Grant and Journal Peer Review: The Registered Reports Model},
howpublished = {Pubrica},
year = {2026},
month = {oct},
url = {https://pubrica.com/academy/concepts-definitions/improving-the-efficiency-of-scientific-grant-review-and-journal-peer-review/},
note = {Accessed: <span data-cite-acc="iso">2026-10-15</span>}
}This article is written to be learned from. Cite it if you are referring to what it says; if you are using the evidence behind it, cite the sources listed above instead.
Before adopting a Registered Reports submission track
This checklist supports the decision on whether a study is suited to the Registered Reports format.
[ ] Confirm the target journal offers a Registered Reports track (check the Center for Open Science listing) [ ] Pre-specify primary hypotheses and exclude exploratory aims from the confirmatory plan [ ] Justify sample size and statistical power before Stage 1 submission [ ] Lock the statistical analysis plan at Stage 1, including handling of missing data [ ] Document any Stage 2 deviations from the approved plan explicitly, with rationale
Pubrica AcademyWritten and maintained by Pubrica’s subject matter experts. Articles are revised when the underlying standards change, and each article states the date on which it was last reviewed.
How Pubrica can help
Pubrica supports research teams in preparing Stage 1 Registered Reports submissions, including pre-specified analysis plans and power calculations designed to withstand Stage 2 review after data collection.