Free scoping read. A written assessment of your manuscript in two business days, at no cost.

Start one
Contents

Academy · Research Publication · Psychology manuscripts and review

Theoretical Framing and Peer-Review Policy in Psychology Manuscripts

Peer-review policies in psychology changed in response to evidence that many published results did not replicate. Of 100 studies in the Open Science Collaboration’s replication project, 97% of the originals reported statistically significant findings, compared with 36% of the replications. Current reviewer requirements — pre-specified hypotheses, reporting of all dependent measures, a sample size justification, and access to data and code — follow from that evidence and from psychologists’ own reports of their research practices.

Pubrica AcademyWritten by the medical writing and biostatistics teams Reviewed byPubrica biostatistics team Published9 October 2026 Last checked9 October 2026 Reading time11 minutes Sources39 peer-reviewed

Two subjects that are usually taught separately are reviewed together. The first is theoretical framing: whether a manuscript names a theory, derives from it a prediction that could have been disconfirmed, and states what result would have counted as disconfirmation. The second is the set of transparency policies that psychology journals adopted after the replication findings of the last decade. The two are connected: a theory stated loosely enough to accommodate any result is precisely what undisclosed analytic flexibility produces, and the policies exist to make both visible. This article examines what reviewers in psychology now look for and how a manuscript can be written to meet those expectations.

Learning objectives

  • The quantitative findings of the replication and questionable-research-practice literature
  • Stating a theoretical approach so that the result that would falsify it is explicit to reviewers
  • Distinguishing confirmatory from exploratory analysis within the manuscript
  • The Registered Report format, its review sequence and the extent to which journals offer it
  • The requirements that psychology-specific reviewer guidelines place on a manuscript
  • The transparency statements that should be prepared before submission rather than on request

Common misconceptions

  • “A theoretical framework is merely background to be cited in the introduction.” A framework that does not generate a falsifiable prediction contributes little to the argument. Reviewers in psychology increasingly ask what result would have counted against the hypothesis, and a manuscript that does not answer this question may be read as unfalsifiable.
  • “The replication problem was confined to a small number of flawed studies.” In the Open Science Collaboration’s project, 97% of 100 original studies reported significant results against 36% of replications; 47% of original effect sizes fell within the replication’s confidence interval, and 39% of effects were subjectively rated as having replicated.
  • “Questionable research practices are rare and confined to other researchers.” In John, Loewenstein and Prelec’s survey of 2,155 psychologists, 63.4% admitted not reporting all of a study’s dependent measures and 55.9% admitted collecting more data after checking whether results were significant; 94.0% admitted at least one practice on the list, while outright data falsification was admitted by 0.6%.
  • “Exploratory analysis is inherently poor practice.” Exploratory analysis is a means of generating hypotheses. The problem lies in presenting exploratory findings as confirmatory, and the remedy is explicit labelling rather than avoidance of exploration.
  • “Pre-registration means that review proceeds as usual, with the addition of a timestamp.” In a Registered Report, review takes place before data collection, and acceptance is granted on the question and the method rather than on the result. More than 300 journals now offer the format.

Interdependence of theoretical framing and review policy

For most of the twentieth century, a psychology manuscript was evaluated on the soundness of its design and the interest of its result. Two bodies of evidence have since changed the questions reviewers ask. The Open Science Collaboration, reporting in Science, attempted replications of 100 studies from three psychology journals: 97% of the original studies had reported statistically significant results, and 36% of the replications did 13. Other measures yielded a similar pattern: 47% of original effect sizes fell within the confidence interval of the replication, 39% of effects were judged to have replicated on subjective assessment, and 68% were significant when original and replication were combined.

The second body of evidence concerns research practice rather than outcomes. John, Loewenstein and Prelec, in Psychological Science, surveyed 2,155 psychologists with an incentive-compatible design intended to elicit truthful admission, and 94.0% admitted at least one questionable research practice 16. Agnoli and Carollo, in the Giornale italiano di psicologia, examined the use and abuse of such practices in the field 12.

Together, these two findings explain the modern review agenda. If analytic flexibility and selective reporting are widespread, a result alone constitutes weak evidence, and a reviewer must assess the process that produced it 13,16. A manuscript must therefore make that process visible. It is at this point that theoretical framing becomes relevant again, because a prediction derived in advance from a stated theory is the strongest available constraint on flexibility.

97%of 100 original studies reported significant results
36%of the replications did
47%of original effect sizes fell within the replication’s confidence interval
39%of effects were subjectively rated as having replicated

The replication project that reset psychology’s review policies. Source: Open Science Collaboration. Estimating the reproducibility of psychological science. Science.

Survey evidence on questionable research practices

The individual items in the questionable-research-practice survey merit separate consideration, because each corresponds to a specific element that reviewers now check. Not reporting all of a study’s dependent measures was admitted by 63.4% of respondents; collecting more data after checking whether results were significant, by 55.9%; selectively reporting studies that worked, by 45.8%; excluding data after looking at the impact of doing so, by 38.2%; and rounding a p value down to a threshold, by 22.0%. Falsifying data was admitted by 0.6%.

Two points about these figures warrant emphasis. First, almost none of them describe fraud. They describe ordinary research decisions taken after the data have been seen, each individually defensible, which collectively inflate the rate of apparently positive findings 16. Second, the survey had a 36% response rate, so the figures carry the usual limitations of survey estimates; the authors were explicit about the method they used to improve candour 13,16.

The practical consequence for a manuscript is that the burden of demonstration has shifted. Reporting what was found is no longer sufficient; reviewers will look for evidence of what was not reported. Reporting every measure collected, naming the stopping rule for data collection, declaring excluded cases with reasons, and giving exact p values rather than thresholds are now expectations rather than virtues 11.

What psychologists admitted about their own practice, and what a reviewer now checks

PracticeAdmitted byWhat the manuscript must now show
Not reporting all of a study’s dependent measures63.4%Every measure administered is listed, whether or not it was analysed
Collecting more data after checking whether results were significant55.9%A stated stopping rule, or an account of when and why collection continued
Selectively reporting studies that worked45.8%All studies in a multi-study paper, including those that failed
Excluding data after looking at the impact of doing so38.2%Pre-set exclusion criteria, plus counts and reasons for any further exclusions
Rounding a p value down to a threshold22.0%Exact test statistics, effect sizes and confidence intervals
Falsifying data0.6%—
At least one practice on the list94.0%—

Admission rates from John LK, Loewenstein G, Prelec D. Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling. Psychological Science; 2,155 respondents, 36% response rate. The right-hand column is an editorial interpretation of the reporting implication, not a finding of that study.

Stating a falsifiable theoretical approach

A theoretical approach in a manuscript serves three functions. It identifies the theory or model being drawn on, specifically enough that a reader could locate it. It derives the prediction under test from that theory, with the auxiliary assumptions made explicit — the measurement assumptions, the population assumptions, and the assumption that the manipulation operates as claimed. It also states what pattern of results would have counted against the prediction.

The third function is the one most manuscripts omit, and its absence renders a framing section ornamental. A reviewer reading “consistent with social-cognitive theory, we predicted an association between X and Y” cannot tell whether the theory predicts an association, a particular direction, a particular magnitude, or a moderated pattern — nor what the theory would have implied had the opposite been found. A single sentence in the introduction stating the disconfirming pattern does more for a manuscript’s credibility than a page of citations.

Where a study is not theory-driven — a prevalence estimate, a psychometric evaluation, a measurement-invariance test — this should be stated rather than a theory being attached retrospectively. A descriptive question framed transparently tends to be reviewed more favourably than one presented as a test. For instrument development specifically, the framing is psychometric rather than theoretical: see the Academy pages on developing and evaluating an instrument and instrument types.

Distinguishing confirmatory from exploratory analyses in the manuscript

The distinction that matters most to a psychology reviewer is between analyses specified before the data were seen and analyses chosen afterwards. Both have a place in a paper. Presenting the latter as the former is not acceptable, and the remedy is structural: each should be labelled.

The methods should state which hypotheses were pre-specified and where that specification is recorded — a registration, a protocol, or an analysis plan deposited with a timestamp. The results should present the confirmatory analyses first, in the order set out in the methods, followed by a separately headed subsection for exploratory analyses. The discussion should treat exploratory findings as hypotheses for future work rather than as evidence. If the study was not pre-registered, this should be stated plainly, together with the analytic decisions made and when they were made; a transparent account of post hoc decisions is reviewable, whereas silence is not.

Three further items now routinely appear in reviewer comments: a justification for the sample size, whether by power analysis, precision or a stated resource constraint; a statement of the constraints on generality of the findings, given the sample and setting; and the location of the data, materials and analysis code, or the reason they cannot be shared 11. Our pages on statistical hypotheses and imprecision in research address the statistical aspects of these requirements.

The same analysis, reported two ways

Flexibility invisible

Consistent with social-cognitive theory, we hypothesised that self-efficacy would predict adherence. Participants completed a battery of questionnaires. Self-efficacy significantly predicted adherence (p < .05), and this effect was stronger in women. Data were collected until a sufficient sample was obtained, and three participants were excluded as outliers.

The theory does no work. “Consistent with social-cognitive theory” names a literature but derives nothing, and no result could have been inconsistent with it as stated.

“A battery of questionnaires”. With 63.4% of surveyed psychologists admitting that they did not report all dependent measures, an unlisted battery is likely to be the first point a reviewer raises.

“Until a sufficient sample was obtained”. No stopping rule and no power justification — and 55.9% admitted collecting more data after checking significance.

Outliers excluded with no criterion. Three cases removed, no rule, no reasons; 38.2% admitted excluding data after seeing the effect of doing so.

A moderation claim with no status. “Stronger in women” is presented alongside the main test, with no indication of whether it was predicted.

A threshold instead of a value. “p < .05” with no effect size and no interval, when 22.0% admitted rounding p values down to a threshold.

Flexibility declared

Social-cognitive theory holds that behaviour change is mediated by expectations about one’s own capability; from this we derived the directional prediction that higher self-efficacy at baseline would be associated with higher adherence at 12 weeks. A null or negative association would have counted against this prediction, and the theory makes no prediction about gender moderation. Hypotheses, sample size and the analysis plan were registered before data collection (registration ______). We planned to recruit 240 participants, giving 80% power to detect r = 0.18 at alpha = .05, and stopped recruitment at that number irrespective of results. Participants completed the six measures listed in Table 1; all six are reported here, and the two not analysed in the primary model are reported in Supplementary Table S2. Exclusion criteria were set in advance; three participants met them (two incomplete baselines, one outside the age range) and no further cases were excluded. Confirmatory analysis: baseline self-efficacy was associated with 12-week adherence, r = 0.22 (95% CI 0.09 to 0.34), p = .001. Exploratory analysis, not pre-specified: the association was larger among women (r = 0.31, 95% CI 0.15 to 0.45) than men (r = 0.11, 95% CI −0.08 to 0.29); we treat this as a hypothesis for replication rather than a finding.

The theory generates a directional prediction and the disconfirming pattern is stated, so a reader can see what was at stake.

All measures administered are accounted for, with the unanalysed ones placed in a supplement rather than omitted.

The sample size has a justification and a stopping rule that was followed regardless of the result.

Exclusions are pre-specified, counted and reasoned, with an explicit statement that no further cases were removed.

Confirmatory and exploratory analyses are separated and labelled, and the moderation is framed as a hypothesis for replication.

Effect sizes with confidence intervals and exact p values let a reader judge magnitude and precision, not just a verdict.

The second version reports the same study. It is one paragraph longer, and it closes each of the specific gaps that psychology’s reviewer guidelines were written to identify.

Registered Reports and review before data collection

A Registered Report inverts the review sequence. Authors submit the introduction, hypotheses, method and analysis plan before collecting data; reviewers assess the question and the design; and if the journal accepts the proposal, it issues an in-principle acceptance, committing to publish the completed study provided the approved plan is followed, whatever the results show 7. Chambers and Tzavella documented the format’s first decade in Nature Human Behaviour, across pages 29 to 42 of volume 6. More than 300 journals now offer it 39.

Specifically, the format changes three things: it removes the incentive to produce a significant result, since acceptance has already been granted; it requires the analysis plan to be written before the data can influence it; and it makes review more useful, because reviewer comments arrive while the design can still be changed 7. The format does not, however, guarantee that the study will be informative; it does not prevent exploratory analysis, provided that such analysis is labelled; and it requires more time at the outset.

The format is also not suited to every project. Secondary analysis of existing data, qualitative work, and research in which the design must adapt as it proceeds fit the format awkwardly or not at all. Where a Registered Report is not possible, a timestamped pre-registration of hypotheses and analysis plan achieves part of the same constraint, and stating in the manuscript exactly what was and was not pre-specified achieves more of it than most authors anticipate.

Standard review against a Registered Report

StageStandard submissionRegistered Report
What is reviewed firstThe completed study, results includedIntroduction, hypotheses, method and analysis plan, before data collection
When reviewer comments can change the designNever; the study is already completeBefore any data is collected
What acceptance depends onThe question, the method and, in practice, the resultThe question and the method; in-principle acceptance precedes the result
Analysis planWritten at any point, often after seeing dataApproved before the data exist
Exploratory analysisPermitted, often unlabelledPermitted, and must be labelled separately from the approved plan
AvailabilityEvery journalMore than 300 journals offer the format

Format description from Chambers CD, Tzavella L. The past, present and future of Registered Reports. Nature Human Behaviour (volume 6, pages 29-42); the count of participating journals is from the Center for Open Science’s Registered Reports listing.

Requirements of psychology-specific reviewer guidance

Davis and colleagues published peer-review guidelines promoting replicability and transparency in psychological science in Advances in Methods and Practices in Psychological Science, across pages 556 to 573 of the fourth issue of volume 1 11. Guidance of this kind is written for reviewers, which makes it the most direct statement available of what a psychology manuscript will be checked against: whether hypotheses were pre-specified, whether all measures and conditions are reported, whether the sample size has a justification, whether exclusions are described with reasons, whether exact test statistics and effect sizes with intervals are given, and whether data, materials and code are available 11.

Two further strands are shaping review in the field. Aly and colleagues, in the Journal of Experimental Psychology: General, argue for changes in the culture of review towards something more inclusive and equitable, which bears on how reports are written as well as who writes them 5. And Brewin, in Perspectives on Psychological Science, makes the case for open post-publication critique as a corrective to inaccuracy that pre-publication review does not catch — a reminder that review is not the last check 6,34. Suls and Martin, in the same journal, set out the structural criticisms of the process itself; the peer reviewing hub collects the general evidence 19.

For reviewers at psychology journals, these guidelines are the most useful single reference, and they also serve authors as a pre-submission checklist for their own manuscripts.

Transparency statements to include in the manuscript

In the introduction: the theory, the prediction derived from it, the auxiliary assumptions, and the pattern that would have counted against it. In the methods: the pre-registration and where it lives; the sample size justification; all conditions and all measures administered, not only those analysed; the stopping rule for data collection; exclusion criteria set in advance and any further exclusions with reasons and counts; and the analysis plan, with model specification.

In the results: confirmatory analyses first, in the methods’ order, with exact test statistics, effect sizes and confidence intervals; then a separately headed exploratory section. In the discussion: a constraints-on-generality statement, and exploratory findings framed as hypotheses. At the end: data, materials and code availability, with a reason where sharing is restricted, and the ethics and consent statements.

None of these elements is lengthy. A manuscript that includes all of them is perhaps 300 words longer than one that includes none, and it removes most of the objections that a reviewer working from the current guidelines would otherwise raise 39. Our stage-by-stage checklists address the same requirements for other designs, and psychology subject support is the service through which Pubrica supports these manuscripts.

Key points

Key points

Peer-review policies in psychology respond to measured problems: 97% of 100 original studies in the Open Science Collaboration’s project reported significant results, compared with 36% of replications, and in a survey of 2,155 psychologists 94.0% admitted at least one questionable research practice — 63.4% not reporting all dependent measures, 55.9% collecting more data after checking significance and 38.2% excluding data after seeing the effect. A manuscript is therefore expected to make its research process visible. Authors should state the theory, derive the prediction and specify what result would have counted against it; report every measure administered; justify the sample size and state the stopping rule; label confirmatory and exploratory analyses separately; report exact statistics with effect sizes and intervals; and state where the data, materials and code are available. Where the design allows, a Registered Report — now offered by more than 300 journals — moves review to before data collection, the stage at which reviewer comments can still alter the study.

Application to your study

Application to your study

  1. State the disconfirming pattern in the introduction. A single sentence should specify the result that would have counted against the prediction. Without it, a framing section tends to read as background rather than as argument.
  2. List every measure and condition administered. Measures that were not analysed should be reported in a supplement rather than omitted; non-reporting of measures is the most frequently admitted practice in the survey literature.
  3. Justify the sample size and state the stopping rule. The justification may rest on statistical power, precision or a stated resource constraint, and the manuscript should confirm that recruitment stopped at the planned number irrespective of the results.
  4. Pre-specify exclusions, then count and explain any others. The report should include an explicit statement that no further cases were excluded.
  5. Label exploratory analyses in their own subsection. Exploratory analysis is legitimate; presenting it as confirmatory is not, and a separate heading resolves the distinction.
  6. Report exact statistics with effect sizes and intervals. A bare significance threshold, or a direction of effect without a magnitude, is insufficient.
  7. Add a constraints-on-generality statement. The statement should describe the sample, the setting from which it was drawn and the resulting limits on generalisation.
  8. Consider a Registered Report where the design permits it. Review before data collection is the only stage at which reviewer comments can still improve the design of the study.

Frequently asked questions

Three elements are required. First, the theory or model being drawn on, identified specifically enough that a reader could locate it rather than infer it from a citation. Second, the prediction derived from that theory for the study, with the auxiliary assumptions stated — what the measures are assumed to capture, what the manipulation is assumed to do, and the population to which the derivation applies. Third, the pattern of results that would have counted against the prediction. The third element is the one most manuscripts omit, and without it a reviewer cannot determine whether the theory informed the study or was attached after the fact.

Two findings account for this. The Open Science Collaboration, in Science, replicated 100 studies: 97% of the originals reported statistically significant results and 36% of the replications did, with 47% of original effect sizes falling inside the replication’s confidence interval. And John, Loewenstein and Prelec, surveying 2,155 psychologists in Psychological Science, found that 94.0% admitted at least one questionable research practice — 63.4% not reporting all dependent measures, 55.9% collecting more data after checking significance, 45.8% selectively reporting studies that worked. If analytic flexibility is this common, a result on its own constitutes weak evidence, and reviewers therefore assess the process that produced it.

It is a format in which authors submit the introduction, hypotheses, method and analysis plan before collecting data. Reviewers assess the question and design, and an accepted proposal receives in-principle acceptance: the journal commits to publishing the completed study provided the approved plan is followed, whatever the results show. Chambers and Tzavella reviewed the format’s first decade in Nature Human Behaviour, and more than 300 journals now offer it. The format is best suited to studies in which the design is fixed in advance and the question is worth answering whatever the outcome. It fits awkwardly with secondary analysis of existing data, with qualitative work, and with designs that must adapt as they proceed.

Yes; exploratory analysis is the means by which most hypotheses are generated. What is not acceptable is presenting an exploratory result as a confirmatory test. The remedy is structural rather than statistical: the methods should state which hypotheses were pre-specified and where that specification is recorded; the confirmatory analyses should be reported first, in the order set out in the methods, followed by a separately headed subsection for exploratory analyses; and the discussion should treat exploratory findings as hypotheses for replication. If nothing was pre-registered, the manuscript should say so and describe which analytic decisions were taken after the data were seen — a transparent account of post hoc choices is reviewable, whereas silence is not.

Davis and colleagues’ peer-review guidelines for replicability and transparency, published in Advances in Methods and Practices in Psychological Science, are the most direct answer available, and they work equally well as a pre-submission checklist. They direct reviewers to ask whether hypotheses were pre-specified, whether all measures and conditions administered are reported, whether the sample size has a justification, whether exclusions are described with criteria and counts, whether exact test statistics and effect sizes with intervals are given, and whether data, materials and analysis code are available or the restriction explained. A manuscript that answers all of those pre-empts most of the methodological comments it would otherwise attract.

Expectations have moved substantially towards sharing, and a growing number of psychology journals require either the data or a reasoned explanation for withholding them. Where sharing is genuinely restricted — identifiable clinical data, consent that did not cover reuse, third-party ownership — authors should state which of these applies, specify what can be shared, and provide a route by which another researcher could request access. Analysis code is almost always shareable even when the data are not, and sharing the code alone addresses a large part of what a reviewer requires, since it makes the analysis specification verifiable.

Not on that ground alone; a great deal of valuable psychological research is not pre-registered. What matters is that the manuscript does not claim a confirmatory status it cannot support. The manuscript should state plainly that the study was not pre-registered, describe the analytic decisions made and when they were made, report all measures and conditions administered, give exclusion criteria with counts, and label as exploratory any analysis chosen after the data were seen. Reviewers respond poorly to an unregistered study written as though it had been planned in detail, and reasonably well to one that is candid about its own status.

It is a short paragraph, usually placed at the end of the discussion, stating which features of the sample, setting, materials and procedure the authors believe are necessary for the result to hold, and which they expect to generalise. It replaces the generic limitations paragraph stating that a larger sample would be desirable. For example, a report of a result obtained in undergraduates in one country, with a particular instrument, during a particular period, should say so and state what the authors believe would and would not transfer. Reviewers in psychology increasingly request it explicitly, and writing it tends to improve the discussion regardless of whether it is requested.

References

  1. International Committee of Medical Journal Editors. Recommendations for the Conduct, Reporting, Editing, and Publication of Scholarly Work in Medical Journals. International Committee of Medical Journal Editors. 2026. read 9 October 2026. icmje.org
  2. Hesselberg J-O, Dalsbo TK, Stromme H, Svege I, Fretheim A. Reviewer training for improving grant and journal peer review. Cochrane Database of Systematic Reviews. 2023:MR000056. doi:10.1002/14651858.MR000056.pub2 read 9 October 2026. doi.org/10.1002/14651858.MR000056.pub2
  3. Jefferson T, Rudin M, Brodney Folse S, Davidoff F. Editorial peer review for improving the quality of reports of biomedical studies. Cochrane Database of Systematic Reviews. 2007:MR000016. doi:10.1002/14651858.MR000016.pub3 read 9 October 2026. doi.org/10.1002/14651858.MR000016.pub3
  4. Cyberpsychology: Journal of Psychosocial Research on Cyberspace (editors). Decisions and Reviews Statistics for 2024. Cyberpsychology: Journal of Psychosocial Research on Cyberspace. 2024. read 9 October 2026. cyberpsychology.eu
  5. Aly M, Colunga E, Crockett MJ, Goldrick M, Gomez P, Kung FYH, McKee PC, Perez M, Stilwell SM, Diekman AB. Changing the culture of peer review for a more inclusive and equitable psychological science. Journal of Experimental Psychology: General. 2023. doi:10.1037/xge0001461 read 9 October 2026. doi.org/10.1037/xge0001461
  6. Brewin CR. Inaccuracy in the Scientific Record and Open Postpublication Critique. Perspectives on Psychological Science. 2023;18(5). doi:10.1177/17456916221141357 read 9 October 2026. doi.org/10.1177/17456916221141357
  7. Chambers CD, Tzavella L. The past, present and future of Registered Reports. Nature Human Behaviour. 2022;6:29-42. doi:10.1038/s41562-021-01193-7 read 9 October 2026. doi.org/10.1038/s41562-021-01193-7
  8. Menon V, Varadharajan N, Praharaj SK, Ameen S. Why Do Manuscripts Get Rejected? A Content Analysis of Rejection Reports from the Indian Journal of Psychological Medicine. Indian Journal of Psychological Medicine. 2022;44(1):59-65. doi:10.1177/0253717620965845 read 9 October 2026. doi.org/10.1177/0253717620965845
  9. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021:n71. doi:10.1136/bmj.n71 read 9 October 2026. doi.org/10.1136/bmj.n71
  10. Lee J, Yang K, Oh DG. Factors influencing the choice of a publication venue in library and information science. Learned Publishing. 2020;33(3):323-332. doi:10.1002/leap.1300 read 9 October 2026. doi.org/10.1002/leap.1300
  11. Davis WE, Giner-Sorolla R, Lindsay DS, Lougheed JP, Makel MC, Meier ME, Sun J, Vaughn LA, Zelenski JM. Peer Review Guidelines Promoting Replicability and Transparency in Psychological Science. Advances in Methods and Practices in Psychological Science. 2018;1(4):556-573. doi:10.1177/2515245918806489 read 9 October 2026. doi.org/10.1177/2515245918806489
  12. Agnoli F, Carollo AG. Use (and abuse) of questionable research practices in psychology. Giornale italiano di psicologia. 2018;XLV(4):713-732. doi:10.1421/92985 read 9 October 2026. doi.org/10.1421/92985
  13. Open Science Collaboration. Estimating the reproducibility of psychological science. Science. 2015;349(6251):aac4716. doi:10.1126/science.aac4716 read 9 October 2026. doi.org/10.1126/science.aac4716
  14. Lee CJ, Sugimoto CR, Zhang G, Cronin B. Bias in peer review. Journal of the American Society for Information Science and Technology. 2013;64(1):2-17. doi:10.1002/asi.22784 read 9 October 2026. doi.org/10.1002/asi.22784
  15. Zhang M, Grieneisen ML. The impact of misconduct on the published medical and non-medical literature, and the news media. Scientometrics. 2013;96(2):573-587. doi:10.1007/s11192-012-0920-5 read 9 October 2026. doi.org/10.1007/s11192-012-0920-5
  16. John LK, Loewenstein G, Prelec D. Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling. Psychological Science. 2012;23(5):524-532. doi:10.1177/0956797611430953 read 9 October 2026. doi.org/10.1177/0956797611430953
  17. Winck JC, Fonseca JA, Azevedo LF, Wedzicha JA. To publish or perish: how to review a manuscript. Pulmonology. 2011;17(2). read 9 October 2026. journalpulmonology.org
  18. Schulz KF, Altman DG, Moher D. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. Trials. 2010;11(1):32. doi:10.1186/1745-6215-11-32 read 9 October 2026. doi.org/10.1186/1745-6215-11-32
  19. Suls J, Martin R. The Air We Breathe: A Critical Look at Practices and Alternatives in the Peer-Review Process. Perspectives on Psychological Science. 2009;4(1). doi:10.1111/j.1745-6924.2009.01105.x read 9 October 2026. doi.org/10.1111/j.1745-6924.2009.01105.x
  20. Jefferson T. Peer review and publishing: it's time to move the agenda on. The Lancet. 2005;366:283-284. doi:10.1016/S0140-6736(05)66968-1 read 9 October 2026. doi.org/10.1016/S0140-6736(05)66968-1
  21. Schroter S, Black N, Evans S, Carpenter J, Godlee F, Smith R. Effects of training on quality of peer review: randomised controlled trial. BMJ. 2004;328(7441):673. doi:10.1136/bmj.38023.700775.AE read 9 October 2026. doi.org/10.1136/bmj.38023.700775.AE
  22. Jefferson T. Glossary of peer review. Journal of Epidemiology and Community Health. 2004;58:272. read 9 October 2026. drtomjefferson.com
  23. Weber EJ, Katz PP, Waeckerle JF, Callahan ML. Author perception of peer review: impact of review quality and acceptance on satisfaction. JAMA. 2002;287(21):2790-2793. read 9 October 2026. garfield.library.upenn.edu
  24. Meadows J. Editorial peer review: its strengths and weaknesses. Journal of Documentation. 2002;58(1):104-106. read 9 October 2026. garfield.library.upenn.edu
  25. Callahan ML, Knopp RK, Gallagher EJ. Effect of written feedback by editors on quality of reviews: two randomized trials. JAMA. 2002;287(21):2781-2783. read 9 October 2026. garfield.library.upenn.edu
  26. Jefferson T, Alderson P, Wager E, Davidoff F. Effects of editorial peer review: a systematic review. JAMA. 2002;287(21):2784-2786. doi:10.1001/jama.287.21.2784 read 9 October 2026. doi.org/10.1001/jama.287.21.2784
  27. Rennie D. Fourth International Congress on Peer Review in Biomedical Publication. JAMA. 2002;287(21):2759-2760. read 9 October 2026. garfield.library.upenn.edu
  28. Tregenza T. Gender bias in the refereeing process? Trends in Ecology & Evolution. 2002;17(8):349-350. read 9 October 2026. garfield.library.upenn.edu
  29. Godlee F. Making reviewers visible: openness, accountability, and credit. JAMA. 2002;287(21):2762-2765. read 9 October 2026. garfield.library.upenn.edu
  30. Jefferson T, Wager E, Davidoff F. Measuring the quality of editorial peer review. JAMA. 2002;287(21):2786-2790. read 9 October 2026. garfield.library.upenn.edu
  31. Marusic A, Lukic IK, Marusic M, McNamee D, Sharp D, Horton R. Peer review in a small and a big medical journal: case study of the Croatian Medical Journal and The Lancet. Croatian Medical Journal. 2002;43(3):286-289. read 9 October 2026. garfield.library.upenn.edu
  32. Gura T. Peer review, unmasked. Nature. 2002;416(6878):258-260. read 9 October 2026. garfield.library.upenn.edu
  33. Bornstein RF. Peer-review in neuropsychology. Cortex. 2002;38(3):403-405. read 9 October 2026. garfield.library.upenn.edu
  34. Horton R. Postpublication criticism and the shaping of clinical knowledge. JAMA. 2002;287(21):2843-2847. read 9 October 2026. garfield.library.upenn.edu
  35. Richardson JV. The peer review process: acceptances, revisions, and outright rejections. Library Quarterly. 2002;72(1):V-XI. read 9 October 2026. garfield.library.upenn.edu
  36. Rowland F. The peer-review process. Learned Publishing. 2002;15(4):247-258. read 9 October 2026. garfield.library.upenn.edu
  37. Wager E, Jefferson T. Shortcomings of peer review in biomedical journals. Learned Publishing. 2001;14:257-263. read 9 October 2026. drtomjefferson.com
  38. van Rooyen S, Godlee F, Evans S, Black N, Smith R. Effect of open peer review on quality of reviews and on reviewers' recommendations: a randomised trial. BMJ. 1999;318(7175):23-27. doi:10.1136/bmj.318.7175.23 read 9 October 2026. doi.org/10.1136/bmj.318.7175.23
  39. Center for Open Science. Registered Reports. Center for Open Science (cos.io). read 9 October 2026. cos.io

Every source above is a peer-reviewed article, a publisher’s record of one, or a standard issued by the body that owns it. Each carries the date it was last read. Where a standard moves, this article is revised rather than left up with a note.

How to cite this article

Pick your referencing style and copy it. Your university or target journal may vary the punctuation — check its guide if it has one.

Pubrica Academy. (2026, October 9). Theoretical Framing and Peer-Review Policy in Psychology Manuscripts. Pubrica. https://pubrica.com/academy/uncategorized/list-out-the-theoretical-approaches-and-peer-review-policies-for-writing-a-psychology-journal-manuscript/

This article is written to be learned from. Cite it if you are referring to what it says; if you are using the evidence behind it, cite the sources listed above instead.

Transparency statements for a psychology manuscript

These statements should be completed before submission. Each block corresponds to an element that psychology’s reviewer guidelines direct reviewers to examine, and each is considerably easier to write at this stage than in a response letter.

PSYCHOLOGY MANUSCRIPT TRANSPARENCY SHEET
Manuscript: ______________________________________

1. THEORETICAL FRAMING  (goes in the introduction)
   Theory or model drawn on: _________________________________
   Prediction derived from it: _______________________________
   Direction predicted: [ ] positive [ ] negative [ ] moderated
     [ ] no directional prediction - say so
   Auxiliary assumptions made explicit:
     measurement: ____________________________________________
     manipulation: ___________________________________________
     population: _____________________________________________
   WHAT WOULD HAVE COUNTED AGAINST THE PREDICTION:
     _________________________________________________________
   [ ] This study is NOT theory-driven; it is descriptive /
       psychometric / exploratory, and the manuscript says so

2. PRE-SPECIFICATION  (goes in the methods)
   [ ] Pre-registered.  Registry and number: ________________
       Date registered: ______  before data collection? [ ]
   [ ] Registered Report, in-principle acceptance date: ______
   [ ] Not pre-registered - state this plainly, and list the
       analytic decisions made after seeing data:
         _______________________________________________________
   Hypotheses pre-specified: _________________________________
   Analyses pre-specified: ___________________________________

3. SAMPLE AND STOPPING
   Planned N: ______   Achieved N: ______
   Justification: [ ] power analysis, assumptions: ___________
                  [ ] precision target: ___________________
                  [ ] resource constraint, stated honestly
   Stopping rule, as applied: ________________________________
   [ ] Recruitment stopped at the planned point regardless of results

4. MEASURES AND CONDITIONS  (the most-admitted omission)
   All measures administered, including unanalysed ones:
     1. ______________________  analysed? [ ] yes [ ] no, in Suppl ___
     2. ______________________  analysed? [ ] yes [ ] no, in Suppl ___
     3. ______________________  analysed? [ ] yes [ ] no, in Suppl ___
   All conditions run, including those not reported in the main text:
     _________________________________________________________

5. EXCLUSIONS
   Criteria set in ADVANCE: __________________________________
   Cases meeting them: ______  reasons: _____________________
   Any FURTHER exclusions: ______  reasons: __________________
   [ ] No further cases were excluded (state this in the text)

6. RESULTS REPORTING
   [ ] Confirmatory analyses first, in the methods' order
   [ ] Exact test statistics, not thresholds
   [ ] Effect sizes with confidence intervals
   [ ] Exploratory analyses in a SEPARATELY HEADED subsection
   [ ] Exploratory findings framed as hypotheses in the discussion

7. GENERALITY AND AVAILABILITY
   Constraints on generality (sample, setting, materials, period):
     _________________________________________________________
   Data: [ ] open at ______________  [ ] restricted because ______
   Materials: [ ] open at ______________  [ ] restricted
   Analysis code: [ ] open at ______________  [ ] restricted
   Ethics approval and consent statement drafted: [ ]

Pubrica AcademyWritten and maintained by Pubrica’s subject matter experts. Articles are revised when the underlying standards change, and each article states the date on which it was last reviewed.

How Pubrica can help

Pubrica supports psychology manuscripts at the two stages that most influence review: the theoretical framing, where the emphasis is on the prediction and the disconfirming pattern rather than a list of citations, and the transparency reporting, where the manuscript is checked against the reviewer guidelines now used in the field — all measures reported, sample size justified, exclusions counted, confirmatory and exploratory analyses separated, and statistics reported with effect sizes and intervals.

Find something else

Search the Pubrica Academy

Access is free and requires no account. Enter a topic, or open the full library to filter by category, sub-topic or resource type.

Pre-submission review of manuscripts and protocols against transparency criteria

A scoping assessment is free and takes two business days. It provides a written assessment of what the work requires and which specialist would undertake it.

Get a free quote

Regulations

Check your project against this rule

  1. 1Your work
  2. 2Your details
  3. 3Send
What do you need?

Material you send is held under signed confidentiality, with access limited to the assigned team and encrypted transfer. It is not used to train anything and is not passed to third-party tools. Ask for the agreement before you send anything you would rather cover first.