Contents
On this page
- Effect of open-data badges on author submissions
- Effectiveness of submission-stage policies relative to general appeals
- The TOP Guidelines: standards beyond a single badge
- Mandatory data-sharing statements in medicine
- Limitations of badges as a general solution
- Preregistration, registered reports and publication bias
- Implications for journal selection
Academy · Research Publication · Submission Strategies & Open Research
The Influence of Journal Submission Strategies on Authors and on Open Research Practices
After a leading psychology journal began awarding a badge for data sharing, the proportion of its articles with publicly posted datasets rose from approximately 3% to 39% in under two years. This is a rare documented case of a journal policy changing author behaviour.
A journal submission strategy is any policy that a journal attaches to the act of submission itself rather than to peer review after submission: a requirement to deposit data, a badge that rewards doing so, a registered-reports track, or a mandatory data-availability statement. The distinguishing feature of these policies is timing. They operate at the point of submission, before a manuscript has been reviewed or accepted, and therefore shape what authors decide to do with their underlying data and materials rather than merely auditing what authors have already done. The best-documented test of whether such a policy is effective comes from psychology, where one journal's adoption of open-practice badges was followed by a measurable, sustained change in author behavior that voluntary appeals for open science had not achieved.
Learning objectives
- The nature of open-practice badges, and why they operate at the submission stage rather than after review
- The measured size of the shift in data-sharing rates before and after a journal adopted badges
- Why submission-stage incentives changed behaviour more rapidly than field-wide appeals for open science
Common misconceptions
- “Open-science badges are symbolic and are largely ignored by authors.” At Psychological Science, the proportion of empirical articles reporting publicly accessible data rose from approximately 3% in the two years before badges were adopted to 39% in the first half of 2015, while comparison journals without badges showed no corresponding increase over the same period.
Effect of open-data badges on author submissions
In 2016, a research team led by Mallory Kidwell at the Center for Open Science published a direct test of whether badges increase data sharing in practice rather than in principle1. The study coded 2,478 empirical articles published in Psychological Science between January 2012 and May 2015, a period spanning the introduction in January 2014 of an “Open Data” badge awarded to articles that made their underlying data publicly available. In the two years before badges were introduced, approximately 3% of the journal's empirical articles reported publicly accessible data. By the first half of 2015, the last period covered by the study, that proportion had reached 39%1. Comparison journals in the same field that had not adopted badges showed no equivalent rise in data-sharing rates over the same period; this finding distinguishes the effect from a broader cultural trend coinciding with the policy change1.
Effectiveness of submission-stage policies relative to general appeals
Before badges existed, the open-science movement had spent several years urging researchers to share data voluntarily, with comparatively little effect on sharing rates at most journals1. What changed with badges was not the argument for sharing data but the point at which the decision was made. Earning a badge required an author to deposit data in a trusted location and to have that deposit verified at the point of submission and acceptance, which converted a discretionary, easily deferred good practice into a concrete step embedded in the publication workflow the author was already following1. This structural placement, within the submission process rather than appended to it, is the feature that other policies seek to replicate: data-availability statements required by a manuscript tracking system, registered-reports tracks that fix a study design before results exist, and preregistration fields that a submission portal does not permit an author to omit.
The TOP Guidelines: standards beyond a single badge
Badges are one implementation of a broader framework. In 2015, a group of 35 editors, funders, and researchers convened by the Center for Open Science published the Transparency and Openness Promotion (TOP) Guidelines in Science, setting out eight separate standards that a journal can adopt at submission: citation standards for data and code, data transparency, analytic-methods transparency, materials transparency, design and analysis transparency, preregistration of studies, preregistration of analysis plans, and recognition of replication2. Each standard has three graduated levels of stringency, so that a journal can require disclosure, require sharing with limited exceptions, or require full sharing verified before publication2. A separate, closely related framework, the FAIR principles published by Wilkinson and more than fifty co-authors in Scientific Data the following year, specifies that shared data should be Findable, Accessible, Interoperable and Reusable, providing journals and repositories with a common technical vocabulary for the characteristics that “available data” must have, rather than leaving the term to each author's interpretation6. Together, TOP and FAIR describe the range of submission-stage mechanisms of which a badge is only the simplest instance.
Mandatory data-sharing statements in medicine
Biomedical publishing moved from optional incentive to formal requirement over approximately the same period. The International Committee of Medical Journal Editors (ICMJE) announced that, as of 1 July 2018, any manuscript reporting clinical trial results submitted to an ICMJE-member journal must include a data-sharing statement, and that any trial beginning enrollment on or after 1 January 2019 must register its data-sharing plan at the point of trial registration, using dedicated “Plan to Share IPD?” and “Plan Description” fields3. The U.S. National Institutes of Health subsequently introduced its own Data Management and Sharing (DMS) Policy, effective for applications submitted on or after 25 January 2023, which requires a DMS plan to be submitted with every funding application and links future funding decisions to whether the awardee follows the plan it submitted7. Despite this movement toward mandates, a 2017 survey of the policies of 318 biomedical journals found that the landscape was still mixed at that time: only 11.9% required data sharing as a condition of publication, 23.3% encouraged it without requiring it, and 31.8% did not mention data sharing in their policies at all8. Authors should therefore establish which category a target journal falls into rather than assuming that a mandate applies.
Limitations of badges as a general solution
The Kidwell badge result at Psychological Science is an observational before-and-after comparison, and a later randomized controlled trial (RCT) tested the same mechanism more rigorously, with a different result. Rowhani-Farid, Aldcroft, and Barnett conducted an RCT at BMJ Open, randomly offering an open-data badge to 80 accepted research articles while 80 others received no offer, and found essentially no effect: two datasets were shared in each arm, an odds ratio of 0.9 with a 95% confidence interval of 0.1 to 9.0, consistent with no detectable difference9. This contrast bears on how the original finding should be interpreted. Psychological Science's badge was introduced into a field, psychology, already sensitised by a public reproducibility crisis and active disciplinary debate about data sharing, whereas the RCT tested the same mechanism in a general medical-journal population without comparable cultural momentum. The effectiveness of a submission-stage incentive appears to depend substantially on the surrounding disciplinary context and not only on the mechanism itself; any single badge study should therefore be treated as a bounded result rather than a general law of author behavior.
Preregistration, registered reports and publication bias
Submission-stage policy also shapes which results are published, not only whether data are archived. In the Registered Reports model, authors submit the introduction, hypotheses and methods of a study for peer review and in-principle acceptance before data collection, which removes the incentive to report only those studies that produced a clear, significant result. Scheel, Schijen, and Lakens directly compared this model with the standard literature in 2021 and found a marked difference: 96% of hypothesis tests in a sample of standard psychology publications reported a positive, hypothesis-confirming result, compared with only 44% among Registered Reports5. This difference is consistent with the broader finding of the 2015 Reproducibility Project, in which the Open Science Collaboration attempted to replicate 100 psychology studies and found that only 36% of the replications reproduced a statistically significant effect, compared with 97% of the original studies10. There is also a measurable association with benefit for authors who comply with data-transparency requirements: Colavizza and colleagues, analyzing more than half a million PubMed Open Access articles, found that papers linking to data in a recognized repository had a citation advantage of approximately 25% on average, although the authors note that this is a correlation rather than a demonstrated causal effect of sharing itself4.
Implications for journal selection
Because the badge effect was specific to the journal that implemented it and did not extend to comparable journals without the policy, the submission-stage requirements of a journal constitute a genuine, journal-specific signal rather than a generic feature of a field or discipline1. Two journals in the same subfield, with similar scope and readership, can impose very different practical obligations and yield very different levels of transparency once a manuscript is published. Authors should therefore check the open-practice requirements of a target journal before submission rather than after acceptance, because badges, data-availability mandates and registered-reports tracks all require preparation (repository selection, data cleaning, documentation) that is considerably easier to incorporate into a project timeline early than to add under revision deadlines.
Key points
Key points
Submission-stage incentives such as open-practice badges have been shown to change author behaviour at the journals that adopt them. A target journal’s data-sharing policy should therefore be regarded as an indicator of its rigour rather than as an administrative requirement to be addressed later.
Practical application
Practical application
- The data policy of the target journal should be checked before submission. Authors should look specifically for badges, mandatory data availability statements or a registered reports track, and establish what verification each requires.
- Data and materials should be prepared for deposit at an early stage. Repository deposit and documentation should be incorporated into the project timeline so that the work qualifies for an incentive, rather than being prepared hurriedly after acceptance.
- The strength of a journal’s policy should be considered when two journals are otherwise comparable. Where scope and readership are similar, a journal that verifies compliance with open practices provides published work with a stronger, verifiable evidence trail.
Frequently asked questions
They were verified. Center for Open Science staff confirmed that a repository link existed and that the data were accessible before a badge was awarded, which partly explains why the measured increase reflected actual archiving behavior rather than self-reported claims.
The badge study did not report submission-to-decision timelines, so no verified figure exists in either direction; the practical cost lies mainly in the author time required in advance to prepare a repository deposit, which is manageable if planned before the manuscript is completed rather than afterwards.
Not necessarily. A randomized controlled trial at BMJ Open found essentially no effect of offering the same type of badge (odds ratio 0.9), so the effectiveness of the mechanism appears to depend on the surrounding field and culture rather than being a universal result.
No. ICMJE and NIH policies require authors to state a plan or disclose their sharing status, but a 2017 survey found that the policies of many biomedical journals still only encouraged rather than required sharing, so the presence of a statement does not guarantee that the underlying data are deposited or usable.
References
- Kidwell MC, Lazarević LB, Baranski E, Hardwicke TE, Piechowski S, Falkenberg LS, Kennett C, Slowik A, Sonnleitner C, Hess-Holden C, Errington TM, Fiedler S, Nosek BA. Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency. PLOS Biology. 2016;14(5):e1002456. read 10 October 2026. View on PLOS Biology
- Nosek BA, Alter G, Banks GC, et al. Promoting an open research culture. Science. 2015;348(6242):1422-1425. read 10 October 2026. View on Science
- Taichman DB, Backus J, Baethge C, et al. Sharing Clinical Trial Data: A Proposal from the International Committee of Medical Journal Editors. 2016, with requirement effective 1 July 2018. read 10 October 2026. View on ICMJE
- Colavizza G, Staden I, Whitaker K, McGillivray B, Hrynaszkiewicz I. The citation advantage of linking publications to research data. PLOS ONE. 2020;15(4):e0230416. read 10 October 2026. View on PLOS ONE
- Scheel AM, Schijen MRMJ, Lakens D. An Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports. Advances in Methods and Practices in Psychological Science. 2021;4(2). read 10 October 2026. View on AMPPS
- Wilkinson MD, Dumontier M, Aalbersberg IJ, et al. The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data. 2016;3:160018. read 10 October 2026. View on Scientific Data
- National Institutes of Health. NIH Data Management and Sharing Policy, effective 25 January 2023. read 10 October 2026. View on NIH
- Vasilevsky NA, Minnier J, Haendel MA, Champieux RE. Reproducible and reusable research: are journal data sharing policies meeting the mark? PeerJ. 2017;5:e3208. read 10 October 2026. View on PeerJ
- Rowhani-Farid A, Aldcroft A, Barnett AG. Did awarding badges increase data sharing in BMJ Open? A randomized controlled trial. Royal Society Open Science. 2020;7(3):191818. read 10 October 2026. View on Royal Society Open Science
- Open Science Collaboration. Estimating the reproducibility of psychological science. Science. 2015;349(6251):aac4716. read 10 October 2026. View on Science
Every source above is a peer-reviewed article, a publisher’s record of one, or a standard issued by the body that owns it. Each carries the date it was last read. Where a standard moves, this article is revised rather than left up with a note.
How to cite this article
Pick your referencing style and copy it. Your university or target journal may vary the punctuation — check its guide if it has one.
Pubrica Academy. (2026, October 10). The Influence of Journal Submission Strategies on Authors and on Open Research Practices. Pubrica. https://pubrica.com/academy/concepts-definitions/the-influence-of-journal-submission-strategies-on-authors-and-use-of-open-research-journals/
Pubrica Academy. “The Influence of Journal Submission Strategies on Authors and on Open Research Practices.” Pubrica, 10 Oct. 2026, pubrica.com/academy/concepts-definitions/the-influence-of-journal-submission-strategies-on-authors-and-use-of-open-research-journals/.
Pubrica Academy (2026) The Influence of Journal Submission Strategies on Authors and on Open Research Practices. Pubrica. Available at: https://pubrica.com/academy/concepts-definitions/the-influence-of-journal-submission-strategies-on-authors-and-use-of-open-research-journals/ (Accessed: 15 October 2026).
Pubrica Academy. “The Influence of Journal Submission Strategies on Authors and on Open Research Practices.” Pubrica. October 10, 2026. https://pubrica.com/academy/concepts-definitions/the-influence-of-journal-submission-strategies-on-authors-and-use-of-open-research-journals/
Pubrica Academy, ‘The Influence of Journal Submission Strategies on Authors and on Open Research Practices’ (Pubrica, 10 October 2026) <https://pubrica.com/academy/concepts-definitions/the-influence-of-journal-submission-strategies-on-authors-and-use-of-open-research-journals/> accessed 15 October 2026.
Pubrica Academy. The Influence of Journal Submission Strategies on Authors and on Open Research Practices. [Internet]. Pubrica; 2026 Oct 10 [cited 2026 Oct 15]. Available from: https://pubrica.com/academy/concepts-definitions/the-influence-of-journal-submission-strategies-on-authors-and-use-of-open-research-journals/
Pubrica Academy, “The Influence of Journal Submission Strategies on Authors and on Open Research Practices,” Pubrica, Oct. 10, 2026. [Online]. Available: https://pubrica.com/academy/concepts-definitions/the-influence-of-journal-submission-strategies-on-authors-and-use-of-open-research-journals/
@misc{/la_journal_submission_strategies_open_research_2026,
author = {{Pubrica Academy}},
title = {The Influence of Journal Submission Strategies on Authors and on Open Research Practices},
howpublished = {Pubrica},
year = {2026},
month = {oct},
url = {https://pubrica.com/academy/concepts-definitions/the-influence-of-journal-submission-strategies-on-authors-and-use-of-open-research-journals/},
note = {Accessed: <span data-cite-acc="iso">2026-10-15</span>}
}This article is written to be learned from. Cite it if you are referring to what it says; if you are using the evidence behind it, cite the sources listed above instead.
Open-Practices Readiness Checklist
This checklist should be completed before submission to a journal that rewards or requires open data or materials.
[ ] Confirmed whether the target journal offers badges, requires a data-availability statement, or runs a registered-reports track [ ] Identified a trusted repository for your data type (field-specific repository or a general one) [ ] Cleaned and documented the dataset so it is usable by someone outside the research team [ ] Checked the journal's exact verification process and timeline for awarding a badge or confirming a statement [ ] Flagged any data that cannot be shared (consent, licensing, sensitive data) and prepared a justification
Pubrica AcademyWritten and maintained by Pubrica’s subject matter experts. Articles are revised when the underlying standards change, and each article states the date on which it was last reviewed.
How Pubrica can help
Pubrica’s publication support team assists authors in mapping a target journal’s open-practice requirements against their dataset before submission, so that repository deposits and data availability statements are prepared in advance rather than after acceptance.