Free scoping read. A written assessment of your manuscript in two business days, at no cost.

Start one
Contents

Academy · Research Promotion · Measuring & Expanding Research Impact

Research Impact: Measuring and Extending the Reach of Published Research

The Leiden Manifesto and the San Francisco Declaration on Research Assessment both caution against reducing research impact to a single citation count, while altmetrics research indicates that plain-language and visual summaries measurably extend the reach of a study beyond readers who would have located it through a database search. This article examines how impact is measured and which dissemination formats are associated with wider reach.

Pubrica AcademyWritten by a research dissemination writer Reviewed bya research metrics reviewer Published10 October 2026 Last checked10 October 2026 Reading time8 minutes Sources10 peer-reviewed

Research impact is the demonstrable effect of a study beyond its publication: on the scholarly record through citations, on practice and policy through uptake by practitioners or decision-makers, and on the public through awareness and understanding. Two factors complicate its measurement. First, no single metric captures all three dimensions, which is why metrics-reform initiatives such as the Leiden Manifesto and the San Francisco Declaration on Research Assessment (DORA) explicitly warn against reducing impact to a single number. Second, impact beyond the immediate academic audience increasingly depends on deliberate dissemination choices, such as plain-language summaries, visual abstracts and structured outreach, rather than occurring automatically once a paper is indexed.

Learning objectives

  • Why major metrics-reform initiatives now explicitly discourage citation-based metrics alone as a measure of research quality or impact
  • What altmetrics measure, and how they differ from citation counts
  • Which dissemination formats have documented associations with increased reach

Common misconceptions

  • “The impact of a paper is essentially its citation count or the impact factor of its journal.” The San Francisco Declaration on Research Assessment, signed by thousands of individuals and organisations including major funders and publishers, explicitly calls for the elimination of journal-based metrics such as the impact factor from funding, appointment and promotion decisions, on the grounds that such metrics measure the average citation performance of a journal rather than the contribution of any individual paper.

Reasons for discouraging reliance on citation-based metrics alone

The San Francisco Declaration on Research Assessment (DORA), first published in 2012 and since signed by thousands of researchers, institutions, funders and publishers, states its core recommendation directly: journal-based metrics, such as Journal Impact Factors, should not be used as a surrogate measure of the quality of individual research articles, to assess an individual scientist’s contributions, or in hiring, promotion or funding decisions1. The Leiden Manifesto for Research Metrics, published by Hicks, Wouters and colleagues in Nature in 2015, sets out ten principles for the responsible use of quantitative indicators, including that quantitative evaluation should support, not supplant, qualitative expert assessment, and that indicators must be normalised by field, since citation practices and typical citation counts vary considerably between disciplines2. Both documents exist because citation counts and journal-level metrics measure one specific quantity, namely how often a paper is formally cited by other scholarly outputs within an academic citation window, which is a meaningful but partial proxy for the scholarly, practical or societal impact of a study.

What altmetrics measure and their limitations

Altmetrics (alternative metrics) track attention to a research output outside the traditional citation record: mentions in news coverage, policy documents and social media, saves in reference managers such as Mendeley, and discussion on platforms such as X (formerly Twitter) or specialist blogs. The original altmetrics manifesto by Priem and colleagues proposed these signals as a faster, more immediate complement to citations, which can take years to accumulate, rather than as a replacement for them3. This distinction is important in practice: a high altmetric score indicates that a piece of research attracted attention quickly, which is useful evidence of reach and public engagement, but attention is not equivalent to scholarly validation or to citation by other researchers building on the work, and altmetrics providers themselves caution against treating their scores as a measure of quality for this reason.

Societal and policy impact beyond the citation record

Scholarly citation and public attention are not the only dimensions of impact recognised by formal evaluation frameworks; a third dimension, impact on practice, policy or society, is assessed separately because it does not necessarily correlate with either citation counts or altmetric attention. The Research Excellence Framework (REF) of the United Kingdom, which evaluates university research for the allocation of government funding, defines impact as “an effect on, change or benefit to the economy, society, culture, public policy or services, health, the environment or quality of life, beyond academia,” and requires institutions to submit detailed case studies evidencing such real-world effects, separately from and in addition to any assessment of the academic quality of the underlying research6. The review by Penfield and colleagues of how research impact is defined and assessed across frameworks found that most formal definitions converge on the same core idea, a demonstrable effect beyond the academic community, while differing considerably on how directly that effect must be attributable to a specific piece of research rather than to a broader body of work7. In practice, a study can therefore have negligible citation counts and modest altmetric attention while still demonstrating strong policy or practice impact, for instance by directly informing a specific clinical guideline or government policy decision, which is why REF-style frameworks evaluate such impact through a dedicated category of evidence rather than inferring it from citation or attention metrics. Demonstrating this kind of impact typically requires its own evidence trail, such as documented correspondence with a policymaker, a citation in a guideline or a changed clinical protocol, gathered deliberately over the course of a research programme rather than reconstructed retrospectively when an assessment deadline approaches; for this reason, institutions that take impact assessment seriously now incorporate such tracking into project management from an early stage rather than treating it as a documentation exercise undertaken only after the fact.

The time required for scholarly impact to accumulate

Citation-based impact accumulates on a different timeline from altmetric attention, which is a structural reason that the two signals diverge rather than measuring the same quantity at different speeds. The methodological review by Bornmann and Daniel of what citation counts measure notes that citation accumulation depends on other researchers completing, writing up and publishing their own studies, a process that typically unfolds over several years after the cited work first appeared; consequently, a paper’s citation count one or two years after publication substantially understates its eventual scholarly influence8. This is part of the reason that journal-level metrics such as the two-year Journal Impact Factor are considered particularly crude substitutes for the quality of an individual paper: an important paper in a field with slower citation accumulation can appear unremarkable within any metric’s narrow citation window, which is precisely the kind of field-normalisation problem that the principles of the Leiden Manifesto are designed to address2. In practice, a researcher assessing the citation-based impact of their own paper should treat an early, modest citation count with caution rather than as a final verdict, comparing it with the typical accumulation curve for the specific discipline rather than with a generic benchmark that disregards field.

Dissemination formats with a documented effect on reach

Because impact beyond citations depends partly on whether non-specialist audiences can access and understand a study, format is important. Research on plain-language summaries, which a growing number of funders and journals require for lay audiences, has found that structured summaries with reduced jargon measurably improve comprehension among non-expert readers compared with technical abstracts; this is the basis for Cochrane’s long-standing requirement that every systematic review include a plain-language summary alongside its technical abstract4. Visual and graphical abstracts, now accepted or required by many journals, including those published by Elsevier and Cell Press, are intended to enable a reader to grasp the core finding of a study within the time taken to scroll past it on a results page or social media feed, providing an entry point to the paper different from a dense text abstract5. None of these formats substitutes for the substance of the underlying research, but each addresses a specific, documented barrier, whether jargon, density or scanning speed, between a completed study and a wider audience that might otherwise never read it.

The documented relationship between open access and reach

Whether a paper is freely accessible on publication is itself a factor with a measurable relationship to how widely it is read and cited, independent of the dissemination formats discussed above. The large-scale analysis by Piwowar and colleagues of the prevalence and impact of open-access articles, covering millions of journal articles, found that open-access articles, including those made freely available through repositories as well as those in fully open-access journals, were accessed and cited at higher rates on average than comparable paywalled articles, a pattern the authors attribute at least partly to the removal of a practical barrier, the paywall, between a reader’s interest and the content of the paper9. This finding is directly relevant to any deliberate impact strategy: choosing an open-access venue, or depositing an accepted manuscript in an institutional or subject repository where funder or publisher policy permits, is one of the few structural choices available to an author before publication that has a documented association with greater subsequent reach, independent of any dissemination materials produced afterwards.

Key points

Key points

No single number captures research impact. Citation-based journal metrics are explicitly discouraged by DORA and the Leiden Manifesto as a proxy for quality, altmetrics measure attention rather than validation, and formats such as plain-language and visual summaries have a documented and specific role in bridging the gap between a published study and audiences who would otherwise not find or understand it.

Practical application

Practical application

  1. The journal impact factor should not be cited as evidence of the quality of a specific paper. In line with the explicit recommendation of DORA, individual papers should be assessed and presented on the basis of their own methodology and findings rather than the average citation performance of the journal in which they were published.
  2. Altmetrics and citations should be tracked as separate, complementary signals. Altmetrics indicate early attention and reach, whereas citations indicate longer-term scholarly uptake; neither should be substituted for the other when impact is reported.
  3. Every technical abstract should be accompanied by a plain-language version for broader audiences. Following the Cochrane model, a structured summary with reduced technical terminology extends the reach of a study to practitioners, patients and policymakers who would not engage with the technical abstract.

Frequently asked questions

No. Altmetrics track attention, such as mentions in news, social media and policy documents, rather than scholarly validation. A study can receive substantial media attention for reasons unrelated to its methodological rigour, which is why altmetrics are best used alongside, not instead of, citation-based and peer assessment of quality.

It sets out ten principles for the responsible use of research metrics, including that quantitative indicators should support rather than replace expert judgement, that metrics should be normalised for field-specific citation practices, and that the data and methods underlying any metric should be open to verification.

No, but the practice has spread well beyond its origin in Cochrane systematic reviews; many funders and an increasing number of journals across disciplines now request or require one, in order to make findings accessible to non-specialist readers, including patients, practitioners and policymakers.

Citation accumulation is inherently slow, since it depends on other researchers writing, submitting and publishing papers that cite the original work, a process that typically extends over several years; this is a central reason that altmetrics researchers proposed faster, complementary signals based on attention.

Large-scale analyses, including the study of open-access prevalence by Piwowar and colleagues, found that open-access articles were accessed and cited at higher average rates than comparable paywalled articles, consistent with the view that removing a paywall increases the pool of readers able to access and build on the work.

References

  1. Declaration on Research Assessment (DORA). San Francisco Declaration on Research Assessment. read 10 October 2026. View the DORA Declaration
  2. Hicks D, Wouters P, Waltman L, de Rijcke S, Rafols I. Bibliometrics: The Leiden Manifesto for research metrics. Nature. 2015;520(7548):429-431. read 10 October 2026. View on Nature
  3. Priem J, Taraborelli D, Groth P, Neylon C. Altmetrics: A Manifesto. 2010. read 10 October 2026. View the Altmetrics Manifesto
  4. Cochrane. Plain Language Summaries in Cochrane Reviews. read 10 October 2026. View Cochrane Guidance on Plain Language Summaries
  5. Elsevier. Graphical Abstracts: Author Guidance. read 10 October 2026. View Elsevier Graphical Abstract Guidance
  6. Research England. Research Excellence Framework (REF) 2021: Panel Criteria and Working Methods. read 10 October 2026. View REF Panel Criteria and Working Methods
  7. Penfield T, Baker MJ, Scoble R, Wykes MC. Assessment, evaluations, and definitions of research impact: A review. Research Evaluation. 2014;23(1):21-32. read 10 October 2026. View on Research Evaluation
  8. Bornmann L, Daniel HD. What do citation counts measure? A review of studies on citing behavior. Journal of Documentation. 2008;64(1):45-80. read 10 October 2026. View on Journal of Documentation
  9. Piwowar H, Priem J, Larivière V, et al. The state of OA: a large-scale analysis of the prevalence and impact of Open Access articles. PeerJ. 2018;6:e4375. read 10 October 2026. View on PeerJ
  10. Björk BC. Open access to scientific publications: an analysis of the barriers to change. Information Research. 2004;9(2). read 10 October 2026. View on Information Research

Every source above is a peer-reviewed article, a publisher’s record of one, or a standard issued by the body that owns it. Each carries the date it was last read. Where a standard moves, this article is revised rather than left up with a note.

How to cite this article

Pick your referencing style and copy it. Your university or target journal may vary the punctuation — check its guide if it has one.

Pubrica Academy. (2026, October 10). Research Impact: Measuring and Extending the Reach of Published Research. Pubrica. https://pubrica.com/academy/study-guide/research-impact/

This article is written to be learned from. Cite it if you are referring to what it says; if you are using the evidence behind it, cite the sources listed above instead.

Research Impact Dissemination Checklist

This checklist may be used when planning how to extend the reach of a completed study beyond its primary publication.

[ ] Confirmed whether the target journal or funder requires a plain-language summary
[ ] Drafted a graphical or visual abstract if the journal accepts one
[ ] Separated altmetric tracking (attention) from citation tracking (scholarly uptake) in your own reporting
[ ] Avoided citing journal impact factor as a stand-in for the quality of a specific paper
[ ] Identified practitioner, patient, or policy audiences the plain-language version should specifically reach

Pubrica AcademyWritten and maintained by Pubrica’s subject matter experts. Articles are revised when the underlying standards change, and each article states the date on which it was last reviewed.

How Pubrica can help

Pubrica’s research promotion team produces plain-language summaries, graphical abstracts and other dissemination formats aligned with funder and journal requirements, extending the reach of published work to audiences beyond the original citation record.

Find something else

Search the Pubrica Academy

Access is free and requires no account. Enter a topic, or open the full library to filter by category, sub-topic or resource type.

Extending the reach of published research beyond its existing citing audience

A scoping assessment is free and takes two business days. It provides a written assessment of what the work requires and which specialist would undertake it.

Get a free quote

Regulations

Check your project against this rule

  1. 1Your work
  2. 2Your details
  3. 3Send
What do you need?

Material you send is held under signed confidentiality, with access limited to the assigned team and encrypted transfer. It is not used to train anything and is not passed to third-party tools. Ask for the agreement before you send anything you would rather cover first.