Free scoping read. A written assessment of your manuscript in two business days, at no cost.

Start one
Contents

On this page

  1. Threats addressed by internal validity
  2. Trade-offs between internal and external validity
  3. Reporting requirements for judging external validity

Academy · Research Data, Analytics & AI · Internal vs external validity

Internal Versus External Validity in Clinical Trials: Rigour, Generalisability and Reporting

A tightly controlled trial may produce a result that is fully valid for the patients it enrolled while providing limited information about the patients encountered in routine clinical practice. This article examines the distinction between internal and external validity and the reporting needed to assess generalisability.

Pubrica AcademyWritten by a clinical epidemiologist Reviewed bya biostatistician Published10 October 2026 Last checked10 October 2026 Reading time7 minutes Sources1 peer-reviewed

Internal validity is the extent to which a study’s result accurately reflects the true effect within the study population itself, free from bias and confounding. External validity is the extent to which that result generalises to other populations and settings. A study can have strong internal validity and weak external validity, or vice versa.

Learning objectives

  • Why the design choices that strengthen internal validity often narrow external validity.
  • What should be reported to enable readers to judge a trial’s external validity.
  • Why external validity cannot be assumed on the basis of strong internal validity.

Common misconceptions

  • “A trial with rigorous methodology (randomisation, blinding, strict protocol) applies automatically to patients in routine practice.” Rothwell argues that the features that strengthen internal validity (narrow eligibility criteria, highly protocolised care, intensive monitoring, selected investigator sites) frequently narrow the population and setting in which the result was generated; strong internal validity does not, by itself, establish that the result generalises.
  • “External validity is a binary property of a trial.” Rothwell frames external validity as a question of degree and specificity, namely to whom, and in what setting, the results apply. This depends on comparing the trial’s eligibility criteria, population characteristics and care setting with the specific patients to whom a reader intends to apply the result, rather than on a general judgement about the trial as a whole.

Threats addressed by internal validity

Internal validity concerns whether the observed association or effect within the study is real and not an artefact of bias, confounding or chance; the features that protect it include randomisation, blinding, pre-specified analysis and complete follow-up. A trial can have excellent internal validity (the result is a true reflection of what happened in that specific study population) while leaving open the question of whether that population resembles other populations1.

Trade-offs between internal and external validity

Rothwell describes a structural tension: narrow eligibility criteria reduce heterogeneity and strengthen internal validity by producing a cleaner comparison, but the same narrowing restricts the population to which the result can be confidently extended. Highly protocolised trial care, delivered at specialist sites with close monitoring, likewise strengthens internal validity while diverging from the way in which the treatment will be delivered in routine practice1.

Reporting requirements for judging external validity

Rothwell recommends that trials report their eligibility criteria in detail, the proportion of screened patients who were eligible and enrolled, baseline characteristics compared against the broader disease population where data exist, and the specific care setting and level of monitoring used, thereby giving readers the information needed to judge whether the trial population and setting resemble the patients to whom they intend to apply the result, rather than asserting generalisability as a conclusion1.

Key points

Key points

Internal validity concerns whether a trial’s result is true for its own population; external validity concerns whether the result generalises to other populations and settings. Because strengthening internal validity often narrows external validity, a trial should report the details that enable readers to judge generalisability, rather than generalisability being assumed from sound design.

Practical application

Practical application

  1. Eligibility criteria and screening and enrolment numbers should be reported in full. The proportion of screened patients who were eligible and enrolled should be reported so that readers can judge how selected the population was.
  2. Trial population characteristics should be compared with those of the broader disease population where data exist. Registry or epidemiological data showing how the trial population compares with the wider patient population should be cited where available.
  3. The care setting and intensity of monitoring should be described explicitly. Authors should state whether care was delivered under conditions approximating routine practice or under intensive, protocol-driven monitoring unlikely to be replicated outside the trial.

Frequently asked questions

Pragmatic trials, designed to reflect routine clinical practice more closely, can improve external validity, but they typically involve a trade-off against some aspects of internal validity (such as less intensive monitoring), which should itself be reported and discussed.

Not with a single statistic; it is typically assessed qualitatively by comparing the trial’s reported population and setting characteristics against the population and setting of interest.

No; it applies equally to any intervention study, including behavioural, surgical, diagnostic and public-health interventions, wherever the trial setting or population may differ from the intended application.

References

  1. Rothwell PM. External validity of randomised controlled trials: "to whom do the results of this trial apply?" The Lancet. 2005;365(9453):82-93. read 10 October 2026. View on PubMed

Every source above is a peer-reviewed article, a publisher’s record of one, or a standard issued by the body that owns it. Each carries the date it was last read. Where a standard moves, this article is revised rather than left up with a note.

How to cite this article

Pick your referencing style and copy it. Your university or target journal may vary the punctuation — check its guide if it has one.

Pubrica Academy. (2026, October 10). Internal Versus External Validity in Clinical Trials: Rigour, Generalisability and Reporting. Pubrica. https://pubrica.com/academy/concepts-definitions/internal-vs-external-validity/

This article is written to be learned from. Cite it if you are referring to what it says; if you are using the evidence behind it, cite the sources listed above instead.

External-validity reporting check

This checklist applies to the drafting of the discussion and limitations sections.

[ ] Eligibility criteria reported in full
[ ] Screening and enrolment numbers reported (eligible vs enrolled)
[ ] Trial population compared against broader disease population where data exists
[ ] Care setting and monitoring intensity described explicitly
[ ] Generalisability discussed with specifics, not asserted as a blanket conclusion

Pubrica AcademyWritten and maintained by Pubrica’s subject matter experts. Articles are revised when the underlying standards change, and each article states the date on which it was last reviewed.

How Pubrica can help

Pubrica assists authors in reporting the eligibility, enrolment and setting details that enable readers to judge a trial’s external validity, rather than leaving generalisability as an unstated assumption.

Submit an enquiry Get your trial's generalisability reporting checked

Explore

Related Academy articles

Selected from the same topic and category, with the most recent first.

Article

The Impact of Electronic Health Records on Research

What electronic health records change about research data, the five quality dimensions reviewers check, and what FDA real-world-data guidance expects…

10 October 2026 · 10 min read

Article

Adverse Drug Effects: Definition and Classification

The precise difference between an adverse event and an adverse drug reaction, the standard mechanistic classification, and why causality has to be…

10 October 2026 · 8 min read

Article

What Post-Marketing Surveillance Is

What post-marketing surveillance is, why pre-approval trials cannot detect every safety signal, the ICH E2E pharmacovigilance planning framework, and…

10 October 2026 · 8 min read

Find something else

Search the Pubrica Academy

Access is free and requires no account. Enter a topic, or open the full library to filter by category, sub-topic or resource type.

Aligning generalisability claims with what the trial supports

A scoping assessment is free and takes two business days. It provides a written assessment of what the work requires and which specialist would undertake it.

Get a free quote Ask about your own case
Get a free quote

Regulations

Check your project against this rule

  1. 1Your work
  2. 2Your details
  3. 3Send
What do you need?

Material you send is held under signed confidentiality, with access limited to the assigned team and encrypted transfer. It is not used to train anything and is not passed to third-party tools. Ask for the agreement before you send anything you would rather cover first.