Contents
Academy · Research Data Analytics & AI · AI in medical imaging
Artificial Intelligence in Medical Imaging Research: Demonstrated Capabilities and Evidence Gaps
Imaging artificial intelligence (AI) models perform well at narrow, well-defined tasks such as segmenting a structure, flagging a probable abnormality or performing a measurement that would otherwise be made visually. The principal evidential problem is not whether the technology works in principle but that most published studies have not evaluated it to the standard a clinical claim requires.
This article is intended for research that uses, validates or reports an imaging AI tool. It describes the tasks these models have been shown to perform well, the two reporting standards that now govern how such work is reported, and the areas in which the published evidence is commonly deficient.
Functions of imaging AI models
Clinical imaging AI predominantly performs one of three functions: segmentation of a structure on a scan (delineating an organ or lesion boundary), classification of an image (flagging a probable finding for human review), or continuous quantification, such as frame-by-frame estimation of left ventricular ejection fraction from an echocardiogram video. In routine practice, none of these tasks replaces clinical diagnosis independently; each functions as a measurement or triage aid within the clinician’s workflow.
Applicable reporting standards
TRIPOD+AI (Collins GS, et al. BMJ. 2024;385:e078378) governs the reporting of clinical prediction models developed with regression or machine-learning methods, including models that use imaging as an input to predict a future outcome or a current diagnosis. STARD-AI (Sounderajah V, et al. Nat Med. 2025) governs diagnostic-accuracy studies that use AI specifically, in which the question is how well the model distinguishes disease from its absence against a reference standard. A study that combines both (for example, an AI model predicting diagnosis from imaging, evaluated against pathology) may need to satisfy items from each.
Characteristics of a well-evidenced example
EchoNet-Dynamic (Ouyang D, et al. Nature. 2020;580:252–256) provides a useful reference point for rigorous external validation: a deep learning model that estimates ejection fraction beat by beat from echocardiogram video was tested against expert human measurements on a held-out Stanford set (mean absolute error 4.1%) and on an entirely separate Cedars-Sinai dataset (mean absolute error 6.0%), and a further prospective assessment showed that its repeat-measurement variance was comparable to or better than that of sonographers. The external, out-of-institution dataset is the critical feature, and it is the element that most published imaging-AI studies omit.
EchoNet-Dynamic’s own validation, two datasets
| Test set | What it was | Mean absolute error | AUC |
|---|---|---|---|
| Stanford (held-out) | Same institution as training data | 4.1% | 0.97 |
| Cedars-Sinai (external) | A wholly separate institution | 6.0% | 0.96 |
Source: Ouyang D, et al. Nature. 2020;580:252–256.
Common limitations of the published evidence
A systematic review of studies comparing deep learning against clinicians on medical imaging tasks (Nagendran M, et al. BMJ. 2020;368:m689) identified only 10 registered trials compared with 81 published non-randomised studies. Most of the non-randomised studies (61 of 81) reported AI performance comparable to or better than that of clinicians; few studies were prospective or conducted in a real clinical setting; and adherence to reporting standards was poor overall, with a generally high risk of bias. These findings do not indicate that the underlying technology is ineffective; rather, a claim in a single published paper provides, on its own, a weak basis for inferring that a tool will perform well in a new setting.
Source: Nagendran M, et al. BMJ. 2020;368:m689.
Implications for studies that use imaging AI tools
Considerations before relying on the output of an imaging AI tool
Frequently asked questions
No. TRIPOD+AI covers prediction models generally (estimating a future outcome, or a patient’s current condition, from inputs that may include imaging). STARD-AI covers diagnostic-accuracy studies specifically (how well a test, including an AI-read image, distinguishes disease from its absence against a confirmed reference standard). The applicable standard depends on the claim the study makes, not on the involvement of AI.
No. This is a substantive methodological distinction rather than a technicality: a second-reader or triage tool that a clinician can override requires different validation from a tool that makes an unreviewed decision. Neither STARD-AI nor TRIPOD+AI treats these roles as interchangeable, and a study should state explicitly which role the tool performed.
References
- Collins GS, Moons KGM, Dhiman P, et al. "TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods." read 8 October 2026. BMJ. 2024;385:e078378
- Sounderajah V, Guni A, Liu X, et al. "The STARD-AI reporting guideline for diagnostic accuracy studies using artificial intelligence." read 8 October 2026. Nat Med. 2025
- Nagendran M, Chen Y, Lovejoy CA, et al. "Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies." read 8 October 2026. BMJ. 2020;368:m689
- Ouyang D, He B, Ghorbani A, et al. "Video-based AI for beat-to-beat assessment of cardiac function." read 8 October 2026. Nature. 2020;580:252–256
Each source carries the date it was last read. Where a standard moves, this article is revised rather than left up with a note.
How to cite this article
Pick your referencing style and copy it. Your university or target journal may vary the punctuation — check its guide if it has one.
Pubrica Academy. (2026, October 8). Artificial Intelligence in Medical Imaging Research: Demonstrated Capabilities and Evidence Gaps. Pubrica. https://pubrica.com/academy/medical-writing/clinical-applications-of-machine-learning-in-radiology/
Pubrica Academy. “Artificial Intelligence in Medical Imaging Research: Demonstrated Capabilities and Evidence Gaps.” Pubrica, 8 Oct. 2026, pubrica.com/academy/medical-writing/clinical-applications-of-machine-learning-in-radiology/.
Pubrica Academy (2026) Artificial Intelligence in Medical Imaging Research: Demonstrated Capabilities and Evidence Gaps. Pubrica. Available at: https://pubrica.com/academy/medical-writing/clinical-applications-of-machine-learning-in-radiology/ (Accessed: 15 October 2026).
Pubrica Academy. “Artificial Intelligence in Medical Imaging Research: Demonstrated Capabilities and Evidence Gaps.” Pubrica. October 8, 2026. https://pubrica.com/academy/medical-writing/clinical-applications-of-machine-learning-in-radiology/
Pubrica Academy, ‘Artificial Intelligence in Medical Imaging Research: Demonstrated Capabilities and Evidence Gaps’ (Pubrica, 8 October 2026) <https://pubrica.com/academy/medical-writing/clinical-applications-of-machine-learning-in-radiology/> accessed 15 October 2026.
Pubrica Academy. Artificial Intelligence in Medical Imaging Research: Demonstrated Capabilities and Evidence Gaps. [Internet]. Pubrica; 2026 Oct 8 [cited 2026 Oct 15]. Available from: https://pubrica.com/academy/medical-writing/clinical-applications-of-machine-learning-in-radiology/
Pubrica Academy, “Artificial Intelligence in Medical Imaging Research: Demonstrated Capabilities and Evidence Gaps,” Pubrica, Oct. 8, 2026. [Online]. Available: https://pubrica.com/academy/medical-writing/clinical-applications-of-machine-learning-in-radiology/
@misc{clinical_applications_of_machine_learn_2026,
author = {{Pubrica Academy}},
title = {Artificial Intelligence in Medical Imaging Research: Demonstrated Capabilities and Evidence Gaps},
howpublished = {Pubrica},
year = {2026},
month = {oct},
url = {https://pubrica.com/academy/medical-writing/clinical-applications-of-machine-learning-in-radiology/},
note = {Accessed: <span data-cite-acc="iso">2026-10-15</span>}
}This article is written to be learned from. Cite it if you are referring to what it says; if you are using the evidence behind it, cite the sources listed above instead.
Pubrica AcademyWritten and maintained by Pubrica’s subject matter experts. Articles are revised when the underlying standards change, and each article states the date on which it was last reviewed.
How Pubrica can help
Pubrica’s biostatistics and medical writing teams determine which reporting standard applies to an AI-related claim before drafting, and write the methods and results sections to satisfy it item by item.