The opportunities
Scale in integrity work. Checks that could never be run manually across every submission can now be run across all of them.
Speed. Faster triage and production shorten time to publication, which matters most for findings with clinical consequences.
Accessibility. Language support lowers a barrier that has disadvantaged non-native English authors for decades — the clearest equity gain available.
Discovery. Better search and summarisation across a literature growing faster than anyone can read.
Synthesis. Screening support in systematic reviews, where workload is the main constraint.
The challenges
Fabrication at scale. Paper mills can now generate plausible manuscripts, including figures, faster than they can be screened. The asymmetry favours the attacker.
Fabricated citations entering the literature, and being cited onward once published.
Unreliable detection, with false accusations falling on exactly the authors least able to contest them.
Opacity. Where automated systems influence editorial decisions, authors may not know it happened or have a route to appeal.
Bias inherited from training data, in reviewer matching and in recommendation.
Confidentiality, wherever unpublished manuscripts meet third-party tools.
The honest assessment
The gains are mostly in work that was not previously being done at all, and the risks are mostly in work that was previously done by people who could be held accountable.
That is why the governance questions — disclosure, appeal, confidentiality, and who is answerable when an automated decision is wrong — matter more than the capability questions, and are further from settled.
In short
What to take from this.
- Largest clear gain: integrity screening that was not previously possible.
- Largest clear risk: fabrication produced faster than it can be screened.
- Unsettled: appeal rights where automation influences editorial decisions.
Sources
- COPE and STM guidance on AI in publishing
- Research integrity literature on paper mills
- Published evaluations of detection tool performance
Related