Contents
On this page
- Changes in the definition of trial quality
- Strategy one: identification of critical-to-quality factors before protocol finalisation
- Evidence from protocol amendments on where quality is lost
- Strategy two: transition from site-visit monitoring to statistical monitoring
- Strength of the evidence for risk-based monitoring
- Strategy three: selective decentralisation of trial activities
- Strategy four: integration of computerised systems into the quality system
- Sequencing the four strategies
- Key points
- Application to your study
- Frequently asked questions
Academy · Research Data Analytics & AI · Trial quality strategies
Four Strategies to Upgrade Clinical Trial Quality in a Computerised Environment
Trial quality is not produced by inspection. It is produced by determining, before the protocol is finalised, which few factors would invalidate the result if they failed, and by designing the monitoring, data flow and computerised systems around those factors. The four strategies discussed here are supported by published evidence, although one of them has considerably less evidence than its vendors suggest.
Most quality failures in a trial originate in its design rather than being introduced later. A protocol that specifies a visit schedule no site can maintain, an eligibility criterion that cannot be verified, or an endpoint dependent on a device the participant cannot operate will generate deviations at every site, and no amount of source data verification will correct them. ICH E6(R3), adopted at Step 4 on 6 January 2025, makes this explicit: quality must be designed in, and the factors critical to quality must be identified prospectively. This article examines the operational implications.
Learning objectives
- How to identify the critical-to-quality factors for a specific protocol using the six domains defined by the Clinical Trials Transformation Initiative (CTTI) framework
- Where the published evidence on central statistical monitoring is strong and where it is limited
- How to write a monitoring plan that specifies thresholds and escalation routes rather than asserting a risk-based approach
- What protocol amendment data imply about when quality is lost
- Which trial activities can be decentralised effectively and which carry documented weaknesses
- How the ICH E6(R3) transition dates affect a protocol currently in preparation
Common misconceptions
- “More monitoring means better quality.” Monitoring detects problems; it does not create quality. Protocol amendment data provide the clearest counter-evidence: in a study of over 3,400 protocols at 17 pharmaceutical and biotechnology companies, more than 40% were amended before the first subject’s first visit, before monitoring of any kind could have begun.
- “100% source data verification is the gold standard.” It is the historical default rather than a standard. It consumes the monitoring budget on the data most likely to be correct, and the comparative evidence for central statistical monitoring is stronger than that for exhaustive on-site verification.
- “Central statistical monitoring is a validated technology.” A scoping review of dynamic site-level risk assessment included 30 reports and identified 24 commercial providers, but found few methods with reliable classification performance. The association between monitoring and site improvement is reasonably well documented; the ability of these methods to correctly identify problem sites is not.
- “Decentralised means remote.” In registered drug trial protocols reporting decentralised data collection, on-site data collection was still reported in 98.4% of protocols, and only 1.6% were exclusively decentralised. In practice, decentralisation is hybrid, and it is the hybrid that must be designed.
- “Quality by design is a documentation exercise.” The CTTI workshop that produced the framework tested it against three hypothetical protocols and found that stakeholders disagreed about which factors were critical. Resolving that disagreement constitutes the substance of the exercise; a critical-to-quality list that has not been debated has not genuinely been developed.
Changes in the definition of trial quality
ICH E6(R3) was adopted at Step 4 on 6 January 2025 and is built on 11 principles 1,5. Three of those principles carry most of the operational weight: quality has to be designed into the trial rather than inspected into it afterwards; the factors critical to the quality of the trial have to be identified prospectively; and processes have to be proportionate to the risks that matter to participant safety and to the reliability of the results 1. None of this is novel as a principle. What is new is that it now frames the guideline as a whole rather than appearing as a single paragraph within it.
The transition dates are relevant to any protocol being written this year. In the EU, the E6 guideline has had legal effect since 1 January 1997; the E6(R3) Principles and Annex 1 took effect on 23 July 2025, and Annex 2 is dated to take effect on 15 January 2027 4,6,9. A protocol drafted now will be inspected against the newer text, which means that the quality rationale must be documented where a sponsor can produce it, typically in the protocol itself and in the monitoring plan rather than in an internal memorandum.
The practical consequence is a shift in where effort is concentrated. Under a verification approach, quality effort is expended after data exist. Under E6(R3), most of it is expended before the first participant is consented, which is also the only point at which it is inexpensive 1,2. Our protocol development work and the SPIRIT checklist both sit at that point in the timeline for this reason.
ICH E6 status and dates relevant to a protocol being written now
| Item | Status |
|---|---|
| E6(R3) adoption | Step 4, 6 January 2025, following Step 2 consultation in 2023 |
| Structure | Built on 11 principles, including prospective identification of factors critical to quality and risk-proportionate processes |
| EU legal effect, E6 | The guideline has had legal effect since 1 January 1997 |
| EU legal effect, E6(R3) Principles and Annex 1 | 23 July 2025 |
| EU legal effect, E6(R3) Annex 2 | Dated to take effect 15 January 2027 |
Dates as published for ICH E6(R3) and its EU implementation. Annex 2 is a scheduled date rather than one already in force.
Strategy one: identification of critical-to-quality factors before protocol finalisation
The Clinical Trials Transformation Initiative’s quality-by-design work organises critical-to-quality factors into six domains, and the 2012 workshop that developed it produced seven recommendations 34. The method is not complicated. For each domain, the team identifies which specific features of the trial would render the result uninterpretable or unsafe if they failed, and then determines what will be done differently as a consequence 33,34.
Two factors make this more difficult than it appears. The first is that most teams produce a list of everything important rather than a list of what is critical, which is equivalent to having no list: if 40 factors are critical, the monitoring plan cannot be proportionate to any of them 37. The second is disagreement. When the CTTI workshop exercised the framework against three hypothetical protocols, stakeholders disagreed about which factors were critical 27. That is the expected result rather than a failure of the exercise. A statistician, a medical monitor and a site coordinator examining the same protocol will nominate different failure modes, and the discussion between them is the source of a useful list.
A workable output is short and specific: not “endpoint data quality” but “the 12-week imaging read, because the primary endpoint is derived from it, it is read centrally, and a site that books scans outside the window generates unusable data that cannot be recovered”. The second formulation specifies what to monitor, what to train, and what to build into the study database as a hard edit check.
The monitoring plan paragraph that follows from a critical-to-quality exercise (thresholds below are illustrative)
Asserts an approach
A risk-based monitoring approach will be adopted in accordance with ICH E6. Key risk indicators will be defined and reviewed regularly by the study team, and monitoring activity will be allocated according to site risk. Centralised monitoring will be used to supplement on-site monitoring visits, and the frequency of visits will be adjusted based on site performance.
Nothing in it is specific to this trial. The paragraph would apply to any protocol in any therapeutic area; it therefore constrains no decision and can be satisfied without any change in practice.
No critical-to-quality factors are named. E6(R3) requires these to be identified prospectively; a plan that defers the identification has not completed the step.
No thresholds. “Reviewed regularly” and “adjusted based on site performance” cannot be audited, because no value is specified at which anyone is obliged to act.
No escalation route. If an indicator is unfavourable, the plan does not state who is informed, within what period, or what action is expected.
Indicator count is unbounded. Without a link between indicators and critical factors, the metric set expands until the review becomes a reporting exercise.
Specifies an approach
Three factors were identified prospectively as critical to quality for this trial: the timing of the week 12 imaging assessment, from which the primary endpoint is derived and which cannot be recovered if the scan falls outside the window; the recording of concomitant corticosteroid use, which defines the per-protocol population; and the chain of custody for the central laboratory sample taken at randomisation. Each is monitored by a named indicator with a defined threshold: proportion of week 12 scans outside the protocol window above 10% at any site; any visit at which concomitant medication is left blank rather than recorded as none; and sample transit time exceeding the stability limit stated in the laboratory manual. A threshold crossing triggers a documented site query within five working days, with an unblinded review of the site by the medical monitor if two consecutive monthly reviews remain above threshold. Indicators not traceable to one of these three factors are reviewed quarterly for information only and do not drive monitoring allocation.
The three factors are specific to this protocol and each comes with the reason it is critical, which is what makes the list defensible to an inspector and useful to a site.
Every indicator traces to a named factor, so the monitoring effort is proportionate by construction rather than by assertion.
Thresholds are numeric, so a review either crosses them or does not, and a monitoring log becomes evidence rather than narrative.
The escalation route specifies a period and a role, which is the element most plans omit and the element that determines whether a signal leads to any change.
Indicators outside the critical set are explicitly demoted rather than deleted, which keeps the review tractable without discarding information.
A reviewer or inspector cannot test the first version against any criterion. The second version states what would constitute a failure before any data exist, which is the essential content of designing quality in rather than inspecting for it.
Evidence from protocol amendments on where quality is lost
The most useful quantitative evidence on designed-in quality comes from protocol amendments. Across more than 3,400 protocols at 17 pharmaceutical and biotechnology companies, over 40% were amended before the first subject’s first visit, one third of all amendments were judged avoidable, amended protocols carried a mean of 2.3 amendments each, and each amendment added around four months 37.
This finding concerns design rather than execution. An amendment made before the first participant is enrolled cannot have been caused by anything learned in the trial 37. It was caused by a problem that was knowable at the writing stage but was not detected, such as an inoperable visit schedule, an eligibility criterion that excludes the available population, or an endpoint assessment that no site is equipped to perform. The finding that one third of amendments were avoidable supports the same conclusion from a different direction.
The implication for a team with a fixed quality budget is clear: a protocol review by those who will operate the protocol yields more quality per hour than monitoring does. Such a review includes a site coordinator, a pharmacist and a statistician reading the draft for feasibility rather than for scientific content. Pubrica’s analysis plan and biostatistics teams read protocols at this stage specifically to find the endpoint definitions that cannot be executed as written.
Protocol amendment burden across more than 3,400 protocols at 17 pharmaceutical and biotechnology companies. An amendment before the first participant is enrolled cannot have been caused by anything learned in the trial.
Strategy two: transition from site-visit monitoring to statistical monitoring
Central statistical monitoring examines the accumulating data across all sites and identifies sites that differ from the others in digit distributions, variance, timing, outlier frequency, visit intervals or adverse event rates 15,21,29. Key risk indicator monitoring is a simpler related approach: a defined set of metrics with thresholds, reviewed on a schedule, with a documented action when a threshold is crossed.
The association between these methods and subsequent site improvement is reasonably well documented. In a review of 1,111 sites across 159 studies at 23 organisations, sites monitored with statistical data monitoring improved on data inconsistency and risk-signal metrics in 83% of cases (95% CI 80% to 85%), compared with 56% of sites in two historical studies run without it 6. Across a larger central monitoring platform covering 212 studies and 1,676 sites with key risk indicator signals at 23 sponsor organisations, 82.9% of flagged sites improved on the statistical score and 81.1% on the observed key risk indicator value, with mean movements of 66.1% and 72.4% respectively 9.
These effects are large and consistent across two independent data sets. However, they derive from before-and-after comparisons on flagged sites rather than randomised comparisons of monitoring strategies, which limits the conclusions that can be drawn about causation 6,9. Sites regress toward the mean; a site flagged because its outlier rate was extreme will often appear improved in the following quarter whether or not any intervention occurred. An accurate summary is that flagged sites improve, that the improvement is substantial, and that the design of these studies cannot separate the effect of the intervention from regression to the mean.
Monitoring approaches and the evidence available for each
| Approach | What it looks at | What the published evidence shows |
|---|---|---|
| On-site source data verification | Transcription accuracy between source records and the case report form, site by site | The historical default. Comparative evidence that exhaustive verification improves trial conclusions is weaker than for the alternatives below |
| Central statistical monitoring | The accumulating data across all sites, looking for sites that are statistically unlike the rest | Sites monitored with statistical data monitoring improved in 83% of 1,111 cases (95% CI 80% to 85%) against 56% in historical studies without it; the scoping review found few methods with reliable classification performance |
| Key risk indicator monitoring | A defined metric set with thresholds and documented actions | Of 1,676 flagged sites across 212 studies, 82.9% improved on the statistical score and 81.1% on the observed indicator value, with mean movements of 66.1% and 72.4% |
| Triggered on-site monitoring | Site visits scheduled in response to a signal rather than on a calendar | Nine of the 30 reports in the scoping review concerned triggered monitoring; effectiveness assessment was attempted in 21 reports overall |
Figures from the statistical data monitoring review of 1,111 sites across 159 studies at 23 organisations; the central monitoring platform analysis of 212 studies and 1,676 flagged sites at 23 sponsor organisations; and the scoping review of dynamic site-level risk assessment, which included 30 reports and identified 24 commercial providers.
Strength of the evidence for risk-based monitoring
The evidence is more limited than commercial claims suggest. A scoping review of dynamic site-level risk assessment methods included 30 reports, of which 21 were peer-reviewed; 20 concerned central statistical monitoring and 9 concerned triggered monitoring 11. It identified 24 commercial providers and found 21 reports that attempted any assessment of effectiveness. Its conclusion was that few methods demonstrated reliable classification performance 11.
This gap merits careful attention. Two distinct claims are made in this field, and only one of them is supported. The first claim, that sites which are flagged and followed up tend to improve, has reasonable supporting data, as described above 6,9. The second claim, that these methods correctly identify the sites with real problems and do not flag those without, requires sensitivity, specificity and predictive values against a known reference standard, and very few reports provide them 11,20. With 24 commercial providers in the market and 21 peer-reviewed reports in total, the ratio of product to published evidence is itself informative.
In practice, a central monitoring signal should be treated as a question rather than a finding, a record should be kept of what each flag proved to be, and the programme’s false positive rate should be reviewed after one year. That record is the only validation data the programme will have, and it costs nothing to maintain. The Academy’s page on monitoring clinical risk with biostatistics goes into the classification statistics in more detail.
Strategy three: selective decentralisation of trial activities
Decentralisation is now normal rather than exceptional, but it is almost never total. Among 254 registered drug trial protocols, decentralised data collection was reported in 68.9% while on-site data collection was reported in 98.4%, and only 1.6% were decentralised only 10. The design problem is therefore not a choice between remote and on-site conduct; it concerns which specific activities are moved, and what fails when they are 8,10.
A structured SWOT analysis of eight key decentralised trial activities, carried out by ten experts, generated 48 strengths, 62 weaknesses, 5 opportunities and 13 threats, which condensed to 11, 13, 2 and 4 categories respectively 1,5. This asymmetry is the principal finding: the expert panel identified more weaknesses than strengths, and considerably more weaknesses than opportunities 5. This does not indicate that decentralisation is inadvisable. It indicates that the risks are better enumerated than the benefits, and that a protocol which decentralises an activity without identifying the corresponding weakness has not completed the analysis.
In practice, the activities requiring the closest scrutiny are those in which a trained observer was doing more than recording a value, such as a physical examination that also screens for unrelated pathology, a sample handled under controlled conditions, or a device reading taken by someone who would notice a malfunction 5. Our page on home diagnostics in trials works through those specific failure modes.
Strategy four: integration of computerised systems into the quality system
The phrase “this computerized world” in the original title of this article now describes something more concrete. A contemporary trial depends on an electronic data capture system, an interactive response technology system, an electronic patient-reported outcome application, one or more wearable data streams, a central laboratory interface and an analysis environment, each with its own validation state, audit trail and failure modes 13,14. E6(R3)’s requirement that processes be proportionate to risk applies to all of them 1.
Two failures recur. The first is treating a system as validated because the vendor validated it, when the relevant question is whether the trial’s own configuration of it (its edit checks, derivations, randomisation strata and data cut logic) performs as the protocol specifies. Vendor validation does not cover the trial’s configuration. The second is a chain from source to analysis that has never been traced end to end on real data before the first interim analysis. Performing that trace once, on dummy or early data, identifies the derivation errors that would otherwise emerge at database lock.
Standards help here because they make the chain inspectable: CDISC SDTM and ADaM structures allow a reviewer to follow a value from collection to analysis dataset without reading the analysis code. Where the analysis is conducted in R, a growing published literature addresses the reproducibility question; see the Academy’s page on R in clinical trial analysis for the current record of regulatory submissions.
Sequencing the four strategies
The four strategies are not parallel options. They follow a sequence, and applying them out of order is the most common way in which a quality programme produces documentation without producing quality.
First, the critical-to-quality exercise, because it determines what everything else monitors. Second, the protocol feasibility review by those who will operate the protocol, because the amendment data locate the losses at that stage. Third, the monitoring plan, which should be derivable from the first step: every key risk indicator should trace to a named critical-to-quality factor, and any indicator that does not is overhead. Fourth, the system and data flow trace, which should take place before the first participant is enrolled rather than before the first interim analysis.
Decentralisation decisions belong within the first two steps rather than after them. The question is not whether to decentralise but which activities can be moved without compromising a factor already identified as critical, a question that can be answered only if that identification has taken place. Where independent review is required at any of these points, Pubrica’s clinical trial support and statistical review are where that work happens.
Key points
Key points
Quality in a trial is largely determined before enrolment. ICH E6(R3), adopted at Step 4 on 6 January 2025 and built on 11 principles, requires the factors critical to quality to be identified prospectively and processes to be proportionate to risk. Protocol amendment data explain why: across more than 3,400 protocols at 17 companies, over 40% were amended before the first subject’s first visit, one third of amendments were judged avoidable, and each added approximately four months. Central statistical monitoring and key risk indicators are the strongest available alternative to exhaustive source data verification, with 83% of 1,111 statistically monitored sites improving against 56% historically, and 82.9% of 1,676 flagged sites improving on their statistical score. The same literature, however, shows that few of these methods have demonstrated reliable classification performance, so a flag should be treated as a question rather than a verdict. Decentralisation should proceed activity by activity, with the weakness introduced by each change identified, because the expert panel that examined eight decentralised activities found more weaknesses than strengths. Finally, the trial’s own configuration of every computerised system, not only the vendor’s validation of it, should be brought within the quality system.
Application to your study
Application to your study
- The critical-to-quality exercise should involve participants who hold differing views. A statistician, a site coordinator, a pharmacist and a medical monitor should work through the six CTTI domains against the actual protocol, concluding with three to five factors rather than forty.
- The protocol should be reviewed for operability before it is finalised. Amendment data indicate that over 40% of protocols are amended before the first participant is enrolled and that one third of amendments are avoidable; this review is the stage at which such problems can be identified.
- Every key risk indicator should be traceable to a named factor. The trace should be documented. Any indicator that cannot be traced should be treated as informational rather than as a driver of monitoring allocation.
- Each indicator should have a numerical threshold and an escalation route. This comprises a threshold value, a review frequency, a named role to be notified, and a period within which action must be taken.
- A disposition log should be kept for every central monitoring flag. The log records what was flagged, what it proved to be and what action was taken. After one year, it provides the only available data on the trial’s own false positive rate.
- Decentralisation should be decided activity by activity. For each activity moved off site, the weakness introduced and its mitigation should be documented, and it should be confirmed that neither affects a factor identified as critical.
- One participant’s data should be traced end to end before the first interim analysis. The trace should proceed from source through the database to the analysis dataset, using real or dummy data, and should test the trial’s own configuration rather than the vendor’s validation.
Frequently asked questions
The substantive change is one of framing. E6(R3), adopted at Step 4 on 6 January 2025, is structured around 11 principles, and those principles require quality to be designed into the trial, factors critical to quality to be identified prospectively, and processes to be proportionate to the risks that matter. In practice that means a sponsor has to be able to produce a written rationale showing which features of this specific trial were judged critical and how the monitoring, training and data systems follow from that judgement. The dates matter too: in the EU the E6(R3) Principles and Annex 1 took effect on 23 July 2025, and Annex 2 is dated to take effect on 15 January 2027.
Both claims require separate consideration. The claim that flagged sites improve has reasonable evidence: in 1,111 sites across 159 studies, 83% of statistically monitored sites improved on data inconsistency and risk-signal metrics against 56% of sites in historical studies without it, and across 212 studies with 1,676 flagged sites, 82.9% improved on the statistical score. The claim that these methods correctly identify the sites with real problems is much less well supported; a scoping review of 30 reports found few methods with reliable classification performance, while identifying 24 commercial providers. The technique is therefore worth using, but its outputs should be treated as questions to investigate rather than as findings.
Few enough that monitoring can genuinely be proportionate to them; in most trials, three to five. The common failure is a list of everything important, which has the same practical effect as no list, because nothing can be prioritised against it. The CTTI framework organises factors into six domains, which serve as a prompt rather than a quota: a critical factor need not be nominated in every domain. Disagreement should be expected while the list is being compiled. When the CTTI workshop exercised the framework against three hypothetical protocols, stakeholders disagreed about which factors were critical, and resolving that disagreement constitutes the substance of the exercise.
It is not required by E6(R3), which calls for monitoring proportionate to risk rather than exhaustive verification. The practical constraint is usually internal rather than regulatory: standard operating procedures written under earlier expectations, and sponsors who are reluctant to document a reduction. Where verification is reduced, the defensible approach is targeted rather than merely reduced: full verification of the data items that feed the primary endpoint, eligibility and safety reporting, and sampled verification elsewhere, with the reasoning recorded in the monitoring plan. The limitations of the evidence base apply in both directions: the comparative case that exhaustive verification improves trial conclusions is not strong either.
Almost none are fully decentralised, and most use some decentralised element. Among 254 registered drug trial protocols, 68.9% reported decentralised data collection while 98.4% reported on-site data collection, and only 1.6% were decentralised only. The realistic planning question is therefore which activities are moved rather than whether the trial is remote. The expert SWOT (strengths, weaknesses, opportunities and threats) analysis of eight key decentralised activities merits review before a decision is made: ten experts generated 62 weaknesses against 48 strengths, condensing to 13 weakness categories against 11 strength categories, so the identified risks currently outnumber the identified benefits in the literature.
Because of when they occur. In the study of more than 3,400 protocols at 17 pharmaceutical and biotechnology companies, over 40% were amended before the first subject’s first visit. An amendment at that point cannot reflect anything learned from participants; it therefore reflects a problem that was knowable at the writing stage and was missed, such as a visit schedule sites cannot maintain, an eligibility criterion that excludes the available population, or an assessment no site is equipped to perform. One third of amendments were judged avoidable, and each amendment added around four months. The cost is not limited to the schedule: a protocol amended during enrolment produces a cohort recruited under two sets of rules.
Key risk indicator monitoring uses a defined metric set with thresholds (query rates, screen failure rates, time to data entry, adverse event rates per participant-month), reviewed on a schedule with a documented action when a threshold is crossed. Central statistical monitoring is model-based: it compares a site’s whole data profile against the rest of the study and flags sites that are statistically atypical, including patterns that no one specified in advance. The first is easier to explain to an inspector and easier to act on; the second can detect problems that were not anticipated. Both appeared in the scoping review of dynamic site-level risk assessment, which covered 20 central statistical monitoring reports and 9 triggered monitoring reports among 30 included.
A protocol feasibility review before the protocol is finalised, conducted by those who will operate it. The evidence supports this priority fairly clearly: over 40% of protocols are amended before the first participant is enrolled, a third of amendments are avoidable, amended protocols carry 2.3 amendments on average, and each adds around four months. No monitoring strategy can correct a design defect, and the amendment literature shows that design defects are both common and detectable in advance. The second priority, if resources remain, is tracing one participant’s data from source to analysis dataset before the first interim analysis, which identifies derivation and configuration errors while they are still inexpensive to correct.
References
- International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH). ICH Harmonised Guideline: Guideline for Good Clinical Practice E6(R3). ICH. 2025. read 9 October 2026. database.ich.org
- Grandinetti C; US Food and Drug Administration, CDER Office of Compliance, Office of Scientific Investigations. Achieving Fit-for-Purpose Clinical Trial Quality. FDA Clinical Investigator Training Course. 2024. read 9 October 2026. fda.gov
- European Medicines Agency; ICH E6(R3) Expert Working Group. ICH guideline E6 on good clinical practice - ICH E6 Principles (Draft Version: March 2021). European Medicines Agency. 2021. read 9 October 2026. ema.europa.eu
- European Medicines Agency. ICH E6 Good clinical practice - Scientific guideline. European Medicines Agency. read 9 October 2026. ema.europa.eu
- Murciano-Gamborino C, Perez-Breva L, de Jong AJ, van Thiel GJM, Santa-Ana-Tellez Y, Boeckhout M, Siiskonen SJ, van Rijssel T, Gardarsdottir H, Fons-Martinez J, et al. SWOT analysis of decentralised clinical trials from an ethical, legal, regulatory and operational perspective. BMC Medical Ethics. 2026;27(1):57. doi:10.1186/s12910-026-01391-w read 9 October 2026. doi.org/10.1186/s12910-026-01391-w
- de Viron S, Trotta L, Steijn W, Young S, Buyse M. Does Central Statistical Monitoring Improve Data Quality? An Analysis of 1,111 Sites in 159 Clinical Trials. Therapeutic Innovation & Regulatory Science. 2024;58(3):483-494. doi:10.1007/s43441-024-00613-w read 9 October 2026. doi.org/10.1007/s43441-024-00613-w
- Wu G, Childress S, Wang Z, Roumaya M, McLaughlin Stern C, Dickens C, Wildfire J. Good Statistical Monitoring: A Flexible Open-Source Tool to Detect Risks in Clinical Trials. Therapeutic Innovation & Regulatory Science. 2024;58(5):838-844. doi:10.1007/s43441-024-00651-4 read 9 October 2026. doi.org/10.1007/s43441-024-00651-4
- Rogers A, De Paoli G, Subbarayan S, Copland R, Harwood K, Coyle J, et al. A Systematic Review of Methods used to Conduct Decentralised Clinical Trials. British Journal of Clinical Pharmacology. 2022;88(6):2843-2862. doi:10.1111/bcp.15205 read 9 October 2026. doi.org/10.1111/bcp.15205
- de Viron S, Trotta L, Steijn W, Young S, Buyse M. Does Central Monitoring Lead to Higher Quality? An Analysis of Key Risk Indicator Outcomes. Therapeutic Innovation & Regulatory Science. 2022;57(2):295-303. doi:10.1007/s43441-022-00470-5 read 9 October 2026. doi.org/10.1007/s43441-022-00470-5
- de Jong AJ, Grupstra RJ, Santa-Ana-Tellez Y, Zuidgeest MGP, de Boer A, Gardarsdottir H. Which decentralised trial activities are reported in clinical trial protocols of drug trials initiated in 2019-2020? A cross-sectional study in ClinicalTrials.gov. BMJ Open. 2022;12(8):e063236. doi:10.1136/bmjopen-2022-063236 read 9 October 2026. doi.org/10.1136/bmjopen-2022-063236
- Cragg WJ, Hurley C, Yorke-Edwards V, Stenning SP. Dynamic methods for ongoing assessment of site-level risk in risk-based monitoring of clinical trials: A scoping review. Clinical Trials. 2021;18(2):245-259. doi:10.1177/1740774520976561 read 9 October 2026. doi.org/10.1177/1740774520976561
- DeVito NJ, Bacon S, Goldacre B. Compliance with legal requirement to report clinical trial results on ClinicalTrials.gov: a cohort study. The Lancet. 2020;395(10221):361-369. doi:10.1016/S0140-6736(19)33220-9 read 9 October 2026. doi.org/10.1016/S0140-6736(19)33220-9
- Wilkinson M, Young R, Harper B, Machion B, Getz K. Baseline assessment of the evolving 2017 eClinical landscape. Therapeutic Innovation & Regulatory Science. 2019;53:71-80. doi:10.1177/2168479018769292 read 9 October 2026. doi.org/10.1177/2168479018769292
- Coravos A, Goldsack JC, Karlin DR, Nebeker C, Perakslis E, Zimmerman N, Erb MK. Digital medicine: a primer on measurement. Digital Biomarkers. 2019;3:31-71. doi:10.1159/000500413 read 9 October 2026. doi.org/10.1159/000500413
- Agrafiotis DK, Lobanov VS, Farnum MA, Yang E, Ciervo J, Walega M, et al. Risk-based monitoring of clinical trials: an integrative approach. Clinical Therapeutics. 2018;40(7):1204-1212. read 9 October 2026. journals.sagepub.com
- Stenning SP, Cragg WJ, Joffe N, Diaz-Montana C, Choudhury R, Sydes MR, et al. Triggered or routine site monitoring visits for randomised controlled trials: results of TEMPER, a prospective, matched-pair study. Clinical Trials. 2018;15:600-609. read 9 October 2026. journals.sagepub.com
- von Niederhausern B, Orleth A, Schadelin S, Rawi N, Velkopolszky M, Becherer C, et al. Generating evidence on a risk-based monitoring approach in the academic setting - lessons learned. BMC Medical Research Methodology. 2017;17(1):26. doi:10.1186/s12874-017-0308-6 read 9 October 2026. doi.org/10.1186/s12874-017-0308-6
- Brosteanu O, Schwarz G, Houben P, Paulus U, Strenge-Hesse A, Zettelmeyer U, et al. Risk-adapted monitoring is not inferior to extensive on-site monitoring: results of the ADAMON cluster-randomised study. Clinical Trials. 2017;14:584-596. read 9 October 2026. journals.sagepub.com
- Buyse M, Squifflet P, Coart E, Quinaux E, Punt CJA, Saad ED. The impact of data errors on the outcome of randomized clinical trials. Clinical Trials. 2017;14(5):499-506. read 9 October 2026. journals.sagepub.com
- Hurley C, Shiely F, Power J, Clarke M, Eustace JA, Flanagan E, Kearney PM. Risk based monitoring (RBM) tools for clinical trials: a systematic review. Contemporary Clinical Trials. 2016;51:15-27. read 9 October 2026. journals.sagepub.com
- Knepper D, Lindblad AS, Sharma G, Gensler GR, Manukyan Z, Matthews AG, Ahn H. Statistical monitoring in clinical trials: best practices for detecting data anomalies suggestive of fabrication or misconduct. Therapeutic Innovation & Regulatory Science. 2016;50:144-154. read 9 October 2026. journals.sagepub.com
- Olsen R, Bihlet AR, Kalakou F, Andersen JR. The impact of clinical trial monitoring approaches on data integrity and cost - a review of current literature. European Journal of Clinical Pharmacology. 2016;72(4):399-412. read 9 October 2026. journals.sagepub.com
- Anderson ML, Chiswell K, Peterson ED, Tasneem A, Topping J, Califf RM. Compliance with results reporting at ClinicalTrials.gov. New England Journal of Medicine. 2015;372(11):1031-1039. doi:10.1056/NEJMsa1409364 read 9 October 2026. doi.org/10.1056/NEJMsa1409364
- Sheetz N, Wilson B, Benedict J, Huffman E, Lawton A, Travers M, et al. Evaluating source data verification as a quality control measure in clinical trials. Therapeutic Innovation & Regulatory Science. 2014;48(6):671-680. read 9 October 2026. journals.sagepub.com
- European Parliament and Council of the European Union. Regulation (EU) No 536/2014 of the European Parliament and of the Council of 16 April 2014 on clinical trials on medicinal products for human use, and repealing Directive 2001/20/EC. Official Journal of the European Union (CELEX 32014R0536). 2014. read 9 October 2026. eur-lex.europa.eu
- Tudur Smith C, Williamson P, Jones A, Smyth A, Hewer SL, Gamble C. Risk-proportionate clinical trial monitoring: an example approach from a non-commercial trials unit. Trials. 2014;15:1-10. read 9 October 2026. journals.sagepub.com
- Clinical Trials Transformation Initiative. Workshop on Quality Risk Management: Understanding What Matters - Executive Summary (workshop held 29-30 January 2014). Clinical Trials Transformation Initiative. 2014. read 9 October 2026. ctti-clinicaltrials.org
- Macefield RC, Beswick AD, Blazeby JM, Lane JA. A systematic review of on-site monitoring methods for health-care randomised controlled trials. Clinical Trials. 2013;10(1):104-124. read 9 October 2026. journals.sagepub.com
- Kirkwood AA, Cox T, Hackshaw A. Application of methods for central statistical monitoring in clinical trials. Clinical Trials. 2013;10(5):783-806. read 9 October 2026. journals.sagepub.com
- Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gotzsche PC, Krleza-Jeric K, Hrobjartsson A, Mann H, Dickersin K, Berlin JA, Dore CJ, Parulekar WR, Summerskill WSM, Groves T, Schulz KF, Sox HC, Rockhold FW, Rennie D, Moher D. SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials. Annals of Internal Medicine. 2013;158(3):200-207. doi:10.7326/0003-4819-158-3-201302050-00583 read 9 October 2026. doi.org/10.7326/0003-4819-158-3-201302050-00583
- Bakobaki J, Joffe N, Burdett S, Tierney J, Meredith S, Stenning S. A systematic search for reports of site monitoring technique comparisons in clinical trials. Clinical Trials. 2012;9(6):777-780. read 9 October 2026. journals.sagepub.com
- Tudur Smith C, Stocken DD, Dunn J, Cox T, Ghaneh P, Cunningham D, Neoptolemos JP. The value of source data verification in a cancer clinical trial. PLoS ONE. 2012;7(12):e51623. read 9 October 2026. journals.sagepub.com
- Clinical Trials Transformation Initiative. Workshop on Quality Risk Management: Making Clinical Trials Fit for Purpose - Executive Summary. Clinical Trials Transformation Initiative. 2012. read 9 October 2026. ctti-clinicaltrials.org
- Clinical Trials Transformation Initiative. Workshop on Quality Risk Management: Understanding What Matters - Executive Summary (workshop held 20-21 September 2012). Clinical Trials Transformation Initiative. 2012. read 9 October 2026. ctti-clinicaltrials.org
- Guyatt GH, Oxman AD, Kunz R, Brozek J, Alonso-Coello P, Rind D, et al. GRADE guidelines 6. Rating the quality of evidence - imprecision. Journal of Clinical Epidemiology. 2011;64(12):1283-1293. doi:10.1016/j.jclinepi.2011.01.012 read 9 October 2026. doi.org/10.1016/j.jclinepi.2011.01.012
- Balshem H, Helfand M, Schunemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. Journal of Clinical Epidemiology. 2011;64(4):401-406. doi:10.1016/j.jclinepi.2010.07.015 read 9 October 2026. doi.org/10.1016/j.jclinepi.2010.07.015
- Getz KA, Zuckerman R, Cropp AB, Hindle AL, Krauss R, Kaitin KI. Measuring the Incidence, Causes, and Repercussions of Protocol Amendments. Drug Information Journal. 2011;45(3):265-275. doi:10.1177/009286151104500307 read 9 October 2026. doi.org/10.1177/009286151104500307
- Journot V, Pignon JP, Gaultier C, Daurat V, Bouxin-Metro A, Giraudeau B, et al. Validation of a risk-assessment scale and a risk-adapted monitoring plan for academic clinical research studies - the Pre-Optimon study. Contemporary Clinical Trials. 2011;32:16-24. read 9 October 2026. journals.sagepub.com
- Schulz KF, Altman DG, Moher D. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. Trials. 2010;11(1):32. doi:10.1186/1745-6215-11-32 read 9 October 2026. doi.org/10.1186/1745-6215-11-32
- Brosteanu O, Houben P, Ihrig K, Ohmann C, Paulus U, Pfistner B, et al. Risk analysis and risk adapted on-site monitoring in noncommercial clinical trials. Clinical Trials. 2009;6(6):585-596. read 9 October 2026. journals.sagepub.com
- von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP; STROBE Initiative. Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007;335(7624):806-808. doi:10.1136/bmj.39335.541782.AD read 9 October 2026. doi.org/10.1136/bmj.39335.541782.AD
- von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP; STROBE Initiative. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Epidemiology. 2007;18(6):800-804. doi:10.1097/EDE.0b013e3181577654 read 9 October 2026. doi.org/10.1097/EDE.0b013e3181577654
Every source above is a peer-reviewed article, a publisher’s record of one, or a standard issued by the body that owns it. Each carries the date it was last read. Where a standard moves, this article is revised rather than left up with a note.
How to cite this article
Pick your referencing style and copy it. Your university or target journal may vary the punctuation — check its guide if it has one.
Pubrica Academy. (2026, October 9). Four Strategies to Upgrade Clinical Trial Quality in a Computerised Environment. Pubrica. https://pubrica.com/academy/latest-topics/four-strategies-to-upgrade-clinical-trial-quality-in-this-computerized-world/
Pubrica Academy. “Four Strategies to Upgrade Clinical Trial Quality in a Computerised Environment.” Pubrica, 9 Oct. 2026, pubrica.com/academy/latest-topics/four-strategies-to-upgrade-clinical-trial-quality-in-this-computerized-world/.
Pubrica Academy (2026) Four Strategies to Upgrade Clinical Trial Quality in a Computerised Environment. Pubrica. Available at: https://pubrica.com/academy/latest-topics/four-strategies-to-upgrade-clinical-trial-quality-in-this-computerized-world/ (Accessed: 15 October 2026).
Pubrica Academy. “Four Strategies to Upgrade Clinical Trial Quality in a Computerised Environment.” Pubrica. October 9, 2026. https://pubrica.com/academy/latest-topics/four-strategies-to-upgrade-clinical-trial-quality-in-this-computerized-world/
Pubrica Academy, ‘Four Strategies to Upgrade Clinical Trial Quality in a Computerised Environment’ (Pubrica, 9 October 2026) <https://pubrica.com/academy/latest-topics/four-strategies-to-upgrade-clinical-trial-quality-in-this-computerized-world/> accessed 15 October 2026.
Pubrica Academy. Four Strategies to Upgrade Clinical Trial Quality in a Computerised Environment. [Internet]. Pubrica; 2026 Oct 9 [cited 2026 Oct 15]. Available from: https://pubrica.com/academy/latest-topics/four-strategies-to-upgrade-clinical-trial-quality-in-this-computerized-world/
Pubrica Academy, “Four Strategies to Upgrade Clinical Trial Quality in a Computerised Environment,” Pubrica, Oct. 9, 2026. [Online]. Available: https://pubrica.com/academy/latest-topics/four-strategies-to-upgrade-clinical-trial-quality-in-this-computerized-world/
@misc{four_strategies_to_upgrade_clinical_tr_2026,
author = {{Pubrica Academy}},
title = {Four Strategies to Upgrade Clinical Trial Quality in a Computerised Environment},
howpublished = {Pubrica},
year = {2026},
month = {oct},
url = {https://pubrica.com/academy/latest-topics/four-strategies-to-upgrade-clinical-trial-quality-in-this-computerized-world/},
note = {Accessed: <span data-cite-acc="iso">2026-10-15</span>}
}This article is written to be learned from. Cite it if you are referring to what it says; if you are using the evidence behind it, cite the sources listed above instead.
Critical-to-quality and monitoring trace sheet
A one-page tool that requires each monitoring activity to be justified against a named critical-to-quality factor. It should be completed before the protocol is finalised, kept with the monitoring plan, and revised only with a documented reason.
CRITICAL-TO-QUALITY AND MONITORING TRACE
Protocol: ______________________ Version/date: ______________
Completed by (roles present, not names): ____________________
[ ] statistician [ ] site coordinator [ ] pharmacist
[ ] medical monitor [ ] data manager [ ] other: ________
STEP 1 - CRITICAL-TO-QUALITY FACTORS (aim for 3 to 5, not 40)
For each: what it is, and WHY its failure would make the result
unsafe or uninterpretable. A factor with no "why" is not a factor.
CTQ-1 ..........................................................
Why critical: ................................................
Recoverable if it fails? [ ] yes [ ] no
CTQ-2 ..........................................................
Why critical: ................................................
Recoverable if it fails? [ ] yes [ ] no
CTQ-3 ..........................................................
Why critical: ................................................
Recoverable if it fails? [ ] yes [ ] no
Points of disagreement recorded during the exercise:
..............................................................
(If nobody disagreed, the exercise has probably not been done.)
STEP 2 - PROTOCOL OPERABILITY REVIEW (before lock)
[ ] Visit schedule walked through by a site coordinator
[ ] Eligibility criteria checked against the real available population
[ ] Every endpoint assessment confirmed performable at every site type
[ ] Drug handling and accountability walked through by a pharmacist
[ ] Derivations for the primary endpoint confirmed by a statistician
Issues found and fixed before lock: ______
Issues deferred to amendment, with reason: ______________________
STEP 3 - INDICATOR TRACE (every indicator maps to a CTQ factor)
Indicator | Maps to | Threshold | Review freq | Who is told | By when
--------- | ------- | --------- | ----------- | ----------- | -------
......... | CTQ-__ | ......... | ........... | ........... | .......
......... | CTQ-__ | ......... | ........... | ........... | .......
......... | CTQ-__ | ......... | ........... | ........... | .......
Indicators with no CTQ mapping (information only, not drivers):
..............................................................
STEP 4 - DECENTRALISATION CHECK (per activity moved off site)
Activity moved: ______________________
Weakness introduced: ______________________
Mitigation: ______________________
Touches a CTQ factor? [ ] no [ ] yes - which, and justification:
..............................................................
STEP 5 - SYSTEM AND DATA FLOW TRACE (before first participant)
[ ] Our configuration of the EDC validated, not just the vendor build
[ ] Edit checks tested against deliberately bad test data
[ ] Randomisation strata tested against the protocol text
[ ] One participant traced source -> database -> analysis dataset
[ ] Primary endpoint derivation reproduced independently
Date trace completed: ______________
FLAG DISPOSITION LOG (start at first participant, never stop)
Date | Site | Signal | Investigated by | What it turned out to be
---- | ---- | ------ | --------------- | ------------------------
.... | .... | ...... | ............... | ........................
Review your own false positive rate at 12 months: ______ Pubrica AcademyWritten and maintained by Pubrica’s subject matter experts. Articles are revised when the underlying standards change, and each article states the date on which it was last reviewed.
How Pubrica can help
Pubrica reviews protocols before finalisation, with a statistician and a data manager examining endpoint definitions and visit schedules that cannot be executed as written, the defects that the amendment literature identifies as both common and avoidable. Pubrica also develops monitoring plans in which every indicator traces to a named critical-to-quality factor, with numerical thresholds and escalation routes rather than an assertion that a risk-based approach will be adopted. Where a central monitoring programme is already in operation, Pubrica audits the flag disposition log and reports the programme’s own false positive rate.