Data quality in an HIV vaccine efficacy clinical trial in South Africa: through natural disasters and with discipline.

BACKGROUND: To produce quality data that informs valid clinical trial results and withstands regulatory inspection, trial sites should adhere to many complex and dynamic requirements. Understanding non-conformance to requirements informs the emerging field of improvement science. We describe protocol deviations in South Africa's largest HIV vaccine efficacy trial. METHODS: We analysed data from the HVTN 702 trial using mixed methods. We obtained descriptive statistics, from protocol deviation case report forms collected from 2016-2022, of deviation by participant, trial site, and time to site awareness. We thematically analysed text narratives of deviation descriptions, corrective and preventive actions, generating categories, codes and themes which emerged from the data. RESULTS: For 5407 enrollments, 4074 protocol deviations were reported (75 [95% CI: 73.0-77.6] deviations per 100 enrolments). There was a median of 1 protocol deviation per participant (IQR 1-2). Median time from deviation to site awareness was 31 days (IQR 0-146). The most common category of deviation type was omitted data and/or procedures (69%), and 54% of these omissions were stated to have arisen because of the national lockdown at the beginning of the COVID-19 pandemic. The ratio of protocol deviations to cumulative enrolments was highest in the year 2020 (0.34). Major themes of deviations were: COVID-19 and climate disasters giving rise to deviation trends, subroutines introducing an opportunity for deviation, and document fragmentation (such as requirements dispersed across multiple guidance documents) as an obstacle. Preventive action categories were: no preventive measures; discipline, training and/or awareness; quality review, checking and verifying and changing the process and/or implementation tools. Major themes of preventive actions were that systems-based actions are unusual, with people-based actions dominating, and that root cause analysis was rarely mentioned. CONCLUSIONS: In the age of infectious and climate disaster risks, trials may benefit from simple study designs and trial-related documents. To optimise protocol adherence, sponsors and sites should consider ongoing training, and routinely review deviation reports with a view to adjusting processes. These data quality lessons may inform future trial design, training and implementation. TRIAL REGISTRATION: HVTN 702 was registered with the South African National Clinical Trials Register (DOH-27-0916-5327) and ClinicalTrials.gov ( NCT02968849 ).

Selective perioperative steroid supplementation protocol in patients undergoing endoscopic transsphenoidal surgery for pituitary adenomas.

BACKGROUND: There is no consensus regarding the use of perioperative steroids for transsphenoidal pituitary surgery. We audited the effectiveness and safety of our selective perioperative steroid supplementation protocol in patients with pituitary adenomas. METHODS: Two hundred ninety-seven patients underwent 306 endoscopic transsphenoidal surgeries for removal of their pituitary tumors. Steroids were given to those with an impaired hypothalamic-pituitary-adrenal (HPA) axis, age ≥ 60 years, clinical apoplexy, hyponatremia, or if the pituitary gland was not preserved at surgery. We excluded 111 patients in whom the integrity of the HPA axis could not be determined. We compared the incidence of early postoperative adrenal insufficiency and complications in 135 patients with intact HPA axes who underwent surgery without steroids (group A) with 60 patients who had compromised preoperative HPA axes and received perioperative steroids (group B). In addition, we audited the total number of protocol violations during this period. RESULTS: Five patients (3.7%) in group A developed postoperative hypocortisolemia. There was no significant difference in the incidence of cerebrospinal fluid leak, diabetes insipidus, or hyponatremia between both groups. There were protocol deviations in 47 (15.4%) patients. Twenty one of these patients did not receive perioperative steroids in violation of the protocol, of whom 4 (19%) developed postoperative hypocortisolemia. CONCLUSIONS: Our steroid sparing protocol was both safe and effective. The 15% incidence of protocol deviations is a reminder that the rigorous usage of checklists is mandatory for successful clinical practice.

An application of a pattern-mixture model with multiple imputation for the analysis of longitudinal trials with protocol deviations.

BACKGROUND: The benefit of a given treatment can be evaluated via a randomized clinical trial design. However, protocol deviations may severely compromise treatment effect since such deviations often lead to missing values. The assumption that methods of analysis can account for the missing data cannot be justified and hence methods of analysis based on plausible assumptions should be used. An alternative analysis to the simple imputation methods requires unverifiable assumptions about the missing data. Therefore sensitivity analysis should be performed to investigate the robustness of statistical inferences to alternative assumptions about the missing data. AIMS: In this paper, we investigate the effect of tuberculosis pericarditis treatment (prednisolone) on CD4 count changes over time and draw inferences in the presence of missing data. The data come from a multicentre clinical trial (the IMPI trial). METHODS: We investigate the effect of prednisolone on CD4 count changes by adjusting for baseline and time-dependent covariates in the fitted model. To draw inferences in the presence of missing data, we investigate sensitivity of statistical inferences to missing data assumptions using the pattern-mixture model with multiple imputation (PM-MI) approach. We also performed simulation experiment to evaluate the performance of the imputation approaches. RESULTS: Our results showed that the prednisolone treatment has no significant effect on CD4 count changes over time and that the prednisolone treatment does not interact with time and anti-retroviral therapy (ART). Also, patients' CD4 count levels significantly increase over the study period and patients on ART treatment have higher CD4 count levels compared with those not on ART. The results also showed that older patients had lower CD4 count levels compared with younger patients, and parameter estimates under the MAR assumption are robust to NMAR assumptions. CONCLUSIONS: Since the parameter estimates under the MAR analysis are robust to NMAR analyses, the process that generated the missing data in the CD4 count measurements is missing at random (MAR). The implication is that valid inferences can be obtained using either the likelihood-based methods or multiple imputation approaches.

Surveillance of protocol deviations in Japanese oncology registration trials: a single institute experience.

Background The contents and requirements of study protocols vary depending upon each clinical registration trial. This study aims to describe details of protocol deviations in Japanese oncology registration trials. Methods We reviewed deviation reports that were discussed by the Institutional Review Board between 2010 and 2015. Results A total of 499 clinical trials were performed, from which 967 deviations were reported. In the initial 3 years, 445 deviations occurred in 535 ongoing trials, while 522 deviations occurred in 876 trials in the subsequent 3 years. The frequency of deviations related to visit, examination, treatment, and others was 189 (19.5%), 446 (46.1%), 275 (28.4%), and 57 (5.9%), respectively. Serious deviations were common at the time of registration of trials and during treatment. The deviations were attributable to the institution (n = 520), subject (n = 93), sponsor (n = 28), schedule management (n = 162), disease condition (n = 95), and others (n = 69). Conclusion This study showed the number and detail responsible factors of protocol deviations. Our findings support to distinguish between the measures to reduce the serious deviations and to reduce the overall number of deviations.

Protocol adherence for continuously titrated interventions in randomized trials: an overview of the current methodology and case study.

BACKGROUND: The standard definition for protocol adherence is the proportion of all scheduled doses that are delivered. In clinical research, this definition has several limitations when evaluating protocol adherence in trials that study interventions requiring continuous titration. DISCUSSION: Building upon a specific case study, we analyzed a recent trial of a continuously titrated intervention to assess the impact of different definitions of protocol deviations on the interpretation of protocol adherence. The OVATION pilot trial was an open-label randomized controlled trial of higher (75-80 mmHg) versus lower (60-65 mmHg) mean arterial pressure (MAP) targets for vasopressor therapy in shock. In this trial, potential protocol deviations were defined as MAP values outside the targeted range for >4 consecutive hours during vasopressor therapy without synchronous and consistent adjustments of vasopressor doses. An adjudication committee reviewed each potential deviation to determine if it was clinically-justified or not. There are four reasons for this contextual measurement and reporting of protocol adherence. First, between-arm separation is a robust measure of adherence to complex protocols. Second, adherence assessed by protocol deviations varies in function of the definition of deviations and the frequency of measurements. Third, distinguishing clinically-justified vs. not clinically-justified protocol deviations acknowledges clinically sensible bedside decision-making and offers a clear terminology before the trial begins. Finally, multiple metrics exist to report protocol deviations, which provides different information but complementary information on protocol adherence. CONCLUSIONS: In trials of interventions requiring continuous titration, metrics used for defining protocol deviations have a considerable impact on the interpretation of protocol adherence. Definitions for protocol deviations should be prespecified and correlated with between-arm separation, if it can be measured.

Reference-based sensitivity analysis via multiple imputation for longitudinal trials with protocol deviation.

Randomized controlled trials provide essential evidence for the evaluation of new and existing medical treatments. Unfortunately, the statistical analysis is often complicated by the occurrence of protocol deviations, which mean we cannot always measure the intended outcomes for individuals who deviate, resulting in a missing-data problem. In such settings, however one approaches the analysis, an untestable assumption about the distribution of the unobserved data must be made. To understand how far the results depend on these assumptions, the primary analysis should be supplemented by a range of sensitivity analyses, which explore how the conclusions vary over a range of different credible assumptions for the missing data. In this article, we describe a new command, mimix, that can be used to perform reference-based sensitivity analyses for randomized controlled trials with longitudinal quantitative outcome data, using the approach proposed by Carpenter, Roger, and Kenward (2013, Journal of Biopharmaceutical Statistics 23: 1352-1371). Under this approach, we make qualitative assumptions about how individuals' missing outcomes relate to those observed in relevant groups in the trial, based on plausible clinical scenarios. Statistical analysis then proceeds using the method of multiple imputation.

Practical Guidelines for Standardised Resolution of Important Protocol Deviations in Clinical Trials Conducted in Sub-Saharan Africa.

A clinical trial is any research on human subjects that involves an investigational medicinal product or device. Investigational medicinal products include unlicensed drugs or drugs used outside the product license (e.g. for a new indication) (ICH-GCP). As per the internationally accepted ICH-GCP guidelines, clinical trials should be conducted strictly per the approved protocol. However, during the lifecycle of a trial, protocol deviations may occur. Under ICH efficacy guidelines, protocol deviations are divided into non-important (minor) or important (major), and the latter can jeopardise the participant's rights, safety or the quality of data generated by the study. Existing guidelines on protocol deviation management do not detail or standardise actions to be taken for participants, investigational products, data or samples as part of a holistic management of important protocol deviations. Herein, we propose guidelines to address the current literature gap and promote the standardisation of actions to address important protocol deviations in clinical trials. The advised actions should complement the existing local institutional review board and national regulatory authority requirements.

Quality Management in Clinical and Public Health Research: A Panacea for Minimising and Eliminating Protocol Deviations in Research Operations.

A quality management system for clinical and public health research operations is indispensable because it ensures the integrity and reliability of research outcomes. By implementing a robust quality management practice in research implementation and operation, research teams can uphold the highest standard of research conduct, thereby enhancing the credibility and trustworthiness of research findings. This paper elucidates the significance and role of a quality management system in clinical and public health research operations and its efficacy in minimising and eliminating protocol deviations and highlights the key steps in setting up a quality management system for research operations.

Unreported protocol deviations - The tip of the research-berg.

Introduction: Failure to stay within an ethics committee (EC)-approved protocol limits is termed protocol deviation or violation (PD/PV), depending on the seriousness of the transgression and its attendant risks and/or harms. PD/PVs arise in the post-approval phase of the research and are often missed. Current guidelines expect ECs to detect, report and recommend suitable actions such that research participants' risks and harms are mitigated, to the extent possible. Objective: Yenepoya Ethics Committee-1 conducted an internal audit of ongoing postgraduate dissertations involving human participants to assess the occurrence of PD/PVs. Materials and Methods: 54 out of 80 postgraduates responded to our request for filling out a self-reported checklist. These responses were followed up with physical verification of the protocol-related documents. Results: Protocol transgressions were classified as non-compliance (administrative issues), protocol deviations (minor transgressions with minimal or less than minimal increase in attendant risk to participants) and protocol violations (serious transgressions with more than minimal increase in attendant risk to participants). The non-compliances included non-reporting for audit and non-reporting of PDs. Protocol deviations included non-conformance to EC validity, sample size, approved methodology, informed consent process and documentation and suboptimal data storage. No protocol violations were observed. Conclusion: We report PD/PVs from these 54 protocols - with our assessment on the negative impact it may have on scientific validity, harm to participants, EC functioning and credibility of the institution - in the hope that our readers appreciate this important aspect of the post-approval process in the functioning of an EC.

Effect of evidence-based nursing management of protocol compliance in anticancer drug clinical trial.

Objective: This study aimed to construct evidence-based anticancer drug clinical trial nursing management norms to ensure the safety and quality of clinical trial nursing. Methods: This before-after study was carried out to complete the evidence implementation in a cancer hospital in Shanghai, China. Seven review indicators were developed and reviewed in one phase I clinical trial center and two oncology wards. The corresponding evidence-based intervention program was formulated, and the completion rate of good clinical practice certification, protocol training, delegation of duties, qualification rate of administration, sampling and document recording in anticancer drug clinical trials before and after implementation were compared. Results: After implementation, the completion rate of protocol training, delegation of duties, and the qualification rate of document recording were significantly higher than those of the baseline review, whereas the completion rate of good clinical practice certification and the qualification rate of sampling did not significantly differ from those observed at the baseline review. There was no administration or infusion device-related protocol deviation during the baseline and post reviews. Conclusions: Anticancer drug clinical trial nursing management norms and relevant standard operating procedures were constructed. The results showed that the implementation of this intervention improved the standardization of nurse qualification procedures and the nursing original document recording in anticancer drug clinical trials, and nursing-related protocol deviation could be reduced to a certain extent.

Understanding Study Drug Discontinuation Through EUCLID.

Introduction: Disparities in the care and outcomes of peripheral artery disease (PAD) have been well-established. In part this is due to disparities in enrollment of PAD trial cohorts. However, less attention has been paid to non-random protocol non-adherence after enrollment, which may lead to inaccurate estimates of treatment effects and reduce generalizability of study results. We aimed to ascertain characteristics associated with premature study drug discontinuation in a PAD cohort. Methods: Using data from EUCLID (Examining Use of Ticagrelor in Peripheral Artery Disease), factors associated with study drug discontinuation were assessed using univariable and multivariable Cox proportional hazards models with time to study drug discontinuation as the outcome of interest. Relationships between study drug discontinuation and major adverse cardiovascular events (MACE; cardiovascular death, myocardial infarction, ischemic stroke), major adverse limb events (MALE; acute limb ischemia, major amputation, and lower extremity revascularization), and all-cause hospitalization were assessed. Results: Of 13,842 eligible EUCLID participants, 3,886 (28.1%) prematurely and permanently discontinued study drug over a maximum follow-up of 42 months (annualized rate of 13.2 discontinuations per 100 patient-years). In a multivariable model, premature study drug discontinuation was associated with older age (aHR 1.16, 95%CI 1.14-1.19), eligibility based on prior lower extremity revascularization rather than ABI/TBI criteria (aHR 1.14, 95%CI 1.06-1.23), CLI status (aHR 1.23, 95%CI 1.06-1.42), COPD (aHR 1.36, 95%CI 1.24-1.49), and geographic region. In a multivariable analysis, study drug discontinuation was significantly associated with MACE (aHR 3.27, 95%CI 2.90-3.67, p < 0.001), MALE (aHR 1.84, 95%CI 1.63-2.07, p < 0.001), and all-cause hospitalization (aHR 2.37, 95%CI 2.21-2.54) following study drug discontinuation. Conclusions: This analysis of EUCLID demonstrates that premature, permanent discontinuation of study drug is relatively common in more than a quarter of PAD patients, is unevenly distributed based on geography and other baseline characteristics, and is associated with worse outcomes in a clinical trial context. Study teams leading future PAD trials may want to address the possibility of study drug discontinuation prospectively, as a proactive approach may help investigators to maintain study cohort diversity and representativeness without sacrificing power and precision.

Protocol Deviations: A Holistic Approach from Defining to Reporting.

Improving interpretation of existing guidelines and management of protocol deviation processes could increase process efficiencies and help reduce noise to support rapid identification of important protocol deviations. Towards this end, TransCelerate identified key principles to build upon and clarify the definition of a protocol deviation and developed a holistic approach to protocol deviation management. The approaches are flexible to suit a variety of indications, study designs, and investigational agents while also supporting consistent application within a study, program or organization.

Feeding protocol deviation after esophagectomy: A retrospective multicenter study.

BACKGROUND: Esophagectomy is associated with high postoperative morbidity rates, which can result in decreased quality of life and impaired recovery. Implementation of enhanced recovery after surgery (ERAS) protocols have made a great impact in optimizing postoperative recovery. However, the best timing to start oral intake is still unclear. Conservative feeding protocols have been developed with a nil-by-mouth period in the first postoperative days to reduce postoperative complication rates (e.g. anastomotic leakage and pneumonia). This study aimed to evaluate adherence to the feeding protocol following minimal invasive esophagectomy and identify reasons for protocol deviation. METHODS: All consecutive patients who underwent an esophagectomy with gastric tube reconstruction between 2014 and 2016 in two high-volume hospitals in the Netherlands were retrospectively analyzed. All patients were planned to receive enteral tube feeding via jejunostomy directly after surgery. Data regarding postoperative feeding related symptoms (e.g. nausea, vomiting, regurgitation) and adherence to the postoperative feeding protocol were gathered. RESULTS: A total of 186 patients were included. Feeding protocol deviation was observed in 109 patients (59%) and was significantly more common in patients with anastomotic leakage, chyle leakage, and acute respiratory distress. Postoperative feeding related symptoms were present in 107 patients (58%) and were significantly more common in female patients and patients with a cervical anastomosis. CONCLUSION: In this study, more than half of the patients deviated from the intended feeding protocol after esophagectomy. Postoperative complications appeared to be the main reason for feeding protocol deviation. This study shows that a predefined feeding protocol including an oral fasting period is often violated because of complications.

Statistical Considerations for Bias and Protocol Deviation in Medical Device Pivotal Clinical Study.

BACKGROUND: The gold standard in conducting clinical trials/studies is to follow what is prespecified in the study protocol. However, deviations from the study protocol may occur. This article discusses the issues of protocol deviation in pivotal clinical trials or studies for medical device and provides statistical approaches to mitigating bias such as selection bias specifically for diagnostic test clinical trials or studies. METHOD: Bias correction methods are developed for 2 specific types of selection biases, prescreening bias and verification bias. Statistical approaches are discussed on how to estimate device performance adjusted for enrollment enrichment and discrepant testing results. We use an FDA-approved Roche Cobas Human Papillomavirus (HPV) test for detecting high-grade cervical disease (>CIN2) as an example to illustrate how to correct for verification bias. A recently FDA-cleared Microarray Assay in detecting copy number variation is used to illustrate how to properly estimate sensitivity and specificity for the discrepancy analysis. RESULTS: The unadjusted sensitivity and specificity based on verified samples were 83.2% and 60.4% for the Roche's HPV test. However, using the correction method with the missing-at-random assumption, the verification bias-adjusted sensitivity and specificity were 34.5% and 93.6%, respectively. CONCLUSION: Protocol deviations can lead to biased estimates of device clinical performance if not handled appropriately. Statistical methods correcting for bias and protocol deviations are recommended in estimating device performance.

Potential role of a pharmacist to enhance medication-related aspects of clinical trials conducted in a dedicated clinical research unit.

PURPOSE: Pharmacist involvement in medication reconciliation has been shown to have a positive impact on patient care in a number of settings [1-6], but there have been no evaluations of the effect of this pharmacist role on patient care during the conduct of clinical trials. Pharmacist involvement in the medication reconciliation process for clinical trials may provide improved protocol compliance. METHODS: This was a retrospective pilot study conducted in a dedicated research unit that assessed completeness of the medication reconciliation process by clinical trial teams for patients participating in a clinical trial involving investigational medication(s). Patients' medication lists in the EHR were reviewed after their study visit. Pharmacy staff evaluated the medication list for accurate inclusion of IDs and any prohibited or restricted concomitant medication(s) per the study protocol. RESULTS: Ninety-five patient visits over two months were evaluated and showed only 20.6% of IDs were listed in the EHR after study visits. Of those included, only 40% had the correct dose and 50% had the correct frequency listed. There were 20 potential protocol prohibited medications identified. There were four medications listed in a fashion that may have compromised maintenance of blinding status in the EHR. CONCLUSIONS: This pilot study showed potential roles for pharmacy personnel involvement in medication reconciliation in the clinical research setting. Pharmacists have the opportunity to ensure that IDs are accurately included in patient medication lists and to identify the use of potential protocol prohibited concomitant medications.