Secondary Endpoint Utilization and Publication Rate among Phase III Oncology Trials.

Secondary endpoints (SEP) provide crucial information in the interpretation of clinical trials, but their features are not yet well understood. Thus, we sought to empirically characterize the scope and publication rate of SEPs among late-phase oncology trials. We assessed SEPs for each randomized, published phase III oncology trial across all publications and ClinicalTrials.gov, performing logistic regressions to evaluate associations between trial characteristics and SEP publication rates. After screening, a total of 280 trials enrolling 244,576 patients and containing 2,562 SEPs met the inclusion criteria. Only 22% of trials (62/280) listed all SEPs consistently between ClinicalTrials.gov and the trial protocol. The absolute number of SEPs per trial increased over time, and trials sponsored by industry had a greater number of SEPs (median 9 vs. 5 SEPs per trial; P < 0.0001). In total, 69% of SEPs (1,770/2,562) were published. The publication rate significantly varied by SEP category [X2 (5, N = 2,562) = 245.86; P < 0.001]. SEPs that place the most burden on patients, such as patient-reported outcomes and translational correlatives, were published at 63% (246/393) and 44% (39/88), respectively. Trials with more SEPs were associated with lower overall SEP publication rates. Overall, our findings are that SEP publication rates in late-phase oncology trials are highly variable based on the type of SEP. To avoid undue burden on patients and promote transparency of findings, trialists should weigh the biological and clinical relevance of each SEP together with its feasibility at the time of trial design. SIGNIFICANCE: In this investigation, we characterized the utilization and publication rates of SEPs among late-phase oncology trials. Our results draw attention to the proliferation of SEPs in recent years. Although overall publication rates were high, underpublication was detected among endpoints that may increase patient burden (such as translational correlatives and patient-reported outcomes).

Increasing Power in Phase III Oncology Trials With Multivariable Regression: An Empirical Assessment of 535 Primary End Point Analyses.

PURPOSE: A previous study demonstrated that power against the (unobserved) true effect for the primary end point (PEP) of most phase III oncology trials is low, suggesting an increased risk of false-negative findings in the field of late-phase oncology. Fitting models with prognostic covariates is a potential solution to improve power; however, the extent to which trials leverage this approach, and its impact on trial interpretation at scale, is unknown. To that end, we hypothesized that phase III trials using multivariable PEP analyses are more likely to demonstrate superiority versus trials with univariable analyses. METHODS: PEP analyses were reviewed from trials registered on ClinicalTrials.gov. Adjusted odds ratios (aORs) were calculated by logistic regressions. RESULTS: Of the 535 trials enrolling 454,824 patients, 69% (n = 368) used a multivariable PEP analysis. Trials with multivariable PEP analyses were more likely to demonstrate PEP superiority (57% [209 of 368] v 42% [70 of 167]; aOR, 1.78 [95% CI, 1.18 to 2.72]; P = .007). Among trials with a multivariable PEP model, 16 conditioned on covariates and 352 stratified by covariates. However, 108 (35%) of 312 trials with stratified analyses lost power by categorizing a continuous variable, which was especially common among immunotherapy trials (aOR, 2.45 [95% CI, 1.23 to 4.92]; P = .01). CONCLUSION: Trials increasing power by fitting multivariable models were more likely to demonstrate PEP superiority than trials with unadjusted analysis. Underutilization of conditioning models and empirical power loss associated with covariate categorization required by stratification were identified as barriers to power gains. These findings underscore the opportunity to increase power in phase III trials with conventional methodology and improve patient access to effective novel therapies.

Proportional Hazards Violations in Phase 3 Cancer Clinical Trials: A Potential Source of Trial Misinterpretation.

BACKGROUND: Survival analyses of novel agents with long-term responders often exhibit differential hazard rates over time. Such proportional hazards violations (PHVs) may reduce the power of the log-rank test and lead to misinterpretation of trial results. We aimed to characterize the incidence and study attributes associated with PHVs in phase 3 oncology trials and assess the utility of restricted mean survival time (RMST) and MaxCombo as additional analyses. METHODS: Clinicaltrials.gov and PubMed were searched to identify 2-arm, randomized, phase 3 superiority-design cancer trials with time-to-event primary endpoints and published results through 2020. Patient-level data were reconstructed from published Kaplan-Meier curves. PHVs were assessed using Schoenfeld residuals. RESULTS: Three hundred fifty-seven Kaplan-Meier comparisons across 341 trials were analyzed, encompassing 292,831 enrolled patients. PHVs were identified in 85/357 (23.8%; 95%CI 19.7%, 28.5%) comparisons. In multivariable analysis, non-OS endpoints (odds ratio [OR] 2.16 [95%CI 1.21, 3.87]; P=.009) were associated with higher odds of PHVs, and immunotherapy comparisons (OR 1.94 [95%CI 0.98, 3.86]; P=.058) were weakly suggestive of higher odds of PHVs. Few trials with PHVs (25/85, 29.4%) pre-specified a statistical plan to account for PHVs. Fourteen trials with PHVs exhibited discordant statistical signals with RMST or MaxCombo, of which ten (71%) reported negative results. CONCLUSION: PHVs are common across therapy types, and attempts to account for PHVs in statistical design are lacking despite the potential for results exhibiting non-proportional hazards to be misinterpreted.

Improving the clinical meaning of surrogate endpoints: An empirical assessment of clinical progression in phase III oncology trials.

Disease progression in clinical trials is commonly defined by radiologic measures. However, clinical progression may be more meaningful to patients, may occur even when radiologic criteria for progression are not met, and often requires a change in therapy in clinical practice. The objective of this study was to determine the utilization of clinical progression criteria within progression-based trial endpoints among phase III trials testing systemic therapies for metastatic solid tumors. The primary manuscripts and protocols of phase III trials were reviewed for whether clinical events, such as refractory pain, tumor bleeding, or neurologic compromise, could constitute a progression event. Univariable logistic regression computed odds ratios (OR) and 95% CI for associations between trial-level covariates and clinical progression. A total of 216 trials enrolling 148,190 patients were included, with publication dates from 2006 through 2020. A major change in clinical status was included in the progression criteria of 13% of trials (n = 27), most commonly as a secondary endpoint (n = 22). Only 59% of trials (n = 16) reported distinct clinical progression outcomes that constituted the composite surrogate endpoint. Compared with other disease sites, genitourinary trials were more likely to include clinical progression definitions (16/33 [48%] vs. 11/183 [6%]; OR, 14.72; 95% CI, 5.99 to 37.84; p < .0001). While major tumor-related clinical events were seldom considered as disease progression events, increased attention to clinical progression may improve the meaningfulness and clinical applicability of surrogate endpoints for patients with metastatic solid tumors.

Towards Treatment Effect Interpretability: A Bayesian Re-analysis of 194,129 Patient Outcomes Across 230 Oncology Trials.

Most oncology trials define superiority of an experimental therapy compared to a control therapy according to frequentist significance thresholds, which are widely misinterpreted. Posterior probability distributions computed by Bayesian inference may be more intuitive measures of uncertainty, particularly for measures of clinical benefit such as the minimum clinically important difference (MCID). Here, we manually reconstructed 194,129 individual patient-level outcomes across 230 phase III, superiority-design, oncology trials. Posteriors were calculated by Markov Chain Monte Carlo sampling using standard priors. All trials interpreted as positive had probabilities > 90% for marginal benefits (HR < 1). However, 38% of positive trials had ≤ 90% probabilities of achieving the MCID (HR < 0.8), even under an enthusiastic prior. A subgroup analysis of 82 trials that led to regulatory approval showed 30% had ≤ 90% probability for meeting the MCID under an enthusiastic prior. Conversely, 24% of negative trials had > 90% probability of achieving marginal benefits, even under a skeptical prior, including 12 trials with a primary endpoint of overall survival. Lastly, a phase III oncology-specific prior from a previous work, which uses published summary statistics rather than reconstructed data to compute posteriors, validated the individual patient-level data findings. Taken together, these results suggest that Bayesian models add considerable unique interpretative value to phase III oncology trials and provide a robust solution for overcoming the discrepancies between refuting the null hypothesis and obtaining a MCID.

Bayesian Interim Analysis and Efficiency of Phase III Randomized Trials.

IMPORTANCE: Improving the efficiency of interim assessments in phase III trials should reduce trial costs, hasten the approval of efficacious therapies, and mitigate patient exposure to disadvantageous randomizations. OBJECTIVE: We hypothesized that in silico Bayesian early stopping rules improve the efficiency of phase III trials compared with the original frequentist analysis without compromising overall interpretation. DESIGN: Cross-sectional analysis. SETTING: 230 randomized phase III oncology trials enrolling 184,752 participants. PARTICIPANTS: Individual patient-level data were manually reconstructed from primary endpoint Kaplan-Meier curves. INTERVENTIONS: Trial accruals were simulated 100 times per trial and leveraged published patient outcomes such that only the accrual dynamics, and not the patient outcomes, were randomly varied. MAIN OUTCOMES AND MEASURES: Early stopping was triggered per simulation if interim analysis demonstrated ≥ 85% probability of minimum clinically important difference/3 for efficacy or futility. Trial-level early closure was defined by stopping frequencies ≥ 0.75. RESULTS: A total of 12,451 simulations (54%) met early stopping criteria. Trial-level early stopping frequency was highly predictive of the published outcome (OR, 7.24; posterior probability of association, >99.99%; AUC, 0.91; P < 0.0001). Trial-level early closure was recommended for 82 trials (36%), including 62 trials (76%) which had performed frequentist interim analysis. Bayesian early stopping rules were 96% sensitive (95% CI, 91% to 98%) for detecting trials with a primary endpoint difference, and there was a high level of agreement in overall trial interpretation (Bayesian Cohen's κ, 0.95; 95% CrI, 0.92 to 0.99). However, Bayesian interim analysis was associated with >99.99% posterior probability of reducing patient enrollment requirements ( P < 0.0001), with an estimated cumulative enrollment reduction of 20,543 patients (11%; 89 patients averaged equally over all studied trials) and an estimated cumulative cost savings of 851 million USD (3.7 million USD averaged equally over all studied trials). CONCLUSIONS AND RELEVANCE: Bayesian interim analyses may improve randomized trial efficiency by reducing enrollment requirements without compromising trial interpretation. Increased utilization of Bayesian interim analysis has the potential to reduce costs of late-phase trials, reduce patient exposures to ineffective therapies, and accelerate approvals of effective therapies. KEY POINTS: Question: What are the effects of Bayesian early stopping rules on the efficiency of phase III randomized oncology trials?Findings: Individual-patient level outcomes were reconstructed for 184,752 patients from 230 trials. Compared with the original interim analysis strategy, in silico Bayesian interim analysis reduced patient enrollment requirements and preserved the original trial interpretation. Meaning: Bayesian interim analysis may improve the efficiency of conducting randomized trials, leading to reduced costs, reduced exposure of patients to disadvantageous treatments, and accelerated approval of efficacious therapies.

Lost in the plot: missing visual elements in Kaplan-Meier plots of phase III oncology trials.

Missing visual elements (MVE) in Kaplan-Meier (KM) curves can misrepresent data, preclude curve reconstruction, and hamper transparency. This study evaluated KM plots of phase III oncology trials. MVE were defined as an incomplete y-axis range or missing number at risk table in a KM curve. Surrogate endpoint KM curves were additionally evaluated for complete interpretability, defined by (1) reporting the number of censored patients and (2) correspondence of the disease assessment interval with the number at risk interval. Among 641 trials enrolling 518 235 patients, 116 trials (18%) had MVE in KM curves. Industry sponsorship, larger trials, and more recently published trials were correlated with lower odds of MVE. Only 3% of trials (15 of 574) published surrogate endpoint KM plots with complete interpretability. Improvements in the quality of KM curves of phase III oncology trials, particularly for surrogate endpoints, are needed for greater interpretability, reproducibility, and transparency in oncology research.

Differential Treatment Effects of Subgroup Analyses in Phase 3 Oncology Trials From 2004 to 2020.

Importance: Subgroup analyses are often performed in oncology to investigate differential treatment effects and may even constitute the basis for regulatory approvals. Current understanding of the features, results, and quality of subgroup analyses is limited. Objective: To evaluate forest plot interpretability and credibility of differential treatment effect claims among oncology trials. Design, Setting, and Participants: This cross-sectional study included randomized phase 3 clinical oncology trials published prior to 2021. Trials were screened from ClinicalTrials.gov. Main Outcomes and Measures: Missing visual elements in forest plots were defined as a missing point estimate or use of a linear x-axis scale for hazard and odds ratios. Multiplicity of testing control was recorded. Differential treatment effect claims were rated using the Instrument for Assessing the Credibility of Effect Modification Analyses. Linear and logistic regressions evaluated associations with outcomes. Results: Among 785 trials, 379 studies (48%) enrolling 331 653 patients reported a subgroup analysis. The forest plots of 43% of trials (156 of 363) were missing visual elements impeding interpretability. While 4148 subgroup effects were evaluated, only 1 trial (0.3%) controlled for multiple testing. On average, trials that did not meet the primary end point conducted 2 more subgroup effect tests compared with trials meeting the primary end point (95% CI, 0.59-3.43 tests; P = .006). A total of 101 differential treatment effects were claimed across 15% of trials (55 of 379). Interaction testing was missing in 53% of trials (29 of 55) claiming differential treatment effects. Trials not meeting the primary end point were associated with greater odds of no interaction testing (odds ratio, 4.47; 95% CI, 1.42-15.55, P = .01). The credibility of differential treatment effect claims was rated as low or very low in 93% of cases (94 of 101). Conclusions and Relevance: In this cross-sectional study of phase 3 oncology trials, nearly half of trials presented a subgroup analysis in their primary publication. However, forest plots of these subgroup analyses largely lacked essential features for interpretation, and most differential treatment effect claims were not supported. Oncology subgroup analyses should be interpreted with caution, and improvements to the quality of subgroup analyses are needed.

Association of differential censoring with survival and suboptimal control arms among oncology clinical trials.

Differential censoring, which refers to censoring imbalance between treatment arms, may bias the interpretation of survival outcomes in clinical trials. In 146 phase III oncology trials with statistically significant time-to-event surrogate primary endpoints, we evaluated the association between differential censoring in the surrogate primary endpoints, control arm adequacy, and the subsequent statistical significance of overall survival results. Twenty-four (16%) trials exhibited differential censoring that favored the control arm, whereas 15 (10%) exhibited differential censoring that favored the experimental arm. Positive overall survival was more common in control arm differential censoring trials (63%) than in trials without differential censoring (37%) or with experimental arm differential censoring (47%; odds ratio = 2.64, 95% confidence interval = 1.10 to 7.20; P = .04). Control arm differential censoring trials more frequently used suboptimal control arms at 46% compared with 20% without differential censoring and 13% with experimental arm differential censoring (odds ratio = 3.60, 95% confidence interval = 1.29 to 10.0; P = .007). The presence of control arm differential censoring in trials with surrogate primary endpoints, especially in those with overall survival conversion, may indicate an inadequate control arm and should be examined and explained.

Editorial Commentary: Augmentation With Allograft Patch Results in Similar Outcomes to Anterior Cable Reconstruction With Autograft Biceps Tendon for Chronic, Retracted, Anterior, L-Shaped Supraspinatus Tears.

Chronic retracted rotator cuff tears are difficult entities to treat. L-shaped tears are a particular subset of such rotator cuff tears that pose challenges for surgeons attempting to reduce the supraspinatus tendon back to the greater tuberosity. Lack of full coverage of the tuberosity, need for medialization of the tendon, undue tension, and incomplete reconstitution of the rotator cable are some of the reasons L-shaped retracted tears of the supraspinatus can be challenging. Anterior cable reconstruction (ACR) is a technique that has gained increasing recent popularity, as is the use of patch augmentation. The long head of the biceps tendon is often readily available for use in ACR, but when it isn't, patch augmentation is an option for partially repairable rotator cuff tears. These produce similar postoperative improvements in range of motion as well as Constant and American Shoulder and Elbow Surgeons scores, but comparison to partial repair is still unknown.

Optic neuropathy in high myopia: Glaucoma or high myopia or both?

Due to the increasing prevalence of high myopia around the world, structural and functional damages to the optic nerve in high myopia has recently attracted much attention. Evidence has shown that high myopia is related to the development of glaucomatous or glaucoma-like optic neuropathy, and that both have many common features. These similarities often pose a diagnostic challenge that will affect the future management of glaucoma suspects in high myopia. In this review, we summarize similarities and differences in optic neuropathy arising from non-pathologic high myopia and glaucoma by considering their respective structural and functional characteristics on fundus photography, optical coherence tomography scanning, and visual field tests. These features may also help to distinguish the underlying mechanisms of the optic neuropathies and to determine management strategies for patients with high myopia and glaucoma.

Update on coronavirus disease 2019: Ophthalmic Manifestations and Adverse Reactions to Vaccination.

The coronavirus disease 2019 (COVID-19) pandemic caused by the severe acute respiratory syndrome coronavirus 2 was one of the most devastating public health issues in recent decades. The ophthalmology community is as concerned about the COVID-19 pandemic as the global public health community is, as COVID-19 was recognized to affect multiple organs in the human body, including the eyes, early in the course of the outbreak. Ophthalmic manifestations of COVID-19 are highly variable and could range from mild ocular surface abnormalities to potentially sight and life-threatening orbital and neuro-ophthalmic diseases. Furthermore, ophthalmic manifestations may also be the presenting or the only findings in COVID-19 infections. Meanwhile, global vaccination campaigns to attain herd immunity in different populations are the major strategy to mitigate the pandemic. As novel vaccinations against COVID-19 emerged, so were reports on adverse ophthalmic reactions potentially related to such. As the world enters a post-pandemic state where COVID-19 continues to exist and evolve as an endemic globally, the ophthalmology community ought to be aware of and keep abreast of the latest knowledge of ophthalmic associations with COVID-19 and its vaccinations. This review is a summary of the latest literature on the ophthalmic manifestations of COVID-19 and the adverse ophthalmic reactions related to its vaccinations.

Prevalence and implications of significance testing for baseline covariate imbalance in randomised cancer clinical trials: The Table 1 Fallacy.

BACKGROUND: The 'Table 1 Fallacy' refers to the unsound use of significance testing for comparing the distributions of baseline variables between randomised groups to draw erroneous conclusions about balance or imbalance. We performed a cross-sectional study of the Table 1 Fallacy in phase III oncology trials. METHODS: From ClinicalTrials.gov, 1877 randomised trials were screened. Multivariable logistic regressions evaluated predictors of the Table 1 Fallacy. RESULTS: A total of 765 randomised controlled trials involving 553,405 patients were analysed. The Table 1 Fallacy was observed in 25% of trials (188 of 765), with 3% of comparisons deemed significant (59 of 2353), approximating the typical 5% type I error assertion probability. Application of trial-level multiplicity corrections reduced the rate of significant findings to 0.3% (six of 2345 tests). Factors associated with lower odds of the Table 1 Fallacy included industry sponsorship (adjusted odds ratio [aOR] 0.29, 95% confidence interval [CI] 0.18-0.47; multiplicity-corrected P < 0.0001), larger trial size (≥795 versus <280 patients; aOR 0.32, 95% CI 0.19-0.53; multiplicity-corrected P = 0.0008), and publication in a European versus American journal (aOR 0.06, 95% CI 0.03-0.13; multiplicity-corrected P < 0.0001). CONCLUSIONS: This study highlights the persistence of the Table 1 Fallacy in contemporary oncology randomised controlled trials, with one of every four trials testing for baseline differences after randomisation. Significance testing is a suboptimal method for identifying unsound randomisation procedures and may encourage misleading inferences. Journal-level enforcement is a possible strategy to help mitigate this fallacy.

Outcomes of Goniotomy With or Without Secondary Intraocular Lens Implantation in Pediatric Glaucoma Following Cataract Surgery: A Prospective Pilot Study.

PURPOSE: To report the outcomes of a 120-degree goniotomy (GT) with or without secondary intraocular lens (IOL) implantation in glaucoma following cataract surgery (GFCS). DESIGN: Prospective, observational study. METHODS: Pediatric patients with GFCS who underwent standalone 120-degree GT or 120-degree GT combined with secondary IOL implantation (GT+IOL) from March 2022 to August 2022 at the Zhongshan Ophthalmic Center were recruited. Primary outcomes were intraocular pressure (IOP) and the number of ocular hypotensive medications. A secondary outcome was the surgical success rate. Success was defined as a postoperative IOP within the range of 5-21 mm Hg. Complete and qualified successes were defined, as the above, without and with ocular hypotensive medications, respectively. RESULTS: Thirty-two eyes of 22 patients were included. The mean age at the time of GT was 68.5 ± 29.3 months. The mean follow-up duration was 12.2 ± 2.3 months (9-15 mo). Mean IOP decreased from 30.9 ± 4.8 mm Hg on 2 (interquartile range = 1) medications at baseline to 15.8 ± 3.6 mm Hg on 0 (interquartile range = 1.5) medication at the latest visit in all eyes. The overall complete and qualified success rates were 68.8% and 90.6%, respectively. There were no significant differences in IOP, number of medications, and complete and qualified success rates between the standalone GT and GT+IOL groups at the latest follow-up at 9 months postoperatively. CONCLUSIONS: To reduce the need for additional surgery, 120-degree GT was a safe and effective surgical treatment for GFCS in children, which could be combined with secondary IOL implantation in aphakic eyes with GFCS.

Challenges, Complexities, and Considerations in the Design and Interpretation of Late-Phase Oncology Trials.

Optimal management of cancer patients relies heavily on late-phase oncology randomized controlled trials. A comprehensive understanding of the key considerations in designing and interpreting late-phase trials is crucial for improving subsequent trial design, execution, and clinical decision-making. In this review, we explore important aspects of late-phase oncology trial design. We begin by examining the selection of primary endpoints, including the advantages and disadvantages of using surrogate endpoints. We address the challenges involved in assessing tumor progression and discuss strategies to mitigate bias. We define informative censoring bias and its impact on trial results, including illustrative examples of scenarios that may lead to informative censoring. We highlight the traditional roles of the log-rank test and hazard ratio in survival analyses, along with their limitations in the presence of nonproportional hazards as well as an introduction to alternative survival estimands, such as restricted mean survival time or MaxCombo. We emphasize the distinctions between the design and interpretation of superiority and noninferiority trials, and compare Bayesian and frequentist statistical approaches. Finally, we discuss appropriate utilization of phase II and phase III trial results in shaping clinical management recommendations and evaluate the inherent risks and benefits associated with relying on phase II data for treatment decisions.

Advances in Radiotherapy for Rectal Cancer.

The current preferred standard of care management for patients with locally advanced rectal cancer is total neoadjuvant therapy, in which all chemotherapy and radiotherapy is delivered before surgery. Within this approach, developed in response to persistently high distant failure rates despite excellent local control with preoperative chemoradiotherapy, there remains questions regarding the optimal radiotherapy regimen (short course vs long course) and sequencing of chemotherapy (induction vs consolidation).

Incidence of Primary End Point Changes Among Active Cancer Phase 3 Randomized Clinical Trials.

Importance: Primary end point (PEP) changes to an active clinical trial raise questions regarding trial quality and the risk of outcome reporting bias. It is unknown how the frequency and transparency of the reported changes depend on reporting method and whether the PEP changes are associated with trial positivity (ie, the trial met the prespecified statistical threshold for PEP positivity). Objectives: To assess the frequency of reported PEP changes in oncology randomized clinical trials (RCTs) and whether these changes are associated with trial positivity. Design, Setting, and Participants: This cross-sectional study used publicly available data for complete oncology phase 3 RCTs registered in ClinicalTrials.gov from inception through February 2020. Main Outcomes and Measures: The main outcome was change between the initial PEP and the final reported PEP, assessed using 3 methods: (1) history of tracked changes on ClinicalTrials.gov, (2) self-reported changes noted in the article, and (3) changes reported within the protocol, including all available protocol documents. Logistic regression analyses were performed to evaluate whether PEP changes were associated with US Food and Drug Administration approval or trial positivity. Results: Of 755 included trials, 145 (19.2%) had PEP changes found by at least 1 of the 3 detection methods. Of the 145 trials with PEP changes, 102 (70.3%) did not have PEP changes disclosed within the manuscript. There was significant variability in rates of PEP detection by each method (χ2 = 72.1; P < .001). Across all methods, PEP changes were detected at higher rates when multiple versions of the protocol (47 of 148 [31.8%]) were available compared with 1 version (22 of 134 [16.4%]) or no protocol (76 of 473 [16.1%]) (χ2 = 18.7; P < .001). Multivariable analysis demonstrated that PEP changes were associated with trial positivity (odds ratio, 1.86; 95% CI, 1.25-2.82; P = .003). Conclusions and Relevance: This cross-sectional study revealed substantial rates of PEP changes among active RCTs; PEP changes were markedly underreported in published articles and mostly occurred after reported study completion dates. Significant discrepancies in the rate of detected PEP changes call into question the role of increased protocol transparency and completeness in identifying key changes occurring in active trials.