Optimal timing for an accelerated interim futility analysis incorporating real world data.

BACKGROUND: Randomized controlled trials include interim monitoring guidelines to stop early for safety, efficacy, or futility. Futility monitoring facilitates re-allocation of limited resources. However, conventional methods for interim futility monitoring require a trial to accrue nearly half of the outcome data to make a reliable early stopping decision, limiting its benefit. As early stopping for futility will not inflate type-I error, these analyses are an appealing venue for incorporating external data to improve efficiency. METHODS: We propose a Bayesian approach to futility monitoring leveraging real world data using Semi-Supervised MIXture Multi-source Exchangeability Models, which accounts for both measured and unmeasured differences between data sources. We implement futility monitoring using predictive probabilities and investigate the optimal timing with respect to the expected sample size under the null hypothesis. Because we only incorporate external data during the interim futility analysis the proposed design is not limited by type-I error inflation. RESULTS: When the external and trial data are exchangeable, the proposed method provides a roughly 70 person reduction in expected sample size under the null. Under scenarios where exchangeability does not hold, our approach still provides a 10-20 person reduction in expected sample size under the null with about 80% power. CONCLUSIONS: External data borrowing in interim futility monitoring is a promising venue to improve trial efficiency without type-I error inflation. Approaches that are acceptable to regulatory authorities and leverage the complementary strengths of real world and trial data are vital to more efficiently allocate limited resources amongst clinical trials.

Semi-supervised mixture multi-source exchangeability model for leveraging real-world data in clinical trials.

The traditional trial paradigm is often criticized as being slow, inefficient, and costly. Statistical approaches that leverage external trial data have emerged to make trials more efficient by augmenting the sample size. However, these approaches assume that external data are from previously conducted trials, leaving a rich source of untapped real-world data (RWD) that cannot yet be effectively leveraged. We propose a semi-supervised mixture (SS-MIX) multisource exchangeability model (MEM); a flexible, two-step Bayesian approach for incorporating RWD into randomized controlled trial analyses. The first step is a SS-MIX model on a modified propensity score and the second step is a MEM. The first step targets a representative subgroup of individuals from the trial population and the second step avoids borrowing when there are substantial differences in outcomes among the trial sample and the representative observational sample. When comparing the proposed approach to competing borrowing approaches in a simulation study, we find that our approach borrows efficiently when the trial and RWD are consistent, while mitigating bias when the trial and external data differ on either measured or unmeasured covariates. We illustrate the proposed approach with an application to a randomized controlled trial investigating intravenous hyperimmune immunoglobulin in hospitalized patients with influenza, while leveraging data from an external observational study to supplement a subgroup analysis by influenza subtype.