A frequentist design for basket trials using adaptive lasso.

A basket trial aims to expedite the drug development process by evaluating a new therapy in multiple populations within the same clinical trial. Each population, referred to as a "basket", can be defined by disease type, biomarkers, or other patient characteristics. The objective of a basket trial is to identify the subset of baskets for which the new therapy shows promise. The conventional approach would be to analyze each of the baskets independently. Alternatively, several Bayesian dynamic borrowing methods have been proposed that share data across baskets when responses appear similar. These methods can achieve higher power than independent testing in exchange for a risk of some inflation in the type 1 error rate. In this paper we propose a frequentist approach to dynamic borrowing for basket trials using adaptive lasso. Through simulation studies we demonstrate adaptive lasso can achieve similar power and type 1 error to the existing Bayesian methods. The proposed approach has the benefit of being easier to implement and faster than existing methods. In addition, the adaptive lasso approach is very flexible: it can be extended to basket trials with any number of treatment arms and any type of endpoint.

Bayesian hierarchical modeling in interim futility analysis for two parallel clinical trials.

Incorporating interim analysis into a trial design is gaining popularity in the field of confirmatory clinical trials, where two studies may be conducted in parallel (ie, twin studies) in order to provide substantial evidence per the requirement of FDA guidance. Interim futility analysis provides a chance to check for the "disaster" scenario when the treatment has a high probability to be not more efficacious than the control. Therefore, it is an efficient tool to mitigate risk of running a complete and expansive trial under such scenario. There is no agreement among trial designers that interim analysis should be based on individual study data or pooled data under the twin study scenario. In fact, it is a dilemma for most scientists when specifying the interim analysis strategy at the design stage as the true treatment effects of the twin studies are unknown no matter how similar they are intended to be. To address the issue, we developed a Bayesian hierarchical modeling method to allow dynamic data borrowing between twin studies and demonstrated a favorable characteristic of the new method over the separate and pooled analyses. We evaluated a wide spectrum of the heterogeneity hyperparameters and visualized its critical impact on the Bayesian model's characteristic. Based on the evaluation, we made a suggestion on the heterogeneity hyperparameter selection independent of any a priori knowledge. We also applied our method to a case study where predictive powers of different methods are compared.

A Bayesian method to detect drug-drug interaction using external information for spontaneous reporting system.

Due to the insufficiency of safety assessments of clinical trials for drugs, further assessments are required for post-marketed drugs. In addition to adverse drug reactions (ADRs) induced by one drug, drug-drug interaction (DDI)-induced ADR should also be investigated. The spontaneous reporting system (SRS) is a powerful tool for evaluating the safety of drugs continually. In this study, we propose a novel Bayesian method for detecting potential DDIs in a database collected by the SRS. By applying a power prior, the proposed method can borrow information from similar drugs for a drug assessed DDI to increase sensitivity of detection. The proposed method can also adjust the amount of the information borrowed by tuning the parameters in power prior. In the simulation study, we demonstrate the aforementioned increase in sensitivity. Depending on the scenarios, approximately 20 points of sensitivity of the proposed method increase from an existing method to a maximum. We also indicate the possibility of early detection of potential DDIs by the proposed method through analysis of the database shared by the Food and Drug Administration. In conclusion, the proposed method has a higher sensitivity and a novel criterion to detect potential DDIs early, provided similar drugs have similar observed-expected ratios to the drug under assessment.

A scaled kernel density estimation prior for dynamic borrowing of historical information with application to clinical trial design.

Incorporating historical data into a current data analysis can improve estimation of parameters shared across both datasets and increase the power to detect associations of interest while reducing the time and cost of new data collection. Several methods for prior distribution elicitation have been introduced to allow for the data-driven borrowing of historical information within a Bayesian analysis of the current data. We propose scaled Gaussian kernel density estimation (SGKDE) prior distributions as potentially more flexible alternatives. SGKDE priors directly use posterior samples collected from a historical data analysis to approximate probability density functions, whose variances depend on the degree of similarity between the historical and current datasets, which are used as prior distributions in the current data analysis. We compare the performances of the SGKDE priors with some existing approaches using a simulation study. Data from a recently completed phase III clinical trial of a maternal vaccine for respiratory syncytial virus are used to further explore the properties of SGKDE priors when designing a new clinical trial while incorporating historical data. Overall, both studies suggest that the new approach results in improved parameter estimation and power in the current data analysis compared to the considered existing methods.

Simulating and reporting frequentist operating characteristics of clinical trials that borrow external information: Towards a fair comparison in case of one-arm and hybrid control two-arm trials.

Borrowing information from historical or external data to inform inference in a current trial is an expanding field in the era of precision medicine, where trials are often performed in small patient cohorts for practical or ethical reasons. Even though methods proposed for borrowing from external data are mainly based on Bayesian approaches that incorporate external information into the prior for the current analysis, frequentist operating characteristics of the analysis strategy are often of interest. In particular, type I error rate and power at a prespecified point alternative are the focus. We propose a procedure to investigate and report the frequentist operating characteristics in this context. The approach evaluates type I error rate of the test with borrowing from external data and calibrates the test without borrowing to this type I error rate. On this basis, a fair comparison of power between the test with and without borrowing is achieved. We show that no power gains are possible in one-sided one-arm and two-arm hybrid control trials with normal endpoint, a finding proven in general before. We prove that in one-arm fixed-borrowing situations, unconditional power (i.e., when external data is random) is reduced. The Empirical Bayes power prior approach that dynamically borrows information according to the similarity of current and external data avoids the exorbitant type I error inflation occurring with fixed borrowing. In the hybrid control two-arm trial we observe power reductions as compared to the test calibrated to borrowing that increase when considering unconditional power.

Dynamic borrowing of historical controls adjusting for covariates in vaccine efficacy clinical trials.

Traditional vaccine efficacy trials usually use fixed designs and often require large sample sizes. Recruiting a large number of subjects can make the trial expensive, long, and difficult to conduct. A possible approach to reduce the sample size and speed up the development is to use historical controls. In this paper, we extend the robust mixture prior (RMP) approach (a well established approach for Bayesian dynamic borrowing of historical controls) to adjust for covariates. The adjustment is done using classical methods from causal inference: inverse probability of treatment weighting, G-computation and double-robust estimation. We evaluate these covariate-adjusted RMP approaches using a comprehensive simulation study and demonstrate their use by performing a retrospective analysis of a prophylactic human papillomavirus vaccine efficacy trial. Adjusting for covariates reduces the drift between current and historical controls, with a beneficial effect on bias, control of type I error and power.

Addressing statistical issues when leveraging external control data in pediatric clinical trials using Bayesian dynamic borrowing.

Conducting a well-powered and adequately controlled clinical trial in children is often challenging. Bayesian approaches are an attractive option for addressing such challenges as they provide a quantitatively rigorous and integrated framework that makes use of current control data to check and borrow information from historical control data. However various practical concerns and related statistical issues emerge when implementing such Bayesian borrowing approaches. In this manuscript we use a motivating case study to discuss a rigorous stepwise approach on how to address those issues within the Bayesian framework. Specifically, a comprehensive quantitative framework is proposed to assess the extent, synergy, and impact of borrowing. Steps on computing the measures to interpret borrowing are illustrated. Those measures can further help to determine whether additional discounting of external information is necessary.

Covariate handling approaches in combination with dynamic borrowing for hybrid control studies.

Borrowing data from external control has been an appealing strategy for evidence synthesis when conducting randomized controlled trials (RCTs). Often named hybrid control trials, they leverage existing control data from clinical trials or potentially real-world data (RWD), enable trial designs to allocate more patients to the novel intervention arm, and improve the efficiency or lower the cost of the primary RCT. Several methods have been established and developed to borrow external control data, among which the propensity score methods and Bayesian dynamic borrowing framework play essential roles. Noticing the unique strengths of propensity score methods and Bayesian hierarchical models, we utilize both methods in a complementary manner to analyze hybrid control studies. In this article, we review methods including covariate adjustments, propensity score matching and weighting in combination with dynamic borrowing and compare the performance of these methods through comprehensive simulations. Different degrees of covariate imbalance and confounding are examined. Our findings suggested that the conventional covariate adjustment in combination with the Bayesian commensurate prior model provides the highest power with good type I error control under the investigated settings. It has desired performance especially under scenarios of different degrees of confounding. To estimate efficacy signals in the exploratory setting, the covariate adjustment method in combination with the Bayesian commensurate prior is recommended.

Vaccine clinical trials with dynamic borrowing of historical controls: Two retrospective studies.

Traditional vaccine efficacy trials usually use fixed designs with fairly large sample sizes. Recruiting a large number of subjects requires longer time and higher costs. Furthermore, vaccine developers are more than ever facing the need to accelerate vaccine development to fulfill the public's medical needs. A possible approach to accelerate development is to use the method of dynamic borrowing of historical controls in clinical trials. In this paper, we evaluate the feasibility and the performance of this approach in vaccine development by retrospectively analyzing two real vaccine studies: a relatively small immunological trial (typical early phase study) and a large vaccine efficacy trial (typical Phase 3 study) assessing prophylactic human papillomavirus vaccine. Results are promising, particularly for early development immunological studies, where the adaptive design is feasible, and control of type I error is less relevant.

A frequentist approach to dynamic borrowing.

There has been growing interest in leveraging external control data to augment a randomized control group data in clinical trials and enable more informative decision making. In recent years, the quality and availability of real-world data have improved steadily as external controls. However, information borrowing by directly pooling such external controls with randomized controls may lead to biased estimates of the treatment effect. Dynamic borrowing methods under the Bayesian framework have been proposed to better control the false positive error. However, the numerical computation and, especially, parameter tuning, of those Bayesian dynamic borrowing methods remain a challenge in practice. In this paper, we present a frequentist interpretation of a Bayesian commensurate prior borrowing approach and describe intrinsic challenges associated with this method from the perspective of optimization. Motivated by this observation, we propose a new dynamic borrowing approach using adaptive lasso. The treatment effect estimate derived from this method follows a known asymptotic distribution, which can be used to construct confidence intervals and conduct hypothesis tests. The finite sample performance of the method is evaluated through extensive Monte Carlo simulations under different settings. We observed highly competitive performance of adaptive lasso compared to Bayesian approaches. Methods for selecting tuning parameters are also thoroughly discussed based on results from numerical studies and an illustration example.

Matching design for augmenting the control arm of a randomized controlled trial using real-world data.

Randomized clinical trials (RCTs) have often been considered as the gold standard in drug development, but they may not be fully powered due to limited patient population and can even lead to ethical concerns in rare disease studies. In situations like this, real-world data (RWD)/historical data can be utilized to augment or possibly serve as the control arm for the current trial. If a subset of subjects from the RWD/historical trial could be matched to the concurrent control arm subjects and they are deemed comparable following certain criteria, then pooling the matched subjects from the historical control arm and the concurrent control arm can boost the power. In this paper, we propose two matching methods of borrowing historical control data that not only balance key observed baseline covariates but also ensure the comparability of responses between the historical and concurrent controls. Close similarity in response variables among controls reduces Type I error inflation and provides further protection against unmeasured confounding bias, which is a major challenge in using RWD. Simulation studies are conducted to evaluate the empirical performance of the two matching methods in terms of Type I error rate and power, and an illustrative description of a planned study is presented.

Borrowing external information to improve Bayesian confidence propagation neural network.

PURPOSE: A Bayesian confidence propagation neural network (BCPNN) is a signal detection method used by the World Health Organization Uppsala Monitoring Centre to analyze spontaneous reporting system databases. We modify the BCPNN to increase its sensitivity for detecting potential adverse drug reactions (ADRs). METHOD: In a BCPNN, the information component (IC) is defined as an index of disproportionality between the observed and expected number of reported drugs and events. Our proposed method adjusts the IC value by borrowing information about events that have occurred in drugs defined as similar to the target drug. We compare the performance of our method with that of a traditional BCPNN through a simulation study. RESULTS: The false positive rate of the proposed method was lower than that of the traditional BCPNN method and close to the nominal value, 0.025, around the true difference in ICs between the target drug and similar drugs equal to 0. The sensitivity of the proposed method was much higher than that of the traditional BCPNN method in case in which the difference in ICs between the target drug and similar drugs ranges from 0 to 2. When applied to a database managed by Japanese regulatory authority, the proposed method could detect known ADRs earlier than the traditional method. CONCLUSIONS: The proposed method is a novel criterion for early detection of signals if similar drugs have the same tendencies. The proposed BCPNN tends to have higher sensitivity when the true difference is greater than 0.

Empirical profile Bayesian estimation for extrapolation of historical adult data to pediatric drug development.

For pediatric drug development, the clinical effectiveness of the study medication for the adult population has already been demonstrated. Given the fact that it is usually not feasible to enroll a large number of pediatric patients, appropriately leveraging historical adult data into pediatric evaluation may be critical to success of pediatric drug development. In this manuscript, we propose a new empirical Bayesian approach, profile Bayesian estimation, to dynamically borrow adult information to the evaluation of treatment effect in pediatric patients. The new approach demonstrates an attractive balance between type I error control and power gain under the transfer-ability assumption that the pediatric treatment effect size may differ from the adult treatment effect size. The decision making boundary mimics the real-world practice in pediatric drug development. In addition, the posterior mean of the proposed empirical profile Bayesian is an unbiased estimator of the true pediatric treatment effect. We compare our approach to robust mixture prior with prior weight for informative borrowing set to 0.5 or 0.9, regular Bayesian approach, and frequentist for both type I error and power.

Critical appraisal of Bayesian dynamic borrowing from an imperfectly commensurate historical control.

Bayesian dynamic borrowing designs facilitate borrowing information from historical studies. Historical data, when perfectly commensurate with current data, have been shown to reduce the trial duration and the sample size, while inflation in the type I error and reduction in the power have been reported, when imperfectly commensurate. These results, however, were obtained without considering that Bayesian designs are calibrated to meet regulatory requirements in practice and even no-borrowing designs may use information from historical data in the calibration. The implicit borrowing of historical data suggests that imperfectly commensurate historical data may similarly impact no-borrowing designs negatively. We will provide a fair appraiser of Bayesian dynamic borrowing and no-borrowing designs. We used a published selective adaptive randomization design and real clinical trial setting and conducted simulation studies under varying degrees of imperfectly commensurate historical control scenarios. The type I error was inflated under the null scenario of no intervention effect, while larger inflation was noted with borrowing. The larger inflation in type I error under the null setting can be offset by the greater probability to stop early correctly under the alternative. Response rates were estimated more precisely and the average sample size was smaller with borrowing. The expected increase in bias with borrowing was noted, but was negligible. Using Bayesian dynamic borrowing designs may improve trial efficiency by stopping trials early correctly and reducing trial length at the small cost of inflated type I error.

Power gains by using external information in clinical trials are typically not possible when requiring strict type I error control.

In the era of precision medicine, novel designs are developed to deal with flexible clinical trials that incorporate many treatment strategies for multiple diseases in one trial setting. This situation often leads to small sample sizes in disease-treatment combinations and has fostered the discussion about the benefits of borrowing of external or historical information for decision-making in these trials. Several methods have been proposed that dynamically discount the amount of information borrowed from historical data based on the conformity between historical and current data. Specifically, Bayesian methods have been recommended and numerous investigations have been performed to characterize the properties of the various borrowing mechanisms with respect to the gain to be expected in the trials. However, there is common understanding that the risk of type I error inflation exists when information is borrowed and many simulation studies are carried out to quantify this effect. To add transparency to the debate, we show that if prior information is conditioned upon and a uniformly most powerful test exists, strict control of type I error implies that no power gain is possible under any mechanism of incorporation of prior information, including dynamic borrowing. The basis of the argument is to consider the test decision function as a function of the current data even when external information is included. We exemplify this finding in the case of a pediatric arm appended to an adult trial and dichotomous outcome for various methods of dynamic borrowing from adult information to the pediatric arm. In conclusion, if use of relevant external data is desired, the requirement of strict type I error control has to be replaced by more appropriate metrics.

Dynamic borrowing through empirical power priors that control type I error.

In order for historical data to be considered for inclusion in the design and analysis of clinical trials, prospective rules are essential. Incorporation of historical data may be of particular interest in the case of small populations where available data is scarce and heterogeneity is not as well understood, and thus conventional methods for evidence synthesis might fall short. The concept of power priors can be particularly useful for borrowing evidence from a single historical study. Power priors employ a parameter γ ∈ [ 0 , 1 ] that quantifies the heterogeneity between the historical study and the new study. However, the possibility of borrowing data from a historical trial will usually be associated with an inflation of the type I error. We suggest a new, simple method of estimating the power parameter suitable for the case when only one historical dataset is available. The method is based on predictive distributions and parameterized in such a way that the type I error can be controlled by calibrating to the degree of similarity between the new and historical data. The method is demonstrated for normal responses in a one or two group setting. Generalization to other models is straightforward.

Using Bayesian Dynamic Borrowing to Maximize the Use of Existing Data: A Case-Study.

Bayesian Dynamic Borrowing (BDB) designs are being increasingly used in clinical drug development. These methods offer a mathematically rigorous and robust approach to increase efficiency and strengthen evidence by integrating existing trial data into a new clinical trial. The regulatory acceptability of BDB is evolving and varies between and within regulatory agencies. This paper describes how BDB can be used to design a new randomised clinical trial including external data to supplement the planned sample size and discusses key considerations related to data re-use and BDB in drug development programs. A case-study illustrating the planning and evaluation of a BDB approach to support registration of a new medicine with the Center for Drug Evaluation in China will be presented. Key steps and considerations for the use of BDB will be discussed and evaluated, including how to decide whether it is appropriate to borrow external data, which external data can be re-used, the weight to put on the external data and how to decide if the new study has successfully demonstrated treatment benefit.

Bayesian Dynamic Borrowing of Historical Information with Applications to the Analysis of Large-Scale Assessments.

The purpose of this paper is to demonstrate and evaluate the use of Bayesian dynamic borrowing (Viele et al, in Pharm Stat 13:41-54, 2014) as a means of systematically utilizing historical information with specific applications to large-scale educational assessments. Dynamic borrowing via Bayesian hierarchical models is a special case of a general framework of historical borrowing where the degree of borrowing depends on the heterogeneity among historical data and current data. A joint prior distribution over the historical and current data sets is specified with the degree of heterogeneity across the data sets controlled by the variance of the joint distribution. We apply Bayesian dynamic borrowing to both single-level and multilevel models and compare this approach to other historical borrowing methods such as complete pooling, Bayesian synthesis, and power priors. Two case studies using data from the Program for International Student Assessment reveal the utility of Bayesian dynamic borrowing in terms of predictive accuracy. This is followed by two simulation studies that reveal the utility of Bayesian dynamic borrowing over simple pooling and power priors in cases where the historical data is heterogeneous compared to the current data based on bias, mean squared error, and predictive accuracy. In cases of homogeneous historical data, Bayesian dynamic borrowing performs similarly to data pooling, Bayesian synthesis, and power priors. In contrast, for heterogeneous historical data, Bayesian dynamic borrowing performed at least as well, if not better, than other methods of borrowing with respect to mean squared error, percent bias, and leave-one-out cross-validation.

Sample size calculation for clinical trials analyzed with the meta-analytic-predictive approach.

The meta-analytic-predictive (MAP) approach is a Bayesian method to incorporate historical controls in new trials that aims to increase the statistical power and reduce the required sample size. Here we investigate how to calculate the sample size of the new trial when historical data is available, and the MAP approach is used in the analysis. In previous applications of the MAP approach, the prior effective sample size (ESS) acted as a metric to quantify the number of subjects the historical information is worth. However, the validity of using the prior ESS in sample size calculation (i.e., reducing the number of randomized controls by the derived prior ESS) is questionable, because different approaches may yield different values for prior ESS. In this work, we propose a straightforward Monte Carlo approach to calculate the sample size that achieves the desired power in the new trial given available historical controls. To make full use of the available historical information to simulate the new trial data, the control parameters are not taken as a point estimate but sampled from the MAP prior. These sampled control parameters and the MAP prior based on the historical data are then used to derive the statistical power for the treatment effect and the resulting required sample size. The proposed sample size calculation approach is illustrated with real-life data sets with different outcomes from three studies. The results show that this approach to calculating the required sample size for the MAP analysis is straightforward and generic.

Minimizing control group allocation in randomized trials using dynamic borrowing of external control data - An application to second line therapy for non-small cell lung cancer.

BACKGROUND: Enrollment of participants to control arms in clinical trials can be challenging. This is particularly an issue in oncology trials where the standard-of-care is shifting rapidly and several promising experimental treatments are undergoing phase III testing. Novel methods for utilizing external control data may mitigate these challenges, but applied examples are sparse. Here, we therefore illustrate how Bayesian dynamic borrowing of external individual patient level control data from similar clinical trials can often reduce randomization to the control intervention without substantially trading-off precision. We further explore which types of scenarios yield viable trade-offs, and which do not. PATIENTS AND METHODS: We obtained individual patient data on patients being treated with second-line therapy for non-small cell lung cancer from Project Data Sphere with minimal in/exclusion criteria restrictions, and applied Bayesian hierarchical models with uninformative priors to generate illustrative synthetic control groups. RESULTS: Four phase III clinical trials were identified and utilized in our analysis. Even when studies which are knowingly incongruent with one another are selected to generate a synthetic control, the nature of this methodology minimizes improper borrowing from historical data. The use of a small concurrent control group within a trial greatly reduces penalized selection, and our results demonstrate the ability to reduce allocation to the control group by up to 80% with a minimal increase in uncertainty when closely matched historical data is available. CONCLUSION: Dynamic borrowing using Bayesian hierarchical models with uninformative priors represents a novel approach to utilizing external controls for comparative estimates using single arm evidence.