IBIS: identify biomarker-based subgroups with a Bayesian enrichment design for targeted combination therapy.

BACKGROUND: Combination therapies directed at multiple targets have potentially improved treatment effects for cancer patients. Compared to monotherapy, targeted combination therapy leads to an increasing number of subgroups and complicated biomarker-based efficacy profiles, making it more difficult for efficacy evaluation in clinical trials. Therefore, it is necessary to develop innovative clinical trial designs to explore the efficacy of targeted combination therapy in different subgroups and identify patients who are more likely to benefit from the investigational combination therapy. METHODS: We propose a statistical tool called 'IBIS' to Identify BIomarker-based Subgroups and apply it to the enrichment design framework. The IBIS contains three main elements: subgroup division, efficacy evaluation and subgroup identification. We first enumerate all possible subgroup divisions based on biomarker levels. Then, Jensen-Shannon divergence is used to distinguish high-efficacy and low-efficacy subgroups, and Bayesian hierarchical model (BHM) is employed to borrow information within these two subsets for efficacy evaluation. Regarding subgroup identification, a hypothesis testing framework based on Bayes factors is constructed. This framework also plays a key role in go/no-go decisions and enriching specific population. Simulation studies are conducted to evaluate the proposed method. RESULTS: The accuracy and precision of IBIS could reach a desired level in terms of estimation performance. In regard to subgroup identification and population enrichment, the proposed IBIS has superior and robust characteristics compared with traditional methods. An example of how to obtain design parameters for an adaptive enrichment design under the IBIS framework is also provided. CONCLUSIONS: IBIS has the potential to be a useful tool for biomarker-based subgroup identification and population enrichment in clinical trials of targeted combination therapy.

Considerations for identifying the "right" subgroup in adaptive enrichment trials.

Adaptive Enrichment Trials aim to make efficient use of data in a pivotal trial of a new targeted therapy to both (a) more precisely identify who benefits from that therapy and (b) improve the likelihood of successfully concluding that the drug is effective, while controlling the probability of false positives. There are a number of frameworks for conducting such a trial and decisions that must be made regarding how to identify that target subgroup. Among those decisions, one must choose how aggressively to restrict enrollment criteria based on the accumulating evidence in the trial. In this article, we empirically evaluate the impact of aggressive versus conservative enrollment restrictions on the power of the trial to detect an effect of treatment. We identify that, in some cases, a more aggressive strategy can substantially improve power. This additionally raises an important question regarding label indication: To what degree do we need a formal test of the hypothesis of no treatment effect in the exact population implied by the label indication? We discuss this question and evaluate how our answer for adaptive enrichment trials may relate to the answer implied by current practice for broad eligibility trials.

Bayesian adaptive trial design for a continuous biomarker with possibly nonlinear or nonmonotone prognostic or predictive effects.

As diseases like cancer are increasingly understood on a molecular level, clinical trials are being designed to reveal or validate subpopulations in which an experimental therapy has enhanced benefit. Such biomarker-driven designs, particularly "adaptive enrichment" designs that initially enroll an unselected population and then allow for later restriction of accrual to "marker-positive" patients based on interim results, are increasingly popular. Many biomarkers of interest are naturally continuous, however, and most existing design approaches either require upfront dichotomization or force monotonicity through algorithmic searches for a single marker threshold, thereby excluding the possibility that the continuous biomarker has a nondisjoint and truly nonlinear or nonmonotone prognostic relationship with outcome or predictive relationship with treatment effect. To address this, we propose a novel trial design that leverages both the actual shapes of any continuous marker effects (both prognostic and predictive) and their corresponding posterior uncertainty in an adaptive decision-making framework. At interim analyses, this marker knowledge is updated and overall or marker-driven decisions are reached such as continuing enrollment to the next interim analysis or terminating early for efficacy or futility. Using simulations and patient-level data from a multi-center Children's Oncology Group trial in Acute Lymphoblastic Leukemia, we derive the operating characteristics of our design and compare its performance to a traditional approach that identifies and applies a dichotomizing marker threshold.

Bayesian group sequential enrichment designs based on adaptive regression of response and survival time on baseline biomarkers.

Precision medicine relies on the idea that, for a particular targeted agent, only a subpopulation of patients is sensitive to it and thus may benefit from it therapeutically. In practice, it is often assumed based on preclinical data that a treatment-sensitive subpopulation is known, and moreover that the agent is substantively efficacious in that subpopulation. Due to important differences between preclinical settings and human biology, however, data from patients treated with a new targeted agent often show that one or both of these assumptions are false. This paper provides a Bayesian randomized group sequential enrichment design that compares an experimental treatment to a control based on survival time and uses early response as an ancillary outcome to assist with adaptive variable selection and enrichment. Initially, the design enrolls patients under broad eligibility criteria. At each interim decision, submodels for regression of response and survival time on a baseline covariate vector and treatment are fit; variable selection is used to identify a covariate subvector that characterizes treatment-sensitive patients and determines a personalized benefit index, and comparative superiority and futility decisions are made. Enrollment of each cohort is restricted to the most recent adaptively identified treatment-sensitive patients. Group sequential decision cutoffs are calibrated to control overall type I error and account for the adaptive enrollment restriction. The design provides a basis for precision medicine by identifying a treatment-sensitive subpopulation, if it exists, and determining whether the experimental treatment is superior to the control in that subpopulation. A simulation study shows that the proposed design reliably identifies a sensitive subpopulation, yields much higher generalized power compared to several existing enrichment designs and a conventional all-comers group sequential design, and is robust.

Enrichment Bayesian design for randomized clinical trials using categorical biomarkers and a binary outcome.

BACKGROUND: Adaptive clinical trials have been increasingly commonly employed to select a potential target population for one trial without conducting trials separately. Such enrichment designs typically consist of two or three stages, where the first stage serves as a screening process for selecting a specific subpopulation. METHODS: We propose a Bayesian design for randomized clinical trials with a binary outcome that focuses on restricting the inclusion to a subset of patients who are likely to benefit the most from the treatment during trial accrual. Several Bayesian measures of efficacy and treatment-by-subset interactions were used to dictate the enrichment, either based on Gail and Simon's or Millen's criteria. A simulation study was used to assess the performance of our design. The method is exemplified in a real randomized clinical trial conducted in patients with respiratory failure that failed to show any benefit of high flow oxygen supply compared with standard oxygen. RESULTS: The use of the enrichment rules allowed the detection of the existence of a treatment-by-subset interaction more rapidly compared with Gail and Simon's criteria, with decreasing proportions of enrollment in the whole sample, and the proportions of enrichment lower, in the presence of interaction based on Millen's criteria. In the real dataset, this may have allowed the detection of the potential interest of high flow oxygen in patients with a SOFA neurological score ≥ 1. CONCLUSION: Enrichment designs that handle the uncertainty in treatment efficacy by focusing on the target population offer a promising balance for trial efficiency and ease of interpretation.

Adaptive enrichment trials: What are the benefits?

When planning a Phase III clinical trial, suppose a certain subset of patients is expected to respond particularly well to the new treatment. Adaptive enrichment designs make use of interim data in selecting the target population for the remainder of the trial, either continuing with the full population or restricting recruitment to the subset of patients. We define a multiple testing procedure that maintains strong control of the familywise error rate, while allowing for the adaptive sampling procedure. We derive the Bayes optimal rule for deciding whether or not to restrict recruitment to the subset after the interim analysis and present an efficient algorithm to facilitate simulation-based optimisation, enabling the construction of Bayes optimal rules in a wide variety of problem formulations. We compare adaptive enrichment designs with traditional nonadaptive designs in a broad range of examples and draw clear conclusions about the potential benefits of adaptive enrichment.

A pragmatic adaptive enrichment design for selecting the right target population for cancer immunotherapies.

One of the challenges in the design of confirmatory trials is to deal with uncertainties regarding the optimal target population for a novel drug. Adaptive enrichment designs (AED) which allow for a data-driven selection of one or more prespecified biomarker subpopulations at an interim analysis have been proposed in this setting but practical case studies of AEDs are still relatively rare. We present the design of an AED with a binary endpoint in the highly dynamic setting of cancer immunotherapy. The trial was initiated as a conventional trial in early triple-negative breast cancer but amended to an AED based on emerging data external to the trial suggesting that PD-L1 status could be a predictive biomarker. Operating characteristics are discussed including the concept of a minimal detectable difference, that is, the smallest observed treatment effect that would lead to a statistically significant result in at least one of the target populations at the interim or the final analysis, respectively, in the setting of AED.

Multi-stage adaptive enrichment trial design with subgroup estimation.

We consider the problem of estimating the best subgroup and testing for treatment effect in a clinical trial. We define the best subgroup as the subgroup that maximizes a utility function that reflects the trade-off between the subgroup size and the treatment effect. For moderate effect sizes and sample sizes, simpler methods for subgroup estimation worked better than more complex tree-based regression approaches. We propose a three-stage design with a weighted inverse normal combination test to test the hypothesis of no treatment effect across the three stages.

The precision interventions for severe and/or exacerbation-prone asthma (PrecISE) adaptive platform trial: statistical considerations.

The Precision Interventions for Severe and/or Exacerbation-prone Asthma (PrecISE) study is an adaptive platform trial designed to investigate novel interventions to severe asthma. The study is conducted under a master protocol and utilizes a crossover design with each participant receiving up to five interventions and at least one placebo. Treatment assignments are based on the patients' biomarker profiles and precision health methods are incorporated into the interim and final analyses. We describe key elements of the PrecISE study including the multistage adaptive enrichment strategy, early stopping of an intervention for futility, power calculations, and the primary analysis strategy.

Two-stage adaptive enrichment design for testing an active factor.

We propose an adaptive enrichment approach to test an active factor, which is a factor whose effect is non-zero in at least one subpopulation. We implement a two-stage play-the-winner design where all subjects in the second stage are enrolled from the subpopulation that has the highest observed effect in the first stage. We recommend a weighted Fisher's combination of the most powerful test for each stage, respectively: the first stage Hotelling's test and the second stage noncentral chi-square test. The test is further extended to cover binary outcomes and time-to-event outcomes.

ASIED: a Bayesian adaptive subgroup-identification enrichment design.

Developing targeted therapies based on patients' baseline characteristics and genomic profiles such as biomarkers has gained growing interests in recent years. Depending on patients' clinical characteristics, the expression of specific biomarkers or their combinations, different patient subgroups could respond differently to the same treatment. An ideal design, especially at the proof of concept stage, should search for such subgroups and make dynamic adaptation as the trial goes on. When no prior knowledge is available on whether the treatment works on the all-comer population or only works on the subgroup defined by one biomarker or several biomarkers, it is necessary to incorporate the adaptive estimation of the heterogeneous treatment effect to the decision-making at interim analyses. To address this problem, we propose an Adaptive Subgroup-Identification Enrichment Design, ASIED, to simultaneously search for predictive biomarkers, identify the subgroups with differential treatment effects, and modify study entry criteria at interim analyses when justified. More importantly, we construct robust quantitative decision-making rules for population enrichment when the interim outcomes are heterogeneous in the context of a multilevel target product profile, which defines the minimal and targeted levels of treatment effect. Through extensive simulations, the ASIED is demonstrated to achieve desirable operating characteristics and compare favorably against alternatives.

Using Bayesian modeling in frequentist adaptive enrichment designs.

Our increased understanding of the mechanistic heterogeneity of diseases has pushed the development of targeted therapeutics. We do not expect all patients with a given disease to benefit from a targeted drug; only those in the target population. That is, those with sufficient dysregulation in the biomolecular pathway targeted by treatment. However, due to complexity of the pathway, and/or technical issues with our characterizing assay, it is often hard to characterize the target population until well into large-scale clinical trials. This has stimulated the development of adaptive enrichment trials; clinical trials in which the target population is adaptively learned; and enrollment criteria are adaptively updated to reflect this growing understanding. This paper proposes a framework for group-sequential adaptive enrichment trials. Building on the work of Simon & Simon (2013). Adaptive enrichment designs for clinical trials. Biostatistics 14(4), 613-625), it includes a frequentist hypothesis test at the end of the trial. However, it uses Bayesian methods to optimize the decisions required during the trial (regarding how to restrict enrollment) and Bayesian methods to estimate effect size, and characterize the target population at the end of the trial. This joint frequentist/Bayesian design combines the power of Bayesian methods for decision making with the use of a formal hypothesis test at the end of the trial to preserve the studywise probability of a type I error.

Multi-stage enrichment and basket trial designs with population selection.

As biomarker information from early-phase trials can be unreliable due to high variability, it is logical to take a prospective two-stage approach when designing a late-phase confirmatory trial, ie, refining the target population at the first stage and performing the hypothesis testing at the second stage. The use of a reliable intermediate endpoint at the first stage can further improve the trial efficiency from both time and cost perspectives. Nevertheless, there are needs for expanding such two-stage confirmatory designs to more stages for monitoring efficacy on the refined population. There is limited literature on this matter, particularly for two popular designs with population selection midway, ie, the biomarker enrichment design and the basket design. In this manuscript, we focus on these two popular designs and discuss how to implement the interim efficacy analyses after population refinement while controlling type I error. Power and stopping probability are also explored for the two designs.

Patient recruitment strategies for adaptive enrichment designs with time-to-event endpoints.

BACKGROUND: Adaptive enrichment designs for clinical trials have great potential for the development of targeted therapies. They enable researchers to stop the recruitment process for a certain population in mid-course based on an interim analysis. However, adaptive enrichment designs increase the total trial period owing to the stoppage in patient recruitment to make interim decisions. This is a major drawback; it results in delays in the submission of clinical trial reports and the appearance of drugs on the market. Here, we explore three types of patient recruitment strategy for the development of targeted therapies based on the adaptive enrichment design. METHODS: We consider recruitment methods which provide an option to continue recruiting patients from the overall population or only from the biomarker-positive population even during the interim decision period. A simulation study was performed to investigate the operating characteristics by comparing an adaptive enrichment design using the recruitment methods with a non-enriched design. RESULTS: The number of patients was similar for both recruitment methods. Nevertheless, the adaptive enrichment design was beneficial in settings in which the recruitment period is expected to be longer than the follow-up period. In these cases, the adaptive enrichment design with continued recruitment from the overall population or only from the biomarker-positive population even during the interim decision period conferred a major advantage, since the total trial period did not differ substantially from that of trials employing the non-enriched design. By contrast, the non-enriched design should be used in settings in which the follow-up period is expected to be longer than the recruitment period, since the total trial period was notably shorter than that of the adaptive enrichment design. Furthermore, the utmost care is needed when the distribution of patient recruitment is concave, i.e., when patient recruitment is slow during the early period, since the total trial period is extended. CONCLUSIONS: Adaptive enrichment designs that entail continued recruitment methods are beneficial owing to the shorter total trial period than expected in settings in which the recruitment period is expected to be longer than the follow-up period and the biomarker-positive population is promising.

Flexible alpha allocation strategies for confirmatory adaptive enrichment clinical trials with a prespecified subgroup.

Adaptive enrichment designs have recently received considerable attention as they have the potential to make drug development process for personalized medicine more efficient. Several statistical approaches have been proposed so far in the literature and the operating characteristics of these approaches are extensively investigated using simulation studies. In this paper, we improve on existing adaptive enrichment designs by assigning unequal weights to the significance levels associated with the hypotheses of the overall population and a prespecified subgroup. More specifically, we focus on the standard combination test, a modified combination test, the marginal combination test, and the partial conditional error rate approach and explore the operating characteristics of these approaches by a simulation study. We show that these approaches can lead to power gains, compared to existing approaches, if the weights are chosen carefully.

Biomarker threshold adaptive designs for survival endpoints.

Due to the importance of precision medicine, it is essential to identify the right patients for the right treatment. Biomarkers, which have been commonly used in clinical research as well as in clinical practice, can facilitate selection of patients with a good response to the treatment. In this paper, we describe a biomarker threshold adaptive design with survival endpoints. In the first stage, we determine subgroups for one or more biomarkers such that patients in these subgroups benefit the most from the new treatment. The analysis in this stage can be based on historical or pilot studies. In the second stage, we sample subjects from the subgroups determined in the first stage and randomly allocate them to the treatment or control group. Extensive simulation studies are conducted to examine the performance of the proposed design. Application to a real data example is provided for implementation of the first-stage algorithms.

Group sequential designs with prospectively planned rules for subpopulation enrichment.

We propose a class of randomized trial designs aimed at gaining the advantages of wider generalizability and faster recruitment while mitigating the risks of including a population for which there is greater a priori uncertainty. We focus on testing null hypotheses for the overall population and a predefined subpopulation. Our designs have preplanned rules for modifying enrollment criteria based on data accrued at interim analyses. For example, enrollment can be restricted if the participants from a predefined subpopulation are not benefiting from the new treatment. Our designs have the following features: the multiple testing procedure fully leverages the correlation among statistics for different populations; the asymptotic familywise Type I error rate is strongly controlled; for outcomes that are binary or normally distributed, the decision rule and multiple testing procedure are functions of the data only through minimal sufficient statistics. Our designs incorporate standard group sequential boundaries for each population of interest; this may be helpful in communicating the designs, because many clinical investigators are familiar with such boundaries, which can be summarized succinctly in a single table or graph. We demonstrate these designs through simulations of a Phase III trial of a new treatment for stroke. User-friendly, free software implementing these designs is described. Copyright © 2016 John Wiley & Sons, Ltd.

An optimal stratified Simon two-stage design.

In Phase II oncology trials, therapies are increasingly being evaluated for their effectiveness in specific populations of interest. Such targeted trials require designs that allow for stratification based on the participants' molecular characterisation. A targeted design proposed by Jones and Holmgren (JH) Jones CL, Holmgren E: 'An adaptive Simon two-stage design for phase 2 studies of targeted therapies', Contemporary Clinical Trials 28 (2007) 654-661.determines whether a drug only has activity in a disease sub-population or in the wider disease population. Their adaptive design uses results from a single interim analysis to decide whether to enrich the study population with a subgroup or not; it is based on two parallel Simon two-stage designs. We study the JH design in detail and extend it by providing a few alternative ways to control the familywise error rate, in the weak sense as well as the strong sense. We also introduce a novel optimal design by minimising the expected sample size. Our extended design contributes to the much needed framework for conducting Phase II trials in stratified medicine. © 2016 The Authors Pharmaceutical Statistics Published by John Wiley & Sons Ltd.

Latest Developments in "Adaptive Enrichment" Clinical Trial Designs in Oncology.

As cancer has become better understood on the molecular level with the evolution of gene sequencing techniques, considerations for individualized therapy using predictive biomarkers (those associated with a treatment's effect) have shifted to a new level. In the last decade or so, randomized "adaptive enrichment" clinical trials have become increasingly utilized to strike a balance between enrolling all patients with a given tumor type, versus enrolling only a subpopulation whose tumors are defined by a potential predictive biomarker related to the mechanism of action of the experimental therapy. In this review article, we review recent innovative design extensions and adaptations to adaptive enrichment designs proposed during the last few years in the clinical trial methodology literature, both from Bayesian and frequentist perspectives.