Modeling the multi-state natural history of rare diseases with heterogeneous individual patient data: A simulation study.

Multi-state survival models are used to represent the natural history of a disease, forming the basis of a health technology assessment comparing a novel treatment to current practice. Constructing such models for rare diseases is problematic, since evidence sources are typically much sparser and more heterogeneous. This simulation study investigated different one-stage and two-stage approaches to meta-analyzing individual patient data (IPD) in a multi-state survival setting when the number and size of studies being meta-analyzed are small. The objective was to assess methods of different complexity to see when they are accurate, when they are inaccurate and when they struggle to converge due to the sparsity of data. Biologically plausible multi-state IPD were simulated from study- and transition-specific hazard functions. One-stage frailty and two-stage stratified models were estimated, and compared to a base case model that did not account for study heterogeneity. Convergence and the bias/coverage of population-level transition probabilities to, and lengths of stay in, each state were used to assess model performance. A real-world application to Duchenne Muscular Dystrophy, a neuromuscular rare disease, was conducted, and a software demonstration is provided. Models not accounting for study heterogeneity were consistently out-performed by two-stage models. Frailty models struggled to converge, particularly in scenarios of low heterogeneity, and predictions from models that did converge were also subject to bias. Stratified models may be better suited to meta-analyzing disparate sources of IPD in rare disease natural history/economic modeling, as they converge more consistently and produce less biased predictions of lengths of stay.

Evaluation of Flexible Parametric Relative Survival Approaches for Enforcing Long-Term Constraints When Extrapolating All-Cause Survival.

OBJECTIVES: Parametric models are used to estimate the lifetime benefit of an intervention beyond the range of trial follow-up. Recent recommendations have suggested more flexible survival approaches and the use of external data when extrapolating. Both of these can be realized by using flexible parametric relative survival modeling. The overall aim of this article is to introduce and contrast various approaches for applying constraints on the long-term disease-related (excess) mortality including cure models and evaluate the consequent implications for extrapolation. METHODS: We describe flexible parametric relative survival modeling approaches. We then introduce various options for constraining the long-term excess mortality and compare the performance of each method in simulated data. These methods include fitting a standard flexible parametric relative survival model, enforcing statistical cure, and forcing the long-term excess mortality to converge to a constant. We simulate various scenarios, including where statistical cure is reasonable and where the long-term excess mortality persists. RESULTS: The compared approaches showed similar survival fits within the follow-up period. However, when extrapolating the all-cause survival beyond trial follow-up, there is variation depending on the assumption made about the long-term excess mortality. Altering the time point from which the excess mortality is constrained enables further flexibility. CONCLUSIONS: The various constraints can lead to applying explicit assumptions when extrapolating, which could lead to more plausible survival extrapolations. The inclusion of general population mortality directly into the model-building process, which is possible for all considered approaches, should be adopted more widely in survival extrapolation in health technology assessment.

Perils of Randomized Controlled Trial Survival Extrapolation Assuming Treatment Effect Waning: Why the Distinction Between Marginal and Conditional Estimates Matters.

OBJECTIVES: A long-term, constant, protective treatment effect is a strong assumption when extrapolating survival beyond clinical trial follow-up; hence, sensitivity to treatment effect waning is commonly assessed for economic evaluations. Forcing a hazard ratio (HR) to 1 does not necessarily estimate loss of individual-level treatment effect accurately because of HR selection bias. A simulation study was designed to explore the behavior of marginal HRs under a waning conditional (individual-level) treatment effect and demonstrate bias in forcing a marginal HR to 1 when the estimand is "survival difference with individual-level waning". METHODS: Data were simulated under 4 parameter combinations (varying prognostic strength of heterogeneity and treatment effect). Time-varying marginal HRs were estimated in scenarios where the true conditional HR attenuated to 1. Restricted mean survival time differences, estimated having constrained the marginal HR to 1, were compared with true values to assess bias induced by marginal constraints. RESULTS: Under loss of conditional treatment effect, the marginal HR took a value >1 because of covariate imbalances. Constraining this value to 1 lead to restricted mean survival time difference bias of up to 0.8 years (57% increase). Inflation of effect size estimates also increased with the magnitude of initial protective treatment effect. CONCLUSIONS: Important differences exist between survival extrapolations assuming marginal versus conditional treatment effect waning. When a marginal HR is constrained to 1 to assess efficacy under individual-level treatment effect waning, the survival benefits associated with the new treatment will be overestimated, and incremental cost-effectiveness ratios will be underestimated.

A cautionary tale: an evaluation of the performance of treatment switching adjustment methods in a real world case study.

BACKGROUND: Treatment switching in randomised controlled trials (RCTs) is a problem for health technology assessment when substantial proportions of patients switch onto effective treatments that would not be available in standard clinical practice. Often statistical methods are used to adjust for switching: these can be applied in different ways, and performance has been assessed in simulation studies, but not in real-world case studies. We assessed the performance of adjustment methods described in National Institute for Health and Care Excellence Decision Support Unit Technical Support Document 16, applying them to an RCT comparing panitumumab to best supportive care (BSC) in colorectal cancer, in which 76% of patients randomised to BSC switched onto panitumumab. The RCT resulted in intention-to-treat hazard ratios (HR) for overall survival (OS) of 1.00 (95% confidence interval [CI] 0.82-1.22) for all patients, and 0.99 (95% CI 0.75-1.29) for patients with wild-type KRAS (Kirsten rat sarcoma virus). METHODS: We tested several applications of inverse probability of censoring weights (IPCW), rank preserving structural failure time models (RPSFTM) and simple and complex two-stage estimation (TSE) to estimate treatment effects that would have been observed if BSC patients had not switched onto panitumumab. To assess the performance of these analyses we ascertained the true effectiveness of panitumumab based on: (i) subsequent RCTs of panitumumab that disallowed treatment switching; (ii) studies of cetuximab that disallowed treatment switching, (iii) analyses demonstrating that only patients with wild-type KRAS benefit from panitumumab. These sources suggest the true OS HR for panitumumab is 0.76-0.77 (95% CI 0.60-0.98) for all patients, and 0.55-0.73 (95% CI 0.41-0.93) for patients with wild-type KRAS. RESULTS: Some applications of IPCW and TSE provided treatment effect estimates that closely matched the point-estimates and CIs of the expected truths. However, other applications produced estimates towards the boundaries of the expected truths, with some TSE applications producing estimates that lay outside the expected true confidence intervals. The RPSFTM performed relatively poorly, with all applications providing treatment effect estimates close to 1, often with extremely wide confidence intervals. CONCLUSIONS: Adjustment analyses may provide unreliable results. How each method is applied must be scrutinised to assess reliability.

Is Intention to Treat Still the Gold Standard or Should Health Technology Assessment Agencies Embrace a Broader Estimands Framework?: Insights and Perspectives From the National Institute for Health and Care Excellence and Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen on the International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use E9 (R1) Addendum.

OBJECTIVES: The International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH) E9 (R1) addendum will have an important impact on the design and analysis of randomized controlled clinical trials, which represent crucial sources of evidence in health technology assessments, and on the intention-to-treat (ITT) principle in particular. This article brings together a task force of health economists and statisticians in academic institutes and the pharmaceutical industry, to examine the implications of the addendum from the perspective of the National Institute for Health and Care Excellence (NICE) and the Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (IQWiG) and to address the question of whether the ITT principle should be considered the gold standard for estimating treatment effects. METHODS: We review the ITT principle, as introduced in the ICH E9 guideline. We then present an overview of the ICH E9 (R1) addendum and its estimand framework, highlighting its premise and the proposed strategies for handling intercurrent events, and examine some cases among submissions to IQWiG and NICE. RESULTS: IQWiG and NICE appear to have diverging perspectives around the relevance of the ITT principle and, in particular, the acceptance of hypothetical strategies for estimating treatment effects, as suggested by examples where the sponsor proposed an alternative approach to the ITT principle when accounting for treatment switching for interventional oncology trials. CONCLUSIONS: The ICH E9 (R1) addendum supports the use of methods that depart from the ITT principle. The relevance of estimands using these methods depends on the perspectives and objectives of payers. It is challenging to design a study that meets all stakeholders' research questions. Different estimands may serve to answer different relevant questions or decision problems.

Propensity Score and Instrumental Variable Techniques in Observational Transplantation Studies: An Overview and Worked Example Relating to Pre-Transplant Cardiac Screening.

Inferring causality from observational studies is difficult due to inherent differences in patient characteristics between treated and untreated groups. The randomised controlled trial is the gold standard study design as the random allocation of individuals to treatment and control arms should result in an equal distribution of known and unknown prognostic factors at baseline. However, it is not always ethically or practically possible to perform such a study in the field of transplantation. Propensity score and instrumental variable techniques have theoretical advantages over conventional multivariable regression methods and are increasingly being used within observational studies to reduce the risk of confounding bias. An understanding of these techniques is required to critically appraise the literature. We provide an overview of propensity score and instrumental variable techniques for transplant clinicians, describing their principles, assumptions, strengths, and weaknesses. We discuss the different patient populations included in analyses and how to interpret results. We illustrate these points using data from the Access to Transplant and Transplant Outcome Measures study examining the association between pre-transplant cardiac screening in kidney transplant recipients and post-transplant cardiac events.

Prevalence of Immature Survival Data for Anti-Cancer Drugs Presented to the National Institute for Health and Care Excellence and Impact on Decision Making.

OBJECTIVES: This research aims to explore how often the National Institute for Health and Care Excellence (NICE) uses immature overall survival data to inform reimbursement decisions on cancer treatments, and the implications of this for resource allocation decisions. METHODS: NICE cancer technology appraisals published between 2015 and 2017 were reviewed to determine the prevalence of using immature survival data. A case study was used to demonstrate the potential impact of basing decisions on immature data. The economic model submitted by the company was reconstructed and was populated first using survival data available at the time of the appraisal, and then using data from an updated data cut published after the appraisal concluded. The incremental cost-effectiveness ratios (ICERs) obtained using the different data cuts were compared. Probabilistic sensitivity analysis was undertaken and expected value of perfect information estimated. RESULTS: Forty-one percent of NICE cancer technology appraisals used immature data to inform reimbursement decisions. In the case study, NICE gave a positive recommendation for a limited patient subgroup, with ICERs too high in the complete patient population. ICERs were dramatically lower when the final data cut was used, irrespective of the parametric model used to model survival. Probabilistic sensitivity analysis and expected value of perfect information may not have fully characterized uncertainty, because as they did not account for structural uncertainty. CONCLUSION: Analyses of cancer treatments using immature survival data may result in incorrect estimates of survival benefit and cost-effectiveness, potentially leading to inappropriate funding decisions. This research highlights the importance of revisiting past decisions when updated data cuts become available.

Self-managed, computerised word finding therapy as an add-on to usual care for chronic aphasia post-stroke: An economic evaluation.

OBJECTIVE: To examine the cost-effectiveness of self-managed computerised word finding therapy as an add-on to usual care for people with aphasia post-stroke. DESIGN: Cost-effectiveness modelling over a life-time period, taking a UK National Health Service (NHS) and personal social service perspective. SETTING: Based on the Big CACTUS randomised controlled trial, conducted in 21 UK NHS speech and language therapy departments. PARTICIPANTS: Big CACTUS included 278 people with long-standing aphasia post-stroke. INTERVENTIONS: Computerised word finding therapy plus usual care; usual care alone; usual care plus attention control. MAIN MEASURES: Incremental cost-effectiveness ratios (ICER) were calculated, comparing the cost per quality adjusted life year (QALY) gained for each intervention. Credible intervals (CrI) for costs and QALYs, and probabilities of cost-effectiveness, were obtained using probabilistic sensitivity analysis. Subgroup and scenario analyses investigated cost-effectiveness in different subsets of the population, and the sensitivity of results to key model inputs. RESULTS: Adding computerised word finding therapy to usual care had an ICER of £42,686 per QALY gained compared with usual care alone (incremental QALY gain: 0.02 per patient (95% CrI: -0.05 to 0.10); incremental costs: £732.73 per patient (95% CrI: £674.23 to £798.05)). ICERs for subgroups with mild or moderate word finding difficulties were £22,371 and £21,262 per QALY gained respectively. CONCLUSION: Computerised word finding therapy represents a low cost add-on to usual care, but QALY gains and estimates of cost-effectiveness are uncertain. Computerised therapy is more likely to be cost-effective for people with mild or moderate, as opposed to severe, word finding difficulties.

Challenges in valuing and paying for combination regimens in oncology: reporting the perspectives of a multi-stakeholder, international workshop.

BACKGROUND: It is increasingly common for two or more treatments for cancer to be combined as a single regimen. Determining value and appropriate payment for such regimens can be challenging. This study discusses these challenges, and possible solutions. METHODS: Stakeholders from around the world attended a 2-day workshop, supported by a background paper. This study captures key outcomes from the discussion, but is not a consensus statement. RESULTS: Workshop attendees agreed that combining on-patent treatments can result in affordability and value for money challenges that delay or deny patient access to clinically effective treatments in many health systems. Options for addressing these challenges include: (i) Increasing the value of combination therapies through improved clinical development; (ii) Willingness to pay more for combinations than for single drugs offering similar benefit, or; (iii) Aligning the cost of constituent therapies with their value within a regimen. Workshop attendees felt that (i) and (iii) merited further discussion, whereas (ii) was unlikely to be justifiable. Views differed on the feasibility of (i). Key to (iii) would be systems allowing different prices to apply to different uses of a drug. CONCLUSIONS: Common ground was identified on immediate actions to improve access to combination regimens. These include an exploration of the legal challenges associated with price negotiations, and ensuring that pricing systems can support implementation of negotiated prices for specific uses. Improvements to clinical development and trial design should be pursued in the medium and longer term.

Adjusting for Treatment Switching in Oncology Trials: A Systematic Review and Recommendations for Reporting.

OBJECTIVES: To systematically review the quality of reporting on the application of switching adjustment approaches in published oncology trials and industry submissions to the National Institute for Health and Care Excellence Although methods such as the rank preserving structural failure time model (RPSFTM) and inverse probability of censoring weights (IPCW) have been developed to address treatment switching, the approaches are not widely accepted within health technology assessment. This limited acceptance may partly be a consequence of poor reporting on their application. METHODS: Published trials and industry submissions were obtained from searches of PubMed and nice.org.uk, respectively. The quality of reporting in these studies was judged against a checklist of reporting recommendations, which was developed by the authors based on detailed considerations of the methods. RESULTS: Thirteen published trials and 8 submissions to nice.org.uk satisfied inclusion criteria. The quality of reporting around the implementation of the RPSFTM and IPCW methods was generally poor. Few studies stated whether the adjustment approach was prespecified, more than a third failed to provide any justification for the chosen method, and nearly half neglected to perform sensitivity analyses. Further, it was often unclear how the RPSFTM and IPCW methods were implemented. CONCLUSIONS: Inadequate reporting on the application of switching adjustment methods increases uncertainty around results, which may contribute to the limited acceptance of these methods by decision makers. The proposed reporting recommendations aim to support the improved interpretation of analyses undertaken to adjust for treatment switching.

Survival Extrapolation in Cancer Immunotherapy: A Validation-Based Case Study.

BACKGROUND: Immune-checkpoint inhibitors may provide long-term survival benefits via a cured proportion, yet data are usually insufficient to prove this upon submission to health technology assessment bodies. OBJECTIVE: We revisited the National Institute for Health and Care Excellence assessment of ipilimumab in melanoma (TA319). We used updated data from the pivotal trial to assess the accuracy of the extrapolation methods used and compared these to previously unused techniques to establish whether an alternative extrapolation may have provided more accurate survival projections. METHODS: We compared projections from the piecewise survival model used in TA319 and those produced by alternative models (fit to trial data with minimum follow-up of 3 years) to a longer-term data cut (5-year follow-up). We also compared projections to external data to help assess validity. Alternative approaches considered were parametric, spline-based, mixture, and mixture-cure models. RESULTS: Only the survival model used in TA319 and a mixture-cure model provided 5-year survival predictions close to those observed in the 5-year follow-up data set. Standard parametric, spline, and non-curative-mixture models substantially underestimated 5-year survival. Survival estimates from the TA319 model and the mixture-cure model diverge considerably after 5 years and remain unvalidated. CONCLUSIONS: In our case study, only models that incorporated an element of external information (through a cure fraction combined with background mortality rates or using registry data) provided accurate estimates of 5-year survival. Flexible models that were able to capture the complex hazard functions observed during the trial, but which did not incorporate external information, extrapolated poorly.

Impact of Nonrandomized Dropout on Treatment Switching Adjustment in the Relapsing-Remitting Multiple Sclerosis CLARITY Trial and the CLARITY Extension Study.

OBJECTIVES: Statistical methods to adjust for treatment switching are commonly applied to randomized controlled trials (RCTs) in oncology. Nevertheless, RCTs with extension studies incorporating nonrandomized dropout require consideration of alternative adjustment methods. The current study used a recognized method and a novel method to adjust for treatment switching in relapsing-remitting multiple sclerosis (MS). METHODS: The Cladribine Tablets Treating Multiple Sclerosis Orally (CLARITY) RCT evaluated the efficacy of cladribine versus placebo over 96 weeks. Many (but not all) CLARITY participants enrolled in the 96-week CLARITY extension study; placebo-treated patients from CLARITY received cladribine (PP→LL), and cladribine-treated patients were re-randomized to placebo (LL→PP) or continued cladribine (LL→LL). End points were time to first qualifying relapse (FQR) and time to 3-month and 6-month confirmed disability progression (3mCDP, 6mCDP). We aimed to estimate the effectiveness of the LL→PP treatment strategy compared with a counterfactual (unobserved) PP→PP strategy. We applied the commonly used rank-preserving structural failure time model (RPSFTM) and a novel approach that combined propensity score matching (PSM) with inverse probability of censoring weights (IPCW). RESULTS: The RPSFTM resulted in LL→PP versus PP→PP hazard ratios (HRs) of 0.48 (95% confidence interval [CI] 0.36-0.62) for FQR, 0.62 (95% CI 0.46-0.84) for 3mCDP, and 0.62 (95% CI 0.44-0.88) for 6mCDP. The PSM+IPCW resulted in HRs of 0.47 (95% CI 0.38-0.63) for FQR, 0.61 (95% CI 0.43-0.86) for 3mCDP, and 0.63 (95% CI 0.40-0.87) for 6mCDP. CONCLUSIONS: The PSM+IPCW HRs were consistent with those from the RPSFTM, suggesting that the results were not substantially biased by informative dropout, assuming that all relevant confounders were controlled for. There was no statistical evidence of a reduction in the cladribine treatment effect during the extension period.

CHALLENGES AND METHODOLOGIES IN USING PROGRESSION FREE SURVIVAL AS A SURROGATE FOR OVERALL SURVIVAL IN ONCOLOGY.

OBJECTIVES: A primary outcome in oncology trials is overall survival (OS). However, to estimate OS accurately requires a sufficient number of patients to have died, which may take a long time. If an alternative end point is sufficiently highly correlated with OS, it can be used as a surrogate. Progression-free survival (PFS) is the surrogate most often used in oncology, but does not always satisfy the correlation conditions for surrogacy. We analyze the methodologies used when extrapolating from PFS to OS. METHODS: Davis et al. previously reviewed the use of surrogate end points in oncology, using papers published between 2001 and 2011. We extend this, reviewing papers published between 2012 and 2016. We also examine the reporting of statistical methods to assess the strength of surrogacy. RESULTS: The findings from 2012 to 2016 do not differ substantially from those of 2001 to 2011: the same factors are shown to affect the relationship between PFS and OS. The proportion of papers reporting individual patient data (IPD), strongly recommended for full assessment of surrogacy, remains low: 33 percent. A wide range of methods has been used to determine the appropriateness of surrogates. While usually adhering to reporting standards, the standard of scholarship appears sometimes to be questionable and the reporting of results often haphazard. CONCLUSIONS: Standards of analysis and reporting PFS to OS surrogate studies should be improved by increasing the rigor of statistical reporting and by agreeing to a minimum set of reporting guidelines. Moreover, the use of IPD to assess surrogacy should increase.

Overall Survival Endpoint in Oncology Clinical Trials: Addressing the Effect of Crossover--The Case of Pazopanib in Advanced Renal Cell Carcinoma.

OBJECTIVE: To identify the issues of using overall survival (OS) as a primary endpoint in the presence of crossover and the statistical analyses available to adjust for confounded OS due to crossover in oncology clinical trials. METHODS: An indirect comparison was conducted between pazopanib and sunitinib in advanced renal cell carcinoma. Statistical adjustment methods were used to estimate the true comparative effectiveness of these treatments. Recently, a head-to-head trial comparing pazopanib and sunitinib was completed. This provided the opportunity to compare the OS treatment effect estimated for pazopanib versus sunitinib using indirect comparison and statistical adjustment techniques with that observed in the head-to-head trial. RESULTS: Using a rank-preserving structural failure time model to adjust for crossover in the pazopanib registration trial, the indirect comparison of pazopanib versus sunitinib resulted in an OS hazard ratio (HR) of 0.97, while an unadjusted analysis resulted in an OS HR of 1.96. The head-to-head trial reported a final OS HR of 0.92 for pazopanib versus sunitinib. CONCLUSION: This case study supports the need to adjust for confounded OS due to crossover, which enables trials to meet ethical standards and provides decision makers with a more accurate estimate of treatment benefit.

The Cost of Costing Treatments Incorrectly: Errors in the Application of Drug Prices in Economic Evaluation Due to Failing to Account for the Distribution of Patient Weight.

BACKGROUND: The cost of pharmaceuticals dosed by weight or body surface area (BSA) can be estimated in several ways for economic evaluations. A review of 20 recent National Institute for Health and Care Excellence appraisals showed that 17 of them took the mean weight or BSA of patients, 2 costed the individual patient data from trials, and 2 fitted a distribution to patient-level data. OBJECTIVES: To investigate the estimated drug costs using different methodologies to account for patient characteristics for pharmaceuticals with a weight- or BSA-based posology. The secondary objective was to explore the suitability of general population data as a proxy for patient-level data. METHODS: Patient-level data were pooled from three clinical trials and used to calculate a hypothetical cost per administration of eight licensed pharmaceuticals, applying the three methods used in recent National Institute for Health and Care Excellence appraisals. The same analysis was performed using data from the Health Survey for England (in place of patient-level data) to investigate the validity of using general population data as a substitute for patient-level data. RESULTS: Compared with using patient-level data from clinical trials, the mean patient characteristics (weight or BSA) led to an underestimation of drug cost by 6.1% (range +1.5% to -25.5%). Fitting a distribution to patient-level data led to a mean difference of +0.04%. All estimates were consistent using general population data. CONCLUSIONS: Estimation of drug costs in health economic evaluation should account for the distribution in weight or BSA to produce accurate results. When patient data are not available, general population data may be used as an alternative.

TREATMENT SWITCHING: STATISTICAL AND DECISION-MAKING CHALLENGES AND APPROACHES.

OBJECTIVES: Treatment switching refers to the situation in a randomized controlled trial where patients switch from their randomly assigned treatment onto an alternative. Often, switching is from the control group onto the experimental treatment. In this instance, a standard intention-to-treat analysis does not identify the true comparative effectiveness of the treatments under investigation. We aim to describe statistical methods for adjusting for treatment switching in a comprehensible way for nonstatisticians, and to summarize views on these methods expressed by stakeholders at the 2014 Adelaide International Workshop on Treatment Switching in Clinical Trials. METHODS: We describe three statistical methods used to adjust for treatment switching: marginal structural models, two-stage adjustment, and rank preserving structural failure time models. We draw upon discussion heard at the Adelaide International Workshop to explore the views of stakeholders on the acceptability of these methods. RESULTS: Stakeholders noted that adjustment methods are based on assumptions, the validity of which may often be questionable. There was disagreement on the acceptability of adjustment methods, but consensus that when these are used, they should be justified rigorously. The utility of adjustment methods depends upon the decision being made and the processes used by the decision-maker. CONCLUSIONS: Treatment switching makes estimating the true comparative effect of a new treatment challenging. However, many decision-makers have reservations with adjustment methods. These, and how they affect the utility of adjustment methods, require further exploration. Further technical work is required to develop adjustment methods to meet real world needs, to enhance their acceptability to decision-makers.

TREATMENT SWITCHING IN CANCER TRIALS: ISSUES AND PROPOSALS.

OBJECTIVES: Treatment switching occurs when patients in a randomized clinical trial switch from the treatment initially assigned to them to another treatment, typically from the control to experimental treatment. This study discusses the issues this raises and possible approaches to addressing them in trials of cancer drugs. METHODS: Stakeholders from around the world were invited to a 1.5-day Workshop in Adelaide, Australia. This study attempts to capture the key points from the discussion and the perspectives of the various stakeholder groups, but is not a formal consensus statement. RESULTS: Treatment switching raises challenging ethical issues with arguments for and against allowing it. It is increasingly common in cancer drug trials and presents challenges for the interpretation of results by regulators, clinicians, patients, and payers. Proposals are offered for good practice in the design, management, and analysis of trials and wider development programs for cancer drugs in which treatment switching has occurred or is likely to. Recommendations are also offered for further action to improve understanding of the importance and challenges of treatment switching and to promote agreement between key stakeholders on guidelines and other steps to address these challenges. CONCLUSIONS: The handling of treatment switching in trials is of concern to all stakeholders. On the basis of the discussions at the Adelaide International Workshop, there would appear to be common ground on approaches to addressing treatment switching in cancer trials and scope for the development of formal guidelines to inform the work of regulators, payers, industry, trial designers and other stakeholders.

Adjusting for the Confounding Effects of Treatment Switching-The BREAK-3 Trial: Dabrafenib Versus Dacarbazine.

BACKGROUND: Patients with previously untreated BRAF V600E mutation-positive melanoma in BREAK-3 showed a median overall survival (OS) of 18.2 months for dabrafenib versus 15.6 months for dacarbazine (hazard ratio [HR], 0.76; 95% confidence interval, 0.48-1.21). Because patients receiving dacarbazine were allowed to switch to dabrafenib at disease progression, we attempted to adjust for the confounding effects on OS. MATERIALS AND METHODS: Rank preserving structural failure time models (RPSFTMs) and the iterative parameter estimation (IPE) algorithm were used. Two analyses, "treatment group" (assumes treatment effect could continue until death) and "on-treatment observed" (assumes treatment effect disappears with discontinuation), were used to test the assumptions around the durability of the treatment effect. RESULTS: A total of 36 of 63 patients (57%) receiving dacarbazine switched to dabrafenib. The adjusted OS HRs ranged from 0.50 to 0.55, depending on the analysis. The RPSFTM and IPE "treatment group" and "on-treatment observed" analyses performed similarly well. CONCLUSION: RPSFTM and IPE analyses resulted in point estimates for the OS HR that indicate a substantial increase in the treatment effect compared with the unadjusted OS HR of 0.76. The results are uncertain because of the assumptions associated with the adjustment methods. The confidence intervals continued to cross 1.00; thus, the adjusted estimates did not provide statistically significant evidence of a treatment benefit on survival. However, it is clear that a standard intention-to-treat analysis will be confounded in the presence of treatment switching-a reliance on unadjusted analyses could lead to inappropriate practice. Adjustment analyses provide useful additional information on the estimated treatment effects to inform decision making. IMPLICATIONS FOR PRACTICE: Treatment switching is common in oncology trials, and the implications of this for the interpretation of the clinical effectiveness and cost-effectiveness of the novel treatment are important to consider. If patients who switch treatments benefit from the experimental treatment and a standard intention-to-treat analysis is conducted, the overall survival advantage associated with the new treatment could be underestimated. The present study applied established statistical methods to adjust for treatment switching in a trial that compared dabrafenib and dacarbazine for metastatic melanoma. The results showed that this led to a substantially increased estimate of the overall survival treatment effect associated with dabrafenib.