Challenges and Opportunities in Interdisciplinary Research and Real-World Data for Treatment Sequences in Health Technology Assessments.

With an ever-increasing number of treatment options, the assessment of treatment sequences has become crucial in health technology assessment (HTA). This review systematically explores the multifaceted challenges inherent in evaluating sequences, delving into their interplay and nuances that go beyond economic model structures. We synthesised a 'roadmap' of literature from key methodological studies, highlighting the evolution of recent advances and emerging research themes. These insights were compared against HTA guidelines to identify potential avenues for future research. Our findings reveal a spectrum of challenges in sequence evaluation, encompassing selecting appropriate decision-analytic modelling approaches and comparators, deriving appropriate clinical effectiveness evidence in the face of data scarcity, scrutinising effectiveness assumptions and statistical adjustments, considering treatment displacement, and optimising model computations. Integrating methodologies from diverse disciplines-statistics, epidemiology, causal inference, operational research and computer science-has demonstrated promise in addressing these challenges. An updated review of application studies is warranted to provide detailed insights into the extent and manner in which these methodologies have been implemented. Data scarcity on the effectiveness of treatment sequences emerged as a dominant concern, especially because treatment sequences are rarely compared in clinical trials. Real-world data (RWD) provide an alternative means for capturing evidence on effectiveness and future research should prioritise harnessing causal inference methods, particularly Target Trial Emulation, to evaluate treatment sequence effectiveness using RWD. This approach is also adaptable for analysing trials harbouring sequencing information and adjusting indirect comparisons when collating evidence from heterogeneous sources. Such investigative efforts could lend support to reviews of HTA recommendations and contribute to synthesising external control arms involving treatment sequences.

A cautionary tale: an evaluation of the performance of treatment switching adjustment methods in a real world case study.

BACKGROUND: Treatment switching in randomised controlled trials (RCTs) is a problem for health technology assessment when substantial proportions of patients switch onto effective treatments that would not be available in standard clinical practice. Often statistical methods are used to adjust for switching: these can be applied in different ways, and performance has been assessed in simulation studies, but not in real-world case studies. We assessed the performance of adjustment methods described in National Institute for Health and Care Excellence Decision Support Unit Technical Support Document 16, applying them to an RCT comparing panitumumab to best supportive care (BSC) in colorectal cancer, in which 76% of patients randomised to BSC switched onto panitumumab. The RCT resulted in intention-to-treat hazard ratios (HR) for overall survival (OS) of 1.00 (95% confidence interval [CI] 0.82-1.22) for all patients, and 0.99 (95% CI 0.75-1.29) for patients with wild-type KRAS (Kirsten rat sarcoma virus). METHODS: We tested several applications of inverse probability of censoring weights (IPCW), rank preserving structural failure time models (RPSFTM) and simple and complex two-stage estimation (TSE) to estimate treatment effects that would have been observed if BSC patients had not switched onto panitumumab. To assess the performance of these analyses we ascertained the true effectiveness of panitumumab based on: (i) subsequent RCTs of panitumumab that disallowed treatment switching; (ii) studies of cetuximab that disallowed treatment switching, (iii) analyses demonstrating that only patients with wild-type KRAS benefit from panitumumab. These sources suggest the true OS HR for panitumumab is 0.76-0.77 (95% CI 0.60-0.98) for all patients, and 0.55-0.73 (95% CI 0.41-0.93) for patients with wild-type KRAS. RESULTS: Some applications of IPCW and TSE provided treatment effect estimates that closely matched the point-estimates and CIs of the expected truths. However, other applications produced estimates towards the boundaries of the expected truths, with some TSE applications producing estimates that lay outside the expected true confidence intervals. The RPSFTM performed relatively poorly, with all applications providing treatment effect estimates close to 1, often with extremely wide confidence intervals. CONCLUSIONS: Adjustment analyses may provide unreliable results. How each method is applied must be scrutinised to assess reliability.

Evaluation of Flexible Parametric Relative Survival Approaches for Enforcing Long-Term Constraints When Extrapolating All-Cause Survival.

OBJECTIVES: Parametric models are used to estimate the lifetime benefit of an intervention beyond the range of trial follow-up. Recent recommendations have suggested more flexible survival approaches and the use of external data when extrapolating. Both of these can be realized by using flexible parametric relative survival modeling. The overall aim of this article is to introduce and contrast various approaches for applying constraints on the long-term disease-related (excess) mortality including cure models and evaluate the consequent implications for extrapolation. METHODS: We describe flexible parametric relative survival modeling approaches. We then introduce various options for constraining the long-term excess mortality and compare the performance of each method in simulated data. These methods include fitting a standard flexible parametric relative survival model, enforcing statistical cure, and forcing the long-term excess mortality to converge to a constant. We simulate various scenarios, including where statistical cure is reasonable and where the long-term excess mortality persists. RESULTS: The compared approaches showed similar survival fits within the follow-up period. However, when extrapolating the all-cause survival beyond trial follow-up, there is variation depending on the assumption made about the long-term excess mortality. Altering the time point from which the excess mortality is constrained enables further flexibility. CONCLUSIONS: The various constraints can lead to applying explicit assumptions when extrapolating, which could lead to more plausible survival extrapolations. The inclusion of general population mortality directly into the model-building process, which is possible for all considered approaches, should be adopted more widely in survival extrapolation in health technology assessment.

Perils of Randomized Controlled Trial Survival Extrapolation Assuming Treatment Effect Waning: Why the Distinction Between Marginal and Conditional Estimates Matters.

OBJECTIVES: A long-term, constant, protective treatment effect is a strong assumption when extrapolating survival beyond clinical trial follow-up; hence, sensitivity to treatment effect waning is commonly assessed for economic evaluations. Forcing a hazard ratio (HR) to 1 does not necessarily estimate loss of individual-level treatment effect accurately because of HR selection bias. A simulation study was designed to explore the behavior of marginal HRs under a waning conditional (individual-level) treatment effect and demonstrate bias in forcing a marginal HR to 1 when the estimand is "survival difference with individual-level waning". METHODS: Data were simulated under 4 parameter combinations (varying prognostic strength of heterogeneity and treatment effect). Time-varying marginal HRs were estimated in scenarios where the true conditional HR attenuated to 1. Restricted mean survival time differences, estimated having constrained the marginal HR to 1, were compared with true values to assess bias induced by marginal constraints. RESULTS: Under loss of conditional treatment effect, the marginal HR took a value >1 because of covariate imbalances. Constraining this value to 1 lead to restricted mean survival time difference bias of up to 0.8 years (57% increase). Inflation of effect size estimates also increased with the magnitude of initial protective treatment effect. CONCLUSIONS: Important differences exist between survival extrapolations assuming marginal versus conditional treatment effect waning. When a marginal HR is constrained to 1 to assess efficacy under individual-level treatment effect waning, the survival benefits associated with the new treatment will be overestimated, and incremental cost-effectiveness ratios will be underestimated.

Survival Extrapolation Incorporating General Population Mortality Using Excess Hazard and Cure Models: A Tutorial.

BACKGROUND: Different parametric survival models can lead to widely discordant extrapolations and decision uncertainty in cost-effectiveness analyses. The use of excess hazard (EH) methods, which incorporate general population mortality data, has the potential to reduce model uncertainty. This review highlights key practical considerations of EH methods for estimating long-term survival. METHODS: Demonstration of methods used a case study of 686 patients from the German Breast Cancer Study Group, followed for a maximum of 7.3 y and divided into low (1/2) and high (3) grade cancers. Seven standard parametric survival models were fit to each group separately. The same 7 distributions were then used in an EH framework, which incorporated general population mortality rates, and fitted both with and without a cure parameter. Survival extrapolations, restricted mean survival time (RMST), and difference in RMST between high and low grades were compared up to 30 years along with Akaike information criterion goodness-of-fit and cure fraction estimates. The sensitivity of the EH models to lifetable misspecification was investigated. RESULTS: In our case study, variability in survival extrapolations was extensive across the standard models, with 30-y RMST ranging from 7.5 to 14.3 y. Incorporation of general population mortality rates using EH cure methods substantially reduced model uncertainty, whereas EH models without cure had less of an effect. Long-term treatment effects approached the null for most models but at varying rates. Lifetable misspecification had minimal effect on RMST differences. CONCLUSIONS: EH methods may be useful for survival extrapolation, and in cancer, EHs may decrease over time and be easier to extrapolate than all-cause hazards. EH cure models may be helpful when cure is plausible and likely to result in less extrapolation variability. HIGHLIGHTS: In health economic modeling, to help anchor long-term survival extrapolation, it has been recommended that survival models incorporate background mortality rates using excess hazard (EH) methods.We present a thorough description of EH methods with and without the assumption of cure and demonstrate user-friendly software to aid researchers wishing to use these methods.EH models are applied to a case study, and we demonstrate that EHs are easier to extrapolate and that the use of the EH cure model, when cure is plausible, can reduce extrapolation variability.EH methods are relatively robust to lifetable misspecification.

A Systematic Review of Methods to Incorporate External Evidence into Trial-Based Survival Extrapolations for Health Technology Assessment.

BACKGROUND: External evidence is commonly used to inform survival modeling for health technology assessment (HTA). While there are a range of methodological approaches that have been proposed, it is unclear which methods could be used and how they compare. PURPOSE: This review aims to identify, describe, and categorize established methods to incorporate external evidence into survival extrapolation for HTA. DATA SOURCES: Embase, MEDLINE, EconLit, and Web of Science databases were searched to identify published methodological studies, supplemented by hand searching and citation tracking. STUDY SELECTION: Eligible studies were required to present a novel extrapolation approach incorporating external evidence (i.e., data or information) within survival model estimation. DATA EXTRACTION: Studies were classified according to how the external evidence was integrated as a part of model fitting. Information was extracted concerning the model-fitting process, key requirements, assumptions, software, application contexts, and presentation of comparisons with, or validation against, other methods. DATA SYNTHESIS: Across 18 methods identified from 22 studies, themes included use of informative prior(s) (n = 5), piecewise (n = 7), and general population adjustment (n = 9), plus a variety of "other" (n = 8) approaches. Most methods were applied in cancer populations (n = 13). No studies compared or validated their method against another method that also incorporated external evidence. LIMITATIONS: As only studies with a specific methodological objective were included, methods proposed as part of another study type (e.g., an economic evaluation) were excluded from this review. CONCLUSIONS: Several methods were identified in this review, with common themes based on typical data sources and analytical approaches. Of note, no evidence was found comparing the identified methods to one another, and so an assessment of different methods would be a useful area for further research.HighlightsThis review aims to identify methods that have been used to incorporate external evidence into survival extrapolations, focusing on those that may be used to inform health technology assessment.We found a range of different approaches, including piecewise methods, Bayesian methods using informative priors, and general population adjustment methods, as well as a variety of "other" approaches.No studies attempted to compare the performance of alternative methods for incorporating external evidence with respect to the accuracy of survival predictions. Further research investigating this would be valuable.

Is Intention to Treat Still the Gold Standard or Should Health Technology Assessment Agencies Embrace a Broader Estimands Framework?: Insights and Perspectives From the National Institute for Health and Care Excellence and Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen on the International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use E9 (R1) Addendum.

OBJECTIVES: The International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH) E9 (R1) addendum will have an important impact on the design and analysis of randomized controlled clinical trials, which represent crucial sources of evidence in health technology assessments, and on the intention-to-treat (ITT) principle in particular. This article brings together a task force of health economists and statisticians in academic institutes and the pharmaceutical industry, to examine the implications of the addendum from the perspective of the National Institute for Health and Care Excellence (NICE) and the Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (IQWiG) and to address the question of whether the ITT principle should be considered the gold standard for estimating treatment effects. METHODS: We review the ITT principle, as introduced in the ICH E9 guideline. We then present an overview of the ICH E9 (R1) addendum and its estimand framework, highlighting its premise and the proposed strategies for handling intercurrent events, and examine some cases among submissions to IQWiG and NICE. RESULTS: IQWiG and NICE appear to have diverging perspectives around the relevance of the ITT principle and, in particular, the acceptance of hypothetical strategies for estimating treatment effects, as suggested by examples where the sponsor proposed an alternative approach to the ITT principle when accounting for treatment switching for interventional oncology trials. CONCLUSIONS: The ICH E9 (R1) addendum supports the use of methods that depart from the ITT principle. The relevance of estimands using these methods depends on the perspectives and objectives of payers. It is challenging to design a study that meets all stakeholders' research questions. Different estimands may serve to answer different relevant questions or decision problems.

Challenges in valuing and paying for combination regimens in oncology: reporting the perspectives of a multi-stakeholder, international workshop.

BACKGROUND: It is increasingly common for two or more treatments for cancer to be combined as a single regimen. Determining value and appropriate payment for such regimens can be challenging. This study discusses these challenges, and possible solutions. METHODS: Stakeholders from around the world attended a 2-day workshop, supported by a background paper. This study captures key outcomes from the discussion, but is not a consensus statement. RESULTS: Workshop attendees agreed that combining on-patent treatments can result in affordability and value for money challenges that delay or deny patient access to clinically effective treatments in many health systems. Options for addressing these challenges include: (i) Increasing the value of combination therapies through improved clinical development; (ii) Willingness to pay more for combinations than for single drugs offering similar benefit, or; (iii) Aligning the cost of constituent therapies with their value within a regimen. Workshop attendees felt that (i) and (iii) merited further discussion, whereas (ii) was unlikely to be justifiable. Views differed on the feasibility of (i). Key to (iii) would be systems allowing different prices to apply to different uses of a drug. CONCLUSIONS: Common ground was identified on immediate actions to improve access to combination regimens. These include an exploration of the legal challenges associated with price negotiations, and ensuring that pricing systems can support implementation of negotiated prices for specific uses. Improvements to clinical development and trial design should be pursued in the medium and longer term.

Estimation of Transition Probabilities for State-Transition Models: A Review of NICE Appraisals.

State transition models are used to inform health technology reimbursement decisions. Within state transition models, the movement of patients between the model health states over discrete time intervals is determined by transition probabilities (TPs). Estimating TPs presents numerous issues, including missing data for specific transitions, data incongruence and uncertainty around extrapolation. Inappropriately estimated TPs could result in biased models. There is limited guidance on how to address common issues associated with TP estimation. To assess current methods for estimating TPs and to identify issues that may introduce bias, we reviewed National Institute for Health and Care Excellence Technology Appraisals published from 1 January, 2019 to 27 May, 2020. Twenty-eight models (from 26 Technology Appraisals) were included in the review. Several methods for estimating TPs were identified: survival analysis (n = 11); count method (n = 9); multi-state modelling (n = 7); logistic regression (n = 2); negative binomial regression (n = 2); Poisson regression (n = 1); and calibration (n = 1). Evidence Review Groups identified several issues relating to TP estimation within these models, including important transitions being excluded (n = 5); potential selection bias when estimating TPs for post-randomisation health states (n = 2); issues concerning the use of multiple data sources (n = 4); potential biases resulting from the use of data from different populations (n = 2), and inappropriate assumptions around extrapolation (n = 3). These issues remained unresolved in almost every instance. Failing to address these issues may bias model results and lead to sub-optimal decision making. Further research is recommended to address these methodological problems.

Prevalence of Immature Survival Data for Anti-Cancer Drugs Presented to the National Institute for Health and Care Excellence and Impact on Decision Making.

OBJECTIVES: This research aims to explore how often the National Institute for Health and Care Excellence (NICE) uses immature overall survival data to inform reimbursement decisions on cancer treatments, and the implications of this for resource allocation decisions. METHODS: NICE cancer technology appraisals published between 2015 and 2017 were reviewed to determine the prevalence of using immature survival data. A case study was used to demonstrate the potential impact of basing decisions on immature data. The economic model submitted by the company was reconstructed and was populated first using survival data available at the time of the appraisal, and then using data from an updated data cut published after the appraisal concluded. The incremental cost-effectiveness ratios (ICERs) obtained using the different data cuts were compared. Probabilistic sensitivity analysis was undertaken and expected value of perfect information estimated. RESULTS: Forty-one percent of NICE cancer technology appraisals used immature data to inform reimbursement decisions. In the case study, NICE gave a positive recommendation for a limited patient subgroup, with ICERs too high in the complete patient population. ICERs were dramatically lower when the final data cut was used, irrespective of the parametric model used to model survival. Probabilistic sensitivity analysis and expected value of perfect information may not have fully characterized uncertainty, because as they did not account for structural uncertainty. CONCLUSION: Analyses of cancer treatments using immature survival data may result in incorrect estimates of survival benefit and cost-effectiveness, potentially leading to inappropriate funding decisions. This research highlights the importance of revisiting past decisions when updated data cuts become available.

Extrapolation of Survival Curves Using Standard Parametric Models and Flexible Parametric Spline Models: Comparisons in Large Registry Cohorts with Advanced Cancer.

BACKGROUND: It is often important to extrapolate survival estimates beyond the limited follow-up times of clinical trials. Extrapolated survival estimates can be highly sensitive to model choice; thus, appropriate model selection is crucial. Flexible parametric spline models have been suggested as an alternative to standard parametric models; however, their ability to extrapolate is not well understood. AIM: To determine how well standard parametric and flexible parametric spline models predict survival when fitted to registry cohorts with artificially right-censored follow-up times. METHODS: Adults with advanced breast, colorectal, small cell lung, non-small cell lung, or pancreatic cancer with a potential follow-up time of 10 y were selected from the SEER 1973-2015 registry data set. Patients were classified into 15 cohorts by cancer and age group at diagnosis (18-59, 60-69, 70+ y). Follow-up times for each cohort were right censored at 20%, 35%, and 50% survival. Standard parametric models (exponential, Weibull, Gompertz, log-logistic, log-normal, generalized gamma) and spline models (proportional hazards, proportional odds, normal/probit) were fitted to the 10-y data set and the 3 right-censored data sets. Predicted 10-y restricted mean survival time and percentage surviving at 10 y were compared with the observed values. RESULTS: Across all data sets, the spline odds and spline normal models most frequently gave accurate predictions of 10-y survival outcomes. Visually, spline models tended to demonstrate better fit to the observed hazard functions than standard parametric models, both in the censored and 10-y data. CONCLUSIONS: In these cohorts, where there was little uncertainty in the observed data, the spline models performed well when extrapolating beyond the observed data. Spline models should be routinely included in the set of models that are fitted when extrapolating cancer survival data.

Self-managed, computerised word finding therapy as an add-on to usual care for chronic aphasia post-stroke: An economic evaluation.

OBJECTIVE: To examine the cost-effectiveness of self-managed computerised word finding therapy as an add-on to usual care for people with aphasia post-stroke. DESIGN: Cost-effectiveness modelling over a life-time period, taking a UK National Health Service (NHS) and personal social service perspective. SETTING: Based on the Big CACTUS randomised controlled trial, conducted in 21 UK NHS speech and language therapy departments. PARTICIPANTS: Big CACTUS included 278 people with long-standing aphasia post-stroke. INTERVENTIONS: Computerised word finding therapy plus usual care; usual care alone; usual care plus attention control. MAIN MEASURES: Incremental cost-effectiveness ratios (ICER) were calculated, comparing the cost per quality adjusted life year (QALY) gained for each intervention. Credible intervals (CrI) for costs and QALYs, and probabilities of cost-effectiveness, were obtained using probabilistic sensitivity analysis. Subgroup and scenario analyses investigated cost-effectiveness in different subsets of the population, and the sensitivity of results to key model inputs. RESULTS: Adding computerised word finding therapy to usual care had an ICER of £42,686 per QALY gained compared with usual care alone (incremental QALY gain: 0.02 per patient (95% CrI: -0.05 to 0.10); incremental costs: £732.73 per patient (95% CrI: £674.23 to £798.05)). ICERs for subgroups with mild or moderate word finding difficulties were £22,371 and £21,262 per QALY gained respectively. CONCLUSION: Computerised word finding therapy represents a low cost add-on to usual care, but QALY gains and estimates of cost-effectiveness are uncertain. Computerised therapy is more likely to be cost-effective for people with mild or moderate, as opposed to severe, word finding difficulties.

Adjusting for Treatment Switching in Oncology Trials: A Systematic Review and Recommendations for Reporting.

OBJECTIVES: To systematically review the quality of reporting on the application of switching adjustment approaches in published oncology trials and industry submissions to the National Institute for Health and Care Excellence Although methods such as the rank preserving structural failure time model (RPSFTM) and inverse probability of censoring weights (IPCW) have been developed to address treatment switching, the approaches are not widely accepted within health technology assessment. This limited acceptance may partly be a consequence of poor reporting on their application. METHODS: Published trials and industry submissions were obtained from searches of PubMed and nice.org.uk, respectively. The quality of reporting in these studies was judged against a checklist of reporting recommendations, which was developed by the authors based on detailed considerations of the methods. RESULTS: Thirteen published trials and 8 submissions to nice.org.uk satisfied inclusion criteria. The quality of reporting around the implementation of the RPSFTM and IPCW methods was generally poor. Few studies stated whether the adjustment approach was prespecified, more than a third failed to provide any justification for the chosen method, and nearly half neglected to perform sensitivity analyses. Further, it was often unclear how the RPSFTM and IPCW methods were implemented. CONCLUSIONS: Inadequate reporting on the application of switching adjustment methods increases uncertainty around results, which may contribute to the limited acceptance of these methods by decision makers. The proposed reporting recommendations aim to support the improved interpretation of analyses undertaken to adjust for treatment switching.

Assessing the Long-Term Effectiveness of Cladribine vs. Placebo in the Relapsing-Remitting Multiple Sclerosis CLARITY Randomized Controlled Trial and CLARITY Extension Using Treatment Switching Adjustment Methods.

OBJECTIVES: Treatment switching adjustment methods are often used to adjust for switching in oncology randomized controlled trials (RCTs). In this exploratory analysis, we apply these methods to adjust for treatment changes in the setting of an RCT followed by an extension study in relapsing-remitting multiple sclerosis. METHODS: The CLARITY trial evaluated cladribine tablets versus placebo over 96 weeks. In the 96-week CLARITY Extension, patients who received placebo in CLARITY received cladribine tablets; patients who received cladribine tablets in CLARITY were re-randomized to placebo or cladribine tablets. End points were time to first qualifying relapse (FQR) and time to 3- and 6-month confirmed disability progression (3mCDP, 6mCDP). We aimed to compare the effectiveness of cladribine tablets with placebo over CLARITY and the extension. The rank-preserving structural failure time model (RPSFTM) and iterative parameter estimation (IPE) were used to estimate what would have happened if patients had received placebo in CLARITY and the extension versus patients that received cladribine tablets and switched to placebo. To gauge whether treatment effect waned after the 96 weeks of CLARITY, we compared hazard ratios (HRs) from the adjustment analysis with HRs from CLARITY. RESULTS: The RPSFTM resulted in an HR of 0.48 [95% confidence interval (CI) 0.36-0.62] for FQR, 0.62 (95% CI 0.46-0.84) for 3mCDP and 0.62 (95% CI 0.44-0.88) for 6mCDP. IPE algorithm results were similar. CLARITY HRs were 0.44 (95% CI 0.34-0.58), 0.60 (95% CI 0.41-0.87) and 0.58 (95% CI 0.40-0.83) for FQR, 3mCDP and 6mCDP, respectively. CONCLUSIONS: Treatment switching adjustment methods are applicable in non-oncology settings. Adjusted CLARITY plus CLARITY Extension HRs were similar to the CLARITY HRs, demonstrating significant treatment benefits associated with cladribine tablets versus placebo. FUNDING: EMD Serono, Inc. (a business of Merck KGaA, Darmstadt, Germany).

Behavioural activation therapy for post-stroke depression: the BEADS feasibility RCT.

BACKGROUND: There is currently insufficient evidence for the clinical effectiveness and cost-effectiveness of psychological therapies for post-stroke depression. OBJECTIVE: To evaluate the feasibility of undertaking a definitive trial to evaluate the clinical effectiveness and cost-effectiveness of behavioural activation (BA) compared with usual stroke care for treating post-stroke depression. DESIGN: Parallel-group, feasibility, multicentre, randomised controlled trial with nested qualitative research and a health economic evaluation. SETTING: Acute and community stroke services in three sites in England. PARTICIPANTS: Community-dwelling adults 3 months to 5 years post stroke who are depressed, as determined by the Patient Health Questionnaire-9 (PHQ-9) or the Visual Analogue Mood Scales 'Sad' item. Exclusions: patients who are blind and/or deaf, have dementia, are unable to communicate in English, do not have mental capacity to consent, are receiving treatment for depression at the time of stroke onset or are currently receiving psychological intervention. RANDOMISATION AND BLINDING: Participants were randomised (1 : 1 ratio) to BA or usual stroke care. Randomisation was conducted using a computer-generated list with random permuted blocks of varying sizes, stratified by site. Participants and therapists were aware of the allocation, but outcome assessors were blind. INTERVENTIONS: The intervention arm received up to 15 sessions of BA over 4 months. BA aims to improve mood by increasing people's level of enjoyable or valued activities. The control arm received usual care only. MAIN OUTCOME MEASURES: Primary feasibility outcomes concerned feasibility of recruitment to the main trial, acceptability of research procedures and measures, appropriateness of baseline and outcome measures, retention of participants and potential value of conducting the definitive trial. Secondary feasibility outcomes concerned the delivery of the intervention. The primary clinical outcome 6 months post randomisation was the PHQ-9. Secondary clinical outcomes were Stroke Aphasic Depression Questionnaire - Hospital version, Nottingham Leisure Questionnaire, Nottingham Extended Activities of Daily Living, Carer Strain Index, EuroQol-5 Dimensions, five-level version and health-care resource use questionnaire. RESULTS: Forty-eight participants were recruited in 27 centre-months of recruitment, at a recruitment rate of 1.8 participants per centre per month. The 25 participants randomised to receive BA attended a mean of 8.5 therapy sessions [standard deviation (SD) 4.4 therapy sessions]; 23 participants were allocated to usual care. Outcome assessments were completed by 39 (81%) participants (BA, n = 18; usual care, n = 21). Mean PHQ-9 scores at 6-month follow-up were 10.1 points (SD 6.9 points) and 14.4 points (SD 5.1 points) in the BA and control groups, respectively, a difference of -3.8 (95% confidence interval -6.9 to -0.6) after adjusting for baseline PHQ-9 score and centre, representing a reduction in depression in the BA arm. Therapy was delivered as intended. BA was acceptable to participants, carers and therapists. Value-of-information analysis indicates that the benefits of conducting a definitive trial would be likely to outweigh the costs. It is estimated that a sample size of between 580 and 623 participants would be needed for a definitive trial. LIMITATIONS: Target recruitment was not achieved, although we identified methods to improve recruitment. CONCLUSIONS: The Behavioural Activation Therapy for Depression after Stroke trial was feasible with regard to the majority of outcomes. The outstanding issue is whether or not a sufficient number of participants could be recruited within a reasonable time frame for a definitive trial. Future work is required to identify whether or not there are sufficient sites that are able to deliver the services required for a definitive trial. TRIAL REGISTRATION: Current Controlled Trials ISRCTN12715175. FUNDING: This project was funded by the NIHR Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 23, No. 47. See the NIHR Journals Library website for further project information.

Approximately one-third of stroke patients experience depression, which can have negative effects on recovery and quality of life (QoL). Currently, we do not have sufficient evidence to indicate which psychological interventions are effective and affordable to the NHS for treating post-stroke depression. We aimed to determine whether or not it is feasible to conduct a future large-scale study to evaluate a psychological intervention, called behavioural activation (BA) therapy, for treating post-stroke depression. BA aims to improve mood by identifying what stroke patients enjoy doing and helping them to undertake these activities. BA can be used with all stroke patients with depression, including people with cognitive or communication difficulties. We recruited 48 post-stroke patients who had suffered a stroke between 3 months and 5 years previously. People with dementia or significant aphasia were excluded. Participants were divided into two groups at random. About half of the participants received BA over a 4-month period and the other half did not. Participants received all other available care. After 6 months, participants completed questionnaires about their mood, activity level and QoL. We also interviewed 16 participants and 10 carers about their views on the actual research process and therapy. Although we were able to recruit participants to the study, we recruited fewer than the original target of 72 participants owing to delays in starting recruitment. However, we have identified ways to improve participant recruitment in a future study. We found that it was feasible to deliver BA, and the therapy was found to be acceptable to participants, carers and therapists. The results indicate that the benefits of conducting a large-scale future study would outweigh the costs. However, the main consideration will be whether or not we could identify enough stroke services able to run the study for a long enough period to recruit the large number of participants required.

Impact of Nonrandomized Dropout on Treatment Switching Adjustment in the Relapsing-Remitting Multiple Sclerosis CLARITY Trial and the CLARITY Extension Study.

OBJECTIVES: Statistical methods to adjust for treatment switching are commonly applied to randomized controlled trials (RCTs) in oncology. Nevertheless, RCTs with extension studies incorporating nonrandomized dropout require consideration of alternative adjustment methods. The current study used a recognized method and a novel method to adjust for treatment switching in relapsing-remitting multiple sclerosis (MS). METHODS: The Cladribine Tablets Treating Multiple Sclerosis Orally (CLARITY) RCT evaluated the efficacy of cladribine versus placebo over 96 weeks. Many (but not all) CLARITY participants enrolled in the 96-week CLARITY extension study; placebo-treated patients from CLARITY received cladribine (PP→LL), and cladribine-treated patients were re-randomized to placebo (LL→PP) or continued cladribine (LL→LL). End points were time to first qualifying relapse (FQR) and time to 3-month and 6-month confirmed disability progression (3mCDP, 6mCDP). We aimed to estimate the effectiveness of the LL→PP treatment strategy compared with a counterfactual (unobserved) PP→PP strategy. We applied the commonly used rank-preserving structural failure time model (RPSFTM) and a novel approach that combined propensity score matching (PSM) with inverse probability of censoring weights (IPCW). RESULTS: The RPSFTM resulted in LL→PP versus PP→PP hazard ratios (HRs) of 0.48 (95% confidence interval [CI] 0.36-0.62) for FQR, 0.62 (95% CI 0.46-0.84) for 3mCDP, and 0.62 (95% CI 0.44-0.88) for 6mCDP. The PSM+IPCW resulted in HRs of 0.47 (95% CI 0.38-0.63) for FQR, 0.61 (95% CI 0.43-0.86) for 3mCDP, and 0.63 (95% CI 0.40-0.87) for 6mCDP. CONCLUSIONS: The PSM+IPCW HRs were consistent with those from the RPSFTM, suggesting that the results were not substantially biased by informative dropout, assuming that all relevant confounders were controlled for. There was no statistical evidence of a reduction in the cladribine treatment effect during the extension period.

Survival Extrapolation in Cancer Immunotherapy: A Validation-Based Case Study.

BACKGROUND: Immune-checkpoint inhibitors may provide long-term survival benefits via a cured proportion, yet data are usually insufficient to prove this upon submission to health technology assessment bodies. OBJECTIVE: We revisited the National Institute for Health and Care Excellence assessment of ipilimumab in melanoma (TA319). We used updated data from the pivotal trial to assess the accuracy of the extrapolation methods used and compared these to previously unused techniques to establish whether an alternative extrapolation may have provided more accurate survival projections. METHODS: We compared projections from the piecewise survival model used in TA319 and those produced by alternative models (fit to trial data with minimum follow-up of 3 years) to a longer-term data cut (5-year follow-up). We also compared projections to external data to help assess validity. Alternative approaches considered were parametric, spline-based, mixture, and mixture-cure models. RESULTS: Only the survival model used in TA319 and a mixture-cure model provided 5-year survival predictions close to those observed in the 5-year follow-up data set. Standard parametric, spline, and non-curative-mixture models substantially underestimated 5-year survival. Survival estimates from the TA319 model and the mixture-cure model diverge considerably after 5 years and remain unvalidated. CONCLUSIONS: In our case study, only models that incorporated an element of external information (through a cure fraction combined with background mortality rates or using registry data) provided accurate estimates of 5-year survival. Flexible models that were able to capture the complex hazard functions observed during the trial, but which did not incorporate external information, extrapolated poorly.