Comparative Effectiveness of Valoctocogene Roxaparvovec and Prophylactic Factor VIII Replacement in Severe Hemophilia A.

INTRODUCTION: A prospective, non-interventional study (270-902) followed 294 adults with severe hemophilia A (SHA) receiving prophylactic factor VIII (FVIII). From these participants, 112 rolled over into a single-arm, multicenter, phase 3 trial (GENEr8-1; NCT03370913) that evaluated efficacy and safety of valoctocogene roxaparvovec, a gene therapy that provides endogenous FVIII in individuals with SHA. Participants from 270-902 who did not roll over provide an opportunity for a contemporaneous external control. Therefore, the comparative effectiveness of valoctocogene roxaparvovec vs FVIII prophylaxis was evaluated using propensity scoring (PS). METHODS: This post hoc analysis compared 112 participants from GENEr8-1 (treated cohort) to 73 participants in 270-902 who did not enroll in GENEr8-1 (control cohort). The primary analysis used standardized mortality ratio weighting to re-weight baseline characteristics of the control cohort to better match the treated cohort. Mean annualized bleeding rates (ABR) for treated and all bleeds were compared between cohorts along with the proportion of participants with zero bleeds (treated and all bleeds). Sensitivity and scenario analyses were also conducted. RESULTS: PS adjustments reduced differences in baseline characteristics between cohorts. Mean treated (4.40 vs 0.85; P < 0.001) and all (5.01 vs 1.54; P < 0.001) ABR were significantly lower, and the proportions of participants with zero treated bleeds (82.1% vs 32.9%; P < 0.001) and all bleeds (58.0% vs 28.5%; P < 0.001) were significantly higher in GENEr8-1. CONCLUSIONS: PS-adjusted analyses were consistent with prior intra-individual comparisons. Compared with participants receiving prophylactic FVIII, the participants receiving valoctocogene roxaparvovec experienced lower ABR, and a higher proportion had zero bleeds. TRAIL REGISTRATION: ClinicalTrials.gov identifier, NCT03370913.

Hemophilia A is a bleeding disorder where blood is unable to clot properly because of a missing protein called factor VIII (FVIII). Individuals with hemophilia A have an increased risk of prolonged bleeding episodes that can be deadly. To prevent bleeding, people with severe hemophilia A need to routinely inject treatment into the skin or vein (prophylaxis). While effective, some people find the time and effort needed to maintain frequent injections difficult, since some forms of the prophylaxis must be administered in a hospital setting. Valoctocogene roxaparvovec is a gene therapy where a single injection provides instructions to the liver of individuals with hemophilia A to make the missing protein (FVIII). Then, their own liver cells can produce FVIII protein and prevent bleeding episodes. The valoctocogene roxaparvovec clinical trial compared the number of treated bleeding episodes participants had prior to gene therapy, while using prophylaxis, with the number of treated bleeding episodes after gene therapy. On average, after gene therapy, participants had 4.1 fewer treated bleeding episodes per year. In this study, mathematical models were used to explore how differences in participant's physical characteristics, such as body weight or medical history, might influence the effectiveness of gene therapy. Even when considering differences in the participants' physical characteristics, the gene therapy reduced treated bleeding episodes by 3.6 events per year. This study confirms results originally presented from the valoctocogene roxaparvovec clinical trial and reinforces confidence in the ability of valoctocogene roxaparvovec to reduce bleeding outcomes for participants with hemophilia A.

Modelling the Effectiveness of Tepotinib in Comparison to Standard-of-Care Treatments in Patients with Advanced Non-small Cell Lung Cancer (NSCLC) Harbouring METex14 Skipping in the UK.

BACKGROUND: Patients with non-small cell lung cancer harbouring mesenchymal-epithelial transition exon 14 (METex14) skipping typically demonstrate poorer prognosis than overall non-small cell lung cancer. Until recently, no targeted treatments were available for patients with non-small cell lung cancer harbouring METex14 skipping in the UK, with limited treatments available. OBJECTIVE: This study estimates the long-term survival and quality-adjusted life-year benefit of MET inhibitor tepotinib versus current standard of care from a UK perspective. METHODS: A partitioned-survival model assessed the survival and quality-adjusted life-year benefits of tepotinib versus immunotherapy ± chemotherapy and chemotherapy for untreated and previously treated patients, respectively, using evidence from the single-arm VISION trial (NCT02864992). Two approaches were used to inform an indirect treatment comparison: (1) published clinical trials in overall non-small cell lung cancer and (2) real-world evidence in the METex14 skipping population. Results are presented as median and total quality-adjusted life-year gain and survival for progression-free survival and overall survival. Survival curves were validated against the external literature and uncertainty assessed using a probabilistic sensitivity analysis. RESULTS: Using the indirect treatment comparison against the published literature, tepotinib is estimated to have a median progression-free survival gain versus pembrolizumab ± chemotherapy (11.0 and 9.2 months) in untreated patients, and docetaxel ± nintedanib (5.1 and 6.4 months) in previously treated patients. Across the populations, tepotinib is estimated to have a median survival gain of 15.4 and 9.2 months versus pembrolizumab ± chemotherapy in untreated patients and 12.8 and 5.1 months versus docetaxel ± nintedanib in previously treated patients. The total quality-adjusted life-year gain ranges between 0.56 and 1.17 across the untreated and previously treated populations. Results from the real-world evidence of indirect treatment comparisons are consistent with these findings. CONCLUSIONS: Despite the limitations of the evidence base, the numerous analyses conducted have consistently indicated positive outcomes for tepotinib versus the current standard of care.

Modelling Health State Utilities as a Transformation of Time to Death in Patients with Non-Small Cell Lung Cancer.

BACKGROUND: When utilities are analyzed by time to death (TTD), this has historically been implemented by 'grouping' observations as discrete time periods to create health state utilities. We extended the approach to use continuous functions, avoiding assumptions around groupings. The resulting models were used to test the concept with data from different regions and different country tariffs. METHODS: Five-year follow-up in advanced non-small cell lung cancer (NSCLC) was used to fit six continuous TTD models using generalized estimating equations, which were compared with progression-based utilities and previously published TTD groupings. Sensitivity analyses were performed using only patients with a confirmed death, the last year of life only, and artificially censoring data at 24 months. The statistically best-fitting model was then applied to data subsets by region and different EQ-5D-3L country tariffs. RESULTS: Continuous (natural) [Formula: see text] and [Formula: see text] models outperformed other continuous models, grouped TTD, and progression-based models in statistical fit (mean absolute error and Quasi Information Criterion). This held through sensitivity and scenario analyses. The pattern of reduced utility as a patient approaches death was consistent across regions and EQ-5D tariffs using the preferred [Formula: see text] model. CONCLUSIONS: The use of continuous models provides a statistically better fit than TTD groupings, without the need for strong assumptions about the health states experienced by patients. Where a TTD approach is merited for use in modelling, continuous functions should be considered, with the scope for further improvements in statistical fit by both widening the number of candidate models tested and the therapeutic areas investigated.

Matching-adjusted indirect comparison of bleeding outcomes in severe haemophilia A: Comparing valoctocogene roxaparvovec gene therapy, emicizumab prophylaxis, and FVIII replacement prophylaxis.

INTRODUCTION: Head-to-head evaluation of valoctocogene roxaparvovec, the first gene therapy approved for haemophilia A, with emicizumab is not available. Therefore, phase 3 trial data were indirectly compared. AIM: To compare bleeding rates in trials evaluating 6 × 1013  vg/kg valoctocogene roxaparvovec (GENEr8-1; NCT03370913), 1.5 mg/kg emicizumab dosed every week (HAVEN 3; NCT02847637), and FVIII prophylaxis (270-902) in participants with severe haemophilia A (FVIII ≤1 IU/dL). METHODS: Valoctocogene roxaparvovec versus emicizumab and FVIII prophylaxis as used in 270-902 versus emicizumab cross-trial comparisons were performed using matching-adjusted indirect comparison (MAIC). Individual participant data from GENEr8-1 and 270-902 were weighted to equalise aggregate participant baseline characteristics from HAVEN 3. After MAIC weighting, annualised bleeding rates (ABR) and proportions of participants without bleeds were compared for treated bleeds, all bleeds, treated joint bleeds, and treated spontaneous bleeds. RESULTS: After MAIC weighting, ABR for all bleeds was statistically significantly lower with valoctocogene roxaparvovec than emicizumab (rate ratio [95% CI], .55 [.33-.93]). Additionally, significantly higher proportions of participants had no treated joint bleeds (odds ratio [95% CI], 2.75 [1.20-6.31]) and no treated bleeds (3.25 [1.53-6.90]) with valoctocogene roxaparvovec versus emicizumab. When compared with the mainly standard half-life FVIII prophylaxis regimens in 270-902, mean ABRs (except for all bleeds) were significantly lower, and significantly higher proportions reported 0 bleeds for all outcomes with emicizumab. CONCLUSION: Valoctocogene roxaparvovec provided generally lower bleeding rates and higher probability of no bleeds, including treated joint bleeds, than emicizumab. Emicizumab was more effective than FVIII prophylaxis regimens used in 270-902.

Incorporating Prior Beliefs Into Meta-Analyses of Health-State Utility Values Using the Bayesian Power Prior.

OBJECTIVES: Health-state utility values (HSUVs) directly affect estimates of Quality-Adjusted Life-Years and thus the cost-utility estimates. In practice a single preferred value (SPV) is often selected for HSUVs, despite meta-analysis being an option when multiple (credible) HSUVs are available. Nevertheless, the SPV approach is often reasonable because meta-analysis implicitly considers all HSUVs as equally relevant. This article presents a method for the incorporation of weights to HSUV synthesis, allowing more relevant studies to have greater influence. METHODS: Using 4 case studies in lung cancer, hemodialysis, compensated liver cirrhosis, and diabetic retinopathy blindness, a Bayesian Power Prior (BPP) approach is used to incorporate beliefs on study applicability, reflecting the authors' perceived suitability for UK decision making. Older studies, non-UK value sets, and vignette studies are thus downweighted (but not disregarded). BPP HSUV estimates were compared with a SPV, random effects meta-analysis, and fixed effects meta-analysis. Sensitivity analyses were conducted iteratively updating the case studies, using alternative weighting methods, and simulated data. RESULTS: Across all case studies, SPVs did not accord with meta-analyzed values, and fixed effects meta-analysis produced unrealistically narrow CIs. Point estimates from random effects meta-analysis and BPP models were similar in the final models, although BPP reflected additional uncertainty as wider credible intervals, particularly when fewer studies were available. Differences in point estimates were seen in iterative updating, weighting approaches, and simulated data. CONCLUSIONS: The concept of the BPP can be adapted for synthesizing HSUVs, incorporating expert opinion on relevance. Because of the downweighting of studies, the BPP reflected structural uncertainty as wider credible intervals, with all forms of synthesis showing meaningful differences compared with SPVs. These differences would have implications for both cost-utility point estimates and probabilistic analyses.

A 24-month updated analysis of the comparative effectiveness of ZUMA-5 (axi-cel) vs. SCHOLAR-5 external control in relapsed/refractory follicular lymphoma.

BACKGROUND: In the ZUMA-5 trial (Clinical trials identification: NCT03105336), axicabtagene ciloleucel (axi-cel; a chimeric antigen receptor T-cell therapy) demonstrated high rates of durable response in relapsed/refractory (r/r) follicular lymphoma (FL) patients and clear superiority relative to the SCHOLAR-5 external control cohort. We update this comparison using the ZUMA-5 24-month data. RESEARCH DESIGN AND METHODS: The SCHOLAR-5 cohort is comprised of r/r FL patients who initiated ≥3rd line of therapy after July 2014 and meeting ZUMA-5 eligibility criteria. Groups were balanced for patient characteristics through propensity scoring on prespecified prognostic factors using standardized mortality ratio (SMR) weighting. The overall response rate was compared using a weighted logistic regression. Time-to-event outcomes were evaluated using a Cox regression. RESULTS: For SCHOLAR-5, the sum of weights for the 143 patients was 85 after SMR weighting, versus 86 patients in ZUMA-5. The median follow-up was 29.4 months and 25.4 months for ZUMA-5 and SCHOLAR-5, respectively. The hazard ratios for overall survival and progression-free survival were 0.52 (95% confidence interval (CI): 0.28-0.95) and 0.28 (95% CI: 0.17-0.45), favoring axi-cel. CONCLUSION: This updated analysis, using a longer minimum follow-up than a previously published analysis, shows that the improved efficacy of axi-cel, relative to available therapies, in r/r FL is durable. .

Health Utility Analysis of Tepotinib in Patients With Non-Small Cell Lung Cancer Harboring MET Exon 14 Skipping.

OBJECTIVES: The VISION trial showed durable activity of tepotinib in MET exon 14 (METex14) skipping non-small cell lung cancer. We analyzed health state utilities using patient-reported outcomes from VISION. METHODS: 5-level version of EQ-5D (EQ-5D-5L) and European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire-Core 30 responses were collected at baseline, every 6 to 12 weeks during treatment, and at the end of treatment and safety follow-up. EQ-5D-5L and European Organisation for Research and Treatment of Cancer Quality of Life Utility Measure-Core 10 Dimensions (QLU-C10D) utilities were derived using United States, Canada, United Kingdom, and Taiwan value sets, where available. Utilities were analyzed with linear mixed models including covariates for progression or time-to-death (TTD). RESULTS: Utilities were derived for 273/291 patients (EQ-5D-5L, 1545 observations; QLU-C10D, 1546 observations). Mean (± SD) US EQ-5D-5L utilities increased after tepotinib initiation, from 0.687 ± 0.287 at baseline to 0.754 ± 0.250 before independently assessed progression, and decreased post progression (0.704 ± 0.288). US QLU-C10D utilities showed similar trends (0.705 ± 0.215, 0.753 ± 0.195, and 0.708 ± 0.209, respectively). Progression-based models demonstrated a statistically significant impact of progression on utilities and predicted higher utilities pre versus post progression. TTD-based models showed statistically significant associations of TTD with utilities and predicted declining utilities as TTD decreased. Prior treatment (yes/no) did not significantly predict utilities in progression- or TTD-based models. Utilities for Canada, United Kingdom, and Taiwan showed comparable trends. CONCLUSIONS: In this first analysis of health state utilities in patients with METex14 skipping non-small cell lung cancer, who received tepotinib, utilities were significantly associated with progression and TTD, but not prior treatment.

Carers' Health-Related Quality of Life in Global Health Technology Assessment: Guidance, Case Studies and Recommendations.

Including health outcomes for carers as well as patients in economic evaluations can change the results and conclusions of the analysis. Whilst in many disease areas there can be clear justification for including carers' health-related quality of life (HRQL) in health technology assessments (HTAs), we believe that, in general, the perspective of carers is under-represented in HTA. We were interested in the extent, and methods by which, HTA bodies include carers' HRQL in economic evaluation. We reviewed guidance from 13 HTA bodies across the world regarding carers' HRQL. We examined five interventions, as case studies, assessed by different HTA bodies, and extracted information on whether carers' HRQL was included by the manufacturers or assessors in their dossiers of evidence, the data and methods used, and the impact on the results. We developed recommendations to guide analysts on including carers' HRQL in economic evaluations. When reviewing the methods guides: two bodies recommend including carers' HRQL in the base case, two referred to outcomes for all individuals, two preferred to exclude carers, three said it depended on other conditions, and it was unclear for four. Across the five case studies: five source studies for carers' HRQL and two different modelling approaches were used. Including carers' HRQL increased incremental quality-adjusted life-years (QALYs) in 19/23 analyses (decreased it in two); there was substantial variation in the magnitude of change. We recommend: (1) the inclusion of carers is clearly justified, (2) the use of HRQL data from the population under comparison where possible, (3) the use of data from another disease area or country is clearly justified (and transferability/applicability issues are discussed), (4) the use of external data to derive comparisons for cross-sectional data is justified, (5) assumptions and implications of the modelling approach are explicit, and (6) disaggregated results for patients and carers are presented.

Comparative effectiveness of ZUMA-5 (axi-cel) vs SCHOLAR-5 external control in relapsed/refractory follicular lymphoma.

In the pivotal ZUMA-5 trial, axicabtagene ciloleucel (axi-cel; an autologous anti-CD19 chimeric antigen receptor T-cell therapy) demonstrated high rates of durable response in relapsed/refractory (r/r) follicular lymphoma (FL) patients. Here, outcomes from ZUMA-5 are compared with the international SCHOLAR-5 cohort, which applied key ZUMA-5 trial eligibility criteria simulating randomized controlled trial conditions. SCHOLAR-5 data were extracted from institutions in 5 countries, and from 1 historical clinical trial, for r/r FL patients who initiated a third or higher line of therapy after July 2014. Patient characteristics were balanced through propensity scoring on prespecified prognostic factors using standardized mortality ratio (SMR) weighting. Time-to-event outcomes were evaluated using weighted Kaplan-Meier analysis. Overall response rate (ORR) and complete response (CR) rate were compared using weighted odds ratios. The 143 ScHOLAR-5 patients reduced to an effective sample of 85 patients after SMR weighting vs 86 patients in ZUMA-5. Median follow-up time was 25.4 and 23.3 months for SCHOLAR-5 and ZUMA-5. Median overall survival (OS) and progression-free survival (PFS) in SCHOLAR-5 were 59.8 months and 12.7 months and not reached in ZUMA-5. Hazard ratios for OS and PFS were 0.42 (95% confidence interval [CI], 0.21-0.83) and 0.30 (95% CI, 0.18-0.49). The ORR and CR rate were 49.9% and 29.9% in SCHOLAR-5 and 94.2% and 79.1% in ZUMA-5, for odds ratios of 16.2 (95% CI, 5.6-46.9) and 8.9 (95% CI, 4.3-18.3). Compared with available therapies, axi-cel demonstrated an improvement in meaningful clinical endpoints, suggesting axi-cel addresses an important unmet need for r/r FL patients. This trial was registered at www.clinicaltrials.gov as #NCT03105336.

Approaches to Selecting "Time Zero" in External Control Arms with Multiple Potential Entry Points: A Simulation Study of 8 Approaches.

BACKGROUND: When including data from an external control arm to estimate comparative effectiveness, there is a methodological choice of when to set "time zero," the point at which a patient would be eligible/enrolled in a contemporary study. Where patients receive multiple lines of eligible therapy and thus alternative points could be selected, this issue is complex. METHODS: A simulation study was conducted in which patients received multiple prior lines of therapy before entering either cohort. The results from the control and intervention data sets are compared using 8 methods for selecting time zero. The base-case comparison was set up to be biased against the intervention (which is generally received later), with methods compared in their ability to estimate the true intervention effectiveness. We further investigate the impact of key study attributes (such as sample size) and degree of overlap in time-varying covariates (such as prior lines of therapy) on study results. RESULTS: Of the 8 methods, 5 (all lines, random line, systematically selecting groups based on mean absolute error, root mean square error, or propensity scores) showed good performance in accounting for differences between the line at which patients were included. The first eligible line can be statistically inefficient in some situations. All lines (with censoring) cannot be used for survival outcomes. The last eligible line cannot be recommended. CONCLUSIONS: Multiple methods are available for selecting the most appropriate time zero from an external control arm. Based on the simulation, we demonstrate that some methods frequently perform poorly, with several viable methods remaining. In selecting between the viable methods, analysts should consider the context of their analysis and justify the approach selected. HIGHLIGHTS: There are multiple methods available from which an analyst may select "time zero" in an external control cohort.This simulation study demonstrates that some methods perform poorly but most are viable options, depending on context and the degree of overlap in time zero across cohorts.Careful thought and clear justification should be used when selecting the strategy for a study.

Comparative efficacy of ravulizumab and eculizumab in the treatment of atypical hemolytic uremic syndrome: An indirect comparison using clinical trial data.

Ravulizumab and eculizumab are approved terminal complement inhibitor treatments for atypical hemolytic uremic syndrome (aHUS). Ravulizumab was engineered from eculizumab to have an increased half-life allowing for reduced dosing frequency (8-weekly vs. 2-weekly). To account for differences in respective clinical trials, a validated balancing technique was used to enable an indirect comparison of ravulizumab and eculizumab treatment efficacy in aHUS. Patient-level data from four eculizumab clinical trials were available for pooling and comparison with data from two ravulizumab trials. In the primary analysis, adult native kidney data were compared. Propensity scores were calculated from baseline characteristics (dialysis status, estimated glomerular filtration rate, platelet count, serum lactate dehydrogenase). Stabilized inverse probability weighting was used to balance groups. Changes in outcomes from baseline to 26 weeks were compared between treatment groups. Sensitivity and subgroup analyses were conducted to assess the robustness of findings. Overall, 85 patients (46 ravulizumab, 39 eculizumab) were included in the primary analysis. Demographic and clinical characteristics were well balanced after weighting at baseline. At 26 weeks, clinical outcomes (including renal function, hematological markers, and dialysis prevalence), and fatigue and quality of life measures were improved with eculizumab and ravulizumab treatment. No differences between treatment groups reached statistical significance, although confidence intervals were wide. Sensitivity and subgroup analysis results were consistent with those of the primary analysis. Using appropriate methodology for indirect comparison of studies, no differences in outcomes were seen between ravulizumab and eculizumab, although, owing to small sample sizes, confidence intervals were wide.

What is the Impact of the Analysis Method Used for Health State Utility Values on QALYs in Oncology? A Simulation Study Comparing Progression-Based and Time-to-Death Approaches.

BACKGROUND: Health state utility values ('utilities') are an integral part of health technology assessment. Though traditionally categorised by disease status in oncology (i.e. progression), several recent assessments have adopted values calculated according to the time that measures were recorded before death. We conducted a simulation study to understand the limitations of each approach, with a focus on mismatches between the way utilities are generated, and analysed. METHODS: Survival times were simulated based on published literature, with permutations of three utility generation mechanisms (UGMs) and utility analysis methods (UAMs): (1) progression based, (2) time-to-death based, and (3) a 'combination approach'. For each analysis quality-adjusted life-years (QALYs) were estimated. Goodness of fit was assessed via percentage mean error (%ME) and mean absolute error (%MAE). Scenario analyses were performed varying individual parameters, with complex scenarios mimicking published studies. The statistical code is provided for transparency and to aid future work in the area. RESULTS: %ME and %MAE were lowest when the correct analysis form was specified (i.e. UGM and UAM aligned). Underestimates were produced when a time-to-death element was present in the UGM but not included in the UAM, while the 'combined' UAM produced overestimates irrespective of the UGM. Scenario analysis demonstrated the importance of the volume of available data beyond the initial time period, for example follow-up. CONCLUSIONS: We show that the use of an incorrectly or over-specified UAM can result in substantial bias in the estimation of utilities. We present a flowchart to highlight the issues that may be faced.

Voretigene Neparvovec for Treating Inherited Retinal Dystrophies Caused by RPE65 Gene Mutations: An Evidence Review Group Perspective of a NICE Highly Specialised Technology Appraisal.

The UK National Institute for Health and Care Excellence (NICE) considered evidence for voretigene neparvovec (VN; Luxturna®) for the treatment of RPE65-mediated inherited retinal dystrophies (IRD) within its highly specialised technology programme. This paper summarises the evidence provided by the company; the appraisal of the evidence by the Peninsula Technology Appraisal Group, who were commissioned to act as the independent evidence review group (ERG); and the development of the NICE guidance by the appraisal committee. The evidence presented by the company highlighted the significant lifelong burden of IRD for patients and carers. Evidence to support the effectiveness of VN was lacking, but the available evidence showed a modest, sustained improvement across a variety of vision-related outcomes. While patients would remain visually impaired, the committee considered that VN would prevent further deterioration in vision. The modelling approach used by the company had a number of limitations and relied heavily upon a large volume of clinical expert input to produce cost-effectiveness estimates with large uncertainty around long-term effectiveness. The ERG's main concerns revolved around these long-term outcomes and the plausibility of utility values. The NICE committee were convinced that the clinical benefits of VN were important and an appropriate use of national health service resources within a specialised service. The committee concluded that a high unmet need existed in patients with RPE65-mediated IRD and that VN represents a step change in the management of this condition.

Real-world evidence use in assessments of cancer drugs by NICE.

OBJECTIVE: To establish how real-world evidence (RWE) has been used to inform single technology appraisals (STAs) of cancer drugs conducted by the National Institute for Health and Care Excellence (NICE). METHODS: STAs published by NICE from April 2011 to October 2018 that evaluated cancer treatments were reviewed. Information regarding the use of RWE to directly inform the company-submitted cost-effectiveness analysis was extracted and categorized by topic. Summary statistics were used to describe emergent themes, and a narrative summary was provided for key case studies. RESULTS: Materials for a total of 113 relevant STAs were identified and analyzed, of which nearly all (96 percent) included some form of RWE within the company-submitted cost-effectiveness analysis. The most common categories of RWE use concerned the health-related quality of life of patients (71 percent), costs (46 percent), and medical resource utilization (40 percent). While sources of RWE were routinely criticized as part of the appraisal process, we identified only two cases where the use of RWE was overtly rejected; hence, in the majority of cases, RWE was accepted in cancer drug submissions to NICE. DISCUSSION: RWE has been used extensively in cancer submissions to NICE. Key criticisms of RWE in submissions to NICE are seldom regarding the use of RWE in general; instead, these are typically concerned with specific data sources and the applicability of these to the decision problem. Within an appropriate context, RWE constitutes an extremely valuable source of information to inform decision making; yet the development of best practice guidelines may improve current reporting standards.

The validation of published utility mapping algorithms: an example of EORTC QLQ-C30 and EQ-5D in non-small cell lung cancer.

BACKGROUND: Mapping algorithms can be used to generate health state utilities when a preference-based instrument is not included in a clinical study. Our aim was to investigate the external validity of published mapping algorithms in non-small cell lung cancer (NSCLC) between the EORTC QLQ-C30 and EQ-5D instruments and to propose methodology for validating any mapping algorithms. METHODS: We conducted a targeted literature review to identify published mappings, then applied these to data from the osimertinib clinical trial programme. Performance of the algorithms was evaluated using the mean absolute error, root mean squared error, and graphical techniques for the observed versus predicted EQ-5D utilities. These statistics were also calculated across the range of utility values (as well as ordinary least squares and quantile regression), to investigate how the mappings fitted across all values, not simply around the mean utility. RESULTS: Three algorithms developed in NSCLC were identified. The algorithm based on response mapping (Young et al., 2015) fitted the validation dataset across the range of observed values with similar fit statistics to the original publication (overall MAE of 0.087 vs 0.134). The two algorithms based on beta-binomial models presented a poor fit to both the mean and distribution of utility values (MAE 0.176, 0.178). CONCLUSIONS: The validation of mapping algorithms is key to demonstrating their generalisability beyond the original dataset, particularly across the range of plausible utility values (not just the mean) - perceived patient similarity being insufficient. The identified algorithm from Young et al. performed well across the range of EORTC scores observed, and thus appears most suitable for use in other studies of NSCLC patients.

Creating historical controls using data from a previous line of treatment - Two non-standard approaches.

Where medical interventions are licensed based on only uncontrolled study data (for example a single-arm trial), a common approach for estimating the incremental benefit is to compare the treatment to a 'historical control'; data collected from patients who did not receive the intervention. We illustrate with motivating examples two methods for the creation of historical controls where disease progression and overall survival are typically the key clinically meaningful endpoints. The first method utilises information routinely collected in a clinical trial programme: patients' time to disease progression on their previous line of treatment against which outcomes can be compared. The second uses published clinical outcomes for the prior line of treatment which can be extrapolated to estimate outcomes at the next line. As examples we use two pharmaceuticals licensed on the basis of uncontrolled clinical studies - idelalisib for double-refractory follicular lymphoma and ofatumumab for double-refractory chronic lymphocytic leukemia. Although subject to limitations that should be considered on a case-by-case basis, the methods may be appropriate when trying to quantify the clinical benefit of treatment based on limited and uncontrolled trial data. As a result, the methods can be used to inform health technology adoption decisions.

Longitudinal assessment of utilities in patients with migraine: an analysis of erenumab randomized controlled trials.

BACKGROUND: Cost-effectiveness analyses in patients with migraine require estimates of patients' utility values and how these relate to monthly migraine days (MMDs). This analysis examined four different modelling approaches to assess utility values as a function of MMDs. METHODS: Disease-specific patient-reported outcomes from three erenumab clinical studies (two in episodic migraine [NCT02456740 and NCT02483585] and one in chronic migraine [NCT02066415]) were mapped to the 5-dimension EuroQol questionnaire (EQ-5D) as a function of the Migraine-Specific Quality of Life Questionnaire (MSQ) and the Headache Impact Test (HIT-6™) using published algorithms. The mapped utility values were used to estimate generic, preference-based utility values suitable for use in economic models. Four models were assessed to explain utility values as a function of MMDs: a linear mixed effects model with restricted maximum likelihood (REML), a fractional response model with logit link, a fractional response model with probit link and a beta regression model. RESULTS: All models tested showed very similar fittings. Root mean squared errors were similar in the four models assessed (0.115, 0.114, 0.114 and 0.114, for the linear mixed effect model with REML, fractional response model with logit link, fractional response model with probit link and beta regression model respectively), when mapped from MSQ. Mean absolute errors for the four models tested were also similar when mapped from MSQ (0.085, 0.086, 0.085 and 0.085) and HIT-6 and (0.087, 0.088, 0.088 and 0.089) for the linear mixed effect model with REML, fractional response model with logit link, fractional response model with probit link and beta regression model, respectively. CONCLUSIONS: This analysis describes the assessment of longitudinal approaches in modelling utility values and the four models proposed fitted the observed data well. Mapped utility values for patients treated with erenumab were generally higher than those for individuals treated with placebo with equivalent number of MMDs. Linking patient utility values to MMDs allows utility estimates for different levels of MMD to be predicted, for use in economic evaluations of preventive therapies. TRIAL REGISTRATION: ClinicalTrials.gov numbers of the trials used in this study: STRIVE, NCT02456740 (registered May 14, 2015), ARISE, NCT02483585 (registered June 12, 2015) and NCT02066415 (registered Feb 17, 2014).

Frequentist and Bayesian meta-regression of health state utilities for multiple myeloma incorporating systematic review and analysis of individual patient data.

This analysis presents the results of a systematic review for health state utilities in multiple myeloma, as well as analysis of over 9,000 observations taken from registry and trial data. The 27 values identified from 13 papers are then synthesised in a frequentist nonparametric bootstrap model and a Bayesian meta-regression. Results were similar between the frequentist and Bayesian models with low utility on disease diagnosis (approximately 0.55), raising to approximately 0.65 on first line treatment and declining slightly with each subsequent line. Stem cell transplant was also found to be a significant predictor of health-related quality of life in both individual patient data and meta-regression, with an increased utility of approximately 0.06 across different models. The work presented demonstrates the feasibility of Bayesian methods for utility meta-regression, whilst also presenting an internally consistent set of data from the analysis of registry data. To facilitate easy updating of the data and model, data extraction tables and model code are provided as Data S1. The main limitations of the model relate to the low number of studies available, particularly in highly pretreated patients.

Migraine day frequency in migraine prevention: longitudinal modelling approaches.

BACKGROUND: Health economic models are critical tools to inform reimbursement agencies on health care interventions. Many clinical trials report outcomes using the frequency of an event over a set period of time, for example, the primary efficacy outcome in most clinical trials of migraine prevention is mean change in the frequency of migraine days (MDs) per 28 days (monthly MDs [MMD]) relative to baseline for active treatment versus placebo. Using these cohort-level endpoints in economic models, accounting for variation among patients is challenging. In this analysis, parametric models of change in MMD for migraine preventives were assessed using data from erenumab clinical studies. METHODS: MMD observations from the double-blind phases of two studies of erenumab were used: one in episodic migraine (EM) (NCT02456740) and one in chronic migraine (CM) (NCT02066415). For each trial, two longitudinal regression models were fitted: negative binomial and beta binomial. For a thorough comparison we also present the fitting from the standard multilevel Poisson and the zero inflated negative binomial. RESULTS: Using the erenumab study data, both the negative binomial and beta-binomial models provided unbiased estimates relative to observed trial data with well-fitting distribution at various time points. CONCLUSIONS: This proposed methodology, which has not been previously applied in migraine, has shown that these models may be suitable for estimating MMD frequency. Modelling MMD using negative binomial and beta-binomial distributions can be advantageous because these models can capture intra- and inter-patient variability so that trial observations can be modelled parametrically for the purposes of economic evaluation of migraine prevention. Such models have implications for use in a wide range of disease areas when assessing repeated measured utility values.