Application of Multi-Criteria Decision Analysis (MCDA) to Prioritize Real-World Evidence Studies for Health Technology Management: Outcomes and Lessons Learned by the Canadian Real-World Evidence for Value of Cancer Drugs (CanREValue) Collaboration.

Multi-criteria decision analysis (MCDA) is a value assessment tool designed to help support complex decision-making by incorporating multiple factors and perspectives in a transparent, structured approach. We developed an MCDA rating tool, consisting of seven criteria evaluating the importance and feasibility of conducting potential real-world evidence (RWE) studies aimed at addressing uncertainties stemming from initial cancer drug funding recommendations. In collaboration with the Canadian Agency for Drugs and Technologies in Health's Provincial Advisory Group, a validation exercise was conducted to further evaluate the application of the rating tool using RWE proposals varying in complexity. Through this exercise, we aimed to gain insight into consensus building and deliberation processes and to identify efficiencies in the application of the rating tool. An experienced facilitator led a multidisciplinary committee, consisting of 11 Canadian experts, through consensus building, deliberation, and prioritization. A total of nine RWE proposals were evaluated and prioritized as low (n = 4), medium (n = 3), or high (n = 2) priority. Through an iterative process, efficiencies and recommendations to improve the rating tool and associated procedures were identified. The refined MCDA rating tool can help decision-makers prioritize important and feasible RWE studies for research and can enable the use of RWE for the life-cycle evaluation of cancer drugs.

Cost and value of cancer medicines in a single-payer public health system in Ontario, Canada: a cross-sectional study.

BACKGROUND: The financial impact of cancer medicines on health systems is not well known. We describe temporal trends in expenditure on cancer medicines within the single-payer health system of Ontario, Canada, and the extent of clinical benefit these treatments offer. METHODS: In this cross-sectional study, we identified cancer medicines and expenditures from formularies and costing databases (the New Drug Funding Program, Ontario Drug Benefit Program, and The High-Cost Therapy Funding Program) during 10 consecutive years (April 1, 2012, to March 31, 2022) in Ontario, Canada. For intravenous medicines, we applied the European Society for Medical Oncology Magnitude of Clinical Benefit Scale (ESMO-MCBS) to identify expenditures associated with substantial clinical benefit. We also identified treatments associated with improved overall survival or quality of life. FINDINGS: 69 intravenous and 98 oral or injectable medicines were funded during 2012-22. Annual expenditure on cancer medicines increased by approximately 15% per year during 2012-22; the increase was more rapid in the most recent 4 years. Total expenditure on cancer medicines in the 2021-22 financial year was CA$1·7 billion. Immune checkpoint inhibitors were the single biggest expense by class ($284 million), representing 17% of the entire cancer medicine annual budget. Drugs with the highest individual costs were lenalidomide ($178 million) and pembrolizumab ($163 million), each accounting for around 10% of the entire budget. 29 (76%) of 38 indications eligible for ESMO-MCBS scoring met the threshold for substantial clinical benefit. Eight (21%) indications had no randomised trial evidence of improved overall survival, and only four (11%) were associated with improved QOL. $346 million (67% of the expenditure on intravenous cancer medicines) was spent on drugs that improved median overall survival by more than 6 months, $82 million (16%) was spent on medicines with overall survival gains of 3-6 months, and $32 million (6%) was spent on medicines with overall survival gains of less than 3 months. $53 million (10%) was spent on medicines with no established improvement in overall survival. INTERPRETATION: Costs of cancer medicines to the Canadian health system are increasing rapidly. Most funded indications met thresholds for substantial clinical benefit and two-thirds of the expenditure were for medicines that improve survival by more than 6 months. Whether this cost trajectory can be maintained in a sustainable, equitable, high-quality health system is unclear. Efforts are needed to ensure the price of medicines with substantial benefit is affordable and funding of treatments with very modest benefit might need to be re-assessed, particularly when alternative supportive and palliative therapies are available. FUNDING: None.

Comparative Effectiveness and Safety of Trastuzumab Biosimilars to Herceptin for Adjuvant Treatment of HER2+ Breast Cancer.

Background: Ontario publicly funds reference trastuzumab (Herceptin) and four biosimilar trastuzumab products for adjuvant treatment of HER2+ breast cancer. We assessed the real-world safety and effectiveness of biosimilar trastuzumab compared to Herceptin for adjuvant treatment of patients with HER2+ breast cancer. Methods: This was a population-based, retrospective study comparing the safety and effectiveness of biosimilar trastuzumab and Herceptin for neoadjuvant/adjuvant treatment of HER2+ breast cancer from 2016 to 2021. Treatment patients started biosimilar trastuzumab from November 2019 to June 2021; historical comparator patients started Herceptin from June 2016 to October 2019. Safety outcomes death within 30 days of last dose of trastuzumab, direct hospitalization, emergency department visit leading to hospitalization, early treatment discontinuation, and in-patient admission for congestive heart failure were measured using logistic/negative binomial regression. Overall survival (OS) was measured using Kaplan-Meier methods and Cox proportional hazards regression. Propensity score matching was applied. Results: From June 2016 to 2021, 5071 patients with breast cancer were treated with neoadjuvant/adjuvant trastuzumab. The rate of direct hospitalization (RR: 0.85, 95% CI: 0.74-0.98, p-value: 0.032) was significantly lower in biosimilar compared to Herceptin patients. OS (log-rank test p = 0.98) and risk of mortality (HR: 1.29, 95% CI: 0.72-2.30, p-value = 0.39) did not significantly differ between treatment groups. Conclusions: Biosimilar trastuzumab demonstrated similar safety and effectiveness to Herceptin. The findings can help improve confidence in and use of biosimilars and demonstrate the value of real-world evidence generation for supporting biosimilar implementations and reassessments.

Development of a Multi-Criteria Decision Analysis Rating Tool to Prioritize Real-World Evidence Questions for the Canadian Real-World Evidence for Value of Cancer Drugs (CanREValue) Collaboration.

The Canadian Real-world Evidence for Value of Cancer Drugs (CanREValue) collaboration developed an MCDA rating tool to assess and prioritize potential post-market real-world evidence (RWE) questions/uncertainties emerging from public drug funding decisions in Canada. In collaboration with a group of multidisciplinary stakeholders from across Canada, the rating tool was developed following a three-step process: (1) selection of criteria to assess the importance and feasibility of an RWE question; (2) development of rating scales, application of weights and calculating aggregate scores; and (3) validation testing. An initial MCDA rating tool was developed, composed of seven criteria, divided into two groups. Group A criteria assess the importance of an RWE question by examining the (1) drug's perceived clinical benefit, (2) magnitude of uncertainty identified, and (3) relevance of the uncertainty to decision-makers. Group B criteria assess the feasibility of conducting an RWE analysis including the (1) feasibility of identifying a comparator, (2) ability to identify cases, (3) availability of comprehensive data, and (4) availability of necessary expertise and methodology. Future directions include partnering with the Canadian Agency for Drugs and Technology in Health's Provincial Advisory Group for further tool refinement and to gain insight into incorporating the tool into drug funding deliberations.

Cost-effectiveness of second-line ipilimumab for metastatic melanoma: A real-world population-based cohort study of resource utilization.

BACKGROUND: The efficacy-effectiveness gap between randomized trial and real-world evidence regarding the clinical benefit of ipilimumab for metastatic melanoma (MM) has been well characterized by previous literature, consistent with initial concerns raised by health technology assessment agencies (HTAs). As these differences can significantly impact cost-effectiveness, it is critical to assess the real-world cost-effectiveness of second-line ipilimumab versus non-ipilimumab treatments for MM. METHODS: This was a population-based retrospective cohort study of patients who received second-line non-ipilimumab therapies between 2008 and 2012 versus ipilimumab treatment between 2012 and 2015 (after public reimbursement) for MM in Ontario. Using a 5-year time horizon, censor-adjusted and discounted (1.5%) costs (from the public payer's perspective in Canadian dollars) and effectiveness were used to calculate incremental cost-effectiveness ratios (ICERs) in life-years gained (LYGs) and quality-adjusted life years (QALYs), with bootstrapping to capture uncertainty. Varying the discount rate and reducing the price of ipilimumab were done as sensitivity analyses. RESULTS: In total, 329 MM were identified (Treated: 189; Controls: 140). Ipilimumab was associated with an incremental effectiveness of 0.59 LYG, incremental cost of $91,233, and ICER of $153,778/LYG. ICERs were not sensitive to discounting rate. Adjusting for quality of life using utility weights resulted in an ICER of $225,885/QALY, confirming the original HTA estimate prior to public reimbursement. Reducing the price of ipilimumab by 100% resulted in an ICER of $111,728/QALY. CONCLUSION: Despite its clinical benefit, ipilimumab as second-line monotherapy for MM patients is not cost-effective in the real world as projected by HTA under conventional willingness-to-pay thresholds.

Comparison of Use of Neoadjuvant Systemic Treatment for Breast Cancer and Short-term Outcomes Before vs During the COVID-19 Era in Ontario, Canada.

Importance: In response to an increase in COVID-19 infection rates in Ontario, several systemic treatment (ST) regimens delivered in the adjuvant setting for breast cancer were temporarily permitted for neoadjuvant-intent to defer nonurgent breast cancer surgical procedures. Objective: To examine the use and compare short-term outcomes of neoadjuvant-intent vs adjuvant ST in the COVID-19 era compared with the pre-COVID-19 era. Design, Setting, and Participants: This was a retrospective population-based cohort study in Ontario, Canada. Patients with cancer starting selected ST regimens in the COVID-19 era (March 11, 2020, to September 30, 2020) were compared to those in the pre-COVID-19 era (March 11, 2019, to March 10, 2020). Patients were diagnosed with breast cancer within 6 months of starting systemic therapy. Main Outcomes and Measures: Estimates were calculated for the use of neoadjuvant vs adjuvant ST, the likelihood of receiving a surgical procedure, the rate of emergency department visits, hospital admissions, COVID-19 infections, and all-cause mortality between treatment groups over time. Results: Among a total of 10 920 patients included, 7990 (73.2%) started treatment in the pre-COVID-19 era and 7344 (67.3%) received adjuvant ST; the mean (SD) age was 61.6 (13.1) years. Neoadjuvant-intent ST was more common in the COVID-19 era (1404 of 2930 patients [47.9%]) than the pre-COVID-19 era (2172 of 7990 patients [27.2%]), with an odds ratio of 2.46 (95% CI, 2.26-2.69; P < .001). This trend was consistent across a range of ST regimens, but differed according to patient age and geography. The likelihood of receiving surgery following neoadjuvant-intent chemotherapy was similar in the COVID-19 era compared with the pre-COVID-19 era (log-rank P = .06). However, patients with breast cancer receiving neoadjuvant-intent hormonal therapy were significantly more likely to receive surgery in the COVID-19 era (log-rank P < .001). After adjustment, there were no significant changes in the rate of emergency department visits over time between patients receiving neoadjuvant ST, adjuvant ST, or ST only during the ST treatment period or postoperative period. Hospital admissions decreased in the COVID-19 era for patients who received neoadjuvant ST compared with adjuvant ST or ST alone (P for interaction = .01 for both) in either setting. Conclusions and Relevance: In this cohort study, patients were more likely to start neoadjuvant ST in the COVID-19 era, which varied across the province and by indication. There was limited evidence to suggest any substantial impact on short-term outcomes.

Real-World Cost-Effectiveness of First-Line Gemcitabine Plus Nab-Paclitaxel vs FOLFIRINOX in Patients With Advanced Pancreatic Cancer.

BACKGROUND: There are no randomized control trials (RCTs) comparing gemcitabine and nab-paclitaxel (Gem-Nab) and fluorouracil, folinic acid, irinotecan, oxaliplatin (FOLFIRINOX) for advanced pancreatic cancer (APC). Although it is well known that RCT-based efficacy often does not translate to real-world effectiveness, there is limited literature investigating comparative cost-effectiveness of Gem-Nab vs FOLFIRINOX for APC. We aimed to examine the real-world cost-effectiveness of Gem-Nab vs FOLFIRINOX for APC in Ontario, Canada. METHODS: This study compared patients treated with first-line Gem-Nab or FOLFIRINOX for APC in Ontario from April 2015 to March 2019. Patients were linked to administrative databases. Using propensity scores and a stabilizing weights method, an inverse probability of treatment weighted cohort was developed. Mean survival and total costs were calculated over a 5-year time horizon, adjusted for censoring, and discounted at 1.5%. Incremental cost-effectiveness ratio and net monetary benefit were computed to estimate cost-effectiveness from the public health-care payer's perspective. Sensitivity analysis was conducted using the propensity score matching method. RESULTS: A total of 1988 patients were identified (Gem-Nab: n = 928; FOLFIRINOX: n = 1060). Mean survival was lower for patients in the Gem-Nab than the FOLFIRINOX group (0.98 vs 1.26 life-years; incremental effectiveness = -0.28 life-years [95% confidence interval = -0.47 to -0.13]). Patients in the Gem-Nab group incurred greater mean 5-year total costs (Gem-Nab: $103 884; FOLFIRINOX: $101 518). Key cost contributors include ambulatory cancer care, acute inpatient hospitalization, and systemic therapy drug acquisition. Gem-Nab was dominated by FOLFIRINOX, as it was less effective and more costly. Results from the sensitivity analysis were similar. CONCLUSIONS: Gem-Nab is likely more costly and less effective than FOLFIRINOX and therefore not considered cost-effective at commonly accepted willingness-to-pay thresholds.

The Association of Drug-Funding Reimbursement With Survival Outcomes and Use of New Systemic Therapies Among Patients With Advanced Pancreatic Cancer.

Importance: Gemcitabine-nab-paclitaxel (GEMNAB) and fluorouracil, leucovorin, irinotecan, and oxaliplatin (FOLFIRINOX) both improve survival of patients with advanced pancreatic cancer when compared with single-agent gemcitabine in clinical trials. Objective: To describe changes in the survival of patients with advanced pancreatic cancer associated with sequential drug-funding approvals and to determine if there exist distinct patient populations for whom GEMNAB and FOLFIRINOX are associated with survival benefit. Design, Setting, and Participants: This population-based, retrospective cohort study examined all incident cases of advanced pancreatic cancer treated with first-line chemotherapy in Ontario, Canada (2008-2018) that were identified from the Cancer Care Ontario (Ontario Health) New Drug Funding Program database. Statistical analysis was performed from October 2020 to January 2021. Exposures: First-line chemotherapy for advanced pancreatic cancer. Main Outcomes and Measures: The main outcomes were the proportion of patients treated with each chemotherapy regimen over time and overall survival for each regimen. Cox proportional hazards regression models were used to compare overall survival between treatment regimens after adjustment for confounding variables, inverse probability of treatment weighting, and matching. Results: From 2008 to 2018, 5465 patients with advanced pancreatic cancer were treated with first-line chemotherapy in Ontario, Canada. The median (range) age of patients was 66.9 (27.8-93.4) years; 2447 (45%) were female; 878 (16%) had prior pancreatic resection, and 328 (6%) had prior adjuvant gemcitabine. During the time period when only gemcitabine and FOLFIRINOX were funded (2011-2015), 49% (929 of 1887) received FOLFIRINOX. When GEMNAB was subsequently funded (2015-2018), 9% (206 of 2347) received gemcitabine, 44% (1034 of 2347) received FOLFIRINOX, and 47% (1107 of 2347) received GEMNAB. The median overall survival increased from 5.6 months (95% CI, 5.1-6.0 months) in 2008 to 2011 to 6.9 months (95% CI, 6.5-7.4 months) in 2011 to 2015 to 7.6 months (95% CI, 7.1-8.0 months) in 2015 to 2018. Patients receiving FOLFIRINOX were younger and healthier than patients receiving GEMNAB. After adjustment and weighting, FOLFIRINOX was associated with better overall survival than GEMNAB (hazard ratio [HR], 0.75 [95% CI, 0.69-0.81]). In analyses comparing patients treated with GEMNAB and gemcitabine, GEMNAB was associated with better overall survival (HR, 0.86 [95% CI, 0.78-0.94]). Conclusions and Relevance: This cohort study of patients with advanced pancreatic cancer receiving first-line palliative chemotherapy within a universal health care system found that drug funding decisions were associated with increased uptake of new treatment options over time and improved survival. Both FOLFIRINOX and GEMNAB were associated with survival benefits in distinct patient populations.

Real-World Cost-Effectiveness of Bevacizumab With First-Line Combination Chemotherapy in Patients With Metastatic Colorectal Cancer: Population-Based Retrospective Cohort Studies in Three Canadian Provinces.

Background. Real-world evidence can be a valuable tool when clinical trial data are incomplete or uncertain. Bevacizumab was adopted as first-line therapy for metastatic colorectal cancer (mCRC) based on significant survival improvements in initial clinical trials; however, survival benefit diminished in subsequent analyses. Consequently, there is uncertainty surrounding the cost-effectiveness of bevacizumab therapy achieved in practice. Objective. To assess real-world cost-effectiveness of first-line bevacizumab with irinotecan-based chemotherapy versus irinotecan-based chemotherapy alone for mCRC in British Columbia (BC), Saskatchewan, and Ontario, Canada. Methods. Using provincial cancer registries and linked administrative databases, we identified mCRC patients who initiated publicly funded irinotecan-based chemotherapy, with or without bevacizumab, in 2000 to 2015. We compared bevacizumab-treated patients to historical controls (treated before bevacizumab funding) and contemporaneous controls (receiving chemotherapy without bevacizumab), using inverse-probability-of-treatment weighting with propensity scores to balance baseline covariates. We calculated incremental cost-effectiveness ratios (ICER) using 5-year cost and survival adjusted for censoring, with bootstrapping to characterize uncertainty. We also conducted one-way sensitivity analysis for key drivers of cost-effectiveness. Results. The cohorts included 12,112 (Ontario), 1,161 (Saskatchewan), and 2,977 (BC) patients. Bevacizumab significantly increased treatment costs, with mean ICERs between $78,000 and $84,000/LYG (life-year gained) in the contemporaneous comparisons and $75,000 and $101,000/LYG in the historical comparisons. Reducing the cost of bevacizumab by 50% brought ICERs in all comparisons below $61,000/LYG. Limitations. Residual confounding in observational data may bias results, while the use of original list prices overestimates current bevacizumab cost. Conclusion. The addition of bevacizumab to irinotecan-based chemotherapy extended survival for mCRC patients but at significant cost. At original list prices bevacizumab can only be considered cost-effective with certainty at a willingness-to-pay threshold over $100,000/LYG, but price reductions or discounts have a significant impact on cost-effectiveness.

Clinician Perspectives of COVID-19-Related Cancer Drug Funding Measures in Ontario.

The COVID-19 pandemic has a significant impact on cancer patients and the delivery of cancer care. To allow clinicians to adapt treatment plans for patients, Ontario Health (Cancer Care Ontario) issued a series of interim funding measures for the province's New Drug Funding Program (NDFP), which covers the cost of most hospital-delivered cancer drugs. To assess the utility of the measures and the need for their continuation, we conducted an online survey of Ontario oncology clinicians. The survey was open 3-25 September 2020 and generated 105 responses. Between April and June 2020, 46% of respondents changed treatment plans for more than 25% of their cancer patients due to the pandemic. Clinicians report broad use of interim funding measures. The most frequently reported strategies used were treatment breaks for stable patients (62%), extending dosing intervals (59%), and deferring routine imaging (56%). Most clinicians anticipate continuing to use these interim funding measures in the coming months. The survey showed that adapting cancer drug funding policies has supported clinical care in Ontario during the pandemic.

Real-world, population-based cohort study of toxicity and resource utilization of second-line ipilimumab for metastatic melanoma in Ontario, Canada.

Second-line ipilimumab has been publicly funded in Ontario for metastatic melanoma (MM) since September 2012. We examined real-world toxicity of second-line ipilimumab compared to standard second-line treatments prior to funding. MM patients who received systemic treatment from April 2005 to March 2015 were included. Patients receiving second-line ipilimumab after September 2012 were considered as cases, and those who received second-line treatment prior to the funding date were included as historical controls. Outcomes assessed include treatment-related mortality, any-cause hospital visits, ipilimumab-related hospital visits and specialist visits (eg, endocrinologists, ophthalmologists, gastroenterologists, rheumatologists and respirologists), which were captured from up to 30 and/or 90 days after end of second-line treatment. Inverse probability of treatment weighting was used to adjust for baseline differences between groups. Odds ratios (ORs) from logistic regressions and rate ratios (RRs) from rate regressions were used to assess differences between groups. We identified 329 MM patients who received second-line treatments (ipilimumab: 189; controls: 140). Ipilimumab was associated greater any-cause (60.1% vs 45.7%; OR = 1.81; P value = .019) and ipilimumab-related (47.2% vs 31.9%; OR = 1.91; P value = .011) hospital visits. Adjusting for different follow-up days, ipilimumab was associated with higher rates of all-cause (RR = 1.56 [95%CI: 1.12-2.16]), and ipilimumab-related (RR = 2.18 [95% CI: 1.45-3.27]) hospital visits. Patients receiving ipilimumab were more likely to visit specialist involved in immunotherapy toxicity management (23.5% vs 13.7%; P value = .04). Compared to historical second-line treatments, second-line ipilimumab was associated with more health service utilization (specifically hospital visits and specialist visits), suggestive of potentially increased toxicity in the real world.

Evolving Best Practice for Take-Home Cancer Drugs.

PURPOSE: Take-home cancer drugs (THCDs) have become a standard treatment of many cancers. Robust guidelines have been developed for intravenous chemotherapy drugs, but few exist for THCDs with a focus on decentralized models. Hence, Ontario Health (Cancer Care Ontario) established the Oncology Pharmacy Task Force (OPTF) to develop consensus-based recommendations on best practices for THCDs to ensure that patients receive safe, consistent, high-quality care in the community once they leave the cancer center/practice with a prescription. METHODS: The OPTF included 34 members with comprehensive representation. Guidance from leading authorities was extracted through literature review, thematically analyzed, and synthesized to develop 29 recommendations. The consensus process (> 70% agreement) included a three-step modified Delphi method followed by an extensive review process. RESULTS: Sixteen recommendations were developed: training and education for providers (2), drug access (1), prescribing (4), patient and family/caregiver education (3), communication (1), dispensing (3), monitoring for patient adherence and adverse effects (1), and incident reporting (1). CONCLUSION: Through a rigorous methodology, the OPTF derived a robust set of recommendations similar to the ASCO/Oncology Nursing Society and ASCO/National Community Oncology Dispensing Association guidelines, further validating and strengthening the applicability across multiple jurisdictions, including those with decentralized models. Unique aspects in a decentralized model include the need for two pharmacy professionals, with one doing cognitive verification of the script and the other dispensing the medication; moreover, they optimize interprofessional communication between community providers and the cancer center/practice health care team.

Impact of rarity on Canadian oncology health technology assessment and funding.

OBJECTIVES: The pan-Canadian Oncology Drug Review (pCODR) evaluates new cancer drugs for public funding recommendations. While pCODR's deliberative framework evaluates overall clinical benefit and includes considerations for exceptional circumstances, rarity of indication is not explicitly addressed. Given the high unmet need that typically accompanies these indications, we explored the impact of rarity on oncology HTA recommendations and funding decisions. METHODS: We examined pCODR submissions with final recommendations from 2012 to 2017. Incidence rates were calculated using pCODR recommendation reports and statistics from the Canadian Cancer Society. Indications were classified as rare if the incidence rate was lower than 1/100,000 diagnoses, a definition referenced by the Canadian Agency for Drugs and Technologies in Health. Each pCODR final report was examined for the funding recommendation/justification, level of supporting evidence (presence of a randomized control trial [RCT]), and time to funding (if applicable). RESULTS: Of the ninety-six pCODR reviews examined, 16.6 percent were classified as rare indications per above criteria. While the frequency of positive funding recommendations were similar between rare and nonrare indication (78.6 vs. 75 percent), rare indications were less likely to be presented with evidence from RCT (50 vs. 90 percent). The average time to funding did not differ significantly across provinces. CONCLUSION: Rare indications appear to be associated with weaker clinical evidence. There appears to be no association between rarity, positive funding recommendations, and time to funding. Further work will evaluate factors associated with positive recommendations and the real-world utilization of funded treatments for rare indications.

Real-world comparative effectiveness of second-line ipilimumab for metastatic melanoma: a population-based cohort study in Ontario, Canada.

BACKGROUND: For novel cancer treatments, effectiveness in clinical practice is not always aligned with clinical efficacy results. As such it is important to understand a treatment's real-world effectiveness. We examined real-world population-based comparative effectiveness of second-line ipilimumab versus non-ipilimumab treatments (chemotherapy or targeted treatments). METHODS: We used a cohort of melanoma patients receiving systemic treatment for advanced disease since April 2005 from Ontario, Canada. Patients were identified from provincial drug databases and the Ontario Cancer Registry who received second-line ipilimumab from 2012 to 2015 (treated) or second-line non-ipilimumab treatment prior to 2012 (historical controls). Historical controls were chosen, to permit the most direct comparison to pivotal trial findings. The cohort was linked to administrative databases to identify baseline characteristics and outcomes. Kaplan-Meier curves and multivariable Cox regression models were used to assess overall survival (OS). Observed potential confounders were adjusted for using inverse probability of treatment weighting (IPTW). RESULTS: We identified 329 patients with metastatic melanoma (MM) who had received second-line treatments (189 treated; 140 controls). Patients receiving second-line ipilimumab were older (61.7 years vs 55.2 years) compared to historical controls. Median OS were 6.9 (95% CI: 5.4-8.3) and 4.95 (4.3-6.0) months for ipilimumab and controls, respectively. The crude 1-year, 2-year, and 3-year OS probabilities were 34.3% (27-41%), 20.6% (15-27%), and 15.2% (9.6-21%) for ipilimumab and 17.1% (11-23%), 7.1% (2.9-11%), and 4.7% (1.2-8.2%) for controls. Ipilimumab was associated with improved OS (IPTW HR = 0.62; 95% CI: 0.49-0.78; p < 0.0001). CONCLUSIONS: This real-world analysis suggests second-line ipilimumab is associated with an improvement in OS for MM patients in routine practice.

Assessing the efficacy-effectiveness gap for cancer therapies: A comparison of overall survival and toxicity between clinical trial and population-based, real-world data for contemporary parenteral cancer therapeutics.

BACKGROUND: Although increasing evidence has suggested that an efficacy-effectiveness gap exists between clinical trial (CT) and real-world evidence (RWE), to the authors' knowledge, the magnitude of this difference remains undercharacterized. The objective of the current study was to quantify the magnitude of survival and toxicity differences between CT and RWE for contemporary cancer systemic therapies. METHODS: Patients receiving cancer therapies funded under Cancer Care Ontario's New Drug Funding Program (NDFP) were identified. Landmark CTs with data regarding survival and adverse events (AEs) for each drug indication were identified. RWE for survival and hospitalization rates during treatment were ascertained through Canadian population-based databases. The efficacy-effectiveness gap for each drug indication was calculated as the difference between RWE and CT data for median overall survival (OS), 1-year OS, and generated hazard ratios (HRs) with 95% CIs from Kaplan-Meier OS curves. Toxicity differences were calculated as the difference between RWE of hospitalization rates and CT serious AE rates. RESULTS: Twenty-nine indications from 20 systemic therapies were included. Twenty-eight of 29 indications (97%) demonstrated worse survival in RWE, with a median OS difference of 5.2 months (interquartile range, 3.0-12.1 months). Lower effectiveness in RWE also was demonstrated through a meta-analysis of an OS hazard ratio of 1.58 (95% CI, 1.39-1.80). The median difference between RWE for hospitalization rates and CT serious AEs was 14% (95% CI, 9%-22%). CONCLUSIONS: An efficacy-effectiveness gap exists for contemporary cancer systemic therapies, with a 5.2-month lower median OS observed in RWE compared with CT data. These data supports the use of RWE to better inform real-world decision making regarding the use of cancer systemic therapies.

Developing a framework to incorporate real-world evidence in cancer drug funding decisions: the Canadian Real-world Evidence for Value of Cancer Drugs (CanREValue) collaboration.

BACKGROUND: Oncology therapy is becoming increasingly more expensive and challenging the affordability and sustainability of drug programmes around the world. When new drugs are evaluated, health technology assessment organisations rely on clinical trials to inform funding decisions. However, clinical trials are not able to assess overall survival and generalises evidence in a real-world setting. As a result, policy makers have little information on whether drug funding decisions based on clinical trials ultimately yield the outcomes and value for money that might be expected. OBJECTIVE: The Canadian Real-world Evidence for Value of Cancer Drugs (CanREValue) collaboration, consisting of researchers, recommendation-makers, decision makers, payers, patients and caregivers, are developing and testing a framework for Canadian provinces to generate and use real-world evidence (RWE) for cancer drug funding in a consistent and integrated manner. STRATEGY: The CanREValue collaboration has established five formal working groups (WGs) to focus on specific processes in the generation and use of RWE for cancer drug funding decisions in Canada. The different RWE WGs are: (1) Planning and Drug Selection; (2) Methods; (3) Data; (4) Reassessment and Uptake; (5) Engagement. These WGs are acting collaboratively to develop a framework for RWE evaluation, validate the framework through the multiprovince RWE projects and help to integrate the final RWE framework into the Canadian healthcare system. OUTCOMES: The framework will enable the reassessment of cancer drugs, refinement of funding recommendations and use of novel funding mechanisms by decision-makers/payers across Canada to ensure the healthcare system is providing clinical benefits and value for money.

Are population-based patient-reported outcomes associated with overall survival in patients with advanced pancreatic cancer?

BACKGROUND: Advanced pancreatic cancer (APC) patients often have substantial symptom burden. In Ontario, patients routinely complete the Edmonton Symptom Assessment Scale (ESAS), which screens for nine symptoms (scale: 0-10), in cancer clinics. We explored the association between baseline patient-reported outcomes, via ESAS, and overall survival (OS). METHODS: Advanced pancreatic cancer patients with ESAS records prior to receiving publicly funded drugs from November 2008 to March 2016 were retrospectively identified from Cancer Care Ontario's administrative databases. We examined three composite ESAS scores: total symptom distress score (TSDS: 9 symptoms), physical symptom score (PHS: 6/9 symptoms), and psychological symptom score (PSS: 2/9 symptoms); Composite scores greater than defined thresholds (TSDS ≥36, PHS ≥24, PSS ≥8) were considered as high symptom burden. Crude OS was assessed using Kaplan-Meier method. Hazard ratios (HRs) were assessed using multivariable Cox models. Analysis was repeated in a sub-cohort with Eastern Cooperative Oncology Group (ECOG) status and metastasis. RESULTS: We identified 2199 APC patients (mean age 64 years, 55% male) with ESAS records prior to receiving chemotherapy. Crude median survival was 4.5 and 7.3 months for high and low TSDS, respectively. High TSDS was associated with lower OS (HR = 1.47, 95% CI: 1.33, 1.63). In the sub-cohort (n = 393) with ECOG status and metastasis, high TSDS was also associated with lower OS (HR = 1.34, 95% CI: 1.04, 1.73). Similar trends were observed for PHS and PSS. CONCLUSIONS: Higher burden of patient-reported outcome was associated with reduced OS among APC patients. The effect was prominent after adjusting for ECOG status.

Real-world outcomes of FOLFIRINOX vs gemcitabine and nab-paclitaxel in advanced pancreatic cancer: A population-based propensity score-weighted analysis.

BACKGROUND: In Ontario, FOLFIRINOX (FFX) and gemcitabine + nab-paclitaxel (GnP) have been publicly funded for first-line unresectable locally advanced pancreatic cancer (uLAPC) or metastatic pancreatic cancer (mPC) since April 2015. We examined the real-world effectiveness and safety of FFX vs GnP for advanced pancreatic cancer, and in uLAPC and mPC. METHODS: Patients receiving first-line FFX or GnP from April 2015 to March 2017 were identified in the New Drug Funding Program database. Baseline characteristics and outcomes were obtained through the Ontario Cancer Registry and other population-based databases. Overall survival (OS) was assessed using Kaplan-Meier and weighted Cox proportional hazard models, weighted by the inverse propensity score adjusting for baseline characteristics. Weighted odds ratio (OR) for hospitalization and emergency department visits (EDV) were estimated from weighted logistic regression models. RESULTS: For 1130 patients (632 FFX, 498 GnP), crude median OS was 9.6 and 6.1 months for FFX and GnP, respectively. Weighted OS was improved for FFX vs GnP (HR = 0.77, 0.70-0.85). Less frequent EDV and hospitalization were observed in FFX (EDV: 67.8%; Hospitalization: 49.2%) than GnP (EDV: 77.7%; Hospitalization: 59.3%). More frequent febrile neutropenia-related hospitalization was observed in FFX (5.8%) than GnP (3.3%). Risk of EDV and hospitalization were significantly lower for FFX vs GnP (EDV: OR = 0.68, P = .0001; Hospitalization: OR = 0.76, P = .002), whereas the risk of febrile neutropenia-related hospitalization was significantly higher (OR = 2.12, P = .001). Outcomes for uLAPC and mPC were similar. CONCLUSION: In the real world, FFX had longer OS, less frequent all-cause EDV and all-cause hospitalization, but more febrile neutropenia-related hospitalization compared to GnP.

Improved survival in overweight and obese patients with aggressive B-cell lymphoma treated with rituximab-containing chemotherapy for curative intent.

The association between obesity and survival in non-Hodgkin lymphoma is unclear. Using the Ontario Cancer Registry we conducted a retrospective analysis of incident cases of aggressive-histology B-cell lymphoma treated with a rituximab-containing regimen with curative intent between 2008-2016. 6246 patients were included. On multivariable analysis the rate of all-cause mortality was lower for the overweight body mass index (BMI 25-29.9 kg/m2) (HR 0.85; 95%CI 0.77-0.95) and obese BMI (≥30 kg/m2) (HR 0.75; 95%CI 0.67-0.85) groups compared to the normal weight group (18.5-24.9 kg/m2). Binomial logistic regression analysis revealed a lower odds ratio (OR) of admission to hospital during treatment in the overweight (OR 0.84; 95%CI 0.75-0.95) compared to normal weight BMI group. In the largest cohort to date of aggressive-histology B-cell lymphoma patients treated with rituximab, increased BMI is associated with a survival advantage, and the magnitude of this effect increases from overweight to obese BMI.

Association of hospital and physician case volumes with cardiac monitoring and cardiotoxicity during adjuvant trastuzumab treatment for breast cancer: a retrospective cohort study.

BACKGROUND: Adjuvant trastuzumab is the standard of care for patients with HER2 overexpressing breast cancer, but use of trastuzumab may lead to cardiotoxicity. Our goal was to evaluate the relationship between hospital and physician case volume and cardiac outcomes in this population. METHODS: In this retrospective cohort study, we identified all female patients in Ontario with a breast cancer diagnosis in 2003-2009 who underwent treatment with trastuzumab through a provincial drug-funding program and linked these patients to administrative databases to ascertain patient demographics, treating hospital and physician characteristics, admissions to hospital, cardiac risk factors, cardiac imaging and comorbidities. Insufficient cardiac monitoring was defined as per the Canadian Trastuzumab Working Group guideline. Cardiotoxicity was defined as receiving fewer than 16 of 18 doses of trastuzumab because of heart failure admission, heart failure diagnosis or discontinuation of the drug after cardiac imaging. We constructed hierarchical multivariable logistic regression models to evaluate the effect of annual hospital volume, cumulative physician volume and treatment period on cardiac monitoring and cardiotoxicity. RESULTS: Of 3777 women treated by 214 oncologists at 68 hospitals, 918 (24.3%) had insufficient cardiac monitoring and cardiotoxicity developed in 640 (16.9%). Cardiotoxicity occurred in 389 (42.4%) and 251 (8.8%) patients in the insufficient- and sufficient-monitoring groups, respectively. Higher annual hospital and cumulative physician volumes, and more recent calendar period, were all independent predictors for decreased cardiotoxicity. Adjustment for rates of cardiac monitoring annulled the relationships between case volume and cardiotoxicity. INTERPRETATION: Greater hospital and physician case volumes are associated with reduced rates of trastuzumab-related cardiotoxicity, most likely because of better cardiac monitoring at higher volume centres.