Implementing preconception expanded carrier screening in a universal health care system: A model-based cost-effectiveness analysis.

PURPOSE: The limited evidence available on the cost-effectiveness (CE) of expanded carrier screening (ECS) prevents its widespread use in most countries, including Italy. Herein, we aimed to estimate the CE of 3 ECS panels (ie, American College of Medical Genetics and Genomics [ACMG] Tier 1 screening, "Focused Screening," testing 15 severe, highly penetrant conditions, and ACMG Tier 3 screening) compared with no screening, the health care model currently adopted in Italy. METHODS: The reference population consisted of Italian couples seeking pregnancy with no increased personal/familial genetic risk. The CE model was developed from the perspective of the Italian universal health care system and was based on the following assumptions: 100% sensitivity of investigated screening strategies, 77% intervention rate of at-risk couples (ARCs), and no risk to conceive an affected child by risk-averse couples opting for medical interventions. RESULTS: The incremental CE ratios generated by comparing each genetic screening panel with no screening were: -14,875 ± 1,208 €/life years gained (LYG) for ACMG1S, -106,863 ± 2,379 €/LYG for Focused Screening, and -47,277 ± 1,430 €/LYG for ACMG3S. ACMG1S and Focused Screening were dominated by ACMG3S. The parameter uncertainty did not significantly affect the outcome of the analyses. CONCLUSION: From a universal health care system perspective, all the 3 ECS panels considered in the study would be more cost-effective than no screening.

The evolution of the Italian National Health Service.

40 years ago, Italy saw the birth of a national, universal health-care system (Servizio Sanitario Nazionale [SSN]), which provides a full range of health-care services with a free choice of providers. The SSN is consistently rated within the Organisation for Economic Co-operation and Development among the highest countries for life expectancy and among the lowest in health-care spending as a proportion of gross domestic product. Italy appears to be in an envious position. However, a rapidly ageing population, increasing prevalence of chronic diseases, rising demand, and the COVID-19 pandemic have exposed weaknesses in the system. These weaknesses are linked to the often tumultuous history of the nation and the health-care system, in which innovation and initiative often lead to spiralling costs and difficulties, followed by austere cost-containment measures. We describe how the tenuous balance of centralised versus regional control has shifted over time to create not one, but 20 different health systems, exacerbating differences in access to care across regions. We explore how Italy can rise to the challenges ahead, providing recommendations for systemic change, with emphasis on data-driven planning, prevention, and research; integrated care and technology; and investments in personnel. The evolution of the SSN is characterised by an ongoing struggle to balance centralisation and decentralisation in a health-care system, a dilemma faced by many nations. If in times of emergency, planning, coordination, and control by the central government can guarantee uniformity of provider behaviour and access to care, during non-emergency times, we believe that a balance can be found provided that autonomy is paired with accountability in achieving certain objectives, and that the central government develops the skills and, therefore, the legitimacy, to formulate health policies of a national nature. These processes would provide local governments with the strategic means to develop local plans and programmes, and the knowledge and tools to coordinate local initiatives for eventual transfer to the larger system.

Recommendations for developing a lifecycle, multidimensional assessment framework for mobile medical apps.

Digital health and mobile medical apps (MMAs) have shown great promise in transforming health care, but their adoption in clinical care has been unsatisfactory, and regulatory guidance and coverage decisions have been lacking or incomplete. A multidimensional assessment framework for regulatory, policymaking, health technology assessment, and coverage purposes based on the MMA lifecycle is needed. A targeted review of relevant policy documents from international sources was conducted to map current MMA assessment frameworks, to formulate 10 recommendations, subsequently shared amongst an expert panel of key stakeholders. Recommendations go beyond economic dimensions such as cost and economic evaluation and also include MMA development and update, classification and evidentiary requirements, performance and maintenance monitoring, usability testing, clinical evidence requirements, safety and security, equity considerations, organizational assessment, and additional outcome domains (patient empowerment and environmental impact). The COVID-19 pandemic greatly expanded the use of MMAs, but temporary policies governing their use and oversight need consolidation through well-developed frameworks to support decision-makers, producers and introduction into clinical care processes, especially in light of the strong international, cross-border character of MMAs, the new EU medical device and health technology assessment regulations, and the Next Generation EU funding earmarked for health digitalization.

Pushing the boundaries of evaluation, diffusion, and use of medical devices in Europe: Insights from the COMED project.

The field of medical devices has attracted considerable interest from scholarly research in health economics in recent years. Medical devices are indispensable tools for quality health care delivery, but their assessment and appropriate use pose significant challenges to healthcare systems. More research is needed to overcome existing gaps associated with evaluation of digital technologies, address challenges in the use of real-world data in generating evidence for decision-making and to uncover drivers of variation in access to medical devices across countries. Furthermore, the translation of the results and recommendations stemming from research projects into health technology assessment practices needs to be strengthened. The European Union (EU) project COMED aimed to address these gaps by improving existing research and developing new research streams on the methods for evaluation and diffusion of medical devices. The project also intended to provide directly applicable policy advice and tools to inform decision-making, with the aim of impacting public health in the EU. This Health Economics Supplement, together with references of other published outputs of the project, is intended to be the main source for researchers and policy makers seeking information on the COMED project.

Cost-effectiveness analysis of oral nutritional supplements with nutritional counselling in head and neck cancer patients undergoing radiotherapy.

OBJECTIVE: There is limited evidence regarding the economic effects of nutrition support in cancer patients. This study aims at investigating the cost-effectiveness profile of systematic oral nutritional supplementation (ONS) in head and neck cancer (HNC) patients undergoing radiotherapy (RT) and receiving nutritional counseling. METHODS: A cost-effectiveness analysis based on a RCT was performed to estimate direct medical costs, life years gained (LYG) and Quality-Adjusted Life Years (QALY) for nutritional counseling with or without ONS at 5-month and 6-year follow up time. Value of information analysis was performed to value the expected gain from reducing uncertainty through further data collection. RESULTS: ONS with nutritional counseling produced higher QALY than nutritional counseling alone (0.291 ± 0.087 vs 0.288 ± 0.087), however the difference was not significant (0.0027, P = 0.84). Mean costs were €987.60 vs €996.09, respectively in the treatment and control group (-€8.96, P = 0.98). The Incremental Cost Effectiveness Ratio (ICER) was -€3,277/QALY, with 55.4% probabilities of being cost-effective at a cost-effectiveness threshold of €30,000/QALY. The Expected Incremental Benefit was €95.16 and the Population Expected Value of Perfect Information was €8.6 million, implying that additional research is likely to be worthwhile. At a median 6-year follow up, the treatment group had a significantly better survival rate when adjusting for late effect (P = 0.039). CONCLUSION: Our findings provide the first evidence to inform decisions about funding and reimbursement of ONS in combination with nutritional counseling in HNC patients undergoing RT. ONS may improve quality of cancer care at no additional costs, however further research on the cost-effectiveness of nutritional supplementation is recommended. TRIAL REGISTRATION: ClinicalTrials.gov: NCT02055833. Registered 5th February 2014 https://clinicaltrials.gov/ct2/show/NCT02055833.

Do existing real-world data sources generate suitable evidence for the HTA of medical devices in Europe? Mapping and critical appraisal.

AIM: Technological and computational advancements offer new tools for the collection and analysis of real-world data (RWD). Considering the substantial effort and resources devoted to collecting RWD, a greater return would be achieved if real-world evidence (RWE) was effectively used to support Health Technology Assessment (HTA) and decision making on medical technologies. A useful question is: To what extent are RWD suitable for generating RWE? METHODS: We mapped existing RWD sources in Europe for three case studies: hip and knee arthroplasty, transcatheter aortic valve implantation (TAVI) and mitral valve repair (TMVR), and robotic surgery procedures. We provided a comprehensive assessment of their content and appropriateness for conducting the HTA of medical devices. The identification of RWD sources was performed combining a systematic search on PubMed with gray literature scoping, covering fifteen European countries. RESULTS: We identified seventy-one RWD sources on arthroplasties; ninety-five on TAVI and TMVR; and seventy-seven on robotic procedures. The number, content, and integrity of the sources varied dramatically across countries. Most sources included at least one health outcome (97.5%), with mortality and rehospitalization/reoperation the most common; 80% of sources included resource outcomes, with length of stay the most common, and comparators were available in almost 70% of sources. CONCLUSIONS: RWD sources bear the potential for the HTA of medical devices. The main challenges are data accessibility, a lack of standardization of health and economic outcomes, and inadequate comparators. These findings are crucial to enabling the incorporation of RWD into decision making and represent a readily available tool for getting acquainted with existing information sources.

Do Social Values and Institutional Context Shape the Use of Economic Evaluation in Reimbursement Decisions? An Empirical Analysis.

OBJECTIVES: To investigate whether the use of economic evaluation (EE) in healthcare decision making is influenced by the social values and institutional context in a given country. METHODS: We developed and tested a conceptual framework for the 36 Organisation for Economic Co-operation and Development (OECD) countries. The countries were divided into two groups based on the extent of their use of EE in drug reimbursement. The key social values were efficiency, equity, and personal responsibility, measured in an international survey. Countries were classified based on their institutional context in terms of their general welfare paradigm/type of healthcare system and the administrative tradition to which they belong. We performed correlation tests and ran path analysis regression models to test our hypotheses. RESULTS: EE high users included significantly more Beveridge-type systems (50% vs 31%) and fewer Bismarck-type (15% vs 56%). Napoleonic tradition countries seemed to reject personal responsibility in health (r = -0.511, P = .009), whereas Germanic tradition countries embraced it (r = 0.572, P = .003); Anglo-American tradition countries exhibited a significant association with efficiency (r = 0.444, P = .026), whereas Scandinavian tradition countries appeared to reject it as a criterion for rationing in healthcare (r = -0.454, P = .023). No significant direct association was found between social values and use of EE. CONCLUSION: Our exploratory analysis suggests that institutional context and, indirectly, social values may play a role in shaping the use of EE in healthcare decision making. Because of the differences among countries in terms of institutional context, which may in part be influenced by social values, it is unlikely that there will ever be a single, harmonious approach to the use of EE.

Harnessing Digital Health Technologies During and After the COVID-19 Pandemic: Context Matters.

A common development observed during the COVID-19 pandemic is the renewed reliance on digital health technologies. Prior to the pandemic, the uptake of digital health technologies to directly strengthen public health systems had been unsatisfactory; however, a relentless acceleration took place within health care systems during the COVID-19 pandemic. Therefore, digital health technologies could not be prescinded from the organizational and institutional merits of the systems in which they were introduced. The Italian National Health Service is strongly decentralized, with the national government exercising general stewardship and regions responsible for the delivery of health care services. Together with the substantial lack of digital efforts previously, these institutional characteristics resulted in delays in the uptake of appropriate solutions, territorial differences, and issues in engaging the appropriate health care professionals during the pandemic. An in-depth analysis of the organizational context is instrumental in fully interpreting the contribution of digital health during the pandemic and providing the foundation for the digital reconstruction of what is to come after.

Trans-arterial radioembolization for intermediate-advanced hepatocellular carcinoma: a budget impact analysis.

BACKGROUND: Trans-arterial radio-embolization (TARE) is an emerging treatment for the management of hepatocellular carcinoma (HCC). TARE may compete with systemic chemotherapy, sorafenib, in intermediate stage patients with prior chemoembolization failure or advanced patients with tumoral macrovascular invasion with no extra-hepatic spread and good liver function. We performed a budget impact analysis (BIA) evaluating the expected changes in the expenditure for the Italian Healthcare Service within scenarios of increased utilization of TARE in place of sorafenib over the next five years. METHODS: Starting from patient level data from three oncology centres in Italy, a Markov model was developed to project on a lifetime horizon survivals and costs associated to matched cohorts of intermediate-advanced HCC patients treated with TARE or sorafenib. The initial model has been integrated with epidemiological data to perform a BIA comparing the current scenario with 20 and 80% utilization rates for TARE and sorafenib, respectively, with increasing utilization rates of TARE of 30, 40 and 50% over the next 1, 3 and 5 years. RESULTS: Compared to the current scenario, progressively increasing utilization rates of TARE over sorafenib in the next 5 years is expected to save globally about 7 million Euros. CONCLUSIONS: Radioembolization can be considered a valuable treatment option for patients with intermediate-advanced HCC. These findings enrich the evidence about the economic sustainability of TARE in comparison to standard systemic chemotherapy within the context of a national healthcare service.

Real-World Data for the Evaluation of Transarterial Radioembolization versus Sorafenib in Hepatocellular Carcinoma: A Cost-Effectiveness Analysis.

OBJECTIVES: To perform a cost-effectiveness analysis comparing the use of transarterial radioembolization (TARE) with that of sorafenib in the treatment of patients with intermediate or advanced hepatocellular carcinoma (HCC) according to the Barcelona Clinic Liver Cancer staging system. METHODS: Patient-level data were consecutively recorded and collected at three oncology centers in Italy. A propensity score matching was performed to compare patients with similar clinical characteristics who underwent TARE or sorafenib treatment. Clinical data from the matched cohorts were used to populate a Markov model to project, on a lifetime horizon, life years, quality-adjusted life years, and economic outcomes associated with TARE and sorafenib for both intermediate and advanced HCC stages. RESULTS: Starting from data covering 389 and 241 patients who underwent TARE and sorafenib treatment, respectively, the propensity score matching yielded a total of 308 matched patients. For intermediate-stage patients, the model estimated for TARE versus sorafenib an incremental cost-utility ratio of €3,302/QALY (incremental cost-effectiveness ratio of €1,865 per life year gained), whereas for patients in advanced stage TARE dominated (lower costs and greater health improvements) compared with sorafenib. CONCLUSIONS: From an Italian health care service perspective, TARE could be a cost-effective strategy in comparison with sorafenib for patients with intermediate or advanced HCC. The results from forthcoming randomized controlled trials comparing TARE with sorafenib will be able to confirm or reject the validity of this preliminary evaluation. In the meantime, decision makers can use these results to control and coordinate the diffusion of the technology.

Good Practices for Real-World Data Studies of Treatment and/or Comparative Effectiveness: Recommendations from the Joint ISPOR-ISPE Special Task Force on Real-World Evidence in Health Care Decision Making.

PURPOSE: Real-world evidence (RWE) includes data from retrospective or prospective observational studies and observational registries and provides insights beyond those addressed by randomized controlled trials. RWE studies aim to improve health care decision making. METHODS: The International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and the International Society for Pharmacoepidemiology (ISPE) created a task force to make recommendations regarding good procedural practices that would enhance decision makers' confidence in evidence derived from RWD studies. Peer review by ISPOR/ISPE members and task force participants provided a consensus-building iterative process for the topics and framing of recommendations. RESULTS: The ISPOR/ISPE Task Force recommendations cover seven topics such as study registration, replicability, and stakeholder involvement in RWE studies. These recommendations, in concert with earlier recommendations about study methodology, provide a trustworthy foundation for the expanded use of RWE in health care decision making. CONCLUSION: The focus of these recommendations is good procedural practices for studies that test a specific hypothesis in a specific population. We recognize that some of the recommendations in this report may not be widely adopted without appropriate incentives from decision makers, journal editors, and other key stakeholders.

A randomized, open-label, multicenter study of the efficacy and safety of intravesical hyaluronic acid and chondroitin sulfate versus dimethyl sulfoxide in women with bladder pain syndrome/interstitial cystitis.

AIMS: Intravesical instillation of hyaluronic acid (HA) plus chondroitin sulfate (CS) in women with bladder pain syndrome/interstitial cystitis (BPS/IC) has shown promising results. This study compared the efficacy, safety, and costs of intravesical HA/CS (Ialuril® , IBSA) to dimethyl sulfoxide (DMSO). METHODS: Randomized, open-label, multicenter study involving 110 women with BPS/IC. The allocation ratio (HA/CS:DMSO) was 2:1. Thirteen weekly instillations of HA (1.6%)/CS (2.0%) or 50% DMSO were given. Patients were evaluated at 3 (end-of-treatment) and 6 months. Primary endpoint was reduction in pain intensity at 6 months by visual analogue scale (VAS) versus baseline. Secondary efficacy measurements were quality of life and economic analyses. RESULTS: A significant reduction in pain intensity was observed at 6 months in both treatment groups versus baseline (P < 0.0001) in the intention-to-treat population. Treatment with HA/CS resulted in a greater reduction in pain intensity at 6 months compared with DMSO for the per-protocol population (mean VAS reduction 44.77 ± 25.07 vs. 28.89 ± 31.14, respectively; P = 0.0186). There were no significant differences between treatment groups in secondary outcomes. At least one adverse event was reported in 14.86% and 30.56% of patients in the HA/CS and DMSO groups, respectively. There were significantly fewer treatment-related adverse events for HA/CS versus DMSO (1.35% vs. 22.22%; P = 0.001). Considering direct healthcare costs, the incremental cost-effectiveness ratio of HA/CS versus DMSO fell between 3735€/quality-adjusted life years (QALY) and 8003€/QALY. CONCLUSIONS: Treatment with HA/CS appears to be as effective as DMSO with a potentially more favorable safety profile. Both treatments increased health-related quality of life, while HA/CS showed a more acceptable cost-effectiveness profile.

Challenges in the Assessment of Medical Devices: The MedtecHTA Project.

Assessing medical devices (MDs) raises challenges which require us to reflect on whether current methods are adequate. Major features of devices are: (i) device-operator interaction can generate learning curve effects; (ii) incremental nature of innovation needs to be addressed by careful identification of the alternatives for comparative and incremental cost-effectiveness analysis; and (iii) broader organizational impact in terms of training and infrastructure, coupled with dynamic pricing, requires a more flexible approach to costing. The objective of the MedtecHTA project was to investigate improvements in HTA methods to allow for more comprehensive evaluation of MDs. It consisted of several work packages concerning (i) the available evidence on the currently adopted approaches for regulation and HTA of medical devices; (ii) the geographical variation in access to MDs; (iii) the development of methodological frameworks for conducting comparative effectiveness research and economic evaluation of MDs; and (iv) the organizational impact of MDs. This introductory paper summarizes the main results of the project and draws out the main overarching themes. This supplement represents a comprehensive report of all the main findings of the MedtecHTA project, and it is intended to be the main source for researchers and policy makers wanting information on the project. © 2017 The Authors. Health Economics published by John Wiley & Sons, Ltd.

Key Recommendations from the MedtecHTA Project.

There are particular characteristics of Medical Devices, such as the device-user interaction, the incremental nature of innovation and the broader organizational impact that lead to additional challenges for health technology assessment (HTA). The project explored key aspects of the conduct and methods of HTA for MDs. Systematic reviews and original research studies were conducted to determine improvements in processes and methods that could enhance the potential for HTA and optimize the diffusion of MDs. Regulatory processes for MDs should be more closely aligned, the HTA evaluative framework should be harmonized and processes for conditional coverage and evidence development should be used. The methods for HTA should consider MDs as complex interventions, require the establishment of high quality registries, consider an iterative approach to the evaluation over time, recognize and allow for the particular characteristics of devices and use appropriate approaches for confounder adjustment in comparative effectiveness studies. To optimize the diffusion, a common classification should be developed across countries in order to facilitate international comparisons, factors driving diffusion should be explored in HTA reports and physicians' personal goals and motivation should be better understood. The key recommendations of the MedtecHTA project should improve the conduct and use of HTA for MDs. © 2017 The Authors. Health Economics published by John Wiley & Sons, Ltd.

Improving the Methods for the Economic Evaluation of Medical Devices.

Medical devices (MDs) have distinctive features, such as incremental innovation, dynamic pricing, the learning curve and organisational impact, that need to be considered when they are evaluated. This paper investigates how MDs have been assessed in practice, in order to identify methodological gaps that need to be addressed to improve the decision-making process for their adoption. We used the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist supplemented by some additional categories to assess the quality of reporting and consideration of the distinctive features of MDs. Two case studies were considered: transcatheter aortic valve implantation (TAVI) representing an emerging technology and implantable cardioverter defibrillators (ICDs) representing a mature technology. Economic evaluation studies published as journal articles or within Health Technology Assessment reports were identified through a systematic literature review. A total of 19 studies on TAVI and 41 studies on ICDs were analysed. Learning curve was considered in only 16% of studies on TAVI. Incremental innovation was more frequently mentioned in the studies of ICDs, but its impact was considered in only 34% of the cases. Dynamic pricing was the most recognised feature but was empirically tested in less than half of studies of TAVI and only 32% of studies on ICDs. Finally, organisational impact was considered in only one study of ICDs and in almost all studies on TAVI, but none of them estimated its impact. By their very nature, most of the distinctive features of MDs cannot be fully assessed at market entry. However, their potential impact could be modelled, based on the experience with previous MDs, in order to make a preliminary recommendation. Then, well-designed post-market studies could help in reducing uncertainties and make policymakers more confident to achieve conclusive recommendations. © 2017 The Authors. Health Economics published by John Wiley & Sons, Ltd.

Characterising Uncertainty in the Assessment of Medical Devices and Determining Future Research Needs.

Decisions about the adoption of medical interventions are informed by evidence on their costs and effects. For a range of reasons, evidence relating to medical devices may be limited. The decision to adopt a device early in its life cycle when the evidence base is least mature may impact on the prospects of acquiring further evidence to reduce uncertainties. Equally, rejecting a device will result in no uptake in practice and hence no chance to learn about performance. Decision options such as 'only in research' or 'approval with research' can overcome these issues by allowing patients early access to promising new technologies while limiting the risks associated with making incorrect decisions until more evidence or learning is established. In this paper, we set out the issues relating to uncertainty and the value of research specific to devices: learning curve effects, incremental device innovation, investment and irrecoverable costs, and dynamic pricing. We show the circumstances under which an only in research or approval with research scheme may be an appropriate policy choice. We also consider how the value of additional research might be shared between the manufacturer and health sector to help inform who might reasonably be expected to conduct the research needed. © 2017 The Authors. Health Economics published by John Wiley & Sons, Ltd.

Good practices for real-world data studies of treatment and/or comparative effectiveness: Recommendations from the joint ISPOR-ISPE Special Task Force on real-world evidence in health care decision making.

PURPOSE: Real-world evidence (RWE) includes data from retrospective or prospective observational studies and observational registries and provides insights beyond those addressed by randomized controlled trials. RWE studies aim to improve health care decision making. METHODS: The International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and the International Society for Pharmacoepidemiology (ISPE) created a task force to make recommendations regarding good procedural practices that would enhance decision makers' confidence in evidence derived from RWD studies. Peer review by ISPOR/ISPE members and task force participants provided a consensus-building iterative process for the topics and framing of recommendations. RESULTS: The ISPOR/ISPE Task Force recommendations cover seven topics such as study registration, replicability, and stakeholder involvement in RWE studies. These recommendations, in concert with earlier recommendations about study methodology, provide a trustworthy foundation for the expanded use of RWE in health care decision making. CONCLUSION: The focus of these recommendations is good procedural practices for studies that test a specific hypothesis in a specific population. We recognize that some of the recommendations in this report may not be widely adopted without appropriate incentives from decision makers, journal editors, and other key stakeholders.

Intermittent catheterisation with hydrophilic and non-hydrophilic urinary catheters: systematic literature review and meta-analyses.

BACKGROUND: Intermittent catheterisation is the method of choice for the management of bladder dysfunctions. Different urinary catheters are available, but there is conflicting evidence on which type of catheter is best. The present study provides an objective evaluation of the clinical effectiveness of different subsets of urinary catheters. METHODS: A systematic literature review was performed for published RCTs regarding hydrophilic coated and PVC (standard) catheters for intermittent catheterisation. Separate meta-analyses were conducted to combine data on frequencies of urinary tract infections (UTIs) and haematuria. Two separate analyses were performed, including or excluding reused standard catheters. RESULTS: Seven studies were eligible for inclusion in the review. The meta-analyses exploring UTI frequencies showed a lower risk ratio associated with hydrophilic catheters in comparison to standard ones (RR = 0.84; 95% CI, 0.75-0.94; p = 0.003). Results for the "reuse" scenario were consistent with the ones related to "single-use" scenario in terms of frequency of UTIs. The meta-analyses exploring haematuria were not able to demonstrate any statistically significant difference between hydrophilic catheters in comparison to standard ones. CONCLUSIONS: The findings confirm previously reported benefits of hydrophilic catheters but a broader evaluation that takes into account also patient preferences, compliance of therapy, quality of life and costs would be needed to assess the economic sustainability of these advanced devices.

A network meta-analysis of everolimus plus exemestane versus chemotherapy in the first- and second-line treatment of estrogen receptor-positive metastatic breast cancer.

The goal of this study was to compare the efficacy and toxicity of chemotherapy to exemestane plus everolimus (EXE/EVE) through a network meta-analysis (NMA) of randomized controlled trials. NMA methods extend standard pairwise meta-analysis to allow simultaneous comparison of multiple treatments while maintaining randomization of individual studies. The method enables "direct" evidence (i.e., evidence from studies directly comparing two interventions) and "indirect" evidence (i.e., evidence from studies that do not compare the two interventions directly) to be pooled under the assumption of evidence consistency. We used NMA to evaluate progression-free survival (PFS) and time to progression (TTP) curves in 34 studies, and response rate (RR) and the hazard ratios (HRs) of the PFS/TTP in 36 studies. A number needed to treat (NNT) analysis was also performed as well as descriptive comparison of reported toxicities. The NMA for PFS/TTP curves and for HR shows EXE/EVE is more efficacious than capecitabine plus sunitinib, CMF, megestrol acetate and tamoxifen, with an average of related-PFS/TTP difference ranging from about 10 months for capecitabine plus sunitinib to more than 6 months for tamoxifen. The NMA for overall RR shows that EXE/EVE provides a better RR than bevacizumab plus capecitabine, capecitabine, capecitabine plus sorafenib, capecitabine plus sunitinib, CMF, gemcitabine plus epirubicin plus paclitaxel, EVE plus tamoxifen, EXE, FEC, megestrol acetate, mitoxantrone, and tamoxifen. Finally, the NMA for NNT shows that EXE/EVE is more beneficial as compared to BMF, capecitabine, capecitabine plus sunitinib, CMF, FEC, megestrol acetate, mitoxantrone, and tamoxifen. The combination of EXE/EVE as first- or second-line therapy for ER+ve/HER2-ve metastatic breast cancer is more efficacious than several chemotherapy regimens that were reported in the literature. Toxicities also favored EXE/EVE in most instances.