Can requests for real-world evidence by the French HTA body be planned? An exhaustive retrospective case-control study of medicinal products appraisals from 2016 to 2021.

OBJECTIVES: In France, decisions for pricing and reimbursement for medicinal products are based on appraisals performed by the National authority for health (Haute Autorité de Santé (HAS)). During the appraisal process, additional real-world evidence can be requested as "Post-Registration Studies" (PRS) when there are uncertainties in evidence that could be resolved by additional data collection. To facilitate PRS planning, a retrospective exploratory analysis was conducted to identify the characteristics of medicinal products associated with a PRS request. METHODS: This analysis encompassed all appraisals finalized between January 1, 2016 and December 31, 2021 and compared products for which the appraisal led to a PRS request with those that did not. RESULTS: Six hundred positive opinions for reimbursement were identified, with a PRS request present in 17 percent (n = 103) of cases. The independent characteristics associated with a PRS request were a mild or moderate clinical benefit score, a major to moderate or minor clinical added value score, previous availability under an early access program, and certain therapeutic areas (neurology, pulmonology, and endocrinology). These findings suggest two different profiles of PRS requests: (i) products for which there is uncertainty in the size of the clinical benefit and (ii) innovative products for which a substantial benefit is expected but uncertainties persist. CONCLUSIONS: These results will assist health technology developers to better anticipate data generation to promptly address uncertainties identified by HAS. It may also help HAS and other assessment agencies to work together to improve postlaunch evidence generation according to the characteristics of the medicinal products.

Experiences of patient organizations' involvement in medicine appraisal and reimbursement processes in Finland - a qualitative study.

BACKGROUND: This study investigated how patient representatives have experienced their involvement in medicines appraisal and reimbursement processes with the Council for Choices in Health Care in Finland (COHERE) and the Pharmaceuticals Pricing Board (PPB) and how authorities perceive the role of patient organizations' input. METHODS: Semi-structured thematic individual and pair interviews were conducted in 2021 with representatives (n = 14) of patient organizations and government officials (n = 7) of the Ministry of Social Affairs and Health. The interview data were analyzed using qualitative content analysis. RESULTS: Patient representatives expressed their appreciation for the PPB and the COHERE in creating consultation processes and systematic models that support involvement. However, there were many challenges: patient representatives were uncertain about how their submissions were utilized in official processes and whether their opinions had any significance in decision-making. Patients or patient organizations lack representation in appraisal and decision-making bodies, and patient representatives felt that decision-making lacked transparency. The importance of patient involvement was highlighted by the authorities, but they also emphasized that the patient organizations' contributions were complementary to the other materials. Submissions regarding the medications used to treat rare diseases and those with limited research evidence were considered particularly valuable. However, the submissions may not necessarily have a direct impact on decisions. CONCLUSIONS: The interviews provided relevant input for the development of involvement processes at the PPB and COHERE. The interviews confirmed the need for increased transparency in the medicines assessment, appraisal, and decision-making procedures in Finland.

A situational and stakeholder analysis of health technology assessment in Zimbabwe.

OBJECTIVES: Systematic priority setting is necessary for achieving high-quality healthcare using limited resources in low- and middle-income countries. Health technology assessment (HTA) is a tool that can be used for systematic priority setting. The objective of this study was to conduct a stakeholder and situational analysis of HTA in Zimbabwe. METHODS: We identified and analyzed stakeholders using the International Decision Support Initiative checklist. The identified stakeholders were invited to an HTA workshop convened at the University of Zimbabwe. We used an existing HTA situational analysis questionnaire to ask for participants' views on the need, demand, and supply of HTA. A follow-up survey was done among representatives of stakeholder organizations that failed to attend the workshop. We reviewed two health policy documents relevant to the HTA. Qualitative data from the survey and document review were analyzed using thematic analysis. RESULTS: Forty-eight organizations were identified as stakeholders for HTA in Zimbabwe. A total of 41 respondents from these stakeholder organizations participated in the survey. Respondents highlighted that the HTA was needed for transparent decision making. The demand for HTA-related evidence was high except for the health economic and ethics dimensions, perhaps reflecting a lack of awareness. Ministry of Health was listed as a major supplier of HTA data. CONCLUSIONS: There is no formal HTA agency in the Zimbabwe healthcare system. Various institutions make decisions on prioritization, procurement, and coverage of health services. The activities undertaken by these organizations provide context for the institutionalization of HTA in Zimbabwe.

Health technology assessment and innovation: here to help or hinder?

Innovative health technologies offer much to patients, clinicians, and health systems. Policy makers can, however, be slow to embrace innovation for many reasons, including a less robust body of evidence, perceived high costs, and a fear that once technologies enter the health system, they will be difficult to remove. Health technology funding decisions are usually made after a rigorous health technology assessment (HTA) process, including a cost analysis. However, by focusing on therapeutic value and cost-savings, the traditional HTA framework often fails to capture innovation in the assessment process. How HTA defines, evaluates, and values innovation is currently inconsistent, and it is generally agreed that by explicitly defining innovation would recognize and reward and, in turn, stimulate, encourage, and incentivize future innovation in the system. To foster innovation in health technology, policy needs to be innovative and utilize other HTA tools to inform decision making including horizon scanning, multicriteria decision analysis, and funding mechanisms such as managed agreements and coverage with evidence development. When properly supported and incentivized, and by shifting the focus from cost to investment, innovation in health technology such as genomics, point-of-care testing, and digital health may deliver better patient outcomes. Industry and agency members of the Health Technology Assessment International Asia Policy Forum (APF) met in Taiwan in November 2023 to discuss the potential of HTA to foster innovation, especially in the Asia region. Discussions and presentations during the 2023 APF were informed by a background paper, which forms the basis of this paper.

Value-based payment for high-cost treatments in Singapore: a qualitative study of stakeholders' perspectives.

OBJECTIVES: The rising costs of drugs have necessitated the exploration of innovative payment methods in healthcare systems. Risk-sharing agreements (RSAs) have been implemented in many countries as a value-based payment mechanism to manage the uncertainty associated with expensive technologies. This study aimed to investigate stakeholder perspectives on value-based payment in the Singaporean context, providing insights for future directions in health technology assessment and financing. METHODS: This descriptive qualitative inquiry involved participant interviews conducted between October 2021 and April 2022. Thematic analysis was conducted in two phases to analyze the interview transcripts. RESULTS: Seventeen respondents participated in the study, and five key themes emerged from the analysis. Stakeholders viewed RSAs as moderately positive, despite limited experience with them. They emphasized the importance of clearly defining objectives and establishing transparent criteria for implementing these schemes. The current data infrastructure was identified as both a barrier and facilitator, as RSAs impose administrative burdens. To successfully implement these payment mechanisms, capacity building, and effective stakeholder engagement that fosters mutual trust and cocreation are crucial. CONCLUSION: This study confirms previously identified barriers and facilitators to successful RSA implementation while contextualizing them within the Singaporean setting. The findings suggest that value-based payment has the potential to address uncertainty and improve access to healthcare technologies, but these barriers must be addressed for the schemes to be effective.

Deliberative process of health technology reassessment by health technology assessment agency in Korea.

In 2019, the National Evidence-based Healthcare Collaborating Agency (NECA) in Korea established a health technology reassessment (HTR) system to manage the life cycle of health technologies and develop operational measures promoting the efficient use of healthcare resources. The purpose of this study is to introduce the detailed implementation process and practical functional methods of the HTR implemented by NECA.The HTR is a structured multidisciplinary method for analyzing health technologies currently used in the healthcare system based on the latest information on parameters, such as clinical safety, effectiveness, and cost-effectiveness of optimizing the use of healthcare resources as well as social and ethical issues. All decision-making stages of the HTR are carefully reviewed and transparently managed. The HTR committee makes significant decisions, and the subcommittee decides the details related to the assessment process.Since the pilot began in 2018, 262 cases have been reassessed, of which, 126 cases (48.1 percent) were health services not covered by the National Health Insurance (NHI). Over the past 5 years, approximately 130 recommendations for the in-use technologies were determined by the HTR committee. In the near future, it will be necessary to officially develop and establish a Korean HTR system and a legal foundation to optimize the NHI system.

Health technology assessment in traditional and complementary medicine: a scoping review of international activity and examples of acupuncture.

BACKGROUND: Traditional therapies are crucial in maintaining and improving human well-being. China's healthcare policymakers are attempting to use health technology assessment (HTA) as a decision-making supportive tool. The value assessment framework for Chinese patent medicine (CPM) has been developed and is being adopted and validated widely by research institutions. Subsequently, the healthcare decision-makers particularly hanker for the value framework of traditional non-pharmacological therapies. METHODS: To construct a practical value framework for traditional non-pharmacological therapies, a scoping review methodology was adopted to identify the evaluation domains and obstacles. A search, screening, and analysis process was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR). Evidence was retrieved from scientific databases and HTA agencies' websites. RESULTS: The search strategy identified 5 guidelines records and 17 acupuncture HTA reports. By synthesizing the valuable reports of CPM and acupuncture evaluation in representative countries, this study found that Mainland China was promoting the comprehensive value assessment of CPM, whereas the United Kingdom, Singapore, Canada, the United States, and Malaysia had carried out the HTA evaluation of acupuncture for various conditions among which chronic pain was the most common. UK and Singapore applied the HTA results to support acupuncture reimbursement decisions. Three domains, including safety, effectiveness, and economy, were commonly adopted. The identified biggest challenge of evaluating traditional non-pharmacological therapies is the scarce high-quality clinical evidence. CONCLUSIONS: This study identified value domains and issues of traditional therapies, and pointed out future research implications, to promote the development value framework of traditional therapies.

Design of a multiple criteria decision analysis framework for prioritizing high-impact health technologies in a regional health service.

OBJECTIVES: This study aims to develop a framework for establishing priorities in the regional health service of Murcia, Spain, to facilitate the creation of a comprehensive multiple criteria decision analysis (MCDA) framework. This framework will aid in decision-making processes related to the assessment, reimbursement, and utilization of high-impact health technologies. METHOD: Based on the results of a review of existing frameworks for MCDA of health technologies, a set of criteria was proposed to be used in the context of evaluating high-impact health technologies. Key stakeholders within regional healthcare services, including clinical leaders and management personnel, participated in a focus group (n = 11) to discuss the proposed criteria and select the final fifteen. To elicit the weights of the criteria, two surveys were administered, one to a small sample of healthcare professionals (n = 35) and another to a larger representative sample of the general population (n = 494). RESULTS: The responses obtained from health professionals in the weighting procedure exhibited greater consistency compared to those provided by the general public. The criteria more highly weighted were "Need for intervention" and "Intervention outcomes." The weights finally assigned to each item in the multicriteria framework were derived as the equal-weighted sum of the mean weights from the two samples. CONCLUSIONS: A multi-attribute function capable of generating a composite measure (multicriteria) to assess the value of high-impact health interventions has been developed. Furthermore, it is recommended to pilot this procedure in a specific decision context to evaluate the efficacy, feasibility, usefulness, and reliability of the proposed tool.

Health technology assessment and healthcare environmental sustainability: Prioritizing effort and maximizing impact.

The growing global focus on and sense of urgency toward improving healthcare environmental sustainability and moving to low-carbon and resilient healthcare systems is increasingly mirrored in discussions of the role of health technology assessment (HTA). This Perspective considers how HTA can most effectively contribute to these goals and where other policy tools may be more effective in driving sustainability, especially given the highly limited pool of resources available to conduct environmental assessments within HTA. It suggests that HTA might most productively focus on assessing those technologies that have intrinsic characteristics which may cause specific environmental harms or vulnerabilities, while the generic environmental impacts of most other products may be better addressed through other policy and regulatory mechanisms.

Development of an multicriteria decision analysis framework for rare disease reimbursement prioritization in Malaysia.

OBJECTIVES: Rare diseases (RD)-related policies have received significant attention due to the pressing medical requirements associated with these medical conditions and the substantial impact and treatments they may have on healthcare budgets. Nevertheless, policymakers frequently encounter difficulties in managing issues concerning resource allocation and prioritization within this population. Realizing the need to address such problems, this study was conducted to develop a framework based on the multicriteria decision analysis to improve RD reimbursement prioritization in Malaysia. METHODS: Primarily, a scoping review was performed to identify the methods and criteria used for the reimbursement of RD treatment, followed by strategic stakeholder engagement and a deliberative process on determining the best approach for the framework, including criteria identification, elicitation of weights, and a pilot assessment using the framework. RESULTS: The findings reflected the priorities and perspectives of the stakeholders, which identified eight key criteria and their associated weights, namely effectiveness (19.6 percent), disease severity (15.6 percent), safety (14.2 percent), access to treatment (12.6 percent), economic consideration (12.2 percent), type of therapeutic treatment (11.5 percent), availability of alternatives (8.3 percent), and population group (6 percent). CONCLUSIONS: In summary, the developed framework was well-accepted by the Rare Disease Committee, which will be applied as part of the committee deliberation for transparent and equitable decision making on fund allocation and reimbursement of orphan and RD treatment in Malaysia.

Assessing medical devices: a qualitative study from the validate perspective.

OBJECTIVES: Our objective was to explore procedures and methods used at health technology assessment (HTA) agencies for assessing medical devices and the underlying views of HTA practitioners about appropriate methodology to identify challenges in adopting new methodologies for assessing devices. We focused on the role of normative commitments of HTA practitioners in the adoption of new methods. METHODS: An online survey, including questions on procedures, scoping, and assessments of medical devices, was sent to members of the International Network of Agencies for Health Technology Assessment. Interviews were conducted with survey respondents and HTA practitioners involved in assessments of transcatheter aortic valve implantation to gain an in-depth understanding of choices made and views about assessing medical devices. Survey and interview questions were inspired by the "values in doing assessments of health technologies" approach towards HTA, which states that HTA addresses value-laden questions and information. RESULTS: The current practice of assessing medical devices at HTA agencies is predominantly based on procedures, methods, and epistemological principles developed for assessments of drugs. Both practical factors (available time, demands of decision-makers, existing legal frameworks, and HTA guidelines), as well as commitments of HTA practitioners to principles of evidence-based medicine, make the adoption of a new methodology difficult. CONCLUSIONS: There is a broad recognition that assessments of medical devices may need changes in HTA methodology. In order to realize this, the HTA community may require both a discussion on the role, responsibility, and goals of HTA, and resulting changes in institutional context to adopt new methodologies.

[Participatory Design of Health Technologies - Challenges and Requirements for Action from the Perspective of Health Services Research]. / Partizipatives Design im Kontext gesundheitsbezogener Technologien ­ Herausforderungen und Handlungserfordernisse aus Perspektive der Versorgungsforschung.

The use of participatory design (PD) provides a framework for involving users in the process of developing healthcare technologies. Within PD, theoretical and methodological decisions need to be made. However, these decisions are often not adequately described or justified. This can lead to limited interpretability of the results. This paper has three objectives: First, to provide an overview of the key theoretical and methodological decisions that must be made in PD from the perspective of health services research; second, to describe the associated challenges and third, to describe action requirements for the future development of PD in health services research.

Varying Willingness to Pay Based on Severity of Illness: Impact on Health Technology Assessment Outcomes of Inpatient and Outpatient Drug Therapies in The Netherlands.

OBJECTIVES: Since 2015, Zorginstituut Nederland (ZIN) has linked disease severity ranges of 0.10 to 0.40, 0.41 to 0.70, and 0.71 to 1.00 with willingness-to-pay (WTP) reference values of €20 000, €50 000, and €80 000 per quality-adjusted life year gained, respectively. We sought to review whether these changes have affected ZIN health technology assessment (HTA) outcomes for specialist and outpatient drugs. METHODS: ZIN recommendations for specialist and outpatient drugs published between January 1, 2012, and December 31, 2020, that included a pharmacoeconomic report were reviewed. Data were extracted on disease severity, proportional shortfall calculation, reported WTP reference value, outcomes related to the cost-effectiveness of the product, budget impact, and ZIN's recommendation including rationale for their advice. RESULTS: A total of 51 HTAs were included. Of the 20 HTAs published before June 2015, a total of 9 received positive recommendations, 7 were conditionally reimbursed, and 4 received negative recommendations. None reported WTP reference values. Of the 31 evaluations published after June 2015, a total of 4 products received positive recommendations, 1 was conditionally approved, and 26 received negative recommendations initially. Most products (65%) reported disease severity to be >0.70. CONCLUSIONS: Since 2015, most products have fallen within the highest category of disease severity. Although pre-2015 outcomes were varied, post-2015 products overwhelmingly received negative recommendations, and the proportion of products for which price negotiations were recommended has increased. These differences in outcomes may result from the introduction of an explicit WTP reference value, whether or not in combination with the severity-adjusted ranges, but may also reflect other national policy changes in 2015.

Systematic Review of Health Economic Evaluations Focused on Artificial Intelligence in Healthcare: The Tortoise and the Cheetah.

OBJECTIVES: This study aimed to systematically review recent health economic evaluations (HEEs) of artificial intelligence (AI) applications in healthcare. The aim was to discuss pertinent methods, reporting quality and challenges for future implementation of AI in healthcare, and additionally advise future HEEs. METHODS: A systematic literature review was conducted in 2 databases (PubMed and Scopus) for articles published in the last 5 years. Two reviewers performed independent screening, full-text inclusion, data extraction, and appraisal. The Consolidated Health Economic Evaluation Reporting Standards and Philips checklist were used for the quality assessment of included studies. RESULTS: A total of 884 unique studies were identified; 20 were included for full-text review, covering a wide range of medical specialties and care pathway phases. The most commonly evaluated type of AI was automated medical image analysis models (n = 9, 45%). The prevailing health economic analysis was cost minimization (n = 8, 40%) with the costs saved per case as preferred outcome measure. A total of 9 studies (45%) reported model-based HEEs, 4 of which applied a time horizon >1 year. The evidence supporting the chosen analytical methods, assessment of uncertainty, and model structures was underreported. The reporting quality of the articles was moderate as on average studies reported on 66% of Consolidated Health Economic Evaluation Reporting Standards items. CONCLUSIONS: HEEs of AI in healthcare are limited and often focus on costs rather than health impact. Surprisingly, model-based long-term evaluations are just as uncommon as model-based short-term evaluations. Consequently, insight into the actual benefits offered by AI is lagging behind current technological developments.

The representation of public values in health technology assessment to inform funding decisions: the case of Australia's national funding bodies.

Over the past few years, there has been an increasing recognition of the value of public involvement in health technology assessment (HTA) to ensure the legitimacy and fairness of public funding decisions [Street J, Stafinski T, Lopes E, Menon D. Defining the role of the public in Health Technology Assessment (HTA) and HTA-informed decision-making processes. Int J Technol Assess Health Care. 2020;36:87-95]. However, important challenges remain, in particular, how to reorient HTA to reflect public priorities. In a recent international survey of thirty HTA agencies conducted by the International Network of Agencies for HTA (INAHTA), public engagement in HTA was listed as one of the "Top 10" challenges for HTA agencies [O'Rourke B, Werko SS, Merlin T, Huang LY, Schuller T. The "Top 10" challenges for health technology assessment: INAHTA viewpoint. Int J Technol Assess. 2020;36:1-4].Historically, Australia has been at the forefront of the application of HTA for assessing the effectiveness and cost-effectiveness of new health technologies to inform public funding decisions. However, current HTA processes in Australia lack meaningful public inputs. Using Australia as an example, we describe this important limitation and discuss the potential impact of this gap on the health system and future directions.

Health technology assessment applied to emergency preparedness: a new perspective.

Emergency preparedness is a continuous quality improvement process through which roles and responsibilities are defined to effectively anticipate, respond to, and recover from the impact of emergencies. This process results in documented plans that provide a backbone structure for developing the core capacities to address health threats. Nevertheless, several barriers can impair an effective preparedness planning, as it needs a 360° perspective to address each component according to the best evidence and practice. Preparedness planning shares common principles with health technology assessment (HTA) as both encompass a multidisciplinary and multistakeholder approach, follow an iterative cycle, adopt a 360° perspective on the impact of intervention measures, and conclude with decision-making support. Our "Perspective" illustrates how each HTA domain can address different component(s) of a preparedness plan that can indeed be seen as a container of multiple HTAs, which can then be used to populate the entire plan itself. This approach can allow one to overcome preparedness barriers, providing an independent, systematic, and robust tool to address the components and ensuring a comprehensive evaluation of their value in the mitigation of the impact of emergencies.

ICER Value Framework 2020 Update: Recommendations on the Aggregation of Benefits and Contextual Considerations.

The Institute for Clinical and Economic Review (ICER) in the United States recently published a 2020 update to its value assessment framework. We are commenting on the method by which the benefits of health interventions are integrated, relating to contextual considerations and other factors relevant to an intervention's value. We start by discussing the theoretical foundations of decision analysis and its extension to multiple criteria decision analysis (MCDA). Then we provide a detailed, evidence-based response to some of the claims made by ICER with regard to the use of MCDA methods and stakeholder engagement. Finally, we provide a number of recommendations on the use of quantitative decision analysis and decision conferencing that could be of relevance to the ICER methodology. Overall, we agree that some of the proposed changes by ICER are moving in the right direction toward improving transparency in the value assessment process, but these changes are probably inadequate. We advocate that more serious attention should be paid to the use of quantitative decision analysis together with decision conferencing for the construction of value preferences via group processes for the integration of an intervention's various benefit components.

Leveraging DICE (Discretely-Integrated Condition Event) Simulation to Simplify the Design and Implementation of Hybrid Models.

OBJECTIVES: Using an example of an existing model constructed by the National Institute for Health and Care Excellence (NICE) to inform a real health technology assessment, this study seeks to demonstrate how a discretely integrated condition event (DICE) simulation can improve the implementation of Markov models. METHODS: Using the technical report and spreadsheet, the original model was translated to a standard DICE simulation without making any changes to the design. All original analyses were repeated and the results were compared. Aspects that could have improved the original design were then considered. RESULTS: The original model consisted of 32 copies (8 risk strata × 4 treatments) of the Markov structure, containing more than 6000 Microsoft Excel® formulas (18 MB files). Three aspects (nonadherence, scheduled treatment stop, and end of fracture risk) were handled by incorporating weighted averages into the cycle-specific calculations. The DICE implementation used 3 conditions to represent the states and a single transition event to apply the probabilities; 3 additional events processed the special aspects, and profiles handled the 8 strata (0.12 MB file). One replication took 16 seconds. The original results were reproduced but extensive additional sensitivity analyses, including structural analyses, were enabled. CONCLUSION: Implementing a real Markov model using DICE simulation both preserves the advantages of the approach and expands the available tools, improving transparency and ease of use and review.

Are We Making a Difference? A Qualitative Study of Patient Engagement at the pan-Canadian Oncology Drug Review: Perspectives of Patient Groups.

OBJECTIVES: Despite wide support for patient involvement in health technology assessments (HTA), determining meaningful engagement is complex. This article explores experiences and perceptions among patient groups participating in the Canadian Agency for Drugs and Technologies in Health (CADTH)'s pan-Canadian Oncology Drug Review (pCODR) process. METHODS: We created a qualitative interview study comprising 22 semi-structured telephone interviews with individuals representing 21 different patient groups registered with the pCODR process. The analysis used a qualitative descriptive approach employing techniques from grounded theory. RESULTS: Patient groups view the ability to make submissions to the pCODR process as a meaningful activity closely aligned with organizational priorities. Concurrently, they face substantial resource challenges to prepare submissions, including high opportunity costs and difficulty accessing needed literature and finding relevant patients. Although patient groups felt that CADTH is committed to transparency, they expressed considerable uncertainty around the direct impact of their submissions and desired additional avenues for engagement. CONCLUSIONS: This study suggests a strong commitment by patient groups to participate in the pCODR process despite uncertainty about how their submissions are used to inform HTA recommendations. Identifying opportunities to provide both financial and nonfinancial resources to patient groups is crucial to encouraging and supporting their meaningful participation in HTA processes.

Do Social Values and Institutional Context Shape the Use of Economic Evaluation in Reimbursement Decisions? An Empirical Analysis.

OBJECTIVES: To investigate whether the use of economic evaluation (EE) in healthcare decision making is influenced by the social values and institutional context in a given country. METHODS: We developed and tested a conceptual framework for the 36 Organisation for Economic Co-operation and Development (OECD) countries. The countries were divided into two groups based on the extent of their use of EE in drug reimbursement. The key social values were efficiency, equity, and personal responsibility, measured in an international survey. Countries were classified based on their institutional context in terms of their general welfare paradigm/type of healthcare system and the administrative tradition to which they belong. We performed correlation tests and ran path analysis regression models to test our hypotheses. RESULTS: EE high users included significantly more Beveridge-type systems (50% vs 31%) and fewer Bismarck-type (15% vs 56%). Napoleonic tradition countries seemed to reject personal responsibility in health (r = -0.511, P = .009), whereas Germanic tradition countries embraced it (r = 0.572, P = .003); Anglo-American tradition countries exhibited a significant association with efficiency (r = 0.444, P = .026), whereas Scandinavian tradition countries appeared to reject it as a criterion for rationing in healthcare (r = -0.454, P = .023). No significant direct association was found between social values and use of EE. CONCLUSION: Our exploratory analysis suggests that institutional context and, indirectly, social values may play a role in shaping the use of EE in healthcare decision making. Because of the differences among countries in terms of institutional context, which may in part be influenced by social values, it is unlikely that there will ever be a single, harmonious approach to the use of EE.