Multistakeholder Perceptions of Additional Value Elements for United States Value Assessment of Health Interventions.

OBJECTIVES: Limitations in conventional cost-effectiveness methods have led to calls for incorporation of additional value elements in assessments of health technologies. However, gaps remain in how additional value elements may inform decision making. This study aimed to prioritize additional value elements from the perspective of healthy individuals without a specific condition or indicated for a specific treatment in the United States among a multistakeholder panel and compare the importance of perspective-specific value elements. METHODS: Additional value elements were prioritized in 2 phases: (1) we identified and categorized additional value elements in a targeted literature review, and (2) we convened a multistakeholder group-based preference elicitation study (N = 28) to evaluate the description of each value element and rank and generate normalized weights of each value element for its significance in value assessment. The importance of additional value elements was also weighted relative to patient-centric value elements. RESULTS: The rank and weight of contextual value elements among 28 stakeholders were "severity of the disease" (26.2%), "disadvantaged and vulnerable target populations highly represented" (21.8%), "broader economic impact" (17.3%), "risk protection" (13.8%), "rarity of the disease" (11.3%), and "novel mechanism of action" (9.7%). Relative weight of the additional value elements versus patient-centric value elements was 52% and 48%, respectively. CONCLUSIONS: Study findings may inform priority setting for value frameworks and emerging US government assessments. The group-based elicitation method is repeatable and useful for structured deliberative processes in value assessment and may help improve the consistency and predictability of what is important to stakeholders.

Population-level norm values by EQ-5D-3L in Hungary - a comparison of survey results from 2022 with those from 2000.

PURPOSE: Although population norms of the EQ-5D-3L instrument had been available in Hungary since 2000, their evaluation was based on a United Kingdom (UK) value set. Our objective was to estimate the population norms for EQ-5D-3L by using the new Hungarian value set available since 2020, to extend the scope to adolescents, and to compare with norms from 2000. METHODS: A cross sectional EQ-5D-3L survey representative of the Hungarian population was conducted in 2022. The EQ-5D-3L dimensional responses were analyzed by age and sex and compared with the survey from 2000, by estimating population frequencies with their 95% confidence intervals; index values were evaluated by both value sets. RESULTS: Altogether, 11,910 respondents, aged 12 or more (578 between 12 and 17), completed the EQ-5D-3L. There was a notable improvement in reporting problems for both sexes (age 35-64) regarding the pain/discomfort and anxiety/depression compared to 2000. Below the age 44, both sexes had an EQ-5D-3L index plateau of 0.98, while above the age 55, men tended to have numerically higher index values compared to women, with the difference increasing with older age. Improvement in dimensional responses were also translated to numerically higher index values for both sexes between ages 18 and 74 compared to 2000. Multivariate regression analysis showed that higher educational attainment, lower age, larger household size, and active occupational status were associated with higher index values. CONCLUSION: Over the past 22 years, there was a large improvement in HRQoL of the middle-aged to elderly men and women in Hungary.

Health states can be described by a combination of statements of health-related quality of life measures. 'Value sets' are numerical expressions of how preferred a health state is. The provision of population-level health-related quality of life estimates (also known as 'population norms') are expected to improve the precision of patient-level clinical decision making, and health economic and public health studies. However, preference towards these health states is influenced by culture, resulting in differences across populations. While responses for the EQ-5D-3L instrument for adults have been available in Hungary since 2000, the evaluation of these responses was based on a 'value set' from the United Kingdom, rather than a Hungarian one.This research, utilizing the newly introduced Hungarian 'value set' (available since 2020) for the EQ-5D-3L instrument, offers a larger sample size, inclusion of adolescents and potentially improved sampling compared to the prior research conducted in 2000. Comparison of the two surveys allows us to estimate changes in both dimensional responses and overall health-related quality of life of the population over a 20-year time horizon, while we also compare the impact of different 'value sets' on health-related quality of life assessment. A large EQ-5D-3L improvement was observed in middle-aged-to-elderly people.

Framework for developing cost-effectiveness analysis threshold: the case of Egypt.

BACKGROUND: Cost-effectiveness analyses rarely offer useful insights to policy decisions unless their results are compared against a benchmark threshold. The cost-effectiveness threshold (CET) represents the maximum acceptable monetary value for achieving a unit of health gain. This study aimed to identify CET values on a global scale, provide an overview of using multiple CETs, and propose a country-specific CET framework specifically tailored for Egypt. The proposed framework aims to consider the globally identified CETs, analyze global trends, and consider the local structure of Egypt's healthcare system. METHODS: We conducted a literature review to identify CET values, with a particular focus on understanding the basis of differentiation when multiple thresholds are present. CETs of different countries were reviewed from secondary sources. Additionally, we assembled an expert panel to develop a national CET framework in Egypt and propose an initial design. This was followed by a multistakeholder workshop, bringing together representatives of different governmental bodies to vote on the threshold value and finalize the recommended framework. RESULTS: The average CET, expressed as a percentage of the gross domestic product (GDP) per capita across all countries, was 135%, with a range of 21 to 300%. Interestingly, while the absolute value of CET increased with a country's income level, the average CET/GDP per capita showed an inverse relationship. Some countries applied multiple thresholds based on disease severity or rarity. In the case of Egypt, the consensus workshop recommended a threshold ranging from one to three times the GDP per capita, taking into account the incremental relative quality-adjusted life years (QALY) gain. For orphan medicines, a CET multiplier between 1.5 and 3.0, based on the disease rarity, was recommended. A two-times multiplier was proposed for the private reimbursement threshold compared to the public threshold. CONCLUSION: The CET values in most countries appear to be closely related to the GDP per capita. Higher-income countries tend to use a lower threshold as a percentage of their GDP per capita, contrasted with lower-income countries. In Egypt, experts opted for a multiple CET framework to assess the value of health technologies in terms of reimbursement and pricing.

Patient and Caregiver Experience Decision Factors in Treatment Decision Making: Results of a Systematic Literature Review of Multiple Myeloma Decision Aids.

OBJECTIVES: Decision-aids (DAs) may facilitate shared decision-making for patients and caregivers, by providing evidence-based information to assist healthcare professionals, patients, and caregivers in making choices about aspects of care, and/or highlighting decision factors to discuss with the potential of altering the treatment decision. These decision factors may not be well integrated in DAs. METHODS: A systematic literature review was conducted in the field of multiple myeloma (MM) on peer-reviewed publications, extended with a gray literature search. Data on whether and how patient and caregiver experience elements, other than survival and physical quality of life, were mentioned as decision factors in the identified MM DAs were extracted and analyzed qualitatively. RESULTS: Seventy MM DAs were found and analyzed; 51% of DAs mentioned any patient non-routinely assessed experience decision factors and only 17% mentioned any caregiver-related information. One hundred and forty potential decision factors were extracted, deduplicated and categorized into the following categories: 1) financial, 2) mode of administration / transportation issues, 3) personal beliefs and values, 4) emotional and social quality of life, 5) other medical information, 6) availability of social support, 7) caregiver burden. None of the DAs presented a comprehensive framework on all seven categories of decision factors being consider when mapping patient and caregiver experience value elements in MM. CONCLUSIONS: Based on available DAs, we recommend a set of patient and caregiver experience decision factors that have the potential to affect treatment choices of patients with MM, which should be included in DAs, including MM clinical guidelines.

Incremental cost of premature birth - a public health care payer perspective from Hungary.

BACKGROUND: Preterm birth remains a significant burden to families, health systems and societies. The aim was to quantify the incremental prematurity-related public health expenditure in Hungary and to estimate the potential impact of a decrease in the prevalence of prematurity on the public payer's spending. METHODS: Over a 6-year time horizon, public financing data of inpatient, outpatient and pharmaceutical care for children born at ≥ 25 weeks of gestation in 2009/2010 were retrieved from the Hungarian National Health Insurance Fund database. In descriptive analysis, the public payer's spending was given as cost/capita. The impact of a decrease in prematurity prevalence was specified as the total budget impact. An exchange rate of 294 Hungarian forint/Euro was applied. RESULTS: A total of 93,124 children (including 8.6% who were premature babies) were included in the analysis. A strong negative relationship was shown between gestational age and per capita cost. The 6-year cost of care for the cohort born at 26 weeks of gestation (28,470 Euro per capita) was 24 times higher than that for the cohort born at 40 weeks. First-year inpatient spending accounted for the largest proportion of total health care spending across all gestational ages. All investigated prematurity complications (retinopathy of prematurity, necrotizing enterocolitis, bronchopulmonary dysplasia, intraventricular cerebral bleeding and leukomalacia) resulted in additional significant incremental spending. If 70% of pregnancies ending with preterm birth could be prolonged by 1 week, the savings would be almost 7.0 million Euros in the first 6 years of life. CONCLUSION: This comprehensive analysis of prematurity-related health care spending confirmed that premature infants have much higher costs for care than those born at term in Hungary. These quantitative outcomes can provide essential inputs for the cost-effectiveness analysis of medical technologies and public health interventions that can decrease the prevalence of premature birth. TRIAL REGISTRATION: Not applicable.

Health technology assessment of tests for SARS-CoV-2 and treatments for COVID-19: A proposed approach and best-practice recommendations.

OBJECTIVES: To develop best-practice guidance for health technology assessment (HTA) agencies when appraising diagnostic tests for SARS-CoV-2 and treatments for COVID-19. METHODS: We used a policy sandbox approach to develop best-practice guidance for HTA agencies to approach known challenges associated with assessing tests and treatments for COVID-19. The guidance was developed by a multi-stakeholder workshop of twenty-one participants representing HTA agencies, clinical and patient experts, academia, industry, and a payer, from across Europe and North America. The workshop was supported by extensive background work to identify the key challenges, including: targeted reviews of existing COVID-related methods guidance for assessing interventions and clinical guidelines, engagement with clinical experts, a survey and workshop of HTA agencies, a systematic review of published economic evaluations, and a workshop of health economic modelers. RESULTS: We suggest HTA agencies should consider using other types of evidence (e.g., real world) where high-quality randomized controlled trials may be lacking and healthcare systems would value timely HTA outputs. A "living" HTA approach may be useful, given the context of an evolving disease, scientific understanding and evidence base, allowing for decisions to be efficiently revisited in response to new information; particularly, if supported by a common "disease model" for COVID-19. Innovative ways of engaging with the public and clinicians, and early engagement with regulators and payers, are recommended. CONCLUSIONS: HTA agencies should consider the elements of this guidance that are most suited to their existing processes to enable them to assess the effectiveness and value of interventions for COVID-19.

Coverage with evidence development for medical devices in Europe: Can practice meet theory?

Health economists have written extensively on the design and implementation of coverage with evidence development (CED) schemes and have proposed theoretical frameworks based on cost-effectiveness modeling and value of information analysis. CED may aid decision-makers when there is uncertainty about the (cost-)effectiveness of a new health technology at the time of reimbursement. Medical devices are potential candidates for CED schemes, as regulatory regimes do not usually require the same level of efficacy and safety data normally needed for pharmaceuticals. The purpose of this research is to assess whether the actual practice of CED for medical devices in Europe meets the theoretical principles proposed by health economists and whether theory and practice can be more closely aligned. Based on decision-makers' perceptions of the challenges associated with CED schemes, plus examples from the schemes themselves, we discuss a series of proposals for assessing the desirability of schemes, their design, implementation, and evaluation. These proposals, while reflecting the practical challenges with developing CED programs, embody many of the principles suggested by economists and should support decision-makers in dealing with uncertainty about the real-world performance of devices.

Implementation of coverage with evidence development schemes for medical devices: A decision tool for late technology adopter countries.

Experiences with coverage with evidence development (CED) schemes are fairly limited in Central and Eastern European (CEE) countries, which are usually late adopters of new health technologies. Our aim was to put forward recommendations on how CEE health technology assessment bodies and payer organizations can apply CED to reduce decision uncertainty on reimbursement of medical devices, with a particular focus on transferring the structure and data from CED schemes in early technology adopter countries in Western Europe. Structured interviews on the practices and feasibility of transferring CED schemes were conducted and subsequently, a draft tool for the systematic classification of decision alternatives and recommendations was developed. The decision tool was reviewed in a focus group discussion and validated within a wider group of CEE experts in a virtual workshop. Transferability assessment is needed in case of (1) joint implementation of a CED scheme; (2) transferring the structure of an existing CED scheme to a CEE country; (3) reimbursement decisions that are linked to outcomes of an ongoing CED scheme in another country and (4) real-world evidence transferred from completed CED schemes. Efficient use of available resources may be improved by adequately transferring evidence and policy tools from early technology adopter countries.

A multicriteria decision analysis (MCDA) tool to purchase implantable medical devices in Egypt.

BACKGROUND: With the availability of several similar medical devices performing the same function, choosing one for reimbursement is not easy, especially if purchased for a large number of patients. The objective of this project was to create a multicriteria decision analysis (MCDA) tool, that captures and compares all implantable medical devices' attributes, to provide an objective method for choosing among the available options in Egypt. METHOD: We conducted a systematic review and expert interviews, to identify the relevant criteria for inclusion in the tool. Subsequently, a workshop was conducted, that involved experts in procuring and tendering medical devices. Experts chose the criteria, ranked them, assigned weights and scoring functions for each criterion, and then created the draft tool. A pilot phase followed; then, another workshop was conducted to fine-tune the tool. We readjusted the tool based on experts' experience with the draft tool. RESULTS: The final tool included eight criteria, arranged according to their weightage: technical characteristics (29.4%), country of origin (19.5%), use in reference countries (14.9%), supply reliability (11.7%), previous use in tenders (9.0%), instant replacement within product variety (6.9%), pharmacovigilance (4.6%), and refund or replacement (4.0%). Each medical device was assessed on these eight criteria to achieve a final score, that was compared to the alternative devices' scores. Price is not included in the MCDA tool, but it will be added in the financial evaluation phase. CONCLUSION: Decisionmakers could use the MCDA tool, to make evidence-based and objective decisions for purchasing implantable devices, in the Egyptian public sector. Post price evaluation, the product with the best value will be chosen for reimbursement. HIGHLIGHTS: We created an MCDA tool to help decision makers choose between alternative implantable medical devices in Egypt. The MCDA tool includes eight criteria, where price is evaluated as a separate step. "Technical characteristics" and "country of origin" criteria carried the highest weights, thus representing approximately 50% of the decision.

Healthcare financing in Egypt: a systematic literature review.

BACKGROUND: The Egyptian healthcare system has multiple stakeholders, including a wide range of public and private healthcare providers and several financing agents. This study sheds light on the healthcare system's financing mechanisms and the flow of funds in Egypt. It also explores the expected challenges facing the system with the upcoming changes. METHODS: We conducted a systematic review of relevant papers through the PubMed and Scopus search engines, in addition to searching gray literature through the ISPOR presentations database and the Google search engine. Articles related to Egypt's healthcare system financing from 2009 to 2019 were chosen for full-text review. Data were aggregated to estimate budgets and financing routes. RESULTS: We analyzed the data of 56 out of 454 identified records. Governmental health expenditure represented approximately one-third of the total health expenditure (THE). Total health expenditure as a percent of gross domestic product (GDP) was almost stagnant in the last 12 years, with a median of 5.5%. The primary healthcare financing source is out-of-pocket (OOP) expenditure, representing more than 60% of THE, followed by government spending through the Ministry of Finance, around 37% of THE. The pharmaceutical expenditure as a percent of THE ranged from 26.0 to 37.0%. CONCLUSIONS: Although THE as an absolute number is increasing, total health expenditure as a percentage of GDP is declining. The Egyptian healthcare market is based mainly on OOP expenditures and the next period anticipates a shift toward more public spending after Universal Health Insurance gets implemented.

Development of a core evaluation framework of value-added medicines: report 2 on pharmaceutical policy perspectives.

BACKGROUND: A core evaluation framework that captures the health care and societal benefits of value added medicines (VAMs, also often called repurposed medicines) was proposed in Report 1, aiming to reduce the heterogeneity in value assessment processes across countries and to create incentives for manufacturers to invest into incremental innovation. However, this can be impactful only if the framework can be adapted to heterogeneous health care financing systems in different jurisdictions, and the cost of evidence generation necessitated by the framework takes into account the anticipated benefits for the health care system and rewards for the developers. AREAS COVERED: The framework could potentially improve the pricing and reimbursement decisions of VAMs by adapting it to different country specific decision-contexts such as deliberative processes, augmented cost-effectiveness frameworks or formal multi-criteria decision analysis (MCDA); alternatively, some of its domains may be added to current general evaluation frameworks of medicines. The proposed evaluation framework may provide a starting point for practices based on which VAMs can be exempted from generic pricing mechanisms or can be integrated into the reimbursement and procurement system, allowing for price differentiation according to their added value. Besides evidence from RCTs, pricing and reimbursement decision processes of VAMs should allow for ex-ante non-RCT evidence for certain domains. Alternatively, relying on ex-post evidence agreements-such as outcome guarantee or coverage with evidence development-can also reduce decision uncertainty. CONCLUSIONS: The core evaluation framework for VAMs could trigger changes in the existing pricing, reimbursement and procurement practices by improving the appraisal of the added value created by incremental innovation.

Development of a core evaluation framework of value-added medicines: report 1 on methodology and findings.

BACKGROUND: Medicines that are based on known molecules and are further developed to address healthcare needs and deliver relevant improvement for patients, healthcare professionals and/or payers are called value-added medicines (VAMs). The evaluation process of VAMs is heterogeneous across countries, and it has been primarily designed for originator pharmaceuticals with confirmatory evidence collected alongside pivotal clinical trials. There is a mismatch between evidence requirements by public decision-makers and evidence generated by manufacturers of VAMs. Our objective was to develop a core evaluation framework for VAMs. METHODS: Potential benefits offered by VAMs were collected through a systematic literature review and allocated to separate domains in an iterative process. The draft list of domains and their applicability were validated during two consecutive virtual workshops by health policy experts representing countries with different economic statuses, geographical and decision-making contexts. RESULTS: Based on 158 extracted studies, the final consensus on the evaluation framework resulted in 11 value domains in 5 main clusters, including unmet medical needs, health gain (measured by health care professionals), patient-reported outcomes, burden on households, and burden on the health care system. CONCLUSIONS: The proposed framework could reduce the heterogeneity in value assessment processes across countries and create incentives for manufacturers to invest in incremental innovation. However, some domains may not be equally relevant or accepted in all countries, therefore the core framework needs thorough adaptation in specific jurisdictions.

Early palliative care associated with lower costs for adults with advanced cancer: evidence from Hungary.

OBJECTIVE: Palliative Care Consult Service (PCCS) programme was established in Hungary to provide palliative care to hospitalised patients with complex needs and to coordinate integrated care across providers. The aim of this study was to measure the association of PCCS with healthcare costs from payer's perspective. METHODS: Study population consisted of patients with metastatic cancer, who were admitted to the Clinical Centre of the University of Pécs between 2014 and 2016. Patients who did not die within 180 days from enrolment were excluded. Patients receiving services from PCCS team (intervention patients) were compared to patients receiving usual care (controls). The two populations were matched using propensity scores. Data were obtained from electronic medical records linked to claims data. RESULTS: For patients who were involved in PCCS at least 60 days before their death, the costs of care outside the acute hospital were higher. However, this was offset by savings in hospital costs so that the total healthcare cost was significantly reduced (p = 0.034). The proportion of patients who died in the hospital was lower in the PCCS group compared to the usual care group (66% vs. 85%, p = 0.022). CONCLUSION: Timely initiation of palliative care for hospitalised patients is associated with cost savings for the healthcare system.

Implementation of palliative care consult Service in Hungary - integration barriers and facilitators.

BACKGROUND: The Palliative Care Consult Service (PCCS) programme was among the first initiations in Hungary to provide palliative care for patients admitted to hospital. The PCCS team provides palliative care for mainly cancer patients and their family members and manages the patient pathway after being discharged from the hospital. The service started in 2014 with 300-400 patient visits per year. The aim of this study is to give a comprehensive overview of the PCCS programme guided by a conceptual framework designed by SELFIE ("Sustainable intEgrated chronic care modeLs for multi-morbidity: delivery, FInancing, and performancE"), a Horizon2020 funded EU project and to identify the facilitators and barriers to its wider implementation. METHODS: PCCS has been selected by the SELFIE consortium for in-depth evaluation as one of the Hungarian integrated care models for persons with multi-morbidity. The qualitative analysis of the PCCS programme was based on available documents of the care provider and interviews with different stakeholders related to the programme. RESULTS: The integrated, multidisciplinary and patient-centred approach was well-received among the patients, family members and clinical departments, as verified by the increasing number of requests for consultations. As a result of the patient pathway management across providers (e.g. from inpatient care to homecare) a higher level of coordination could be achieved in the continuity of care for seriously-ill patients. The regulatory framework has only partially been established, policies to integrate care across organizations and sectors and adequate financial mechanism to support the enhancement and sustainability of the PCCS are still missing. CONCLUSIONS: The service integration of palliative care could be implemented successfully in an academic hospital in Hungary. However, the continuation and enhancement of the programme will require further evidence on the performance of the integrated model of palliative care and a more systematic approach particularly regarding the evaluation, financing and implementation process.

Development of transferability guidance for integrated care models with special focus on Central and Eastern European countries.

AIM: To develop pragmatic recommendations for Central and Eastern European (CEE) policymakers about transferability assessment of integrated care models established in higher income European Union (EU) countries. METHODS: Draft recommendations were developed based on Horizon 2020-funded SELFIE project deliverables related to 17 promising integrated care models for multimorbid patients throughout Europe, as well as on an online survey among CEE stakeholders on the relevance of implementation barriers. Draft recommendations were discussed at the SELFIE transferability workshop and finalized together with 22 experts from 12 CEE countries. RESULTS: Thirteen transferability recommendations are provided in three areas. Feasibility of local implementation covers the identification and prioritization of implementation barriers and proposals for potential solutions. Performance measurement of potentially transferable models focuses on the selection of models with proven benefits and assurance of performance monitoring. Transferability of financing methods for integrated care explores the relevance of financing methodologies and planning of adequate initial and long-term financing. CONCLUSIONS: Implementation of international integrated care models cannot be recommended without evidence on its local feasibility or scientifically sound and locally relevant performance assessment in the country of origin. However, if the original financing method is not transferable to the target region, development of a locally relevant alternative financing method can be considered.

Planning, implementation and operation of a personalized patient management system for subjects with first suspect of cancer (OnkoNetwork): system description based on a qualitative study.

BACKGROUND: OnkoNetwork is a recently established integrated care model with a personalized pathway system to manage patients with first suspect of a solid tumour in secondary care, that evolved as a regional initiative in Hungary. The primary aim of OnkoNetwork is the improvement of clinical outcomes via timely access to quality assured and defragmented healthcare services. The Horizon 2020 funded SELFIE project has selected OnkoNetwork for in-depth qualitative and quantitative evaluation. The aim of this study was to provide a qualitative evaluation of OnkoNetwork along the six components of the SELFIE conceptual framework: 1) service delivery, 2) leadership and governance, 3) workforce, 4) financing, 5) technologies and medical products, and 6) information and research. METHODS: Analysis of published and grey programme documentation, followed by 20 semi-structured interviews with representatives of programme initiators, general and financial managers, involved physicians and non-physician professionals, patients and their informal caregivers. Transcripts of all interviews were analysed by Mayring's content analysis method by two independent researchers. RESULTS: This study yielded the first comprehensive description of the programme. OnkoNetwork is a blue dahila in Central and Eastern Europe, providing timely and quality-assured healthcare services for the target patients by personalized patient path monitoring and management in a financially sustainable manner without macro-level financing of its operation. Innovative professional roles were implemented for non-physicians and physicians, and a supporting information technology application was developed. CONCLUSIONS: This paper provides a systematic description of OnkoNetwork on the six components of the SELFIE conceptual framework for integrated care in multimorbidity to understand how and why OnkoNetwork was implemented and cares (better) for its patients. Because integrated care models are designed and adjusted to their specific local needs and context, those few successful and sustainable models that were established in Central and Eastern European countries represent important benchmarks for other initiatives in this region. Experience with OnkoNetwork during its planning, implementation and operation including the description of key success factors and barriers as perceived by various stakeholder groups, may support the development of further integrated care models especially in countries with similar economic status and healthcare settings.

Health Technology Assessment Implementation in Ukraine: Current Status and Future Perspectives.

OBJECTIVES: The need for improving healthcare decision making by implementing health technology assessment (HTA) has been a top priority in Ukraine since 2016. This study sought to provide a tailor-made HTA implementation roadmap, drawing on insights from national stakeholders. METHODS: We conducted a survey using a questionnaire already applied in previous HTA research. We assessed the status of HTA when reforms were initiated in 2016 and examined perspectives on possible future developments among policy makers and representatives of pharmaceutical companies and patient organizations. RESULTS: Thirty-two respondents answered the survey. Forty-eight percent of respondents were not aware of HTA training in Ukraine, but 91 percent preferred having either a graduate or postgraduate training. Experts stated that funding for HTA research and for critical appraisal of HTA submissions was limited, but in the future, they would increase funding mainly from public sources. A public HTA agency with academic support was the most preferred organizational structure. Eighty-eight percent of respondents opted for full transparency, making the HTA agency's recommendations and the related appraisal reports publicly available. A great majority of participants preferred mandating the use of local data in certain categories and indicated the importance of evaluating the transferability of international evidence. Healthcare priority and cost-effectiveness were the most important criteria for decisions, applied with a soft explicit threshold. CONCLUSIONS: Ukraine is in the early phase of implementing HTA and our study provides a clear vision of national stakeholders about the future directions. In addition, learning from the experiences of other countries may help the implementation process.

Challenges in Research and Health Technology Assessment of Rare Disease Technologies: Report of the ISPOR Rare Disease Special Interest Group.

BACKGROUND: Successful development of new treatments for rare diseases (RDs) and their sustainable patient access require overcoming a series of challenges related to research and health technology assessment (HTA). These impediments, which may be unique to RDs or also apply to common diseases but are particularly pertinent in RDs, are diverse and interrelated. OBJECTIVE: To develop for the first time a catalog of primary impediments to RD research and HTA, and to describe the cause and effect of individual challenges. METHODS: Challenges were identified by an international 22-person expert working group and qualitative outreach to colleagues with relevant expertise. A broad range of stakeholder perspectives is represented. Draft results were presented at annual European and North American International Society for Pharmacoeconomics and Outcomes Research (ISPOR) congresses, and written comments were received by the 385-strong ISPOR Rare Disease Review Group from two rounds of review. Findings were refined and confirmed via targeted literature search. RESULTS: Research-related challenges linked to the low prevalence of RDs were categorized into those pertaining to disease recognition and diagnosis, evaluation of treatment effect, and patient recruitment for clinical research. HTA-related challenges were classified into issues relating to the lack of a tailored HTA method for RD treatments and uncertainty for HTA agencies and health care payers. CONCLUSIONS: Identifying and highlighting diverse, but interrelated, key challenges in RD research and HTA is an essential first step toward developing implementable and sustainable solutions. A collaborative multistakeholder effort is required to enable faster and less costly development of safe, efficacious, and appropriate new RD therapies that offer value for money.

Understanding perceived availability and importance of tobacco control interventions to inform European adoption of a UK economic model: a cross-sectional study.

BACKGROUND: The evidence on the extent to which stakeholders in different European countries agree with availability and importance of tobacco-control interventions is limited. This study assessed and compared stakeholders' views from five European countries and compared the perceived ranking of interventions with evidence-based ranking using cost-effectiveness data. METHODS: An interview survey (face-to-face, by phone or Skype) was conducted between April and July 2014 with five categories of stakeholders - decision makers, service purchasers, service providers, evidence generators and health promotion advocates - from Germany, Hungary, the Netherlands, Spain, and the United Kingdom. A list of potential stakeholders drawn from the research team's contacts and snowballing served as the sampling frame. An email invitation was sent to all stakeholders in this list and recruitment was based on positive replies. Respondents were asked to rate availability and importance of 30 tobacco control interventions. Kappa coefficients assessed agreement of stakeholders' views. A mean importance score for each intervention was used to rank the interventions. This ranking was compared with the ranking based on cost-effectiveness data from a published review. RESULTS: Ninety-three stakeholders (55.7% response rate) completed the survey: 18.3% were from Germany, 17.2% from Hungary, 30.1% from the Netherlands, 19.4% from Spain, and 15.1% from the UK. Of those, 31.2% were decision makers, 26.9% evidence generators, 19.4% service providers, 15.1% health-promotion advocates, and 7.5% purchasers of services/pharmaceutical products. Smoking restrictions in public areas were rated as the most important intervention (mean score = 1.89). The agreement on availability of interventions between the stakeholders was very low (kappa = 0.098; 95% CI = [0.085, 0.111] but the agreement on the importance of the interventions was fair (kappa = 0.239; 95% CI = [0.208, 0.253]). A correlation was found between availability and importance rankings for stage-based interventions. The importance ranking was not statistically concordant with the ranking based on published cost-effectiveness data (Kendall rank correlation coefficient = 0.40; p-value = 0.11; 95% CI = [- 0.09, 0.89]). CONCLUSIONS: The intrinsic differences in stakeholder views must be addressed while transferring economic evidence Europe-wide. Strong engagement with stakeholders, focussing on better communication, has a potential to mitigate this challenge.

Development of multi-criteria decision analysis (MCDA) framework for off-patent pharmaceuticals - an application on improving tender decision making in Indonesia.

BACKGROUND: Off-patent pharmaceuticals (OPPs) hold vital importance in meeting public health objectives, especially in developing countries where resources are limited. OPPs are comprised of off-patent originals, branded generics and unbranded generics; nonetheless, these products are not identical and often there are differences in their equivalence, manufacturing quality standards and reliability of supply. This necessitates reconsideration of the lowest price policy objective in pharmaceutical decision making. The aim of this study was to develop a Multi-Criteria Decision Analysis (MCDA) framework through a pilot workshop to inform the national procurement of OPPs in Indonesia. METHODS: An initial list of potentially relevant criteria was identified based on previous work and a literature review. In a 2-day pilot policy workshop, twenty local experts representing different stakeholder groups and decision-making bodies selected the final criteria, approved the scoring function for each criterion, and assigned weights to each criterion. RESULTS: An MCDA framework was proposed for OPP drug decision making in developing countries, which included price and 8 non-price criteria. Based on the pilot policy workshop 6 + 1 criteria were considered relevant for Indonesia: pharmaceutical price (40% weight), manufacturing quality (18.8%), equivalence with the reference product (12.2%), product stability and drug formulation (12.2%), reliability of drug supply (8.4%), real world clinical or economic outcomes, such as adherence or non-drug costs (4.2%) and pharmacovigilance (3.6%). CONCLUSIONS: According to the pilot policy workshop, other criteria apart from price need to be strengthened in the tendering process. The introduction of additional criteria for OPP procurement in an MCDA framework creates incentives for manufacturers to invest into improved manufacturing standards, equivalence proof, product quality, reliability of supply or even additional real-world data collection, which ultimately may result in more health gain for the society.