An Inclusive Civil Society Dialogue for Successful Implementation of the EU HTA Regulation: Call to Action to Ensure Appropriate Involvement of Stakeholders and Collaborators.

OBJECTIVES: Stakeholder involvement has long been considered a success factor for a joint European health technology assessment (HTA) process, and its relevance is now anchored in the EU HTA Regulation's (EU HTAR) legislative wording. Therefore, we aimed to explore the roles, challenges, and most important activities to increase the level of involvement per stakeholder group. METHODS: At the 2022 Fall Convention of the European Access Academy (EAA), working groups addressed the involvement of patients, clinicians, regulators, health technology developers (HTD), and national HTA bodies and payers within the EU HTA process. Each working group revisited the pre-convention survey results, determined key role characteristics for each stakeholder, and agreed on the most important activities to fulfill the role profile. Finally, the activities suggested per group were prioritized by plenary group. RESULTS: The prioritized actions for patients included training and capacity building, the establishment of a patient involvement committee, and the establishment of a patient unit at the EC secretariat. For clinicians, it included alignment on evidence assessment from a clinical vs. HTA point of view, capacity building, and standardization of processes. The most important actions for regulators are to develop joint regulatory-HTA guidance documents, align processes and interfaces under the regulation, and share discussions on post-licensing evidence generation. HTDs prioritized scientific advice capacity and the review of the scoping process, and further development of the scope of the assessment report fact checks. The top three actions for national HTA bodies and payers included clarification on the early HTD dialogue process, political support and commitment, and clarification on financial support. CONCLUSIONS: Addressing the activities identified as the most important for stakeholders/collaborators in the EU HTA process (e.g., in the implementation of the EU HTA Stakeholder Network and of the guidance documents developed by the EUnetHTA 21 consortium) will be key to starting an "inclusive civil society dialogue", as suggested by the European Commission's Pharmaceutical Strategy.

Increasing uptake through collaboration in the development of core outcome sets: Lessons learned at OMERACT 2023.

OBJECTIVE: This manuscript highlights the importance of enhancing the uptake of Core Outcome Sets (COS) by building partnerships with Collaborators and addressing their needs in COS development. METHODS AND SETTING: This session was structured as a simulation, resembling a format akin to a classic television game show. The moderator posed a series of questions to eight different Collaborator groups who briefly described the importance of COS within their areas of interest. Previous studies examining the uptake of individual core outcomes revealed disparities in uptake rates. The Identified barriers to the uptake of COS include the lack of recommendations for validated instruments for each domain, insufficient involvement of patients and key Collaborator groups in COS development, and a lack of awareness regarding the existence of COS. CONCLUSIONS: This analysis underscores the need for COS development approaches that prioritize the inclusion of patients and diverse Collaborator groups at every stage. While current studies on COS uptake are limited, future research should explore the broader implementation of COS across diverse disease categories and delve into the factors that hinder or facilitate their uptake such as, the importance of COS developers extending their work to recommending domains with well validated instruments. Embracing patient leadership and multifaceted engagement is essential for advancing the relevance and impact of COS in clinical research.

A literature review of quality assessment and applicability to HTA of risk prediction models of coronary heart disease in patients with diabetes.

This literature review had two objectives: to identify models for predicting the risk of coronary heart diseases in patients with diabetes (DM); and to assess model quality in terms of risk of bias (RoB) and applicability for the purpose of health technology assessment (HTA). We undertook a targeted review of journal articles published in English, Dutch, Chinese, or Spanish in 5 databases from 1st January 2016 to 18th December 2022, and searched three systematic reviews for the models published after 2012. We used PROBAST (Prediction model Risk Of Bias Assessment Tool) to assess RoB, and used findings from Betts et al. 2019, which summarized recommendations and criticisms of HTA agencies on cardiovascular risk prediction models, to assess model applicability for the purpose of HTA. As a result, 71 % and 67 % models reporting C-index showed good discrimination abilities (C-index >= 0.7). Of the 26 model studies and 30 models identified, only one model study showed low RoB in all domains, and no model was fully applicable for HTA. Since the major cause of high RoB is inappropriate use of analysis method, we advise clinicians to carefully examine the model performance declared by model developers, and to trust a model if all PROBAST domains except analysis show low RoB and at least one validation study conducted in the same setting (e.g. country) is available. Moreover, since general model applicability is not informative for HTA, novel adapted tools may need to be developed.

Added benefit and revenues of oncology drugs approved by the European Medicines Agency between 1995 and 2020: retrospective cohort study.

OBJECTIVES: To evaluate the added benefit and revenues of oncology drugs, explore their association, and investigate potential discrepancies between added benefit and revenues across different approval pathways of the European Medicines Agency (EMA). DESIGN: Retrospective cohort study. SETTING: Oncology drugs and their indications approved by the EMA between 1995 and 2020. MAIN OUTCOME MEASURES: Added benefit was evaluated using ratings published by seven organisations: health technology assessment agencies from the United States, France, Germany, and Italy, two medical oncology societies, and a drug bulletin. All retrieved ratings were recategorised using a four point ranking scale to indicate negative or non-quantifiable, minor, substantial, or major added benefit. Revenue data were extracted from publicly available financial reports and compared with published estimates of research and development (R&D) costs. Finally, the association between added benefit and revenue was evaluated. All analyses were performed within the overall study cohort, and within subgroups based on the EMA approval pathway: standard marketing authorisation, conditional marketing authorisation, and authorisation under exceptional circumstances. RESULTS: 131 oncology drugs with 166 indications were evaluated for their added benefit by at least one organisation within the required timeframe, yielding a total of 458 added benefit ratings; 189 (41%) were negative or non-quantifiable. The median time to offset the median R&D costs ($684m, £535m, €602m, adjusted to 2020 values) was three years; 50 of 55 (91%) drugs recovered these costs within eight years. Drugs with higher added benefit ratings generally had greater revenues. Negative or non-quantifiable added benefit ratings were more frequent for conditional marketing authorisations and authorisations under exceptional circumstances than for standard marketing authorisations (relative risk 1.53, 95% confidence interval 1.23 to 1.89). Conditional marketing authorisations generated lower revenues and took longer to offset R&D costs than standard marketing authorisations (four years compared with three years). CONCLUSIONS: While revenues seem to align with added benefit, most oncology drugs recover R&D costs within a few years despite providing little added benefit. This is particularly true for drugs approved through conditional marketing authorisations, which inherently appear to lack comprehensive evidence. Policy makers should evaluate whether current regulatory and reimbursement incentives effectively promote development of the most effective drugs for patients with the greatest needs.

A blueprint for health technology assessment capacity building: lessons learned from Malta.

OBJECTIVES: The development and strengthening of health technology assessment (HTA) capacity on the individual and organizational level and the wider environment is relevant for cooperation on HTAs. Based on the Maltese case, we provide a blueprint for building HTA capacity. METHODS: A set of activities were developed based on Pichler et al.'s framework and the starting HTA capacity in Malta. Individual level activities focused on strengthening epidemiological and health economic skills through online and in-person training. On the organizational level, a new HTA framework was developed which was subsequently utilized in a shadow assessment. Awareness campaign activities raised awareness and support in the wider environment where HTAs are conducted and utilized. RESULTS: The time needed to build HTA capacity exceeded the planned two years accommodating the learning progress of the assessors. In addition to the planned trainings, webinars supplemented the online courses, allowing for more knowledge exchange. The advanced online course was extended over time to facilitate learning next to the assessors' daily tasks. Training sessions were added to implement the new economic evaluation framework, which was utilized in a second shadow assessment. Awareness by decision-makers was achieved with reports, posters, and an article on the current and developing HTA capacity. CONCLUSIONS: It takes time and much (hands-on) training to build skills for conducting complex assessment such as HTAs. Facilitating exchange with knowledgeable parties is crucial for succeeding as well as the buy-in of local managers motivating staff. Decision-makers need to be on-boarded for the continued success of HTA capacity building.

Tools for assessing quality of studies investigating health interventions using real-world data: a literature review and content analysis.

OBJECTIVES: We aimed to identify existing appraisal tools for non-randomised studies of interventions (NRSIs) and to compare the criteria that the tools provide at the quality-item level. DESIGN: Literature review through three approaches: systematic search of journal articles, snowballing search of reviews on appraisal tools and grey literature search on websites of health technology assessment (HTA) agencies. DATA SOURCES: Systematic search: Medline; Snowballing: starting from three articles (D'Andrea et al, Quigley et al and Faria et al); Grey literature: websites of European HTA agencies listed by the International Network of Agencies for Health Technology Assessment. Appraisal tools were searched through April 2022. ELIGIBILITY CRITERIA FOR SELECTING STUDIES: We included a tool, if it addressed quality concerns of NRSIs and was published in English (unless from grey literature). A tool was excluded, if it was only for diagnostic, prognostic, qualitative or secondary studies. DATA EXTRACTION AND SYNTHESIS: Two independent researchers searched, screened and reviewed all included studies and tools, summarised quality items and scored whether and to what extent a quality item was described by a tool, for either methodological quality or reporting. RESULTS: Forty-nine tools met inclusion criteria and were included for the content analysis. Concerns regarding the quality of NRSI were categorised into 4 domains and 26 items. The Research Triangle Institute Item Bank (RTI Item Bank) and STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) were the most comprehensive tools for methodological quality and reporting, respectively, as they addressed (n=20; 17) and sufficiently described (n=18; 13) the highest number of items. However, none of the tools covered all items. CONCLUSION: Most of the tools have their own strengths, but none of them could address all quality concerns relevant to NRSIs. Even the most comprehensive tools can be complemented by several items. We suggest decision-makers, researchers and tool developers consider the quality-item level heterogeneity, when selecting a tool or identifying a research gap. OSF REGISTRATION NUMBER: OSF registration DOI (https://doi.org/10.17605/OSF.IO/KCSGX).

Disease severity-based subgrouping of type 2 diabetes does not parallel differences in quality of life: the Maastricht Study.

AIMS/HYPOTHESIS: Type 2 diabetes is a highly heterogeneous disease for which new subgroups ('clusters') have been proposed based on disease severity: moderate age-related diabetes (MARD), moderate obesity-related diabetes (MOD), severe insulin-deficient diabetes (SIDD) and severe insulin-resistant diabetes (SIRD). It is unknown how disease severity is reflected in terms of quality of life in these clusters. Therefore, we aimed to investigate the cluster characteristics and cluster-wise evolution of quality of life in the previously defined clusters of type 2 diabetes. METHODS: We included individuals with type 2 diabetes from the Maastricht Study, who were allocated to clusters based on a nearest centroid approach. We used logistic regression to evaluate the cluster-wise association with diabetes-related complications. We plotted the evolution of HbA1c levels over time and used Kaplan-Meier curves and Cox regression to evaluate the cluster-wise time to reach adequate glycaemic control. Quality of life based on the Short Form 36 (SF-36) was also plotted over time and adjusted for age and sex using generalised estimating equations. The follow-up time was 7 years. Analyses were performed separately for people with newly diagnosed and already diagnosed type 2 diabetes. RESULTS: We included 127 newly diagnosed and 585 already diagnosed individuals. Already diagnosed people in the SIDD cluster were less likely to reach glycaemic control than people in the other clusters, with an HR compared with MARD of 0.31 (95% CI 0.22, 0.43). There were few differences in the mental component score of the SF-36 in both newly and already diagnosed individuals. In both groups, the MARD cluster had a higher physical component score of the SF-36 than the other clusters, and the MOD cluster scored similarly to the SIDD and SIRD clusters. CONCLUSIONS/INTERPRETATION: Disease severity suggested by the clusters of type 2 diabetes is not entirely reflected in quality of life. In particular, the MOD cluster does not appear to be moderate in terms of quality of life. Use of the suggested cluster names in practice should be carefully considered, as the non-neutral nomenclature may affect disease perception in individuals with type 2 diabetes and their healthcare providers.

Opportunities and Challenges for Decentralized Clinical Trial Approaches: European Health Technology Assessment Perspective.

OBJECTIVES: Decentralized clinical trial (DCT) approaches are clinical trials in which some or all trial activities take place closer to participants' proximities instead of a traditional investigative site. Data from DCTs may be used for clinical and economic evaluations by health technology assessment (HTA) bodies to support reimbursement decision making. This study aimed to explore the opportunities and challenges for DCT approaches from an HTA perspective by interviewing representatives from European HTA bodies. METHODS: We conducted semistructured interviews with 25 European HTA representatives between September 2022 and February 2023, and transcripts were analyzed after thematic analysis. RESULTS: Two main themes were identified from the data relating to (1) DCT approaches in HTA and (2) trial-level acceptance and relevance. Experience with assessing DCTs was limited and a variety of knowledge about DCTs was observed. The respondents recognized the opportunity of DCTs to reduce recall bias when participant-reported outcome data can be collected more frequently and conveniently from home. Concerns were expressed about the data quality when participants become responsible for data collection. Despite this challenge, the respondents recognized the potential of DCTs to increase the generalizability of results because data can be collected in a setting reflective of the everyday situation potentially from a more diverse participant group. CONCLUSIONS: DCTs could generate relevant results for HTA decision making when data are collected in a real-world setting from a diverse participant group. Increased awareness of the opportunities and challenges could help HTA assessors in their appraisal of DCT approaches.

Importance of aligning the implementation of new payment models for innovative pharmaceuticals in European countries.

INTRODUCTION: The uptake of complex technologies and platforms has resulted in several challenges in the pricing and reimbursement of innovative pharmaceuticals. To address these challenges, plenty of concepts have already been described in the scientific literature about innovative value judgment or payment models, which are either (1) remaining theoretical; or (2) applied only in pilots with limited impact on patient access; or (3) applied so heterogeneously in many different countries that it prevents the health care industry from meeting expectations of HTA bodies and health care payers in the evidence requirements or offerings in different jurisdictions. AREAS COVERED: This paper provides perspectives on how to reduce the heterogeneity of pharmaceutical payment models across European countries in five areas, including 1) extended evaluation frameworks, 2) performance-based risk-sharing agreements, 3) pooled procurement for low volume or urgent technologies, 4) alternative access schemes, and 5) delayed payment models for technologies with high upfront costs. EXPERT OPINION: Whilst pricing and reimbursement decisions will remain a competence of EU member states, there is a need for alignment of European pharmaceutical payment model components in critical areas with the ultimate objective of improving the equitable access of European patients to increasingly complex pharmaceutical technologies.

Perspectives on how to build bridges between regulation, health technology assessment and clinical guideline development: a qualitative focus group study with European experts.

OBJECTIVE: Improving synergy among regulation, health technology assessment (HTA) and clinical guideline development is relevant as these independent processes are building on shared evidence-based grounds. The two objectives were first to assess how convergence of evidentiary needs among stakeholders may be achieved, and second, to determine to what extent convergence can be achieved. DESIGN: Qualitative study using eight online dual-moderator focus groups. SETTING: Discussions had a European focus and were contextualised in four case studies on head and neck cancer, diabetes mellitus, multiple sclerosis and myelodysplastic syndromes. PARTICIPANTS: Forty-two experienced (over 10 years) European regulators, HTA representatives and clinicians participated in the discussion. INTERVENTIONS: Participants received information on the case study and research topic in advance. An introductory background presentation and interview guide for the moderators were used to steer the discussion. RESULTS: Convergence may be achieved through improved communication institutionalised in multistakeholder early dialogues, shared definitions and shared methods. Required data sets should be inclusive rather than aligned. Deliberation and decision-making should remain independent. Alignment could be sought for pragmatic clinical trial designs and patient registries. Smaller and lower-income countries should be included in these efforts. CONCLUSION: Actors in the field expressed that improving synergy among stakeholders always involves trade-offs. A balance needs to be found between the convergence of processes and the institutional remits or geographical independence. A similar tension exists between the involvement of more actors, for example, patients or additional countries, and the level of collaboration that may be achieved. Communication is key to establishing this balance.

Recommendations for patient involvement in health technology assessment in Central and Eastern European countries.

Introduction: Meaningful patient involvement in health technology assessment (HTA) is essential in ensuring that the interests of the affected patient population, their families, and the general public are accurately reflected in coverage and reimbursement decisions. Central and Eastern European (CEE) countries are generally at less advanced stages of implementing HTA, which is particularly true for patient involvement activities. As part of the Horizon2020 HTx project, this research aimed to form recommendations for critical barriers to patient involvement in HTA in CEE countries. Methods: Built on previous research findings on potential barriers, a prioritisation survey was conducted online with CEE stakeholders. Recommendations for prioritised barriers were formed through a face-to-face workshop by CEE stakeholders and HTx experts. Results: A total of 105 stakeholders from 13 CEE countries completed the prioritisation survey and identified 12 of the 22 potential barriers as highly important. The workshop had 36 participants representing 9 CEE countries, and 5 Western European countries coming together to discuss solutions in order to form recommendations based on best practices, real-life experience, and transferability aspects. Stakeholder groups involved in both phases included HTA organisation representatives, payers, patients, caregivers, patient organisation representatives, patient experts, health care providers, academic and non-academic researchers, health care consultants and health technology manufacturers/providers. As a result, 12 recommendations were formed specified to the CEE region's context, but potentially useful for a broader geographic audience. Conclusion: In this paper, we present 12 recommendations for meaningful, systematic, and sustainable patient involvement in HTA in CEE countries. Our hope is that engaging more than a hundred CEE stakeholders in the study helped to spread awareness of the importance and potential of patient involvement and that the resulting recommendations provide tangible steps for the way forward. Future studies shall focus on country-specific case studies of the implemented recommendations.

The role of stakeholder involvement in the evolving EU HTA process: Insights generated through the European Access Academy's multi-stakeholder pre-convention questionnaire.

Involvement of all relevant stakeholders will be of utmost importance for the success of the developing EU HTA harmonization process. A multi-step procedure was applied to develop a survey across stakeholders/collaborators within the EU HTA framework to assess their current level of involvement, determine their suggested future role, identify challenges to contribution, and highlight efficient ways to fulfilling their role. The 'key' stakeholder groups identified and covered by this research included: patients', clinicians', regulatory, and Health Technology Developer representatives. The survey was circulated to a wide expert audience including all relevant stakeholder groups in order to determine self-perception by the 'key' stakeholders regarding involvement in the HTA process (self-rating), and in a second, slightly modified version of the questionnaire, to determine the perception of 'key' stakeholder involvement by HTA bodies, payers, and policymakers (external rating). Predefined analyses were conducted on the submitted responses. Fifty-four responses were received (patients 9; clinicians: 8; regulators: 4; HTDs 14; HTA bodies: 7; Payers: 5; policymakers 3; others 4). The mean self-perceived involvement score was consistently lower for each of the 'key' stakeholder groups than the respective external ratings. Based on the qualitative insights generated in the survey, a RACI Chart (Responsible/Accountable/Consulted/Informed) was developed for each of the stakeholder groups to determine their roles and involvement in the current EU HTA process. Our findings suggest extensive effort and a distinct research agenda are required to ensure adequate involvement of the key stakeholder groups in the evolving EU HTA process.

Uncertainty management in regulatory and health technology assessment decision-making on drugs: guidance of the HTAi-DIA Working Group.

OBJECTIVES: Uncertainty is a fundamental component of decision making regarding access to and pricing and reimbursement of drugs. The context-specific interpretation and mitigation of uncertainty remain major challenges for decision makers. Following the 2021 HTAi Global Policy Forum, a cross-sectoral, interdisciplinary HTAi-DIA Working Group (WG) was initiated to develop guidance to support stakeholder deliberation on the systematic identification and mitigation of uncertainties in the regulatory-HTA interface. METHODS: Six online discussions among WG members (Dec 2021-Sep 2022) who examined the output of a scoping review, two literature-based case studies and a survey; application of the initial guidance to a real-world case study; and two international conference panel discussions. RESULTS: The WG identified key concepts, clustered into twelve building blocks that were collectively perceived to define uncertainty: "unavailable," "inaccurate," "conflicting," "not understandable," "random variation," "information," "prediction," "impact," "risk," "relevance," "context," and "judgment." These were converted into a checklist to explain and define whether any issue constitutes a decision-relevant uncertainty. A taxonomy of domains in which uncertainty may exist within the regulatory-HTA interface was developed to facilitate categorization. The real-world case study was used to demonstrate how the guidance may facilitate deliberation between stakeholders and where additional guidance development may be needed. CONCLUSIONS: The systematic approach taken for the identification of uncertainties in this guidance has the potential to facilitate understanding of uncertainty and its management across different stakeholders involved in drug development and evaluation. This can improve consistency and transparency throughout decision processes. To further support uncertainty management, linkage to suitable mitigation strategies is necessary.

Recommendations to overcome barriers to the use of artificial intelligence-driven evidence in health technology assessment.

Background: Artificial intelligence (AI) has attracted much attention because of its enormous potential in healthcare, but uptake has been slow. There are substantial barriers that challenge health technology assessment (HTA) professionals to use AI-generated evidence for decision-making from large real-world databases (e.g., based on claims data). As part of the European Commission-funded HTx H2020 (Next Generation Health Technology Assessment) project, we aimed to put forward recommendations to support healthcare decision-makers in integrating AI into the HTA processes. The barriers, addressed by the paper, are particularly focusing on Central and Eastern European (CEE) countries, where the implementation of HTA and access to health databases lag behind Western European countries. Methods: We constructed a survey to rank the barriers to using AI for HTA purposes, completed by respondents from CEE jurisdictions with expertise in HTA. Using the results, two members of the HTx consortium from CEE developed recommendations on the most critical barriers. Then these recommendations were discussed in a workshop by a wider group of experts, including HTA and reimbursement decision-makers from both CEE countries and Western European countries, and summarized in a consensus report. Results: Recommendations have been developed to address the top 15 barriers in areas of (1) human factor-related barriers, focusing on educating HTA doers and users, establishing collaborations and best practice sharing; (2) regulatory and policy-related barriers, proposing increasing awareness and political commitment and improving the management of sensitive information for AI use; (3) data-related barriers, suggesting enhancing standardization and collaboration with data networks, managing missing and unstructured data, using analytical and statistical approaches to address bias, using quality assessment tools and quality standards, improving reporting, and developing better conditions for the use of data; and (4) technological barriers, suggesting sustainable development of AI infrastructure. Conclusion: In the field of HTA, the great potential of AI to support evidence generation and evaluation has not yet been sufficiently explored and realized. Raising awareness of the intended and unintended consequences of AI-based methods and encouraging political commitment from policymakers is necessary to upgrade the regulatory and infrastructural environment and knowledge base required to integrate AI into HTA-based decision-making processes better.

Health technology assessment of tests for SARS-CoV-2 and treatments for COVID-19: A proposed approach and best-practice recommendations.

OBJECTIVES: To develop best-practice guidance for health technology assessment (HTA) agencies when appraising diagnostic tests for SARS-CoV-2 and treatments for COVID-19. METHODS: We used a policy sandbox approach to develop best-practice guidance for HTA agencies to approach known challenges associated with assessing tests and treatments for COVID-19. The guidance was developed by a multi-stakeholder workshop of twenty-one participants representing HTA agencies, clinical and patient experts, academia, industry, and a payer, from across Europe and North America. The workshop was supported by extensive background work to identify the key challenges, including: targeted reviews of existing COVID-related methods guidance for assessing interventions and clinical guidelines, engagement with clinical experts, a survey and workshop of HTA agencies, a systematic review of published economic evaluations, and a workshop of health economic modelers. RESULTS: We suggest HTA agencies should consider using other types of evidence (e.g., real world) where high-quality randomized controlled trials may be lacking and healthcare systems would value timely HTA outputs. A "living" HTA approach may be useful, given the context of an evolving disease, scientific understanding and evidence base, allowing for decisions to be efficiently revisited in response to new information; particularly, if supported by a common "disease model" for COVID-19. Innovative ways of engaging with the public and clinicians, and early engagement with regulators and payers, are recommended. CONCLUSIONS: HTA agencies should consider the elements of this guidance that are most suited to their existing processes to enable them to assess the effectiveness and value of interventions for COVID-19.

Regulatory, health technology assessment and company interactions: the current landscape and future ecosystem for drug development, review and reimbursement.

BACKGROUND: Multi-stakeholder interactions have evolved at product and policy levels. There is a need to assess the current and future landscape of interactions between companies, and regulatory and HTA agencies to address challenges and identify areas for improvement. OBJECTIVES: The aims of this study were to review the current interactions within and across regulatory and HTA agencies, and companies' experiences in engaging in these activities; to assess the added value of interactions as well as limitations; to explore the future ecosystem for stakeholder interactions. METHOD: Three separate questionnaires were developed for companies, regulators and HTA agencies, respectively, to assess their experiences and perceptions. The responses were analyzed using descriptive statistics and discussed at a multi-stakeholder workshop. Key outcomes from the surveys and workshop discussion were reported. RESULTS: All seven regulators and seven HTA agencies in the survey indicated that they had stakeholder interactions. More formal collaboration occurred with regulators compared with HTA agencies. All nine companies have taken early advice but indicated the need for future prioritization. Success indicators can be built at the product and therapy levels, with the added value of faster patient access. Four principles were proposed for the future ecosystem: separate remit and functions between regulators and HTA; align processes; converge evidence requirements where possible; increase transparency. CONCLUSIONS: This research brought together regulators, HTA agencies, companies to examine how they interact with one another. We propose measures of value and make recommendations on future evolution to enable better evidence generation and improve regulatory and HTA decision-making.

Synergy between health technology assessments and clinical guidelines for multiple sclerosis.

Decision-making for reimbursement and clinical guidelines (CGs) serves different purposes although the decision-criteria and required evidence largely overlap. This study aimed to assess similarities and discrepancies between health technology assessment (HTA) reports as compared to CGs for multiple sclerosis (MS) medicines. All HTA reports and corresponding CGs for MS from the UK, France, Germany, the Netherlands, Poland, Sweden, and the European Union were assessed to identify synergies in recommendations for MS medicines (approved 1995-2020). A content analysis of HTA reports and CGs was performed to identify similarities and discrepancies in wording of treatment recommendations across documents. We assessed 132 HTA reports and 9 CGs for 16 MS treatments. Final recommendations for reimbursement and inclusion in CGs were mostly similar (90%), albeit with considerable differences in treatment lines and subindications. Since 2010, HTA reports refer to the use of CGs in 42% (55/132) and to consultations with clinicians in 43% (57/132) of cases. Six of nine CGs referred to HTA reports and two referred to HTA consultations, in one case having a formal relation to the HTA organization. CGs referenced pharmacoeconomic studies (4/9) for costs and cost-effectiveness. To date, not all new HTA recommendations for MS treatments are included in CGs. Some synergy exists between treatment recommendations in HTA reports and CGs, although discrepancies were seen in timelines and in recommended treatment lines and subindications. More stakeholder dialogue and/or consultation of each other's publications may further improve synergy, facilitate transparency, and enhance patient access.