Illustrating the Financial Consequences of Outcome-Based Payment Models From a Payers Perspective: The Case of Autologous Gene Therapy Atidarsagene Autotemcel (Libmeldy®).

OBJECTIVES: To illustrate the financial consequences of implementing different managed entry agreements (managed entry agreements for the Dutch healthcare system for autologous gene therapy atidarsagene autotemcel [Libmeldy]), while also providing a first systematic guidance on how to construct managed entry agreements to aid future reimbursement decision making and create patient access to high-cost, one-off potentially curative therapies. METHODS: Three payment models were compared: (1) an arbitrary 60% price discount, (2) an outcome-based spread payment with discounts, and (3) an outcome-based spread payment linked to a willingness to pay model with discounts. Financial consequences were estimated for full responders (A), patients responding according to the predicted clinical pathway presented in health technology assessment reports (B), and unstable responders (C). The associated costs for an average patient during the time frame of the payment agreement, the total budget impact, and associated benefits expressed in quality-adjusted life-years of the patient population were calculated. RESULTS: When patients responded according to the predicted clinical pathway presented in health technology assessment reports (scenario B), implementing outcome-based reimbursement models (models 2 and 3) had lower associated budget impacts while gaining similar benefits compared with the discount (scenario 1, €8.9 million to €6.6 million vs €9.2 million). In the case of unstable responders (scenario C), costs for payers are lower in the outcome-based scenarios (€4.1 million and €3.0 million, scenario 2C and 3C, respectively) compared with implementing the discount (€9.2 million, scenario 1C). CONCLUSIONS: Outcome-based models can mitigate the financial risk of reimbursing atidarsagene autotemcel. This can be considerably beneficial over simple discounts when clinical performance was similar to or worse than predicted.

Lifecycle HTA: promising applications and a framework for implementation. An HTAi Global Policy Forum Task Force report.

The 2022 Health Technology Assessment International (HTAi) Global Policy Forum (GPF) established the goal of developing a position statement and framework for lifecycle HTA (LC-HTA), through a Task Force leveraging multi-stakeholder monthly discussions and GPF member input. The Task Force developed a working definition: LC-HTA is a systematic process utilizing sequential HTA activities to inform decision making where the evidence base, the health technology itself, or the context in which it is applied, has a potential to meaningfully change at different points in its LC. Four key scenarios were identified where it was considered that an LC-HTA approach would add sufficient value to HTA bodies and their key stakeholders to justify the additional resource burden. Based on the four scenarios, a high-level LC-HTA framework was developed consisting of (i) defining the decision problem, (ii) sequencing of HTA activities, and (iii) developing optimization criteria. Subsequently, the Task Force developed operationalization guidance for LC-HTA in a companion paper.

An operationalization framework for lifecycle health technology assessment: a Health Technology Assessment International Global Policy Forum Task Force report.

Operationalization guidance is needed to support health technology assessment (HTA) bodies considering implementing lifecycle HTA (LC-HTA) approaches. The 2022 Health Technology Assessment International (HTAi) Global Policy Forum (GPF) established a Task Force to develop a position paper on LC-HTA. In its first paper, the Task Force established a definition and framework for LC-HTA in order to tailor it to specific decision problems. This second paper focused on the provision of practical operational guidance to implement LC-HTA. Detailed descriptions of the three LC-HTA operational steps are provided (defining the decision problem, sequencing of HTA activities, and developing optimization criteria) and accompanied by worked examples and an operationalization checklist with 20 different questions for HTA bodies to consider when developing an LC-HTA approach. The questions were designed to be applicable across different types of HTA and scenarios, and require adaptation to local jurisdictions, remits, and context.

The Beneluxa Initiative domain task force health technology assessment: a comparison of member countries' past health technology assessments.

OBJECTIVE: This study aimed to compare assessments between Beneluxa Initiative member countries' assessments and identify alignments and divergences. METHODS: A retrospective comparative analysis was performed that investigated (i) number and type of assessed indications (for Austria (AT), Belgium (BE), Ireland (IE), and the Netherlands (NL)); (ii) added benefit conclusions (for BE, IE, and NL); and (iii) the main arguments underlying differences in conclusions (for BE, IE, and NL). Data were retrieved directly from agency representatives and from public HTA reports. European Medicines Agency approved indications were included for drugs assessed between 2016 and 2020, excluding veterinary drugs, generics, and biosimilars. RESULTS: Only 44 (10 percent) of the 444 included indications were assessed by all four member countries. Between any pair of two countries, the overlap was higher, from 63 (AT-NL) to 188 (BE-IE). Added benefit conclusions matched exactly in 62-74 percent of the indications, depending on the countries compared. In the remaining cases, most often a difference of one added benefit level was observed (e.g., higher vs. equal relative effect). Contradictory outcomes were very rare: only three cases were observed (lower vs. higher effect). When assessing the underlying arguments for seven cases with different outcomes, differences were attributable to slight differences in weighing of evidence and uncertainties rather than disagreement on aspects within the assessment itself. CONCLUSIONS: Despite high variability in European HTA procedures, collaboration on HTA between the Beneluxa Initiative member countries is very feasible and would likely not result in added benefit conclusions that would be very different from added benefit conclusions in national procedures.

Reported Challenges in Health Technology Assessment of Complex Health Technologies.

OBJECTIVES: With complex health technologies entering the market, methods for health technology assessment (HTA) may require changes. This study aimed to identify challenges in HTA of complex health technologies. METHODS: A survey was sent to European HTA organizations participating in European Network for HTA (EUnetHTA). The survey contained open questions and used predefined potentially complex health technologies and 7 case studies to identify types of complex health technologies and challenges faced during HTA. The survey was validated, tested for reliability by an expert panel, and pilot tested before dissemination. RESULTS: A total of 22 HTA organizations completed the survey (67%). Advanced therapeutic medicinal products (ATMPs) and histology-independent therapies were considered most challenging based on the predefined complex health technologies and case studies. For the case studies, more than half of the reported challenges were "methodological," equal in relative effectiveness assessments as in cost-effectiveness assessments. Through the open questions, we found that most of these challenges actually rooted in data unavailability. Data were reported as "absent," "insufficient," "immature," or "low quality" by 18 of 20 organizations (90%), in particular data on quality of life. Policy and organizational challenges and challenges because of societal or political pressure were reported by 8 (40%) and 4 organizations (20%), respectively. Modeling issues were reported least often (n = 2, 4%). CONCLUSIONS: Most challenges in HTA of complex health technologies root in data insufficiencies rather than in the complexity of health technologies itself. As the number of complex technologies grows, the urgency for new methods and policies to guide HTA decision making increases.

Understanding innovation of health technology assessment methods: the IHTAM framework.

Adequate methods are urgently needed to guarantee the good practice of health technology assessment (HTA) for technologies with novel properties. The aim of the study was to construct a conceptual framework to help understand the innovation of HTA methods (IHTAM). The construction of the IHTAM framework was based on two scoping reviews, one on the current practice of innovating methods, that is existing HTA frameworks, and one on theoretical foundations for innovating methods outside the HTA discipline. Both aimed to identify and synthesize concepts of innovation (i.e., innovation processes and roles of stakeholders in innovation). Using these concepts, the framework was developed in iterative brainstorming sessions and subsequent discussions with representatives from various stakeholder groups. The framework was constructed based on twenty documents on innovating HTA frameworks and fourteen guidelines from three scientific disciplines. It includes a generic innovation process consisting of three phases ("Identification," "Development," and "Implementation") and nine subphases. In the framework, three roles that HTA stakeholders can play in innovation ("Developers," "Practitioners," and "Beneficiaries") are defined, and a process on how the stakeholders innovate HTA methods is included. The IHTAM framework visualizes systematically which elements and stakeholders are important to the development and implementation of novel HTA methods. The framework could be used by all stakeholders involved in HTA innovation to learn how to engage dynamically and collaborate effectively throughout the innovation process. HTA stakeholders in practice have welcomed the framework, though additional testing of its applicability and acceptance is essential.

Addressing uncertainty in relative effectiveness assessments by HTA organizations.

This study outlines the ways in which different health technology assessment (HTA) organizations deal with uncertainty in relative effectiveness assessments (REAs), using the GRADE framework as a common reference. Guidelines regarding REA and uncertainty assessment methods and three most recent HTA reports (as of April 2020) of seven HTA organizations in Germany, England and Wales, France, the Netherlands, Europe (EUnetHTA), the USA, and Canada were included. First, it was analyzed how each organization addressed uncertainty on the following levels of evidence: (i) individual studies, (ii) body of evidence for one outcome, (iii) body of evidence across all outcomes, and (iv) added net benefit. Second, the extent to which HTA organizations considered the eight domains of certainty of evidence defined by GRADE was assessed. For individual studies, checklists were the most common approach to express uncertainty (4/7 organizations). Uncertainty in the body of evidence for all outcomes and in added benefit was combined in a single conclusion by five organizations. All organizations reported on at least 4/5 downgrading domains of GRADE, while the three upgrading domains were reported less. The operationalization of the assessment of multiple domains was unclear due to vague or absent guidelines. HTA organizations consider most domains of the GRADE framework, but approaches to assess uncertainty within REAs on different levels of evidence differ substantially between organizations. More alignment and guidance on the best methods to deal with uncertainty within HTA could lead to more clarity for stakeholders and to more aligned reimbursement recommendations.

Regulatory reliance pathways during health emergencies: enabling timely authorizations for COVID-19 vaccines in Latin America.

Objectives: To map the timing and nature of regulatory reliance pathways used to authorize COVID-19 vaccines in Latin America. Methods: An observational study was conducted assessing the characteristics of all COVID-19 vaccine authorizations in Latin America. For every authorization it was determined whether reliance was used in the authorization process. Subgroups of reference national regulatory authorities (NRAs) and non-reference NRAs were compared. Results: 56 authorizations of 10 different COVID-19 vaccines were identified in 18 countries, of which 25 (44.6%) used reliance and 12 (21.4%) did not. For the remaining 19 (33.0%) it was not possible to determine whether reliance was used. Reference agencies used reliance less often (40% of authorizations with a known pathway) compared to non-reference agencies (100%). The median review time was just 15 days and does not meaningfully differ between reliance and non-reliance authorizations. Conclusions: This study demonstrated that for these vaccines, despite reliance pathways being associated with numerous rapid authorizations, independent authorization review times were not considerably longer than reliance reviews; reliance pathways were not a prerequisite for rapid authorization. Nevertheless, reliance pathways provided rapid authorizations in response to the COVID-19 emergency.

Early Cost-Effectiveness of Onasemnogene Abeparvovec-xioi (Zolgensma) and Nusinersen (Spinraza) Treatment for Spinal Muscular Atrophy I in The Netherlands With Relapse Scenarios.

OBJECTIVES: Onasemnogene Abeparvovec-xioi (AVXS-101) is a gene therapy intended for curative treatment of spinal muscular atrophy (SMA) with an expected price of around €2 000 000. The goal of this study is to perform a cost-effectiveness analysis of treatment of SMA I patients with AVXS-101 in The Netherlands including relapse scenarios. METHODS: An individual-based state-transition model was used to model treatment effect and survival of SMA I patients treated with AVXS-101, nusinersen and best supportive care (BSC). The model included five health states: three health states according to SMA types, one for permanent ventilation and one for death. Deterministic and probabilistic sensitivity analyses were performed. Effects of relapsing to lower health states in the years following treatment was explored. RESULTS: The base-case incremental cost-effectiveness ratio (ICER) for AVXS-101 versus BSC is €138 875/QALY, and €53 447/QALY for AVXS-101 versus nusinersen. If patients relapse within 10 years after treatment with AVXS-101, the ICER can increase up to 6-fold, with effects diminishing thereafter. Only relapses occurring later than 50 years after treatment have a negligible effect on the ICER. To comply with Dutch willingness-to-pay reference values, the price of AVXS-101 must decrease to €680 000. CONCLUSIONS: Based on this model, treatment with AVXS-101 is unlikely to be cost-effective under Dutch willingness-to-pay reference values. Uncertainty regarding the long-term curative properties of AVXS-101 can result in multiplication of the ICER. Decision-makers are advised to appropriately balance these uncertainties against the price they are willing to pay now.

Cost-Effectiveness Assessment of Monitoring Abiraterone Levels in Metastatic Castration-Resistant Prostate Cancer Patients.

OBJECTIVES: Abiraterone acetate is registered for the treatment of metastatic castration-sensitive and resistant prostate cancer (mCRPC). Treatment outcome is associated with plasma trough concentrations (Cmin) of abiraterone. Patients with a plasma Cmin below the target of 8.4 ng/mL may benefit from treatment optimization by dose increase or concomitant intake with food. This study aims to investigate the cost-effectiveness of monitoring abiraterone Cmin in patients with mCRPC. METHODS: A Markov model was built with health states progression-free survival, progressed disease, and death. The benefits of monitoring abiraterone Cmin followed by a dose increase or food intervention were modeled via a difference in the percentage of patients achieving adequate Cmin taking a healthcare payer perspective. Deterministic and probabilistic sensitivity analyses were performed to assess uncertainties and their impac to the incremental cost-effectiveness ratio (ICER). RESULTS: Monitoring abiraterone followed by a dose increase resulted in 0.149 incremental quality-adjusted life-years (QALYs) with €22 145 incremental costs and an ICER of €177 821/QALY. The food intervention assumed equal effects and estimated incremental costs of €7599, resulting in an ICER of €61 019/QALY. The likelihoods of therapeutic drug monitoring (TDM) with a dose increase or food intervention being cost-effective were 8.04%and 81.9%, respectively. CONCLUSIONS: Monitoring abiraterone followed by a dose increase is not cost-effective in patients with mCRPC from a healthcare payer perspective. Monitoring in combination with a food intervention is likely to be cost-effective. This cost-effectiveness assessment may assist decision making in future integration of abiraterone TDM followed by a food intervention into standard abiraterone acetate treatment practices of mCRPC patients.

Exploring the opportunities for alignment of regulatory postauthorization requirements and data required for performance-based managed entry agreements.

Performance-based managed entry agreements (PB-MEAs) might allow patient access to new medicines, but practical hurdles make competent authorities for pricing and reimbursement (CAPR) reluctant to implement PB-MEAs. We explored if the feasibility of PB-MEAs might improve by better aligning regulatory postauthorization requirements with the data generation of PB-MEAs and by active collaboration and data sharing. Reviewers from seven CAPRs provided structured assessments of the information available at the European Medicines Agency (EMA) Web site on regulatory postauthorization requirements for fifteen recently authorized products. The reviewers judged to what extent regulatory postauthorization studies could help implement PB-MEAs by addressing uncertainty gaps. Study domains assessed were: patient population, intervention, comparators, outcomes, time horizon, anticipated data quality, and anticipated robustness of analysis. Reviewers shared general comments about PB-MEAs for each product and on cooperation with other CAPRs. Reviewers rated regulatory postauthorization requirements at least partly helpful for most products and across domains except the comparator domain. One quarter of responses indicated that public information provided by the EMA was insufficient to support the implementation of PB-MEAs. Few PB-MEAs were in place for these products, but the potential for implementation of PB-MEAs or collaboration across CAPRs was seen as more favorable. Responses helped delineate a set of conditions where PB-MEAs may help reduce uncertainty. In conclusion, PB-MEAs are not a preferred option for CAPRs, but we identified conditions where PB-MEAs might be worth considering. The complexities of implementing PB-MEAs remain a hurdle, but collaboration across silos and more transparency on postauthorization studies could help overcome some barriers.

Efficacy gap between phase II and subsequent phase III studies in oncology.

AIMS: There is a trend for more flexibility in timing of evidence generation in relation to marketing authorization, including the option to complete phase III trials after authorization or not at all. This paper investigated the relation between phase II and III clinical trial efficacy in oncology. METHODS: All oncology drugs approved by the European Medicines Agency (2007-2016) were included. Phase II and phase III trials were matched based on indication and treatment and patient characteristics. Reported objective response rates (ORR), median progression-free survival (PFS) and median overall survival (OS) were analysed through weighted mixed-effects regression with previous treatment, treatment regimen, blinding, randomization, marketing authorization type and cancer type as covariates. RESULTS: A total of 81 phase II-III matches were identified including 252 trials. Mean (standard deviation) weighted difference (phase III minus II) was -4.2% (17.4) for ORR, 2.1 (6.7) months for PFS and -0.3 (5.1) months for OS, indicating very small average differences between phases. Differences varied substantially between individual indications: from -46.6% to 47.3% for ORR, from -5.3 to 35.9 months for PFS and from -13.3 to 10.8 months for OS. All covariates except blinding were associated with differences in effect sizes for at least 1 outcome. CONCLUSIONS: The lack of marked average differences between phases may encourage decision-makers to regard the quality of design and total body of evidence instead of differentiating between phases of clinical development. The large variability emphasizes that replication of study findings remains essential to confirm efficacy of oncology drugs and discern variables associated with demonstrated effects.

Differences in Health Technology Assessment Recommendations Among European Jurisdictions: The Role of Practice Variations.

BACKGROUND: Health technology assessment (HTA) plays an important role in reimbursement decision-making in many countries, but recommendations vary widely throughout jurisdictions, even for the same drug. This variation may be due to differences in the weighing of evidence or differences in the processes or procedures, which are known as HTA practices. OBJECTIVE: To provide insight into the effects of differences in practices on interpretation of intercountry differences in HTA recommendations for conditionally approved drugs. METHODS: HTA recommendations for conditionally approved drugs (N = 27) up until June 2017 from England/Wales, France, Germany, the Netherlands, and Scotland were included. Recommendations and practice characteristics were extracted from these five jurisdictions and this data was validated. The effect of nonsubmissions, resubmissions, and reassessments; cost-effectiveness assessments; and price negotiations on changes in the percentage of negative recommendations and the interpretation of intercountry differences in HTA outcomes were analyzed using Fisher exact tests. RESULTS: The inclusion of cost-effectiveness assessments led to significant increases in the proportion of negative recommendations in England/Wales (from 4% to 50%, P<.01) and Scotland (from 21% to 71%, P<.01). The subsequent inclusion of price negotiations led to significant reductions in the proportion of negative recommendations in England/Wales (from 50% to 14%, P<.01), France (from 31% to 3%, P=.012), and Germany (from 34% to 0%, P<.01). Results indicated that the inclusion of nonsubmissions and resubmissions might affect Scottish negative HTA recommendations (from 7% to 21%), but this effect was not significant. No significant effects were observed in the Netherlands, possibly owing to sample size. CONCLUSION: Variations in HTA practices between international jurisdictions can have a substantial and significant impact on conclusions about recommendations by HTA bodies, as exemplified in this cohort of conditionally approved products. Studies comparing international HTA recommendations should carefully consider possible practice variations between jurisdictions.

Increasing the information provided by probabilistic sensitivity analysis: The relative density plot.

BACKGROUND: Results of probabilistic sensitivity analyses (PSA) are frequently visualized as a scatterplot, which is limited through overdrawing and a lack of insight in relative density. To overcome these limitations, we have developed the Relative Density plot (PSA-ReD). METHODS: The PSA-ReD combines a density plot and a contour plot to visualize and quantify PSA results. Relative density, depicted using a color gradient, is transformed to a cumulative probability. Contours are then plotted over regions with a specific cumulative probability. We use two real-world case studies to demonstrate the value of the PSA-ReD plot. RESULTS: The PSA-ReD method demonstrates proof-of-concept and feasibility. In the real-world case-studies, PSA-ReD provided additional visual information that could not be understood from the traditional scatterplot. High density areas were identified by color-coding and the contour plot allowed for quantification of PSA iterations within areas of the cost-effectiveness plane, diminishing overdrawing and putting infrequent iterations in perspective. Critically, the PSA-ReD plot informs modellers about non-linearities within their model. CONCLUSIONS: The PSA-ReD plot is easy to implement, presents more of the information enclosed in PSA data, and prevents inappropriate interpretation of PSA results. It gives modelers additional insight in model functioning and the distribution of uncertainty around the cost-effectiveness estimate.

Unmet Medical Need: An Introduction to Definitions and Stakeholder Perceptions.

BACKGROUND: Despite increasing informal and formal use of unmet medical need (UMN) in drug development, regulation, and assessment, there is no insight into its definitions in use. This study aims to provide insight into the current definitions in use and to provide a starting point for a multi-stakeholder discussion on alignment. METHODS: A scoping and a gray literature review were performed to locate definitions of UMN in literature and on stakeholder websites. These definitions were categorized and then discussed among the multi-stakeholder author group via semistructured group discussions and open session workshops with a broader stakeholder audience. Issues with the formation of a common definition and mechanisms for use were discussed. RESULTS: The reviews yielded 16 definitions. Differences were evident, but all included 1 or more of the following elements: (adequacy of) available treatments (16 of 16: 100%), disease severity or burden (6 of 16: 38%), and patient population size (1 of 16: 6%). The stakeholder discussions led to a suggestion for a definition including the first 2 items and, depending on context, population size. The discussions also showed that quantification of UMN is highly dependent on the scope and the value framework in which it is used based on different stakeholder preferences and responsibilities. CONCLUSION: We encourage stakeholders that want to promote alignment on the concept of UMN to prospectively discuss the scope in which they want to apply the concept, what elements they find important for consideration in each case, and how they would measure UMN within the broader regulatory or value framework applicable.

Agreement about Availability of Alternative Treatments for Innovative Drugs Assessed by the EMA and HTA Organizations.

The European Medicines Agency (EMA) and European national/regional health technology assessment (HTA) organizations consider the availability of existing treatments when evaluating a new drug. Since disagreement about the availability of alternative treatments may impact patient access to new drugs, this study aimed to investigate whether the EMA and HTA organizations agreed on the availability of alternative treatments and whether a lack of alternative treatments was associated with HTA organizations' added benefit assessment outcomes. For 97 innovative drugs authorized in 2019-2021 (excluding vaccines and diagnostic tools), assessments by the EMA and AEMPS (Spain), AIFA (Italy), HAS (France), IQWiG/G-BA (Germany), NICE (England and Wales), and ZIN (the Netherlands) were identified. Until 1 June 2022, 429 HTA drug-indication combinations were identified for these 97 drugs, of which 205 exactly matched the EMA's indication. For those, the overall agreement between the EMA and HTA organizations on whether alternative treatments were available was 87%. The agreement of HTA organizations with the EMA on whether available treatments were either pharmacological on-label, pharmacological off-label, or non-pharmacological was 87%, 21%, and 57%, respectively. For all 429 HTA drug-indication combinations, absence of alternative treatments as considered by HTA organizations was associated with a higher chance to provide added benefit: risk ratio 1.8 (95%-CI 1.4-2.3). In conclusion, although there was high overall agreement between the EMA and HTA organizations about whether alternative treatments exist, there were differences in the types of treatment considered. Parallel joint scientific consultations could inform drug developers about relevant alternative treatments to facilitate patient access to innovative drugs.

Managed Entry Agreements for High-Cost, One-Off Potentially Curative Therapies: A Framework and Calculation Tool to Determine Their Suitability.

OBJECTIVE: To construct a framework and calculation tool to compare the consequences of implementing different payment models for high-cost, one-off potentially curative therapies and enable decision making to ultimately enhance timely patient access to innovative health interventions. METHODS: A framework outlining steps to determine potentially suitable payment models was developed. Based on the framework, a supporting calculation tool operationalised as an Excel-based model was constructed to quantify the associated costs for an average patient during the timeframe of the intended payment agreement, the total budget impact and associated benefits expressed in quality-adjusted life-years for the total expected lifetime of the patient population. To demonstrate the potential of the framework, three case studies were used: onasemnogene abeparvovec (Zolgensma®), brexucabtagene autoleucel (Tecartus®) and etranacogene dezaparvovec (Hemgenix®). A hypothetical case study was used to illustrate the output of the calculation tool. RESULTS: Part 1 of the framework presents steps for matching a suitable reimbursement and payment model with the disease and treatment characteristics. The reimbursement and payment models are further specified in Part 2. Part 3 guides end users through the setup of a calculation tool with which the financial impact can be calculated of two payment models: a price discount model and an outcome-based spread payment model with a discount. Part 4 concerns the output of the calculation tool, showing how different payment models lead to different financial consequences under three assumptions of longer term effectiveness. CONCLUSIONS: The presented framework provides decision makers with insight into the financial consequences of their chosen payment model under different assumptions. This can aid reimbursement negotiations by clarifying the optimal choice given a therapy's characteristics.

Importance of aligning the implementation of new payment models for innovative pharmaceuticals in European countries.

INTRODUCTION: The uptake of complex technologies and platforms has resulted in several challenges in the pricing and reimbursement of innovative pharmaceuticals. To address these challenges, plenty of concepts have already been described in the scientific literature about innovative value judgment or payment models, which are either (1) remaining theoretical; or (2) applied only in pilots with limited impact on patient access; or (3) applied so heterogeneously in many different countries that it prevents the health care industry from meeting expectations of HTA bodies and health care payers in the evidence requirements or offerings in different jurisdictions. AREAS COVERED: This paper provides perspectives on how to reduce the heterogeneity of pharmaceutical payment models across European countries in five areas, including 1) extended evaluation frameworks, 2) performance-based risk-sharing agreements, 3) pooled procurement for low volume or urgent technologies, 4) alternative access schemes, and 5) delayed payment models for technologies with high upfront costs. EXPERT OPINION: Whilst pricing and reimbursement decisions will remain a competence of EU member states, there is a need for alignment of European pharmaceutical payment model components in critical areas with the ultimate objective of improving the equitable access of European patients to increasingly complex pharmaceutical technologies.

Tools for assessing quality of studies investigating health interventions using real-world data: a literature review and content analysis.

OBJECTIVES: We aimed to identify existing appraisal tools for non-randomised studies of interventions (NRSIs) and to compare the criteria that the tools provide at the quality-item level. DESIGN: Literature review through three approaches: systematic search of journal articles, snowballing search of reviews on appraisal tools and grey literature search on websites of health technology assessment (HTA) agencies. DATA SOURCES: Systematic search: Medline; Snowballing: starting from three articles (D'Andrea et al, Quigley et al and Faria et al); Grey literature: websites of European HTA agencies listed by the International Network of Agencies for Health Technology Assessment. Appraisal tools were searched through April 2022. ELIGIBILITY CRITERIA FOR SELECTING STUDIES: We included a tool, if it addressed quality concerns of NRSIs and was published in English (unless from grey literature). A tool was excluded, if it was only for diagnostic, prognostic, qualitative or secondary studies. DATA EXTRACTION AND SYNTHESIS: Two independent researchers searched, screened and reviewed all included studies and tools, summarised quality items and scored whether and to what extent a quality item was described by a tool, for either methodological quality or reporting. RESULTS: Forty-nine tools met inclusion criteria and were included for the content analysis. Concerns regarding the quality of NRSI were categorised into 4 domains and 26 items. The Research Triangle Institute Item Bank (RTI Item Bank) and STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) were the most comprehensive tools for methodological quality and reporting, respectively, as they addressed (n=20; 17) and sufficiently described (n=18; 13) the highest number of items. However, none of the tools covered all items. CONCLUSION: Most of the tools have their own strengths, but none of them could address all quality concerns relevant to NRSIs. Even the most comprehensive tools can be complemented by several items. We suggest decision-makers, researchers and tool developers consider the quality-item level heterogeneity, when selecting a tool or identifying a research gap. OSF REGISTRATION NUMBER: OSF registration DOI (https://doi.org/10.17605/OSF.IO/KCSGX).

A literature review of quality assessment and applicability to HTA of risk prediction models of coronary heart disease in patients with diabetes.

This literature review had two objectives: to identify models for predicting the risk of coronary heart diseases in patients with diabetes (DM); and to assess model quality in terms of risk of bias (RoB) and applicability for the purpose of health technology assessment (HTA). We undertook a targeted review of journal articles published in English, Dutch, Chinese, or Spanish in 5 databases from 1st January 2016 to 18th December 2022, and searched three systematic reviews for the models published after 2012. We used PROBAST (Prediction model Risk Of Bias Assessment Tool) to assess RoB, and used findings from Betts et al. 2019, which summarized recommendations and criticisms of HTA agencies on cardiovascular risk prediction models, to assess model applicability for the purpose of HTA. As a result, 71 % and 67 % models reporting C-index showed good discrimination abilities (C-index >= 0.7). Of the 26 model studies and 30 models identified, only one model study showed low RoB in all domains, and no model was fully applicable for HTA. Since the major cause of high RoB is inappropriate use of analysis method, we advise clinicians to carefully examine the model performance declared by model developers, and to trust a model if all PROBAST domains except analysis show low RoB and at least one validation study conducted in the same setting (e.g. country) is available. Moreover, since general model applicability is not informative for HTA, novel adapted tools may need to be developed.