Disease severity-based subgrouping of type 2 diabetes does not parallel differences in quality of life: the Maastricht Study.

AIMS/HYPOTHESIS: Type 2 diabetes is a highly heterogeneous disease for which new subgroups ('clusters') have been proposed based on disease severity: moderate age-related diabetes (MARD), moderate obesity-related diabetes (MOD), severe insulin-deficient diabetes (SIDD) and severe insulin-resistant diabetes (SIRD). It is unknown how disease severity is reflected in terms of quality of life in these clusters. Therefore, we aimed to investigate the cluster characteristics and cluster-wise evolution of quality of life in the previously defined clusters of type 2 diabetes. METHODS: We included individuals with type 2 diabetes from the Maastricht Study, who were allocated to clusters based on a nearest centroid approach. We used logistic regression to evaluate the cluster-wise association with diabetes-related complications. We plotted the evolution of HbA1c levels over time and used Kaplan-Meier curves and Cox regression to evaluate the cluster-wise time to reach adequate glycaemic control. Quality of life based on the Short Form 36 (SF-36) was also plotted over time and adjusted for age and sex using generalised estimating equations. The follow-up time was 7 years. Analyses were performed separately for people with newly diagnosed and already diagnosed type 2 diabetes. RESULTS: We included 127 newly diagnosed and 585 already diagnosed individuals. Already diagnosed people in the SIDD cluster were less likely to reach glycaemic control than people in the other clusters, with an HR compared with MARD of 0.31 (95% CI 0.22, 0.43). There were few differences in the mental component score of the SF-36 in both newly and already diagnosed individuals. In both groups, the MARD cluster had a higher physical component score of the SF-36 than the other clusters, and the MOD cluster scored similarly to the SIDD and SIRD clusters. CONCLUSIONS/INTERPRETATION: Disease severity suggested by the clusters of type 2 diabetes is not entirely reflected in quality of life. In particular, the MOD cluster does not appear to be moderate in terms of quality of life. Use of the suggested cluster names in practice should be carefully considered, as the non-neutral nomenclature may affect disease perception in individuals with type 2 diabetes and their healthcare providers.

Illustrating the Financial Consequences of Outcome-Based Payment Models From a Payers Perspective: The Case of Autologous Gene Therapy Atidarsagene Autotemcel (Libmeldy®).

OBJECTIVES: To illustrate the financial consequences of implementing different managed entry agreements (managed entry agreements for the Dutch healthcare system for autologous gene therapy atidarsagene autotemcel [Libmeldy]), while also providing a first systematic guidance on how to construct managed entry agreements to aid future reimbursement decision making and create patient access to high-cost, one-off potentially curative therapies. METHODS: Three payment models were compared: (1) an arbitrary 60% price discount, (2) an outcome-based spread payment with discounts, and (3) an outcome-based spread payment linked to a willingness to pay model with discounts. Financial consequences were estimated for full responders (A), patients responding according to the predicted clinical pathway presented in health technology assessment reports (B), and unstable responders (C). The associated costs for an average patient during the time frame of the payment agreement, the total budget impact, and associated benefits expressed in quality-adjusted life-years of the patient population were calculated. RESULTS: When patients responded according to the predicted clinical pathway presented in health technology assessment reports (scenario B), implementing outcome-based reimbursement models (models 2 and 3) had lower associated budget impacts while gaining similar benefits compared with the discount (scenario 1, €8.9 million to €6.6 million vs €9.2 million). In the case of unstable responders (scenario C), costs for payers are lower in the outcome-based scenarios (€4.1 million and €3.0 million, scenario 2C and 3C, respectively) compared with implementing the discount (€9.2 million, scenario 1C). CONCLUSIONS: Outcome-based models can mitigate the financial risk of reimbursing atidarsagene autotemcel. This can be considerably beneficial over simple discounts when clinical performance was similar to or worse than predicted.

Regulatory, health technology assessment and company interactions: the current landscape and future ecosystem for drug development, review and reimbursement.

BACKGROUND: Multi-stakeholder interactions have evolved at product and policy levels. There is a need to assess the current and future landscape of interactions between companies, and regulatory and HTA agencies to address challenges and identify areas for improvement. OBJECTIVES: The aims of this study were to review the current interactions within and across regulatory and HTA agencies, and companies' experiences in engaging in these activities; to assess the added value of interactions as well as limitations; to explore the future ecosystem for stakeholder interactions. METHOD: Three separate questionnaires were developed for companies, regulators and HTA agencies, respectively, to assess their experiences and perceptions. The responses were analyzed using descriptive statistics and discussed at a multi-stakeholder workshop. Key outcomes from the surveys and workshop discussion were reported. RESULTS: All seven regulators and seven HTA agencies in the survey indicated that they had stakeholder interactions. More formal collaboration occurred with regulators compared with HTA agencies. All nine companies have taken early advice but indicated the need for future prioritization. Success indicators can be built at the product and therapy levels, with the added value of faster patient access. Four principles were proposed for the future ecosystem: separate remit and functions between regulators and HTA; align processes; converge evidence requirements where possible; increase transparency. CONCLUSIONS: This research brought together regulators, HTA agencies, companies to examine how they interact with one another. We propose measures of value and make recommendations on future evolution to enable better evidence generation and improve regulatory and HTA decision-making.

Reported Challenges in Health Technology Assessment of Complex Health Technologies.

OBJECTIVES: With complex health technologies entering the market, methods for health technology assessment (HTA) may require changes. This study aimed to identify challenges in HTA of complex health technologies. METHODS: A survey was sent to European HTA organizations participating in European Network for HTA (EUnetHTA). The survey contained open questions and used predefined potentially complex health technologies and 7 case studies to identify types of complex health technologies and challenges faced during HTA. The survey was validated, tested for reliability by an expert panel, and pilot tested before dissemination. RESULTS: A total of 22 HTA organizations completed the survey (67%). Advanced therapeutic medicinal products (ATMPs) and histology-independent therapies were considered most challenging based on the predefined complex health technologies and case studies. For the case studies, more than half of the reported challenges were "methodological," equal in relative effectiveness assessments as in cost-effectiveness assessments. Through the open questions, we found that most of these challenges actually rooted in data unavailability. Data were reported as "absent," "insufficient," "immature," or "low quality" by 18 of 20 organizations (90%), in particular data on quality of life. Policy and organizational challenges and challenges because of societal or political pressure were reported by 8 (40%) and 4 organizations (20%), respectively. Modeling issues were reported least often (n = 2, 4%). CONCLUSIONS: Most challenges in HTA of complex health technologies root in data insufficiencies rather than in the complexity of health technologies itself. As the number of complex technologies grows, the urgency for new methods and policies to guide HTA decision making increases.

Understanding innovation of health technology assessment methods: the IHTAM framework.

Adequate methods are urgently needed to guarantee the good practice of health technology assessment (HTA) for technologies with novel properties. The aim of the study was to construct a conceptual framework to help understand the innovation of HTA methods (IHTAM). The construction of the IHTAM framework was based on two scoping reviews, one on the current practice of innovating methods, that is existing HTA frameworks, and one on theoretical foundations for innovating methods outside the HTA discipline. Both aimed to identify and synthesize concepts of innovation (i.e., innovation processes and roles of stakeholders in innovation). Using these concepts, the framework was developed in iterative brainstorming sessions and subsequent discussions with representatives from various stakeholder groups. The framework was constructed based on twenty documents on innovating HTA frameworks and fourteen guidelines from three scientific disciplines. It includes a generic innovation process consisting of three phases ("Identification," "Development," and "Implementation") and nine subphases. In the framework, three roles that HTA stakeholders can play in innovation ("Developers," "Practitioners," and "Beneficiaries") are defined, and a process on how the stakeholders innovate HTA methods is included. The IHTAM framework visualizes systematically which elements and stakeholders are important to the development and implementation of novel HTA methods. The framework could be used by all stakeholders involved in HTA innovation to learn how to engage dynamically and collaborate effectively throughout the innovation process. HTA stakeholders in practice have welcomed the framework, though additional testing of its applicability and acceptance is essential.

Addressing uncertainty in relative effectiveness assessments by HTA organizations.

This study outlines the ways in which different health technology assessment (HTA) organizations deal with uncertainty in relative effectiveness assessments (REAs), using the GRADE framework as a common reference. Guidelines regarding REA and uncertainty assessment methods and three most recent HTA reports (as of April 2020) of seven HTA organizations in Germany, England and Wales, France, the Netherlands, Europe (EUnetHTA), the USA, and Canada were included. First, it was analyzed how each organization addressed uncertainty on the following levels of evidence: (i) individual studies, (ii) body of evidence for one outcome, (iii) body of evidence across all outcomes, and (iv) added net benefit. Second, the extent to which HTA organizations considered the eight domains of certainty of evidence defined by GRADE was assessed. For individual studies, checklists were the most common approach to express uncertainty (4/7 organizations). Uncertainty in the body of evidence for all outcomes and in added benefit was combined in a single conclusion by five organizations. All organizations reported on at least 4/5 downgrading domains of GRADE, while the three upgrading domains were reported less. The operationalization of the assessment of multiple domains was unclear due to vague or absent guidelines. HTA organizations consider most domains of the GRADE framework, but approaches to assess uncertainty within REAs on different levels of evidence differ substantially between organizations. More alignment and guidance on the best methods to deal with uncertainty within HTA could lead to more clarity for stakeholders and to more aligned reimbursement recommendations.

Comparative effectiveness and safety of pharmaceuticals assessed in observational studies compared with randomized controlled trials.

BACKGROUND: There have been ongoing efforts to understand when and how data from observational studies can be applied to clinical and regulatory decision making. The objective of this review was to assess the comparability of relative treatment effects of pharmaceuticals from observational studies and randomized controlled trials (RCTs). METHODS: We searched PubMed and Embase for systematic literature reviews published between January 1, 1990, and January 31, 2020, that reported relative treatment effects of pharmaceuticals from both observational studies and RCTs. We extracted pooled relative effect estimates from observational studies and RCTs for each outcome, intervention-comparator, or indication assessed in the reviews. We calculated the ratio of the relative effect estimate from observational studies over that from RCTs, along with the corresponding 95% confidence interval (CI) for each pair of pooled RCT and observational study estimates, and we evaluated the consistency in relative treatment effects. RESULTS: Thirty systematic reviews across 7 therapeutic areas were identified from the literature. We analyzed 74 pairs of pooled relative effect estimates from RCTs and observational studies from 29 reviews. There was no statistically significant difference (based on the 95% CI) in relative effect estimates between RCTs and observational studies in 79.7% of pairs. There was an extreme difference (ratio < 0.7 or > 1.43) in 43.2% of pairs, and, in 17.6% of pairs, there was a significant difference and the estimates pointed in opposite directions. CONCLUSIONS: Overall, our review shows that while there is no significant difference in the relative risk ratios between the majority of RCTs and observational studies compared, there is significant variation in about 20% of comparisons. The source of this variation should be the subject of further inquiry to elucidate how much of the variation is due to differences in patient populations versus biased estimates arising from issues with study design or analytical/statistical methods.

Early Cost-Effectiveness of Onasemnogene Abeparvovec-xioi (Zolgensma) and Nusinersen (Spinraza) Treatment for Spinal Muscular Atrophy I in The Netherlands With Relapse Scenarios.

OBJECTIVES: Onasemnogene Abeparvovec-xioi (AVXS-101) is a gene therapy intended for curative treatment of spinal muscular atrophy (SMA) with an expected price of around €2 000 000. The goal of this study is to perform a cost-effectiveness analysis of treatment of SMA I patients with AVXS-101 in The Netherlands including relapse scenarios. METHODS: An individual-based state-transition model was used to model treatment effect and survival of SMA I patients treated with AVXS-101, nusinersen and best supportive care (BSC). The model included five health states: three health states according to SMA types, one for permanent ventilation and one for death. Deterministic and probabilistic sensitivity analyses were performed. Effects of relapsing to lower health states in the years following treatment was explored. RESULTS: The base-case incremental cost-effectiveness ratio (ICER) for AVXS-101 versus BSC is €138 875/QALY, and €53 447/QALY for AVXS-101 versus nusinersen. If patients relapse within 10 years after treatment with AVXS-101, the ICER can increase up to 6-fold, with effects diminishing thereafter. Only relapses occurring later than 50 years after treatment have a negligible effect on the ICER. To comply with Dutch willingness-to-pay reference values, the price of AVXS-101 must decrease to €680 000. CONCLUSIONS: Based on this model, treatment with AVXS-101 is unlikely to be cost-effective under Dutch willingness-to-pay reference values. Uncertainty regarding the long-term curative properties of AVXS-101 can result in multiplication of the ICER. Decision-makers are advised to appropriately balance these uncertainties against the price they are willing to pay now.

Bridging health technology assessment and healthcare quality improvement using international consortium of health outcomes measurement standard sets.

OBJECTIVE: Although health technology assessment (HTA) and healthcare quality improvement are distinct processes, a greater level of alignment in outcome measures used may increase the quality and efficiency of data collection. This study evaluates the agreement in outcome measures used in oncology for healthcare quality improvement and HTAs, and how these align to the International Consortium for Health Outcomes Measurement (ICHOM) standard sets. METHODS: We conducted a cross-sectional comparative analysis of ICHOM sets focusing on oncological indications and publicly available measures for healthcare quality and HTA reports published by the National Health Care Institute from the Netherlands and the National Institute for Health and Care Excellence from the United Kingdom. RESULTS: All ICHOM sets and HTAs used overall survival, whereas quality improvement used different survival estimates. Different progression estimates for cancer were used in HTAs, ICHOM sets, and quality improvement. Data on health-related quality of life (HRQoL) was recommended in all ICHOM sets and all HTAs, but selectively for quality improvement. In HTAs, generic HRQoL questionnaires were preferred, whereas, in quality improvement and ICHOM sets, disease-specific questionnaires were recommended. Unfavorable outcomes were included in all HTAs and all ICHOM sets, but not always for quality improvement. CONCLUSIONS: Although HTA and quality improvement use outcome measures from the same domains, a greater level of alignment seems possible. ICHOM may provide input on standardized outcome measures to support this alignment. However, residual discrepancies will remain due to the different objectives of HTA and quality improvement.

Exploring the opportunities for alignment of regulatory postauthorization requirements and data required for performance-based managed entry agreements.

Performance-based managed entry agreements (PB-MEAs) might allow patient access to new medicines, but practical hurdles make competent authorities for pricing and reimbursement (CAPR) reluctant to implement PB-MEAs. We explored if the feasibility of PB-MEAs might improve by better aligning regulatory postauthorization requirements with the data generation of PB-MEAs and by active collaboration and data sharing. Reviewers from seven CAPRs provided structured assessments of the information available at the European Medicines Agency (EMA) Web site on regulatory postauthorization requirements for fifteen recently authorized products. The reviewers judged to what extent regulatory postauthorization studies could help implement PB-MEAs by addressing uncertainty gaps. Study domains assessed were: patient population, intervention, comparators, outcomes, time horizon, anticipated data quality, and anticipated robustness of analysis. Reviewers shared general comments about PB-MEAs for each product and on cooperation with other CAPRs. Reviewers rated regulatory postauthorization requirements at least partly helpful for most products and across domains except the comparator domain. One quarter of responses indicated that public information provided by the EMA was insufficient to support the implementation of PB-MEAs. Few PB-MEAs were in place for these products, but the potential for implementation of PB-MEAs or collaboration across CAPRs was seen as more favorable. Responses helped delineate a set of conditions where PB-MEAs may help reduce uncertainty. In conclusion, PB-MEAs are not a preferred option for CAPRs, but we identified conditions where PB-MEAs might be worth considering. The complexities of implementing PB-MEAs remain a hurdle, but collaboration across silos and more transparency on postauthorization studies could help overcome some barriers.

Information Patients With Melanoma Spontaneously Report About Health-Related Quality of Life on Web-Based Forums: Case Study.

BACKGROUND: There is a general agreement on the importance of health-related quality of life (HRQoL). This type of information is becoming increasingly important for the value assessment of health technology assessment agencies in evaluating the benefits of new health technologies, including medicines. However, HRQoL data are often limited, and additional sources that provide this type of information may be helpful. OBJECTIVE: We aim to identify the HRQoL topics important to patients with melanoma based on web-based discussions on public social media forums. METHODS: We identified 3 public web-based forums from the United States and the United Kingdom, namely the Melanoma Patient Information Page, the Melanoma International Forum, and MacMillan. Their posts were randomly selected and coded using qualitative methods until saturation was reached. RESULTS: Of the posts assessed, 36.7% (150/409) of posts on Melanoma International Forum, 45.1% (198/439) on MacMillan, and 35.4% (128/362) on Melanoma Patient Information Page focused on HRQoL. The 2 themes most frequently mentioned were mental health and (un)certainty. The themes were constructed based on underlying and more detailed codes. Codes related to fear, worry and anxiety, uncertainty, and unfavorable effects were the most-often discussed ones. CONCLUSIONS: Web-based forums are a valuable source for identifying relevant HRQoL aspects in patients with a given disease. These aspects could be cross-referenced with existing tools and they might improve the content validity of patient-reported outcome measures, including HRQoL questionnaires. In addition, web-based forums may provide health technology assessment agencies with a more holistic understanding of the external aspects affecting patient HRQoL. These aspects might support the value assessment of new health technologies and could therefore help inform topic prioritization as well as the scoping phase before any value assessment.

Efficacy gap between phase II and subsequent phase III studies in oncology.

AIMS: There is a trend for more flexibility in timing of evidence generation in relation to marketing authorization, including the option to complete phase III trials after authorization or not at all. This paper investigated the relation between phase II and III clinical trial efficacy in oncology. METHODS: All oncology drugs approved by the European Medicines Agency (2007-2016) were included. Phase II and phase III trials were matched based on indication and treatment and patient characteristics. Reported objective response rates (ORR), median progression-free survival (PFS) and median overall survival (OS) were analysed through weighted mixed-effects regression with previous treatment, treatment regimen, blinding, randomization, marketing authorization type and cancer type as covariates. RESULTS: A total of 81 phase II-III matches were identified including 252 trials. Mean (standard deviation) weighted difference (phase III minus II) was -4.2% (17.4) for ORR, 2.1 (6.7) months for PFS and -0.3 (5.1) months for OS, indicating very small average differences between phases. Differences varied substantially between individual indications: from -46.6% to 47.3% for ORR, from -5.3 to 35.9 months for PFS and from -13.3 to 10.8 months for OS. All covariates except blinding were associated with differences in effect sizes for at least 1 outcome. CONCLUSIONS: The lack of marked average differences between phases may encourage decision-makers to regard the quality of design and total body of evidence instead of differentiating between phases of clinical development. The large variability emphasizes that replication of study findings remains essential to confirm efficacy of oncology drugs and discern variables associated with demonstrated effects.

Differences in Health Technology Assessment Recommendations Among European Jurisdictions: The Role of Practice Variations.

BACKGROUND: Health technology assessment (HTA) plays an important role in reimbursement decision-making in many countries, but recommendations vary widely throughout jurisdictions, even for the same drug. This variation may be due to differences in the weighing of evidence or differences in the processes or procedures, which are known as HTA practices. OBJECTIVE: To provide insight into the effects of differences in practices on interpretation of intercountry differences in HTA recommendations for conditionally approved drugs. METHODS: HTA recommendations for conditionally approved drugs (N = 27) up until June 2017 from England/Wales, France, Germany, the Netherlands, and Scotland were included. Recommendations and practice characteristics were extracted from these five jurisdictions and this data was validated. The effect of nonsubmissions, resubmissions, and reassessments; cost-effectiveness assessments; and price negotiations on changes in the percentage of negative recommendations and the interpretation of intercountry differences in HTA outcomes were analyzed using Fisher exact tests. RESULTS: The inclusion of cost-effectiveness assessments led to significant increases in the proportion of negative recommendations in England/Wales (from 4% to 50%, P<.01) and Scotland (from 21% to 71%, P<.01). The subsequent inclusion of price negotiations led to significant reductions in the proportion of negative recommendations in England/Wales (from 50% to 14%, P<.01), France (from 31% to 3%, P=.012), and Germany (from 34% to 0%, P<.01). Results indicated that the inclusion of nonsubmissions and resubmissions might affect Scottish negative HTA recommendations (from 7% to 21%), but this effect was not significant. No significant effects were observed in the Netherlands, possibly owing to sample size. CONCLUSION: Variations in HTA practices between international jurisdictions can have a substantial and significant impact on conclusions about recommendations by HTA bodies, as exemplified in this cohort of conditionally approved products. Studies comparing international HTA recommendations should carefully consider possible practice variations between jurisdictions.

Unmet Medical Need: An Introduction to Definitions and Stakeholder Perceptions.

BACKGROUND: Despite increasing informal and formal use of unmet medical need (UMN) in drug development, regulation, and assessment, there is no insight into its definitions in use. This study aims to provide insight into the current definitions in use and to provide a starting point for a multi-stakeholder discussion on alignment. METHODS: A scoping and a gray literature review were performed to locate definitions of UMN in literature and on stakeholder websites. These definitions were categorized and then discussed among the multi-stakeholder author group via semistructured group discussions and open session workshops with a broader stakeholder audience. Issues with the formation of a common definition and mechanisms for use were discussed. RESULTS: The reviews yielded 16 definitions. Differences were evident, but all included 1 or more of the following elements: (adequacy of) available treatments (16 of 16: 100%), disease severity or burden (6 of 16: 38%), and patient population size (1 of 16: 6%). The stakeholder discussions led to a suggestion for a definition including the first 2 items and, depending on context, population size. The discussions also showed that quantification of UMN is highly dependent on the scope and the value framework in which it is used based on different stakeholder preferences and responsibilities. CONCLUSION: We encourage stakeholders that want to promote alignment on the concept of UMN to prospectively discuss the scope in which they want to apply the concept, what elements they find important for consideration in each case, and how they would measure UMN within the broader regulatory or value framework applicable.

The impact of quality-of-life data in relative effectiveness assessments of new anti-cancer drugs in European countries.

PURPOSE: The aim of this study is to investigate the role of health-related quality-of-life (QoL) data in relative effectiveness assessments (REAs) of new anti-cancer drugs across European jurisdictions, during health technology assessment procedures. METHODS: Comparative analysis of guidelines and publicly available REAs in six European jurisdictions of anti-cancer drugs approved by EMA between 2011 and 2013. RESULTS: Fourteen anti-cancer drugs were included, adding up to 79 REAs. Whilst all guidelines state that QoL is a relevant endpoint to determine the relative effectiveness of new cancer drugs, QoL data were included in only 54% of the 79 reports and their impact on the recommendations was limited. CONCLUSIONS: Whilst national guidelines recognize the relevance of QoL to determine the relative effectiveness of new anti-cancer drugs, this is not well-reflected in current assessments. Developing and implementing into REAs specific evidence requirements for QoL data would improve the use of this patient-centred outcome in future reimbursement and pricing decisions.

Can a Joint Assessment Provide Relevant Information for National/Local Relative Effectiveness Assessments? An In-Depth Comparison of Pazopanib Assessments.

BACKGROUND: In many European jurisdictions, relative effectiveness assessments (REAs) of pharmaceuticals are performed during the reimbursement decision-making process. International collaboration in the production of these assessments may prevent the duplication of information in various jurisdictions. A first pilot of a joint REA (pazopanib for the treatment of renal cell carcinoma) was published in 2011. OBJECTIVE: The objective was to investigate how well the methods used in the joint REA match the methods used in the national/local assessments on the same topic. METHODS: National/local assessments from European jurisdictions, available in English language, were identified through a literature search and an e-mail request to health technology assessment organizations. Data were abstracted from joint and national/local assessments using a structured data abstraction form. Results were compared for differences and similarities. RESULTS: In total, five national/local reports were included (Belgium, England/Wales, France, The Netherlands, and Scotland). The general methods (indication, main comparator, main end points, main trial) were similar. The details of the assessment (e.g., exact wording of indication, additional comparators, additional trials included, and method of indirect comparison), however, varied. Despite these differences, the joint REA included nearly all comparators, end points, trials, and methods of analysis that were used in national/local REA reports. CONCLUSIONS: This study has shown overlap in the methods national/local REA bodies in Europe have chosen for a pazopanib REA for renal cell carcinoma, except for the use and methods of indirect comparisons. Although some additional comparators and outcomes differed between national/local REAs, they can be captured in a comprehensive joint REA.

Standardized reporting for rapid relative effectiveness assessments of pharmaceuticals.

OBJECTIVES: Many European countries perform rapid assessments of the relative effectiveness (RE) of pharmaceuticals as part of the reimbursement decision making process. Increased sharing of information on RE across countries may save costs and reduce duplication of work. The objective of this article is to describe the development of a tool for rapid assessment of RE of new pharmaceuticals that enter the market, the HTA Core Model® for Rapid Relative Effectiveness Assessment (REA) of Pharmaceuticals. METHODS: Eighteen member organisations of the European Network of Health Technology Assessment (EUnetHTA) participated in the development of the model. Different versions of the model were developed and piloted in this collaboration and adjusted accordingly based on feedback on the content and feasibility of the model. RESULTS: The final model deviates from the traditional HTA Core Model® used for assessing other types of technologies. This is due to the limited scope (strong focus on RE), the timing of the assessment (just after market authorisation), and strict timelines (e.g. 90 days) required for performing the assessment. The number of domains and assessment elements was limited and it was decided that the primary information sources should preferably be a submission file provided by the marketing authorisation holder and the European Public Assessment Report. CONCLUSIONS: The HTA Core Model® for Rapid REA (version 3.0) was developed to produce standardised transparent RE information of pharmaceuticals. Further piloting can provide input for possible improvements, such as further refining the assessment elements and new methodological guidance on relevant areas.

Piloting international production of rapid relative effectiveness assessments of pharmaceuticals.

BACKGROUND: This article describes the lessons learned from an international pilot assessment using the first version of the HTA Core Model® and Guidelines for rapid Relative Effectiveness Assessment (REA) of pharmaceuticals based on input from three different perspectives: the assessors, the users (health technology assessment organisations) and the marketing authorisation holder. METHODS: A pilot assessment was performed of pazopanib for the treatment of advanced or metastatic renal cell carcinoma for which 54 individuals from 22 EUnetHTA member organisations from 16 European countries gave their contribution. The work was divided in eight domain teams. Subsequently, results of these domain teams were synthesised in one pilot report. Feedback on the outcomes of the pilot was gathered throughout the project and through structured surveys. RESULTS: The first version of the assessment was produced in six months and consisted of 55 question and answer pairs, 8 domain reports and a synthesis section that combined the results from the different domains. The organisation of the pilot required intense coordination. Main points of criticism on the assessment were the lengthiness of the document and overlap of information throughout the assessment. CONCLUSIONS: A reduction in the number of authoring organisations and individuals participating is necessary to avoid information overlap and increase efficiency in undertaking the assessment. Involving several organisations (e.g. five) in an in-depth review could still ensure the benefit of broad participation from various countries. The focus of a rapid REA should be on the first four domains of the Model.