Multicriteria Decision Analysis to Support Health Technology Assessment Agencies: Benefits, Limitations, and the Way Forward.

OBJECTIVE: Recent years have witnessed an increased interest in the use of multicriteria decision analysis (MCDA) to support health technology assessment (HTA) agencies for setting healthcare priorities. However, its implementation to date has been criticized for being "entirely mechanistic," ignoring opportunity costs, and not following best practice guidelines. This article provides guidance on the use of MCDA in this context. METHODS: The present study was based on a systematic review and consensus development. We developed a typology of MCDA studies and good implementation practice. We reviewed 36 studies over the period 1990 to 2018 on their compliance with good practice and developed recommendations. We reached consensus among authors over the course of several review rounds. RESULTS: We identified 3 MCDA study types: qualitative MCDA, quantitative MCDA, and MCDA with decision rules. The types perform differently in terms of quality, consistency, and transparency of recommendations on healthcare priorities. We advise HTA agencies to always include a deliberative component. Agencies should, at a minimum, undertake qualitative MCDA. The use of quantitative MCDA has additional benefits but also poses design challenges. MCDA with decision rules, used by HTA agencies in The Netherlands and the United Kingdom and typically referred to as structured deliberation, has the potential to further improve the formulation of recommendations but has not yet been subjected to broad experimentation and evaluation. CONCLUSION: MCDA holds large potential to support HTA agencies in setting healthcare priorities, but its implementation needs to be improved.

Why laparoscopists may opt for three-dimensional view: a summary of the full HTA report on 3D versus 2D laparoscopy by S.I.C.E. (Società Italiana di Chirurgia Endoscopica e Nuove Tecnologie).

BACKGROUND: Three-dimensional view in laparoscopic general, gynaecologic and urologic surgery is an efficient, safe and sustainable innovation. The present paper is an extract taken from a full health technology assessment report on three-dimensional vision technology compared with standard two-dimensional laparoscopic systems. METHODS: A health technology assessment approach was implemented in order to investigate all the economic, social, ethical and organisational implications related to the adoption of the innovative three-dimensional view. With the support of a multi-disciplinary team, composed of eight experts working in Italian hospitals and Universities, qualitative and quantitative data were collected, by means of literature evidence, validated questionnaire and self-reported interviews, applying a final MCDA quantitative approach, and considering the dimensions resulting from the EUnetHTA Core Model. RESULTS: From systematic search of literature, we retrieved the following studies: 9 on general surgery, 35 on gynaecology and urology, both concerning clinical setting. Considering simulated setting we included: 8 studies regarding pitfalls and drawbacks, 44 on teaching, 12 on surgeons' confidence and comfort and 34 on surgeons' performances. Three-dimensional laparoscopy was shown to have advantages for both the patients and the surgeons, and is confirmed to be a safe, efficacious and sustainable vision technology. CONCLUSIONS: The objective of the present paper, under the patronage of Italian Society of Endoscopic Surgery, was achieved in that there has now been produced a scientific report, based on a HTA approach, that may be placed in the hands of surgeons and used to support the decision-making process of the health providers.

EXPLORING VALUES OF HEALTH TECHNOLOGY ASSESSMENT AGENCIES USING REFLECTIVE MULTICRITERIA AND RARE DISEASE CASE.

OBJECTIVES: Tackling ethical dilemmas faced by reimbursement decision makers requires deeper understanding of values on which health technology assessment (HTA) agencies are founded and how trade-offs are made. This was explored in this study including the case of rare disease. METHODS: Representatives from eight HTA explored values on which institutions are founded using a narrative approach and reflective multicriteria (developed from EVIDEM, criteria derived from ethical imperatives of health care). Trade-offs between criteria and the impact of incorporating defined priorities (including for rare diseases) were explored through a quantitative values elicitation exercise. RESULTS: Participants reported a diversity of substantive and procedural values with a common emphasis on scientific excellence, stakeholder involvement, independence, and transparency. Examining the ethical imperatives behind EVIDEM criteria was found to be useful to further explore substantive values. Most criteria were deemed to reflect institutions' values, while 70 percent of the criteria were reported by at least half of participants to be considered formally by their institutions. The quantitative values elicitation highlighted the difficulty to balance imperatives of "alleviating or preventing patient suffering," "serving the whole population equitably," "upholding healthcare system sustainability," and "making decisions informed by evidence and context" but may help share the ethical reasoning behind decisions. Incorporating "Priorities" (including for rare diseases) helped reveal trade-offs from other criteria and their underlying ethical imperatives. CONCLUSIONS: Reflective multicriteria are useful to explore substantive values of HTAs, reflect how these values and their ethical underpinnings can be operationalized into criteria, and explore the ethical reasoning at the heart of the healthcare debate.

Detection of clinical relapses in multiple sclerosis cohorts: construction and validation of a model based on administrative data.

Multiple sclerosis (MS) is the main cause of chronic disability in young people during their most productive years of life and therefore carries a high social and economic burden. The present study aimed to: (1) verify the capacity of an administrative data source to furnish data for constructing a model able to detect the occurrence of clinical relapses in MS patients and (2) validate the constructed theoretical model on a set of real-world data. Two MS experts identified some administrative variables as proxies of clinical relapses. Thereafter, the two MS experts analysed 889 events in 100 MS patients, considering only the administrative data relating to these patients, while a third neurologist independently analysed the real-world data (documented medical history) of the same patients in the same period. Absolute concordance between the theoretical model and the real-world data was found in 86 % of the events. The model we propose is easily and rapidly applicable, requiring the collection of just a few variables that are already present in local health authority administrative databases in Italy. It can be used to estimate, with a good level of reliability, the occurrence of relapses in various settings. Moreover, the model is also exportable to different and larger MS cohorts and could be useful for healthcare planning and for evaluating the efficacy of drugs in the real-world, thus favouring better resource allocation and management.

Implementation of EUnetHTA core Model® in Lombardia: the VTS framework.

OBJECTIVES: This study describes the health technology assessment (HTA) framework introduced by Regione Lombardia to regulate the introduction of new technologies. The study outlines the process and dimensions adopted to prioritize, assess and appraise the requests of new technologies. METHODS: The HTA framework incorporates and adapts elements from the EUnetHTA Core Model and the EVIDEM framework. It includes dimensions, topics, and issues provided by EUnetHTA Core Model to collect data and process the assessment. Decision making is instead supported by the criteria and Multi-Criteria Decision Analysis technique from the EVIDEM consortium. RESULTS: The HTA framework moves along three process stages: (i) prioritization of requests, (ii) assessment of prioritized technology, (iii) appraisal of technology in support of decision making. Requests received by Regione Lombardia are first prioritized according to their relevance along eight dimensions (e.g., costs, efficiency and efficacy, organizational impact, safety). Evidence about the impacts of the prioritized technologies is then collected following the issues and topics provided by EUnetHTA Core Model. Finally, the Multi-Criteria Decision Analysis technique is used to appraise the novel technology and support Regione Lombardia decision making. CONCLUSIONS: The VTS (Valutazione delle Tecnologie Sanitarie) framework has been successfully implemented at the end of 2011. From its inception, twenty-six technologies have been processed.

Moving Towards Accountability for Reasonableness - A Systematic Exploration of the Features of Legitimate Healthcare Coverage Decision-Making Processes Using Rare Diseases and Regenerative Therapies as a Case Study.

BACKGROUND: The accountability for reasonableness (A4R) framework defines 4 conditions for legitimate healthcare coverage decision processes: Relevance, Publicity, Appeals, and Enforcement. The aim of this study was to reflect on how the diverse features of decision-making processes can be aligned with A4R conditions to guide decision-making towards legitimacy. Rare disease and regenerative therapies (RDRTs) pose special decision-making challenges and offer therefore a useful case study. METHODS: Features operationalizing each A4R condition as well as three different approaches to address these features (cost-per-QALY-focused and multicriteria-based) were defined and organized into a matrix. Seven experts explored these features during a panel run under the Chatham House Rule and provided general and RDRT-specific recommendations. Responses were analyzed to identify converging and diverging recommendations. RESULTS: Regarding Relevance, recommendations included supporting deliberation, stakeholder participation and grounding coverage decision criteria in normative and societal objectives. Thirteen of 17 proposed decision criteria were recommended by a majority of panelists. The usefulness of universal cost-effectiveness thresholds to inform allocative efficiency was challenged, particularly in the RDRT context. RDRTs raise specific issues that need to be considered; however, rarity should be viewed in relation to other aspects, such as disease severity and budget impact. Regarding Publicity, panelists recommended transparency about the values underlying a decision and value judgements used in selecting evidence. For Appeals, recommendations included a life-cycle approach with clear provisions for re-evaluations. For Enforcement, external quality reviews of decisions were recommended. CONCLUSION: Moving coverage decision-making processes towards enhanced legitimacy in general and in the RDRT context involves designing and refining approaches to support participation and deliberation, enhancing transparency, and allowing explicit consideration of multiple decision criteria that reflect normative and societal objectives.

Neoadjuvant Model in Cancer Treatment: From Clinical Opportunity to Health-Care Utility.

In the last few decades, research has demonstrated that cancer can be treated and cured if diagnosed at very early stage and a proper therapeutic strategy is adopted. Recent omics-based approaches have unveiled the molecular mechanisms of cancer tumorigenesis and have aided in identifying next-generation molecular markers for early diagnosis, prognosis, and targeted therapy. New tests based on genomic profiling, circulating tumor cells, or mutation profiling are appraised for purpose by Health Technology Assessment. The potential clinical utility of these tests lies on their ability to discriminate between patients who will benefit to a greater or lesser extent from a therapeutic intervention. Assessment of new technologies for the management of cancer could be of interest to other countries given the potentially high impact that they can have on the quality and cost of health care services.

Early discharge of infectious disease patients: an opportunity or extra cost for the Italian Healthcare System?

In order to assess the economic benefits of an early discharge (ED) programme for patients with complicated skin and soft tissue infections (cSSTIs) in terms of hospital and regional authority costs, an economic analysis was conducted comparing two possible alternatives: standard hospital management vs. an ED strategy followed by a period of outpatient management. Utilization of resources and costs were derived from the literature and expert panel evaluation. Patients were classified into four groups: low-intensity non-walking (LINW), low-intensity walking (LIW), high-intensity non-walking (HINW) and high-intensity walking (HIW). The overall costs (inpatient/outpatient) of hospitalization with ED for cSSTIs range from Euros 2,079 for LIW to Euros 2,193 for HINW, with the most expensive regimen (HINW) being 50% lower than the costs for 12.6 days of hospitalization alone (Euros 4,619). The weighted average Diagnosis Related Group (DRG) reimbursement for cSSTIs (Euros 2,042) does not cover the costs of such hospitalization. In conclusion, when a patient's conditions allow for early discharge there is an economic advantage for the hospital with an outpatient management plan, especially for patients requiring low-intensity care. However, this could be disadvantageous in terms of regional costs if outpatient management has to be paid in addition to payment by the DRG.

Foundations of a healthcare knowledge management application system.

Much of the knowledge management (KM) literature suggests that organizations should adopt either a "personalization" or "codification" strategy and that to mix the two is unwise. Two European schools have come to the conclusion that a broad strategy is needed. Its key conceptual elements are in three dimensions: the type (explicit - tacit), focus (information - learning) and organization (digital - social) of knowledge. Without this broad approach it is impossible to reconcile the wish to provide (codified) evidence-based solutions to populations at the same time as personalized care for individuals.

A clinically rooted approach to Knowledge Management in a large Italian community hospital.

A strategy for Knowledge Management (KM) implementation in a large hospital involved three areas: intranet/internet technologies for professional practice standardization and communication; multiprofessional group building for sharing and discovering of social perspectives; learning opportunities targeted to high quality information sources and information mastering methods. A cooperative prototyping approach assured high levels of user's acceptance and involvement, and initial results are encouraging, but measuring and sustaining clinical practice changes will require additional efforts.

Integration of a standard gastrointestinal endoscopy terminology in the UMLS Metathesaurus.

MST(c), a standard terminology for gastrointestinal endoscopy reporting, was integrated in the January 2002 UMLS Metathesaurus in order to ease the practical interoperability of clinical data repositories in gastroenterology. The integration required full specification of names, resolution of discrepancies between English, French and Italian versions of MST, appropriate categorization with UMLS Semantic Types and MST-level Class attributes, assignment of explicit intra-table (and some useful inter-table) relationships mainly at concept level but also at the source level in order to retain and fully represent the original explicit and implicit MST organization. Main results, problems encountered and future plans are discussed.