Co-construction of health technology assessment recommendations with patients: An example with cardiac defibrillator replacement.

CONTEXT: The National Institute of Excellence in Health and Social Services (INESSS), which functions as the Québec health technology assessment (HTA) agency, tested a new way to engage patients along with health-care professionals in the co-construction of recommendations regarding implantable cardioverter-defibrillator replacement. OBJECTIVE: The objective of this article was to describe the process of co-construction of recommendations and to propose methods of building best practices for patient involvement (PI) in HTA. DESIGN: Throughout the process, documents were collected and participant observations were made. Individual interviews were conducted with patients, health-care professionals and the INESSS scientific team, from January to March 2018. RESULTS: Three committees were established: an expert patient committee to reflect on patient experience literature; an expert health professional committee to reflect on medical literature; and a co-construction committee through which both patients and health-care professionals contributed to develop the recommendations. The expert patients validated and contextualized a literature review produced by the scientific team. This allowed the scientists to consider aspects related to the patient experience and to integrate the feedback from patients into HTA recommendations. The most important factor contributing to a positive PI experience was the structured methodology for selecting patient participants, and a key factor that inhibited the process was a lack of training in PI on the part of the scientific team. CONCLUSIONS: This experience demonstrates that it is possible to co-construct recommendations, even for technically complex HTA subjects, through a more democratic process than usual which led to more patient-focused guidance.

Can reflective multicriteria be the new paradigm for healthcare decision-making? The EVIDEM journey.

BACKGROUND: Multiple technologies, procedures and programs call for fairly-based decisions for prioritization of healthcare interventions. There is a diversity of perspectives of what constitutes a legitimate decision, which depends on both the process and the reasoning applied. Current approaches focus on technical aspects while methods to support alignment of decisions with the compassionate impetus of healthcare systems is lacking. METHODS: The framework was developed based on an analysis of the foundations of healthcare systems, the reasoning underlying decisions and fair processes. The concept of reflective multicriteria was created: it assumes that decisionmakers guided by a generic interpretative frame rooted in the compassionate impetus of healthcare systems, can sharpen their reasoning, raise awareness of their motivation and increase legitimacy of decisions. The initial framework was made available through a not for profit organization (the EVIDEM Collaboration, 2006-2017) to stimulate its development with thought leaders and stakeholders in an open source philosophy. Development was tailored to the real-life needs of decisionmakers and drew on several domains of knowledge including healthcare ethics, evidenced-based medicine, health economics, health technology assessment and multicriteria approaches. RESULTS: The 10th edition framework builds on four dimensions: (1) the universal impetus of healthcare systems, (2) reasoning, values and ethics, (3) evidence and knowledge on interventions, and (4) a transformative process. Mathematical aspects of the framework are designed to help clarify, express and share individual reasoning; this non-conventional use of numbers requires a cultural change and needs to be phased in slowly. The framework includes four tools for easy adaptation and operationalization: (a) concepts and operationalization, (b) adapt and pilot, (c) evidence matrix, (d) mathematical representation of reasoning. Application is useful throughout all types of healthcare interventions, for all levels of decision, and across the globe. CONCLUSION: By clarifying their reasoning while keeping decisionmakers aware of the impetus of healthcare systems, reflective multicriteria provides an effective approach to increase the legitimacy of decisions. Beyond a tool, reflective multicriteria pioneered by EVIDEM is geared to transform our vision of the value of healthcare interventions and how they might contribute to relevant, equitable and sustainable healthcare systems.

Appraising the holistic value of Lenvatinib for radio-iodine refractory differentiated thyroid cancer: A multi-country study applying pragmatic MCDA.

BACKGROUND: The objective of the study was to reveal through pragmatic MCDA (EVIDEM) the contribution of a broad range of criteria to the value of the orphan drug lenvatinib for radioiodine refractory differentiated thyroid cancer (RR-DTC) in country-specific contexts. METHODS: The study was designed to enable comprehensive appraisal (12 quantitative, 7 qualitative criteria) in the current disease context (watchful waiting, sorafenib) of France, Italy and Spain. Data on the value of lenvatinib was collected from diverse stakeholders during country-specific panels and included: criteria weights (individual and social values); performance scores (judgments on evidence-collected through MCDA systematic review); qualitative impacts of contextual criteria; and verbal and written insights structured by criteria. The value contribution of each criterion was calculated and uncertainty explored. RESULTS: Comparative effectiveness, Quality of evidence (Spain and Italy) and Disease severity (France) received the greatest weights. Four criteria contributed most to the value of lenvatinib, reflecting its superior Comparative effectiveness (16-22% of value), the severity of RR-DTC (16-22%), significant unmet needs (14-21%) and robust evidence (14-20%). Contributions varied by comparator, country and individuals, highlighting the importance of context and consultation. Results were reproducible at the group level. Impacts of contextual criteria varied across countries reflecting different health systems and cultural backgrounds. The MCDA process promoted sharing stakeholders' knowledge on lenvatinib and insights on context. CONCLUSIONS: The value of lenvatinib was consistently positive across diverse therapeutic contexts. MCDA identified the aspects contributing most to value, revealed rich contextual insights, and helped participants express and explicitly tackle ethical trade-offs inherent to balanced appraisal and decisionmaking.

DRUG EVALUATION AND DECISION MAKING IN CATALONIA: DEVELOPMENT AND VALIDATION OF A METHODOLOGICAL FRAMEWORK BASED ON MULTI-CRITERIA DECISION ANALYSIS (MCDA) FOR ORPHAN DRUGS.

OBJECTIVES: The aim of this study was to adapt and assess the value of a Multi-Criteria Decision Analysis (MCDA) framework (EVIDEM) for the evaluation of Orphan drugs in Catalonia (Catalan Health Service). METHODS: The standard evaluation and decision-making procedures of CatSalut were compared with the EVIDEM methodology and contents. The EVIDEM framework was adapted to the Catalan context, focusing on the evaluation of Orphan drugs (PASFTAC program), during a Workshop with sixteen PASFTAC members. The criteria weighting was done using two different techniques (nonhierarchical and hierarchical). Reliability was assessed by re-test. RESULTS: The EVIDEM framework and methodology was found useful and feasible for Orphan drugs evaluation and decision making in Catalonia. All the criteria considered for the development of the CatSalut Technical Reports and decision making were considered in the framework. Nevertheless, the framework could improve the reporting of some of these criteria (i.e., "unmet needs" or "nonmedical costs"). Some Contextual criteria were removed (i.e., "Mandate and scope of healthcare system", "Environmental impact") or adapted ("population priorities and access") for CatSalut purposes. Independently of the weighting technique considered, the most important evaluation criteria identified for orphan drugs were: "disease severity", "unmet needs" and "comparative effectiveness", while the "size of the population" had the lowest relevance for decision making. Test-retest analysis showed weight consistency among techniques, supporting reliability overtime. CONCLUSIONS: MCDA (EVIDEM framework) could be a useful tool to complement the current evaluation methods of CatSalut, contributing to standardization and pragmatism, providing a method to tackle ethical dilemmas and facilitating discussions related to decision making.

EXPLORING VALUES OF HEALTH TECHNOLOGY ASSESSMENT AGENCIES USING REFLECTIVE MULTICRITERIA AND RARE DISEASE CASE.

OBJECTIVES: Tackling ethical dilemmas faced by reimbursement decision makers requires deeper understanding of values on which health technology assessment (HTA) agencies are founded and how trade-offs are made. This was explored in this study including the case of rare disease. METHODS: Representatives from eight HTA explored values on which institutions are founded using a narrative approach and reflective multicriteria (developed from EVIDEM, criteria derived from ethical imperatives of health care). Trade-offs between criteria and the impact of incorporating defined priorities (including for rare diseases) were explored through a quantitative values elicitation exercise. RESULTS: Participants reported a diversity of substantive and procedural values with a common emphasis on scientific excellence, stakeholder involvement, independence, and transparency. Examining the ethical imperatives behind EVIDEM criteria was found to be useful to further explore substantive values. Most criteria were deemed to reflect institutions' values, while 70 percent of the criteria were reported by at least half of participants to be considered formally by their institutions. The quantitative values elicitation highlighted the difficulty to balance imperatives of "alleviating or preventing patient suffering," "serving the whole population equitably," "upholding healthcare system sustainability," and "making decisions informed by evidence and context" but may help share the ethical reasoning behind decisions. Incorporating "Priorities" (including for rare diseases) helped reveal trade-offs from other criteria and their underlying ethical imperatives. CONCLUSIONS: Reflective multicriteria are useful to explore substantive values of HTAs, reflect how these values and their ethical underpinnings can be operationalized into criteria, and explore the ethical reasoning at the heart of the healthcare debate.

TESTING MULTI-CRITERIA DECISION ANALYSIS FOR MORE TRANSPARENT RESOURCE-ALLOCATION DECISION MAKING IN COLOMBIA.

OBJECTIVES: In 2012, Colombia experienced an important institutional transformation after the establishment of the Health Technology Assessment Institute (IETS), the disbandment of the Regulatory Commission for Health and the reassignment of reimbursement decision-making powers to the Ministry of Health and Social Protection (MoHSP). These dynamic changes provided the opportunity to test Multi-Criteria Decision Analysis (MCDA) for systematic and more transparent resource-allocation decision-making. METHODS: During 2012 and 2013, the MCDA framework Evidence and Value: Impact on Decision Making (EVIDEM) was tested in Colombia. This consisted of a preparatory stage in which the investigators conducted literature searches and produced HTA reports for four interventions of interest, followed by a panel session with decision makers. This method was contrasted with a current approach used in Colombia for updating the publicly financed benefits package (POS), where narrative health technology assessment (HTA) reports are presented alongside comprehensive budget impact analyses (BIAs). RESULTS: Disease severity, size of population, and efficacy ranked at the top among fifteen preselected relevant criteria. MCDA estimates of technologies of interest ranged between 71 to 90 percent of maximum value. The ranking of technologies was sensitive to the methods used. Participants considered that a two-step approach including an MCDA template, complemented by a detailed BIA would be the best approach to assist decision-making in this context. Participants agreed that systematic priority setting should take place in Colombia. CONCLUSIONS: This work may serve as the basis to the MoHSP on its interest of setting up a systematic and more transparent process for resource-allocation decision-making.

Balancing costs and benefits at different stages of medical innovation: a systematic review of Multi-criteria decision analysis (MCDA).

BACKGROUND: The diffusion of health technologies from translational research to reimbursement depends on several factors included the results of health economic analysis. Recent research identified several flaws in health economic concepts. Additionally, the heterogeneous viewpoints of participating stakeholders are rarely systematically addressed in current decision-making. Multi-criteria Decision Analysis (MCDA) provides an opportunity to tackle these issues. The objective of this study was to review applications of MCDA methods in decisions addressing the trade-off between costs and benefits. METHODS: Using basic steps of the PRISMA guidelines, a systematic review of the healthcare literature was performed to identify original research articles from January 1990 to April 2014. Medline, PubMed, Springer Link and specific journals were searched. Using predefined categories, bibliographic records were systematically extracted regarding the type of policy applications, MCDA methodology, criteria used and their definitions. RESULTS: 22 studies were included in the analysis. 15 studies (68 %) used direct MCDA approaches and seven studies (32 %) used preference elicitation approaches. Four studies (19 %) focused on technologies in the early innovation process. The majority (18 studies - 81 %) examined reimbursement decisions. Decision criteria used in studies were obtained from the literature research and context-specific studies, expert opinions, and group discussions. The number of criteria ranged between three up to 15. The most frequently used criteria were health outcomes (73 %), disease impact (59 %), and implementation of the intervention (40 %). Economic criteria included cost-effectiveness criteria (14 studies, 64 %), and total costs/budget impact of an intervention (eight studies, 36 %). The process of including economic aspects is very different among studies. Some studies directly compare costs with other criteria while some include economic consideration in a second step. CONCLUSIONS: In early innovation processes, MCDA can provide information about stakeholder preferences as well as evidence needs in further development. However, only a minority of these studies include economic features due to the limited evidence. The most important economic criterion cost-effectiveness should not be included from a technical perspective as it is already a composite of costs and benefit. There is a significant lack of consensus in methodology employed by the various studies which highlights the need for guidance on application of MCDA at specific phases of an innovation.

Exploring the perspectives and preferences for HTA across German healthcare stakeholders using a multi-criteria assessment of a pulmonary heart sensor as a case study.

BACKGROUND: Health technology assessment and healthcare decision-making are based on multiple criteria and evidence, and heterogeneous opinions of participating stakeholders. Multi-criteria decision analysis (MCDA) offers a potential framework to systematize this process and take different perspectives into account. The objectives of this study were to explore perspectives and preferences across German stakeholders when appraising healthcare interventions, using multi-criteria assessment of a heart pulmonary sensor as a case study. METHODS: An online survey of 100 German healthcare stakeholders was conducted using a comprehensive MCDA framework (EVIDEM V2.2). Participants were asked to provide i) relative weights for each criterion of the framework; ii) performance scores for a health pulmonary sensor, based on available data synthesized for each criterion; and iii) qualitative feedback on the consideration of contextual criteria. Normalized weights and scores were combined using a linear model to calculate a value estimate across different stakeholders. Differences across types of stakeholders were explored. RESULTS: The survey was completed by 54 participants. The most important criteria were efficacy, patient reported outcomes, disease severity, safety, and quality of evidence (relative weight >0.075 each). Compared to all participants, policymakers gave more weight to budget impact and quality of evidence. The quantitative appraisal of a pulmonary heart sensor revealed differences in scoring performance of this intervention at the criteria level between stakeholder groups. The highest value estimate of the sensor reached 0.68 (on a scale of 0 to 1, 1 representing maximum value) for industry representatives and the lowest value of 0.40 was reported for policymakers, compared to 0.48 for all participants. Participants indicated that most qualitative criteria should be considered and their impact on the quantitative appraisal was captured transparently. CONCLUSIONS: The study identified important variations in perspectives across German stakeholders when appraising a healthcare intervention and revealed that MCDA can demonstrate the value of a specified technology for all participating stakeholders. Better understanding of these differences at the criteria level, in particular between policymakers and industry representatives, is important to focus innovation aligned with patient health and healthcare system values and constraints.

Does technique matter; a pilot study exploring weighting techniques for a multi-criteria decision support framework.

BACKGROUND: There is an increased interest in the use of multi-criteria decision analysis (MCDA) to support regulatory and reimbursement decision making. The EVIDEM framework was developed to provide pragmatic multi-criteria decision support in health care, to estimate the value of healthcare interventions, and to aid in priority-setting. The objectives of this study were to test 1) the influence of different weighting techniques on the overall outcome of an MCDA exercise, 2) the discriminative power in weighting different criteria of such techniques, and 3) whether different techniques result in similar weights in weighting the criteria set proposed by the EVIDEM framework. METHODS: A sample of 60 Dutch and Canadian students participated in the study. Each student used an online survey to provide weights for 14 criteria with two different techniques: a five-point rating scale and one of the following techniques selected randomly: ranking, point allocation, pairwise comparison and best worst scaling. RESULTS: The results of this study indicate that there is no effect of differences in weights on value estimates at the group level. On an individual level, considerable differences in criteria weights and rank order occur as a result of the weight elicitation method used, and the ability of different techniques to discriminate in criteria importance. Of the five techniques tested, the pair-wise comparison of criteria has the highest ability to discriminate in weights when fourteen criteria are compared. CONCLUSIONS: When weights are intended to support group decisions, the choice of elicitation technique has negligible impact on criteria weights and the overall value of an innovation. However, when weights are used to support individual decisions, the choice of elicitation technique influences outcome and studies that use dissimilar techniques cannot be easily compared. Weight elicitation through pairwise comparison of criteria is preferred when taking into account its superior ability to discriminate between criteria and respondents' preferences.

Clinical and economic consequences of vancomycin and fidaxomicin for the treatment of Clostridium difficile infection in Canada.

BACKGROUND: Clostridium difficile infection (CDI) represents a public health problem with increasing incidence and severity. OBJECTIVE: To evaluate the clinical and economic consequences of vancomycin compared with fidaxomicin in the treatment of CDI from the Canadian health care system perspective. METHODS: A decision-tree model was developed to compare vancomycin and fidaxomicin for the treatment of severe CDI. The model assumed identical initial cure rates and included first recurrent episodes of CDI (base case). Treatment of patients presenting with recurrent CDI was examined as an alternative analysis. Costs included were for study medication, physician services and hospitalization. Cost effectiveness was measured as incremental cost per recurrence avoided. Sensitivity analyses of key input parameters were performed. RESULTS: In a cohort of 1000 patients with an initial episode of severe CDI, treatment with fidaxomicin led to 137 fewer recurrences at an incremental cost of $1.81 million, resulting in an incremental cost of $13,202 per recurrence avoided. Among 1000 patients with recurrent CDI, 113 second recurrences were avoided at an incremental cost of $18,190 per second recurrence avoided. Incremental costs per recurrence avoided increased with increasing proportion of cases caused by the NAP1/B1/027 strain. Results were sensitive to variations in recurrence rates and treatment duration but were robust to variations in other parameters. CONCLUSIONS: The use of fidaxomicin is associated with a cost increase for the Canadian health care system. Clinical benefits of fidaxomicin compared with vancomycin depend on the proportion of cases caused by the NAP1/B1/027 strain in patients with severe CDI.

HISTORIQUE: L'infection à Clostridium difficile (ICD) est un problème de santé publique à l'incidence et à la gravité croissantes. OBJECTIF: Évaluer les conséquences cliniques et économiques de la vancomycine par rapport à la fidaxomicine pour traiter l'ICD dans le système de santé canadien. MÉTHODOLOGIE: Les chercheurs ont élaboré un modèle d'arbre décisionnel pour comparer la vancomycine et la fidaxomicine dans le traitement des graves ICD. Selon ce modèle, le taux de guérison initial était identique et incluait les premiers épisodes récurrents d'ICD (cas de référence). L'autre méthode d'analyse examinée était le traitement des patients atteints d'ICD. Les coûts inclus étaient ceux du médicament à l'étude, des services des médecins et de l'hospitalisation. Les chercheurs ont mesuré l'efficacité des coûts sous forme de coût incrémentiel par récurrence évitée. Ils ont effectué les analyses de sensibilité des principaux paramètres d'entrée. RÉSULTATS: Dans une cohorte de 1 000 patients ayant eu un épisode initial de grave ICD, le traitement à la fidaxomicine suscitait 137 récurrences de moins à un coût incrémentiel de 1,81 million de dollars, pour un coût incrémentiel de 13 202 $ par récurrence évitée. Chez 1 000 patients ayant eu une ICD récurrente, 113 deuxièmes récurrences ont été évitées, à un coût incrémentiel de 18 190 $ par deuxième récurrence évitée. Les coûts incrémentiels par récurrence évitée grimpaient proportionnellement à l'augmentation de la proportion des cas causés par la souche NAP1/B1/027. Les résultats étaient sensibles aux variations des taux de récurrence et de la durée de traitement, mais robustes aux variations des autres paramètres. CONCLUSIONS: L'utilisation de fidaxomicine s'associe à une augmentation des coûts dans le système de santé canadien. Les avantages cliniques de la fidaxomicine par rapport à la vancomycine dépendent de la proportion de cas causés par la souche NAP1/B1/027 chez les patients atteints d'une grave ICD.

Which criteria are considered in healthcare decisions? Insights from an international survey of policy and clinical decision makers.

OBJECTIVES: The aim of this study was to gather qualitative and quantitative data on criteria considered by healthcare decision makers. METHODS: Using snowball sampling and an online questionnaire with forty-three criteria organized into ten clusters, decision makers were invited by an international task force to report which criteria they consider when making decisions on healthcare interventions in their context. Respondents reported whether each criterion is "currently considered," "should be considered," and its relative weight (scale 0-5). Differences in proportions of respondents were explored with inferential statistics across levels of decision (micro, meso, macro), decision maker perspectives, and world regions. RESULTS: A total of 140 decision makers (1/3 clinical, 2/3 policy) from 23 countries in five continents completed the survey. The most relevant criteria (top ranked for "Currently considered," "Should be considered," and weights) were Clinical efficacy/effectiveness, Safety, Quality of evidence, Disease severity, and Impact on healthcare costs. Organizational and skill requirements were frequently considered but had relatively low weights. For almost all criteria, a higher proportion of decision makers reported that they "Should be considered" than that they are "Currently considered" (p < .05). For more than 74 percent of criteria, there were no statistical differences in proportions across levels of decision, perspectives and world regions. Statistically significant differences across several comparisons were found for: Population priorities, Stakeholder pressure/interests, Capacity to stimulate research, Impact on partnership and collaboration, and Environmental impact. CONCLUSIONS: Results suggest convergence among decision makers on the relevance of a core set of criteria and on the need to consider a wider range of criteria. Areas of divergence appear to be principally related to contextual factors.

HTA challenges for appraising rare disease interventions viewed through the lens of an institutional multidimensional value framework.

INTRODUCTION: Evaluating rare disease interventions poses challenges for HTA agencies, including uncertainties and ethical issues and tensions. INESSS has recently adopted a Statement of Principles and Ethical Foundations which proposes a multidimensional approach to value appraisal as well as five principles to frame the evaluation process. AREAS COVERED: Our aim was to identify and analyze HTA challenges for appraising interventions for rare diseases, using the Statement's approach to value appraisal as an analytical framework, and outline how the Statement's principles can help address these challenges. Challenges, covering a diversity of aspects, were identified by leveraging institutional experience in diverse domains of expertise and consolidated through narrative literature review. Challenges were categorized by value dimension (clinical, populational, economic, organizational, and sociocultural), which allowed to pinpoint how each challenge affects the ability to appraise the value of an intervention. Key ethical tensions across dimensions were also identified. Specific approaches to addressing these challenges - related to knowledge mobilization and integration, deliberation, and recommendation-making - were outlined on the basis of the principles promulgated in the Statement. EXPERT OPINION: A multidimensional approach can be fruitful for analyzing challenges for appraising the value of rare disease interventions and help guide approaches to tackle them.

Burden of community-acquired and nosocomial rotavirus gastroenteritis in the pediatric population of Western Europe: a scoping review.

BACKGROUND: Rotavirus affects 95% of children worldwide by age 5 years and is the leading cause of severe dehydrating diarrhea. The objective of this review was to estimate the burden of rotavirus gastroenteritis (RVGE) in the Western European pediatric population. METHODS: A comprehensive literature search (1999-2010) was conducted in PubMed and other sources (CDC; WHO, others). Data on the epidemiology and burden of RVGE among children < 5 years-old in Western Europe --including hospital-acquired disease--were extracted. RESULTS: 76 studies from 16 countries were identified. The mean percentage of acute gastroenteritis (AGE) cases caused by rotavirus ranged from 25.3%-63.5% in children < 5 years of age, peaking during winter. Incidence rates of RVGE ranged from 1.33-4.96 cases/100 person- years. Hospitalization rates for RVGE ranged from 7% to 81% among infected children, depending on the country. Nosocomial RVGE accounted for 47%-69% of all hospital-acquired AGE and prolonged hospital stays by 4-12 days. Each year, RVGE incurred $0.54- $53.6 million in direct medical costs and $1.7-$22.4 million in indirect costs in the 16 countries studied. Full serotyping data was available for 8 countries. G1P[8], G2P[4], G9P[8], and G3P[8] were the most prevalent serotypes (cumulative frequency: 57.2%- 98.7%). Serotype distribution in nosocomial RVGE was similar. CONCLUSIONS: This review confirms that RVGE is a common disease associated with significant morbidity and costs across Western Europe. A vaccine protecting against multiple serotypes may decrease the epidemiological and cost burden of RVGE in Western Europe.

Field testing of a multicriteria decision analysis (MCDA) framework for coverage of a screening test for cervical cancer in South Africa.

BACKGROUND: Systematic and transparent approaches to priority setting are needed, particularly in low-resource settings, to produce decisions that are sound and acceptable to stakeholders. The EVIDEM framework brings together Health Technology Assessment (HTA) and multi-criteria decision analysis (MCDA) by proposing a comprehensive set of decision criteria together with standardized processes to support decisionmaking. The objective of the study was to field test the framework for decisionmaking on a screening test by a private health plan in South Africa. METHODS: Liquid-based cytology (LBC) for cervical cancer screening was selected by the health plan for this field test. An HTA report structured by decision criterion (14 criteria organized in the MCDA matrix and 4 contextual criteria) was produced based on a literature review and input from the health plan. During workshop sessions, committee members 1) weighted each MCDA decision criterion to express their individual perspectives, and 2) to appraise LBC, assigned scores to each MCDA criterion on the basis of the by-criterion HTA report.Committee members then considered the potential impacts of four contextual criteria on the use of LBC in the context of their health plan. Feedback on the framework and process was collected through discussion and from a questionnaire. RESULTS: For 9 of the MCDA matrix decision criteria, 89% or more of committee members thought they should always be considered in decisionmaking. Greatest weights were given to the criteria "Budget impact", "Cost-effectiveness" and "Completeness and consistency of reporting evidence". When appraising LBC for cervical cancer screening, the committee assigned the highest scores to "Relevance and validity of evidence" and "Disease severity". Combination of weights and scores yielded a mean MCDA value estimate of 46% (SD 7%) of the potential maximum value. Overall, the committee felt the framework brought greater clarity to the decisionmaking process and was easily adaptable to different types of health interventions. CONCLUSIONS: The EVIDEM framework was easily adapted to evaluating a screening technology in South Africa, thereby broadening its applicability in healthcare decision making.

From efficacy to equity: Literature review of decision criteria for resource allocation and healthcare decisionmaking.

OBJECTIVES: Resource allocation is a challenging issue faced by health policy decisionmakers requiring careful consideration of many factors. Objectives of this study were to identify decision criteria and their frequency reported in the literature on healthcare decisionmaking. METHOD: An extensive literature search was performed in Medline and EMBASE to identify articles reporting healthcare decision criteria. Studies conducted with decisionmakers (e.g., focus groups, surveys, interviews), conceptual and review articles and articles describing multicriteria tools were included. Criteria were extracted, organized using a classification system derived from the EVIDEM framework and applying multicriteria decision analysis (MCDA) principles, and the frequency of their occurrence was measured. RESULTS: Out of 3146 records identified, 2790 were excluded. Out of 356 articles assessed for eligibility, 40 studies included. Criteria were identified from studies performed in several regions of the world involving decisionmakers at micro, meso and macro levels of decision and from studies reporting on multicriteria tools. Large variations in terminology used to define criteria were observed and 360 different terms were identified. These were assigned to 58 criteria which were classified in 9 different categories including: health outcomes; types of benefit; disease impact; therapeutic context; economic impact; quality of evidence; implementation complexity; priority, fairness and ethics; and overall context. The most frequently mentioned criteria were: equity/fairness (32 times), efficacy/effectiveness (29), stakeholder interests and pressures (28), cost-effectiveness (23), strength of evidence (20), safety (19), mission and mandate of health system (19), organizational requirements and capacity (17), patient-reported outcomes (17) and need (16). CONCLUSION: This study highlights the importance of considering both normative and feasibility criteria for fair allocation of resources and optimized decisionmaking for coverage and use of healthcare interventions. This analysis provides a foundation to develop a questionnaire for an international survey of decisionmakers on criteria and their relative importance. The ultimate objective is to develop sound multicriteria approaches to enlighten healthcare decisionmaking and priority-setting.

Methodological guidance for incorporating equity when informing rapid-policy and guideline development.

OBJECTIVES: We provide guidance for considering equity in rapid reviews through examples of published COVID-19 rapid reviews. STUDY DESIGN AND SETTING: This guidance was developed based on a series of methodological meetings, review of internationally renowned guidance such as the Cochrane Handbook and the Preferred Reporting Items for Systematic Reviews and Meta-Analysis for equity-focused systematic reviews (PRISMA-Equity) guideline. We identified Exemplar rapid reviews by searching COVID-19 databases and requesting examples from our team. RESULTS: We proposed the following key steps: 1. involve relevant stakeholders with lived experience in the conduct and design of the review; 2. reflect on equity, inclusion and privilege in team values and composition; 3. develop research question to assess health inequities; 4. conduct searches in relevant disciplinary databases; 5. collect data and critically appraise recruitment, retention and attrition for populations experiencing inequities; 6. analyse evidence on equity; 7. evaluate the applicability of findings to populations experiencing inequities; and 8. adhere to reporting guidelines for communicating review findings. We illustrated these methods through rapid review examples. CONCLUSION: Implementing this guidance could contribute to improving equity considerations in rapid reviews produced in public health emergencies, and help policymakers better understand the distributional impact of diseases on the population.

Burden of rotavirus gastroenteritis in the Middle Eastern and North African pediatric population.

BACKGROUND: Rotavirus gastroenteritis (RVGE) is the most common cause of severe childhood diarrhea worldwide. Objectives were to estimate the burden of RVGE among children less than five years old in the Middle East (Bahrain, Iran, Iraq, Israel, Jordan, Kuwait, Oman, Qatar, Saudi Arabia, Syria, UAE, Yemen), North Africa (Algeria, Egypt, Libya, Morocco, Tunisia) and Turkey. METHODS: A comprehensive literature search was conducted in major databases on the epidemiology and burden of rotavirus among children less than five years old between 1999 and 2009. Data from each country was extracted and compared. RESULTS: The search identified 43 studies. RVGE was identified in 16-61% of all cases of acute gastroenteritis, with a peak in the winter. RVGE-related hospitalization rates ranged from 14% to 45%, compared to 14%-28% for non-RVGE. Annually, RVGE caused up to 112 fatalities per 100,000 in certain countries in the region. Hospitalization costs ranged from $1.8 to $4.6 million annually, depending on the country. The most recent literature available showed that G1P[8] was the most prevalent genotype combination in 8 countries (range 23%-56%). G2P[4] was most prevalent in 4 countries (26%-48%). G9P[8] and G4P[8] were also frequently detected. CONCLUSIONS: RVGE is a common disease associated with significant morbidity, mortality, and economic burden. Given the variety and diverse rotavirus types in the region, use of a vaccine with broad and consistent serotype coverage would be important to help decrease the burden of RVGE in the Middle East and North Africa.

Burden of rotavirus gastroenteritis in the pediatric population in Central and Eastern Europe: serotype distribution and burden of illness.

BACKGROUND: Rotaviral gastroenteritis (RVGE) is the leading cause of severe diarrhea in children under five years of age worldwide. This comprehensive review aims to estimate the burden of RVGE among children in Central and Eastern Europe. METHODS: An extensive search of the biomedical literature (1999-2009) was conducted in major databases. Studies pertaining to the epidemiology and burden of rotavirus in Central and Eastern Europe were captured and data from each country was systematically extracted and compared. RESULTS: This literature search captured 38 studies pertaining to RVGE infection in the region. Among children under 15 years of age, RVGE accounted for between 22.0% and 55.3% of all cases of acute gastroenteritis per year. For most countries RVGE was most common in the winter months, although it was reported year round in Bulgaria. Geographical comparison of genotyping data revealed that three genotype combinations, G1P[8], G4P[8], and G2P[4] were present in all countries for which full genotyping data was available. Genotype predominance varied on a season to season basis within each country. Only limited data was available for healthcare resource utilization, and economic burden for this region. CONCLUSIONS: RVGE is a common disease associated with significant morbidity, and mortality. While three genotype combinations currently predominate in the region, the dominance of a certain serotype can change dramatically from year to year and from country to country. A vaccination program with broad serotype coverage may help to decrease the burden of RVGE in Central and Eastern Europe.

Bridging health technology assessment (HTA) with multicriteria decision analyses (MCDA): field testing of the EVIDEM framework for coverage decisions by a public payer in Canada.

BACKGROUND: Consistent healthcare decision making requires systematic consideration of decision criteria and evidence available to inform them. This can be tackled by combining multicriteria decision analysis (MCDA) and Health Technology Assessment (HTA). The objective of this study was to field-test a decision support framework (EVIDEM), explore its utility to a drug advisory committee and test its reliability over time. METHODS: Tramadol for chronic non-cancer pain was selected by the health plan as a case study relevant to their context. Based on extensive literature review, a by-criterion HTA report was developed to provide synthesized evidence for each criterion of the framework (14 criteria for the MCDA Core Model and 6 qualitative criteria for the Contextual Tool). During workshop sessions, committee members tested the framework in three steps by assigning: 1) weights to each criterion of the MCDA Core Model representing individual perspective; 2) scores for tramadol for each criterion of the MCDA Core Model using synthesized data; and 3) qualitative impacts of criteria of the Contextual Tool on the appraisal. Utility and reliability of the approach were explored through discussion, survey and test-retest. Agreement between test and retest data was analyzed by calculating intra-rater correlation coefficients (ICCs) for weights, scores and MCDA value estimates. RESULTS: The framework was found useful by the drug advisory committee in supporting systematic consideration of a broad range of criteria to promote a consistent approach to appraising healthcare interventions. Directly integrated in the framework as a "by-criterion" HTA report, synthesized evidence for each criterion facilitated its consideration, although this was sometimes limited by lack of relevant data. Test-retest analysis showed fair to good consistency of weights, scores and MCDA value estimates at the individual level (ICC ranging from 0.676 to 0.698), thus lending some support for the reliability of the approach. Overall, committee members endorsed the inclusion of most framework criteria and revealed important areas of discussion, clarification and adaptation of the framework to the needs of the committee. CONCLUSIONS: By promoting systematic consideration of all decision criteria and the underlying evidence, the framework allows a consistent approach to appraising healthcare interventions. Further testing and validation are needed to advance MCDA approaches in healthcare decisionmaking.