Systematic Review of Outcomes for Assessment of Medication Adherence Enhancing Interventions: An ISPOR Special Interest Group Report.

OBJECTIVES: The lack of universal guidance on outcome measures for evaluating medication adherence enhancing interventions (MAEIs) poses a challenge for assessing their effectiveness. This literature review aimed to provide a systematic overview of outcome measures currently used for the value assessment of MAEIs. METHODS: We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and searched MEDLINE, PsycINFO, Scopus, CINAHL, and Academic Search Complete for randomized and nonrandomized clinical trials, prospective cohort studies, model-based economic evaluations, and value frameworks published in English between January 2010 and September 2020. Two independent reviewers screened all titles and abstracts, followed by a full-text review. Due to the large number of relevant studies, data extraction was limited to articles published between January 2018 and September 2020. We collected data on the general characteristics of the study, the type of intervention, and the outcomes measured. RESULTS: We screened 14 685 records and identified 308 articles for data extraction. Behavioral interventions were the most common (n = 143), followed by educational interventions (n = 110) and mixed-method interventions (n = 73). Outcomes were clustered into 7 categories with medication adherence (n = 286) being the most frequently measured, followed by clinical outcomes (n = 155), health-related quality of life (n = 57), resource use (n = 43), patient satisfaction (n = 31), economic outcomes (n = 18), and other outcomes (n = 76). CONCLUSIONS: Various outcomes measures have been used to evaluate MAEIs, with only a small number of studies exploring economic and patient-reported outcomes. Future research is warranted to develop a consensus-based set of criteria for assessing MAEIs to facilitate the comparison of interventions and enable informed decision making.

Commentary: Advocating for patient and public involvement and engagement in health economic evaluation.

BACKGROUND: Patient and public involvement in health economic evaluation is still relatively rare, compared to other areas of health and social care research. Developing stronger patient and public involvement in health economic evaluation will be important in the future because such evaluations can impact on the treatments and interventions that patients can access in routine care. MAIN TEXT: The Consolidated Health Economic Evaluation Reporting Standards (CHEERS) is a reporting guideline for authors publishing health economic evaluations. We established an international group of public contributors who were involved in the update of the CHEERS 2022 reporting guidance, ensuring two items (areas of reporting) specifically about public involvement were included. In this commentary we focus on the development of a guide to support public involvement in reporting, a key suggestion made by the CHEERS 2022 Public Reference Group, who advocated for greater public involvement in health economic evaluation. This need for this guide was identified during the development of CHEERS 2022 when it became apparent that the language of health economic evaluation is complex and not always accessible, creating challenges for meaningful public involvement in key deliberation and discussion. We took the first step to more meaningful dialogue by creating a guide that patient organisations could use to support their members to become more involved in discussions about health economic evaluations. CONCLUSIONS: CHEERS 2022 provides a new direction for health economic evaluation, encouraging researchers to undertake and report their public involvement to build the evidence base for practice and may provide some reassurance to the public that their voice has played a part in evidence development. The CHEERS 2022 guide for patient representatives and patient organisations aims to support that endeavour by enabling deliberative discussions among patient organisations and their members. We recognise it is only a first step and further discussion is needed about the best ways to involve public contributors in health economic evaluation.

BACKGROUND: Patient and public involvement in health economic evaluation is still relatively rare, compared to other areas of health and social care research. Developing stronger patient and public involvement in health economic evaluation will be important in the future because such evaluations can impact on the treatments and interventions that patients can access in routine care. MAIN TEXT: We established an international group of public contributors who were involved in the development of the CHEERS 2022 reporting guidance, ensuring two items (areas of reporting) specifically about patient and public involvement were included. In this commentary we focus on the development of a guide to support patient and public involvement in reporting, a key suggestion made by the CHEERS 2022 Public Reference Group, who advocated for greater public involvement in health economic evaluation. The need for this guide was identified during the development of CHEERS 2022 when it became apparent that the language of health economic evaluation is complex and not always accessible, creating challenges for meaningful public involvement in key deliberation and discussion. We took the first step to more meaningful dialogue by creating a guide that patient representatives and patient organisations could use as support to become more involved in discussions about health economic evaluations. CONCLUSIONS: CHEERS 2022 provides a new direction for health economic evaluation, encouraging researchers to undertake and report their public involvement in order to build the evidence base for practice. The CHEERS 2022 guide aims to support patient representatives and patient organisations to become more involved in discussions about health economic evaluations. We recognise it is only a first step and further discussion is needed about the best ways to involve public contributors in health economic evaluation.

Recommendations for patient involvement in health technology assessment in Central and Eastern European countries.

Introduction: Meaningful patient involvement in health technology assessment (HTA) is essential in ensuring that the interests of the affected patient population, their families, and the general public are accurately reflected in coverage and reimbursement decisions. Central and Eastern European (CEE) countries are generally at less advanced stages of implementing HTA, which is particularly true for patient involvement activities. As part of the Horizon2020 HTx project, this research aimed to form recommendations for critical barriers to patient involvement in HTA in CEE countries. Methods: Built on previous research findings on potential barriers, a prioritisation survey was conducted online with CEE stakeholders. Recommendations for prioritised barriers were formed through a face-to-face workshop by CEE stakeholders and HTx experts. Results: A total of 105 stakeholders from 13 CEE countries completed the prioritisation survey and identified 12 of the 22 potential barriers as highly important. The workshop had 36 participants representing 9 CEE countries, and 5 Western European countries coming together to discuss solutions in order to form recommendations based on best practices, real-life experience, and transferability aspects. Stakeholder groups involved in both phases included HTA organisation representatives, payers, patients, caregivers, patient organisation representatives, patient experts, health care providers, academic and non-academic researchers, health care consultants and health technology manufacturers/providers. As a result, 12 recommendations were formed specified to the CEE region's context, but potentially useful for a broader geographic audience. Conclusion: In this paper, we present 12 recommendations for meaningful, systematic, and sustainable patient involvement in HTA in CEE countries. Our hope is that engaging more than a hundred CEE stakeholders in the study helped to spread awareness of the importance and potential of patient involvement and that the resulting recommendations provide tangible steps for the way forward. Future studies shall focus on country-specific case studies of the implemented recommendations.

Framework for Patient Experience Value Elements in Rare Disease: A Case Study Demonstrating the Applicability of Combined Qualitative and Quantitative Methods.

BACKGROUND AND OBJECTIVE: Several novel methods have been suggested to extend a conventional value assessment to capture a more comprehensive perspective of value from a patient perspective. The objective of this research was to demonstrate a framework for implementing a combined qualitative and quantitative method to elicit and prioritize patient experience value elements in rare diseases. Neuromyelitis optica spectrum disorder was used as a case study. METHODS: The method for eliciting and prioritizing patient experience value elements involved a three-step process: (1) collecting potential patient experience value elements from existing literature sources followed by deliberation by a multi-stakeholder research team; (2) a pre-workshop webinar and survey to identify additional patient-reported value elements; and (3) a workshop to discuss, prioritize the value elements using a swing weighting method. Outcomes were prioritized value elements with normalized weights for patients considering a treatment for neuromyelitis optica spectrum disorder. RESULTS: A literature review and deliberation resulted in the following initial value elements: ability to reach important personal milestones, patient's financial burden, value of hope/balance or timing of risks and benefits, Uncertainty about long-term benefits and safety of the treatment, Patient empowerment through therapeutic advancement and technology, Caregiver/family's financial burden, patient experience related to treatment regimen, Therapeutic options, and Caregiver/family's quality of life. Eight patients with neuromyelitis optica spectrum disorder participated in the case study. In the online survey, participants found the nine proposed patient experience value elements both understandable and important with no additions. During the workshop, 'Uncertainty about long-term benefits and safety,' 'Patient experience related to treatment regimen,' and 'Patient's financial burden' were found to be the most important patient experience value elements, with a respective weight of 25%, 19.2%, and 14.4% (out of total 100%). CONCLUSIONS: This case study provides a framework for eliciting and prioritizing patient experience value elements using direct patient input. Although elements/weights may differ by disease, and even in neuromyelitis optica spectrum disorder, additional research is needed, value frameworks, researchers, and manufacturers can use this practical method to generate patient experience value elements and evaluate their impact on treatment selection.

Patient and Caregiver Experience Decision Factors in Treatment Decision Making: Results of a Systematic Literature Review of Multiple Myeloma Decision Aids.

OBJECTIVES: Decision-aids (DAs) may facilitate shared decision-making for patients and caregivers, by providing evidence-based information to assist healthcare professionals, patients, and caregivers in making choices about aspects of care, and/or highlighting decision factors to discuss with the potential of altering the treatment decision. These decision factors may not be well integrated in DAs. METHODS: A systematic literature review was conducted in the field of multiple myeloma (MM) on peer-reviewed publications, extended with a gray literature search. Data on whether and how patient and caregiver experience elements, other than survival and physical quality of life, were mentioned as decision factors in the identified MM DAs were extracted and analyzed qualitatively. RESULTS: Seventy MM DAs were found and analyzed; 51% of DAs mentioned any patient non-routinely assessed experience decision factors and only 17% mentioned any caregiver-related information. One hundred and forty potential decision factors were extracted, deduplicated and categorized into the following categories: 1) financial, 2) mode of administration / transportation issues, 3) personal beliefs and values, 4) emotional and social quality of life, 5) other medical information, 6) availability of social support, 7) caregiver burden. None of the DAs presented a comprehensive framework on all seven categories of decision factors being consider when mapping patient and caregiver experience value elements in MM. CONCLUSIONS: Based on available DAs, we recommend a set of patient and caregiver experience decision factors that have the potential to affect treatment choices of patients with MM, which should be included in DAs, including MM clinical guidelines.

Potential Barriers of Patient Involvement in Health Technology Assessment in Central and Eastern European Countries.

Patients' perspectives are important to identify preferences, estimate values and appreciate unmet medical needs in the process of research and development and subsequent assessment of new health technologies. Patient and public involvement in health technology assessment (HTA) is essential in understanding and assessing wider implications of coverage and reimbursement decisions for patients, their relatives, caregivers, and the general population. There are two approaches to incorporating the patients' voice in HTA, preferably used in a mix. In the first one, patients, caregivers and/or their representatives directly participate at discussions in different stages of the HTA process, often at the same table with other stakeholders. Secondly, patient involvement activities can be supported by evidence on patient value and experience collected directly from patients, caregivers and/or their representatives often by patient groups Patient involvement practices, however, are limited in Central and Eastern European (CEE) countries without clear methodology or regulatory mechanisms to guide patient involvement in the HTA process. This poses the question of transferability of practices used in other countries, and might call for the development of new CEE-specific guidelines and methods. In this study we aim to map potential barriers of patient involvement in HTA in countries of the CEE region.

Patient and Payer Preferences for Additional Value Criteria.

Background: Defining the value of healthcare is an elusive target, and depends heavily on the decision context and stakeholders involved. Cost-utility analysis and the quality-adjusted life year (QALY) have become the method and value definition of choice for traditional value judgements in coverage and pricing decisions. Other criteria that may influence value are often not measured and therefore omitted from value assessments, or are only used to qualitatively contextualize assessments. The objective of this study was to engage two key stakeholders; patients and payers to elicit and rank the importance of additional value criteria, potentially assessed in Multiple Criteria Decision Analysis (MCDA). Methods: This study consisted of a focus group with cancer patients (n = 7), including follow-up questions through an electronic survey, and in-depth phone interviews with payers (n = 5). Results: For payers, value equated either with criteria that provided tangible benefits (from their perspective) such as new treatment options that respond to serious unmet need. For patients, population-level value equated to options that would potentially benefit them in the future and the value of hope. However, these criteria were seen by payers as difficult to measure and incorporate into objective decision making. Limitations: The findings from this study are primarily limited due to generalizability. Due to the small sample size, it was outside the scope of this study to calculate a weight for each criterion that could be used as part of a quantitative MCDA. Conclusion: MCDA, with particular attention to qualitative aspects, is an avenue to incorporate these additional criteria into value assessments, as well as provide an opportunity for reflecting the patient's preferences in assessing the value of a treatment.

Proposal for capturing patient experience through extended value frameworks of health technologies.

BACKGROUND: Inclusion of patient experience (PEx) in health technology assessment (HTA) has become increasingly important; however, no harmonized approach exists to help manufacturers or decision makers ensure PEx considerations are fair, consistent, and thorough within global HTA frameworks. OBJECTIVE: To develop a proposal for including PEx in the HTA frameworks of health technologies. METHODS: A systematic literature review (SLR) on existing value frameworks (VFs) was conducted to capture how PEx-related value judgment is currently considered. Guided by the results of the SLR, a research group including HTA experts and patient representatives used an iterative process to develop potential value domains to capture PEx, in accordance with international guidelines. Subsequently, a panel of international payer experts was used to challenge the proposed PEx domains and provide recommendations for implementation. RESULTS: The SLR found 61 VFs and multi-criteria decision analyses (MCDAs) that considered PEx; however, PEx-related value elements were often referred to superficially, without clear definitions. Five potential PEx domains, with proposed measures for each, were developed and refined using expert feedback: (1) responsiveness to patient's individual needs, (2) improved health literacy and empowerment, (3) patient and caregiver reported outcomes, (4) household's financial burden, and (5) improved access for vulnerable patient populations. A flexible approach for framework implementation was proposed. CONCLUSIONS: Proposed PEx domains could be implemented at multiple levels of healthcare decision making to formalize consideration of PEx in the assessment of value, either through the extension of existing VFs or to create new PEx-focused VFs and more holistic decision making tools. DISCLOSURES: This study was funded and sponsored by UCB Pharma. The funding agreement ensured the authors' independence in designing the study, interpreting the data, writing, and publishing the report. Charokopou, Mountain, and Szegvari are employed by UCB Pharma. Inotai, Jakab, and Kalo are employed by Syreon Research Institute, which received funding from UCB Pharma for this research. Brixner has received fees from AbbVie, Elevar, Millcreek Outcomes Group, Novartis, Sanofi, UCB Pharma, and Xcenda. Campbell has received grants and contracts from the PhRMA Foundation and the Institute for Clinical and Economic Review. During a sabbatical leave, Campbell collaborated with Syreon Research Institute on research projects that included funding from UCB Pharma. Hawkins has received consultancy fees from UCB Pharma. Kristensen has received speakers bureau fees from Pfizer, AbbVie, Amgen, UCB Pharma, Celgene, Bristol-Myers Squibb, MSD, Novartis, Eli Lilly, and Janssen Pharmaceuticals and consultancy fees from UCB Pharma.

Nondestructive evaluation of baking parameters on pogácsa texture.

This study aimed to investigate the potential application of image texture processing method on visible crumb structure of salty cake pogácsa, which was prepared with different baking times (5 and 7 min) and temperatures (200, 215, and 230°C). For this purpose, changes in gray level co-occurrence matrix (GLCM) features including energy, contrast, correlation, homogeneity, and entropy were monitored and their relationship with the instrumental texture parameters (hardness, adhesiveness, cohesiveness, springiness, gumminess, and chewiness) were assessed. The pore ratios were also extracted and visualized using image processing technique. Texture profile parameters indicated strong correlation (p < .01) with the image pattern parameters in different pogácsa groups. Gumminess showed strong correlation with contrast (0.503), correlation (-0.498), and homogeneity (0.401). Hardness also exhibited correlation with contrast (0.517), entropy (0.341), and correlation (-0.476). The pore ratio showed marked variation in crumb structure when different times and temperatures were used. Baking at 230°C for 7 min maximized the pore ratio (0.56). Penalty analysis revealed that oiliness, pore structure, and color of products were linked with baking time and temperature. Overall, the results suggested that the GLCM-based technique had the potential to be used as a nondestructive method for rapid quality assessment of pogácsa.

Potential Criteria for Frameworks to Support the Evaluation of Innovative Medicines in Upper Middle-Income Countries-A Systematic Literature Review on Value Frameworks and Multi-Criteria Decision Analyses.

BACKGROUND: Multicriteria Decision Analysis (MCDA), a formal decision support framework, has been growing in popularity recently in the field of health care. MCDA can support pricing and reimbursement decisions on the macro level, which is of great importance especially in countries with more limited resources. OBJECTIVES: The aim of this systematic review was to facilitate the development of future MCDA frameworks, by proposing a set of criteria focusing on the purchasing decisions of single-source innovative pharmaceuticals in upper middle-income countries. METHODS: A systematic literature review was conducted on the decision criteria included in value frameworks (VFs) or MCDA tools. Scopus, Medline, databases of universities, websites of Health Technology Assessment Agencies, and other relevant organizations were included in the search. Double title-abstract screening and double full-text review were conducted, and all extracted data were double-checked. A team of researchers performed the merging and selection process of the extracted criteria. RESULTS: A total of 1,878 articles entered the title and abstract screening. From these, 341 were eligible to the full-text review, and 36 were included in the final data extraction phase. From these articles 394 criteria were extracted in total. After deduplication and clustering, 26 different criteria were identified. After the merging and selection process, a set of 16 general criteria was proposed. CONCLUSION: Based on the results of the systematic literature review, a pool of 16 criteria was selected. This can serve as a starting point for constructing MCDA frameworks in upper middle-income countries after careful adaptation to the local context.