Ethics information retrieval in HTA: state of current practice.

OBJECTIVES: Though there have been longstanding discussions on the value of ethics in health technology assessment (HTA), less awareness exists on ethics information retrieval methods. This study aimed to scope available evidence and determine current practices for ethics information retrieval in HTA. METHODS: Literature searches were conducted in Ovid MEDLINE, LISTA, Scopus, and Google Scholar. Once a list of relevant articles was determined, citation tracking was conducted via Scopus. HTA agency websites were searched for published guidance on ethics searching, and for reports which included ethical analyses. Methods sections of each report were analyzed to determine the databases, subject headings, and keywords used in search strategies. The team also reached out to information specialists for insight into current search practices. RESULTS: Findings from this study indicate that there is still little published guidance from HTA agencies, few HTAs that contain substantial ethical analysis, and even less information on the methodology for ethics information retrieval. The researchers identified twenty-five relevant HTAs. Ten of these reports did not utilize subject-specific databases outside health sciences. Eight reports published ethics searches, with significant overlap in subject headings and text words. CONCLUSIONS: This scoping study of current practice in HTA ethics information retrieval highlights findings of previous studies-while ethics analysis plays a crucial role in HTA, methods for literature searching remain relatively unclear. These findings provide insight into the current state of ethics searching, and will inform continued work on filter development, database selection, and grey literature searching.

Current methods for development of rapid reviews about diagnostic tests: an international survey.

BACKGROUND: Rapid reviews (RRs) have emerged as an efficient alternative to time-consuming systematic reviews-they can help meet the demand for accelerated evidence synthesis to inform decision-making in healthcare. The synthesis of diagnostic evidence has important methodological challenges. Here, we performed an international survey to identify the current practice of producing RRs for diagnostic tests. METHODS: We developed and administered an online survey inviting institutions that perform RRs of diagnostic tests from all over the world. RESULTS: All participants (N = 25) reported the implementation of one or more methods to define the scope of the RR; however, only one strategy (defining a structured question) was used by ≥90% of participants. All participants used at least one methodological shortcut including the use of a previous review as a starting point (92%) and the use of limits on the search (96%). Parallelization and automation of review tasks were not extensively used (48 and 20%, respectively). CONCLUSION: Our survey indicates a greater use of shortcuts and limits for conducting diagnostic test RRs versus the results of a recent scoping review analyzing published RRs. Several shortcuts are used without knowing how their implementation affects the results of the evidence synthesis in the setting of diagnostic test reviews. Thus, a structured evaluation of the challenges and implications of the adoption of these RR methods is warranted.

ENVIRONMENTAL IMPACT ASSESSMENT OF A HEALTH TECHNOLOGY: A SCOPING REVIEW.

INTRODUCTION: The Health Technology Expert Review Panel is an advisory body to Canadian Agency for Drugs and Technologies in Health (CADTH) that develops recommendations on health technology assessments (HTAs) for nondrug health technologies using a deliberative framework. The framework spans several domains, including the environmental impact of the health technology(ies). Our research objective was to identify articles on frameworks, methods or case studies on the environmental impact assessment of health technologies. METHODS: A literature search in major databases and a focused gray literature search were conducted. The main search concepts were HTA and environmental impact/sustainability. Eligible articles were those that described a conceptual framework or methods used to conduct an environmental assessment of health technologies, and case studies on the application of an environmental assessment. RESULTS: From the 1,710 citations identified, thirteen publications were included. Two articles presented a framework to incorporate environmental assessment in HTAs. Other approaches described weight of evidence practices and comprehensive and integrated environmental impact assessments. Central themes derived include transparency and repeatability, integration of components in a framework or of evidence into a single outcome, data availability to ensure the accuracy of findings, and familiarity with the approach used. CONCLUSIONS: Each framework and methods presented have different foci related to the ecosystem, health economics, or engineering practices. Their descriptions suggested transparency, repeatability, and the integration of components or of evidence into a single outcome as their main strengths. Our review is an initial step of a larger initiative by CADTH to develop the methods and processes to address the environmental impact question in an HTA.

Actovegin in the management of patients after ischemic stroke: A systematic review.

BACKGROUND: Actovegin is a hemodialysate of calf's blood and has been used for several decades in the countries of Central Asia, East Asia, Russia and some European countries. It has been used to treat patients with various neurological conditions, vascular disorders, and ischemic stroke. OBJECTIVES: To perform a systematic review to evaluate the effect of Actovegin in patients who have suffered an ischemic stroke. METHODS: A search of MEDLINE, PubMed, Cochrane and Embase was carried out from inception to October 10, 2021 for clinical trials and observational studies with a control group, published in English or Russian. RESULTS: Of 220 identified unique records, 84 full-text articles were screened, and 5 studies were selected that met the inclusion criteria. This included 4 observational studies with control groups and one randomized, placebo-controlled clinical trial. These studies enrolled a total of 3879 patients of which 720 patients received Actovegin administered intravenously and/or orally for a duration ranging from 10 to 180 days. Because of study heterogeneity, meta-analysis was not performed. No consistent evidence on improved survival, quality of life, neurologic symptoms, activities of daily living or disability was identified. One study showed statistically significant improvements in the Alzheimer's Disease Assessment Scale, cognitive subscale, extended version (ADAS-cog+) for Actovegin compared with placebo at 6 months but the clinical relevance of this change is uncertain. One study reported a higher incidence of recurrent ischemic stroke, transient ischemic attack or intracerebral hemorrhage in patients taking Actovegin compared to placebo. CONCLUSIONS: The benefits of Actovegin are uncertain and that there is potential risk of harm in patients with stroke. More evidence is needed from rigorously designed clinical trials to justify the role of Actovegin in patients with ischemic stroke.

Guidance on review type selection for health technology assessments: key factors and considerations for deciding when to conduct a de novo systematic review, an update of a systematic review, or an overview of systematic reviews.

BACKGROUND: A systematic review (SR) helps us make sense of a body of research while minimizing bias and is routinely conducted to evaluate intervention effects in a health technology assessment (HTA). In addition to the traditional de novo SR, which combines the results of multiple primary studies, there are alternative review types that use systematic methods and leverage existing SRs, namely updates of SRs and overviews of SRs. This paper shares guidance that can be used to select the most appropriate review type to conduct when evaluating intervention effects in an HTA, with a goal to leverage existing SRs and reduce research waste where possible. PROCESS: We identified key factors and considerations that can inform the process of deciding to conduct one review type over the others to answer a research question and organized them into guidance comprising a summary and a corresponding flowchart. This work consisted of three steps. First, a guidance document was drafted by methodologists from two Canadian HTA agencies based on their experience. Next, the draft guidance was supplemented with a literature review. Lastly, broader feedback from HTA researchers across Canada was sought and incorporated into the final guidance. INSIGHTS: Nine key factors and six considerations were identified to help reviewers select the most appropriate review type to conduct. These fell into one of two categories: the evidentiary needs of the planned review (i.e., to understand the scope, objective, and analytic approach required for the review) and the state of the existing literature (i.e., to know the available literature in terms of its relevance, quality, comprehensiveness, currency, and findings). The accompanying flowchart, which can be used as a decision tool, demonstrates the interdependency between many of the key factors and considerations and aims to balance the potential benefits and challenges of leveraging existing SRs instead of primary study reports. CONCLUSIONS: Selecting the most appropriate review type to conduct when evaluating intervention effects in an HTA requires a myriad of factors to be considered. We hope this guidance adds clarity to the many competing considerations when deciding which review type to conduct and facilitates that decision-making process.

How We Might Further Integrate Considerations of Environmental Impact When Assessing the Value of Health Technologies.

There is growing awareness of the impact health technologies can have on the environment and the negative consequences of these environmental impacts on human health. However, health system decision-makers may lack the expertise, data, or resources to incorporate environmental considerations when making decisions about the adoption and use of health technologies. In this article, we describe how health technology assessment (HTA) is evolving to address climate change by providing health system decision-makers with the information they can use to reduce the impact of health care systems on the environment. Our objective is to consider approaches for including the environment domain when conducting an HTA-in particular, the use of the deliberative process-and for determining when the domain should be included. We explore the challenges of gathering the relevant data necessary to assess the environmental impact of a health technology, and we describe a "triage" approach for determining when an in-depth environmental impact assessment is warranted. We also summarize related initiatives from HTA agencies around the world.

How well do search filters perform in identifying economic evaluations in MEDLINE and EMBASE.

OBJECTIVES: Health technology assessment (HTA) agencies assessing the cost-effectiveness of healthcare technologies seek evidence from economic evaluations. As well as searching economic evaluation databases, researchers often search MEDLINE and EMBASE, using search filters whose current performance is unclear. We assessed the performance of search filters in identifying economic evaluations from MEDLINE and EMBASE. METHODS: A gold standard of economic evaluations was compiled from National Health Service Economic Evaluation Database (NHS EED) records for 2000, 2003, and 2006. Corresponding records were retrieved in MEDLINE and EMBASE. Search filters were identified from the InterTASC Information Specialists' SubGroup Web site and from Canadian Agency for Drugs and Technologies in Health (CADTH) Information Services. The sensitivity and precision of search filters in retrieving gold standard records from MEDLINE and EMBASE were tested. RESULTS: A total of 2,070 full economic evaluations were identified from NHS EED. Of these, 1,955 records were available in Ovid MEDLINE and 1,873 were available in Ovid EMBASE. Thirteen MEDLINE and eight EMBASE filters were identified. NHS Quality Improvement Scotland (full and brief filters), the NHS EED and Royle and Waugh filters achieved over 0.99 sensitivity in MEDLINE. NHS Quality Improvement Scotland, CADTH, Royle and Waugh, and NHS EED filters achieved greater than 0.99 sensitivity in EMBASE. Filters demonstrated low precision. CONCLUSIONS: This research provided new performance data on search filters to identify economic evaluations in MEDLINE and EMBASE. It demonstrated that highly sensitive economic evaluation filters are available, but that precision is low, yielding perhaps 5 relevant records per 100 records scanned.

A scoping review found increasing examples of rapid qualitative evidence syntheses and no methodological guidance.

OBJECTIVES: The objective of the study was to identify existing methodological guidance for the conduct of rapid qualitative evidence syntheses and examples of rapid qualitative evidence syntheses to describe the methods used. STUDY DESIGN AND SETTING: We conducted a systematic scoping review. We searched MEDLINE, CINAHL, gray literature, including PROSPERO, with no date limits and solicited examples through experts and researchers in the field. RESULTS: We found no methodological guidance to direct the conduct of rapid qualitative evidence synthesis and 15 examples including 13 completed reviews and two protocols. Diverse methods to abbreviate the review process were followed, which largely mirror methods developed for rapid reviews of clinical effects. Abbreviated search strategies, including date and language restrictions, were common, as was the use of a single reviewer for screening, data extraction, and quality appraisal. Descriptive approaches to synthesis, such as thematic synthesis, were more common than interpretive approaches, such as metaethnography. CONCLUSION: There is a need to develop and explore methods for the synthesis of qualitative research that balance the need for rapidity with rigor. In the meantime, providing details on the methods used, shortcuts made, and the implications of such methodological choices, together with collective sharing of innovations, becomes more important under increased time constraints.

Challenges of rapid reviews for diagnostic test accuracy questions: a protocol for an international survey and expert consultation.

BACKGROUND: Assessment of diagnostic tests, broadly defined as any element that aids in the collection of additional information for further clarification of a patient's health status, has increasingly become a critical issue in health policy and decision-making. Diagnostic evidence, including the accuracy of a medical test for a target condition, is commonly appraised using standard systematic review methodology. Owing to the considerable time and resources required to conduct these, rapid reviews have emerged as a pragmatic alternative by tailoring methods according to the decision maker's circumstances. However, it is not known if streamlining methodological aspects has an impact on the validity of evidence synthesis. Furthermore, due to the particular nature and complexity of the appraisal of diagnostic accuracy, there is need for detailed guidance on how to conduct rapid reviews of diagnostic tests. In this study, we aim to identify the methods currently used by rapid review developers to synthesize evidence on diagnostic test accuracy, as well as to analyze potential shortcomings and challenges related to these methods. METHODS: We will carry out a two-fold approach: (1) an international survey of professionals working in organizations that develop rapid reviews of diagnostic tests, in terms of the methods and resources used by these agencies when conducting rapid reviews, and (2) semi-structured interviews with senior-level individuals to further explore and validate the findings from the survey and to identify challenges in conducting rapid reviews. We will use STATA 15.0 for quantitative analyses and framework analysis for qualitative analyses. We will ensure protection of data during all stages. DISCUSSION: The main result of this research will be a map of methods and resources currently used for conducting rapid reviews of diagnostic test accuracy, as well as methodological shortcomings and potential solutions in diagnostic knowledge synthesis that require further research.

Rapid reviews of medical tests used many similar methods to systematic reviews but key items were rarely reported: a scoping review.

BACKGROUND AND OBJECTIVES: Rapid reviews provide an efficient alternative to standard systematic reviews in response to a high priority or urgent need. Although rapid reviews of interventions have been extensively evaluated, little is known about the characteristics of rapid reviews of diagnostic evidence. STUDY DESIGN AND SETTING: We performed a scoping review for rapid reviews of medical tests published from 2013 to 2018. We extracted information on review characteristics and methods used to assess the evidence. RESULTS: We identified 191 rapid reviews. All reviews were developed within a short time (less than 12 months) and were relatively concise (less than 10 pages). The reviews involved multiple index tests (44%), multiple outcomes (88%), and several test applications (29%). Well-known methodological tailoring strategies were infrequently used. Although reporting of several key features was limited, we found that, in general, rapid reviews have similar characteristics to broader knowledge syntheses. CONCLUSION: Our scoping review is the first to describe the characteristics and methods of rapid reviews of diagnostic evidence. Future research should identify the most appropriate methods for performing rapid reviews of medical tests. Standards for reporting of rapid reviews are needed.