Characteristics and impact of interventions to support healthcare providers' compliance with guideline recommendations for breast cancer: a systematic literature review.

BACKGROUND: Breast cancer clinical practice guidelines (CPGs) offer evidence-based recommendations to improve quality of healthcare for patients. Suboptimal compliance with breast cancer guideline recommendations remains frequent, and has been associated with a decreased survival. The aim of this systematic review was to characterize and determine the impact of available interventions to support healthcare providers' compliance with CPGs recommendations in breast cancer healthcare. METHODS: We searched for systematic reviews and primary studies in PubMed and Embase (from inception to May 2021). We included experimental and observational studies reporting on the use of interventions to support compliance with breast cancer CPGs. Eligibility assessment, data extraction and critical appraisal was conducted by one reviewer, and cross-checked by a second reviewer. Using the same approach, we synthesized the characteristics and the effects of the interventions by type of intervention (according to the EPOC taxonomy), and applied the GRADE framework to assess the certainty of evidence. RESULTS: We identified 35 primary studies reporting on 24 different interventions. Most frequently described interventions consisted in computerized decision support systems (12 studies); educational interventions (seven), audit and feedback (two), and multifaceted interventions (nine). There is low quality evidence that educational interventions targeted to healthcare professionals may improve compliance with recommendations concerning breast cancer screening, diagnosis and treatment. There is moderate quality evidence that reminder systems for healthcare professionals improve compliance with recommendations concerning breast cancer screening. There is low quality evidence that multifaceted interventions may improve compliance with recommendations concerning breast cancer screening. The effectiveness of the remaining types of interventions identified have not been evaluated with appropriate study designs for such purpose. There is very limited data on the costs of implementing these interventions. CONCLUSIONS: Different types of interventions to support compliance with breast cancer CPGs recommendations are available, and most of them show positive effects. More robust trials are needed to strengthen the available evidence base concerning their efficacy. Gathering data on the costs of implementing the proposed interventions is needed to inform decisions about their widespread implementation. TRIAL REGISTRATION: CRD42018092884 (PROSPERO).

GRADE guidance 35: update on rating imprecision for assessing contextualized certainty of evidence and making decisions.

OBJECTIVES: Grading of Recommendations Assessment, Development and Evaluation (GRADE) guidance to rate the certainty domain of imprecision is presently not fully operationalized for rating down by two levels and when different baseline risk or uncertainty in these risks are considered. In addition, there are scenarios in which lowering the certainty of evidence by three levels for imprecision is more appropriate than lowering it by two levels. In this article, we conceptualize and operationalize rating down for imprecision by one, two and three levels for imprecision using the contextualized GRADE approaches and making decisions. METHODS: Through iterative discussions and refinement in online meetings and through email communication, we developed draft guidance to rating the certainty of evidence down by up to three levels based on examples. The lead authors revised the approach according to the feedback and the comments received during these meetings and developed GRADE guidance for how to apply it. We presented a summary of the results to all attendees of the GRADE Working Group meeting for feedback in October 2021 (approximately 80 people) where the approach was formally approved. RESULTS: This guidance provides GRADE's novel approach for the considerations about rating down for imprecision by one, two and three levels based on serious, very serious and extremely serious concerns. The approach includes identifying or defining thresholds for health outcomes that correspond to trivial or none, small, moderate or large effects and using them to rate imprecision. It facilitates the use of evidence to decision frameworks and also provides guidance for how to address imprecision about implausible large effects and trivial or no effects using the concept of the 'review information size' and for varying baseline risks. The approach is illustrated using practical examples, an online calculator and graphical displays and can be applied to dichotomous and continuous outcomes. CONCLUSION: In this GRADE guidance article, we provide updated guidance for how to rate imprecision using the partially and fully contextualized GRADE approaches for making recommendations or decisions, considering alternate baseline risks and for both dichotomous and continuous outcomes.

Defining decision thresholds for judgments on health benefits and harms using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Evidence to Decision (EtD) frameworks: a protocol for a randomised methodological study (GRADE-THRESHOLD).

INTRODUCTION: The Grading of Recommendations Assessment, Development and Evaluation (GRADE) and similar Evidence to Decision (EtD) frameworks require its users to judge how substantial the effects of interventions are on desirable and undesirable people-important health outcomes. However, decision thresholds (DTs) that could help understand the magnitude of intervention effects and serve as reference for interpretation of findings are not yet available.The objective of this study is an approach to derive and use DTs for EtD judgments about the magnitude of health benefits and harms. We hypothesise that approximate DTs could have the ability to discriminate between the existing four categories of EtD judgments (Trivial, Small, Moderate, Large), support panels of decision-makers in their work, and promote consistency and transparency in judgments. METHODS AND ANALYSIS: We will conduct a methodological randomised controlled trial to collect the data that allow deriving the DTs. We will invite clinicians, epidemiologists, decision scientists, health research methodologists, experts in Health Technology Assessment (HTA), members of guideline development groups and the public to participate in the trial. Then, we will investigate the validity of our DTs by measuring the agreement between judgments that were made in the past by guideline panels and the judgments that our DTs approach would suggest if applied on the same guideline data. ETHICS AND DISSEMINATION: The Hamilton Integrated Research Ethics Board reviewed this study as a quality improvement study and determined that it requires no further consent. Survey participants will be required to read a consent statement in order to participate in this study at the beginning of the trial. This statement reads: You are being invited to participate in a research project which aims to identify indicative DTs that could assist users of the GRADE EtD frameworks in making judgments. Your input will be used in determining these indicative thresholds. By completing this survey, you provide consent that the anonymised data collected will be used for the research study and to be summarised in aggregate in publication and electronic tools. PROTOCOL REGISTRATION NUMBER: NCT05237635.

Cost-effectiveness of diagnostic strategies for venous thromboembolism: a systematic review.

Guideline developers consider cost-effectiveness evidence in decision making to determine value for money. This consideration in the guideline development process can be informed either by formal and dedicated economic evaluations or by systematic reviews of existing studies. To inform the American Society of Hematology guideline on the diagnosis of venous thromboembolism (VTE), we conducted a systematic review focused on the cost-effectiveness of diagnostic strategies for VTE within the guideline scope. We systematically searched Medline (Ovid), Embase (Ovid), National Health Service Economic Evaluation Database, and the Cost-effectiveness Analysis Registry; summarized; and critically appraised the economic evidence on diagnostic strategies for VTE. We identified 49 studies that met our inclusion criteria, with 26 on pulmonary embolism (PE) and 24 on deep vein thrombosis (DVT). For the diagnosis of PE, strategies including d-dimer to exclude PE were cost-effective compared with strategies without d-dimer testing. The cost-effectiveness of computed tomography pulmonary angiogram (CTPA) in relation to ventilation-perfusion (V/Q) scan was inconclusive. CTPA or V/Q scan following ultrasound or d-dimer results could be cost-effective or even cost saving. For DVT, studies supporting strategies with d-dimer and/or ultrasound were cost-effective, supporting the recommendation that for patients at low (unlikely) VTE risk, using d-dimer as the initial test reduces the need for diagnostic imaging. Our systematic review informed the American Society of Hematology guideline recommendations about d-dimer, V/Q scan and CTPA for PE diagnosis, and d-dimer and ultrasound for DVT diagnosis.

GRADE Guidelines 30: the GRADE approach to assessing the certainty of modeled evidence-An overview in the context of health decision-making.

OBJECTIVES: The objective of the study is to present the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) conceptual approach to the assessment of certainty of evidence from modeling studies (i.e., certainty associated with model outputs). STUDY DESIGN AND SETTING: Expert consultations and an international multidisciplinary workshop informed development of a conceptual approach to assessing the certainty of evidence from models within the context of systematic reviews, health technology assessments, and health care decisions. The discussions also clarified selected concepts and terminology used in the GRADE approach and by the modeling community. Feedback from experts in a broad range of modeling and health care disciplines addressed the content validity of the approach. RESULTS: Workshop participants agreed that the domains determining the certainty of evidence previously identified in the GRADE approach (risk of bias, indirectness, inconsistency, imprecision, reporting bias, magnitude of an effect, dose-response relation, and the direction of residual confounding) also apply when assessing the certainty of evidence from models. The assessment depends on the nature of model inputs and the model itself and on whether one is evaluating evidence from a single model or multiple models. We propose a framework for selecting the best available evidence from models: 1) developing de novo, a model specific to the situation of interest, 2) identifying an existing model, the outputs of which provide the highest certainty evidence for the situation of interest, either "off-the-shelf" or after adaptation, and 3) using outputs from multiple models. We also present a summary of preferred terminology to facilitate communication among modeling and health care disciplines. CONCLUSION: This conceptual GRADE approach provides a framework for using evidence from models in health decision-making and the assessment of certainty of evidence from a model or models. The GRADE Working Group and the modeling community are currently developing the detailed methods and related guidance for assessing specific domains determining the certainty of evidence from models across health care-related disciplines (e.g., therapeutic decision-making, toxicology, environmental health, and health economics).

Acceptability, equity, and feasibility of using antipsychotics in children and adolescents with autism spectrum disorder: a systematic review.

BACKGROUND: It is unclear whether the administration of antipsychotics to children and adolescents with autism spectrum disorders (ASD) is acceptable, equitable, and feasible. METHODS: We performed a systematic review to support a multidisciplinary panel in formulating a recommendation on antipsychotics, for the development of the Italian national guidelines for the management of ASD. A comprehensive search strategy was performed to find data related to intervention acceptability, health equity, and implementation feasibility. We used quantitative data from randomized controlled trials to perform a meta-analysis assessing the acceptability and tolerability of antipsychotics, and we estimated the certainty of the effect according to the GRADE approach. We extracted data from systematic reviews, primary studies, and grey literature, and we assessed the risk of bias and methodological quality of the published studies. RESULTS: Antipsychotics were acceptable (dropouts due to any cause: RR 0.61, 95% CI 0.48-0.78, moderate certainty of evidence) and well tolerated (dropouts due to adverse events: RR 0.99, 95% CI 0.55-1.79, low certainty of evidence) by children and adolescents with ASD. Parents and clinicians did not raise significant issues concerning acceptability. We did not find studies reporting evidence of reduced equity for antipsychotics in disadvantaged subgroups of children and adolescents with ASD. Workloads, cost barriers, and inadequate monitoring of metabolic adverse events were indirect evidence of concerns for feasibility. CONCLUSION: Antipsychotics in children and adolescents with ASD were likely acceptable and possibly feasible. We did not find evidence of concern for equity.

Equity, acceptability and feasibility of using polyunsaturated fatty acids in children and adolescents with autism spectrum disorder: a rapid systematic review.

INTRODUCTION: Some recent randomized controlled trials (RCTs) assessed the efficacy and safety of polyunsaturated fatty acids (PUFAs) for the treatment of autism spectrum disorder (ASD). To optimally inform the Italian guideline for the management of ASD in children and adolescents, we reviewed the impact on equity, acceptability and feasibility for developing a pilot recommendation for PUFAs. METHODS: We performed a rapid systematic review of observational and experimental studies on PUFAs for children and adolescents with ASD, extracting data on resources required, equity, acceptability, and feasibility of PUFAs. We followed the framework provided by the grading of recommendations assessment, development and evaluation (GRADE) methodology, and we assessed risk of bias and methodological quality of included studies. Results were synthesized both narratively and quantitatively to address clinically relevant questions on equity, acceptability, and feasibility. RESULTS: We found 14 papers related to equity. PUFAs did not seem to impact equity importantly. We did not find variation in effectiveness across subgroups and in a base case scenario, the cost of a 12 weeks cycle of therapy with 1.155 g/day of PUFAs was €65.51 euro. The acceptability of PUFAs was evaluated in 17 studies, 9 of which were RCTs. PUFAs were widely used among children and adolescents with ASD (18 to 51%), and 50% of parents considered nutritional supplementation as useful. Difficulty in swallowing capsules and bad taste were identified as possible causes of poor compliance, but treatment adherence, when measured in included RCTs, was judged to be good to excellent. Discontinuation due to any cause for PUFAs could not differ from placebo (low certainty of evidence). The feasibility of using PUFAs was assessed in 12 studies. PUFAs were probably sustainable, and no particular critical issue emerged from the feasibility assessment. However, the evidence appeared scarce and indirect. CONCLUSIONS: We found the administration of PUFAs in children and adolescents with ASD to be potentially equitable, acceptable and feasible. These results are limited by the limited number and quality of retrieved documents, and need to be viewed in light of efficacy and safety data to formulate clinical recommendations.