Assessing how information is packaged in rapid reviews for policy-makers and other stakeholders: a cross-sectional study.

BACKGROUND: Rapid reviews (RRs) are useful products to healthcare policy-makers and other stakeholders, who require timely evidence. Therefore, it is important to assess how well RRs convey useful information in a format that is easy to understand so that decision-makers can make best use of evidence to inform policy and practice. METHODS: We assessed a diverse sample of 103 RRs against the BRIDGE criteria, originally developed for communicating clearly to support healthcare policy-making. We modified the criteria to increase assessability and to align with RRs. We identified RRs from key database searches and through searching organisations known to produce RRs. We assessed each RR on 26 factors (e.g. organisation of information, lay language use). Results were descriptively analysed. Further, we explored differences between RRs published in journals and those published elsewhere. RESULTS: Certain criteria were well covered across the RRs (e.g. all aimed to synthesise research evidence and all provided references of included studies). Further, most RRs provided detail on the problem or issue (96%; n = 99) and described methods to conduct the RR (91%; n = 94), while several addressed political or health systems contexts (61%; n = 63). Many RRs targeted policy-makers and key stakeholders as the intended audience (66%; n = 68), yet only 32% (n = 33) involved their tacit knowledge, while fewer (27%; n = 28) directly involved them reviewing the content of the RR. Only six RRs involved patient partners in the process. Only 23% (n = 24) of RRs were prepared in a format considered to make information easy to absorb (i.e. graded entry) and 25% (n = 26) provided specific key messages. Readability assessment indicated that the text of key RR sections would be hard to understand for an average reader (i.e. would require post-secondary education) and would take 42 (± 36) minutes to read. CONCLUSIONS: Overall, conformity of the RRs with the modified BRIDGE criteria was modest. By assessing RRs against these criteria, we now understand possible ways in which they could be improved to better meet the information needs of healthcare decision-makers and their potential for innovation as an information-packaging mechanism. The utility and validity of these items should be further explored. PROTOCOL AVAILABILITY: The protocol, published on the Open Science Framework, is available at: osf.io/68tj7.

Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement.

Importance: Systematic reviews of diagnostic test accuracy synthesize data from primary diagnostic studies that have evaluated the accuracy of 1 or more index tests against a reference standard, provide estimates of test performance, allow comparisons of the accuracy of different tests, and facilitate the identification of sources of variability in test accuracy. Objective: To develop the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) diagnostic test accuracy guideline as a stand-alone extension of the PRISMA statement. Modifications to the PRISMA statement reflect the specific requirements for reporting of systematic reviews and meta-analyses of diagnostic test accuracy studies and the abstracts for these reviews. Design: Established standards from the Enhancing the Quality and Transparency of Health Research (EQUATOR) Network were followed for the development of the guideline. The original PRISMA statement was used as a framework on which to modify and add items. A group of 24 multidisciplinary experts used a systematic review of articles on existing reporting guidelines and methods, a 3-round Delphi process, a consensus meeting, pilot testing, and iterative refinement to develop the PRISMA diagnostic test accuracy guideline. The final version of the PRISMA diagnostic test accuracy guideline checklist was approved by the group. Findings: The systematic review (produced 64 items) and the Delphi process (provided feedback on 7 proposed items; 1 item was later split into 2 items) identified 71 potentially relevant items for consideration. The Delphi process reduced these to 60 items that were discussed at the consensus meeting. Following the meeting, pilot testing and iterative feedback were used to generate the 27-item PRISMA diagnostic test accuracy checklist. To reflect specific or optimal contemporary systematic review methods for diagnostic test accuracy, 8 of the 27 original PRISMA items were left unchanged, 17 were modified, 2 were added, and 2 were omitted. Conclusions and Relevance: The 27-item PRISMA diagnostic test accuracy checklist provides specific guidance for reporting of systematic reviews. The PRISMA diagnostic test accuracy guideline can facilitate the transparent reporting of reviews, and may assist in the evaluation of validity and applicability, enhance replicability of reviews, and make the results from systematic reviews of diagnostic test accuracy studies more useful.

Efficacy, effectiveness and immunogenicity of reduced HPV vaccination schedules: A review of available evidence.

Background: Current National Advisory Committee on Immunization (NACI) guidance recommends human papillomavirus (HPV) vaccines be administered as a two or three-dose schedule. Recently, several large clinical trials have reported the clinical benefit of a single HPV vaccine dose. As a result, the World Health Organization released updated guidance on HPV vaccines in 2022, recommending a two-dose schedule for individuals aged 9-20 years, and acknowledging the use of an alternative off-label single dose schedule. Objective: The objective of this overview is to provide a detailed account of the available evidence comparing HPV vaccination schedules, which was considered by NACI when updating recommendations on HPV vaccines. Methods: To identify relevant evidence, existing systematic reviews were leveraged where possible. Individual studies were critically appraised, and the Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology was used to assess the certainty of evidence. Results: Available evidence suggests that a one, two, or three-dose HPV vaccine schedule may provide similar protection from HPV infection. While antibody levels against HPV vaccine types were statistically significantly lower with a single dose schedule compared to two or three doses, titres were sustained for up to 16 years. The clinical significance of lower antibody titres is unknown, as there is no established immunologic correlate of protection. Conclusion: While the available evidence on single-dose HPV vaccination schedules shows a one-dose schedule is highly effective, continued follow-up of single-dose cohorts will be critical to understanding the relative duration of protection for reduced dose schedules and informing future NACI guidance on HPV vaccines.

Effectiveness of e-cigarettes as a stop smoking intervention in adults: a systematic review.

BACKGROUND: This systematic review aims to identify the benefits and harms of electronic cigarettes (e-cigarettes) as a smoking cessation aid in adults (aged ≥ 18 years) and to inform the development of the Canadian Task Force on Preventive Health Care's (CTFPHC) clinical practice guidelines on e-cigarettes. METHODS: We searched Ovid MEDLINE®, Ovid MEDLINE® Epub Ahead of Print, In-Process & Other Non-Indexed Citations, PsycINFO, Embase Classic + Embase, and the Cochrane Library on Wiley. Searches were conducted from January 2016 to July 2019 and updated on 24 September 2020 and 25 January 2024. Two reviewers independently performed title-abstract and full-text screening according to the pre-determined inclusion criteria. Data extraction, quality assessments, and the application of Grading of Recommendations Assessment, Development and Evaluation (GRADE) were performed by one independent reviewer and verified by another. RESULTS: We identified 18 studies on 17 randomized controlled trials that compared e-cigarettes with nicotine to e-cigarettes without nicotine and e-cigarettes (with or without nicotine) to other interventions (i.e., no intervention, waitlist, standard/usual care, quit advice, or behavioral support). Considering the benefits of e-cigarettes in terms of smoking abstinence and smoking frequency reduction, 14 studies showed small or moderate benefits of e-cigarettes with or without nicotine compared to other interventions; although, with low, very low or moderate evidence certainty. With a focus on e-cigarettes with nicotine specifically, 12 studies showed benefits in terms of smoking abstinence when compared with usual care or non-nicotine e-cigarettes. In terms of harms following nicotine or non-nicotine e-cigarette use, 15 studies reported mild adverse events with little to no difference between groups and low to very low evidence certainty. CONCLUSION: The evidence synthesis on the e-cigarette's effectiveness shows data surrounding benefits having low to moderate evidence certainty for some comparisons and very low certainty for others, indicating that e-cigarettes may or probably increase smoking cessation, whereas, for harms, there is low to very low evidence certainty. Since the duration for outcome measurement varied among different studies, it may not be long-term enough for Adverse Events (AEs) to emerge, and there is a need for more research to understand the long-term benefits and potential harms of e-cigarettes. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42018099692.

Effectiveness of smoking cessation interventions among adults: an overview of systematic reviews.

BACKGROUND: This overview of reviews aims to identify evidence on the benefits (i.e. tobacco use abstinence and reduction in smoking frequency) and harms (i.e. possible adverse events/outcomes) of smoking cessation interventions among adults aged 18 years and older. METHODS: We searched Medline, Embase, PsycINFO, Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects, the CADTH Health Technology Assessment Database and several other websites for grey literature. Searches were conducted on November 12, 2018, updated on September 24, 2020, with publication years 2008 to 2020. Two reviewers independently performed title-abstract and full-text screening considering pre-determined inclusion criteria. Data extraction and quality assessments were initially completed by two reviewers independently (i.e. 73% of included studies (n = 22)) using A Measurement Tool to Assess Systematic Reviews-2 (AMSTAR 2), and the remainder done by one reviewer and verified by another due to resources and feasibility. The application of Grading of Recommendations Assessment, Development and Evaluation (GRADE) was performed by one independent reviewer and verified by another. RESULTS: A total of 22 Cochrane systematic reviews evaluating the impact of smoking cessation interventions on outcomes such as tobacco use abstinence, reduction in smoking frequency, quality of life and possible adverse events were included. Pharmaceutical (i.e. varenicline, cytisine, nicotine replacement therapy (NRT), bupropion) and behavioural interventions (i.e. physician advice, non-tailored print-based self-help materials, stage-based individual counselling, etc.) showed to have increased smoking cessation; whereas, data for mobile phone-based interventions including text messaging, hypnotherapy, acupuncture, continuous auricular stimulation, laser therapy, electrostimulation, acupressure, St John's wort, S-adenosyl-L-methionine (SAMe), interactive voice response systems and other combination treatments were unclear. Considering harms related to smoking cessation interventions, small/mild harms (i.e. increased palpitations, chest pain, nausea, insomnia, headache) were observed following NRT, varenicline and cytisine use. There were no data on harms related to behavioural therapies (i.e. individual or group counselling self-help materials, internet interventions), combination therapies or other therapies (i.e. laser therapy, electrostimulation, acupressure, St John's wort, SAMe). CONCLUSION: Results suggest that pharmacological and behavioural interventions may help the general smoking population quit smoking with observed small/mild harms following NRT or varenicline. Consequently, evidence regarding ideal intervention strategies and the long-term impact of these interventions for preventing smoking was unclear. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42018099691.

A multimethods randomized trial found that plain language versions improved adults understanding of health recommendations.

OBJECTIVES: To make informed decisions, the general population should have access to accessible and understandable health recommendations. To compare understanding, accessibility, usability, satisfaction, intention to implement, and preference of adults provided with a digital "Plain Language Recommendation" (PLR) format vs. the original "Standard Language Version" (SLV). STUDY DESIGN AND SETTING: An allocation-concealed, blinded, controlled superiority trial and a qualitative study to understand participant preferences. An international on-line survey. 488 adults with some English proficiency. 67.8% of participants identified as female, 62.3% were from the Americas, 70.1% identified as white, 32.2% had a bachelor's degree as their highest completed education, and 42% said they were very comfortable reading health information. In collaboration with patient partners, advisors, and the Cochrane Consumer Network, we developed a plain language format of guideline recommendations (PLRs) to compare their effectiveness vs. the original standard language versions (SLVs) as published in the source guideline. We selected two recommendations about COVID-19 vaccine, similar in their content, to compare our versions, one from the World Health Organization (WHO) and one from Centers for Disease Control and Prevention (CDC). The primary outcome was understanding, measured as the proportion of correct responses to seven comprehension questions. Secondary outcomes were accessibility, usability, satisfaction, preference, and intended behavior, measured on a 1-7 scale. RESULTS: Participants randomized to the PLR group had a higher proportion of correct responses to the understanding questions for the WHO recommendation (mean difference [MD] of 19.8%, 95% confidence interval [CI] 14.7-24.9%; P < 0.001) but this difference was smaller and not statistically significant for the CDC recommendation (MD of 3.9%, 95% CI -0.7% to 8.3%; P = 0.096). However, regardless of the recommendation, participants found the PLRs more accessible, (MD of 1.2 on the seven-point scale, 95% CI 0.9-1.4%; P < 0.001) and more satisfying (MD of 1.2, 95% CI 0.9-1.4%; P < 0.001). They were also more likely to follow the recommendation if they had not already followed it (MD of 1.2, 95% CI 0.7-1.8%; P < 0.001) and share it with other people they know (MD of 1.9, 95% CI 0.5-1.2%; P < 0.001). There was no significant difference in the preference between the two formats (MD of -0.3, 95% CI -0.5% to 0.03%; P = 0.078). The qualitative interviews supported and contextualized these findings. CONCLUSION: Health information provided in a PLR format improved understanding, accessibility, usability, and satisfaction and thereby has the potential to shape public decision-making behavior.

Trivalent and quadrivalent seasonal influenza vaccine in adults aged 60 and older: a systematic review and network meta-analysis.

OBJECTIVES: To compare the efficacy of influenza vaccines of any valency for adults 60 years and older. DESIGN AND SETTING: Systematic review with network meta-analysis (NMA) of randomised controlled trials (RCTs). MEDLINE, EMBASE, JBI Evidence-Based Practice (EBP) Database, PsycINFO, and Cochrane Evidence -Based Medicine database were searched from inception to 20 June 20, 2022. Two reviewers screened, abstracted, and appraised articles (Cochrane Risk of Bias (ROB) 2.0 tool) independently. We assessed certainty of findings using Confidence in Network Meta-Analysis and Grading of Recommendations, Assessment, Development and Evaluations approaches. We performed random-effects meta-analysis and network meta-analysis (NMA), and estimated odds ratios (ORs) for dichotomous outcomes and incidence rate ratios (IRRs) for count outcomes along with their corresponding 95% confidence intervals (CIs) and prediction intervals. PARTICIPANTS: Older adults (≥60 years old) receiving an influenza vaccine licensed in Canada or the USA (vs placebo, no vaccine, or any other licensed vaccine), at any dose. MAIN OUTCOME MEASURES: Laboratory-confirmed influenza (LCI) and influenza-like illness (ILI). Secondary outcomes were the number of vascular adverse events, hospitalisation for acute respiratory infection (ARI) and ILI, inpatient hospitalisation, emergency room (ER) visit for ILI, outpatient visit, and mortality, among others. RESULTS: We included 41 RCTs and 15 companion reports comprising 8 vaccine types and 206 032 participants. Vaccines may prevent LCI compared with placebo, with high-dose trivalent inactivated influenza vaccine (IIV3-HD) (NMA: 9 RCTs, 52 202 participants, OR 0.23, 95% confidence interval (CI) (0.11 to 0.51), low certainty of evidence) and recombinant influenza vaccine (RIV) (OR 0.25, 95%CI (0.08 to 0.73), low certainty of evidence) among the most efficacious vaccines. Standard dose trivalent IIV3 (IIV3-SD) may prevent ILI compared with placebo, but the result was imprecise (meta-analysis: 2 RCTs, 854 participants, OR 0.39, 95%CI (0.15 to 1.02), low certainty of evidence). Any HD was associated with prevention of ILI compared with placebo (NMA: 9 RCTs, 65 658 participants, OR 0.38, 95%CI (0.15 to 0.93)). Adjuvanted quadrivalent IIV (IIV4-Adj) may be associated with the least vascular adverse events, but the results were very uncertain (NMA: eight 8 RCTs, 57 677 participants, IRR 0.18, 95%CI (0.07 to 0.43), very low certainty of evidence). RIV on all-cause mortality may be comparable to placebo (NMA: 20 RCTs, 140 577 participants, OR 1.01, 95%CI (0.23 to 4.49), low certainty of evidence). CONCLUSIONS: This systematic review demonstrated efficacy associated with IIV3-HD and RIV vaccines in protecting older persons against LCI. RIV vaccine may reduce all-cause mortality when compared with other vaccines, but the evidence is uncertain. Differences in efficacy between influenza vaccines remain uncertain with very low to moderate certainty of evidence. PROSPERO REGISTRATION NUMBER: CRD42020177357.

Plain Language vs Standard Format for Youth Understanding of COVID-19 Recommendations: A Randomized Clinical Trial.

Importance: To ensure that youths can make informed decisions about their health, it is important that health recommendations be presented for understanding by youths. Objective: To compare understanding, accessibility, usability, satisfaction, intention to implement, and preference of youths provided with a digital plain language recommendation (PLR) format vs the original standard language version (SLV) of a health recommendation. Design, Setting, and Participants: This pragmatic, allocation-concealed, blinded, superiority randomized clinical trial included individuals from any country who were 15 to 24 years of age, had internet access, and could read and understand English. The trial was conducted from May 27 to July 6, 2022, and included a qualitative component. Interventions: An online platform was used to randomize youths in a 1:1 ratio to an optimized digital PLR or SLV format of 1 of 2 health recommendations related to the COVID-19 vaccine; youth-friendly PLRs were developed in collaboration with youth partners and advisors. Main Outcomes and Measures: The primary outcome was understanding, measured as the proportion of correct responses to 7 comprehension questions. Secondary outcomes were accessibility, usability, satisfaction, preference, and intended behavior. After completion of the survey, participants indicated their interest in completing a 1-on-1 semistructured interview to reflect on their preferred digital format (PLR or SLV) and their outcome assessment survey response. Results: Of the 268 participants included in the final analysis, 137 were in the PLR group (48.4% female) and 131 were in the SLV group (53.4% female). Most participants (233 [86.9%]) were from North and South America. No significant difference was found in understanding scores between the PLR and SLV groups (mean difference, 5.2%; 95% CI, -1.2% to 11.6%; P = .11). Participants found the PLR to be more accessible and usable (mean difference, 0.34; 95% CI, 0.05-0.63) and satisfying (mean difference, 0.39; 95% CI, 0.06-0.73) and had a stronger preference toward the PLR (mean difference, 4.8; 95% CI, 4.5-5.1 [4.0 indicated a neutral response]) compared with the SLV. No significant difference was found in intended behavior (mean difference, 0.22 (95% CI, -0.20 to 0.74). Interviewees (n = 14) agreed that the PLR was easier to understand and generated constructive feedback to further improve the digital PLR. Conclusions and Relevance: In this randomized clinical trial, compared with the SLV, the PLR did not produce statistically significant findings in terms of understanding scores. Youths ranked it higher in terms of accessibility, usability, and satisfaction, suggesting that the PLR may be preferred for communicating health recommendations to youths. The interviews provided suggestions for further improving PLR formats. Trial Registration: ClinicalTrials.gov Identifier: NCT05358990.

Knowledge mobilization activities to support decision-making by youth, parents, and adults using a systematic and living map of evidence and recommendations on COVID-19: protocol for three randomized controlled trials and qualitative user-experience studies.

INTRODUCTION: The COVID-19 pandemic underlined that guidelines and recommendations must be made more accessible and more understandable to the general public to improve health outcomes. The objective of this study is to evaluate, quantify, and compare the public's understanding, usability, satisfaction, intention to implement, and preference for different ways of presenting COVID-19 health recommendations derived from the COVID-19 Living Map of Recommendations and Gateway to Contextualization (RecMap). METHODS AND ANALYSIS: This is a protocol for a multi-method study. Through an online survey, we will conduct pragmatic allocation-concealed, blinded superiority randomized controlled trials (RCTs) in three populations to test alternative formats of presenting health recommendations: adults, parents, and youth, with at least 240 participants in each population. Prior to initiating the RCT, our interventions will have been refined with relevant stakeholder input. The intervention arm will receive a plain language recommendation (PLR) format while the control arm will receive the corresponding original recommendation format as originally published by the guideline organizations (standard language version). Our primary outcome is understanding, and our secondary outcomes are accessibility and usability, satisfaction, intended behavior, and preference for the recommendation formats. Each population's results will be analyzed separately. However, we are planning a meta-analysis of the results across populations. At the end of each survey, participants will be invited to participate in an optional one-on-one, virtual semi-structured interview to explore their user experience. All interviews will be transcribed and analyzed using the principles of thematic analysis and a hybrid inductive and deductive approach. ETHICS AND DISSEMINATION: Through Clinical Trials Ontario, the Hamilton Integrated Research Ethics Board has reviewed and approved this protocol (Project ID: 3856). The University of Alberta has approved the parent portion of the trial (Project ID:00114894). Findings from this study will be disseminated through open-access publications in peer-reviewed journals and using social media. TRIAL REGISTRATION: Clinicaltrials.gov NCT05358990 . Registered on May 3, 2022.

Good or best practice statements: proposal for the operationalisation and implementation of GRADE guidance.

An evidence-based approach is considered the gold standard for health decision-making. Sometimes, a guideline panel might judge the certainty that the desirable effects of an intervention clearly outweigh its undesirable effects as high, but the body of supportive evidence is indirect. In such cases, the application of the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) approach for grading the strength of recommendations is inappropriate. Instead, the GRADE Working Group has recommended developing ungraded best or good practice statement (GPS) and developed guidance under which circumsances they would be appropriate.Through an evaluation of COVID-1- related recommendations on the eCOVID Recommendation Map (COVID-19.recmap.org), we found that recommendations qualifying a GPS were widespread. However, guideline developers failed to label them as GPS or transparently report justifications for their development. We identified ways to improve and facilitate the operationalisation and implementation of the GRADE guidance for GPS.Herein, we propose a structured process for the development of GPSs that includes applying a sequential order for the GRADE guidance for developing GPS. This operationalisation considers relevant evidence-to-decision criteria when assessing the net consequences of implementing the statement, and reporting information supporting judgments for each criterion. We also propose a standardised table to facilitate the identification of GPS and reporting of their development. This operationalised guidance, if endorsed by guideline developers, may palliate some of the shortcomings identified. Our proposal may also inform future updates of the GRADE guidance for GPS.

Paper 2: Performing rapid reviews.

BACKGROUND: Health policy-makers must often make decisions in compressed time frames and with limited resources. Hence, rapid reviews have become a pragmatic alternative to comprehensive systematic reviews. However, it is important that rapid review methods remain rigorous to support good policy development and decisions. There is currently little evidence about which streamlined steps in a rapid review are less likely to introduce unacceptable levels of uncertainty while still producing a product that remains useful to policy-makers. METHODS: This paper summarizes current research describing commonly used methods and practices that are used to conduct rapid reviews and presents key considerations and options to guide methodological choices for a rapid review. RESULTS: The most important step for a rapid review is for an experienced research team to have early and ongoing engagement with the people who have requested the review. A clear research protocol, derived from a needs assessment conducted with the requester, serves to focus the review, defines the scope of the rapid review, and guides all subsequent steps. Common recommendations for rapid review methods include tailoring the literature search in terms of databases, dates, and languages. Researchers can consider using a staged search to locate high-quality systematic reviews and then subsequently published primary studies. The approaches used for study screening and selection, data extraction, and risk-of-bias assessment should be tailored to the topic, researcher experience, and available resources. Many rapid reviews use a single reviewer for study selection, risk-of-bias assessment, or data abstraction, sometimes with partial or full verification by a second reviewer. Rapid reviews usually use a descriptive synthesis method rather than quantitative meta-analysis. Use of brief report templates and standardized production methods helps to speed final report publication. CONCLUSIONS: Researchers conducting rapid reviews need to make transparent methodological choices, informed by stakeholder input, to ensure that rapid reviews meet their intended purpose. Transparency is critical because it is unclear how or how much streamlined methods can bias the conclusions of reviews. There are not yet internationally accepted standards for conducting or reporting rapid reviews. Thus, this article proposes interim guidance for researchers who are increasingly employing these methods.

Bibliometric study of 'overviews of systematic reviews' of health interventions: Evaluation of prevalence, citation and journal impact factor.

Overviews synthesising the results of multiple systematic reviews help inform evidence-based clinical practice. In this first of two companion papers, we evaluate the bibliometrics of overviews, including their prevalence and factors affecting citation rates and journal impact factor (JIF). We searched MEDLINE, Epistemonikos and Cochrane Database of Systematic Reviews (CDSR). We included overviews that: (a) synthesised reviews, (b) conducted a systematic search, (c) had a methods section and (d) examined a healthcare intervention. Multivariable regression was conducted to determine the association between citation density, JIF and six predictor variables. We found 1218 overviews published from 2000 to 2020; the majority (73%) were published in the most recent 5-year period. We extracted a selection of these overviews (n = 541; 44%) dated from 2000 to 2018. The 541 overviews were published in 307 journals; CDSR (8%), PLOS ONE (3%) and Sao Paulo Medical Journal (2%) were the most prevalent. The majority (70%) were published in journals with impact factors between 0.05 and 3.97. We found a mean citation count of 10 overviews per year, published in journals with a mean JIF of 4.4. In multivariable analysis, overviews with a high number of citations and JIFs had more authors, larger sample sizes, were open access and reported the funding source. An eightfold increase in the number of overviews was found between 2009 and 2020. We identified 332 overviews published in 2020, which is equivalent to one overview published per day. Overviews perform above average for the journals in which they publish.

A new taxonomy was developed for overlap across 'overviews of systematic reviews': A meta-research study of research waste.

Multiple 'overviews of reviews' conducted on the same topic ("overlapping overviews") represent a waste of research resources and can confuse clinicians making decisions amongst competing treatments. We aimed to assess the frequency and characteristics of overlapping overviews. MEDLINE, Epistemonikos and Cochrane Database of Systematic Reviews were searched for overviews that: synthesized reviews of health interventions and conducted systematic searches. Overlap was defined as: duplication of PICO eligibility criteria, and not reported as an update nor a replication. We categorized overview topics according to 22 WHO ICD-10 medical classifications, overviews as broad or narrow in scope, and overlap as identical, nearly identical, partial, or subsumed. Subsummation was defined as when broad overviews subsumed the populations, interventions and at least one outcome of another overview. Of 541 overviews included, 169 (31%) overlapped across similar PICO, fell within 13 WHO ICD-10 medical classifications, and 62 topics. 148/169 (88%) overlapping overviews were broad in scope. Fifteen overviews were classified as having nearly identical overlap (9%); 123 partial overlap (73%), and 31 subsumed (18%) others. One third of overviews overlapped in content and a majority covered broad topic areas. A multiplicity of overviews on the same topic adds to the ongoing waste of research resources, time, and effort across medical disciplines. Authors of overviews can use this study and the sample of overviews to identify gaps in the evidence for future analysis, and topics that are already studied, which do not need to be duplicated.

Screening for depression among the general adult population and in women during pregnancy or the first-year postpartum: two systematic reviews to inform a guideline of the Canadian Task Force on Preventive Health Care.

BACKGROUND: Depression affects an individual's physical health and mental well-being and, in pregnant and postpartum women, has specific adverse short- and long-term effects on maternal, child, and family health. The aim of these two systematic reviews is to identify evidence on the benefits and harms of screening for depression compared to no screening in the general adult and pregnant and postpartum populations in primary care or non-mental health clinic settings. These reviews will inform recommendations by the Canadian Task Force on Preventive Health Care. METHODS: We searched MEDLINE, Embase, PsycINFO, CINAHL, and the Cochrane Library using a randomized controlled trial filter, where applicable, October 4, 2018, and updated to May 11, 2020. We also searched for gray literature (e.g., websites of organizations of health professionals and patients). Study selection for depression screening trials was performed first on title and abstract, followed by full-text screening. Data extraction, assessment of the risk of bias using the Cochrane risk of bias tool, and application of Grading of Recommendations Assessment, Development and Evaluation were performed by one reviewer and validated by a second reviewer. RESULTS: A total of three trials were included. All three trials were included in the general adult review, while one of the three trials was included in the pregnant and postpartum review. We did not pool results due to substantial differences between studies and high risk of bias. In the general adult review, the first trial (n = 1001) evaluated whether screening for depression in adults with acute coronary syndrome compared to usual care improves health-related quality of life, depression symptoms, or harms of screening at 6, 12, and 18 months. There were little to no differences between the groups at 18 months for the outcomes. The second trial included adults (n = 1412) undergoing initial consultation for osteoarthritis, evaluated for depression and general health (mental and physical) after initial consultation and at 3, 6, and 12 months. The physical component score was statistically significantly lower (worse health) in the screened group at 6 months; however, this difference was not significant at 3 or at 12 months. There were no clinically important or statistically significant differences for other outcomes between groups at any time. The third trial (included in both reviews) reported on 462 postpartum women. At 6 months postpartum, fewer women in the screening group were identified as possibly depressed compared to the control group (RR 0.59, 95% confidence interval (CI) 0.39 to 0.89) and mean EPDS scores were also statistically significantly lower in the screened group (standardized mean difference 0.34 lower (95% CI 0.15 to 0.52 lower)). All other outcomes did not differ between groups at follow-up. There were serious concerns about the cut-offs used for the questionnaire used to screen, diagnostic confirmation, selective outcome reporting, and the reported magnitude of effects. DISCUSSION: There are limitations of the evidence included in the reviews. There was moderate certainty in the evidence from one trial that screening for depression in the general adult population in primary care or non-mental health clinic settings likely results in little to no difference on reported outcomes; however, the evidence was uncertain from the other two included trials. The evidence is very uncertain about the effect of screening for depression in pregnant or postpartum women in primary care or non-mental health clinic settings. Well-conducted and better-reported trials are needed that meet the screening trial criteria used in this review. SYSTEMATIC REVIEW REGISTRATION: Both protocols have been registered in the International Prospective Registry of Systematic Reviews (PROSPERO) [adult: CRD42018099690 ; pregnancy and postpartum: CRD42018099689 ] and published ( https://systematicreviewsjournal.biomedcentral.com/track/pdf/10.1186/s13643-018-0930-3 ).

Which actionable statements qualify as good practice statements In Covid-19 guidelines? A systematic appraisal.

OBJECTIVES: To evaluate the development and quality of actionable statements that qualify as good practice statements (GPS) reported in COVID-19 guidelines. DESIGN AND SETTING: Systematic review . We searched MEDLINE, MedSci, China National Knowledge Infrastructure (CNKI), databases of Grading of Recommendations Assessment, Development and Evaluation (GRADE) Guidelines, NICE, WHO and Guidelines International Network (GIN) from March 2020 to September 2021. We included original or adapted recommendations addressing any COVID-19 topic. MAIN OUTCOME MEASURES: We used GRADE Working Group criteria for assessing the appropriateness of issuing a GPS: (1) clear and actionable; (2) rationale necessitating the message for healthcare practice; (3) practicality of systematically searching for evidence; (4) likely net positive consequences from implementing the GPS and (5) clear link to the indirect evidence. We assessed guideline quality using the Appraisal of Guidelines for Research and Evaluation II tool. RESULTS: 253 guidelines from 44 professional societies issued 3726 actionable statements. We classified 2375 (64%) as GPS; of which 27 (1%) were labelled as GPS by guideline developers. 5 (19%) were labelled as GPS by their authors but did not meet GPS criteria. Of the 2375 GPS, 85% were clear and actionable; 59% provided a rationale necessitating the message for healthcare practice, 24% reported the net positive consequences from implementing the GPS. Systematic collection of evidence was deemed impractical for 13% of the GPS, and 39% explained the chain of indirect evidence supporting GPS development. 173/2375 (7.3%) statements explicitly satisfied all five criteria. The guidelines' overall quality was poor regardless of the appropriateness of GPS development and labelling. CONCLUSIONS: Statements that qualify as GPS are common in COVID-19 guidelines but are characterised by unclear designation and development processes, and methodological weaknesses.

A taxonomy and framework for identifying and developing actionable statements in guidelines suggests avoiding informal recommendations.

OBJECTIVE: To propose a taxonomy and framework that identifies and presents actionable statements in guidelines. STUDY DESIGN AND SETTING: We took an iterative approach reviewing case studies of guidelines produced by the World Health Organization and the American Society of Hematology to develop an initial conceptual framework. We then tested it using randomly selected recommendations from published guidelines addressing COVID-19 from different organizations, evaluated its results, and refined it before retesting. The urgency and availability of evidence for development of these recommendations varied. We consulted with experts in research methodology and guideline developers to improve the final framework. RESULTS: The resulting taxonomy and framework distinguishes five types of actional statements: formal recommendations; research recommendations; good practice statements; implementation considerations, tools and tips; and informal recommendations. These statements should respond to a priori established criteria and require a clear structure and recognizable presentation in a guideline. Most importantly, this framework identifies informal recommendations that differ from formal recommendations by how they consider evidence and in their development process. CONCLUSION: The identification, standardization and explicit labelling of actionable statements according to the framework may support guideline developers to create actionable statements with clear intent, avoid informal recommendations and improve their understanding and implementation by users.

American Society of Hematology living guidelines on the use of anticoagulation for thromboprophylaxis in patients with COVID-19: January 2022 update on the use of therapeutic-intensity anticoagulation in acutely ill patients.

BACKGROUND: COVID-19-related acute illness is associated with an increased risk of venous thromboembolism (VTE). OBJECTIVE: These evidence-based guidelines from the American Society of Hematology (ASH) are intended to support patients, clinicians, and other health care professionals in making decisions about the use of anticoagulation in patients with COVID-19. METHODS: ASH formed a multidisciplinary guideline panel that included patient representatives and applied strategies to minimize potential bias from conflicts of interest. The McMaster University GRADE Centre supported the guideline development process and performed systematic evidence reviews (through November 2021). The panel prioritized clinical questions and outcomes according to their importance for clinicians and patients. The panel used the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to assess evidence and make recommendations, which were subject to public comment. This is an update to guidelines published in February 2021 as part of the living phase of these guidelines. RESULTS: The panel made one additional recommendation. The panel issued a conditional recommendation in favor of therapeutic-intensity over prophylactic-intensity anticoagulation in patients with COVID-19-related acute illness who do not have suspected or confirmed VTE. The panel emphasized the need for an individualized assessment of risk of thrombosis and bleeding. The panel also noted that heparin (unfractionated or low molecular weight) may be preferred because of a preponderance of evidence with this class of anticoagulants. CONCLUSION: This conditional recommendation was based on very low certainty in the evidence, underscoring the need for additional, high-quality, randomized controlled trials comparing different intensities of anticoagulation in patients with COVID-19-related acute illness.

American Society of Hematology living guidelines on the use of anticoagulation for thromboprophylaxis for patients with COVID-19: March 2022 update on the use of anticoagulation in critically ill patients.

BACKGROUND: COVID-19-related critical illness is associated with an increased risk of venous thromboembolism (VTE). OBJECTIVE: These evidence-based guidelines of the American Society of Hematology (ASH) are intended to support patients, clinicians, and other health care professionals in decisions about the use of anticoagulation for patients with COVID-19. METHODS: ASH formed a multidisciplinary guideline panel, including 3 patient representatives, and applied strategies to minimize potential bias from conflicts of interest. The McMaster University Grading of Recommendations Assessment, Development and Evaluation (GRADE) Centre supported the guideline development process, including performing systematic evidence reviews (up to January 2022). The panel prioritized clinical questions and outcomes according to their importance for clinicians and patients. The panel used the GRADE approach to assess evidence and make recommendations, which were subject to public comment. This is an update to guidelines published in February 2021 and May 2021 as part of the living phase of these guidelines. RESULTS: The panel made 1 additional recommendation: a conditional recommendation for the use of prophylactic-intensity over therapeutic-intensity anticoagulation for patients with COVID-19-related critical illness who do not have suspected or confirmed VTE. The panel emphasized the need for an individualized assessment of thrombotic and bleeding risk. CONCLUSIONS: This conditional recommendation was based on very low certainty in the evidence, underscoring the need for additional, high-quality, randomized controlled trials comparing different intensities of anticoagulation for patients with COVID-19-related critical illness.

American Society of Hematology living guidelines on the use of anticoagulation for thromboprophylaxis in patients with COVID-19: July 2021 update on postdischarge thromboprophylaxis.

BACKGROUND: COVID-19-related acute illness is associated with an increased risk of venous thromboembolism (VTE). OBJECTIVE: These evidence-based guidelines of the American Society of Hematology (ASH) are intended to support patients, clinicians, and other health care professionals in decisions about the use of anticoagulation for thromboprophylaxis in patients with COVID-19 who do not have confirmed or suspected VTE. METHODS: ASH formed a multidisciplinary guideline panel, including 3 patient representatives, and applied strategies to minimize potential bias from conflicts of interest. The McMaster University GRADE Centre supported the guideline development process, including performing systematic evidence reviews (up to March 2021). The panel prioritized clinical questions and outcomes according to their importance for clinicians and patients. The panel used the grading of recommendations assessment, development, and evaluation (GRADE) approach to assess evidence and make recommendations, which were subject to public comment. RESULTS: The panel agreed on 1 additional recommendation. The panel issued a conditional recommendation against the use of outpatient anticoagulant prophylaxis in patients with COVID-19 who are discharged from the hospital and who do not have suspected or confirmed VTE or another indication for anticoagulation. CONCLUSIONS: This recommendation was based on very low certainty in the evidence, underscoring the need for high-quality randomized controlled trials assessing the role of postdischarge thromboprophylaxis. Other key research priorities include better evidence on assessing risk of thrombosis and bleeding outcomes in patients with COVID-19 after hospital discharge.