Gender Differences in Authorship and Quality of Anesthesia Clinical Practice Guidelines From 2016 to 2020 Using the Appraisal of Guidelines for Research and Evaluation II Instrument.

INTRODUCTION: Women continue to be underrepresented in academic anesthesiology. This study assessed guidelines in anesthesia journals over the past 5 years, evaluating differences in woman-led versus man-led guidelines in terms of author gender, quality, and changes over time. We hypothesized that anesthesia guidelines would be predominately man-led, and that there would be differences in quality between woman-led versus man-led guidelines. METHODS: All clinical practice guidelines published in the top 10 anesthesia journals were identified as per Clarivate Analytics Impact Factor between 2016 and 2020. Fifty-one guidelines were included for author, gender, and quality analysis using the Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument. Each guideline was assessed across 6 domains and 23 items and given an overall score, overall quality score, and overall rating/recommendation. Stratified and trend analyses were performed for woman-led versus man-led guidelines. RESULTS: Fifty out of 51 guidelines were included: 1 was excluded due to unidentifiable first-author gender. In total, 255 of 1052 (24%) authors were women, and woman-led guidelines (woman-first author) represented 12 of 50 (24%) overall guidelines. Eighteen percent (9 of 50) of guidelines had all-male authors, and a majority (26 of 50, 52%) had less than one-third of female authors. The overall number and percentage of woman-led guidelines did not change over time. There was a significantly higher percentage of female authors in woman-led versus man-led guidelines, median 39% vs 20% (P = .012), as well as a significantly higher number of female coauthors in guidelines that were woman-led median 3.5 vs 1.0, P = .049. For quality, there was no significant difference in the overall rating or objective quality of woman- versus man-led guidelines. However, there was a significant increase in the overall rating of all the guidelines over time (P = .010), driven by the increase in overall rating among man-led guidelines, P = .002. The overall score of guidelines did not increase over time; however, they increased in man-led but not woman-led guidelines. There was no significant correlation between the percentage of female authors per guideline and either overall score or overall rating. CONCLUSIONS: There is a substantial disparity in the number of women leading and contributing to guidelines which has not improved over time. Woman-led guidelines included more women and a higher percentage of women. There was no difference in quality of guidelines by first-author gender or percentage of female authors. Further systematic and quota-driven sponsorship is needed to promote gender equity, diversity, and inclusion in anesthesia guidelines.

Guidelines and evidence-based recommendations in anaesthesia: where do we stand?

Clinical practice guidelines are increasingly important to guide clinical care. However, they can vary widely in quality, and many recommendations are based on low-level evidence. The COVID-19 pandemic highlighted the need for new flexible formats for rigorously developed guidelines. Future guideline development should be standardised, graded, registered, and updated to ensure that they are 'living' works in progress.

Evaluation of the quality of COVID-19 guidance documents in anaesthesia using the Appraisal of Guidelines for Research and Evaluation II instrument.

BACKGROUND: Guidance documents are a valuable resource to clinicians to guide evidenced-based decision making. The quality of guidelines in anaesthesia and across other specialties has been demonstrated to be poor. COVID-19 presented an urgent need for immediate guidance for anaesthetists as frontline clinicians. The aim of this study was to evaluate the quality of COVID-19 guidance documents using the internationally validated Appraisal of Guidelines for Research & Evaluation (AGREE) II tool. METHODS: A search was conducted in Ovid EMBASE and Ovid MEDLINE to identify all COVID-19 anaesthesia guidance documents from 2020-2021. Thirty-eight guidance documents were selected for analysis by 4 independent appraisers using the AGREE II instrument, across its 6 domains and 23 items. A scoring threshold for high quality was agreed by the working group via consensus. RESULTS: Overall, the body of COVID-19 guidance documents achieved poor scores using AGREE II. Only 5% of documents met the high-quality criteria. Markers of quality included international and multi-institutional collaboration. Document title ('guideline' vs 'consensus statement'/ 'recommendations') did not yield any differences in domain scores and overall quality ratings. Compared with recent general anaesthesia guidelines, COVID-19 guidelines performed significantly worse. CONCLUSIONS: COVID-19 guidance documents published during the first two years of the pandemic lacked rigour and appropriate quality. This raises concern about their trustworthiness for use in clinical practice. Enhanced systems are required to ensure the integrity of rapidly formulated guidance.

Quality of recent clinical practice guidelines in anaesthesia publications using the Appraisal of Guidelines for Research and Evaluation II instrument.

Clinical practice guidelines are a valuable resource aiding medical decision-making based on scientific evidence. In anaesthesia, guidelines are increasing in both number and scope, influencing individual practice and shaping local departmental policy. The aim of this review is to assess the quality of clinical practice guidelines published in high impact anaesthesia journals over the past 5 yr using the internationally validated Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument. A literature search was conducted in Scopus to identify all guidelines published in the top 10 anaesthesia journals as per Clarivate Analytics Impact Factor from 2016 and 2020. Fifty-one guidelines were included for analysis by five independent appraisers using AGREE II. Each guideline was assessed across six domains and 23 items. Individual domain scores were calculated with a threshold agreed via consensus to represent high-quality guidelines. There was a significant increase in overall score over time (P=0.041), driven by Domain 3 (Rigour of Development, P=0.046). The raw overall score for Domain 3, however, was low. The other domains performed as expected based on previous studies, with Domains 1, 4, and 6 achieving high scores and Domains 2 and 5 incurring poor ratings. Most guidelines studied involved international collaboration but emerged from a single professional society. Use of an appraisal tool was stated as high but poorly detailed. The improvement in the overall score of guidelines and rigour of development is promising; however, only seven guidelines met high-quality criteria, suggesting room for improvement for the overall integrity of guidelines in anaesthesia.