Gender Differences in Authorship and Quality of Anesthesia Clinical Practice Guidelines From 2016 to 2020 Using the Appraisal of Guidelines for Research and Evaluation II Instrument.

INTRODUCTION: Women continue to be underrepresented in academic anesthesiology. This study assessed guidelines in anesthesia journals over the past 5 years, evaluating differences in woman-led versus man-led guidelines in terms of author gender, quality, and changes over time. We hypothesized that anesthesia guidelines would be predominately man-led, and that there would be differences in quality between woman-led versus man-led guidelines. METHODS: All clinical practice guidelines published in the top 10 anesthesia journals were identified as per Clarivate Analytics Impact Factor between 2016 and 2020. Fifty-one guidelines were included for author, gender, and quality analysis using the Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument. Each guideline was assessed across 6 domains and 23 items and given an overall score, overall quality score, and overall rating/recommendation. Stratified and trend analyses were performed for woman-led versus man-led guidelines. RESULTS: Fifty out of 51 guidelines were included: 1 was excluded due to unidentifiable first-author gender. In total, 255 of 1052 (24%) authors were women, and woman-led guidelines (woman-first author) represented 12 of 50 (24%) overall guidelines. Eighteen percent (9 of 50) of guidelines had all-male authors, and a majority (26 of 50, 52%) had less than one-third of female authors. The overall number and percentage of woman-led guidelines did not change over time. There was a significantly higher percentage of female authors in woman-led versus man-led guidelines, median 39% vs 20% (P = .012), as well as a significantly higher number of female coauthors in guidelines that were woman-led median 3.5 vs 1.0, P = .049. For quality, there was no significant difference in the overall rating or objective quality of woman- versus man-led guidelines. However, there was a significant increase in the overall rating of all the guidelines over time (P = .010), driven by the increase in overall rating among man-led guidelines, P = .002. The overall score of guidelines did not increase over time; however, they increased in man-led but not woman-led guidelines. There was no significant correlation between the percentage of female authors per guideline and either overall score or overall rating. CONCLUSIONS: There is a substantial disparity in the number of women leading and contributing to guidelines which has not improved over time. Woman-led guidelines included more women and a higher percentage of women. There was no difference in quality of guidelines by first-author gender or percentage of female authors. Further systematic and quota-driven sponsorship is needed to promote gender equity, diversity, and inclusion in anesthesia guidelines.

A decade of systematic reviews: an assessment of Weill Cornell Medicine's systematic review service.

Background: The Weill Cornell Medicine, Samuel J. Wood Library's Systematic Review (SR) service began in 2011, with 2021 marking a decade of service. This paper will describe how the service policies have grown and will break down our service quantitatively over the past 11 years to examine SR timelines and trends. Case Presentation: We evaluated 11 years (2011-2021) of SR request data from our in-house documentation. In the years assessed, there have been 319 SR requests from 20 clinical departments, leading to 101 publications with at least one librarian collaborator listed as co-author. The average review took 642 days to publication, with the longest at 1408 days, and the shortest at 94 days. On average, librarians spent 14.7 hours in total on each review. SR projects were most likely to be abandoned at the title/abstract screening phase. Several policies have been put into place over the years in order to accommodate workflows and demand for our service. Discussion: The SR service has seen several changes since its inception in 2011. Based on the findings and emerging trends discussed here, our service will inevitably evolve further to adapt to these changes, such as machine learning-assisted technology.

Quality of recent clinical practice guidelines in anaesthesia publications using the Appraisal of Guidelines for Research and Evaluation II instrument.

Clinical practice guidelines are a valuable resource aiding medical decision-making based on scientific evidence. In anaesthesia, guidelines are increasing in both number and scope, influencing individual practice and shaping local departmental policy. The aim of this review is to assess the quality of clinical practice guidelines published in high impact anaesthesia journals over the past 5 yr using the internationally validated Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument. A literature search was conducted in Scopus to identify all guidelines published in the top 10 anaesthesia journals as per Clarivate Analytics Impact Factor from 2016 and 2020. Fifty-one guidelines were included for analysis by five independent appraisers using AGREE II. Each guideline was assessed across six domains and 23 items. Individual domain scores were calculated with a threshold agreed via consensus to represent high-quality guidelines. There was a significant increase in overall score over time (P=0.041), driven by Domain 3 (Rigour of Development, P=0.046). The raw overall score for Domain 3, however, was low. The other domains performed as expected based on previous studies, with Domains 1, 4, and 6 achieving high scores and Domains 2 and 5 incurring poor ratings. Most guidelines studied involved international collaboration but emerged from a single professional society. Use of an appraisal tool was stated as high but poorly detailed. The improvement in the overall score of guidelines and rigour of development is promising; however, only seven guidelines met high-quality criteria, suggesting room for improvement for the overall integrity of guidelines in anaesthesia.

Evaluation of spin in the abstracts of systematic reviews and meta-analyses relating to postoperative nausea and vomiting.

INTRODUCTION: Spin - the beautification of study results to emphasise benefits or minimise harms - is a deceptive reporting strategy with the potential to affect clinical decision-making adversely. Few studies have investigated the extent of spin in systematic reviews. Here, we sought to address this gap by evaluating the presence of the nine most severe forms of spin in the abstracts of systematic reviews on treatments for postoperative nausea and vomiting (PONV). PONV has the potential to increase hospital costs and patient burden, adversely affecting outcomes. METHODS: We developed search strategies for MEDLINE and Embase to identify systematic reviews focused on PONV. Following title and abstract screening of the reviews identified during the initial search, those that met inclusion criteria were evaluated for the presence of spin and received a revised AMSTAR-2 (A Measurement Tool to Assess Systematic Reviews) appraisal by two investigators in a masked, duplicate manner. Study characteristics for each review were also extracted in duplicate. RESULTS: Our systematic search returned 3513 studies, of which 130 systematic reviews and meta-analyses were eligible for data extraction. We found that 29.2% of included systematic reviews contained spin (38/130). Eight of the nine types of spin were identified, with spin type 3 ('selective reporting of or overemphasis on efficacy outcomes or analysis favouring the beneficial effect of the experimental intervention') being the most common. Associations were found between spin and funding source. Spin was more likely in the abstracts of privately funded than nonfunded studies, odds ratio (OR) 2.81 [95% confidence interval (CI), 0.66 to 11.98]. In the abstracts of studies not mentioning funding spin was also more likely than in nonfunded studies, OR 2.30 (95% CI, 0.61 to 8.70). Neither of these results were statistically significant. Significance was found in the association between the presence of spin and AMSTAR-2 ratings: 'low' quality studies were less likely to contain spin than 'high' quality, OR 0.24 (95% CI, 0.07 to 0.88): 'critically low' studies were also less likely to contain spin than 'high' quality studies, OR 0.21 (95% CI, 0.07 to 0.65). There were no other associations between spin and the remaining extracted study characteristics or AMSTAR-2 ratings. CONCLUSION: Spin was present in greater than 29% of abstracts of systematic reviews and meta-analyses regarding PONV. Various stakeholders must take steps to improve the reporting quality of abstracts on PONV.

Spin Infrequently Occurs in Abstracts of Systematic Reviews For The Pharmacological Treatment of Type 2 Diabetes Mellitus.

AIMS: Currently, there is a growing body of research demonstrating that spin - the misinterpretation and distortion of a study's findings - is common in different fields of medicine. To our knowledge, no study has investigated its presence in systematic reviews focused on diabetic therapies. METHODS: We performed a cross-sectional study by searching MEDLINE and Embase for systematic reviews focused on pharmacologic treatments for type 2 diabetes mellitus. Our search retrieved 26,490 records, from which 199 studies were extracted in a masked, duplicate fashion. Each study was evaluated for the nine most severe types of spin and other study design parameters. Spin was presented as frequencies and odds ratios to identify associations between study characteristics. RESULTS: Spin was identified in the abstracts of 15 systematic reviews (15/199, 7.5%). Spin type 5 was the most common type identified (7/199, 3.5%). Spin types 1, 2, 4, and 8 were not identified. In the last 5 years (2016-2021), 7 systematic reviews contained spin within their abstract. There was no association between spins presence and any extracted study characteristic . CONCLUSIONS: Our findings show that spin infrequently occurs in abstracts of systematic reviews focused on pharmacologic therapies for type 2 diabetes mellitus. However, any amount of spin can lead to the distortion of a reader's interpretation of the study's findings. Thus, we provide recommendations with rationale to prevent spin in future systematic reviews.

Achieving universal genetic assessment for women with ovarian cancer: Are we there yet? A systematic review and meta-analysis.

PURPOSE: Several professional organizations recommend universal genetic assessment for people with ovarian cancer as identifying pathogenic variants can affect treatment, prognosis, and all-cause mortality for patients and relatives. We sought to evaluate the literature on genetic assessment for women with ovarian cancer and determine if any interventions or patient characteristics drive utilization of services. METHODS: We searched key electronic databases to identify trials that evaluated genetic assessment for people with ovarian cancer. Trials with the primary aim to evaluate utilization of genetic assessment with or without interventions were included. Eligible trials were subjected to meta-analysis and the moderating influence of health interventions on rates of genetic assessment were examined. RESULTS: A total of 35 studies were included (19 report on utilization of genetic services without an intervention, 7 with an intervention, and 9 with both scenarios). Without an intervention, pooled estimates for referral to genetic counseling and completion of genetic testing were 39% [CI 27-53%] and 30% [CI 19-44%]. Clinician-facilitated interventions included: mainstreaming of genetic services (99% [CI 86-100%]), telemedicine (75% [CI 43-93%]), clinic-embedded genetic counselor (76% [CI 32-95%]), reflex tumor somatic genetic assessment (64% [CI 17-94%]), universal testing (57% [28-82%]), and referral forms (26% [CI 10-53%]). Random-effects pooled proportions demonstrated that Black vs. White race was associated with a lower rate of genetic testing (26%[CI 17-38%] vs. 40% [CI 25-57%]) as was being un-insured vs. insured (23% [CI 18-28%] vs. 38% [CI 26-53%]). CONCLUSIONS: Reported rates of genetic testing for people with ovarian cancer remain well below the goal of universal testing. Interventions such as mainstreaming can improve testing uptake. Strategies aimed at improving utilization of genetic services should consider existing disparities in race and insurance status.

Over 30% of Systematic Reviews and Meta-analyses Focused on Rotator Cuff Tear Treatments Contained Spin in the Abstract.

PURPOSE: The purpose of this study is to determine the prevalence of spin in the abstracts of systematic reviews and meta-analyses on treatments for rotator cuff tears and whether various study and publishing journal characteristics were associated with the presence of spin. METHODS: A search strategy was developed for Ovid MEDLINE and Ovid Embase to retrieve systematic reviews focused on treatments for rotator cuff tears. For an article to be included, it must meet the following criteria: (1) the article must be a systematic review with or without a meta-analysis, (2) the article must pertain to the treatment of rotator cuff tears, (3) the article must only contain human subjects, and (4) the article must be accessible in English. Systematic reviews were analyzed for spin using a previously developed classification scheme in a masked, duplicate manner. Binary logistic regression was used to examine independent associations via unadjusted odds ratios and 95% confidence intervals between the presence of spin and study characteristics. RESULTS: Search queries returned 932 articles, of which 121 systematic reviews and meta-analyses were eligible. A total of 36.4% (44/121) of systematic reviews contained spin. Among the general characteristics evaluated, there were no correlations with spin. CONCLUSIONS: Spin was present in more than one-third of systematic reviews and meta-analyses covering rotator cuff tear treatments. Spin was not associated with any general study or journal characteristics, which indicates that clinicians must be aware of the potential presence of spin in all such abstracts. CLINICAL RELEVANCE: Clinicians rely on systematic reviews and meta-analyses, especially abstracts of these articles, to provide succinct guidance on best practices in patient care. The presence of spin could adversely affect patient care; thus, steps should be taken to improve the reporting quality of abstracts on rotator cuff tear treatment.

Evaluation of spin in the abstracts of systematic reviews and meta-analyses focused on treatments of alcohol use disorder.

Background: With 14.4 million U.S. adults diagnosed with alcohol use disorder (AUD) annually, effective treatments for combatting this condition are essential. Clinicians are often guided by systematic reviews and meta-analyses - considered the gold standard of research. Spin, a biased way of reporting results, may lead to misinterpretation of research findings, resulting in suboptimal patient care.Objective: Our primary objective was to investigate the presence of spin in the abstracts of systematic reviews of AUD treatments.Methods: After systematically searching MEDLINE and Embase for systematic reviews of AUD treatments, abstracts were evaluated for the nine most severe types of spin. Additional article characteristics were concurrently extracted and study quality was evaluated. Descriptive statistics of spin were calculated and associations between spin and study characteristics were determined through Fisher's exact and logistic regression.Results: Among 79 included systematic reviews, 44 instances of spin were identified spanning 43% of our sample (34/79). Of the nine forms of spin, eight were found with a majority of instances being "selective reporting of or overemphasis on efficacy outcomes" (13/44, 29.5% of cases). The majority of articles were rated as critically low quality (51/79, 64.6%). No association was found between the presence of spin and extracted study characteristics.Conclusions: Spin was found in more than 40% of systematic review abstracts that evaluated pharmacotherapies in the treatment of AUD. Coupled with the finding that the majority of systematic reviews on the subject were of low quality, increased awareness of spin among physicians may be warranted.

Evaluation of spin in the abstracts of systematic reviews and meta-analyses of studies on opioid use disorder.

BACKGROUND: Spin, or the inappropriate formatting of information to emphasize certain outcomes, should not be present in research. This study focuses on identifying and characterizing the presence of spin in systematic review and meta-analysis abstracts that focus on the treatment of opioid use disorder. Methods: Search strategies were developed to identify studies pertaining to the treatment of opioid use disorder. The studies were then screened by two authors. These qualifying studies were then evaluated for the presence of spin within their abstracts by two trained authors. These studies were also evaluated by the AMSTAR-2 standards to evaluate the quality of the qualifying systematic reviews by two trained reviewers. Results: The sample in this study included 113 systematic reviews and meta-analyses. Spin was present in 20 of these studies (20/113, 17.7%). The most common spin form was spin type 3 (6/20, 30%), followed by types 5 and 9 (both 4/20, 20%), type 6 (3/20, 15%), type 7 (2/20, 10%), and type 8 (1/20, 5%). The remaining spin types 1, 2, and 4 were not present in the sample. Of the 113 included studies, the most common intervention type was pharmacologic (93/113, 82%). No significant association was found between the quality of a systematic review and the presence of spin. Conclusions: Findings in this study show positive trends in prevalence of five forms of spin evaluated in abstracts of systematic reviews and meta-analyses looking at treatments for opioid use disorder. However, study quality had no significant association with the presence of spin. Misrepresentation of results, or spin, may alter a clinician's perceptions about treatment efficacies. Therefore, increasing physician awareness of spin may improve clinical decision-making.

Evaluating spin in the abstracts of systematic reviews and meta-analyses on cannabis use disorder.

BACKGROUND: Clinicians rely upon abstracts to provide them quick synopses of research findings that may apply to their practice. Spin can exist within these abstracts that distorts or misrepresents the findings. Our goal was to evaluate the level of spin within systematic reviews (SRs) focused on the treatment of cannabis use disorder (CUD). Methods: A systematic search was conducted in May 2020. To meet inclusion criteria, publications had to be either an SR or meta-analysis related to the treatment of cannabis use. Screening and data extraction was performed in a duplicate and masked fashion. Study quality was assessed using AMSTAR-2 Results: 16/24 SRs (66.7%) contained at least one form of spin in the abstract. The most common forms of spin identified were type 3-selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention (45.8%)-and type 8-the review's findings from a surrogate marker or a specific outcome to the global improvement of the disease (37.5%). No significant association between spin and intervention type, PRISMA requirements, or funding source was identified. Weak positive correlations were found between the presence of spin and abstract word count (r =.217) and between spin and AMSTAR-2 rating (r = 0.143). "Moderate" was the most common AMSTAR-2 rating (9/24, 37.5%), followed by "low" (7/24, 29.2%) and "critically low" (7/24, 29.2%). One systematic review received an AMSTAR-2 rating of "high" (1/24, 4.2%). Conclusions: Spin was common among abstracts from the SRs focused on the treatments for CUD. Higher quality studies may help reduce the overall rate as well as standardizing treatment outcomes. To facilitate this, we encourage all authors, peer-reviewers, and editors to be more aware of the various types of spin as they can help reduce the overall amount of spin seen within the literature.

Evaluation of spin in the abstracts of systematic reviews and meta-analyses related to the treatment of proximal humerus fractures.

BACKGROUND: Research has shown that many physicians rely solely on abstracts to make clinical decisions. However, many abstracts have been shown to be misleading. The primary objective of this study was to identify the prevalence of spin - bias towards particular results - within the abstracts of systematic reviews and meta-analyses pertaining to the treatment of proximal humerus fractures, one of the most common osteoporotic fractures among elderly patients. METHODS: We systematically searched MEDLINE and Embase databases to identify systematic reviews and meta-analyses examining the treatment of proximal humerus fractures. Screening and data extraction occurred in a masked, duplicate fashion. The nine most severe types of spin that occur within abstracts were extracted along with study characteristics, including journal recommendations to adhere to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) and year in which the review was performed, to identify potential associations. We subsequently explored the association between spin and the methodological quality of a systematic review using the revised A MeaSurement Tool to Assess systematic Reviews (AMSTAR 2) appraisal instrument. RESULTS: Our search retrieved 505 articles, of which 73 systematic reviews met inclusion criteria. We found that 34.2% (25/73) of the included systematic reviews contained spin. Spin type 3 (selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention) was the most common type identified (12/73, 16.4%). Three spin types were not identified in any of the abstracts. Spin was 3.2 (OR 3.2; 95% CI, 1.02-10.02) times more likely to be present in systematic reviews published in journals recommending adherence to PRISMA. Furthermore, the odds of an abstract containing spin was 1.25 (OR 1.25; 95% CI, 1.02-1.52) times more likely to be present in systematic reviews for each year after 2000. No other study characteristics were associated with spin. The methodological quality of 24 studies were rated as "critically low" (32.9%), 14 were "low" (19.2%), 28 were "moderate" (38.4%), and 7 were "high" (9.6%), but these findings were not associated with spin. CONCLUSION: Spin was present in systematic review abstracts regarding treatment of proximal humerus fractures. Measures such as education on the subject of spin and improved reporting standards should be implemented to increase awareness and reduce incidence of spin in abstracts. LEVEL OF EVIDENCE OF THE STUDY PERFORMED: Basic Science Study; Research Methodology.

Supporting Consensus Statements: Considerations and Recommendations for a Systematic Review Service.

Increasingly, a critical eye has been placed on the methodological quality of consensus statements. As expert systematic review (SR) methodologists, librarians are often called on to support consensus statement work. Using the Weill Cornell Medicine Samuel J. Wood Library's SR Service experience as a guide, the aim of this paper is to answer three main questions regarding librarians supporting consensus statement work: (1) What is a consensus statement? (2) What is consensus statement methodology and how does this compare to practice guidelines? (3) What are important and practical points to consider when supporting this kind of request?

An assessment of the quality of current clinical meta-analyses.

BACKGROUND: The objective of this study was to assess the overall quality of study-level meta-analyses in high-ranking journals using commonly employed guidelines and standards for systematic reviews and meta-analyses. METHODS: 100 randomly selected study-level meta-analyses published in ten highest-ranking clinical journals in 2016-2017 were evaluated by medical librarians against 4 assessments using a scale of 0-100: the Peer Review of Electronic Search Strategies (PRESS), Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), Institute of Medicine's (IOM) Standards for Systematic Reviews, and quality items from the Cochrane Handbook. Multiple regression was performed to assess meta-analyses characteristics' associated with quality scores. RESULTS: The overall median (interquartile range) scores were: PRESS 62.5(45.8-75.0), PRISMA 92.6(88.9-96.3), IOM 81.3(76.6-85.9), and Cochrane 66.7(50.0-83.3). Involvement of librarians was associated with higher PRESS and IOM scores on multiple regression. Compliance with journal guidelines was associated with higher PRISMA and IOM scores. CONCLUSION: This study raises concerns regarding the reporting and methodological quality of published MAs in high impact journals Early involvement of information specialists, stipulation of detailed author guidelines, and strict adherence to them may improve quality of published meta-analyses.

A Systematic Review of Postoperative Delirium in the Urologic Patient.

PURPOSE OF REVIEW: Postoperative delirium (POD) is a common phenomenon among general surgery patients, but it is not well described in urologic surgical patients. We sought to define the incidence and predictive risk factors for POD in patients undergoing urologic surgery. RECENT FINDINGS: Eighteen articles were included for review. The pooled incidence rate of postoperative delirium after urologic surgery was 1.69% (0.69-46.97%). Longer intraoperative time, male sex, unmarried status, and age were shown to be risk factors for POD. POD is common after many urologic surgeries and leads to worse postoperative outcomes and higher healthcare utilization. Future studies are needed to better assess for and prevent POD.

The impact of institutional repositories: a systematic review.

OBJECTIVE: Institutional repositories are platforms for presenting and publicizing scholarly output that might not be suitable to publish in a peer-reviewed journal or that must meet open access requirements. However, there are many challenges associated with their launch and up-keep. The objective of this systematic review was to define the impacts of institutional repositories (IRs) on an academic institution, thus justifying their implementation and/or maintenance. METHODS: A comprehensive literature search was performed in the following databases: Ovid MEDLINE, Ovid EMBASE, the Cochrane Library (Wiley), ERIC (ProQuest), Web of Science (Core Collection), Scopus (Elsevier), and Library, Information Science & Technology Abstracts (EBSCO). A total of 6,593 citations were screened against predefined inclusion and exclusion criteria. RESULTS: Thirteen included studies were divided into 3 areas of impact: citation count, exposure or presence, and administrative impact. Those focusing on citation count (n=5) and exposure or presence (n=7) demonstrated positive impacts of IRs on institutions and researchers. One study focusing on administrative benefit demonstrated the utility of IRs in automated population of ORCID profiles. CONCLUSION: Based on the available literature, IRs appear to have a positive impact on citation count, exposure or presence, and administrative burden. To draw stronger conclusions, more and higher-quality studies are needed.

Burnout among medical and health sciences information professionals who support systematic reviews: an exploratory study.

OBJECTIVE: The aim of this exploratory study was to assess personal, work-related, and client-related burnout among information professionals who support systematic review (SR) work. METHODS: The Copenhagen Burnout Inventory, a validated tool for assessing burnout, was administered to information professionals who support SR work. A broad range of health sciences or medical librarians and information professionals were targeted via professional email discussion lists and news outlets. Questionnaire responses were captured electronically using Qualtrics Survey Software and quantitatively analyzed. RESULTS: Respondents experienced an average personal burnout score of 48.6, work-related score of 46.4, and client-related score of 32.5 out of 100. Respondents who reported spending >80% of their job duties on SR work had significantly lower personal burnout scores than those who reported spending <10% of their job duties on SR work (average, 31.5 versus 50.9, respectively). Also, respondents who reported using an SR support tool had significantly lower personal burnout scores than those who reported sometimes using a tool (average, 43.7 versus 54.7, respectively). CONCLUSION: The results suggest that information professionals who dedicate more time to SR work or who consistently use an SR support tool experience less burnout. This study provides groundwork for further investigation with the aim of developing approaches to prevent or combat SR-related burnout among information professionals.

An Evaluation of Spin in the Abstracts of Systematic Reviews and Meta-analyses on the Treatment of Psoriasis: A Cross-sectional Analysis.

Spin is a way of reporting that distorts the true findings; we sought to investigate the prevalence of spin in systematic review abstracts on psoriasis treatments and whether study characteristics were associated with spin. We searched MEDLINE and Embase to obtain our sample. Screening and data extraction were performed in a masked duplicate fashion. Each included study was evaluated for the 9 most severe types of spin and other study characteristics. The methodological quality was assessed to explore potential relationships between spin and study quality. Search queries returned 3200 articles, which included 173 systematic reviews. Spin was present in systematic review abstracts. Preventing spin is essential for improving future systematic reviews.

Systematic review of current natural language processing methods and applications in cardiology.

Natural language processing (NLP) is a set of automated methods to organise and evaluate the information contained in unstructured clinical notes, which are a rich source of real-world data from clinical care that may be used to improve outcomes and understanding of disease in cardiology. The purpose of this systematic review is to provide an understanding of NLP, review how it has been used to date within cardiology and illustrate the opportunities that this approach provides for both research and clinical care. We systematically searched six scholarly databases (ACM Digital Library, Arxiv, Embase, IEEE Explore, PubMed and Scopus) for studies published in 2015-2020 describing the development or application of NLP methods for clinical text focused on cardiac disease. Studies not published in English, lacking a description of NLP methods, non-cardiac focused and duplicates were excluded. Two independent reviewers extracted general study information, clinical details and NLP details and appraised quality using a checklist of quality indicators for NLP studies. We identified 37 studies developing and applying NLP in heart failure, imaging, coronary artery disease, electrophysiology, general cardiology and valvular heart disease. Most studies used NLP to identify patients with a specific diagnosis and extract disease severity using rule-based NLP methods. Some used NLP algorithms to predict clinical outcomes. A major limitation is the inability to aggregate findings across studies due to vastly different NLP methods, evaluation and reporting. This review reveals numerous opportunities for future NLP work in cardiology with more diverse patient samples, cardiac diseases, datasets, methods and applications.

Spin within systematic review abstracts on antiplatelet therapies after acute coronary syndrome: a cross-sectional study.

OBJECTIVES: Spin is a reporting practice in which study results are misrepresented by overestimating efficacy or underestimating harm. Prevalence of spin varies between clinical specialties, and estimates are based almost entirely on clinical trials. Little is known about spin in systematic reviews. DESIGN: We performed a cross-sectional analysis searching MEDLINE and Embase for systematic reviews and meta-analyses pertaining to antiplatelet therapies following acute coronary syndrome on 2 June 2020. Data were extracted evaluating the presence of spin and study characteristics, including methodological quality as rated by A MeaSurement Tool to Assess systematic Reviews (AMSTAR-2). All data extraction was conducted in a masked, duplicate manner from 2 June 2020 to 26 June 2020. PARTICIPANTS AND SETTING: Not applicable. PRIMARY AND SECONDARY OUTCOME MEASURES: We assessed abstracts of systematic reviews on antiplatelet therapy following acute coronary syndrome and evaluated the prevalence of the nine most severe types of spin. We additionally explored associations between spin and certain study characteristics, including quality. RESULTS: Our searches returned 15 263 articles, and 185 systematic reviews met inclusion criteria. Of these 185 reviews, 31.9% (59/185) contained some form of spin in the abstract. Seven forms of spin (1, 2, 3, 4, 5, 7 and 9) among the nine most severe were identified. No instances of types 6 or 8 were found. There were no statistically significant relationships between spin and the evaluated study characteristics or AMSTAR-2 appraisals. CONCLUSIONS: Spin was present in abstracts for systematic reviews and meta-analyses; subsequent studies are needed to identify correlations between spin and specific study characteristics. There were no statistically significant associations between spin and study characteristics or AMSTAR-2 ratings; however, implementing changes will ensure that spin is reduced in the field of cardiology as well as other fields of medicine.

Evaluation of Spin in the Abstracts of Systematic Reviews and Meta-Analyses Focused on Tinnitus.

HYPOTHESIS: The objective was to investigate the prevalence of spin in abstracts of systematic reviews and meta-analyses covering the treatment of tinnitus. We hypothesized that spin would be present in these articles and a significant relationship would exist between spin usage and extracted study characteristics. BACKGROUND: Spin, the misrepresentation of study findings, can alter a clinician's interpretation of a study's results, potentially affecting patient care. Previous work demonstrates that spin is present in abstracts of randomized clinical trials. METHODS: Using a cross-sectional analysis, we conducted a systematic search using MEDLINE and Embase databases on June 2, 2020, for systematic reviews focused on tinnitus treatment. Investigators performed screening and data extraction in a masked, duplicate fashion. RESULTS: Forty systematic reviews met inclusion criteria, and spin was identified in four of them. Spin in abstracts most frequently occurred when conclusions claimed the beneficial effect of the experimental treatment despite high risk of bias in primary studies (n = 3). The other form of spin found was the conclusion claims safety based on nonstatistically significant results with a wide confidence interval (n = 1). There was no significant association between spin and any of our extracted study characteristics. CONCLUSION: Spin was observed in 10% of abstracts of systematic reviews and meta-analyses covering the treatment of tinnitus. Although this percentage may be small, we recommend that medical journals provide a more detailed framework for abstract structure and require the inclusion of risk of bias assessment results in abstracts to prevent the incorporation of spin.