RESUMEN
INTRODUCTION: Spin - the beautification of study results to emphasise benefits or minimise harms - is a deceptive reporting strategy with the potential to affect clinical decision-making adversely. Few studies have investigated the extent of spin in systematic reviews. Here, we sought to address this gap by evaluating the presence of the nine most severe forms of spin in the abstracts of systematic reviews on treatments for postoperative nausea and vomiting (PONV). PONV has the potential to increase hospital costs and patient burden, adversely affecting outcomes. METHODS: We developed search strategies for MEDLINE and Embase to identify systematic reviews focused on PONV. Following title and abstract screening of the reviews identified during the initial search, those that met inclusion criteria were evaluated for the presence of spin and received a revised AMSTAR-2 (A Measurement Tool to Assess Systematic Reviews) appraisal by two investigators in a masked, duplicate manner. Study characteristics for each review were also extracted in duplicate. RESULTS: Our systematic search returned 3513 studies, of which 130 systematic reviews and meta-analyses were eligible for data extraction. We found that 29.2% of included systematic reviews contained spin (38/130). Eight of the nine types of spin were identified, with spin type 3 ('selective reporting of or overemphasis on efficacy outcomes or analysis favouring the beneficial effect of the experimental intervention') being the most common. Associations were found between spin and funding source. Spin was more likely in the abstracts of privately funded than nonfunded studies, odds ratio (OR) 2.81 [95% confidence interval (CI), 0.66 to 11.98]. In the abstracts of studies not mentioning funding spin was also more likely than in nonfunded studies, OR 2.30 (95% CI, 0.61 to 8.70). Neither of these results were statistically significant. Significance was found in the association between the presence of spin and AMSTAR-2 ratings: 'low' quality studies were less likely to contain spin than 'high' quality, OR 0.24 (95% CI, 0.07 to 0.88): 'critically low' studies were also less likely to contain spin than 'high' quality studies, OR 0.21 (95% CI, 0.07 to 0.65). There were no other associations between spin and the remaining extracted study characteristics or AMSTAR-2 ratings. CONCLUSION: Spin was present in greater than 29% of abstracts of systematic reviews and meta-analyses regarding PONV. Various stakeholders must take steps to improve the reporting quality of abstracts on PONV.
RESUMEN
AIMS: Currently, there is a growing body of research demonstrating that spin - the misinterpretation and distortion of a study's findings - is common in different fields of medicine. To our knowledge, no study has investigated its presence in systematic reviews focused on diabetic therapies. METHODS: We performed a cross-sectional study by searching MEDLINE and Embase for systematic reviews focused on pharmacologic treatments for type 2 diabetes mellitus. Our search retrieved 26,490 records, from which 199 studies were extracted in a masked, duplicate fashion. Each study was evaluated for the nine most severe types of spin and other study design parameters. Spin was presented as frequencies and odds ratios to identify associations between study characteristics. RESULTS: Spin was identified in the abstracts of 15 systematic reviews (15/199, 7.5%). Spin type 5 was the most common type identified (7/199, 3.5%). Spin types 1, 2, 4, and 8 were not identified. In the last 5 years (2016-2021), 7 systematic reviews contained spin within their abstract. There was no association between spins presence and any extracted study characteristic . CONCLUSIONS: Our findings show that spin infrequently occurs in abstracts of systematic reviews focused on pharmacologic therapies for type 2 diabetes mellitus. However, any amount of spin can lead to the distortion of a reader's interpretation of the study's findings. Thus, we provide recommendations with rationale to prevent spin in future systematic reviews.
RESUMEN
BACKGROUND: Spin - the misrepresentation of a study's results - has been identified in abstracts of studies focused on a variety of disorders from multiple fields of medicine. OBJECTIVES: This study's primary objective was to evaluate the abstracts of systematic reviews and meta-analyses focused on the treatment of atopic dermatitis for the nine most severe forms of spin. METHODS: We systematically searched Embase and MEDLINE for systematic reviews of atopic dermatitis therapies. Screening and data extraction occurred in a masked, duplicate fashion. Each included study was evaluated for the nine most severe types of spin and other study characteristics. RESULTS: Our searches retrieved 2,456 studies, of which 113 were included for data extraction. Spin was found in 74.3% of our included studies (84/113). Spin type 6 occurred most frequently (68/113, 60.2%). Spin types 1, 2, and 9 were not identified. All industry-funded systematic reviews contained spin in their abstract. The presence of spin was not associated with any specific study characteristics, including the methodological quality of the study. CONCLUSIONS: Severe forms of spin were found in the majority of abstracts for systematic reviews of atopic dermatitis treatments. Steps should be taken to prevent spin to improve the quality of reporting in abstracts.
RESUMEN
PURPOSE: The purpose of this study is to determine the prevalence of spin in the abstracts of systematic reviews and meta-analyses on treatments for rotator cuff tears and whether various study and publishing journal characteristics were associated with the presence of spin. METHODS: A search strategy was developed for Ovid MEDLINE and Ovid Embase to retrieve systematic reviews focused on treatments for rotator cuff tears. For an article to be included, it must meet the following criteria: (1) the article must be a systematic review with or without a meta-analysis, (2) the article must pertain to the treatment of rotator cuff tears, (3) the article must only contain human subjects, and (4) the article must be accessible in English. Systematic reviews were analyzed for spin using a previously developed classification scheme in a masked, duplicate manner. Binary logistic regression was used to examine independent associations via unadjusted odds ratios and 95% confidence intervals between the presence of spin and study characteristics. RESULTS: Search queries returned 932 articles, of which 121 systematic reviews and meta-analyses were eligible. A total of 36.4% (44/121) of systematic reviews contained spin. Among the general characteristics evaluated, there were no correlations with spin. CONCLUSIONS: Spin was present in more than one-third of systematic reviews and meta-analyses covering rotator cuff tear treatments. Spin was not associated with any general study or journal characteristics, which indicates that clinicians must be aware of the potential presence of spin in all such abstracts. CLINICAL RELEVANCE: Clinicians rely on systematic reviews and meta-analyses, especially abstracts of these articles, to provide succinct guidance on best practices in patient care. The presence of spin could adversely affect patient care; thus, steps should be taken to improve the reporting quality of abstracts on rotator cuff tear treatment.
Asunto(s)
Lesiones del Manguito de los Rotadores , Humanos , Metaanálisis como Asunto , Manguito de los Rotadores/cirugía , Revisiones Sistemáticas como AsuntoRESUMEN
Background: With 14.4 million U.S. adults diagnosed with alcohol use disorder (AUD) annually, effective treatments for combatting this condition are essential. Clinicians are often guided by systematic reviews and meta-analyses - considered the gold standard of research. Spin, a biased way of reporting results, may lead to misinterpretation of research findings, resulting in suboptimal patient care.Objective: Our primary objective was to investigate the presence of spin in the abstracts of systematic reviews of AUD treatments.Methods: After systematically searching MEDLINE and Embase for systematic reviews of AUD treatments, abstracts were evaluated for the nine most severe types of spin. Additional article characteristics were concurrently extracted and study quality was evaluated. Descriptive statistics of spin were calculated and associations between spin and study characteristics were determined through Fisher's exact and logistic regression.Results: Among 79 included systematic reviews, 44 instances of spin were identified spanning 43% of our sample (34/79). Of the nine forms of spin, eight were found with a majority of instances being "selective reporting of or overemphasis on efficacy outcomes" (13/44, 29.5% of cases). The majority of articles were rated as critically low quality (51/79, 64.6%). No association was found between the presence of spin and extracted study characteristics.Conclusions: Spin was found in more than 40% of systematic review abstracts that evaluated pharmacotherapies in the treatment of AUD. Coupled with the finding that the majority of systematic reviews on the subject were of low quality, increased awareness of spin among physicians may be warranted.
RESUMEN
BACKGROUND: Clinicians rely upon abstracts to provide them quick synopses of research findings that may apply to their practice. Spin can exist within these abstracts that distorts or misrepresents the findings. Our goal was to evaluate the level of spin within systematic reviews (SRs) focused on the treatment of cannabis use disorder (CUD). Methods: A systematic search was conducted in May 2020. To meet inclusion criteria, publications had to be either an SR or meta-analysis related to the treatment of cannabis use. Screening and data extraction was performed in a duplicate and masked fashion. Study quality was assessed using AMSTAR-2 Results: 16/24 SRs (66.7%) contained at least one form of spin in the abstract. The most common forms of spin identified were type 3-selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention (45.8%)-and type 8-the review's findings from a surrogate marker or a specific outcome to the global improvement of the disease (37.5%). No significant association between spin and intervention type, PRISMA requirements, or funding source was identified. Weak positive correlations were found between the presence of spin and abstract word count (r =.217) and between spin and AMSTAR-2 rating (r = 0.143). "Moderate" was the most common AMSTAR-2 rating (9/24, 37.5%), followed by "low" (7/24, 29.2%) and "critically low" (7/24, 29.2%). One systematic review received an AMSTAR-2 rating of "high" (1/24, 4.2%). Conclusions: Spin was common among abstracts from the SRs focused on the treatments for CUD. Higher quality studies may help reduce the overall rate as well as standardizing treatment outcomes. To facilitate this, we encourage all authors, peer-reviewers, and editors to be more aware of the various types of spin as they can help reduce the overall amount of spin seen within the literature.
RESUMEN
BACKGROUND: Spin, or the inappropriate formatting of information to emphasize certain outcomes, should not be present in research. This study focuses on identifying and characterizing the presence of spin in systematic review and meta-analysis abstracts that focus on the treatment of opioid use disorder. Methods: Search strategies were developed to identify studies pertaining to the treatment of opioid use disorder. The studies were then screened by two authors. These qualifying studies were then evaluated for the presence of spin within their abstracts by two trained authors. These studies were also evaluated by the AMSTAR-2 standards to evaluate the quality of the qualifying systematic reviews by two trained reviewers. Results: The sample in this study included 113 systematic reviews and meta-analyses. Spin was present in 20 of these studies (20/113, 17.7%). The most common spin form was spin type 3 (6/20, 30%), followed by types 5 and 9 (both 4/20, 20%), type 6 (3/20, 15%), type 7 (2/20, 10%), and type 8 (1/20, 5%). The remaining spin types 1, 2, and 4 were not present in the sample. Of the 113 included studies, the most common intervention type was pharmacologic (93/113, 82%). No significant association was found between the quality of a systematic review and the presence of spin. Conclusions: Findings in this study show positive trends in prevalence of five forms of spin evaluated in abstracts of systematic reviews and meta-analyses looking at treatments for opioid use disorder. However, study quality had no significant association with the presence of spin. Misrepresentation of results, or spin, may alter a clinician's perceptions about treatment efficacies. Therefore, increasing physician awareness of spin may improve clinical decision-making.
RESUMEN
BACKGROUND: Research has shown that many physicians rely solely on abstracts to make clinical decisions. However, many abstracts have been shown to be misleading. The primary objective of this study was to identify the prevalence of spin - bias towards particular results - within the abstracts of systematic reviews and meta-analyses pertaining to the treatment of proximal humerus fractures, one of the most common osteoporotic fractures among elderly patients. METHODS: We systematically searched MEDLINE and Embase databases to identify systematic reviews and meta-analyses examining the treatment of proximal humerus fractures. Screening and data extraction occurred in a masked, duplicate fashion. The nine most severe types of spin that occur within abstracts were extracted along with study characteristics, including journal recommendations to adhere to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) and year in which the review was performed, to identify potential associations. We subsequently explored the association between spin and the methodological quality of a systematic review using the revised A MeaSurement Tool to Assess systematic Reviews (AMSTAR 2) appraisal instrument. RESULTS: Our search retrieved 505 articles, of which 73 systematic reviews met inclusion criteria. We found that 34.2% (25/73) of the included systematic reviews contained spin. Spin type 3 (selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention) was the most common type identified (12/73, 16.4%). Three spin types were not identified in any of the abstracts. Spin was 3.2 (OR 3.2; 95% CI, 1.02-10.02) times more likely to be present in systematic reviews published in journals recommending adherence to PRISMA. Furthermore, the odds of an abstract containing spin was 1.25 (OR 1.25; 95% CI, 1.02-1.52) times more likely to be present in systematic reviews for each year after 2000. No other study characteristics were associated with spin. The methodological quality of 24 studies were rated as "critically low" (32.9%), 14 were "low" (19.2%), 28 were "moderate" (38.4%), and 7 were "high" (9.6%), but these findings were not associated with spin. CONCLUSION: Spin was present in systematic review abstracts regarding treatment of proximal humerus fractures. Measures such as education on the subject of spin and improved reporting standards should be implemented to increase awareness and reduce incidence of spin in abstracts. LEVEL OF EVIDENCE OF THE STUDY PERFORMED: Basic Science Study; Research Methodology.
RESUMEN
PURPOSE: Our primary aim of our study is to evaluate the prevalence of spin among abstracts in orthopaedic randomized controlled trials (RCTs) with nonsignificant primary endpoints. METHODS: This study was conducted in accordance with a previously written protocol publicly available via the Open Science Framework. PubMed (which includes Medline) was searched for RCTs in orthopaedic surgery. The articles that were identified were then uploaded to Rayyan, and the abstracts were screened for inclusion. To be included, a trial had to have randomized the patients for intervention, statistically compare multiple groups, and had a primary endpoint that was not significant. Odds ratios and summary statistics (frequencies and proportions) were then calculated for spin in the abstracts. RESULTS: Of the 780 articles retrieved from our search string, 250 articles met the inclusion criteria. Analysis resulted in 112/250 (44.80%; [95% CI, 38.64-50.96]) RCTs that containing spin within the abstract. Of the 112 RCTs, 52 (46.43%; [95% CI, 37.19-55.66]) had spin in the results, and 89 (79.46%; [95% CI, 71.98-86.95]) had spin in the conclusion of the abstract. The Journal of Bone and Joint Surgery was found to have the highest prevalence of spin (21/37, 56.76% [95% CI, 40.79%-72.72%]) while Arthroscopy: The Journal of Arthroscopic & Related Surgery had the lowest prevalence of spin (5/15, 33.33% [95% CI, 9.48%-57.19%]). No correlation was found between industry funding and increased odds of spin in the abstract (uOR, 1.10; 95% CI, 0.45-2.63). Discrepancies for our primary endpoint, prevalence of spin among abstracts, were analyzed with Gwet's AC1 inter-rater statistic and found to be 81% [95% CI, 0.75-0.87]. CONCLUSION: Spin was found in 44.8% of the abstracts within our sample of orthopaedic RCTs. Nonsignificant primary data were often represented to seem significant, many orthopaedic RCTs did not indicate primary endpoints, and orthopaedic RCTs infrequently reported trial registration.
RESUMEN
Spin is a way of reporting that distorts the true findings; we sought to investigate the prevalence of spin in systematic review abstracts on psoriasis treatments and whether study characteristics were associated with spin. We searched MEDLINE and Embase to obtain our sample. Screening and data extraction were performed in a masked duplicate fashion. Each included study was evaluated for the 9 most severe types of spin and other study characteristics. The methodological quality was assessed to explore potential relationships between spin and study quality. Search queries returned 3200 articles, which included 173 systematic reviews. Spin was present in systematic review abstracts. Preventing spin is essential for improving future systematic reviews.
RESUMEN
CONTEXT: The Cardiovascular and Renal Drugs Advisory Committee (CRDAC) of the Food and Drug Administration (FDA) reviews safety and efficacy data for cardiovascular and renal drugs, ultimately making recommendations to the Commissioner of Food and Drugs for approval. The Open Public Hearing segment of these meetings allows for patients, advocates, healthcare professionals, clinical trialists, and members of the public to provide testimony, which often results in expressing their preference for, or against, drug approval. Prior to providing testimony, the public speakers are highly encouraged to disclose any financial conflicts of interest (FCOIs) with the sponsor or other groups. Given the potential influence of these speakers on drug approval recommendations, we investigated the industry associations disclosed by public speakers in the Open Public Hearing section of the CRDAC meetings. Previous studies, such as one done by Lurie et al. indicated that positive testimony is tied to a higher likelihood of drug approval, and because drug companies provide financial compensation for speakers to provide testimony in general, we wanted to determine the likelihood with which speakers who have an FCOI provided a positive testimony vs. those without any FCOI. OBJECTIVES: The purpose is to evaluate whether public speakers with an FCOI are more likely to provide positive testimony regarding the drug in question during the CRDAC of the FDA between February 2009 and December 2019 through the use of publicly available transcripts. METHODS: Independent researchers investigated public transcripts and minutes of the CRDAC meetings with public speakers (n=20). We identified all speakers, along with characteristics such as an FCOI, and classified statements utilizing a pilot-tested Google form. The data collected were analyzed utilizing Stata. The speaker's testimony was then compared with their FCOI. An ordered logistic regression was performed utilizing the speaker's testimony regarding the drug as the dependent variable. RESULTS: Of the 88 speakers represented in our sample, 35 (35/88, 39.8%) disclosed an FCOI, most commonly regarding travel cost. Among speakers with an FCOI, 30 (30/35, 85.7%) spoke positively. Speakers with an FCOI were 4.96 times more likely to provide positive testimony (OR=4.96, 95% CI 1.67-14.78). Speakers with the disease were also more likely to provide positive testimony (OR=13.05, 95% CI 2.84-59.93). CONCLUSIONS: Public speakers often play a role during meetings, and they may also have an FCOI, most commonly related to travel expenses. Our study shows that speakers with an FCOI are more likely to provide positive testimony. Stipulations, such as requiring disclosure of FCOI and randomizing the selection process of speakers, can help ensure the integrity of the drug approval process.
Asunto(s)
Fármacos Cardiovasculares , Conflicto de Intereses , Comités Consultivos , Humanos , Estados Unidos , United States Food and Drug AdministrationRESUMEN
OBJECTIVES: Spin is a reporting practice in which study results are misrepresented by overestimating efficacy or underestimating harm. Prevalence of spin varies between clinical specialties, and estimates are based almost entirely on clinical trials. Little is known about spin in systematic reviews. DESIGN: We performed a cross-sectional analysis searching MEDLINE and Embase for systematic reviews and meta-analyses pertaining to antiplatelet therapies following acute coronary syndrome on 2 June 2020. Data were extracted evaluating the presence of spin and study characteristics, including methodological quality as rated by A MeaSurement Tool to Assess systematic Reviews (AMSTAR-2). All data extraction was conducted in a masked, duplicate manner from 2 June 2020 to 26 June 2020. PARTICIPANTS AND SETTING: Not applicable. PRIMARY AND SECONDARY OUTCOME MEASURES: We assessed abstracts of systematic reviews on antiplatelet therapy following acute coronary syndrome and evaluated the prevalence of the nine most severe types of spin. We additionally explored associations between spin and certain study characteristics, including quality. RESULTS: Our searches returned 15 263 articles, and 185 systematic reviews met inclusion criteria. Of these 185 reviews, 31.9% (59/185) contained some form of spin in the abstract. Seven forms of spin (1, 2, 3, 4, 5, 7 and 9) among the nine most severe were identified. No instances of types 6 or 8 were found. There were no statistically significant relationships between spin and the evaluated study characteristics or AMSTAR-2 appraisals. CONCLUSIONS: Spin was present in abstracts for systematic reviews and meta-analyses; subsequent studies are needed to identify correlations between spin and specific study characteristics. There were no statistically significant associations between spin and study characteristics or AMSTAR-2 ratings; however, implementing changes will ensure that spin is reduced in the field of cardiology as well as other fields of medicine.
Asunto(s)
Síndrome Coronario Agudo , Sesgo , Inhibidores de Agregación Plaquetaria , Síndrome Coronario Agudo/tratamiento farmacológico , Estudios Transversales , Humanos , Inhibidores de Agregación Plaquetaria/uso terapéutico , Revisiones Sistemáticas como AsuntoRESUMEN
BACKGROUND: Spin is defined as the misrepresentation of a study's results, which may lead to misperceptions or misinterpretation of the findings. Spin has previously been found in randomized controlled trials and systematic reviews of acne vulgaris treatments and treatments of various nondermatological conditions. OBJECTIVE: The purpose of this study was to quantify the presence of spin in abstracts of systematic reviews and meta-analyses of melanoma therapies and identify any related secondary characteristics of these articles. METHODS: We used a cross-sectional approach on June 2, 2020, to search the MEDLINE and Embase databases from their inception. To meet inclusion criteria, a study was required to be a systematic review or meta-analysis pertaining to the treatment of melanoma in human subjects, and reported in English. We used the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) definition of systematic reviews and meta-analyses. Data were extracted in a masked, duplicate fashion. We conducted a powered bivariate linear regression and calculated odds ratios for each study characteristic. RESULTS: A total of 200 systematic reviews met the inclusion criteria. We identified spin in 38% (n=76) of the abstracts. The most common type of spin found was type 3 (selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention), occurring 40 times; the least common was type 2 (title claims or suggests a beneficial effect of the experimental intervention not supported by the findings), which was not present in any included abstracts. We found that abstracts pertaining to pharmacologic interventions were 3.84 times more likely to contain spin. The likelihood of an article containing spin has decreased annually (adjusted odds ratio 0.91, 95% CI 0.84-0.99). No significant correlation between funding source or other study characteristics and the presence of spin was identified. CONCLUSIONS: We have found that spin is fairly common in the abstracts of systematic reviews of melanoma treatments, but the prevalence of spin in these abstracts has been declining from 1992-2020.
RESUMEN
BACKGROUND: Spin-the misrepresentation of a study's actual results-has the potential to alter a clinician's interpretation of the study's findings and therefore could affect patient care. Studies have shown spin frequently occurs in abstracts of systematic reviews from a variety of other medical disorders and specialties. AIMS: Our primary aim was to evaluate whether the nine most severe types of spin occurred in systematic review abstracts' concerning diabetic neuropathy treatments. Secondly, we aimed to determine whether spin presence was associated with the methodological quality of a systematic review. METHODS: A search of MEDLINE and Embase collected 1297 articles focused on diabetic neuropathy treatments, of which we included 114 systematic reviews for spin assessment. Each included study was evaluated for the nine most severe types of spin as defined by Yachitz et al. The methodological quality of a systematic review was determined by using the AMSTAR-2 instrument. All screening and data extraction were conducted in a masked, duplicate fashion. Since the final sample size of 114 was not sufficiently powered to do multivariable logistic regression, we calculated unadjusted odds ratios which evaluated relationships between spin presence within abstracts and study characteristics. RESULTS: From the 114 articles reviewed, spin was present in 7.9% of the studies (9/114), with spin type 5: "conclusion claims the beneficial effect of the experimental treatment despite the high risk of bias in the included primary studies" as the most frequent in our study. Spin types 1, 2, 6, and 8 were not identified. No association was observed between the study characteristics and spin presence, including the methodological quality of a systematic review. CONCLUSIONS: Overall, spin is infrequently observed in abstracts of systematic reviews covering diabetic neuropathy treatments. When comparing our results to other fields of medicine, the field of diabetic neuropathy research publishes systematic reviews whose abstracts mostly portray the findings of the review's full-text to reflect the results adequately.
Asunto(s)
Diabetes Mellitus , Neuropatías Diabéticas , Estudios Transversales , Neuropatías Diabéticas/terapia , Humanos , MEDLINE , Informe de Investigación , Revisiones Sistemáticas como AsuntoRESUMEN
HYPOTHESIS: The objective was to investigate the prevalence of spin in abstracts of systematic reviews and meta-analyses covering the treatment of tinnitus. We hypothesized that spin would be present in these articles and a significant relationship would exist between spin usage and extracted study characteristics. BACKGROUND: Spin, the misrepresentation of study findings, can alter a clinician's interpretation of a study's results, potentially affecting patient care. Previous work demonstrates that spin is present in abstracts of randomized clinical trials. METHODS: Using a cross-sectional analysis, we conducted a systematic search using MEDLINE and Embase databases on June 2, 2020, for systematic reviews focused on tinnitus treatment. Investigators performed screening and data extraction in a masked, duplicate fashion. RESULTS: Forty systematic reviews met inclusion criteria, and spin was identified in four of them. Spin in abstracts most frequently occurred when conclusions claimed the beneficial effect of the experimental treatment despite high risk of bias in primary studies (nâ=â3). The other form of spin found was the conclusion claims safety based on nonstatistically significant results with a wide confidence interval (nâ=â1). There was no significant association between spin and any of our extracted study characteristics. CONCLUSION: Spin was observed in 10% of abstracts of systematic reviews and meta-analyses covering the treatment of tinnitus. Although this percentage may be small, we recommend that medical journals provide a more detailed framework for abstract structure and require the inclusion of risk of bias assessment results in abstracts to prevent the incorporation of spin.
RESUMEN
OBJECTIVES: A cross-sectional analysis of orthopedic trauma randomized controlled trial (RCT) abstracts to assess the frequency and manifestations of spin, the misrepresentation or distortion of research findings, in orthopedic trauma clinical trials. METHODS: The top 5 orthopedic trauma journals were searched from January 1, 2012, to December 31, 2017. RCTs with nonsignificant endpoints (p > .05) were analyzed for spin in the abstract. The primary endpoint of our investigation was the frequency and type of spin. The secondary endpoint was to assess whether funding source was associated with the presence of spin. Due to the low reporting of funding sources no statistics were able to be computed for this outcome. RESULTS: Our PubMed search yielded 517 articles. Primary screening excluded 303 articles, and full text evaluation excluded an additional 161. Overall, 53 articles were included. Spin was identified in 35 of the 53 (66.0%) abstracts analyzed. Evidence of spin was found in 21 (39.6%) abstract results sections and 22 (41.5%) abstract conclusion sections. Of the 21 RCTs reporting a clinical trial registry, 3 (14.3%) had evidence of selective reporting bias. CONCLUSIONS: Orthopedic trauma RCTs from highly ranked journals with nonsignificant endpoints published from 2012 to 2017 frequently have spin in their abstracts. Abstracts with evidence of spin may influence a reader's perception of new drugs or procedures. In orthopedic trauma, the implications of spin may affect the treatment of patients with orthopedic trauma, so efforts to mitigate spin in RCT abstracts must be prioritized.
RESUMEN
OBJECTIVES: To identify, quantify, and characterize the presence of spin-specific strategies leading to misrepresentation of study results-in the abstracts of systematic reviews and meta-analyses of Ménière's disease treatment. METHODS: Using a cross-sectional design, we searched MEDLINE and Embase on May 28, 2020, for systematic reviews and meta-analyses focused on Ménière's disease treatment. Returned searches were screened, and data were extracted in a masked, duplicate fashion. RESULTS: Our sample included 36 systematic reviews and meta-analyses. Of the 36 included studies, 22 (61.1%) abstracts contained spin while 14 (38.9%) did not. The most common spin types were selective reporting of benefit (10/36, 27.8%) or harm (8/36, 22.2%). Other types of spin occurred when findings were extrapolated to the global improvement of the disease (5/36, 13.9%), beneficial effects were reported with high risk of bias in primary studies (3/36, 8.3%), and when beneficial effects were extrapolated to an entire class of interventions (1/36, 2.8%). No instances of other spin types occurred. Abstracts containing spin were substantively associated with studies of critically low methodological quality compared with studies with low and moderate quality. No studies had a methodological rating of high quality. No associations were observed between spin and intervention types, journal recommendation of adhering to Preferred Reporting Items for Systematic Reviews and Meta-Analyses, or funding. We found a negative correlation (r = -.31) between abstract word limit and presence of spin. CONCLUSIONS: Our study highlights that spin in the abstracts of systematic reviews of Ménière's disease is common, and it further enhances the discussion surrounding spin in abstracts of scientific research. Spin in an abstract does not discredit a study's findings; however, its occurrence should be eliminated.
RESUMEN
PURPOSE: Spin-the misrepresentation of study findings such that the beneficial effects of an intervention are magnified beyond what the results actually show-is a reporting practice that has been shown to influence perceptions of treatment efficacy and clinical decision making. We evaluated the extent of spin in the abstracts of systematic reviews of cataract surgery and its complications. We also evaluated whether particular study attributes were associated with spin. DESIGN: Cross-sectional study. METHODS: We searched MEDLINE and Embase for systematic reviews and meta-analyses relating to cataract treatment. From these search records, screening for eligible studies was done in duplicate. Using a previously developed classification system for spin, we assessed the systematic reviews that met our eligibility criteria for the occurrence of the 9 most severe forms of spin. We performed the evaluation of spin, extracted study characteristics, and appraised the methodological quality of each study using the 16-question AMSTAR-2 scale in duplicate. RESULTS: Searches retrieved 2,059 studies, of which 110 were eligible for data extraction. We found at least 1 form of spin in 30.0% of included systematic reviews (33/110). Six of the 9 types of spin were identified in our sample, the most common being type 3 in 18.2% (20/110) of abstracts. We found no significant association between spin in abstracts, AMSTAR-2 appraisal, and any of the extracted study characteristics. CONCLUSION: Spin was evident in approximately one-third of the abstracts of evaluated systematic reviews and meta-analyses of cataract surgery and associated complications.
RESUMEN
BACKGROUND: While spin - i.e., a reporting practice that embellishes positive findings and understates negative ones - is prevalent in randomized controlled trials, it has yet to be investigated in the context of systematic reviews. Owing to their significant role in clinical decision making and patient outcomes, this study seeks to identify and evaluate the severity of spin in the abstracts of systematic reviews on breast cancer. METHODS: We searched MEDLINE and Embase for systematic reviews and meta-analyses focused on breast cancer treatment, screening, and post-treatment quality of life between 1987 and 2020. Investigators independently screened for study selection, extracted spin data, and appraised the methodological quality of reviews using AMSTAR 2. In this cross-sectional study, 11,717 articles were identified, of which 581 met inclusion criteria. Following randomization, the first 200 were evaluated and 21 % contained evidence of at least one of nine types of spin. RESULTS: We identified spin types one, three, four, five, and six but not two, seven, eight, or nine. In particular, pharmacological (AOR 4.36, 95 % CI [1.18-16.01]) and surgical (AOR, 10.10 95 % CI [1.60-63.68]) intervention-type studies were highly associated with spin. There were no other associations between study characteristics and spin. While these results are significant, they contain a wide confidence interval and the reader should draw conclusions accordingly. CONCLUSIONS: There is evidence of spin in meta-analyses and systematic reviews regarding breast cancer treatment and quality of life outcomes. Accordingly, readers of systematic review abstracts related to breast cancer could be misled by distorted presentation of findings. POLICY SUMMARY: This study aims to improve the standards of reporting in systematic reviews and meta-analyses related to cancer.
Asunto(s)
Neoplasias de la Mama , Calidad de Vida , Neoplasias de la Mama/diagnóstico , Estudios Transversales , Detección Precoz del Cáncer , Femenino , Humanos , Metaanálisis como Asunto , Revisiones Sistemáticas como AsuntoRESUMEN
OBJECTIVE: Spin, i.e., the misrepresentation of research findings, has the potential to affect patient care. Evidence suggests that spin is prevalent in obesity randomized controlled trials. Therefore, the primary objective of this study was to evaluate spin in abstracts of systematic reviews covering obesity treatments. METHODS: MEDLINE and Embase were searched to retrieve systematic reviews on obesity treatments. Each systematic review abstract was inspected for the nine most severe types of spin, i.e., the misrepresentation of study findings by exaggeration or omission, regardless of intentionality. Screening and data extraction occurred in a masked, triplicate fashion. Methodological quality was determined using A MeaSurement Tool to Assess systematic Reviews (AMSTAR-2). RESULTS: Spin was identified in 20 (out of 200, 10%) abstracts, with spin type 5 (claiming efficacy despite high risk of bias among primary studies) being most common (11/200, 5.5%). Spin types 2 and 7, both related to unsupported efficacy claims, were not found. No associations were found between spin and extracted study characteristics. The methodological quality of the sample was rated as follows: critically low (23.0%), low (13.5%), moderate (60.5%), and high (3%). CONCLUSIONS: Although these findings demonstrate a low proportion of spin in the abstracts of systematic reviews for obesity treatment; increased preventive measures may further reduce its presence.