RESUMO
INTRODUCTION: Clinical practice guidelines(CPGs) are important tools for medical decision-making. Given the high prevalence and financial burden associated with tobacco use disorder(TUD), it is critical that recommendations within CPGs are based on robust evidence. Systematic reviews(SRs) are considered the highest level of evidence, thus, we evaluated the quality of SRs underpinning CPG recommendations for TUD. METHODS: We used PubMed to search for CPGs relating to TUD published between January 1, 2010 and May 21, 2021. SRs were extracted from CPG references and evaluated using Preferred Reporting Items for Systematic Reviews and Meta-Analyses(PRISMA) and A MeaSurement Tool to Assess Systematic Reviews(AMSTAR-2) tools. We then compared SRs conducted by the Cochrane Collaboration with non-Cochrane SRs using a Mann-Whitney U test and determined associations between PRISMA and AMSTAR-2 extracted characteristics using multiple regression. RESULTS: Our search generated 10 CPGs with 98 SRs extracted. Mean PRISMA completion was 74.7%(SD = 16.7) and mean AMSTAR-2 completion was 53.8%(SD = 22.0) across all guidelines. Cochrane SRs were more complete than non-Cochrane studies in the PRISMA and AMSTAR-2 assessments. The regression model showed a statistically significant association between PRISMA completion and AMSTAR-2 rating, with those classified as "low" or "moderate" quality having higher PRISMA completion than those with "critically low" ratings. CONCLUSION: We found substandard adherence to PRISMA and AMSTAR-2 checklists across SRs cited in TUD CPGs. A lack of recent SRs in CPGs could lead to outdated recommendations. Therefore, frequent guideline updates with recently published evidence may ensure more accurate clinical recommendations and improve patient care. IMPLICATIONS: Systematic reviews used to underpin clinical practice guideline recommendations influence treatment decisions and, ultimately, patient outcomes. We found that many systematic reviews underpinning tobacco use disorder guideline recommendations were out of date and unsatisfactory in reporting and quality. Thus, including newer systematic reviews containing more recently conducted trials and better reporting could alter recommendations and improve the rate of successful tobacco cessation attempts.
Assuntos
Tabagismo , Humanos , Análise Multivariada , Guias de Prática Clínica como Assunto , Projetos de Pesquisa , Relatório de Pesquisa , Tabagismo/terapiaRESUMO
The number of American adults who use electronic nicotine delivery systems (ENDS) increased by 3 million people in 2018, up 38.3% from 8.1 to 11.2 million. Search data for ENDS were analyzed against relevant traits including state longitude, tobacco tax rate and national tobacco program funding. Searches increased 88% (95% CI, 70-100) over the last 5 years and peaked on 8 September 2019, after the CDC issued a warning about the link between ENDS and high-profile lung damage cases. Searches aimed at buying ENDS subsequently dropped 25% (95% CI, 20.1-29.6), while health-related ENDS searches spiked to their all-time high, increasing 22% (95% CI, -6 to 55) compared with the first half of 2019. ENDS searches are now more concentrated than 5 years ago, reversing the trend of the early 2010s, likely because certain states have passed laws to curb the use of ENDS. The public prefers searching for 'vaping' over 'e-cigarette' in a phenomenon similar to 'high fructose corn syrup' versus 'sugar'. Consequently, public policy discussions and public education campaigns need to use 'vaping' terms, and more states should enact policies that are strongly associated with lower ENDS usage, many of which we identify.
Assuntos
Sistemas Eletrônicos de Liberação de Nicotina , Produtos do Tabaco , Vaping , Adulto , Estudos Transversais , Humanos , Saúde Pública , Ferramenta de Busca , Estados UnidosRESUMO
BACKGROUND: Randomized control trials (RCTs) serve as evidentiary support for recommendations underpinning clinical practice guidelines (CPGs) with the goal of optimizing patient care. A knowledge gap exists within scientific literature when evaluating the quality of RCTs used as evidence in the American Academy of Orthopaedic Surgery (AAOS) pediatric CPGs. We aim to evaluate the reporting quality and risk of bias in RCTs underlying AAOS Pediatric CPG recommendations. METHODS: We located all AAOS Pediatric CPGs. We then extracted all RCTs from the CPG reference sections. All included RCTs were evaluated using the Consolidated Standards of Reporting Trials (CONSORT) checklist and Cochrane Collaboration risk of bias assessment tool (RoB 2.0). Descriptive statistics were recorded, and bivariate analysis was used to account for variance in CONSORT scores. A Mann-Whitney U test was completed to compare CONSORT studies published before and after 2010. RESULTS: Three CPGs and 23 RCTs met inclusion criteria. Mean CONSORT adherence was 69.8% (21.6/31). The lowest adhered to CONSORT items were 10, 23, and 24, while items 2a, 13a, and 18 displayed the highest adherence. Ten RCTs (43.5%, 10/23) had "low" risk of bias, 5 RCTs (21.7%, 5/23) were of "some concerns," and 8 RCTs (34.8%, 8/23) received a "high" designation for risk of bias. There were no statistically significant associations in the bivariate regression analysis or Mann-Whitney U test. CONCLUSIONS: Our results suggest that CONSORT adherence within RCTs used as evidence in AAOS Pediatric CPGs is substandard-relying on evidence that, in some cases, is >20 years old. Many of the RCTs cited as supporting evidence have a "high" risk of bias. Altogether, these CPGs may need to be updated or expanded to include more recent evidence relevant to pediatric orthopaedic surgery.
Assuntos
Procedimentos Ortopédicos , Ortopedia , Pediatria , Adulto , Lista de Checagem , Criança , Humanos , Guias de Prática Clínica como Assunto , Ensaios Clínicos Controlados Aleatórios como Assunto , Padrões de Referência , Adulto JovemRESUMO
BACKGROUND: Cardiac assessment in noncardiac surgery clinical practice guidelines should be supported by the highest-quality evidence such as that offered by systematic reviews. Currently, the methodological and reporting quality of these studies remains unknown. METHODS: We used PubMed to search for all clinical practice guidelines related to perioperative cardiovascular patients undergoing noncardiac surgery from 2010 to 2021. The included clinical practice guidelines were analysed for all systematic reviews and meta-analyses. The primary objective of this study was to determine reporting and methodological quality using the PRISMA (Preferred Reporting Instrument for Systematic Reviews and Meta-Analyses) and AMSTAR-2 (A Measurement Tool to Assess Systematic Reviews-2) instruments. Our secondary objective was to compare systematic reviews conducted by the Cochrane Collaboration with non-Cochrane studies. RESULTS: Three clinical practice guidelines were included in our study. Within these, 78 systematic reviews were included. PRISMA completion ranged from 34.8% to 100.0% with a mean of 76.9%. AMSTAR-2 completion ranged from 15.6% to 96.9% with a mean of 58.0%. Fifty-four systematic reviews underpinned a clinical practice guidelines recommendation, of which 25 were rated 'critically low' by AMSTAR-2 appraisal. Cochrane systematic reviews typically performed better than non-Cochrane studies, but were a minority of the included studies (10/78). CONCLUSION: We found deficiencies in several key areas regarding the methodological and reporting qualities of systematic reviews included in cardiac assessment in noncardiac surgery clinical practice guidelines. As these clinical practice guidelines are instrumental to clinical decision-making and patient care in cardiac assessment in noncardiac surgery, we advocate for improved reporting quality among systematic reviews cited as supportive evidence for these recommendations.
Assuntos
Doenças Cardiovasculares/diagnóstico , Doenças Cardiovasculares/prevenção & controle , Guias de Prática Clínica como Assunto , Projetos de Pesquisa/normas , Procedimentos Cirúrgicos Operatórios , Revisões Sistemáticas como Assunto/normas , Humanos , Metanálise como Assunto , Medição de Risco , Revisões Sistemáticas como Assunto/métodosRESUMO
OBJECTIVE: Data-sharing plays an essential role in advancing scientific understanding. Here, we aim to identify the commonalities and differences in data-sharing policies endorsed by otolaryngology journals and to assess their adherence to the FAIR (findable, accessible, interoperable, reusable) principles. METHODS: Data-sharing policies were searched for among 111 otolaryngology journals, as listed by Scimago Journal & Country Rank. Policy extraction of the top biomedical journals as ranked by Google Scholar metrics were used as a comparison. The FAIR principles for scientific data management and stewardship were used for the extraction framework. This occurred in a blind, masked, and independent fashion. RESULTS: Of the 111 ranked otolaryngology journals, 100 met inclusion criteria. Of those 100 journals, 79 provided data-sharing policies. There was a clear lack of standardization across policies, along with specific gaps in accessibility and reusability which need to be addressed. Seventy-two policies (of 79; 91%) designated that metadata should have globally unique and persistent identifiers. Seventy-one (of 79; 90%) policies specified that metadata should clearly include the identifier of the data they describe. Fifty-six policies (of 79; 71%) outlined that metadata should be richly described with a plurality of accurate and relevant attributes. CONCLUSION: Otolaryngology journals have varying data-sharing policies, and adherence to the FAIR principles appears to be moderate. This calls for increased data transparency, allowing for results to be reproduced, confirmed, and debated.
Assuntos
Disseminação de Informação , Otolaringologia , Publicações Periódicas como Assunto , Humanos , PolíticasRESUMO
CONTEXT: Clinical practice guidelines (CPGs) are vital to establishing a standardized and evidence-based approach in medicine. These guidelines rely on the use of methodologically sound clinical trials, and the subsequent reporting of their methodology. OBJECTIVE: To evaluate the completeness of randomized controlled trials (RCTs) underpinning CPGs published by the American Academy of Orthopedic Surgeons (AAOS) for management of osteoarthritis of the knee. DATA SOURCES: We searched the most recent AAOS CPGs for surgical and nonsurgical management of osteoarthritis of the knee for RCTs. To estimate the necessary sample size, we performed a power analysis using OpenEpi 3.0 (openepi.com). STUDY SELECTION: Two authors independently screened the reference sections of the included CPGs. Included studies met the definition of an RCT, were retrievable in the English language, and were cited in at least one of the included CPGs. STUDY DESIGN: Meta-Analysis. LEVEL OF EVIDENCE: Level 1a. DATA EXTRACTION: We performed double-blind screening and extraction of RCTs included in the AAOS CPGs. We evaluated each RCT for adherence to the Consolidated Standards of Reporting Trials (CONSORT) 2010 checklist. A multiple regression analysis was conducted to assess CONSORT adherence against characteristics of included studies (ie, type of intervention, funding source, etc). RESULTS: Our study included 179 RCTs. The overall adherence was 68.5% with significant differences between those published before and since the development of the 2010 CONSORT guidelines (P = 0.02). We found that RCTs receiving funding from industry/private sources as well as studies that included a conflict of interest statement showed more completeness than RCTs that reported receiving no funding (P < 0.01). CONCLUSION: We found suboptimal CONSORT adherence for RCTs cited in AAOS CGPs for management of osteoarthritis of the knee. Therefore, the CPGs are likely supported by outdated evidence and lack of high-quality reporting. It is important that evidence used to guide clinical decision making be of the highest quality in order to optimize patient outcomes. In order for clinicians to confer the greatest benefits to their patients, CPGs should provide the totality of evidence and emphasize emerging high-quality RCTs to ensure up-to-date, evidence-based clinical decision-making.
Assuntos
Cirurgiões Ortopédicos , Osteoartrite do Joelho , Humanos , Estados Unidos , Osteoartrite do Joelho/terapia , Lista de Checagem , Ensaios Clínicos Controlados Aleatórios como AssuntoRESUMO
OBJECTIVE: To evaluate harms reporting in systematic reviews (SRs) of microvascular free flap (MFF) in head and neck reconstruction. DATA SOURCES: This cross-sectional analysis included searches from the following major databases from 2012 to June 1, 2022: MEDLINE (Pubmed and Ovid), Embase, Epistemonikos, and the Cochrane Database of Systematic Reviews. REVIEW METHODS: In a masked duplicate manner, screening was performed using Rayyan, and data were extracted using a pilot-tested Google form. A MeaSurement Tool to Assess systematic Reviews-2 (AMSTAR-2) was used to appraise the methodological quality of reviews and the corrected covered area was calculated to detect primary study overlap across all reviews. Reviews were then grouped in pairs of 2, called dyads, and the corrected covered area was calculated again for each individual dyad. Dyads with high overlap (≥50%) were further investigated for the accuracy of harms reporting. RESULTS: Our initial search yielded 268 records, with 50 SRs meeting the inclusion criteria. A total of 46 (92%) of the included reviews demonstrated 50% or more adherence to the items assessed in our harms checklist. Our corrected covered area tool revealed 0.6% primary study overlap across all reviews, and 1 dyad with high overlap (≥50%). No statistically significant relationship was observed between the completeness of harms reporting and reviews listing harms as a primary outcome, reviews reporting adherence to Preferred Reporting Items of Systematic Reviews and Meta-Analyses, or a review's AMSTAR rating. CONCLUSION: This study identifies how harms reporting in SRs of MFF reconstruction of the head and neck can be improved and provides suggestions with the potential to mitigate the paucity in current literature.
Assuntos
Retalhos de Tecido Biológico , Procedimentos de Cirurgia Plástica , Humanos , Estudos Transversais , Revisões Sistemáticas como Assunto , Lista de ChecagemRESUMO
OBJECTIVE: Language can influence societal perceptions of medical conditions. The employment of person-centered language (PCL) in health care is reflected in many scientific publications; however, the extent of this adaptation in reference to obesity is unknown. METHODS: This cross-sectional analysis included a systematic search of PubMed obesity-related articles across four cohorts spanning January 2004 through December 2006; January 2008 through December 2010; January 2015 through December 2018; and January 2019 through May 2020, respectively. Approximately 1971 publications were screened and examined for prespecified, non-PCL terminology set forth by the American Medical Association Manual of Style and the International Committee of Medical Journal Editors, of which 991 were retained. Statistical analysis demonstrating PCL and non-PCL findings was then performed. Incidence rates and cohort classifications were reported. RESULTS: Of the 991 articles examined, it was found that 24.02% of publications adhered to PCL. Similar adherence was observed across obesity-specific, general medicine, and nutrition journals. PCL adherence increased over time. The most common non-PCL label was "obese," occurring in 75.48% of articles. CONCLUSIONS: This investigation showed that non-PCL in reference to obesity is widely evident in weight-focused journals despite recommendations for adherence to PCL guidelines. Continued use of non-PCL in reference to obesity in research may inadvertently perpetuate weight-based stigma and health disparities in future generations.
Assuntos
Idioma , Obesidade , Humanos , Estudos Transversais , Obesidade/epidemiologia , Projetos de Pesquisa , Estado NutricionalRESUMO
BACKGROUND: Clinical practice guidelines (CPGs) inform evidence-based decision-making in the clinical setting; however, systematic reviews (SRs) that inform these CPGs may vary in terms of reporting and methodological quality, which affects confidence in summary effect estimates. OBJECTIVE: Our objective was to appraise the methodological and reporting quality of the SRs used in CPGs for cutaneous melanoma and evaluate differences in these outcomes between Cochrane and non-Cochrane reviews. METHODS: We conducted a cross-sectional analysis by searching PubMed for cutaneous melanoma guidelines published between January 1, 2015, and May 21, 2021. Next, we extracted SRs composing these guidelines and appraised their reporting and methodological rigor using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) and AMSTAR (A Measurement Tool to Assess Systematic Reviews) checklists. Lastly, we compared these outcomes between Cochrane and non-Cochrane SRs. All screening and data extraction occurred in a masked, duplicate fashion. RESULTS: Of the SRs appraised, the mean completion rate was 66.5% (SD 12.29%) for the PRISMA checklist and 44.5% (SD 21.05%) for AMSTAR. The majority of SRs (19/50, 53%) were of critically low methodological quality, with no SRs being appraised as high quality. There was a statistically significant association (P<.001) between AMSTAR and PRISMA checklists. Cochrane SRs had higher PRISMA mean completion rates and higher methodological quality than non-Cochrane SRs. CONCLUSIONS: SRs supporting CPGs focused on the management of cutaneous melanoma vary in reporting and methodological quality, with the majority of SRs being of low quality. Increasing adherence to PRISMA and AMSTAR checklists will likely increase the quality of SRs, thereby increasing the level of evidence supporting cutaneous melanoma CPGs.
RESUMO
OBJECTIVE: Evidence-based decision making is crucial in reducing the health and economic burdens imposed by tonsillar-related pathologies. Clinical practice guidelines are used to guide these decisions; however, uptake of recommendations in these guidelines is low. Systematic reviews are the highest level of evidence used to influence guideline recommendations; therefore, improving the reporting and methodological quality of systematic reviews related to tonsillar-related pathologies may improve guideline uptake and patient care. METHODS: We used PubMed to search for all clinical practice guidelines related to tonsillar-related pathologies from 2010 to 2020. Included guidelines were then searched for all systematic reviews and meta-analyses. Study characteristics were extracted from each cited systematic review/meta-analysis before being evaluated using the PRISMA (Preferred Reporting Instrument for Systematic Reviews and Meta-Analyses) and AMSTAR-2 (A Measurement Tool to Assess Systematic Reviews 2) instruments. We then compared systematic reviews conducted by a Cochrane systematic review group with non-Cochrane systematic reviews. RESULTS: Seven clinical practice guidelines were included in our study and within these guidelines 98 SRs/MAs were cited, 80 of which were unique and included. Systematic reviews composed 9.1% (98/1082) of all guideline citations. Guideline PRISMA scores ranged from 0.47 to 0.83 with a mean score of 0.71 (n = 80) and guideline AMSTAR-2 scores ranged from 0.52 to 0.83 with a mean of 0.56 (7.29/13) and 0.75 (11.94/16) (n = 80). Cochrane systematic reviews displayed greater PRISMA (0.88 vs. 0.64: p < 0.001) and AMSTAR-2 (0.90 vs. 0.57; p < 0.001) scores compared to the non-Cochrane studies. We found PRISMA and AMSTAR-2 scores were positively correlated across guidelines (r = 0.93). CONCLUSION: Wide variation exists in adherence to PRISMA and AMSTAR-2 guidelines among systematic reviews cited in clinical practice guidelines for tonsillar-related pathologies. Prior registration and adequate risk of bias assessment are two areas where improvements may be needed. Given the importance of guideline uptake, careful considerations to improve the methodological and reporting quality of evidence supporting tonsillar-related pathology recommendations are necessary.
Assuntos
Tonsila Palatina , Projetos de Pesquisa , Humanos , Guias de Prática Clínica como AssuntoRESUMO
BACKGROUND: As Clinical Practice Guidelines (CPGs) provide effective guidance for providing medical care for individuals with alcohol use disorder (AUD), the evidence behind them should be robust. OBJECTIVE: Our primary objective was to critically appraise the methodological and reporting quality of systematic reviews cited within CPGs regarding the treatment of AUD. Our secondary objective was to determine how frequently Cochrane Reviews were cited as justification and to evaluate appraisals between Cochrane and non-Cochrane reviews. METHODS: We searched PubMed to identify CPGs for the treatment of AUD published between 2015 and 2021. Systematic reviews included in each CPG were evaluated using the Preferred Reporting Instrument for Systematic Reviews and Meta-Analyses (PRISMA) and a validated quality assessment tool (AMSTAR-2). Additional study characteristics were recorded. RESULTS: From the screening process, 98 systematic reviews from 6 CPGs met inclusion criteria. PRISMA adherence ranged from 72% to 85% (mean of 79%). AMSTAR-2 adherence ranged from 52% to 73% (mean of 68%). AMSTAR appraisal ratings found 32 (35.6%) critically low, 10 (11.1%) low, 35 (38.9%) moderate, and only 13 (14.4%) high systematic reviews. Cochrane systematic reviews displayed greater PRISMA (0.92 vs. 0.75: p < 0.001) and AMSTAR-2 (0.90 vs. 0.61.; p < 0.001) scores compared to the non-Cochrane studies. CONCLUSION: Systematic reviews included in CPGs for AUD treatment showed variable adherence to PRISMA and AMSTAR-2 guidelines, with almost half of the systematic reviews being critically low to low methodological quality. Given the prevalence of alcohol use disorder, methodological and reporting quality recommendations are important to strengthening evidence informing CPGs.
Assuntos
Alcoolismo , Alcoolismo/diagnóstico , Alcoolismo/terapia , Humanos , Guias de Prática Clínica como Assunto , Projetos de Pesquisa , Relatório de PesquisaRESUMO
INTRODUCTION: Author conflicts of interest (COI) and industry sponsorship may lead to biased research results and conclusions. Considering the direct influence that systematic reviews have on patient care, including the management of patients being treated for opioid use disorders (OUD), these studies should be free of industry bias. Thus, we sought to determine whether a relationship exists between COI and the favorability of systematic review outcomes using a sample of systematic reviews regarding OUD interventions. METHODS: We searched MEDLINE and Embase for systematic reviews and meta-analysis related to OUD treatment. The study team performed all data extraction in a masked duplicate fashion. We searched for undisclosed COI for each systematic review author in 3 databases--the CMS Open Payments database, Dollars for Profs, and the United States Patent and Trademark Office (USPTO). The research team quantified results using descriptive statistics. We evaluated associations between review characteristics using Fisher's exact tests, when possible. RESULTS: This article includes seventeen systematic reviews and meta-analyses with 81 authors. We found that 25 authors (30.9%) had some form of COI, and 22 (of 25, 88.0%) authors had an undisclosed COI. However, no significant association existed between COI and favorability of results and conclusions. Notably, two systematic reviews (of 17; 11.76%) were industry-sponsored. Similarly, we found no association between the study sponsor source and the favorability of systematic review results and conclusions. CONCLUSIONS: Our results suggest the favorability of systematic review results and conclusions are not influenced by author COI or industry sponsorship. However, nearly one-fourth of authors had an undisclosed COI, further emphasizing the need for standardization and adherence to COI disclosure policies within addiction medicine literature.
Assuntos
Conflito de Interesses , Transtornos Relacionados ao Uso de Opioides , Bases de Dados Factuais , Revelação , Humanos , Metanálise como Assunto , Transtornos Relacionados ao Uso de Opioides/tratamento farmacológico , Revisões Sistemáticas como Assunto , Estados UnidosRESUMO
BACKGROUND: Poor diet is a leading cause of premature death and thus diet and lifestyle changes are needed; yet, no consensus exists regarding diets that provide the greatest benefit. One of these diets gaining popularity around the world is a plant-based, vegan diet. Recently, Netflix documentaries What the Health (2017) and The Game Changers (2019) have attempted to improve public awareness of veganism and plant-based diets. METHODS: We used Google Trends to obtain data for keywords specific to plant-based diets, veganism, and documentary-specific terms over a time period before and after the release of the Netflix documentaries. We then created a forecasted model for trended search terms using autoregressive integrated moving algorithms and compared the actual trends to the forecast model to determine the effect of the documentaries on each selected term. RESULTS: Search interest for the term "plant-based diet" increased significantly-2.8 times the mean forecasted value for What the Health (t = 12.892, df = 30.012, P < .001) and 2 times the forecasted mean for The Game Changers (t = 19.826, df = 30.118, P < .001). Additionally, following the release of The Game Changers, mean search interest for "plant-based athlete" was 2.8 times higher than the forecasted values. CONCLUSION: The documentaries What the Health (2017) and The Game Changers (2019) are associated with an increased interest in plant-based diets based on Google search trends, highlighting the need for continued research regarding plant-based diets and their health benefits related to chronic disease.
RESUMO
OBJECTIVE: To evaluate the reporting quality of systematic reviews (SRs) underpinning the American Urologic Association (AUA) clinical practice guidelines (CPGs). METHODS: We searched the AUA for CPGs from 2015-2021. We extracted all SRs from the reference sections and two independent investigators evaluated eligible SR/meta-analysis using the PRISMA (Preferred Reporting Instrument for Systematic Reviews and Meta-Analyses) and AMSTAR-2 (A Measurement Tool to Assess Systematic Reviews 2) instruments. We compared SRs conducted by the Cochrane group to non-Cochrane SRs using a Mann-Whitney test. A multivariate regression was used to compare study characteristics. RESULTS: Eighteen CPG's met inclusion criteria. We extracted 120 unique SRs, which accounted for 5.1% (n = 120/2346) of all citations. Mean percent adherence to PRISMA and AMSTAR-2 was 65.4% -d 55.2% respectively. SRs conducted by the Cochrane Collaboration scored higher on AMSTAR-2 compared to non-Cochrane (z = -4.41, P <.01) and a positive correlation between PRISMA and AMSTAR-2 scores (r = 0.56, P <.001) was determined. CONCLUSION: Our study indicated the quality of SRs used to develop AUA CPGs across both PRISMA and AMSTAR-2 was variable. Despite higher evaluations, Cochrane SRs accounted for less than 15% of SRs underpinning CPG recommendations. Given the importance placed on CPGs within clinical practice, we recommended a synergistic relationship between the AUA and the Cochrane Collaboration to increase the number of quality urologic SRs.
Assuntos
Projetos de Pesquisa , Urologia , Humanos , Guias de Prática Clínica como Assunto , Revisões Sistemáticas como Assunto , Estados UnidosRESUMO
OBJECTIVE: The aim of this study was to assess the methodological quality and accuracy of reporting within systematic reviews (SRs) that provide evidence to form clinical practice guidelines (CPGs) in the management and treatment of breast cancer. METHODS: The 5 included CPGs for breast cancer management among National Comprehensive Cancer Network and European Society for Medical Oncology were searched for all SRs and meta-analyses. The characteristics of each study along with their methodological reporting were extracted from each SR using the PRISMA (Preferred Reporting Instrument for Systematic Reviews and Meta-Analyses) and AMSTAR-2 (A Measurement Tool to Assess Systematic Reviews 2) tools. Our second objective was to compare SRs produced by Cochrane groups vs non-Cochrane. RESULTS: Our study included 5 CPGs for the management of breast cancer, containing 1341 total references with 69 being unique SRs we analyzed. PRISMA completeness percent had a mean 76.3% (n = 69), while AMSTAR-2 completeness score mean was 66.5% (n = 59). Cochrane SRs were found to adhere far better to PRISMA (0.91 vs. 0.74) and AMSTAR-2 (0.95 vs. 0.62) guidelines compared to the non-Cochrane SRs. CONCLUSION: The reporting quality of SRs that underpin CPGs in breast cancer management widely varies. We recommend that authors of SRs adopt a more uniform approach in assessing the quality of reporting within their studies. In addition, CPGs should use a more standardized method to seek out evidence to establish their recommendations. With improved reporting, clinicians may have increased confidence in CPGs and thus increased utilization of CPGs in clinical decision making.
Assuntos
Neoplasias da Mama , Relatório de Pesquisa , Neoplasias da Mama/diagnóstico , Neoplasias da Mama/terapia , Feminino , Humanos , Projetos de PesquisaRESUMO
OBJECTIVE: Clinical practice guidelines (CPGs) are essential to clinical decision-making as their recommendations are supported by published literature. Systematic reviews are considered the highest quality of evidence used to underpin these guidelines. However, research to support these recommendations may lack compliance to quality reporting among systematic reviews (SRs). Here, we aim to evaluate the quality of SRs underpinning CPG recommendations for the management of head and neck cancer (HNC). STUDY DESIGN: Retrospective cross-sectional analysis. METHODS: Using PubMed, we searched for CPGs pertinent to the management of head and neck cancer published between January 2017 and May 2021. Relevant guidelines were analyzed for all SRs. Cited SRs in CPGs were evaluated using A Measurement Tool to Assess Systematic Reviews-2 (AMSTAR-2) and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) instruments. Study characteristics were extracted in a masked triplicate fashion. RESULTS: A total of 16 CPGs and 142 unique SRs were included in our study. PRISMA completion ranged from 67.15% to 87.65% across CPGs with a mean of 76.41% (SD = 16.9). AMSTAR-2 completion ranged from 34.38% to 84.38% across CPGs with a mean of 67.55% (SD = 20.9) among all SRs. The lowest rated items included funding sources and publication bias. A higher score was achieved in SR done by Cochrane group and it was only 2.11% (3/142) of all SR's quoted in CPG. CONCLUSION: Adherence to AMSTAR-2 and PRISMA items exhibits a variation among SRs cited in CPGs for the management of HNC. The mature underpinning CPG recommendation of SRs cited as supportive evidence could be enhanced in reporting quality. LEVEL OF EVIDENCE: NA Laryngoscope, 132:1976-1983, 2022.
Assuntos
Neoplasias de Cabeça e Pescoço , Relatório de Pesquisa , Estudos Transversais , Neoplasias de Cabeça e Pescoço/terapia , Humanos , Viés de Publicação , Estudos RetrospectivosRESUMO
OBJECTIVES: The main objective of this study was to assess the methodological and reporting quality of the systematic reviews (SRs) supporting the European Society of Cardiology (ESC) and the American College of Cardiology (ACC) clinical practice guidelines (CPGs) recommendations for the management of patients with ventricular arrhythmias and sudden cardiac death (SCD). As a secondary objective, we sought to determine: (1) the proportion of Cochrane SRs were cited; and (2) whether Cochrane SRs scored higher on Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and A Measurement Tool to Assess Systematic Reviews 2 (AMSTAR-2) appraisals. DESIGN: Cross-sectional analysis. MAIN OUTCOME MEASURES: We searched for CPGs published by the ESC and the ACC from 2010 to 2020. We selected the CPGs for ventricular arrhythmias and the prevention of SCD. The reference sections were searched for SRs. Two independent investigators evaluated eligible SR using the PRISMA checklist and the AMSTAR-2 assessment tool. RESULTS: Two CPGs for ventricular arrhythmia and SCD were included in this study. Fifty-five SRs were included in our analysis. Across all SRs, the mean PRISMA score was 0.70. The lowest scoring PRISMA item related to the presence of a pre-published protocol (item 5, score 0.17). Overall, 40% of included SRs were found to have 'critically low' AMSTAR-2 ratings. One of the lowest scoring items for AMSTAR-2 was reporting of sources of funding (item 10). The 4 Cochrane SRs that were included scored higher on both assessment tools than non-Cochrane studies, specifically in PRISMA overall completion (88.7% vs 69.7%). CONCLUSION: Our study suggests the methodological and reporting quality of SRs used within ESC and ACC CPGs is insufficient, as demonstrated by the lack of adherence to both AMSTAR-2 and PRISMA checklists. Given the importance of CPGs on clinical decision making, and ultimately patient care, the methodological rigour and quality reporting within SRs used in CPGs should be held to the highest standard within the field of cardiology.
Assuntos
Cardiologia , Relatório de Pesquisa , Humanos , Estados Unidos , Estudos Transversais , Projetos de Pesquisa , Morte Súbita Cardíaca/prevenção & controle , Arritmias Cardíacas/diagnóstico , Arritmias Cardíacas/terapiaRESUMO
OBJECTIVE: This study assesses the quality and completeness of systematic reviews (SRs) included by the National Comprehensive Cancer Network (NCCN) cancer screening clinical practice guidelines (CPGs). METHODS: We evaluated SRs according to PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) and AMSTAR-2 (A Measurement Tool to Assess systematic Reviews). RESULTS: Seven NCCN CPGs were included with 109 SRs. The mean PRISMA percent completeness of included SRs was 71 % (range 0.1-1.0). The mean AMSTAR-2 percent completeness was 56 % (range 0.05-0.99). Of the 70 SRs assessed via AMSTAR-2, 42 (60 %) received a "critically low" rating, 11 (15.7 %) received "low" ratings, and 17 (24.3 %) received "moderate". None of the SRs received a "high" rating. CONCLUSION: Lack of adherence to AMSTAR-2 and PRISMA reporting standards among the SRs included is prevalent. We suggest improved reporting of SR inclusion criteria and evaluation to bolster the reporting quality of SRs underpinning CPG recommendations.
Assuntos
Neoplasias , Projetos de Pesquisa , Detecção Precoce de Câncer , Humanos , Neoplasias/diagnóstico , Neoplasias/epidemiologia , Neoplasias/terapia , Relatório de PesquisaRESUMO
Conflicts of interest (COIs) in healthcare are increasingly discussed in the literature, yet these relationships continue to influence healthcare. Research has consistently shown that financial COIs shape prescribing practices, medical education and guideline recommendations. In 2009, the Institute of Medicine (IOM, now the National Academy of Medicine) published Conflicts of Interest in Medical Research, Practice, and Education-one of the most comprehensive reviews of empirical research on COIs in medicine. Ten years after publication of theIOM's report, we review the current state of COIs within medicine. We also provide specific recommendations for enhancing scientific integrity in medical research, practice, education and editorial practices.