ABSTRACT
INTRODUCTION: In endodontics, the number of umbrella reviews has increased significantly over the last few years, but there is no evidence that they were methodologically sound. The aim of the current study was to appraise the methodological quality of umbrella reviews in endodontics, and to identify possible predictive factors associated with methodological quality. METHODS: Umbrella reviews published in the discipline of endodontics until December 2023 were included. The methodological quality of the reviews was evaluated using a checklist consisting of 11 items. Each item in the checklist was evaluated by two independent assessors who assigned a score of '1' if it was fully addressed, '0.5' if it was partially ddressed, and '0' if it was not addressed. Bootstrapped multiple linear regression analysis was used to examine the association between the total scores awarded and five predictor variables (a priori protocol registration, year of publication, number of authors, journal impact factor (IF) and continent of the corresponding author). The statistical significance level was set as 5%. RESULTS: A total of 27 reviews were included. Ninety-six per cent of the reviews adequately reported: eligibility criteria for selecting the reviews, details of the reviews, techniques for assessing the risk of bias or methodological quality of the individual systematic reviews they included. Only 30% of the reviews adequately managed overlapping primary studies within individual systematic reviews. Among the five predictors analysed, a priori protocol registration and journals with IFs were associated with significantly greater total methodological quality scores. DISCUSSION: Several methodological shortcomings in the umbrella reviews published within the field of endodontics were revealed. Umbrella reviews published in journals with IFs and those with protocols registered a priori had significantly superior methodological quality scores. CONCLUSION: In endodontics, authors intending to publish umbrella reviews should consider the limitations revealed in this study and follow the appropriate rules to ensure their reviews comply with the highest standards and provide accurate and dependable information and conclusions.
ABSTRACT
BACKGROUND: To assess the frequency of patient-reported outcomes (PROs) and non-PROs in randomized controlled trials (RCTs) addressing head/neck cancers. METHODS: We included RCTs about interventions to treat head/neck cancers. PubMed was searched on September 16, 2022 and included studies published during three periods (2000-2002, 2010-2012, and 2020-2022). Data on types of outcomes and instruments to measure them were extracted and organized into PROs and non-PROs, and temporal trends for reporting outcomes were determined. RESULTS: There was a reduction in the frequency of non-PROs (40% to 22%) and an increase in PROs (5% to 19%) over 20 years. The frequency of reporting both non-PROs and PROs seemed to be stable over the same period (55% to 58%). A great variety of instruments to measure PROs and non-PROs was identified. CONCLUSIONS: There has been a growth in the types of PROs in more recent years, and they were more frequently reported in RCTs. However, head/neck cancer trials with a combination of PROs and non-PROs were the most prevalent.
Subject(s)
Head and Neck Neoplasms , Patient Reported Outcome Measures , Randomized Controlled Trials as Topic , Humans , Head and Neck Neoplasms/therapy , Quality of LifeABSTRACT
Junior doctors make clinical decisions regularly; therefore, they need to adequately interpret the evidence supporting these decisions. Patients can be harmed if clinical treatments are supported by biased or unreliable evidence. Systematic reviews that contain meta-analyses of randomized controlled trials are a relatively low-biased type of evidence to support clinical interventions. Therefore, it is reasonable to think that doctors will likely select this type of study to answer clinical questions. In this article, doctors are informed about potential methodological and ethical issues in systematic reviews that contain a meta-analysis that are sometimes not easily identified or even overlooked by the current tools developed to assess their methodological quality or risk of bias. The article presents a discussion of topics related to data extraction, accuracy in reporting, reproducibility, heterogeneity, quality assessment of primary studies included in the systematic review, sponsorship, and conflict of interest. It is expected that the information reported will be useful for junior doctors when they are reading and interpreting evidence from systematic reviews containing meta-analyses of therapeutic interventions, mainly those doctors unfamiliar with methodological principles.
Subject(s)
Reproducibility of Results , Humans , Systematic Reviews as Topic , BiasABSTRACT
BACKGROUND: The overall confidence in the results of systematic reviews including animal models can be heterogeneous. We assessed the methodological quality of systematic reviews including animal models in dentistry as well as the overall confidence in the results of those systematic reviews. MATERIAL & METHODS: PubMed, Web of Science and Scopus were searched for systematic reviews including animal studies in dentistry published later than January 2010 until 18th of July 2022. Overall confidence in the results was assessed using a modified version of the A MeaSurement Tool to Assess systematic Reviews (AMSTAR-2) checklist. Checklist items were rated as yes, partial yes, no and not applicable. Linear regression analysis was used to investigate associations between systematic review characteristics and the overall adherence to the AMSTAR-2 checklist. The overall confidence in the results was calculated based on the number of critical and non-critical weaknesses presented in the AMSTAR-2 items and rated as high, moderate, low and critical low. RESULTS: Of initially 951 retrieved systematic reviews, 190 were included in the study. The overall confidence in the results was low in 43 (22.6%) and critically low in 133 (70.0%) systematic reviews. While some AMSTAR-2 items were regularly reported (e.g. conflict of interest, selection in duplicate), others were not (e.g. FUNDING: n = 1; 0.5%). Multivariable linear regression analysis showed that the adherence scores of AMSTAR-2 was significantly associated with publication year, journal impact factor (IF), topic, and the use of tools to assess risk of bias (RoB) of the systematic reviews. CONCLUSION: Although the methodological quality of dental systematic reviews of animal models improved over the years, it is still suboptimal. The overall confidence in the results was mostly low or critically low. Systematic reviews, which were published later, published in a journal with a higher IF, focused on non-surgery topics, and used at least one tool to assess RoB correlated with greater adherence to the AMSTAR-2 guidelines.