RESUMO
This paper is part of a series of methodological guidance from the Cochrane Rapid Reviews Methods Group. Rapid reviews (RRs) use modified systematic review methods to accelerate the review process while maintaining systematic, transparent and reproducible methods. This paper guides how to use supportive software for RRs.We strongly encourage the use of supportive software throughout RR production. Specifically, we recommend (1) using collaborative online platforms that enable working in parallel, allow for real-time project management and centralise review details; (2) using automation software to support, but not entirely replace a human reviewer and human judgement and (3) being transparent in reporting the methodology and potential risk for bias due to the use of supportive software.
Assuntos
Software , Humanos , Revisões Sistemáticas como Assunto/métodos , Projetos de Pesquisa , Literatura de Revisão como AssuntoRESUMO
BACKGROUND: Major depressive disorder (MDD) is the most prevalent, disabling form of depression, with a high economic effect. PURPOSE: To assess evidence on cost-effectiveness of pharmacologic and nonpharmacologic interventions as first- and second-step treatments in patients with MDD. DATA SOURCES: Multiple electronic databases limited to English language were searched (1 January 2015 to 29 November 2022). STUDY SELECTION: Two investigators independently screened the literature. Seven economic modeling studies fulfilled the eligibility criteria. DATA EXTRACTION: Data abstraction by a single investigator was confirmed by a second; 2 investigators independently rated risk of bias. One investigator determined certainty of evidence, and another checked for plausibility. DATA SYNTHESIS: Seven modeling studies met the eligibility criteria. In a U.S. setting over a 5-year time horizon, cognitive behavioral therapy (CBT) was cost-effective compared with second-generation antidepressants (SGAs) as a first-step treatment from the societal and health care sector perspectives. However, the certainty of evidence is low, and the findings should be interpreted cautiously. For second-step treatment, only switch strategies between SGAs were assessed. The evidence is insufficient to draw any conclusions. LIMITATIONS: Methodologically heterogeneous studies, which compared only CBT and some SGAs, were included. No evidence on other psychotherapies or complementary and alternative treatments as first-step treatment or augmentation strategies as second-step treatment was available. CONCLUSION: Although CBT may be cost-effective compared with SGAs as a first-step treatment at a 5-year time horizon from the societal and health care sector perspectives, the certainty of evidence is low, and the findings need to be interpreted cautiously. For other comparisons, the evidence was entirely missing or insufficient to draw conclusions. PRIMARY FUNDING SOURCE: American College of Physicians.
Assuntos
Antidepressivos de Segunda Geração , Terapia Cognitivo-Comportamental , Transtorno Depressivo Maior , Humanos , Transtorno Depressivo Maior/terapia , Análise Custo-Benefício , Psicoterapia , Antidepressivos de Segunda Geração/uso terapêuticoRESUMO
BACKGROUND: Developers of clinical practice guidelines need to take patient values and preferences into consideration when weighing benefits and harms of treatment options for depressive disorder. PURPOSE: To assess patient values and preferences regarding pharmacologic and nonpharmacologic treatments of depressive disorder. DATA SOURCES: MEDLINE (Ovid) and PsycINFO (EBSCO) were searched for eligible studies published from 1 January 2014 to 30 November 2022. STUDY SELECTION: Pairs of reviewers independently screened 30% of search results. The remaining 70% of the abstracts were screened by single reviewers; excluded abstracts were checked by a second reviewer. Pairs of reviewers independently screened full texts. DATA EXTRACTION: One reviewer extracted data and assessed the certainty of evidence, and a second reviewer checked for completeness and accuracy. Two reviewers independently assessed risk of bias. DATA SYNTHESIS: The review included 11 studies: 4 randomized controlled trials, 5 cross-sectional studies, and 2 qualitative studies. In 1 randomized controlled trial, participants reported at the start of therapy that they expected supportive-expressive psychotherapy and antidepressants to yield similar improvements. A cross-sectional study reported that non-Hispanic White participants and men generally preferred antidepressants over talk therapy, whereas Hispanic and non-Hispanic Black participants and women generally did not have a preference. Another cross-sectional study reported that the most important nonserious adverse events for patients treated with antidepressants were insomnia, anxiety, fatigue, weight gain, agitation, and sexual dysfunction. For other comparisons and outcomes, no conclusions could be drawn because of the insufficient certainty of evidence. LIMITATIONS: The main limitation of this review is the low or insufficient certainty of evidence for most outcomes. No evidence was available on second-step depression treatment or differences in values and preferences based on gender, race/ethnicity, age, and depression severity. CONCLUSION: Low-certainty evidence suggests that there may be some differences in preferences for talk therapy or pharmacologic treatment of depressive disorders based on gender or race/ethnicity. In addition, low-certainty evidence suggests that insomnia, anxiety, fatigue, weight gain, agitation, and sexual dysfunction may be the most important nonserious adverse events for patients treated with antidepressants. Evidence is lacking or insufficient to draw any further conclusions about patients' weighing or valuation of the benefits and harms of depression treatments. PRIMARY FUNDING SOURCE: American College of Physicians. (PROSPERO: CRD42020212442).
Assuntos
Transtorno Depressivo , Distúrbios do Início e da Manutenção do Sono , Masculino , Humanos , Feminino , Estudos Transversais , Distúrbios do Início e da Manutenção do Sono/tratamento farmacológico , Antidepressivos/efeitos adversos , FadigaRESUMO
BACKGROUND: Primary care patients and clinicians may prefer alternative options to second-generation antidepressants for major depressive disorder (MDD). PURPOSE: To compare the benefits and harms of nonpharmacologic treatments with second-generation antidepressants as first-step interventions for acute MDD, and to compare second-step treatment strategies for patients who did not achieve remission after an initial attempt with antidepressants. DATA SOURCES: English-language studies from several electronic databases from 1 January 1990 to 8 August 2022, trial registries, gray literature databases, and reference lists to identify unpublished research. STUDY SELECTION: 2 investigators independently selected randomized trials of at least 6 weeks' duration. DATA EXTRACTION: Reviewers abstracted data about study design and conduct, participants, interventions, and outcomes. They dually rated the risk of bias of studies and the certainty of evidence for outcomes of interest. DATA SYNTHESIS: 65 randomized trials met the inclusion criteria; eligible data from nonrandomized studies were not found. Meta-analyses and network meta-analyses indicated similar benefits of most nonpharmacologic treatments and antidepressants as first-step treatments. Antidepressants had higher risks for discontinuation because of adverse events than most other treatments. For second-step therapies, different switching and augmentation strategies provided similar symptomatic relief. The certainty of evidence for most comparisons is low; findings should be interpreted cautiously. LIMITATIONS: Many studies had methodological limitations or dosing inequalities; publication bias might have affected some comparisons. In some cases, conclusions could not be drawn because of insufficient evidence. CONCLUSION: Although benefits seem to be similar among first- and second-step MDD treatments, the certainty of evidence is low for most comparisons. Clinicians and patients should focus on options with the most reliable evidence and take adverse event profiles and patient preferences into consideration. PRIMARY FUNDING SOURCE: American College of Physicians. (PROSPERO: CRD42020204703).
Assuntos
Antidepressivos de Segunda Geração , Transtorno Depressivo Maior , Médicos , Humanos , Adulto , Transtorno Depressivo Maior/tratamento farmacológico , Metanálise em Rede , Antidepressivos/uso terapêutico , Antidepressivos de Segunda Geração/efeitos adversosRESUMO
BACKGROUND: Due to the growing need to provide evidence syntheses under time constraints, researchers have begun focusing on the exploration of rapid review methods, which often employ single-reviewer literature screening. However, single-reviewer screening misses, on average, 13% of relevant studies, compared to 3% with dual-reviewer screening. Little guidance exists regarding methods to recover studies falsely excluded during literature screening. Likewise, it is unclear whether specific study characteristics can predict an increased risk of false exclusion. This systematic review aimed to identify supplementary search methods that can be used to recover studies falsely excluded during literature screening. Moreover, it strove to identify study-level predictors that indicate an elevated risk of false exclusions of studies during literature screening. METHODS: We performed literature searches for eligible studies in MEDLINE, Science Citation Index Expanded, Social Sciences Citation Index, Current Contents Connect, Embase, Epistemonikos.org, and Information Science & Technology Abstracts from 1999 to June 23, 2020. We searched for gray literature, checked reference lists, and conducted hand searches in two relevant journals and similar article searches current to January 28, 2021. Two investigators independently screened the literature; one investigator performed the data extraction, and a second investigator checked for correctness and completeness. Two reviewers assessed the risk of bias of eligible studies. We synthesized the results narratively. RESULTS: Three method studies, two with a case-study design and one with a case-series design, met the inclusion criteria. One study reported that all falsely excluded publications (8%) could be recovered through reference list checking compared to other supplementary search methods. No included methods study analyzed the impact of recovered studies on conclusions or meta-analyses. Two studies reported that up to 8% of studies were falsely excluded due to uninformative titles and abstracts, and one study showed that 11% of non-English studies were falsely excluded. CONCLUSIONS: Due to the limited evidence based on two case studies and one case series, we can draw no firm conclusion about the most reliable and most valid method to recover studies falsely excluded during literature screening or about the characteristics that might predict a higher risk of false exclusion. SYSTEMATIC REVIEW REGISTRATION: https://osf.io/v2pjr/.
Assuntos
Programas de Rastreamento , Humanos , MEDLINERESUMO
OBJECTIVE: To summarize the evidence on the effectiveness of soil remediation to prevent or reduce lead exposure. METHODS: We systematically searched MEDLINE, the Agricultural & Environmental Science Database, Web of Science, and Scopus from 1980 to February 15, 2021. We also performed reference list checking, hand-searched websites, and contacted experts. Eligible studies evaluated the effect of soil remediation to prevent or reduce lead exposure in humans of any age. We screened all records dually; one investigator performed the data extraction; a second checked for completeness and accuracy. Two investigators independently rated the risk of bias of included studies and graded the certainty of evidence. We synthesized findings narratively. RESULTS: We identified 6614 potentially relevant publications, all focused on children, of which five studies (six records) fulfilled our prespecified inclusion criteria. The number of evaluated participants ranged from 31 to 1425, with follow-up periods of 11 months to one year. The primary soil remediation method was the replacement of the upper layer with clean soil. Outcomes were limited to blood lead levels (BLL), dust lead levels, and soil lead levels. The largest study, a controlled before- after study (n = 1425) reported favorable effects of soil remediation compared to no intervention. This finding was consistent with results from two cross-sectional studies and one uncontrolled before-after study. One year post-remediation, the mean reduction in BLL was 2.1 µg/dL (p < 0.0001) greater in the intervention group than in the control group. Two randomized controlled trials with a total of 511 participants showed no statistically significant incremental effect of soil remediation when combined with paint and/or dust abatement. The certainty of evidence for all outcomes was low. CONCLUSION: Soil remediation appears to reduce BLL in children when used as a single intervention. The incremental benefit of soil remediation when part of other interventions is limited.
Assuntos
Intoxicação por Chumbo , Chumbo , Criança , Estudos Transversais , Exposição Ambiental , Humanos , SoloRESUMO
OBJECTIVE: This study evaluated a simple environmental intervention called 'Water Schools' in Lower Austria providing free refillable water bottles and educational material. DESIGN: Non-randomised controlled cluster trial with three measurements: at baseline (T0), after the intervention at 9 months (T1) and after 1-year follow-up (T2). SETTING: Half-day elementary schools in Lower Austria (Austria). PARTICIPANTS: Third-grade pupils from twenty-two schools in the intervention group (IG) and thirty-two schools in the control group (CG) participated in the study. Data were analysed for 569 to 598 pupils in the IG and for 545 to 613 in the CG, depending on the time of measurement. RESULTS: The consumption of tap water increased in the IG from baseline to T1 and then decreased again at T2, but this was similar in the CG (no statistically significant difference in the time trend between the IG and CG). Similar results were seen for tap water consumption in the mornings. The proportion of children who only drank tap water on school mornings increased significantly from baseline to T1 in the IG compared to the CG (P = 0·020). No difference in the changes over time occurred between the groups for the proportion of pupils drinking approximately one bottle of tap water during school mornings. CONCLUSIONS: Not only the children in the IG but also those in the CG drank more tap water after 1 school year than at the beginning. The measurement of drinking habits in the CG may have been intervention enough to bring about changes or to initiate projects.
Assuntos
Ingestão de Líquidos , Promoção da Saúde , Áustria , Criança , Promoção da Saúde/métodos , Humanos , Instituições AcadêmicasRESUMO
BACKGROUND: Dyspnea is a common and often debilitating symptom with a complex diagnostic work-up. PURPOSE: To evaluate the benefits, harms, and diagnostic test accuracy of point-of-care ultrasonography (POCUS) in patients with acute dyspnea. (PROSPERO: CRD42019126419). DATA SOURCES: Searches of multiple electronic databases without language limitations (January 2004 to August 2020) and reference lists of pertinent articles and reviews. STUDY SELECTION: Five randomized controlled trials (RCTs) and 44 prospective cohort-type studies in patients with acute dyspnea evaluated POCUS as a diagnostic tool to determine the underlying cause of dyspnea. Two investigators independently screened the literature for inclusion. DATA EXTRACTION: Data abstraction by a single investigator was confirmed by a second investigator; 2 investigators independently rated risk of bias and determined certainty of evidence. DATA SYNTHESIS: Point-of-care ultrasonography, when added to a standard diagnostic pathway, led to statistically significantly more correct diagnoses in patients with dyspnea than the standard diagnostic pathway alone. In-hospital mortality and length of hospital stay did not differ significantly between patients who did or did not receive POCUS in addition to standard diagnostic tests. Finally, POCUS consistently improved the sensitivities of standard diagnostic pathways to detect congestive heart failure, pneumonia, pulmonary embolism, pleural effusion, or pneumothorax; specificities increased in most but not all studies. LIMITATIONS: Most studies assessed diagnostic test accuracy, which has limited utility for clinical decision making. Studies rarely reported on the proportion of indeterminate sonography results, and no evidence is available on adverse health outcomes of false-positive or false-negative POCUS results. CONCLUSION: Point-of-care ultrasonography can improve the correctness of diagnosis in patients with acute dyspnea. PRIMARY FUNDING SOURCE: American College of Physicians.
Assuntos
Dispneia/diagnóstico por imagem , Dispneia/etiologia , Testes Imediatos , Ultrassonografia , Doença Aguda , Procedimentos Clínicos , Mortalidade Hospitalar , Humanos , Tempo de Internação , Readmissão do Paciente , Guias de Prática Clínica como Assunto , Sensibilidade e Especificidade , Ultrassonografia/efeitos adversosRESUMO
OBJECTIVES: To develop methods guidance to support the conduct of rapid reviews (RRs) produced within Cochrane and beyond, in response to requests for timely evidence syntheses for decision-making purposes including urgent health issues of high priority. STUDY DESIGN AND SETTING: Interim recommendations were informed by a scoping review of the underlying evidence, primary methods studies conducted, and a survey sent to 119 representatives from 20 Cochrane entities, who were asked to rate and rank RR methods across stages of review conduct. Discussions among those with expertise in RR methods further informed the list of recommendations with accompanying rationales provided. RESULTS: Based on survey results from 63 respondents (53% response rate), 26 RR methods recommendations are presented for which there was a high or moderate level of agreement or scored highest in the absence of such agreement. Where possible, how recommendations align with Cochrane methods guidance for systematic reviews is highlighted. CONCLUSION: The Cochrane Rapid Reviews Methods Group offers new, interim guidance to support the conduct of RRs. Because best practice is limited by the lack of currently available evidence for some RR methods shortcuts taken, this guidance will need to be updated as additional abbreviated methods are evaluated.
Assuntos
Guias como Assunto , Projetos de Pesquisa/normas , Relatório de Pesquisa/normas , Revisões Sistemáticas como Assunto/normas , Humanos , Inquéritos e QuestionáriosRESUMO
OBJECTIVES: To assess the feasibility of a modified workflow that uses machine learning and crowdsourcing to identify studies for potential inclusion in a systematic review. STUDY DESIGN AND SETTING: This was a substudy to a larger randomized study; the main study sought to assess the performance of single screening search results versus dual screening. This substudy assessed the performance in identifying relevant randomized controlled trials (RCTs) for a published Cochrane review of a modified version of Cochrane's Screen4Me workflow which uses crowdsourcing and machine learning. We included participants who had signed up for the main study but who were not eligible to be randomized to the two main arms of that study. The records were put through the modified workflow where a machine learning classifier divided the data set into "Not RCTs" and "Possible RCTs." The records deemed "Possible RCTs" were then loaded into a task created on the Cochrane Crowd platform, and participants classified those records as either "Potentially relevant" or "Not relevant" to the review. Using a prespecified agreement algorithm, we calculated the performance of the crowd in correctly identifying the studies that were included in the review (sensitivity) and correctly rejecting those that were not included (specificity). RESULTS: The RCT machine learning classifier did not reject any of the included studies. In terms of the crowd, 112 participants were included in this substudy. Of these, 81 completed the training module and went on to screen records in the live task. Applying the Cochrane Crowd agreement algorithm, the crowd achieved 100% sensitivity and 80.71% specificity. CONCLUSIONS: Using a crowd to screen search results for systematic reviews can be an accurate method as long as the agreement algorithm in place is robust. TRIAL REGISTRATION: Open Science Framework: https://osf.io/3jyqt.
Assuntos
Algoritmos , Pesquisa Biomédica/métodos , Crowdsourcing/métodos , Confiabilidade dos Dados , Coleta de Dados/métodos , Aprendizado de Máquina , Revisões Sistemáticas como Assunto , Humanos , Ensaios Clínicos Controlados Aleatórios como Assunto , Projetos de PesquisaRESUMO
BACKGROUND: Decision-makers increasingly request rapid answers to clinical or public health questions. To save time, personnel, and financial resources, rapid reviews streamline the methodological steps of the systematic review process. We aimed to explore the validity of a rapid review approach that combines a substantially abbreviated literature search with a single-reviewer screening of abstracts and full texts using three case studies. METHODS: We used a convenience sample of three ongoing Cochrane reviews as reference standards. Two reviews addressed oncological topics and one addressed a public health topic. For each of the three topics, three reviewers screened the literature independently. Our primary outcome was the change in conclusions between the rapid reviews and the respective Cochrane reviews. In case the rapid approach missed studies, we recalculated the meta-analyses for the main outcomes and asked Cochrane review authors if the new body of evidence would change their original conclusion compared with the reference standards. Additionally, we assessed the sensitivity of the rapid review approach compared with the results of the original Cochrane reviews. RESULTS: For the two oncological topics (case studies 1 and 2), the three rapid reviews each yielded the same conclusions as the Cochrane reviews. However, the authors would have had less certainty about their conclusion in case study 2. For case study 3, the public health topic, only one of the three rapid reviews led to the same conclusion as the Cochrane review. The other two rapid reviews provided insufficient information for the authors to draw conclusions. Using the rapid review approach, the sensitivity was 100% (3 of 3) for case study 1. For case study 2, the three rapid reviews identified 40% (4 of 10), 50% (5 of 10), and 60% (6 of 10) of the included studies, respectively; for case study 3, the respective numbers were 38% (8 of 21), 43% (9 of 21), and 48% (10 of 21). CONCLUSIONS: Within the limitations of these case studies, a rapid review approach that combines abbreviated literature searches with single-reviewer screening may be feasible for focused clinical questions. For complex public health topics, sensitivity seems to be insufficient.
Assuntos
Publicações , Projetos de Pesquisa , Humanos , Literatura de Revisão como AssuntoRESUMO
OBJECTIVES: The objective is to identify studies that have assessed methodological shortcuts for undertaking rapid reviews (RRs) and mapping these to review conduct stages and Methodological Expectations of Cochrane Intervention Reviews (MECIR) guidance. STUDY DESIGN AND SETTING: We conducted a systematic scoping review. We searched multiple databases (e.g., MEDLINE, Embase), which were supplemented by grey literature searching. Methods were defined a priori in a published protocol. RESULTS: Out of 1,873 records, 90 publications were divided into four RR categories: formal evaluation (n = 14), development, which included four subcategories (n = 65), comparison (n = 2), and applying reporting guidelines/critical appraisal tools (n = 3), and a systematic review surrogate category (n = 6). Four formal evaluation studies were composite evaluations, including more than one shortcut simultaneously. The remaining 10 studies evaluated viable (e.g., including English-only publications) and unviable (e.g., single-reviewer screening) shortcuts, covering five key dimensions and five 'other' (e.g., involving stakeholders) considerations while conducting a review. Because of complexities around shortcuts evaluated, only a cursory mapping to MECIR criteria was possible. CONCLUSION: Some methods shortcuts may be valid in the context of RRs, but limitations in the studies may limit their applicability. The results will serve to inform discussions within Cochrane regarding possible future implementation of RRs.
Assuntos
Bases de Dados Factuais/estatística & dados numéricos , MEDLINE/estatística & dados numéricos , Publicações/tendências , Abreviaturas como Assunto , Austrália/epidemiologia , Canadá/epidemiologia , Bases de Dados Bibliográficas/estatística & dados numéricos , Bases de Dados Factuais/tendências , Guias como Assunto , Humanos , Projetos de Pesquisa/tendências , Literatura de Revisão como Assunto , Reino Unido/epidemiologiaRESUMO
OBJECTIVES: To determine the accuracy of single-reviewer screening in correctly classifying abstracts as relevant or irrelevant for literature reviews. STUDY DESIGN AND SETTING: We conducted a crowd-based, parallel-group randomized controlled trial. Using the Cochrane Crowd platform, we randomly assigned eligible participants to 100 abstracts each of a pharmacological or a public health topic. After completing a training exercise, participants screened abstracts online based on predefined inclusion and exclusion criteria. We calculated sensitivities and specificities of single- and dual-reviewer screening using two published systematic reviews as reference standards. RESULTS: Two hundred and eighty participants made 24,942 screening decisions on 2,000 randomly selected abstracts from the reference standard reviews. On average, each abstract was screened 12 times. Overall, single-reviewer abstract screening missed 13% of relevant studies (sensitivity: 86.6%; 95% confidence interval [CI], 80.6%-91.2%). By comparison, dual-reviewer abstract screening missed 3% of relevant studies (sensitivity: 97.5%; 95% CI, 95.1%-98.8%). The corresponding specificities were 79.2% (95% CI, 77.4%-80.9%) and 68.7% (95% CI, 66.4%-71.0%), respectively. CONCLUSIONS: Single-reviewer abstract screening does not appear to fulfill the high methodological standards that decisionmakers expect from systematic reviews. It may be a viable option for rapid reviews, which deliberately lower methodological standards to provide decision makers with accelerated evidence synthesis products.
Assuntos
Indexação e Redação de Resumos/estatística & dados numéricos , Confiabilidade dos Dados , Revisão da Pesquisa por Pares , Revisões Sistemáticas como Assunto , Indexação e Redação de Resumos/normas , Adulto , Depressão/terapia , Feminino , Humanos , Masculino , Revisão da Pesquisa por Pares/normas , Distribuição Aleatória , Análise de Regressão , Tamanho da Amostra , Sensibilidade e Especificidade , Bebidas Adoçadas com AçúcarRESUMO
OBJECTIVES: Occupational injuries and diseases are a huge public health problem and cause extensive suffering and loss of productivity. Nevertheless, many occupational health and safety (OHS) guidelines are still not based on the best available evidence. In the last decade, numerous systematic reviews on behavioural, relational and mixed interventions to reduce occupational injuries and diseases have been carried out, but a comprehensive synopsis is yet missing. The aim of this overview of reviews is to provide a comprehensive basis to inform evidence-based decision-making about interventions in the field of OHS. METHODS: We conducted an overview of reviews. We searched MEDLINE (Ovid), the Cochrane Library (Wiley), epistemonikos.org and Scopus (Elsevier) for relevant systematic reviews published between January 2008 and June 2018. Two authors independently screened abstracts and full-text publications and determined the risk of bias of the included systematic reviews with the ROBIS (Risk of Bias in Systematic Reviews) tool. RESULTS: We screened 2287 abstracts and 200 full-texts for eligibility. Finally, we included 25 systematic reviews with a low risk of bias for data synthesis and analysis. We identified systematic reviews on the prevention of occupational injuries, musculoskeletal, skin and lung diseases, occupational hearing impairment and interventions without specific target diseases. Several interventions led to consistently positive results on individual diseases; other interventions did not show any effects, or the studies are contradictory. We provide detailed results on all included interventions. DISCUSSION: To our knowledge, this is the first comprehensive overview of behavioural, relational and mixed interventions and their effectiveness in preventing occupational injuries and diseases. It provides policymakers with an important basis for making evidence-based decisions on interventions in this field. PROSPERO REGISTRATION NUMBER: CRD42018100341.
Assuntos
Doenças Profissionais/prevenção & controle , Saúde Pública/normas , Gestão da Segurança/métodos , Medicina Baseada em Evidências , Humanos , Saúde OcupacionalRESUMO
BACKGROUND: Web applications that employ natural language processing technologies to support systematic reviewers during abstract screening have become more common. The goal of our project was to conduct a case study to explore a screening approach that temporarily replaces a human screener with a semi-automated screening tool. METHODS: We evaluated the accuracy of the approach using DistillerAI as a semi-automated screening tool. A published comparative effectiveness review served as the reference standard. Five teams of professional systematic reviewers screened the same 2472 abstracts in parallel. Each team trained DistillerAI with 300 randomly selected abstracts that the team screened dually. For all remaining abstracts, DistillerAI replaced one human screener and provided predictions about the relevance of records. A single reviewer also screened all remaining abstracts. A second human screener resolved conflicts between the single reviewer and DistillerAI. We compared the decisions of the machine-assisted approach, single-reviewer screening, and screening with DistillerAI alone against the reference standard. RESULTS: The combined sensitivity of the machine-assisted screening approach across the five screening teams was 78% (95% confidence interval [CI], 66 to 90%), and the combined specificity was 95% (95% CI, 92 to 97%). By comparison, the sensitivity of single-reviewer screening was similar (78%; 95% CI, 66 to 89%); however, the sensitivity of DistillerAI alone was substantially worse (14%; 95% CI, 0 to 31%) than that of the machine-assisted screening approach. Specificities for single-reviewer screening and DistillerAI were 94% (95% CI, 91 to 97%) and 98% (95% CI, 97 to 100%), respectively. Machine-assisted screening and single-reviewer screening had similar areas under the curve (0.87 and 0.86, respectively); by contrast, the area under the curve for DistillerAI alone was just slightly better than chance (0.56). The interrater agreement between human screeners and DistillerAI with a prevalence-adjusted kappa was 0.85 (95% CI, 0.84 to 0.86%). CONCLUSIONS: The accuracy of DistillerAI is not yet adequate to replace a human screener temporarily during abstract screening for systematic reviews. Rapid reviews, which do not require detecting the totality of the relevant evidence, may find semi-automation tools to have greater utility than traditional systematic reviews.
Assuntos
Armazenamento e Recuperação da Informação/métodos , Processamento de Linguagem Natural , Software , Indexação e Redação de Resumos/classificação , Humanos , Internet , Reprodutibilidade dos Testes , Sensibilidade e Especificidade , Revisões Sistemáticas como AssuntoRESUMO
The Austrian periodic health examination (PHE) was introduced in 1974 as a health insurance benefit and was redesigned for the last time in 2005. Therefore, the aim of this work was to revise the scientific basis of the PHE using the GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach. We updated the scientific evidence of examinations and consultations that are currently part of the PHE and searched and integrated new examinations. We assessed the expectations of the population towards the PHE in three focus groups. A panel of experts developed evidence-based recommendations for the revised PHE. They formulated 26 recommendations on 20 target diseases or risk factors. In comparison to the previous PHE, the panel added screening for abdominal aortic aneurysm, osteoporotic fracture risk, and chronic kidney disease to the recommendations, while screening for asymptomatic bacteriuria, screening for iron deficiency/pernicious anaemia, and risk identification of glaucoma should no longer be included.
Assuntos
Programas de Rastreamento , Exame Físico , Áustria , Humanos , Fatores de RiscoRESUMO
AIMS: To assess the efficacy, safety, and cost-effectiveness of lifestyle intervention, compared with treatment as usual in people with prediabetes as defined by the American Diabetes Association. For older studies, we used the 1985 World Health Organization definition. METHODS: We systematically searched multiple electronic databases and referenced lists of pertinent review articles from January 1980 through November 2015. We performed an update search in MEDLINE on April 26, 2017. Based on a priori established eligibility criteria, we dually reviewed the literature, extracted data, and rated the risk of bias of included studies with validated checklists. To assess the efficacy of lifestyle intervention to prevent or delay further progression to type 2 diabetes, we conducted a random-effects meta-analysis. We assessed the certainty of evidence using the GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach. RESULT: Pooled results of 16 randomized controlled trials showed that people with prediabetes who received lifestyle intervention had a lower rate of progression to type 2 diabetes after one (4% vs. 10%, RR 0.46 [CI 0.32, 0.66]) and three years of follow-up (14% vs. 23%, RR 0.64 [95% CI 0.53, 0.77]). The majority of the studies also showed a greater weight loss in lifestyle intervention participants, with a great variation between studies. Costs per quality-adjusted life-year were lower when the benefits of lifestyle intervention were analyzed over a lifelong time horizon compared to only the period of lifestyle intervention (three years) or to modeling over a ten-year period. CONCLUSION: Lifestyle intervention is an efficacious, safe, and cost-effective measure to reduce the risk of progression to type 2 diabetes in people diagnosed with prediabetes. More research is necessary to compare the efficacy of various modes, frequencies, and intensities of lifestyle intervention across studies.
Assuntos
Diabetes Mellitus Tipo 2/prevenção & controle , Estado Pré-Diabético/terapia , Prevenção Primária/métodos , Comportamento de Redução do Risco , Adulto , Idoso , Idoso de 80 Anos ou mais , Análise Custo-Benefício , Diabetes Mellitus Tipo 2/diagnóstico , Diabetes Mellitus Tipo 2/economia , Diabetes Mellitus Tipo 2/epidemiologia , Progressão da Doença , Feminino , Custos de Cuidados de Saúde , Humanos , Incidência , Masculino , Pessoa de Meia-Idade , Estado Pré-Diabético/diagnóstico , Estado Pré-Diabético/economia , Estado Pré-Diabético/epidemiologia , Prevenção Primária/economia , Fatores de Proteção , Ensaios Clínicos Controlados Aleatórios como Assunto , Medição de Risco , Fatores de Risco , Fatores de Tempo , Resultado do TratamentoRESUMO
In healthcare, the processes, criteria, and evidence that decision makers use to reach their judgments often remain unclear. Decision makers sometimes neglect important criteria, give undue weight to criteria, or do not use the best available evidence to inform their judgments. Thus, the GRADE (Grading of Recommendations Assessment, Development and Evaluation) working group developed a system to support transparent decision making. The purpose of the Evidence-to-Decision (EtD) framework is to help people use evidence in a structured and transparent way to inform decisions in the context of clinical recommendations, coverage decisions, and health system, or public health recommendations and decisions. EtD frameworks include the formulation of the question, an assessment of the evidence, and drawing conclusions. EtD frameworks inform users of recommendations about judgments that were made and the evidence supporting these judgments by making the basis for decisions transparent to target audiences. EtD frameworks also facilitate dissemination of recommendations.