ABSTRACT
The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement, published in 2009, was designed to help systematic reviewers transparently report why the review was done, what the authors did, and what they found. Over the past decade, advances in systematic review methodology and terminology have necessitated an update to the guideline. The PRISMA 2020 statement replaces the 2009 statement and includes new reporting guidance that reflects advances in methods to identify, select, appraise, and synthesise studies. The structure and presentation of the items have been modified to facilitate implementation. In this article, we present the PRISMA 2020 27-item checklist, an expanded checklist that details reporting recommendations for each item, the PRISMA 2020 abstract checklist, and the revised flow diagrams for original and updated reviews.
La declaración PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses), publicada en 2009, se diseñó para ayudar a los autores de revisiones sistemáticas a documentar de manera transparente el porqué de la revisión, qué hicieron los autores y qué encontraron. Durante la última década, ha habido muchos avances en la metodología y terminología de las revisiones sistemáticas, lo que ha requerido una actualización de esta guía. La declaración PRISMA 2020 sustituye a la declaración de 2009 e incluye una nueva guía de presentación de las publicaciones que refleja los avances en los métodos para identificar, seleccionar, evaluar y sintetizar estudios. La estructura y la presentación de los ítems ha sido modificada para facilitar su implementación. En este artículo, presentamos la lista de verificación PRISMA 2020 con 27 ítems, y una lista de verificación ampliada que detalla las recomendaciones en la publicación de cada ítem, la lista de verificación del resumen estructurado PRISMA 2020 y el diagrama de flujo revisado para revisiones sistemáticas.
ABSTRACT
Matthew Page and co-authors describe PRISMA 2020, an updated reporting guideline for systematic reviews and meta-analyses.
Subject(s)
Evidence-Based Medicine/standards , Publishing/standards , Systematic Reviews as Topic , Humans , Systematic Reviews as Topic/methods , Systematic Reviews as Topic/standardsABSTRACT
BACKGROUND: When a journal receives a duplicate publication, the ability to identify the submitted work as previously published, and reject it, is an assay to publication ethics best practices. The aim of this study was to evaluate how three different types of journals, namely open access (OA) journals, subscription-based journals, and presumed predatory journals, responded to receiving a previously published manuscript for review. METHODS: We performed a quasi-experimental study in which we submitted a previously published article to a random sample of 602 biomedical journals, roughly 200 journals from each journal type sampled: OA journals, subscription-based journals, and presumed predatory journals. Three hundred and three journals received a Word version in manuscript format, while 299 journals received the formatted publisher's PDF version of the published article. We then recorded responses to the submission received after approximately 1 month. Responses were reviewed, extracted, and coded in duplicate. Our primary outcome was the rate of rejection of the two types of submitted articles (PDF vs Word) within our three journal types. RESULTS: We received correspondence back from 308 (51.1%) journals within our study timeline (32 days); (N = 46 predatory journals, N = 127 OA journals, N = 135 subscription-based journals). Of the journals that responded, 153 received the Word version of the paper, while 155 received the PDF version. Four journals (1.3%) accepted our paper, 291 (94.5%) journals rejected the paper, and 13 (4.2%) requested a revision. A chi-square test looking at journal type, and submission type, was significant (χ2 (4) = 23.50, p < 0.001). All four responses to accept our article came from presumed predatory journals, 3 of which received the Word format and 1 that received the PDF format. Less than half of journals that rejected our submissions did so because they identified ethical issues such as plagiarism with the manuscript (133 (45.7%)). CONCLUSION: Few journals accepted our submitted paper. However, our findings suggest that all three types of journals may not have adequate safeguards in place to recognize and act on plagiarism or duplicate submissions.
Subject(s)
Periodicals as Topic/standards , Publications/standards , Humans , Non-Randomized Controlled Trials as Topic , Research DesignSubject(s)
Animals, Laboratory , Biomedical Research/statistics & numerical data , Developed Countries/statistics & numerical data , Developing Countries/statistics & numerical data , Periodicals as Topic/ethics , Publishing/ethics , Research Personnel/statistics & numerical data , Animals , Authorship , Avoidance Learning , Biomedical Research/standards , Clinical Trials as Topic/statistics & numerical data , Developed Countries/economics , Developing Countries/economics , Guidelines as Topic , Humans , Internationality , National Institutes of Health (U.S.)/economics , Open Access Publishing/economics , Open Access Publishing/statistics & numerical data , Open Access Publishing/supply & distribution , Periodicals as Topic/standards , Publishing/standards , Publishing/supply & distribution , Research Personnel/education , Research Personnel/ethics , Research Personnel/standards , Research Support as Topic/standards , Research Support as Topic/statistics & numerical data , Review Literature as Topic , United StatesABSTRACT
BACKGROUND: The Internet has transformed scholarly publishing, most notably, by the introduction of open access publishing. Recently, there has been a rise of online journals characterized as 'predatory', which actively solicit manuscripts and charge publications fees without providing robust peer review and editorial services. We carried out a cross-sectional comparison of characteristics of potential predatory, legitimate open access, and legitimate subscription-based biomedical journals. METHODS: On July 10, 2014, scholarly journals from each of the following groups were identified - potential predatory journals (source: Beall's List), presumed legitimate, fully open access journals (source: PubMed Central), and presumed legitimate subscription-based (including hybrid) journals (source: Abridged Index Medicus). MEDLINE journal inclusion criteria were used to screen and identify biomedical journals from within the potential predatory journals group. One hundred journals from each group were randomly selected. Journal characteristics (e.g., website integrity, look and feel, editors and staff, editorial/peer review process, instructions to authors, publication model, copyright and licensing, journal location, and contact) were collected by one assessor and verified by a second. Summary statistics were calculated. RESULTS: Ninety-three predatory journals, 99 open access, and 100 subscription-based journals were analyzed; exclusions were due to website unavailability. Many more predatory journals' homepages contained spelling errors (61/93, 66%) and distorted or potentially unauthorized images (59/93, 63%) compared to open access journals (6/99, 6% and 5/99, 5%, respectively) and subscription-based journals (3/100, 3% and 1/100, 1%, respectively). Thirty-one (33%) predatory journals promoted a bogus impact metric - the Index Copernicus Value - versus three (3%) open access journals and no subscription-based journals. Nearly three quarters (n = 66, 73%) of predatory journals had editors or editorial board members whose affiliation with the journal was unverified versus two (2%) open access journals and one (1%) subscription-based journal in which this was the case. Predatory journals charge a considerably smaller publication fee (median $100 USD, IQR $63-$150) than open access journals ($1865 USD, IQR $800-$2205) and subscription-based hybrid journals ($3000 USD, IQR $2500-$3000). CONCLUSIONS: We identified 13 evidence-based characteristics by which predatory journals may potentially be distinguished from presumed legitimate journals. These may be useful for authors who are assessing journals for possible submission or for others, such as universities evaluating candidates' publications as part of the hiring process.
Subject(s)
Bibliometrics , Open Access Publishing , Peer Review/methods , Publishing , Humans , Internet , Journalism, Medical/standards , Models, Organizational , Open Access Publishing/organization & administration , Open Access Publishing/standards , Publishing/organization & administration , Publishing/standardsABSTRACT
BACKGROUND: Scientific editors are responsible for deciding which articles to publish in their journals. However, we have not found documentation of their required knowledge, skills, and characteristics, or the existence of any formal core competencies for this role. METHODS: We describe the development of a minimum set of core competencies for scientific editors of biomedical journals. RESULTS: The 14 key core competencies are divided into three major areas, and each competency has a list of associated elements or descriptions of more specific knowledge, skills, and characteristics that contribute to its fulfillment. CONCLUSIONS: We believe that these core competencies are a baseline of the knowledge, skills, and characteristics needed to perform competently the duties of a scientific editor at a biomedical journal.
Subject(s)
Biomedical Research/methods , Consensus , Editorial Policies , Humans , Periodicals as Topic , PublishingABSTRACT
We developed a reporting guideline to provide authors with guidance about what should be reported when writing a paper for publication in a scientific journal using a particular type of research design: the single-case experimental design. This report describes the methods used to develop the Single-Case Reporting guideline In BEhavioural interventions (SCRIBE) 2016. As a result of 2 online surveys and a 2-day meeting of experts, the SCRIBE 2016 checklist was developed, which is a set of 26 items that authors need to address when writing about single-case research. This article complements the more detailed SCRIBE 2016 Explanation and Elaboration article (Tate et al., 2016 ) that provides a rationale for each of the items and examples of adequate reporting from the literature. Both these resources will assist authors to prepare reports of single-case research with clarity, completeness, accuracy, and transparency. They will also provide journal reviewers and editors with a practical checklist against which such reports may be critically evaluated. We recommend that the SCRIBE 2016 is used by authors preparing manuscripts describing single-case research for publication, as well as journal reviewers and editors who are evaluating such manuscripts. SCIENTIFIC ABSTRACT Reporting guidelines, such as the Consolidated Standards of Reporting Trials (CONSORT) Statement, improve the reporting of research in the medical literature (Turner et al., 2012 ). Many such guidelines exist and the CONSORT Extension to Nonpharmacological Trials (Boutron et al., 2008 ) provides suitable guidance for reporting between-groups intervention studies in the behavioural sciences. The CONSORT Extension for N-of-1 Trials (CENT 2015) was developed for multiple crossover trials with single individuals in the medical sciences (Shamseer et al., 2015 ; Vohra et al., 2015 ), but there is no reporting guideline in the CONSORT tradition for single-case research used in the behavioural sciences. We developed the Single-Case Reporting guideline In BEhavioural interventions (SCRIBE) 2016 to meet this need. This Statement article describes the methodology of the development of the SCRIBE 2016, along with the outcome of 2 Delphi surveys and a consensus meeting of experts. We present the resulting 26-item SCRIBE 2016 checklist. The article complements the more detailed SCRIBE 2016 Explanation and Elaboration article (Tate et al., 2016 ) that provides a rationale for each of the items and examples of adequate reporting from the literature. Both these resources will assist authors to prepare reports of single-case research with clarity, completeness, accuracy, and transparency. They will also provide journal reviewers and editors with a practical checklist against which such reports may be critically evaluated.
Subject(s)
Behavior Therapy , Checklist , Guidelines as Topic , Publishing , Research Design , Research Report/standards , Humans , Peer Review, Research/standardsABSTRACT
BACKGROUND: Systematic reviews (SRs) can help decision makers interpret the deluge of published biomedical literature. However, a SR may be of limited use if the methods used to conduct the SR are flawed, and reporting of the SR is incomplete. To our knowledge, since 2004 there has been no cross-sectional study of the prevalence, focus, and completeness of reporting of SRs across different specialties. Therefore, the aim of our study was to investigate the epidemiological and reporting characteristics of a more recent cross-section of SRs. METHODS AND FINDINGS: We searched MEDLINE to identify potentially eligible SRs indexed during the month of February 2014. Citations were screened using prespecified eligibility criteria. Epidemiological and reporting characteristics of a random sample of 300 SRs were extracted by one reviewer, with a 10% sample extracted in duplicate. We compared characteristics of Cochrane versus non-Cochrane reviews, and the 2014 sample of SRs versus a 2004 sample of SRs. We identified 682 SRs, suggesting that more than 8,000 SRs are being indexed in MEDLINE annually, corresponding to a 3-fold increase over the last decade. The majority of SRs addressed a therapeutic question and were conducted by authors based in China, the UK, or the US; they included a median of 15 studies involving 2,072 participants. Meta-analysis was performed in 63% of SRs, mostly using standard pairwise methods. Study risk of bias/quality assessment was performed in 70% of SRs but was rarely incorporated into the analysis (16%). Few SRs (7%) searched sources of unpublished data, and the risk of publication bias was considered in less than half of SRs. Reporting quality was highly variable; at least a third of SRs did not report use of a SR protocol, eligibility criteria relating to publication status, years of coverage of the search, a full Boolean search logic for at least one database, methods for data extraction, methods for study risk of bias assessment, a primary outcome, an abstract conclusion that incorporated study limitations, or the funding source of the SR. Cochrane SRs, which accounted for 15% of the sample, had more complete reporting than all other types of SRs. Reporting has generally improved since 2004, but remains suboptimal for many characteristics. CONCLUSIONS: An increasing number of SRs are being published, and many are poorly conducted and reported. Strategies are needed to help reduce this avoidable waste in research.
Subject(s)
Biomedical Research , Epidemiologic Methods , Research Design , Review Literature as Topic , Biomedical Research/statistics & numerical data , Cross-Sectional Studies , HumansABSTRACT
BACKGROUND: Biomedical journals are the main route for disseminating the results of health-related research. Despite this, their editors operate largely without formal training or certification. To our knowledge, no body of literature systematically identifying core competencies for scientific editors of biomedical journals exists. Therefore, we aimed to conduct a scoping review to determine what is known on the competency requirements for scientific editors of biomedical journals. METHODS: We searched the MEDLINE®, Cochrane Library, Embase®, CINAHL, PsycINFO, and ERIC databases (from inception to November 2014) and conducted a grey literature search for research and non-research articles with competency-related statements (i.e. competencies, knowledge, skills, behaviors, and tasks) pertaining to the role of scientific editors of peer-reviewed health-related journals. We also conducted an environmental scan, searched the results of a previous environmental scan, and searched the websites of existing networks, major biomedical journal publishers, and organizations that offer resources for editors. RESULTS: A total of 225 full-text publications were included, 25 of which were research articles. We extracted a total of 1,566 statements possibly related to core competencies for scientific editors of biomedical journals from these publications. We then collated overlapping or duplicate statements which produced a list of 203 unique statements. Finally, we grouped these statements into seven emergent themes: (1) dealing with authors, (2) dealing with peer reviewers, (3) journal publishing, (4) journal promotion, (5) editing, (6) ethics and integrity, and (7) qualities and characteristics of editors. DISCUSSION: To our knowledge, this scoping review is the first attempt to systematically identify possible competencies of editors. Limitations are that (1) we may not have captured all aspects of a biomedical editor's work in our searches, (2) removing redundant and overlapping items may have led to the elimination of some nuances between items, (3) restricting to certain databases, and only French and English publications, may have excluded relevant publications, and (4) some statements may not necessarily be competencies. CONCLUSION: This scoping review is the first step of a program to develop a minimum set of core competencies for scientific editors of biomedical journals which will be followed by a training needs assessment, a Delphi exercise, and a consensus meeting.
Subject(s)
Editorial Policies , Peer Review, Research/standards , Periodicals as Topic/standards , Professional Competence/standards , Biomedical Research/standards , Databases, Factual , Humans , Publishing , Quality ControlABSTRACT
BACKGROUND: Attention deficit hyperactivity disorder (ADHD) is one of the most common psychiatric conditions affecting children and adolescents. Amphetamines are among the most commonly prescribed medications to manage ADHD. There are three main classes of amphetamines: dexamphetamine, lisdexamphetamine and mixed amphetamine salts, which can be further broken down into short- and long-acting formulations. A systematic review assessing their efficacy and safety in this population has never been conducted. OBJECTIVES: To assess the efficacy and safety of amphetamines for ADHD in children and adolescents. SEARCH METHODS: In August 2015 we searched CENTRAL, Ovid MEDLINE, Embase, PsycINFO, ProQuest Dissertation and Theses, and the Networked Digital Library of Theses and Dissertations. We also searched ClinicalTrials.gov, and checked the reference lists of relevant studies and reviews identified by the searches. No language or date restrictions were applied. SELECTION CRITERIA: Parallel-group and cross-over randomized controlled trials (RCTs) comparing amphetamine derivatives against placebo in a pediatric population (< 18 years) with ADHD. DATA COLLECTION AND ANALYSIS: Two authors independently extracted data on participants, settings, interventions, methodology, and outcomes for each included study. For continuous outcomes, we calculated the standardized mean difference (SMD) and for dichotomous outcomes we calculated the risk ratio (RR). Where possible, we conducted meta-analyses using a random-effects model. We also performed a meta-analysis of the most commonly reported adverse events in the primary studies. MAIN RESULTS: We included 23 trials (8 parallel-group and 15 cross-over trials), with 2675 children aged three years to 17 years. All studies compared amphetamines to placebo. Study durations ranged from 14 days to 365 days, with the majority lasting less than six months. Most studies were conducted in the United States; three studies were conducted across Europe. We judged 11 included studies to be at a high risk of bias due to insufficient blinding methods, failing to account for dropouts and exclusions from the analysis, and failing to report on all outcomes defined a priori. We judged the remaining 12 studies to be at unclear risk of bias due to inadequate reporting.Amphetamines improved total ADHD core symptom severity according to parent ratings (SMD -0.57; 95% confidence interval (CI) -0.86 to -0.27; 7 studies; 1247 children/adolescents; very low quality evidence), teacher ratings (SMD -0.55; 95% CI -0.83 to -0.27; 5 studies; 745 children/adolescents; low quality evidence), and clinician ratings (SMD -0.84; 95% CI -1.32 to -0.36; 3 studies; 813 children/adolescents; very low quality evidence). In addition, the proportion of responders as rated by the Clinical Global Impression - Improvement (CGI-I) scale was higher when children were taking amphetamines (RR 3.36; 95% CI 2.48 to 4.55; 9 studies; 2207 children/adolescents; very low quality evidence).The most commonly reported adverse events included decreased appetite, insomnia/trouble sleeping, abdominal pain, nausea/vomiting, headaches, and anxiety. Amphetamines were associated with a higher proportion of participants experiencing decreased appetite (RR 6.31; 95% CI 2.58 to 15.46; 11 studies; 2467 children/adolescents), insomnia (RR 3.80; 95% CI 2.12 to 6.83; 10 studies; 2429 children/adolescents), and abdominal pain (RR 1.44; 95% CI 1.03 to 2.00; 10 studies; 2155 children/adolescents). In addition, the proportion of children who experienced at least one adverse event was higher in the amphetamine group (RR 1.30; 95% CI 1.18 to 1.44; 6 studies; 1742 children/adolescents; low quality evidence).We performed subgroup analyses for amphetamine preparation (dexamphetamine, lisdexamphetamine, mixed amphetamine salts), amphetamine release formulation (long acting versus short acting), and funding source (industry versus non industry). Between-group differences were observed for proportion of participants experiencing decreased appetite in both the amphetamine preparation (P < 0.00001) and amphetamine release formulation (P value = 0.008) subgroups, as well as for retention in the amphetamine release formulation subgroup (P value = 0.03). AUTHORS' CONCLUSIONS: Most of the included studies were at high risk of bias and the overall quality of the evidence ranged from low to very low on most outcomes. Although amphetamines seem efficacious at reducing the core symptoms of ADHD in the short term, they were associated with a number of adverse events. This review found no evidence that supports any one amphetamine derivative over another, and does not reveal any differences between long-acting and short-acting amphetamine preparations. Future trials should be longer in duration (i.e. more than 12 months), include more psychosocial outcomes (e.g. quality of life and parent stress), and be transparently reported.
Subject(s)
Amphetamines/therapeutic use , Attention Deficit Disorder with Hyperactivity/drug therapy , Adolescent , Child , Child, Preschool , Humans , Randomized Controlled Trials as TopicABSTRACT
Reporting guidelines, such as the Consolidated Standards of Reporting Trials (CONSORT) Statement, improve the reporting of research in the medical literature (Turner et al., 2012). Many such guidelines exist, and the CONSORT Extension to Nonpharmacological Trials (Boutron et al., 2008) provides suitable guidance for reporting between-groups intervention studies in the behavioral sciences. The CONSORT Extension for N-of-1 Trials (CENT 2015) was developed for multiple crossover trials with single individuals in the medical sciences (Shamseer et al., 2015; Vohra et al., 2015), but there is no reporting guideline in the CONSORT tradition for single-case research used in the behavioral sciences. We developed the Single-Case Reporting guideline In Behavioral interventions (SCRIBE) 2016 to meet this need. This Statement article describes the methodology of the development of the SCRIBE 2016, along with the outcome of 2 Delphi surveys and a consensus meeting of experts. We present the resulting 26-item SCRIBE 2016 checklist. The article complements the more detailed SCRIBE 2016 Explanation and Elaboration article (Tate et al., 2016) that provides a rationale for each of the items and examples of adequate reporting from the literature. Both these resources will assist authors to prepare reports of single-case research with clarity, completeness, accuracy, and transparency. They will also provide journal reviewers and editors with a practical checklist against which such reports may be critically evaluated.
Subject(s)
Behavioral Sciences/methods , Checklist , Guidelines as Topic , Publishing/standards , Research Design , Research Report/standards , Delphi Technique , HumansABSTRACT
Detailed phylogenetic and comparative genomic analyses are reported on 140 genome sequenced cyanobacteria with the main focus on the heterocyst-differentiating cyanobacteria. In a phylogenetic tree for cyanobacteria based upon concatenated sequences for 32 conserved proteins, the available cyanobacteria formed 8-9 strongly supported clades at the highest level, which may correspond to the higher taxonomic clades of this phylum. One of these clades contained all heterocystous cyanobacteria; within this clade, the members exhibiting either true (Nostocales) or false (Stigonematales) branching of filaments were intermixed indicating that the division of the heterocysts-forming cyanobacteria into these two groups is not supported by phylogenetic considerations. However, in both the protein tree as well as in the 16S rRNA gene tree, the akinete-forming heterocystous cyanobacteria formed a distinct clade. Within this clade, the members which differentiate into hormogonia or those which lack this ability were also separated into distinct groups. A novel molecular signature identified in this work that is uniquely shared by the akinete-forming heterocystous cyanobacteria provides further evidence that the members of this group are specifically related and they shared a common ancestor exclusive of the other cyanobacteria. Detailed comparative analyses on protein sequences from the genomes of heterocystous cyanobacteria reported here have also identified eight conserved signature indels (CSIs) in proteins involved in a broad range of functions, and three conserved signature proteins, that are either uniquely or mainly found in all heterocysts-forming cyanobacteria, but generally not found in other cyanobacteria. These molecular markers provide novel means for the identification of heterocystous cyanobacteria, and they provide evidence of their monophyletic origin. Additionally, this work has also identified seven CSIs in other proteins which in addition to the heterocystous cyanobacteria are uniquely shared by two smaller clades of cyanobacteria, which form the successive outgroups of the clade comprising of the heterocystous cyanobacteria in the protein trees. Based upon their close relationship to the heterocystous cyanobacteria, the members of these clades are indicated to be the closest relatives of the heterocysts-forming cyanobacteria.
Subject(s)
Cyanobacteria/classification , Cyanobacteria/genetics , Phylogeny , Amino Acid Sequence , Bacterial Proteins/genetics , Bacterial Proteins/metabolism , Conserved Sequence , Cyanobacteria/metabolism , DNA, Bacterial/genetics , Gene Expression Regulation, Bacterial , Molecular Sequence DataABSTRACT
Predatory journals are a blemish on scholarly publishing and academia and the studies published within them are more likely to contain data that is false. The inclusion of studies from predatory journals in evidence syntheses is potentially problematic due to this propensity for false data to be included. To date, there has been little exploration of the opinions and experiences of evidence synthesisers when dealing with predatory journals in the conduct of their evidence synthesis. In this paper, the thoughts, opinions, and attitudes of evidence synthesisers towards predatory journals and the inclusion of studies published within these journals in evidence syntheses were sought. Focus groups were held with participants who were experienced evidence synthesisers from JBI (previously the Joanna Briggs Institute) collaboration. Utilising qualitative content analysis, two generic categories were identified: predatory journals within evidence synthesis, and predatory journals within academia. Our findings suggest that evidence synthesisers believe predatory journals are hard to identify and that there is no current consensus on the management of these studies if they have been included in an evidence synthesis. There is a critical need for further research, education, guidance, and development of clear processes to assist evidence synthesisers in the management of studies from predatory journals.
Subject(s)
Periodicals as Topic , Humans , Surveys and Questionnaires , Qualitative ResearchABSTRACT
Synthesizers of evidence are increasingly likely to encounter studies published in predatory journals during the evidence synthesis process. The evidence synthesis discipline is uniquely positioned to encounter novel concerns associated with predatory journals. The objective of this research was to explore the attitudes, opinions, and experiences of experts in the synthesis of evidence regarding predatory journals. Employing a descriptive survey-based cross-sectional study design, these experts were asked a series of questions regarding predatory journals to explore these attitudes, opinions, and experiences. Two hundred and sixty four evidence synthesis experts responded to this survey. Most respondents agreed with the definition of a predatory journal (86%), however several (19%) responded that this definition was difficult to apply practically. Many respondents believed that studies published in predatory journals are still eligible for inclusion into an evidence synthesis project. However, this was only after the study had been determined to be 'high-quality' (39%) or if the results were validated (13%). While many respondents could identify common characteristics of these journals, there was still hesitancy regarding the appropriate methods to follow when considering including these studies into an evidence synthesis project.
Subject(s)
Periodicals as Topic , Cross-Sectional Studies , Surveys and QuestionnairesABSTRACT
BACKGROUND: An overwhelming body of evidence stating that the completeness of reporting of randomised controlled trials (RCTs) is not optimal has accrued over time. In the mid-1990s, in response to these concerns, an international group of clinical trialists, statisticians, epidemiologists, and biomedical journal editors developed the CONsolidated Standards Of Reporting Trials (CONSORT) Statement. The CONSORT Statement, most recently updated in March 2010, is an evidence-based minimum set of recommendations including a checklist and flow diagram for reporting RCTs and is intended to facilitate the complete and transparent reporting of trials and aid their critical appraisal and interpretation. In 2006, a systematic review of eight studies evaluating the "effectiveness of CONSORT in improving reporting quality in journals" was published. OBJECTIVES: To update the earlier systematic review assessing whether journal endorsement of the 1996 and 2001 CONSORT checklists influences the completeness of reporting of RCTs published in medical journals. SEARCH METHODS: We conducted electronic searches, known item searching, and reference list scans to identify reports of evaluations assessing the completeness of reporting of RCTs. The electronic search strategy was developed in MEDLINE and tailored to EMBASE. We searched the Cochrane Methodology Register and the Cochrane Database of Systematic Reviews using the Wiley interface. We searched the Science Citation Index, Social Science Citation Index, and Arts and Humanities Citation Index through the ISI Web of Knowledge interface. We conducted all searches to identify reports published between January 2005 and March 2010, inclusive. SELECTION CRITERIA: In addition to studies identified in the original systematic review on this topic, comparative studies evaluating the completeness of reporting of RCTs in any of the following comparison groups were eligible for inclusion in this review: 1) Completeness of reporting of RCTs published in journals that have and have not endorsed the CONSORT Statement; 2) Completeness of reporting of RCTs published in CONSORT-endorsing journals before and after endorsement; or 3) Completeness of reporting of RCTs before and after the publication of the CONSORT Statement (1996 or 2001). We used a broad definition of CONSORT endorsement that includes any of the following: (a) requirement or recommendation in journal's 'Instructions to Authors' to follow CONSORT guidelines; (b) journal editorial statement endorsing the CONSORT Statement; or (c) editorial requirement for authors to submit a CONSORT checklist and/or flow diagram with their manuscript. We contacted authors of evaluations reporting data that could be included in any comparison group(s), but not presented as such in the published report and asked them to provide additional data in order to determine eligibility of their evaluation. Evaluations were not excluded due to language of publication or validity assessment. DATA COLLECTION AND ANALYSIS: We completed screening and data extraction using standardised electronic forms, where conflicts, reasons for exclusion, and level of agreement were all automatically and centrally managed in web-based management software, DistillerSR(®). One of two authors extracted general characteristics of included evaluations and all data were verified by a second author. Data describing completeness of reporting were extracted by one author using a pre-specified form; a 10% random sample of evaluations was verified by a second author. Any discrepancies were discussed by both authors; we made no modifications to the extracted data. Validity assessments of included evaluations were conducted by one author and independently verified by one of three authors. We resolved all conflicts by consensus.For each comparison we collected data on 27 outcomes: 22 items of the CONSORT 2001 checklist, plus four items relating to the reporting of blinding, and one item of aggregate CONSORT scores. Where reported, we extracted and qualitatively synthesised data on the methodological quality of RCTs, by scale or score. MAIN RESULTS: Fifty-three publications reporting 50 evaluations were included. The total number of RCTs assessed within evaluations was 16,604 (median per evaluation 123 (interquartile range (IQR) 77 to 226) published in a median of six (IQR 3 to 26) journals. Characteristics of the included RCT populations were variable, resulting in heterogeneity between included evaluations. Validity assessments of included studies resulted in largely unclear judgements. The included evaluations are not RCTs and less than 8% (4/53) of the evaluations reported adjusting for potential confounding factors. Twenty-five of 27 outcomes assessing completeness of reporting in RCTs appeared to favour CONSORT-endorsing journals over non-endorsers, of which five were statistically significant. 'Allocation concealment' resulted in the largest effect, with risk ratio (RR) 1.81 (99% confidence interval (CI) 1.25 to 2.61), suggesting that 81% more RCTs published in CONSORT-endorsing journals adequately describe allocation concealment compared to those published in non-endorsing journals. Allocation concealment was reported adequately in 45% (393/876) of RCTs in CONSORT-endorsing journals and in 22% (329/1520) of RCTs in non-endorsing journals. Other outcomes with results that were significant include: scientific rationale and background in the 'Introduction' (RR 1.07, 99% CI 1.01 to 1.14); 'sample size' (RR 1.61, 99% CI 1.13 to 2.29); method used for 'sequence generation' (RR 1.59, 99% CI 1.38 to 1.84); and an aggregate score over reported CONSORT items, 'total sum score' (standardised mean difference (SMD) 0.68 (99% CI 0.38 to 0.98)). AUTHORS' CONCLUSIONS: Evidence has accumulated to suggest that the reporting of RCTs remains sub-optimal. This review updates a previous systematic review of eight evaluations. The findings of this review are similar to those from the original review and demonstrate that, despite the general inadequacies of reporting of RCTs, journal endorsement of the CONSORT Statement may beneficially influence the completeness of reporting of trials published in medical journals. Future prospective studies are needed to explore the influence of the CONSORT Statement dependent on the extent of editorial policies to ensure adherence to CONSORT guidance.
Subject(s)
Checklist/standards , Periodicals as Topic/standards , Publishing/standards , Randomized Controlled Trials as Topic/standards , Reference StandardsABSTRACT
BACKGROUND: Rhodiola rosea (R. rosea) is grown at high altitudes and northern latitudes. Due to its purported adaptogenic properties, it has been studied for its performance-enhancing capabilities in healthy populations and its therapeutic properties in a number of clinical populations. To systematically review evidence of efficacy and safety of R. rosea for physical and mental fatigue. METHODS: Six electronic databases were searched to identify randomized controlled trials (RCTs) and controlled clinical trials (CCTs), evaluating efficacy and safety of R. rosea for physical and mental fatigue. Two reviewers independently screened the identified literature, extracted data and assessed risk of bias for included studies. RESULTS: Of 206 articles identified in the search, 11 met inclusion criteria for this review. Ten were described as RCTs and one as a CCT. Two of six trials examining physical fatigue in healthy populations report R. rosea to be effective as did three of five RCTs evaluating R. rosea for mental fatigue. All of the included studies exhibit either a high risk of bias or have reporting flaws that hinder assessment of their true validity (unclear risk of bias). CONCLUSION: Research regarding R. rosea efficacy is contradictory. While some evidence suggests that the herb may be helpful for enhancing physical performance and alleviating mental fatigue, methodological flaws limit accurate assessment of efficacy. A rigorously-designed well reported RCT that minimizes bias is needed to determine true efficacy of R. rosea for fatigue.
Subject(s)
Mental Fatigue/drug therapy , Plant Extracts/adverse effects , Rhodiola/chemistry , Controlled Clinical Trials as Topic , Humans , Randomized Controlled Trials as TopicABSTRACT
INTRODUCTION: Health inequities are defined as unfair and avoidable differences in health between groups within a population. Most health research is conducted through observational studies, which are able to offer real-world insights about etiology, healthcare policy/programme effectiveness and the impacts of socioeconomic factors. However, most published reports of observational studies do not address how their findings relate to health equity. Our team seeks to develop equity-relevant reporting guidance as an extension of the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement. This scoping review will inform the development of candidate items for the STROBE-Equity extension. We will operationalise equity-seeking populations using the PROGRESS-Plus framework of sociodemographic factors. As part of a parallel stream of the STROBE-Equity project, the relevance of candidate guideline items to Indigenous research will be led by Indigenous coinvestigators on the team. METHODS AND ANALYSIS: We will follow the Joanna Briggs Institute method for conducting scoping reviews. We will evaluate the extent to which the identified guidance supports or refutes our preliminary candidate items for reporting equity in observational studies. These candidate items were developed based on items from equity-reporting guidelines for randomised trials and systematic reviews, developed by members of this team. We will consult with our knowledge users, patients/public partners and Indigenous research steering committee to invite suggestions for relevant guidance documents and interpretation of findings. If the identified guidance suggests the need for additional candidate items, they will be developed through inductive thematic analysis. ETHICS AND DISSEMINATION: We will follow a principled approach that promotes ethical codevelopment with our community partners, based on principles of cultural safety, authentic partnerships, addressing colonial structures in knowledge production and the shared ownership, interpretation, and dissemination of research. All products of this research will be published as open access.
Subject(s)
Health Equity , Humans , Population Groups , Research Design , Research Report , Review Literature as Topic , Socioeconomic FactorsABSTRACT
Background: Funded health research is being published in journals that many regard as "predatory", deceptive, and non-credible. We do not currently know whether funders provide guidance on how to select a journal in which to publish funded health research. Methods: We identified the largest 46 philanthropic, public, development assistance, public-private partnership, and multilateral funders of health research by expenditure, globally as well as four public funders from lower-middle income countries, from the list at https://healthresearchfunders.org. One of us identified guidance on disseminating funded research from each funders' website (August/September 2017), then extracted information about selecting journals, which was verified by another assessor. Discrepancies were resolved by discussion. Results were summarized descriptively. This research used publicly available information; we did not seek verification with funding bodies. Results: The majority (44/50) of sampled funders indicated funding health research. 38 (of 44, 86%) had publicly available information about disseminating funded research, typically called "policies" (29, 76%). Of these 38, 36 (95%) mentioned journal publication for dissemination of which 13 (36.11%) offer variable guidance on selecting a journal, all of which relate to the funder's open access mandate. Six funders (17%) outlined publisher requirements or features by which to select a journal. One funder linked to a document providing features of journals to look for (e.g. listed in the Directory of Open Access Journals) and to be wary of (e.g., no journal scope statement, uses direct and unsolicited marketing). Conclusions: Few funders provided guidance on how to select a journal in which to publish funded research. Funders have a duty to ensure that the research they fund is discoverable by others. This research is a benchmark for funder guidance on journal selection prior to the January 2021 implementation of Plan S (a global, funder-led initiative to ensure immediate, open access to funded, published research).
Subject(s)
Periodicals as TopicABSTRACT
ABSTRACT: A systematic review involves the identification, evaluation, and synthesis of the best-available evidence to provide an answer to a specific question. The "best-available evidence" is, in many cases, a peer-reviewed scientific article published in an academic journal that details the conduct and results of a scientific study. Any potential threat to the validity of these individual studies (and hence the resultant synthesis) must be evaluated and critiqued.In science, the number of predatory journals continue to rise. Studies published in predatory journals may be of lower quality and more likely to be impacted by fraud and error compared to studies published in traditional journals. This poses a threat to the validity of systematic reviews that include these studies and, therefore, the translation of evidence into guidance for policy and practice. Despite the challenges predatory journals present to systematic reviewers, there is currently little guidance regarding how they should be managed.In 2020, a subgroup of the JBI Scientific Committee was formed to investigate this issue. In this overview paper, we introduce predatory journals to systematic reviewers, outline the problems they present and their potential impact on systematic reviews, and provide some alternative strategies for consideration of studies from predatory journals in systematic reviews. Options for systematic reviewers could include excluding all studies from suspected predatory journals, applying additional strategies to forensically examine the results of studies published in suspected predatory journals, setting stringent search limits, and applying analytical techniques (such as subgroup or sensitivity analyses) to investigate the impact of suspected predatory journals in a synthesis.