A guide for social science journal editors on easing into open science.

Journal editors have a large amount of power to advance open science in their respective fields by incentivising and mandating open policies and practices at their journals. The Data PASS Journal Editors Discussion Interface (JEDI, an online community for social science journal editors: www.dpjedi.org ) has collated several resources on embedding open science in journal editing ( www.dpjedi.org/resources ). However, it can be overwhelming as an editor new to open science practices to know where to start. For this reason, we created a guide for journal editors on how to get started with open science. The guide outlines steps that editors can take to implement open policies and practices within their journal, and goes through the what, why, how, and worries of each policy and practice. This manuscript introduces and summarizes the guide (full guide: https://doi.org/10.31219/osf.io/hstcx ).

Publication of Results of Registered Trials With Published Study Protocols, 2011-2022.

Importance: Publishing study protocols might reduce research waste because of unclear methods or incomplete reporting; on the other hand, there might be few additional benefits of publishing protocols for registered trials that are never completed or published. No study has investigated the proportion of published protocols associated with published results. Objective: To estimate the proportion of published trial protocols for which there are not associated published results. Design, Setting, and Participants: This cross-sectional study used stratified random sampling to identify registered clinical trials with protocols published between January 2011 and August 2022 and indexed in PubMed Central. Ongoing studies and those within 1 year of the primary completion date on ClinicalTrials.gov were excluded. Published results were sought from August 2022 to March 2023 by searching ClinicalTrials.gov, emailing authors, and using an automated tool, as well as through incidental discovery. Main Outcomes and Measures: The primary outcome was a weighted estimate of the proportion of registered trials with published protocols that also had published main results. The proportion of trials with unpublished results was estimated using a weighted mean. Results: From 1500 citations that were screened, 308 clinical trial protocols were included, and it was found that 87 trials had not published their main results. Most included trials were investigator-initiated evaluations of nonregulated products. When published, results appeared a mean (SD) of 3.4 (2.0) years after protocol publications. With the use of a weighted mean, an estimated 4754 (95% CI, 4296-5226) eligible clinical trial protocols were published and indexed in PubMed Central between 2011 and 2022. In the weighted analysis, 1708 of those protocols (36%; 95% CI, 31%-41%) were not associated with publication of main results. In a sensitivity analysis excluding protocols published after 2019, an estimated 25% (95% CI, 20%-30%) of 3670 (95% CI, 3310-4032) protocol publications were not associated with publication of main results. Conclusions and Relevance: This cross-sectional study of clinical trial protocols published on PubMed Central between 2011 and 2022 suggests that many protocols were not associated with subsequent publication of results. The overall benefits of publishing study protocols might outweigh the research waste caused by unnecessary protocol publications.

Harms were detected but not reported in six clinical trials of gabapentin.

OBJECTIVES: We sought to assess and report harms that were observed but not disclosed previously in clinical trials of gabapentin. STUDY DESIGN AND SETTING: We reanalyzed individual participant data from six randomized parallel trials of gabapentin for neuropathic pain, and we conducted meta-analyses. Between 1996 and 2003, adult participants were assigned to gabapentin (600 mg-3,600 mg per day) or placebo for 7-14 weeks. We calculated the proportion of participants with: one or more adverse events (AEs), one or more serious AEs, discontinued, discontinued because AEs. We also estimated effects on AEs at three levels of aggregation using COSTART, a hierarchical system for classifying AEs: body system, midlevel system, preferred term. RESULTS: We found evidence of important harms that were neither included in published trial reports nor included in systematic reviews. Aggregating related harms led to greater confidence that gabapentin might harm the nervous system and possibly the digestive, metabolic and nutritional, respiratory, sensory, and urogenital body systems. Nervous system harms were more common than previous reports suggest. CONCLUSION: Clinical trials identified harms that were not reported publicly, and journal articles overstated uncertainty about harms. Relying on journal articles to evaluate gabapentin's harms could contribute to incomplete and misleading conclusions in systematic reviews and guidelines. To prevent bias arising from the selective nonreporting of results, journal articles should describe how to access data for all harms observed in clinical trials (e.g., by sharing individual participant data).

Methodology reporting improved over time in 176,469 randomized controlled trials.

OBJECTIVES: To describe randomized controlled trial (RCT) methodology reporting over time. STUDY DESIGN AND SETTING: We used a deep learning-based sentence classification model based on the Consolidated Standards of Reporting Trials (CONSORT) statement, considered minimum requirements for reporting RCTs. We included 176,469 RCT reports published between 1966 and 2018. We analyzed the reporting trends over 5-year time periods, grouping trials from 1966 to 1990 in a single stratum. We also explored the effect of journal impact factor (JIF) and medical discipline. RESULTS: Population, Intervention, Comparator, Outcome (PICO) items were commonly reported during each period, and reporting increased over time (e.g., interventions: 79.1% during 1966-1990 to 87.5% during 2010-2018). Reporting of some methods information has increased, although there is room for improvement (e.g., sequence generation: 10.8-41.8%). Some items are reported infrequently (e.g., allocation concealment: 5.1-19.3%). The number of items reported and JIF are weakly correlated (Pearson's r (162,702) = 0.16, P < 0.001). The differences in the proportion of items reported between disciplines are small (<10%). CONCLUSION: Our analysis provides large-scale quantitative support for the hypothesis that RCT methodology reporting has improved over time. Extending these models to all CONSORT items could facilitate compliance checking during manuscript authoring and peer review, and support metaresearch.

Open Science Standards at Journals that Inform Evidence-Based Policy.

Evidence-based policy uses intervention research to inform consequential decisions about resource allocation. Research findings are often published in peer-reviewed journals. Because detrimental research practices associated with closed science are common, journal articles report more false-positives and exaggerated effect sizes than would be desirable. Journal implementation of standards that promote open science-such as the transparency and openness promotion (TOP) guidelines-could reduce detrimental research practices and improve the trustworthiness of research evidence on intervention effectiveness. We evaluated TOP implementation at 339 peer-reviewed journals that have been used to identify evidence-based interventions for policymaking and programmatic decisions. Each of ten open science standards in TOP was not implemented in most journals' policies (instructions to authors), procedures (manuscript submission systems), or practices (published articles). Journals implementing at least one standard typically encouraged, but did not require, an open science practice. We discuss why and how journals could improve implementation of open science standards to safeguard evidence-based policy.

Conducting separate reviews of benefits and harms could improve systematic reviews and meta-analyses.

Guidance for systematic reviews of interventions recommends both benefits and harms be included. Systematic reviews may reach conclusions about harms (or lack of harms) that are not true when reviews include only some relevant studies, rely on incomplete data from eligible studies, use inappropriate methods for synthesizing data, and report results selectively. Separate reviews about harms could address some of these problems, and we argue that conducting separate reviews of harms is a feasible alternative to current standards and practices. Systematic reviews of potential benefits could be organized around the use of interventions for specific health problems. Systematic reviews of potential harms could be broader, including more diverse study designs and including all people at risk of harms (who might use the same intervention to treat different health problems). Multiple reviews about benefits could refer to a single review of harms. This approach could improve the reliability, completeness, and efficiency of systematic reviews.

CONSORT Harms 2022 statement, explanation, and elaboration: updated guideline for the reporting of harms in randomized trials.

Randomized controlled trials remain the reference standard for healthcare research on effects of interventions, and the need to report both benefits and harms is essential. The Consolidated Standards of Reporting Trials (the main CONSORT) statement includes one item on reporting harms (i.e., all important harms or unintended effects in each group). In 2004, the CONSORT group developed the CONSORT Harms extension; however, it has not been consistently applied and needs to be updated. Here, we describe CONSORT Harms 2022, which replaces the CONSORT Harms 2004 checklist, and shows how CONSORT Harms 2022 items could be incorporated into the main CONSORT checklist. Thirteen items from the main CONSORT were modified to improve harms reporting. Three new items were added. In this article, we describe CONSORT Harms 2022 and how it was integrated into the main CONSORT checklist and elaborate on each item relevant to complete reporting of harms in randomized controlled trials. Until future work from the CONSORT group produces an updated checklist, authors, journal reviewers, and editors of randomized controlled trials should use the integrated checklist presented in this paper.

Zinc supplementation for preventing mortality, morbidity, and growth failure in children aged 6 months to 12 years.

BACKGROUND: Zinc deficiency is prevalent in low- and middle-income countries, and is considered a significant risk factor for morbidity, mortality, and linear growth failure. The effectiveness of preventive zinc supplementation in reducing prevalence of zinc deficiency needs to be assessed. OBJECTIVES: To assess the effects of zinc supplementation for preventing mortality and morbidity, and for promoting growth, in children aged 6 months to 12 years. SEARCH METHODS: A previous version of this review was published in 2014. In this update, we searched CENTRAL, MEDLINE, Embase, five other databases, and one trials register up to February 2022, together with reference checking and contact with study authors to identify additional studies. SELECTION CRITERIA: Randomized controlled trials (RCTs) of preventive zinc supplementation in children aged 6 months to 12 years compared with no intervention, a placebo, or a waiting list control. We excluded hospitalized children and children with chronic diseases or conditions. We excluded food fortification or intake, sprinkles, and therapeutic interventions. DATA COLLECTION AND ANALYSIS: Two review authors screened studies, extracted data, and assessed the risk of bias. We contacted study authors for missing information and used GRADE to assess the certainty of evidence. The primary outcomes of this review were all-cause mortality; and cause-specific mortality, due to all-cause diarrhea, lower respiratory tract infection (LRTI, including pneumonia), and malaria. We also collected information on a number of secondary outcomes, such as those related to diarrhea and LRTI morbidity, growth outcomes and serum levels of micronutrients, and adverse events. MAIN RESULTS: We included 16 new studies in this review, resulting in a total of 96 RCTs with 219,584 eligible participants. The included studies were conducted in 34 countries; 87 of them in low- or middle-income countries. Most of the children included in this review were under five years of age. The intervention was delivered most commonly in the form of syrup as zinc sulfate, and the most common dose was between 10 mg and 15 mg daily. The median duration of follow-up was 26 weeks. We did not consider that the evidence for the key analyses of morbidity and mortality outcomes was affected by risk of bias. High-certainty evidence showed little to no difference in all-cause mortality with preventive zinc supplementation compared to no zinc (risk ratio (RR) 0.93, 95% confidence interval (CI) 0.84 to 1.03; 16 studies, 17 comparisons, 143,474 participants). Moderate-certainty evidence showed that preventive zinc supplementation compared to no zinc likely results in little to no difference in mortality due to all-cause diarrhea (RR 0.95, 95% CI 0.69 to 1.31; 4 studies, 132,321 participants); but probably reduces mortality due to LRTI (RR 0.86, 95% CI 0.64 to 1.15; 3 studies, 132,063 participants) and mortality due to malaria (RR 0.90, 95% CI 0.77 to 1.06; 2 studies, 42,818 participants); however, the confidence intervals around the summary estimates for these outcomes were wide, and we could not rule out a possibility of increased risk of mortality. Preventive zinc supplementation likely reduces the incidence of all-cause diarrhea (RR 0.91, 95% CI 0.90 to 0.93; 39 studies, 19,468 participants; moderate-certainty evidence) but results in little to no difference in morbidity due to LRTI (RR 1.01, 95% CI 0.95 to 1.08; 19 studies, 10,555 participants; high-certainty evidence) compared to no zinc. There was moderate-certainty evidence that preventive zinc supplementation likely leads to a slight increase in height (standardized mean difference (SMD) 0.12, 95% CI 0.09 to 0.14; 74 studies, 20,720 participants). Zinc supplementation was associated with an increase in the number of participants with at least one vomiting episode (RR 1.29, 95% CI 1.14 to 1.46; 5 studies, 35,192 participants; high-certainty evidence). We report a number of other outcomes, including the effect of zinc supplementation on weight and serum markers such as zinc, hemoglobin, iron, copper, etc. We also performed a number of subgroup analyses and there was a consistent finding for a number of outcomes that co-supplementation of zinc with iron decreased the beneficial effect of zinc. AUTHORS' CONCLUSIONS: Even though we included 16 new studies in this update, the overall conclusions of the review remain unchanged. Zinc supplementation might help prevent episodes of diarrhea and improve growth slightly, particularly in children aged 6 months to 12 years of age. The benefits of preventive zinc supplementation may outweigh the harms in regions where the risk of zinc deficiency is relatively high.

Exploring enablers and barriers to implementing the Transparency and Openness Promotion Guidelines: a theory-based survey of journal editors.

The Transparency and Openness Promotion (TOP) Guidelines provide a framework to help journals develop open science policies. Theories of behaviour change can guide understanding of why journals do (not) implement open science policies and the development of interventions to improve these policies. In this study, we used the Theoretical Domains Framework to survey 88 journal editors on their capability, opportunity and motivation to implement TOP. Likert-scale questions assessed editor support for TOP, and enablers and barriers to implementing TOP. A qualitative question asked editors to provide reflections on their ratings. Most participating editors supported adopting TOP at their journal (71%) and perceived other editors in their discipline to support adopting TOP (57%). Most editors (93%) agreed their roles include maintaining policies that reflect current best practices. However, most editors (74%) did not see implementing TOP as a high priority compared with other editorial responsibilities. Qualitative responses expressed structural barriers to implementing TOP (e.g. lack of time, resources and authority to implement changes) and varying support for TOP depending on study type, open science standard, and level of implementation. We discuss how these findings could inform the development of theoretically guided interventions to increase open science policies, procedures and practices.

Toward more rigorous and informative nutritional epidemiology: The rational space between dismissal and defense of the status quo.

To date, nutritional epidemiology has relied heavily on relatively weak methods including simple observational designs and substandard measurements. Despite low internal validity and other sources of bias, claims of causality are made commonly in this literature. Nutritional epidemiology investigations can be improved through greater scientific rigor and adherence to scientific reporting commensurate with research methods used. Some commentators advocate jettisoning nutritional epidemiology entirely, perhaps believing improvements are impossible. Still others support only normative refinements. But neither abolition nor minor tweaks are appropriate. Nutritional epidemiology, in its present state, offers utility, yet also needs marked, reformational renovation. Changing the status quo will require ongoing, unflinching scrutiny of research questions, practices, and reporting-and a willingness to admit that "good enough" is no longer good enough. As such, a workshop entitled "Toward more rigorous and informative nutritional epidemiology: the rational space between dismissal and defense of the status quo" was held from July 15 to August 14, 2020. This virtual symposium focused on: (1) Stronger Designs, (2) Stronger Measurement, (3) Stronger Analyses, and (4) Stronger Execution and Reporting. Participants from several leading academic institutions explored existing, evolving, and new better practices, tools, and techniques to collaboratively advance specific recommendations for strengthening nutritional epidemiology.

Guidelines for Reporting Outcomes in Trial Reports: The CONSORT-Outcomes 2022 Extension.

Importance: Clinicians, patients, and policy makers rely on published results from clinical trials to help make evidence-informed decisions. To critically evaluate and use trial results, readers require complete and transparent information regarding what was planned, done, and found. Specific and harmonized guidance as to what outcome-specific information should be reported in publications of clinical trials is needed to reduce deficient reporting practices that obscure issues with outcome selection, assessment, and analysis. Objective: To develop harmonized, evidence- and consensus-based standards for reporting outcomes in clinical trial reports through integration with the Consolidated Standards of Reporting Trials (CONSORT) 2010 statement. Evidence Review: Using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework, the CONSORT-Outcomes 2022 extension of the CONSORT 2010 statement was developed by (1) generation and evaluation of candidate outcome reporting items via consultation with experts and a scoping review of existing guidance for reporting trial outcomes (published within the 10 years prior to March 19, 2018) identified through expert solicitation, electronic database searches of MEDLINE and the Cochrane Methodology Register, gray literature searches, and reference list searches; (2) a 3-round international Delphi voting process (November 2018-February 2019) completed by 124 panelists from 22 countries to rate and identify additional items; and (3) an in-person consensus meeting (April 9-10, 2019) attended by 25 panelists to identify essential items for the reporting of outcomes in clinical trial reports. Findings: The scoping review and consultation with experts identified 128 recommendations relevant to reporting outcomes in trial reports, the majority (83%) of which were not included in the CONSORT 2010 statement. All recommendations were consolidated into 64 items for Delphi voting; after the Delphi survey process, 30 items met criteria for further evaluation at the consensus meeting and possible inclusion in the CONSORT-Outcomes 2022 extension. The discussions during and after the consensus meeting yielded 17 items that elaborate on the CONSORT 2010 statement checklist items and are related to completely defining and justifying the trial outcomes, including how and when they were assessed (CONSORT 2010 statement checklist item 6a), defining and justifying the target difference between treatment groups during sample size calculations (CONSORT 2010 statement checklist item 7a), describing the statistical methods used to compare groups for the primary and secondary outcomes (CONSORT 2010 statement checklist item 12a), and describing the prespecified analyses and any outcome analyses not prespecified (CONSORT 2010 statement checklist item 18). Conclusions and Relevance: This CONSORT-Outcomes 2022 extension of the CONSORT 2010 statement provides 17 outcome-specific items that should be addressed in all published clinical trial reports and may help increase trial utility, replicability, and transparency and may minimize the risk of selective nonreporting of trial results.

Guidelines for Reporting Outcomes in Trial Protocols: The SPIRIT-Outcomes 2022 Extension.

Importance: Complete information in a trial protocol regarding study outcomes is crucial for obtaining regulatory approvals, ensuring standardized trial conduct, reducing research waste, and providing transparency of methods to facilitate trial replication, critical appraisal, accurate reporting and interpretation of trial results, and knowledge synthesis. However, recommendations on what outcome-specific information should be included are diverse and inconsistent. To improve reporting practices promoting transparent and reproducible outcome selection, assessment, and analysis, a need for specific and harmonized guidance as to what outcome-specific information should be addressed in clinical trial protocols exists. Objective: To develop harmonized, evidence- and consensus-based standards for describing outcomes in clinical trial protocols through integration with the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 statement. Evidence Review: Using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework, the SPIRIT-Outcomes 2022 extension of the SPIRIT 2013 statement was developed by (1) generation and evaluation of candidate outcome reporting items via consultation with experts and a scoping review of existing guidance for reporting trial outcomes (published within the 10 years prior to March 19, 2018) identified through expert solicitation, electronic database searches of MEDLINE and the Cochrane Methodology Register, gray literature searches, and reference list searches; (2) a 3-round international Delphi voting process (November 2018-February 2019) completed by 124 panelists from 22 countries to rate and identify additional items; and (3) an in-person consensus meeting (April 9-10, 2019) attended by 25 panelists to identify essential items for outcome-specific reporting to be addressed in clinical trial protocols. Findings: The scoping review and consultation with experts identified 108 recommendations relevant to outcome-specific reporting to be addressed in trial protocols, the majority (72%) of which were not included in the SPIRIT 2013 statement. All recommendations were consolidated into 56 items for Delphi voting; after the Delphi survey process, 19 items met criteria for further evaluation at the consensus meeting and possible inclusion in the SPIRIT-Outcomes 2022 extension. The discussions during and after the consensus meeting yielded 9 items that elaborate on the SPIRIT 2013 statement checklist items and are related to completely defining and justifying the choice of primary, secondary, and other outcomes (SPIRIT 2013 statement checklist item 12) prospectively in the trial protocol, defining and justifying the target difference between treatment groups for the primary outcome used in the sample size calculations (SPIRIT 2013 statement checklist item 14), describing the responsiveness of the study instruments used to assess the outcome and providing details on the outcome assessors (SPIRIT 2013 statement checklist item 18a), and describing any planned methods to account for multiplicity relating to the analyses or interpretation of the results (SPIRIT 2013 statement checklist item 20a). Conclusions and Relevance: This SPIRIT-Outcomes 2022 extension of the SPIRIT 2013 statement provides 9 outcome-specific items that should be addressed in all trial protocols and may help increase trial utility, replicability, and transparency and may minimize the risk of selective nonreporting of trial results.

A declaração PRISMA 2020: diretriz atualizada para relatar revisões sistemáticas*

[RESUMO]. A declaração dos Principais Itens para Relatar Revisões Sistemáticas e Meta-análises (PRISMA), publicada em 2009, foi desenvolvida para ajudar revisores sistemáticos a relatar de forma transparente por que a revisão foi feita, os métodos empregados e o que os autores encontraram. Na última década, os avanços na metodo- logia e terminologia de revisões sistemáticas exigiram a atualização da diretriz. A declaração PRISMA 2020 substitui a declaração de 2009 e inclui novas orientações para relato que refletem os avanços nos métodos para identificar, selecionar, avaliar e sintetizar estudos. A estrutura e apresentação dos itens foram modifi- cadas para facilitar a implementação. Neste artigo, apresentamos a lista de checagem PRISMA 2020 de 27 itens, uma lista de checagem expandida que detalha as recomendações para relato para cada item, a lista de checagem PRISMA 2020 para resumos e os fluxogramas revisados para novas revisões e para atualização de revisões.

[ABSTRACT]. The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement, published in 2009, was designed to help systematic reviewers transparently report why the review was done, what the authors did, and what they found. Over the past decade, advances in systematic review methodology and terminology have necessitated an update to the guideline. The PRISMA 2020 statement replaces the 2009 statement and includes new reporting guidance that reflects advances in methods to identify, select, appraise, and synthesise studies. The structure and presentation of the items have been modified to facilitate imple- mentation. In this article, we present the PRISMA 2020 27-item checklist, an expanded checklist that details reporting recommendations for each item, the PRISMA 2020 abstract checklist, and the revised flow diagrams for original and updated reviews.

[RESUMEN]. La declaración PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses), publicada en 2009, se diseñó para ayudar a los autores de revisiones sistemáticas a documentar de manera transparente el porqué de la revisión, qué hicieron los autores y qué encontraron. Durante la última década, ha habido muchos avances en la metodología y terminología de las revisiones sistemáticas, lo que ha requerido una actualización de esta guía. La declaración PRISMA 2020 sustituye a la declaración de 2009 e incluye una nueva guía de presentación de las publicaciones que refleja los avances en los métodos para identificar, seleccionar, evaluar y sintetizar estudios. La estructura y la presentación de los ítems ha sido modificada para facilitar su implementación. En este artículo, presentamos la lista de verificación PRISMA 2020 con 27 ítems, y una lista de verificación ampliada que detalla las recomendaciones en la publicación de cada ítem, la lista de verificación del resumen estructurado PRISMA 2020 y el diagrama de flujo revisado para revisiones sistemáticas.

Comparing the Value of Data Visualization Methods for Communicating Harms in Clinical Trials.

In clinical trials, harms (i.e., adverse events) are often reported by simply counting the number of people who experienced each event. Reporting only frequencies ignores other dimensions of the data that are important for stakeholders, including severity, seriousness, rate (recurrence), timing, and groups of related harms. Additionally, application of selection criteria to harms prevents most from being reported. Visualization of data could improve communication of multidimensional data. We replicated and compared the characteristics of 6 different approaches for visualizing harms: dot plot, stacked bar chart, volcano plot, heat map, treemap, and tendril plot. We considered binary events using individual participant data from a randomized trial of gabapentin for neuropathic pain. We assessed their value using a heuristic approach and a group of content experts. We produced all figures using R and share the open-source code on GitHub. Most original visualizations propose presenting individual harms (e.g., dizziness, somnolence) alone or alongside higher level (e.g., by body systems) summaries of harms, although they could be applied at either level. Visualizations can present different dimensions of all harms observed in trials. Except for the tendril plot, all other plots do not require individual participant data. The dot plot and volcano plot are favored as visualization approaches to present an overall summary of harms data. Our value assessment found the dot plot and volcano plot were favored by content experts. Using visualizations to report harms could improve communication. Trialists can use our provided code to easily implement these approaches.

Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research.

OBJECTIVES: To evaluate (1) the feasibility of an audit-feedback intervention to facilitate sports science journal policy change, (2) the reliability of the Transparency of Research Underpinning Social Intervention Tiers (TRUST) policy evaluation form, and (3) the extent to which policies of sports science journals support transparent and open research practices. METHODS: We conducted a cross-sectional, audit-feedback, feasibility study of transparency and openness standards of the top 38 sports science journals by impact factor. The TRUST form was used to evaluate journal policies support for transparent and open research practices. Feedback was provided to journal editors in the format of a tailored letter. Inter-rater reliability and agreement of the TRUST form was assessed using intraclass correlation coefficients and the standard error of measurement, respectively. Time-based criteria, fidelity of intervention delivery and qualitative feedback were used to determine feasibility. RESULTS: The audit-feedback intervention was feasible based on the time taken to rate journals and provide tailored feedback. The mean (SD) score on the TRUST form (range 0-27) was 2.05 (1.99), reflecting low engagement with transparent and open practices. Inter-rater reliability of the overall score of the TRUST form was moderate [ICC (2,1) = 0.68 (95% CI 0.55-0.79)], with standard error of measurement of 1.17. However, some individual items had poor reliability. CONCLUSION: Policies of the top 38 sports science journals have potential for improved support for transparent and open research practices. The feasible audit-feedback intervention developed here warrants large-scale evaluation as a means to facilitate change in journal policies. REGISTRATION: OSF ( https://osf.io/d2t4s/ ).

Designing clinically useful psychopharmacological trials: challenges and ways forward.

The clinical guidelines that underpin the use of drugs for mental disorders are informed by evidence from randomised controlled trials (RCTs). RCTs are performed to obtain marketing authorisation from regulators. The methods used in these RCTs could be appropriate for early phases of drug development because they identify drugs with important harms and drugs that are efficacious for specific health problems and populations. RCTs done before marketing authorisation do not tend to address clinical questions that concern the effectiveness of a drug in heterogeneous and comorbid populations, the optimisation of drug sequencing and discontinuation, or the comparative benefits and harms of different drugs that could be used for the same health problem. This Review proposes an overview of some shortcomings of RCTs, at an individual level and at the whole portfolio level, and identifies some methods in planning, conducting, and carrying out analyses in RCTs that could enhance their ability to support therapeutic decisions. These suggestions include: identifying patient-important questions to be investigated by psychopharmacological RCTs; embedding pragmatic RCTs within clinical practice to improve generalisability to target populations; collecting evidence about drugs in overlooked populations; developing methods to facilitate the recruitment of patients with mental disorders and to reduce the number of patients who drop out, using specific methods; using core outcome sets to standardise the assessment of benefits and harms; and recording systematically serious objective outcomes, such as suicide or hospitalisation, to be evaluated in meta-analyses. This work is a call to address questions relevant to patients using diverse design of RCTs, thus contributing to the development of a patient-centred, evidence-based psychiatry.

Vitamin A supplementation for preventing morbidity and mortality in children from six months to five years of age.

BACKGROUND: Vitamin A deficiency (VAD) is a major public health problem in low- and middle-income countries, affecting 190 million children under five years of age and leading to many adverse health consequences, including death. Based on prior evidence and a previous version of this review, the World Health Organization has continued to recommend vitamin A supplementation (VAS) for children aged 6 to 59 months. The last version of this review was published in 2017, and this is an updated version of that review. OBJECTIVES: To assess the effects of vitamin A supplementation (VAS) for preventing morbidity and mortality in children aged six months to five years. SEARCH METHODS: We searched CENTRAL, MEDLINE, Embase, six other databases, and two trials registers up to March 2021. We also checked reference lists and contacted relevant organisations and researchers to identify additional studies. SELECTION CRITERIA: Randomised controlled trials (RCTs) and cluster-RCTs evaluating the effect of synthetic VAS in children aged six months to five years living in the community. We excluded studies involving children in hospital and children with disease or infection. We also excluded studies evaluating the effects of food fortification, consumption of vitamin A rich foods, or beta-carotene supplementation. DATA COLLECTION AND ANALYSIS: For this update, two review authors independently assessed studies for inclusion resolving discrepancies by discussion. We performed meta-analyses for outcomes, including all-cause and cause-specific mortality, disease, vision, and side effects. We used the GRADE approach to assess the quality of the evidence. MAIN RESULTS: The updated search identified no new RCTs. We identified 47 studies, involving approximately 1,223,856 children. Studies were set in 19 countries: 30 (63%) in Asia, 16 of these in India; 8 (17%) in Africa; 7 (15%) in Latin America, and 2 (4%) in Australia. About one-third of the studies were in urban/periurban settings, and half were in rural settings; the remaining studies did not clearly report settings. Most studies included equal numbers of girls and boys and lasted about one year. The mean age of the children was about 33 months. The included studies were at variable overall risk of bias; however, evidence for the primary outcome was at low risk of bias. A meta-analysis for all-cause mortality included 19 trials (1,202,382 children). At longest follow-up, there was a 12% observed reduction in the risk of all-cause mortality for VAS compared with control using a fixed-effect model (risk ratio (RR) 0.88, 95% confidence interval (CI) 0.83 to 0.93; high-certainty evidence). Nine trials reported mortality due to diarrhoea and showed a 12% overall reduction for VAS (RR 0.88, 95% CI 0.79 to 0.98; 1,098,538 children; high-certainty evidence). There was no evidence of a difference for VAS on mortality due to measles (RR 0.88, 95% CI 0.69 to 1.11; 6 studies, 1,088,261 children; low-certainty evidence), respiratory disease (RR 0.98, 95% CI 0.86 to 1.12; 9 studies, 1,098,538 children; low-certainty evidence), and meningitis. VAS reduced the incidence of diarrhoea (RR 0.85, 95% CI 0.82 to 0.87; 15 studies, 77,946 children; low-certainty evidence), measles (RR 0.50, 95% CI 0.37 to 0.67; 6 studies, 19,566 children; moderate-certainty evidence), Bitot's spots (RR 0.42, 95% CI 0.33 to 0.53; 5 studies, 1,063,278 children; moderate-certainty evidence), night blindness (RR 0.32, 95% CI 0.21 to 0.50; 2 studies, 22,972 children; moderate-certainty evidence), and VAD (RR 0.71, 95% CI 0.65 to 0.78; 4 studies, 2262 children, moderate-certainty evidence). However, there was no evidence of a difference on incidence of respiratory disease (RR 0.99, 95% CI 0.92 to 1.06; 11 studies, 27,540 children; low-certainty evidence) or hospitalisations due to diarrhoea or pneumonia. There was an increased risk of vomiting within the first 48 hours of VAS (RR 1.97, 95% CI 1.44 to 2.69; 4 studies, 10,541 children; moderate-certainty evidence). AUTHORS' CONCLUSIONS: This update identified no new eligible studies and the conclusions remain the same. VAS is associated with a clinically meaningful reduction in morbidity and mortality in children. Further placebo-controlled trials of VAS in children between six months and five years of age would not change the conclusions of this review, although studies that compare different doses and delivery mechanisms are needed. In populations with documented VAD, it would be unethical to conduct placebo-controlled trials.

Transparent, Open, and Reproducible Prevention Science.

The field of prevention science aims to understand societal problems, identify effective interventions, and translate scientific evidence into policy and practice. There is growing interest among prevention scientists in the potential for transparency, openness, and reproducibility to facilitate this mission by providing opportunities to align scientific practice with scientific ideals, accelerate scientific discovery, and broaden access to scientific knowledge. The overarching goal of this manuscript is to serve as a primer introducing and providing an overview of open science for prevention researchers. In this paper, we discuss factors motivating interest in transparency and reproducibility, research practices associated with open science, and stakeholders engaged in and impacted by open science reform efforts. In addition, we discuss how and why different types of prevention research could incorporate open science practices, as well as ways that prevention science tools and methods could be leveraged to advance the wider open science movement. To promote further discussion, we conclude with potential reservations and challenges for the field of prevention science to address as it transitions to greater transparency, openness, and reproducibility. Throughout, we identify activities that aim to strengthen the reliability and efficiency of prevention science, facilitate access to its products and outputs, and promote collaborative and inclusive participation in research activities. By embracing principles of transparency, openness, and reproducibility, prevention science can better achieve its mission to advance evidence-based solutions to promote individual and collective well-being.