Feasibility of an Audit and Feedback Intervention to Facilitate Journal Policy Change Towards Greater Promotion of Transparency and Openness in Sports Science Research.

OBJECTIVES: To evaluate (1) the feasibility of an audit-feedback intervention to facilitate sports science journal policy change, (2) the reliability of the Transparency of Research Underpinning Social Intervention Tiers (TRUST) policy evaluation form, and (3) the extent to which policies of sports science journals support transparent and open research practices. METHODS: We conducted a cross-sectional, audit-feedback, feasibility study of transparency and openness standards of the top 38 sports science journals by impact factor. The TRUST form was used to evaluate journal policies support for transparent and open research practices. Feedback was provided to journal editors in the format of a tailored letter. Inter-rater reliability and agreement of the TRUST form was assessed using intraclass correlation coefficients and the standard error of measurement, respectively. Time-based criteria, fidelity of intervention delivery and qualitative feedback were used to determine feasibility. RESULTS: The audit-feedback intervention was feasible based on the time taken to rate journals and provide tailored feedback. The mean (SD) score on the TRUST form (range 0-27) was 2.05 (1.99), reflecting low engagement with transparent and open practices. Inter-rater reliability of the overall score of the TRUST form was moderate [ICC (2,1) = 0.68 (95% CI 0.55-0.79)], with standard error of measurement of 1.17. However, some individual items had poor reliability. CONCLUSION: Policies of the top 38 sports science journals have potential for improved support for transparent and open research practices. The feasible audit-feedback intervention developed here warrants large-scale evaluation as a means to facilitate change in journal policies. REGISTRATION: OSF ( https://osf.io/d2t4s/ ).

Considerations of complexity in rating certainty of evidence in systematic reviews: a primer on using the GRADE approach in global health.

Public health interventions and health technologies are commonly described as 'complex', as they involve multiple interacting components and outcomes, and their effects are largely influenced by contextual interactions and system-level processes. Systematic reviewers and guideline developers evaluating the effects of these complex interventions and technologies report difficulties in using existing methods and frameworks, such as the Grading of Recommendations Assessment, Development and Evaluation (GRADE). As part of a special series of papers on implications of complexity in the WHO guideline development, this paper serves as a primer on how to consider sources of complexity when using the GRADE approach to rate certainty of evidence. Relevant sources of complexity in systematic reviews, health technology assessments and guidelines of public health are outlined and mapped onto the reported difficulties in rating the estimates of the effect of these interventions. Recommendations on how to address these difficulties are further outlined, and the need for an integrated use of GRADE from the beginning of the review or guideline development is emphasised. The content of this paper is informed by the existing GRADE guidance, an ongoing research project on considering sources of complexity when applying the GRADE approach to rate certainty of evidence in systematic reviews and the review authors' own experiences with using GRADE.

Comparative Effectiveness of Brief Alcohol Interventions for College Students: Results from a Network Meta-Analysis.

Late adolescence is a time of increased drinking, and alcohol plays a predominant role in college social experiences. Colleges seeking to prevent students' hazardous drinking may elect to implement brief alcohol interventions (BAIs). However, numerous manualized BAIs exist, so an important question remains regarding the comparative effectiveness of these different types of BAIs for college students. This study uses network meta-analyses (NMA) to compare seven manualized BAIs for reducing problematic alcohol use among college students. We systematically searched multiple sources for literature, and we screened studies and extracted data in duplicate. For the quantitative synthesis, we employed a random-effects frequentist NMA to determine the effectiveness of different BAIs compared to controls and estimated the relative effectiveness ranking of each BAI. A systematic literature search resulted in 52 included studies: On average, 58% of participants were male, 75% were binge drinkers, and 20% were fraternity/sorority-affiliated students. Consistency models demonstrated that BASICS was consistently effective in reducing students' problematic alcohol use (ES range: g = - 0.23, 95%CI [- 0.36, - 0.16] to g = - 0.36, 95% CI [- 0.55, - 0.18]), but AlcoholEDU (g = - 0.13, 95%CI [- 0.22, - 0.04]), e-CHUG (g = - 0.35, 95%CI [- 0.45, - 0.05]), and THRIVE (g = - 0.47, 95%CI [- 0.60, - 0.33]) were also effective for some outcomes. Intervention rankings indicated that BASICS, THRIVE, and AlcoholEDU hold the most promise for future trials. Several BAIs appear effective for college students. BASICS was the most effective but is resource intensive and may be better suited for higher risk students; THRIVE and e-CHUG are less resource intensive and show promise for universal prevention efforts.

Reporting quality of social and psychological intervention trials: a systematic review of reporting guidelines and trial publications.

BACKGROUND: Previous reviews show that reporting guidelines have improved the quality of trial reports in medicine, yet existing guidelines may not be fully suited for social and psychological intervention trials. OBJECTIVE/DESIGN: We conducted a two-part study that reviewed (1) reporting guidelines for and (2) the reporting quality of social and psychological intervention trials. DATA SOURCES: (1) To identify reporting guidelines, we systematically searched multiple electronic databases and reporting guideline registries. (2) To identify trials, we hand-searched 40 journals with the 10 highest impact factors in clinical psychology, criminology, education, and social work. ELIGIBILITY: (1) Reporting guidelines consisted of articles introducing a checklist of reporting standards relevant to social and psychological intervention trials. (2) Trials reported randomised experiments of complex interventions with psychological, social, or health outcomes. RESULTS: (1) We identified 19 reporting guidelines that yielded 147 reporting standards relevant to social and psychological interventions. Social and behavioural science guidelines included 89 standards not found in CONSORT guidelines. However, CONSORT guidelines used more recommended techniques for development and dissemination compared to other guidelines. (2) Our review of trials (n = 239) revealed that many standards were poorly reported, such as identification as a randomised trial in titles (20% reported the information) and abstracts (55%); information about blinding (15%), sequence generation (23%), and allocation concealment (17%); and details about actual delivery of experimental (43%) and control interventions (34%), participant uptake (25%), and service environment (28%). Only 11 of 40 journals referenced reporting guidelines in "Instructions to Authors." CONCLUSION: Existing reporting guidelines have important limitations in content, development, and/or dissemination. Important details are routinely missing from trial publications; most leading journals in social and behavioural sciences do not ask authors to follow reporting standards. Findings demonstrate a need to develop a CONSORT extension with updated standards for social and psychological intervention trials.

Underestimations of blood alcohol concentration predict event-specific negative consequences.

The current study sought to establish in vivo misperception of blood alcohol concentration (BAC) as a predictor of event-specific alcohol-consumption-related negative consequences. During spring 2010, 225 (56.4% male) college students, who had consumed at least one alcoholic drink within the 2 hr prior to assessment, completed a questionnaire, gave a breath sample to assess breath alcohol content, and later completed a follow-up questionnaire. Underestimation of BAC was predictive of event-specific, alcohol-consumption-related negative consequences, over and above other factors including total drinks consumed. This study highlights the need for more focused BAC education strategies at American universities.