RESUMEN
Background: Transparency can build trust in the scientific process, but scientific findings can be undermined by poor and obscure data use and reporting practices. The purpose of this work is to report how data from the Adolescent Brain Cognitive Development (ABCD) Study has been used to date, and to provide practical recommendations on how to improve the transparency and reproducibility of findings. Methods: Articles published from 2017 to 2023 that used ABCD Study data were reviewed using more than 30 data extraction items to gather information on data use practices. Total frequencies were reported for each extraction item, along with computation of a Level of Completeness (LOC) score that represented overall endorsement of extraction items. Univariate linear regression models were used to examine the correlation between LOC scores and individual extraction items. Post hoc analysis included examination of whether LOC scores were correlated with the logged 2-year journal impact factor. Results: There were 549 full-length articles included in the main analysis. Analytic scripts were shared in 30% of full-length articles. The number of participants excluded due to missing data was reported in 60% of articles, and information on missing data for individual variables (e.g., household income) was provided in 38% of articles. A table describing the analytic sample was included in 83% of articles. A race and/or ethnicity variable was included in 78% of reviewed articles, while its inclusion was justified in only 41% of these articles. LOC scores were highly correlated with extraction items related to examination of missing data. A bottom 10% of LOC score was significantly correlated with a lower logged journal impact factor when compared to the top 10% of LOC scores (ß=-0.77, 95% -1.02, -0.51; p-value < 0.0001). Conclusion: These findings highlight opportunities for improvement in future papers using ABCD Study data to readily adapt analytic practices for better transparency and reproducibility efforts. A list of recommendations is provided to facilitate adherence in future research.
RESUMEN
BACKGROUND: Transparency can build trust in the scientific process, but scientific findings can be undermined by poor and obscure data use and reporting practices. The purpose of this work is to report how data from the Adolescent Brain Cognitive Development (ABCD) Study has been used to date, and to provide practical recommendations on how to improve the transparency and reproducibility of findings. METHODS: Articles published from 2017 to 2023 that used ABCD Study data were reviewed using more than 30 data extraction items to gather information on data use practices. Total frequencies were reported for each extraction item, along with computation of a Level of Completeness (LOC) score that represented overall endorsement of extraction items. Univariate linear regression models were used to examine the correlation between LOC scores and individual extraction items. Post hoc analysis included examination of whether LOC scores were correlated with the logged 2-year journal impact factor. RESULTS: There were 549 full-length articles included in the main analysis. Analytic scripts were shared in 30â¯% of full-length articles. The number of participants excluded due to missing data was reported in 60â¯% of articles, and information on missing data for individual variables (e.g., household income) was provided in 38â¯% of articles. A table describing the analytic sample was included in 83â¯% of articles. A race and/or ethnicity variable was included in 78â¯% of reviewed articles, while its inclusion was justified in only 41â¯% of these articles. LOC scores were highly correlated with extraction items related to examination of missing data. A bottom 10â¯% of LOC score was significantly correlated with a lower logged journal impact factor when compared to the top 10â¯% of LOC scores (ß=-0.77, 95â¯% -1.02, -0.51; p-value < 0.0001). CONCLUSION: These findings highlight opportunities for improvement in future papers using ABCD Study data to readily adapt analytic practices for better transparency and reproducibility efforts. A list of recommendations is provided to facilitate adherence in future research.
Asunto(s)
Desarrollo del Adolescente , Humanos , Reproducibilidad de los Resultados , Adolescente , Desarrollo del Adolescente/fisiología , Cognición/fisiología , Encéfalo/crecimiento & desarrolloRESUMEN
cDNA rat stress microarrays were used to test the general hypothesis that atypical gene expression patterns exist in the brains of Hydrocephalic-Texas (H-Tx) compared to normal Sprague-Dawley (SD) rats on embryonic day 18. Sixty-two percent of the 216 target transcripts were detected in at least 2 of 3 replicates, with maximum mean fold change (MFC) ratios (H-Tx:SD) in Bcl-2-related ovarian killer protein (BOK, 3.07) and peroxisome proliferator-activated receptor-alpha (PPAR-alpha, 0.04). Five (3.73%) of the 134 detected transcripts were elevated and 20 (17.2%) were suppressed more than twofold in H-Tx. MFC ratios for stress response, cytoskeleton-motility, and intracellular transducer-effector-modulator functional classifications were elevated, while MFC ratios for transcription and apoptosis groups were suppressed in H-Tx. K-means clustering revealed several patterns of gene expression with potential biological relevance in apoptosis, intracellular transducer-effector-modulator, metabolism, cell cycle, and stress response transcripts. Multiplex RT-PCR methodology, used to corroborate the cDNA data, captured four distinct temporal expression patterns on embryonic days 16-20 (E16-E20) for HSP27, DnaJ2, HSP47, HSP60, HSP70, HIP, HSP90A, and HSP90beta. The discovery of unique chaperone/heat shock expression profiles in the embryonic brains of H-Tx and SD rats is a powerful step towards the development of novel mechanistic hypotheses in the study of hydrocephalus disorders. This is the first study to associate early stress responses with the differential expression of chaperones/heat shock protein-related genes using the H-Tx model of congenital hydrocephalus.