Reproducibility in systems biology modelling.

Reproducibility of scientific results is a key element of science and credibility. The lack of reproducibility across many scientific fields has emerged as an important concern. In this piece, we assess mathematical model reproducibility and propose a scorecard for improving reproducibility in this field.

BioModels-15 years of sharing computational models in life science.

Computational modelling has become increasingly common in life science research. To provide a platform to support universal sharing, easy accessibility and model reproducibility, BioModels (https://www.ebi.ac.uk/biomodels/), a repository for mathematical models, was established in 2005. The current BioModels platform allows submission of models encoded in diverse modelling formats, including SBML, CellML, PharmML, COMBINE archive, MATLAB, Mathematica, R, Python or C++. The models submitted to BioModels are curated to verify the computational representation of the biological process and the reproducibility of the simulation results in the reference publication. The curation also involves encoding models in standard formats and annotation with controlled vocabularies following MIRIAM (minimal information required in the annotation of biochemical models) guidelines. BioModels now accepts large-scale submission of auto-generated computational models. With gradual growth in content over 15 years, BioModels currently hosts about 2000 models from the published literature. With about 800 curated models, BioModels has become the world's largest repository of curated models and emerged as the third most used data resource after PubMed and Google Scholar among the scientists who use modelling in their research. Thus, BioModels benefits modellers by providing access to reliable and semantically enriched curated models in standard formats that are easy to share, reproduce and reuse.

Comparison of first trimester dating methods for gestational age estimation and their implication on preterm birth classification in a North Indian cohort.

BACKGROUND: Different formulae have been developed globally to estimate gestational age (GA) by ultrasonography in the first trimester of pregnancy. In this study, we develop an Indian population-specific dating formula and compare its performance with published formulae. Finally, we evaluate the implications of the choice of dating method on preterm birth (PTB) rate. This study's data was from GARBH-Ini, an ongoing pregnancy cohort of North Indian women to study PTB. METHODS: Comparisons between ultrasonography-Hadlock and last menstrual period (LMP) based dating methods were made by studying the distribution of their differences by Bland-Altman analysis. Using data-driven approaches, we removed data outliers more efficiently than by applying clinical parameters. We applied advanced machine learning algorithms to identify relevant features for GA estimation and developed an Indian population-specific formula (Garbhini-GA1) for the first trimester. PTB rates of Garbhini-GA1 and other formulae were compared by estimating sensitivity and accuracy. RESULTS: Performance of Garbhini-GA1 formula, a non-linear function of crown-rump length (CRL), was equivalent to published formulae for estimation of first trimester GA (LoA, - 0.46,0.96 weeks). We found that CRL was the most crucial parameter in estimating GA and no other clinical or socioeconomic covariates contributed to GA estimation. The estimated PTB rate across all the formulae including LMP ranged 11.27-16.50% with Garbhini-GA1 estimating the least rate with highest sensitivity and accuracy. While the LMP-based method overestimated GA by 3 days compared to USG-Hadlock formula; at an individual level, these methods had less than 50% agreement in the classification of PTB. CONCLUSIONS: An accurate estimation of GA is crucial for the management of PTB. Garbhini-GA1, the first such formula developed in an Indian setting, estimates PTB rates with higher accuracy, especially when compared to commonly used Hadlock formula. Our results reinforce the need to develop population-specific gestational age formulae.

Development and external validation of Indian population-specific Garbhini-GA2 model for estimating gestational age in second and third trimesters.

Background: A large proportion of pregnant women in lower and middle-income countries (LMIC) seek their first antenatal care after 14 weeks of gestation. While the last menstrual period (LMP) is still the most prevalent method of determining gestational age (GA), ultrasound-based foetal biometry is considered more accurate in the second and third trimesters. In LMIC settings, the Hadlock formula, originally developed using data from a small Caucasian population, is widely used for estimating GA and foetal weight worldwide as the pre-programmed formula in ultrasound machines. This approach can lead to inaccuracies when estimating GA in a diverse population. Therefore, this study aimed to develop a population-specific model for estimating GA in the late trimesters that was as accurate as the GA estimation in the first trimester, using data from GARBH-Ini, a pregnancy cohort in a North Indian district hospital, and subsequently validate the model in an independent cohort in South India. Methods: Data obtained by longitudinal ultrasonography across all trimesters of pregnancy was used to develop and validate GA models for the second and third trimesters. The gold standard for GA estimation in the first trimester was determined using ultrasonography. The Garbhini-GA2, a polynomial regression model, was developed using the genetic algorithm-based method, showcasing the best performance among the models considered. This model incorporated three of the five routinely measured ultrasonographic parameters during the second and third trimesters. To assess its performance, the Garbhini-GA2 model was compared against the Hadlock and INTERGROWTH-21st models using both the TEST set (N = 1493) from the GARBH-Ini cohort and an independent VALIDATION dataset (N = 948) from the Christian Medical College (CMC), Vellore cohort. Evaluation metrics, including root-mean-squared error, bias, and preterm birth (PTB) rates, were utilised to comprehensively assess the model's accuracy and reliability. Findings: With first trimester GA dating as the baseline, Garbhini-GA2 reduced the GA estimation median error by more than three times compared to the Hadlock formula. Further, the PTB rate estimated using Garbhini-GA2 was more accurate when compared to the INTERGROWTH-21st and Hadlock formulae, which overestimated the rate by 22.47% and 58.91%, respectively. Interpretation: The Garbhini-GA2 is the first late-trimester GA estimation model to be developed and validated using Indian population data. Its higher accuracy in GA estimation, comparable to GA estimation in the first trimester and PTB classification, underscores the significance of deploying population-specific GA formulae to enhance antenatal care. Funding: The GARBH-Ini cohort study was funded by the Department of Biotechnology, Government of India (BT/PR9983/MED/97/194/2013). The ultrasound repository was partly supported by the Grand Challenges India-All Children Thriving Program, Biotechnology Industry Research Assistance Council, Department of Biotechnology, Government of India (BIRAC/GCI/0115/03/14-ACT). The research reported in this publication was made possible by a grant (BT/kiData0394/06/18) from the Grand Challenges India at Biotechnology Industry Research Assistance Council (BIRAC), an operating division jointly supported by DBT-BMGF-BIRAC. The external validation study at CMC Vellore was partly supported by a grant (BT/kiData0394/06/18) from the Grand Challenges India at Biotechnology Industry Research Assistance Council (BIRAC), an operating division jointly supported by DBT-BMGF-BIRAC and by Exploratory Research Grant (SB/20-21/0602/BT/RBCX/008481) from Robert Bosch Centre for Data Science and Artificial Intelligence (RBCDSAI), IIT Madras. An alum endowment from Prakash Arunachalam (BIO/18-19/304/ALUM/KARH) partly funded this study at the Centre for Integrative Biology and Systems Medicine, IIT Madras.