Deep learning to estimate gestational age from fly-to cineloop videos: A novel approach to ultrasound quality control.

OBJECTIVE: Low-cost devices have made obstetric sonography possible in settings where it was previously unfeasible, but ensuring quality and consistency at scale remains a challenge. In the present study, we sought to create a tool to reduce substandard fetal biometry measurement while minimizing care disruption. METHODS: We developed a deep learning artificial intelligence (AI) model to estimate gestational age (GA) in the second and third trimester from fly-to cineloops-brief videos acquired during routine ultrasound biometry-and evaluated its performance in comparison to expert sonographer measurement. We then introduced random error into fetal biometry measurements and analyzed the ability of the AI model to flag grossly inaccurate measurements such as those that might be obtained by a novice. RESULTS: The mean absolute error (MAE) of our model (±standard error) was 3.87 ± 0.07 days, compared to 4.80 ± 0.10 days for expert biometry (difference -0.92 days; 95% CI: -1.10 to -0.76). Based on simulated novice biometry with average absolute error of 7.5%, our model reliably detected cases where novice biometry differed from expert biometry by 10 days or more, with an area under the receiver operating characteristics curve of 0.93 (95% CI: 0.92, 0.95), sensitivity of 81.0% (95% CI: 77.9, 83.8), and specificity of 89.9% (95% CI: 88.1, 91.5). These results held across a range of sensitivity analyses, including where the model was provided suboptimal truncated fly-to cineloops. CONCLUSIONS: Our AI model estimated GA more accurately than expert biometry. Because fly-to cineloop videos can be obtained without any change to sonographer workflow, the model represents a no-cost guardrail that could be incorporated into both low-cost and commercial ultrasound devices to prevent reporting of most gross GA estimation errors.

AI Estimation of Gestational Age from Blind Ultrasound Sweeps in Low-Resource Settings.

BACKGROUND: Ultrasound is indispensable to gestational age estimation and thus to quality obstetrical care, yet high equipment cost and the need for trained sonographers limit its use in low-resource settings. METHODS: From September 2018 through June 2021, we recruited 4695 pregnant volunteers in North Carolina and Zambia and obtained blind ultrasound sweeps (cineloop videos) of the gravid abdomen alongside standard fetal biometry. We trained a neural network to estimate gestational age from the sweeps and, in three test data sets, assessed the performance of the artificial intelligence (AI) model and biometry against previously established gestational age. RESULTS: In our main test set, the mean absolute error (MAE) (±SE) was 3.9±0.12 days for the model versus 4.7±0.15 days for biometry (difference, -0.8 days; 95% confidence interval [CI], -1.1 to -0.5; P<0.001). The results were similar in North Carolina (difference, -0.6 days; 95% CI, -0.9 to -0.2) and Zambia (-1.0 days; 95% CI, -1.5 to -0.5). Findings were supported in the test set of women who conceived by in vitro fertilization (MAE of 2.8±0.28 vs. 3.6±0.53 days for the model vs. biometry; difference, -0.8 days; 95% CI, -1.7 to 0.2) and in the set of women from whom sweeps were collected by untrained users with low-cost, battery-powered devices (MAE of 4.9±0.29 vs. 5.4±0.28 days for the model vs. biometry; difference, -0.6; 95% CI, -1.3 to 0.1). CONCLUSIONS: When provided blindly obtained ultrasound sweeps of the gravid abdomen, our AI model estimated gestational age with accuracy similar to that of trained sonographers conducting standard fetal biometry. Model performance appears to extend to blind sweeps collected by untrained providers in Zambia using low-cost devices. (Funded by the Bill and Melinda Gates Foundation.).