A markerless pipeline to analyze spontaneous movements of preterm infants.

BACKGROUND AND OBJECTIVE: The analysis of spontaneous movements of preterm infants is important because anomalous motion patterns can be a sign of neurological disorders caused by lesions in the developing brain. A diagnosis in the first weeks of child's life is crucial to plan timely and appropriate rehabilitative interventions. An accurate visual assessment of infants' spontaneous movements requires highly specialized personnel, not always available, and it is operator dependent. Motion capture systems, markers and wearable sensors are commonly used for human motion analysis, but they can be cumbersome, limiting their use in the study of infants' movements. METHODS: In this paper we propose a computer-aided pipeline to characterize and classify infants' motion from 2D video recordings. The final goal is detecting anomalous motion patterns. The implemented pipeline is based on computer vision and machine learning algorithms and includes a specific step to increase the interpretability of the results. Specifically, it can be summarized by the following steps: (i) body keypoints detection: we rely on a deep learning-based semantic features detector to localize the positions of meaningful landmark points on infants' bodies; (ii) parameters extraction: starting from the trajectories of the detected landmark points, we extract quantitative parameters describing infants motion patterns; (iii) classification: we implement different classifiers (Support Vector Machines, Random Forest, fully connected Neural Network, Long Short Term Memory) that, starting from the motion parameters, classify between normal or abnormal motion patterns. RESULTS: We tested the proposed pipeline on a dataset, recorded at the 40th gestational week, of 142 infants, 59 with evidence of neuromotor disorders according to a medical assessment carried out a posteriori. Our procedure successfully discriminates normal and anomalous motion patterns with a maximum accuracy of 85.7%. CONCLUSIONS: In conclusion, our pipeline has the potential to be adopted as a tool to support the early detection of abnormal motion patterns in preterm infants.

Spontaneous movements in the newborns: a tool of quantitative video analysis of preterm babies.

BACKGROUND AND OBJECTIVES: The number of preterm babies is steadily growing world-wide and these neonates are at risk of neuro-motor-cognitive deficits. The observation of spontaneous movements in the first three months of age is known to predict such risk. However, the analysis by specifically trained physiotherapists is not suited for the clinical routine, motivating the development of simple computerized video analysis systems, integrated with a well-structured Biobank to make available for preterm babies a growing service with diagnostic, prognostic and epidemiological purposes. METHODS: MIMAS (Markerless Infant Movement Analysis System) is a simple, low-cost system of video analysis of spontaneous movements of newborns in their natural environment, based on a single standard RGB camera, without markers attached to the body. The original videos are transformed into binarized sequences highlighting the silhouette of the baby, in order to minimize the illumination effects and increase the robustness of the analysis; such sequences are then coded by a large set of parameters (39) related to the spatial and spectral changes of the silhouette. The parameter vectors of each baby were stored in the Biobank together with related clinical information. RESULTS: The preliminary test of the system was carried out at the Gaslini Pediatric Hospital in Genoa, where 46 preterm (PT) and 21 full-term (FT) babies (as controls) were recorded at birth (T0) and 8-12 weeks thereafter (T1). A simple statistical analysis of the data showed that the coded parameters are sensitive to the degree of maturation of the newborns (comparing T0 with T1, for both PT and FT babies), and to the conditions at birth (PT vs. FT at T0), whereas this difference tends to vanish at T1. Moreover, the coding method seems also able to detect the few 'abnormal' preterm babies in the PT populations that were analyzed as specific case studies. CONCLUSIONS: Preliminary results motivate the adoption of this tool in clinical practice allowing for a systematic accumulation of cases in the Biobank, thus for improving the accuracy of data analysis performed by MIMAS and ultimately allowing the adoption of data mining techniques.