Monitoring infants by automatic video processing: A unified approach to motion analysis.

A unified approach to contact-less and low-cost video processing for automatic detection of neonatal diseases characterized by specific movement patterns is presented. This disease category includes neonatal clonic seizures and apneas. Both disorders are characterized by the presence or absence, respectively, of periodic movements of parts of the body-e.g., the limbs in case of clonic seizures and the chest/abdomen in case of apneas. Therefore, one can analyze the data obtained from multiple video sensors placed around a patient, extracting relevant motion signals and estimating, using the Maximum Likelihood (ML) criterion, their possible periodicity. This approach is very versatile and allows to investigate various scenarios, including: a single Red, Green and Blue (RGB) camera, an RGB-depth sensor or a network of a few RGB cameras. Data fusion principles are considered to aggregate the signals from multiple sensors. In the case of apneas, since breathing movements are subtle, the video can be pre-processed by a recently proposed algorithm which is able to emphasize small movements. The performance of the proposed contact-less detection algorithms is assessed, considering real video recordings of newborns, in terms of sensitivity, specificity, and Receiver Operating Characteristic (ROC) curves, with respect to medical gold standard devices. The obtained results show that a video processing-based system can effectively detect the considered specific diseases, with increasing performance for increasing number of sensors.

Optimizing Detection Rate and Characterization of Subtle Paroxysmal Neonatal Abnormal Facial Movements with Multi-Camera Video-Electroencephalogram Recordings.

Objectives We retrospectively analyze the diagnostic accuracy for paroxysmal abnormal facial movements, comparing one camera versus multi-camera approach. Background Polygraphic video-electroencephalogram (vEEG) recording is the current gold standard for brain monitoring in high-risk newborns, especially when neonatal seizures are suspected. One camera synchronized with the EEG is commonly used. Methods Since mid-June 2012, we have started using multiple cameras, one of which point toward newborns' faces. We evaluated vEEGs recorded in newborns in the study period between mid-June 2012 and the end of September 2014 and compared, for each recording, the diagnostic accuracies obtained with one-camera and multi-camera approaches. Results We recorded 147 vEEGs from 87 newborns and found 73 episodes of paroxysmal facial abnormal movements in 18 vEEGs of 11 newborns with the multi-camera approach. By using the single-camera approach, only 28.8% of these events were identified (21/73). Ten positive vEEGs with multicamera with 52 paroxysmal facial abnormal movements (52/73, 71.2%) would have been considered as negative with the single-camera approach. Conclusions The use of one additional facial camera can significantly increase the diagnostic accuracy of vEEGs in the detection of paroxysmal abnormal facial movements in the newborns.

Real-time automated detection of clonic seizures in newborns.

OBJECTIVE: The aim of this study is to apply a real-time algorithm for clonic neonatal seizures detection, based on a low complexity image processing approach extracting the differential average luminance from videotaped body movements. METHODS: 23 video-EEGs from 12 patients containing 78 electrographically confirmed neonatal seizures of clonic type were reviewed and all movements were divided into noise, random movements, clonic seizures or other seizure types. Six video-EEGs from 5 newborns without seizures were also reviewed. Videos were then separately analyzed using either single, double or triple windows (these latter with 50% overlap) each of a 10s duration. RESULTS: With a decision threshold set at 0.5, we obtained a sensitivity of 71% (corresponding specificity: 69%) with double-window processing for clonic seizures diagnosis. The discriminatory power, indicated by the Area Under the Curve (AUC), is higher with two interlaced windows (AUC=0.796) than with single (AUC=0.788) or triple-window (AUC=0.728). Among subjects without neonatal seizures, our algorithm showed a specificity of 91% with double-window processing. CONCLUSIONS: Our algorithm reliably detects neonatal clonic seizures and differentiates them from either noise, random movements and other seizure types. SIGNIFICANCE: It could represent a low-cost, low complexity, real-time automated screening tool for clonic neonatal seizures.

Low-complexity image processing for real-time detection of neonatal clonic seizures.

In this paper, we consider a novel low-complexity real-time image-processing-based approach to the detection of neonatal clonic seizures. Our approach is based on the extraction, from a video of a newborn, of an average luminance signal representative of the body movements. Since clonic seizures are characterized by periodic movements of parts of the body (e.g., the limbs), by evaluating the periodicity of the extracted average luminance signal it is possible to detect the presence of a clonic seizure. The periodicity is investigated, through a hybrid autocorrelation-Yin estimation technique, on a per-window basis, where a time window is defined as a sequence of consecutive video frames. While processing is first carried out on a single window basis, we extend our approach to interlaced windows. The performance of the proposed detection algorithm is investigated, in terms of sensitivity and specificity, through receiver operating characteristic curves, considering video recordings of newborns affected by neonatal seizures.