Toward Synthetic Physical Fingerprint Targets.

Biometric fingerprint identification hinges on the reliability of its sensors; however, calibrating and standardizing these sensors poses significant challenges, particularly in regards to repeatability and data diversity. To tackle these issues, we propose methodologies for fabricating synthetic 3D fingerprint targets, or phantoms, that closely emulate real human fingerprints. These phantoms enable the precise evaluation and validation of fingerprint sensors under controlled and repeatable conditions. Our research employs laser engraving, 3D printing, and CNC machining techniques, utilizing different materials. We assess the phantoms' fidelity to synthetic fingerprint patterns, intra-class variability, and interoperability across different manufacturing methods. The findings demonstrate that a combination of laser engraving or CNC machining with silicone casting produces finger-like phantoms with high accuracy and consistency for rolled fingerprint recordings. For slap recordings, direct laser engraving of flat silicone targets excels, and in the contactless fingerprint sensor setting, 3D printing and silicone filling provide the most favorable attributes. Our work enables a comprehensive, method-independent comparison of various fabrication methodologies, offering a unique perspective on the strengths and weaknesses of each approach. This facilitates a broader understanding of fingerprint recognition system validation and performance assessment.

Improved automatic identification of isolated rapid eye movement sleep behavior disorder with a 3D time-of-flight camera.

BACKGROUND AND PURPOSE: Automatic 3D video analysis of the lower body during rapid eye movement (REM) sleep has been recently proposed as a novel tool for identifying people with isolated REM sleep behavior disorder (iRBD), but, so far, it has not been validated on unseen subjects. This study aims at validating this technology in a large cohort and at improving its performances by also including an analysis of movements in the head, hands and upper body. METHODS: Fifty-three people with iRBD and 128 people without RBD (of whom 89 had sleep disorders considered RBD differential diagnoses) were included in the study. An automatic algorithm identified movements from 3D videos during REM sleep in four regions of interest (ROIs): head, hands, upper body and lower body. The movements were divided into categories according to duration: short (0.1-2 s), medium (2-15 s) and long (15-300 s). For each ROI and duration range, features were obtained from the identified movements. Logistic regression models using as predictors the features from one single ROI or a combination of ROIs were trained and tested in a 10-runs 10-fold cross-validation scheme on the task of differentiating people with iRBD from people without RBD. RESULTS: The best differentiation was achieved using short movements in all four ROIs (test accuracy 0.866 ± 0.007, test F1 score = 0.783 ± 0.010). Single group analyses showed that people with iRBD were distinguished successfully from subjects with RBD differential diagnoses. CONCLUSIONS: Automatic 3D video analysis might be implemented in clinical routine as a supportive screening tool for identifying people with RBD.

TeaSpam: A Novel Method of TEmporal And SPAtial Movement Encoding during Sleep.

Movements during sleep characterize sleep disorders, which can disturb sleep or its onset, impacting sleep quantity and quality. Video-polysomnography is the current gold standard to assess movements during sleep, but its availability is limited. Using data recorded with a 3D time of flight sensor, we developed a novel method of encoding temporal and spatial information of automatically identified movements during sleep. In a cohort of 20 insomnia patients and 18 controls, we showed that this novel method holds important information able to discriminate the groups. Future studies will explore the methodology in the context of other sleep disorders.

Automatic 3D Video Analysis of Upper and Lower Body Movements to Identify Isolated REM Sleep Behavior Disorder: A Pilot Study.

Rapid eye movement (REM) sleep behavior disorder (RBD) is a parasomnia characterized by dream enactment, abnormal jerks and movements during REM sleep. Isolated RBD (iRBD) is recognized as the early stage of alpha-synucleinopathies, i.e. dementia with Lewy bodies, Parkinson's disease and multiple system atrophy. The certain diagnosis of iRBD requires video-polysomnography, evaluated by experts with time-consuming visual analyses. In this study, we propose automatic analysis of movements detected with 3D contactless video as a promising technology to assist sleep experts in the identification of patients with iRBD. By using automatically detected upper and lower body movements occurring during REM sleep with a duration between 4s and 5s, we could discriminate 20 iRBD patients from 24 patients with sleep-disordered breathing with an accuracy of 0.91 and F1-score of 0.90. This pilot study shows that 3D contactless video can be successfully used as a non-invasive technology to assist clinicians in identifying abnormal movements during REM sleep, and therefore to recognize patients with iRBD. Future investigations in larger cohorts are needed to validate the proposed technology and methodology.

Fidgety Philip and the Suggested Clinical Immobilization Test: Annotation data for developing a machine learning algorithm.

The cartoon Fidgety Philip, the banner of Western-ADHD diagnosis, depicts a 'restless' child exhibiting hyperactive-behaviors with hyper-arousability and/or hypermotor-restlessness (H-behaviors) during sitting. To overcome the gaps between differential diagnostic considerations and modern computing methodologies, we have developed a non-interpretative, neutral pictogram-guided phenotyping language (PG-PL) for describing body-segment movements during sitting (Journal of Psychiatric Research). To develop the PG-PL, seven research assistants annotated three original Fidgety Philip cartoons. Their annotations were analyzed with descriptive statistics. To review the PG-PL's performance, the same seven research assistants annotated 12 snapshots with free hand annotations, followed by using the PG-PL, each time in randomized sequence and on two separate occasions. After achieving satisfactory inter-observer agreements, the PG-PL annotation software was used for reviewing videos where the same seven research assistants annotated 12 one-minute long video clips. The video clip annotations were finally used to develop a machine learning algorithm for automated movement detection (Journal of Psychiatric Research). These data together demonstrate the value of the PG-PL for manually annotating human movement patterns. Researchers are able to reuse the data and the first version of the machine learning algorithm to further develop and refine the algorithm for differentiating movement patterns.

3D Camera and Pulse Oximeter for Respiratory Events Detection.

OBJECTIVE: The purpose of this study was to derive a respiratory movement signal from a 3D time-of-flight camera and to investigate if it can be used in combination with SpO2 to detect respiratory events comparable to polysomnography (PSG) based detection. METHODS: We derived a respiratory signal from a 3D camera and developed a new algorithm that detects reduced respiratory movement and SpO2 desaturation to score respiratory events. The method was tested on 61 patients' synchronized 3D video and PSG recordings. The predicted apnea-hypopnea index (AHI), calculated based on total sleep time, and predicted severity were compared to manual PSG annotations (manualPSG). Predicted AHI evaluation, measured by intraclass correlation (ICC), and severity classification were performed. Furthermore, the results were evaluated by 30-second epoch analysis, labelled either as respiratory event or normal breathing, wherein the accuracy, sensitivity, specificity and Cohen's kappa were calculated. RESULTS: The predicted AHI scored an ICC r = 0.94 (0.90 - 0.96 at 95% confidence interval, p < 0.001) compared to manualPSG. Severity classification scored 80% accuracy, with no misclassification by more than one severity level. Based on 30-second epoch analysis, the method scored a Cohen's kappa = 0.72, accuracy = 0.88, sensitivity = 0.80, and specificity = 0.91. CONCLUSION: Our detection method using SpO2 and 3D camera had excellent reliability and substantial agreement with PSG-based scoring. SIGNIFICANCE: This method showed the potential to reliably detect respiratory events without airflow and respiratory belt sensors, sensors that can be uncomfortable to patients and susceptible to movement artefacts.

Is Fidgety Philip's ground truth also ours? The creation and application of a machine learning algorithm.

BACKGROUND: Behavioral observations support clinical in-depth phenotyping but phenotyping and pattern recognition are affected by training background. As Attention Deficit Hyperactivity Disorder, Restless Legs syndrome/Willis Ekbom disease and medication induced activation syndromes (including increased irritability and/or akathisia), present with hyperactive-behaviors with hyper-arousability and/or hypermotor-restlessness (H-behaviors), we first developed a non-interpretative, neutral pictogram-guided phenotyping language (PG-PL) for describing body-segment movements during sitting. METHODOLOGY & RESULTS: The PG-PL was applied for annotating 12 1-min sitting-videos (inter-observer agreements >85%->97%) and these manual annotations were used as a ground truth to develop an automated algorithm using OpenPose, which locates skeletal landmarks in 2D video. We evaluated the algorithm's performance against the ground truth by computing the area under the receiver operator curve (>0.79 for the legs, arms, and feet, but 0.65 for the head). While our pixel displacement algorithm performed well for the legs, arms, and feet, it predicted head motion less well, indicating the need for further investigations. CONCLUSION: This first automated analysis algorithm allows to start the discussion about distinct phenotypical characteristics of H-behaviors during structured behavioral observations and may support differential diagnostic considerations via in-depth phenotyping of sitting behaviors and, in consequence, of better treatment concepts.

Automated 3D video analysis of lower limb movements during REM sleep: a new diagnostic tool for isolated REM sleep behavior disorder.

STUDY OBJECTIVES: The differentiation of isolated rapid eye movement (REM) sleep behavior disorder (iRBD) or its prodromal phase (prodromal RBD) from other disorders with motor activity during sleep is critical for identifying α-synucleinopathy in an early stage. Currently, definite RBD diagnosis requires video polysomnography (vPSG). The aim of this study was to evaluate automated 3D video analysis of leg movements during REM sleep as objective diagnostic tool for iRBD. METHODS: A total of 122 participants (40 iRBD, 18 prodromal RBD, 64 participants with other disorders with motor activity during sleep) were recruited among patients undergoing vPSG at the Sleep Disorders Unit, Department of Neurology, Medical University of Innsbruck. 3D videos synchronous to vPSG were recorded. Lower limb movements rate, duration, extent, and intensity were computed using a newly developed software. RESULTS: The analyzed 3D movement features were significantly increased in subjects with iRBD compared to prodromal RBD and other disorders with motor activity during sleep. Minor leg jerks with a duration < 2 seconds discriminated with the highest accuracy (90.4%) iRBD from other motor activity during sleep. Automatic 3D analysis did not differentiate between prodromal RBD and other disorders with motor activity during sleep. CONCLUSIONS: Automated 3D video analysis of leg movements during REM sleep is a promising diagnostic tool for identifying subjects with iRBD in a sleep laboratory population and is able to distinguish iRBD from subjects with other motor activities during sleep. For future application as a screening, further studies should investigate usefulness of this tool when no information about sleep stages from vPSG is available and in the home environment.

Contactless detection of periodic leg movements during sleep: A 3D video pilot study.

In clinical practice, the quality of polysomnographic recordings in children and patients with neurodegenerative diseases may be affected by sensor displacement and diminished total sleep time due to stress during the recording. In the present study, we investigated if contactless three-dimensional (3D) detection of periodic leg movements during sleep was comparable to polysomnography. We prospectively studied a sleep laboratory cohort from two Austrian sleep laboratories. Periodic leg movements during sleep were classified according to the standards of the World Association of Sleep Medicine and served as ground truth. Leg movements including respiratory-related events (A1) and excluding respiratory-related events (A2 and A3) were presented as A1, A2 and A3. Three-dimensional movement analysis was carried out using an algorithm developed by the Austrian Institute of Technology. Fifty-two patients (22 female, mean age 52.2 ± 15.1 years) were included. Periodic leg movement during sleep indexes were significantly higher with 3D detection compared to polysomnography (33.3 [8.1-97.2] vs. 30.7 [2.9-91.9]: +9.1%, p = .0055/27.8 [4.5-86.2] vs. 24.2 [0.00-88.7]: +8.2%, p = .0154/31.8 [8.1-89.5] vs. 29.6 [2.4-91.1]: +8.9%, p = .0129). Contactless automatic 3D analysis has the potential to detect restlessness mirrored by periodic leg movements during sleep reliably and may especially be suited for children and the elderly.

A Novel Approach to Assess Sleep-Related Rhythmic Movement Disorder in Children Using Automatic 3D Analysis.

Background: Unlike other episodic sleep disorders in childhood, there are no agreed severity indices for rhythmic movement disorder. While movements can be characterized in detail by polysomnography, in our experience most children inhibit rhythmic movement during polysomnography. Actigraphy and home video allow assessment in the child's own environment, but both have limitations. Standard actigraphy analysis algorithms fail to differentiate rhythmic movements from other movements. Manual annotation of 2D video is time consuming. We aimed to develop a sensitive, reliable method to detect and quantify rhythmic movements using marker free and automatic 3D video analysis. Method: Patients with rhythmic movement disorder (n = 6, 4 male) between age 5 and 14 years (M: 9.0 years, SD: 4.2 years) spent three nights in the sleep laboratory as part of a feasibility study (https://clinicaltrials.gov/ct2/show/NCT03528096). 2D and 3D video data recorded during the adaptation and baseline nights were analyzed. One ceiling-mounted camera captured 3D depth images, while another recorded 2D video. We developed algorithms to analyze the characteristics of rhythmic movements and built a classifier to distinguish between rhythmic and non-rhythmic movements based on 3D video data alone. Data from 3D automated analysis were compared to manual 2D video annotations to assess algorithm performance. Novel indices were developed, specifically the rhythmic movement index, frequency index, and duration index, to better characterize severity of rhythmic movement disorder in children. Result: Automatic 3D video analysis demonstrated high levels of agreement with the manual approach indicated by a Cohen's kappa >0.9 and F1-score >0.9. We also demonstrated how rhythmic movement assessment can be improved using newly introduced indices illustrated with plots for ease of visualization. Conclusion: 3D video technology is widely available and can be readily integrated into sleep laboratory settings. Our automatic 3D video analysis algorithm yields reliable quantitative information about rhythmic movements, reducing the burden of manual scoring. Furthermore, we propose novel rhythmic movement disorder severity indices that offer a means to standardize measurement of this disorder in both clinical and research practice. The significance of the results is limited due to the nature of a feasibility study and its small number of samples. A larger follow up study is needed to confirm presented results.

3D detection of periodic limb movements in sleep.

The standard polysomnographic method for detecting periodic limb movements in sleep (PLMS) includes measuring the electromyography (EMG) signals from electrodes at the left and right tibialis anterior muscles. This procedure has disadvantages as the cabling affects the patients quality of sleep and the electrodes tend to come off during the night, deteriorating data quality. We used contactless monitoring of body movements by a 3D time-of-flight camera mounted above the bed. Changes in the 3D silhouette indicate motion. Contactless detection of PLMS has several substantial advantages over the EMG and provides more complete and more specific diagnostic data: (1) Motor events caused by other leg muscles than tibialis anterior muscles are fully captured by the 3D method, but missed by EMG. (2) 3D does not react to tonic muscle contractions, where such contractions cause strong deflections in EMG which are annotated as limb movements by most PSG apparatus. Another aspect turned out to be of high practical relevance: Deflections in EMG traces are frequently caused by poor electrode contacts, potentially causing false movement annotations. This can lead to substantial overestimation of the automatically computed PLM index. Contactless sensing completely avoids such problems.