Video-based analysis of the blink reflex in Parkinson's disease patients.

We developed a video-based tool to quantitatively assess the Glabellar Tap Reflex (GTR) in patients with idiopathic Parkinson's disease (iPD) as well as healthy age-matched participants. We also video-graphically assessed the effect of dopaminergic medication on the GTR in iPD patients, as well as the frequency and blinking duration of reflex and non-reflex blinks. The Glabellar Tap Reflex is a clinical sign seen in patients e.g. suffering from iPD. Reliable tools to quantify this sign are lacking. METHODS: We recorded the GTR in 11 iPD patients and 12 healthy controls (HC) with a consumer-grade camera at a framerate of at least 180 images/s. In these videos, reflex and non-reflex blinks were analyzed for blink count and blinking duration in an automated fashion. RESULTS: With our setup, the GTR can be extracted from high-framerate cameras using landmarks of the MediaPipe face algorithm. iPD patients did not habituate to the GTR; dopaminergic medication did not alter that response. iPD patients' non-reflex blinks were higher in frequency and higher in blinking duration (width at half prominence); dopaminergic medication decreased the median frequency (Before medication-HC: p < 0.001, After medication-HC: p = 0.0026) and decreased the median blinking duration (Before medication-HC: p = 0.8594, After medication-HC: p = 0.6943)-both in the direction of HC. CONCLUSION: We developed a quantitative, video-based tool to assess the GTR and other blinking-specific parameters in HC and iPD patients. Further studies could compare the video data to electromyogram (EMG) data for accuracy and comparability, as well as evaluate the specificity of the GTR in patients with other neurodegenerative disorders, in whom the GTR can also be present. SIGNIFICANCE: The video-based detection of the blinking parameters allows for unobtrusive measurement in patients, a safer and more comfortable option.

Multiple instance learning framework can facilitate explainability in murmur detection.

OBJECTIVE: Cardiovascular diseases (CVDs) account for a high fatality rate worldwide. Heart murmurs can be detected from phonocardiograms (PCGs) and may indicate CVDs. Still, they are often overlooked as their detection and correct clinical interpretation require expert skills. In this work, we aim to predict the presence of murmurs and clinical outcomes from multiple PCG recordings employing an explainable multitask model. APPROACH: Our approach consists of a two-stage multitask model. In the first stage, we predict the murmur presence in single PCGs using a multiple instance learning (MIL) framework. MIL also allows us to derive sample-wise classifications (i.e. murmur locations) while only needing one annotation per recording ("weak label") during training. In the second stage, we fuse explainable hand-crafted features with features from a pooling-based artificial neural network (PANN) derived from the MIL framework. Finally, we predict the presence of murmurs and the clinical outcome for a single patient based on multiple recordings using a simple feed-forward neural network. MAIN RESULTS: We show qualitatively and quantitatively that the MIL approach yields useful features and can be used to detect murmurs on multiple time instances and may thus guide a practitioner through PCGs. We analyze the second stage of the model in terms of murmur classification and clinical outcome. We achieved a weighted accuracy of 0.714 and an outcome cost of 13612 when using the PANN model and demographic features on the CirCor dataset (hidden test set of the George B. Moody PhysioNet challenge 2022, team "Heart2Beat", rank 12 / 40). SIGNIFICANCE: To the best of our knowledge, we are the first to demonstrate the usefulness of MIL in PCG classification. Also, we showcase how the explainability of the model can be analyzed quantitatively, thus avoiding confirmation bias inherent to many post-hoc methods. Finally, our overall results demonstrate the merit of employing MIL combined with handcrafted features for the generation of explainable features as well as for a competitive classification performance.

An extensive quantitative analysis of the effects of errors in beat-to-beat intervals on all commonly used HRV parameters.

Heart rate variability (HRV) analysis is often used to estimate human health and fitness status. More specifically, a range of parameters that express the variability in beat-to-beat intervals are calculated from electrocardiogram beat detections. Since beat detection may yield erroneous interval data, these errors travel through the processing chain and may result in misleading parameter values that can lead to incorrect conclusions. In this study, we utilized Monte Carlo simulation on real data, Kolmogorov-Smirnov tests and Bland-Altman analysis to carry out extensive analysis of the noise sensitivity of different HRV parameters. The used noise models consider Gaussian and student-t distributed noise. As a result we observed that commonly used HRV parameters (e.g. pNN50 and LF/HF ratio) are especially sensitive to noise and that all parameters show biases to some extent. We conclude that researchers should be careful when reporting different HRV parameters, consider the distributions in addition to mean values, and consider reference data if applicable. The analysis of HRV parameter sensitivity to noise and resulting biases presented in this work generalizes over a wide population and can serve as a reference and thus provide a basis for the decision about which HRV parameters to choose under similar conditions.

Video-Based Hand Movement Analysis of Parkinson Patients before and after Medication Using High-Frame-Rate Videos and MediaPipe.

Tremor is one of the common symptoms of Parkinson's disease (PD). Thanks to the recent evolution of digital technologies, monitoring of PD patients' hand movements employing contactless methods gained momentum. Objective: We aimed to quantitatively assess hand movements in patients suffering from PD using the artificial intelligence (AI)-based hand-tracking technologies of MediaPipe. Method: High-frame-rate videos and accelerometer data were recorded from 11 PD patients, two of whom showed classical Parkinsonian-type tremor. In the OFF-state and 30 Minutes after taking their standard oral medication (ON-state), video recordings were obtained. First, we investigated the frequency and amplitude relationship between the video and accelerometer data. Then, we focused on quantifying the effect of taking standard oral treatments. Results: The data extracted from the video correlated well with the accelerometer-based measurement system. Our video-based approach identified the tremor frequency with a small error rate (mean absolute error 0.229 (±0.174) Hz) and an amplitude with a high correlation. The frequency and amplitude of the hand movement before and after medication in PD patients undergoing medication differ. PD Patients experienced a decrease in the mean value for frequency from 2.012 (±1.385) Hz to 1.526 (±1.007) Hz and in the mean value for amplitude from 8.167 (±15.687) a.u. to 4.033 (±5.671) a.u. Conclusions: Our work achieved an automatic estimation of the movement frequency, including the tremor frequency with a low error rate, and to the best of our knowledge, this is the first paper that presents automated tremor analysis before/after medication in PD, in particular using high-frame-rate video data.

Exploiting lamina terminalis appearance and motion in prediction of hydrocephalus using convolutional LSTM network.

BACKGROUND: Evaluation of the lamina terminalis (LT) is crucial for non-invasive evaluation of the CSF diversion for the treatment of hydrocephalus. Together with deep learning algorithms, morphological and physiological analyses of the LT may play an important role in the management of hydrocephalus. AIM: We aim to show that exploiting the motion of LT can contribute to the evaluation of hydrocephalus using deep learning algorithms. METHODS: The dataset contains 61 True-fisp data with routine sequences 37 of which are labeled as 'hydrocephalus' and the others as 'normal condition'. A fifteen-year experienced neuroradiologist divided data into two groups. The first group, 'hydrocephalus', consists of patients with typical MRI findings (ventriculomegaly, enlargement of the third ventricular recesses and lateral ventricular horns, decreased mamillo-pontine distance, reduced frontal horn angle, thinning/elevation of the corpus callosum, and non-dilated convexity sulci), and the second group contains samples that did not show any symptoms or neurologic abnormality and labeled as 'normal condition'. The region of interest was determined by the radiologist supervisor to cover the LT. To achieve our purpose, we used both spatial and spatio-temporal analysis with two different deep learning architectures. We utilized Convolutional Neural Networks (CNN) for spatial and Convolutional Long Short-Term Memory (ConvLSTM) models for spatio-temporal analysis using an ROI around LT on sagittal True-fisp images. RESULTS: Our results show that 80.7% classification accuracy was achieved with the ConvLSTM model exploiting LT motion, whereas 76.5% and 71.6% accuracies were obtained by the 2D CNN model using all frames, and only the first frame from only spatial information, respectively. CONCLUSION: We suggest that the motion of the LT can be used as an additional attribute to the spatial information to evaluate the hydrocephalus.

An Overview of Deep Learning Algorithms and Their Applications in Neuropsychiatry.

Deep learning (DL) algorithms have achieved important successes in data analysis tasks, thanks to their capability of revealing complex patterns in data. With the advance of new sensors, data storage, and processing hardware, DL algorithms start dominating various fields including neuropsychiatry. There are many types of DL algorithms for different data types from survey data to functional magnetic resonance imaging scans. Because of limitations in diagnosing, estimating prognosis and treatment response of neuropsychiatric disorders; DL algorithms are becoming promising approaches. In this review, we aim to summarize the most common DL algorithms and their applications in neuropsychiatry and also provide an overview to guide the researchers in choosing the proper DL architecture for their research.

Comparison of noise reduction methods in photoacoustic microscopy.

Photoacoustic microscopy (PAM) is classified as a hybrid imaging technique based on the photoacoustic effect and has been frequently studied in recent years. Photoacoustic (PA) signals are inherently recorded in a noisy environment and are also exposed to noise by system components. Therefore, it is essential to reduce the noise in PA signals to reconstruct images with less error. In this study, an image reconstruction algorithm for PAM system was implemented and different filtering approaches for denoising were compared. Studies were carried out in three steps: simulation, experimental phantom and blood cell studies. FIR low-pass and band-pass filters and Discrete Wavelet Transform (DWT) based filters (mother wavelets: "bior3.5″, "bior3.7″, "sym7″) with four different thresholding techniques were examined. For the evaluation purposes, Root Mean Square Error (RMSE), Signal to Noise Ratio (SNR) and Contrast to Noise Ratio (CNR) metrics were calculated. In the simulation studies, the most effective methods were obtained as: sym7/heursure/hard thresh. combination (low and medium level noise) and bior3.7/sqtwolog/soft thresh. combination (high-level noise). In experimental phantom studies, noise was classified into five levels. Different filtering approaches perform better depending on the SNR of PA images. For the blood cell study, based on the standard deviation in the background, sym7/sqtwolog/soft thresh. combination provided the best improvement and this result supported the experimental phantom results.