Automated Motor Tic Detection: A Machine Learning Approach.

BACKGROUND: Video-based tic detection and scoring is useful to independently and objectively assess tic frequency and severity in patients with Tourette syndrome. In trained raters, interrater reliability is good. However, video ratings are time-consuming and cumbersome, particularly in large-scale studies. Therefore, we developed two machine learning (ML) algorithms for automatic tic detection. OBJECTIVE: The aim of this study was to evaluate the performances of state-of-the-art ML approaches for automatic video-based tic detection in patients with Tourette syndrome. METHODS: We used 64 videos of n = 35 patients with Tourette syndrome. The data of six subjects (15 videos with ratings) were used as a validation set for hyperparameter optimization. For the binary classification task to distinguish between tic and no-tic segments, we established two different supervised learning approaches. First, we manually extracted features based on landmarks, which served as input for a Random Forest classifier (Random Forest). Second, a fully automated deep learning approach was used, where regions of interest in video snippets were input to a convolutional neural network (deep neural network). RESULTS: Tic detection F1 scores (and accuracy) were 82.0% (88.4%) in the Random Forest and 79.5% (88.5%) in the deep neural network approach. CONCLUSIONS: ML algorithms for automatic tic detection based on video recordings are feasible and reliable and could thus become a valuable assessment tool, for example, for objective tic measurements in clinical trials. ML algorithms might also be useful for the differential diagnosis of tics. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

Chaos analysis of the cortical boundary for the recognition of psychosis.

BACKGROUND: Structural MRI studies in people with first-episode psychosis (FEP) and those in the clinical high-risk (CHR) state have consistently shown volumetric abnormalities that depict changes in the structural complexity of the cortical boundary. The aim of the present study was to employ chaos analysis in the identification of people with psychosis based on the structural complexity of the cortical boundary and subcortical areas. METHODS: We performed chaos analysis of the grey matter distribution on structural MRIs. First, the outer boundary points for each slice in the axial, coronal and sagittal view were calculated for grey matter maps. Next, the distance of each boundary point from the centre of mass in the grey matter was calculated and stored as spatial series, which was further analyzed by extracting the Largest Lyapunov Exponent (lambda [λ]), a feature depicting the structural complexity of the cortical boundary. RESULTS: Structural MRIs were acquired from 77 FEP, 73 CHR and 44 healthy controls. We compared λ brain maps between groups, which resulted in statistically significant differences in all comparisons. By matching the λ values extracted in axial view with the Morlet wavelet, differences on the surface relief are observed between groups. LIMITATIONS: Parameters were selected after experimentation on the examined sample. Investigation of the effectiveness of the method in a larger data set is needed. CONCLUSION: The proposed framework using spatial series verifies diagnosis-relevant features and may contribute to the identification of structural biomarkers for psychosis.

Longitudinal multiple sclerosis lesion segmentation: Resource and challenge.

In conjunction with the ISBI 2015 conference, we organized a longitudinal lesion segmentation challenge providing training and test data to registered participants. The training data consisted of five subjects with a mean of 4.4 time-points, and test data of fourteen subjects with a mean of 4.4 time-points. All 82 data sets had the white matter lesions associated with multiple sclerosis delineated by two human expert raters. Eleven teams submitted results using state-of-the-art lesion segmentation algorithms to the challenge, with ten teams presenting their results at the conference. We present a quantitative evaluation comparing the consistency of the two raters as well as exploring the performance of the eleven submitted results in addition to three other lesion segmentation algorithms. The challenge presented three unique opportunities: (1) the sharing of a rich data set; (2) collaboration and comparison of the various avenues of research being pursued in the community; and (3) a review and refinement of the evaluation metrics currently in use. We report on the performance of the challenge participants, as well as the construction and evaluation of a consensus delineation. The image data and manual delineations will continue to be available for download, through an evaluation website2 as a resource for future researchers in the area. This data resource provides a platform to compare existing methods in a fair and consistent manner to each other and multiple manual raters.

Artificial Intelligence-Based Prediction of Contrast Medium Doses for Computed Tomography Angiography Using Optimized Clinical Parameter Sets.

OBJECTIVES: In this paper, an artificial intelligence-based algorithm for predicting the optimal contrast medium dose for computed tomography (CT) angiography of the aorta is presented and evaluated in a clinical study. The prediction of the contrast dose reduction is modelled as a classification problem using the image contrast as the main feature. METHODS: This classification is performed by random decision forests (RDF) and k-nearest-neighbor methods (KNN). For the selection of optimal parameter subsets all possible combinations of the 22 clinical parameters (age, blood pressure, etc.) are considered using the classification accuracy and precision of the KNN classifier and RDF as quality criteria. Subsequently, the results of the evaluation were optimized by means of feature transformation using regression neural networks (RNN). These were used for a direct classification based on regressed Hounsfield units as well as preprocessing for a subsequent KNN classification. RESULTS: For feature selection, an RDF model achieved the highest accuracy of 84.42% and a KNN model achieved the best precision of 86.21%. The most important parameters include age, height, and hemoglobin. The feature transformation using an RNN considerably exceeded these values with an accuracy of 90.00% and a precision of 97.62% using all 22 parameters as input. However, also the feasibility of the parameter sets in routine clinical practice has to be considered, because some of the 22 parameters are not measured in routine clinical practice and additional measurement time of 15 to 20 minutes per patient is needed. Using the standard feature set available in clinical routine the best accuracy of 86.67% and precision of 93.18% was achieved by the RNN. CONCLUSION: We developed a reliable hybrid system that helps radiologists determine the optimal contrast dose for CT angiography based on patient-specific parameters.

Optimized image-based soft tissue deformation algorithms for visualization of haptic needle insertion.

Real-time surgical simulation relies on the fast computation of soft tissue deformations. In this paper, we present image-based algorithms for computing the deformations of a volumetric image during a needle insertion in real-time. The algorithms are based on diffusive and linear elastic finite difference methods as utilized in image registration. For an evaluation, the methods are compared to a finite element simulation of the pre-puncture phase of a needle insertion. Furthermore, the methods are improved and tested; contrary to our assumption, an improved diffusion based approach outperforms a linear elastic approach. The algorithms are used to perform a VR simulation of a needle insertion with visuo-haptic feedback.

Random Forest and Gradient Boosted Trees for Patient Individualized Contrast Agent Dose Reduction in CT Angiography.

This work aims to recognize the patient individual possibility of contrast dose reduction in CT angiography. This system should help to identify whether the dose of contrast agent in CT angiography can be reduced to avoid side effects. In a clinical study, 263 CT angiographies were performed and, in addition, 21 clinical parameters were recorded for each patient before contrast agent administration. The resulting images were labeled according to their contrast quality. It is assumed that the contrast dose could be reduced for CT angiography images with excessive contrast. These data was used to develop a model for predicting excessive contrast based on the clinical parameters using logistic regression, random forest, and gradient boosted trees. In addition, the minimization of clinical parameters required was investigated to reduce the overall effort. Therefore, models were tested with all subsets of clinical parameters and each parameter's importance was examined. In predicting excessive contrast in CT angiography images covering the aortic region, a maximum accuracy of 0.84 was achieved by a random forest with 11 clinical parameters; for the leg-pelvis region data, an accuracy of 0.87 was achieved by a random forest with 7 parameters; and for the entire data set, an accuracy of 0.74 was achieved by gradient boosted trees with 9 parameters.

4D blood flow visualization fusing 3D and 4D MRA image sequences.

PURPOSE: To present and evaluate the feasibility of a novel automatic method for generating 4D blood flow visualizations fusing high spatial resolution 3D and time-resolved (4D) magnetic resonance angiography (MRA) datasets. MATERIALS AND METHODS: In a first step, the cerebrovascular system is segmented in the 3D MRA dataset and a surface model is computed. The hemodynamic information is extracted from the 4D MRA dataset and transferred to the surface model using rigid registration where it can be visualized color-coded or dynamically over time. The presented method was evaluated using software phantoms and 20 clinical datasets from patients with an arteriovenous malformation. Clinical evaluation was performed by comparison of Spetzler-Martin scores determined from the 4D blood flow visualizations and corresponding digital subtraction angiographies. RESULTS: The performed software phantom validation showed that the presented method is capable of producing reliable visualization results for vessels with a minimum diameter of 2 mm for which a mean temporal error of 0.27 seconds was achieved. The clinical evaluation based on 20 datasets comparing the 4D visualization to DSA images revealed an excellent interrater reliability. CONCLUSION: The presented method enables an improved combined representation of blood flow and anatomy while reducing the time needed for clinical rating.

Direct haptic volume rendering in lumbar puncture simulation.

The preparation phase for surgical simulations often comprises the segmentation of patient data, which is needed for realistic visual and haptic rendering. Expert segmentation of 3D patient data sets can last from several hours to days. In this paper we introduce a direct haptic volume rendering approach for lumbar punctures. Preparation time spent for segmentation is much shorter and compared to our reference system nearly identical force output at the needle tip can be observed. The number of structures to be completely segmented by an expert is reduced from 11 to 3 tissues in abdominal data sets with 300 slices.

Migration path for structured documentation systems including standardized medical device data.

A standardized end-to-end solution has been implemented with the aim of supporting the semantic integration of clinical content in institution spanning applications. The approach outlined is a proof-of-concept design. It has shown that the standards chosen are suitable to integrate device data into forms, to document the results consistently and finally enable semantic interoperability. In detail the implementation includes a standardized device interface, a standardized representation of data entry forms and enables the communication of structured data via HL7 CDA. Because the proposed method applies a combination of standards semantic interoperability and the possibility of a contextual interpretation at each stage can be ensured.

Standardizing intensive care device data to enable secondary usages.

To represent medical device observations in a format that is consumable by clinical software, standards like HL7v3 and ISO/IEEE 11073 should be used jointly. This is demonstrated in a project with Dräger Medical GmbH focusing on their Patient Data Management System (PDMS) in intensive care, called Integrated Care Manager (ICM). Patient and device data of interest should be mapped to suitable formats to enable data exchange and decision support. Instead of mapping device data to target formats bilaterally we use a generic HL7v3 Refined Message Information Model (RMIM) with device specific parts adapted to ISO/IEEE 11073 DIM. The generality of the underlying model (based on Yuksel et al. [1]) allows the flexible inclusion of IEEE 11073 conformant device models of interest on the one hand and the generation of needed artifacts for secondary usages on the other hand, e.g. HL7 V2 messages, HL7 CDA documents like the Personal Health Monitoring Report (PHMR) or web services. Hence, once the medical device data are obtained in the RMIM format, it can quite easily be transformed into HL7-based standard interfaces through XSL transformations because these interfaces all have their building blocks from the same RIM. From there data can be accessed uniformly, e.g. as needed by Dräger´s decision support system SmartCare [2] for automated control and optimization of weaning from mechanical ventilation.

Proposal of Semantic Annotation for German Metadata Using Bidirectional Recurrent Neural Networks.

The distributed nature of our digital healthcare and the rapid emergence of new data sources prevents a compelling overview and the joint use of new data. Data integration, e.g., with metadata and semantic annotations, is expected to overcome this challenge. In this paper, we present an approach to predict UMLS codes to given German metadata using recurrent neural networks. The augmentation of the training dataset using the Medical Subject Headings (MeSH), particularly the German translations, also improved the model accuracy. The model demonstrates robust performance with 75% accuracy and aims to show that increasingly sophisticated machine learning tools can already play a significant role in data integration.

A systematic comparison of generative models for medical images.

PURPOSE: This work aims for a systematic comparison of popular shape and appearance models. Here, two statistical and four deep-learning-based shape and appearance models are compared and evaluated in terms of their expressiveness described by their generalization ability and specificity as well as further properties like input data format, interpretability and latent space distribution and dimension. METHODS: Classical shape models and their locality-based extension are considered next to autoencoders, variational autoencoders, diffeomorphic autoencoders and generative adversarial networks. The approaches are evaluated in terms of generalization ability, specificity and likeness depending on the amount of training data. Furthermore, various latent space metrics are presented in order to capture further major characteristics of the models. RESULTS: The experimental setup showed that locality statistical shape models yield best results in terms of generalization ability for 2D and 3D shape modeling. However, the deep learning approaches show strongly improved specificity. In the case of simultaneous shape and appearance modeling, the neural networks are able to generate more realistic and diverse appearances. A major drawback of the deep-learning models is, however, their impaired interpretability and ambiguity of the latent space. CONCLUSIONS: It can be concluded that for applications not requiring particularly good specificity, shape modeling can be reliably established with locality-based statistical shape models, especially when it comes to 3D shapes. However, deep learning approaches are more worthwhile in terms of appearance modeling.

Image registration and appearance adaptation in non-correspondent image regions for new MS lesions detection.

Manual detection of newly formed lesions in multiple sclerosis is an important but tedious and difficult task. Several approaches for automating the detection of new lesions have recently been proposed, but they tend to either overestimate the actual amount of new lesions or to miss many lesions. In this paper, an image registration convolutional neural network (CNN) that adapts the baseline image to the follow-up image by spatial deformations and simulation of new lesions is proposed. Simultaneously, segmentations of new lesions are generated, which are shown to reliably estimate the real new lesion load and to separate stable and progressive patients. Several applications of the proposed network emerge: image registration, detection and segmentation of new lesions, and modeling of new MS lesions. The modeled lesions offer the possibility to investigate the intensity profile of new lesions.

Chronological Registration of OCT and Autofluorescence Findings in CSCR: Two Distinct Patterns in Disease Course.

Optical coherence tomography (OCT) and fundus autofluorescence (FAF) are important imaging modalities for the assessment and prognosis of central serous chorioretinopathy (CSCR). However, setting the findings from both into spatial and temporal contexts as desirable for disease analysis remains a challenge due to both modalities being captured in different perspectives: sparse three-dimensional (3D) cross sections for OCT and two-dimensional (2D) en face images for FAF. To bridge this gap, we propose a visualisation pipeline capable of projecting OCT labels to en face image modalities such as FAF. By mapping OCT B-scans onto the accompanying en face infrared (IR) image and then registering the IR image onto the FAF image by a neural network, we can directly compare OCT labels to other labels in the en face plane. We also present a U-Net inspired segmentation model to predict segmentations in unlabeled OCTs. Evaluations show that both our networks achieve high precision (0.853 Dice score and 0.913 Area under Curve). Furthermore, medical analysis performed on exemplary, chronologically arranged CSCR progressions of 12 patients visualized with our pipeline indicates that, on CSCR, two patterns emerge: subretinal fluid (SRF) in OCT preceding hyperfluorescence (HF) in FAF and vice versa.

Deep learning-based simultaneous registration and unsupervised non-correspondence segmentation of medical images with pathologies.

PURPOSE: The registration of medical images often suffers from missing correspondences due to inter-patient variations, pathologies and their progression leading to implausible deformations that cause misregistrations and might eliminate valuable information. Detecting non-corresponding regions simultaneously with the registration process helps generating better deformations and has been investigated thoroughly with classical iterative frameworks but rarely with deep learning-based methods. METHODS: We present the joint non-correspondence segmentation and image registration network (NCR-Net), a convolutional neural network (CNN) trained on a Mumford-Shah-like functional, transferring the classical approach to the field of deep learning. NCR-Net consists of one encoding and two decoding parts allowing the network to simultaneously generate diffeomorphic deformations and segment non-correspondences. The loss function is composed of a masked image distance measure and regularization of deformation field and segmentation output. Additionally, anatomical labels are used for weak supervision of the registration task. No manual segmentations of non-correspondences are required. RESULTS: The proposed network is evaluated on the publicly available LPBA40 dataset with artificially added stroke lesions and a longitudinal optical coherence tomography (OCT) dataset of patients with age-related macular degeneration. The LPBA40 data are used to quantitatively assess the segmentation performance of the network, and it is shown qualitatively that NCR-Net can be used for the unsupervised segmentation of pathologies in OCT images. Furthermore, NCR-Net is compared to a registration-only network and state-of-the-art registration algorithms showing that NCR-Net achieves competitive performance and superior robustness to non-correspondences. CONCLUSION: NCR-Net, a CNN for simultaneous image registration and unsupervised non-correspondence segmentation, is presented. Experimental results show the network's ability to segment non-correspondence regions in an unsupervised manner and its robust registration performance even in the presence of large pathologies.

Chaos analysis of the brain topology in first-episode psychosis and clinical high risk patients.

Structural MRI studies in first-episode psychosis (FEP) and in clinical high risk (CHR) patients have consistently shown volumetric abnormalities in frontal, temporal, and cingulate cortex areas. The aim of the present study was to employ chaos analysis for the identification of brain topology differences in people with psychosis. Structural MRI were acquired from 77 FEP, 73 CHR and 44 healthy controls (HC). Chaos analysis of the gray matter distribution was performed: First, the distances of each voxel from the center of mass in the gray matter image was calculated. Next, the distances multiplied by the voxel intensity were represented as a spatial-series, which then was analyzed by extracting the Largest-Lyapunov-Exponent (lambda). The lambda brain map depicts thus how the gray matter topology changes. Between-group differences were identified by (a) comparing the lambda brain maps, which resulted in statistically significant differences in FEP and CHR compared to HC; and (b) matching the lambda series with the Morlet wavelet, which resulted in statistically significant differences in the scalograms of FEP against CHR and HC. The proposed framework using spatial-series extraction enhances the between-group differences of FEP, CHR and HC subjects, verifies diagnosis-relevant features and may potentially contribute to the identification of structural biomarkers for psychosis.

Registration of histological brain images onto optical coherence tomography images based on shape information.

Identifying tumour infiltration zones during tumour resection in order to excise as much tumour tissue as possible without damaging healthy brain tissue is still a major challenge in neurosurgery. The detection of tumour infiltrated regions so far requires histological analysis of biopsies taken from at expected tumour boundaries. The gold standard for histological analysis is the staining of thin cut specimen and the evaluation by a neuropathologist. This work presents a way to transfer the histological evaluation of a neuropathologist onto optical coherence tomography (OCT) images. OCT is a method suitable for real timein vivoimaging during neurosurgery however the images require processing for the tumour detection. The method demonstrated here enables the creation of a dataset which will be used for supervised learning in order to provide a better visualization of tumour infiltrated areas for the neurosurgeon. The created dataset contains labelled OCT images from two different OCT-systems (wavelength of 930 nm and 1300 nm). OCT images corresponding to the stained histological images were determined by shaping the sample, a controlled cutting process and a rigid transformation process between the OCT volumes based on their topological information. The histological labels were transferred onto the corresponding OCT images through a non-rigid transformation based on shape context features retrieved from the sample outline in the histological image and the OCT image. The accuracy of the registration was determined to be 200 ± 120µm. The resulting dataset consists of 1248 labelled OCT images for each of the two OCT systems.

Differentiation of different stages of brain tumor infiltration using optical coherence tomography: Comparison of two systems and histology.

The discrimination of tumor-infiltrated tissue from non-tumorous brain tissue during neurosurgical tumor excision is a major challenge in neurosurgery. It is critical to achieve full tumor removal since it directly correlates with the survival rate of the patient. Optical coherence tomography (OCT) might be an additional imaging method in the field of neurosurgery that enables the classification of different levels of tumor infiltration and non-tumorous tissue. This work investigated two OCT systems with different imaging wavelengths (930 nm/1310 nm) and different resolutions (axial (air): 4.9 µm/16 µm, lateral: 5.2 µm/22 µm) in their ability to identify different levels of tumor infiltration based on freshly excised ex vivo brain samples. A convolutional neural network was used for the classification. For both systems, the neural network could achieve classification accuracies above 91% for discriminating between healthy white matter and highly tumor infiltrated white matter (tumor infiltration >60%) .This work shows that both OCT systems with different optical properties achieve similar results regarding the identification of different stages of brain tumor infiltration.

Reference-based linear curve fitting for bolus arrival time estimation in 4D MRA and MR perfusion-weighted image sequences.

The bolus arrival time (BAT) based on an indicator dilution curve is an important hemodynamic parameter. As the direct estimation of this parameter is generally problematic, various parametric models have been proposed that describe typical physiological shapes of indicator dilution curves, but it remains unclear which model describes the real physiological background. This article presents a method that indirectly incorporates physiological information derived from the data available. For this, a patient-specific hemodynamic reference curve is extracted, and the corresponding reference BAT is determined. To estimate a BAT for a given signal curve, the reference curve is fitted linearly to the signal curve. The parameters of the fitting process are then used to transfer the reference BAT to the signal curve. The validation of the method proposed based on Monte Carlo simulations showed that the approach presented is capable of improving the BAT estimation precision compared with standard BAT estimation methods by up to 59% while at the same time reduces the computation time. A major benefit of the method proposed is that no assumption about the underlying distribution of indicator dilution has to be made, as it is implicitly modeled in the reference curve.

Image-based classification of parkinsonian syndromes using T2'-atlases.

Parkinsonian syndromes (PS) are genetically and pathologically heterogeneous neurodegenerative disorders. Clinical distinction between different PS can be difficult, particularly in early disease stages. This paper describes an automatic method for the distinction between classical Parkinson's disease (PD) and progressive supranuclear palsy (PSP) using T2' atlases. This procedure is based on the assumption that regional brain iron content differs between PD and PSP, which can be selectively measured using T2' MR imaging. The proposed method was developed and validated based on 33 PD patients, 10 PSP patients, and 24 healthy controls. The first step of the proposed procedure comprises T2' atlas generation for each group using affine and following non-linear registration. For classification, a T2' dataset is registered to the atlases and compared to each one of them using the mean sum of squared differences metric. The dataset is assigned to the group for which the corresponding atlas yields the lowest value. The evaluation using leave-one-out validation revealed that the proposed method achieves a classification accuracy of 91%. The presented method might serve as the basis for an improved automatic classification of PS in the future.