Heart rate estimation from ballistocardiographic signals using deep learning.

Objective.Ballistocardiography (BCG) is an unobtrusive approach for cost-effective and patient-friendly health monitoring. In this work, deep learning methods are used for heart rate estimation from BCG signals and are compared against five digital signal processing methods found in literature.Approach.The models are evaluated on a dataset featuring BCG recordings from 42 patients, acquired with a pneumatic system. Several different deep learning architectures, including convolutional, recurrent and a combination of both are investigated. Besides model performance, we are also concerned about model size and specifically investigate less complex and smaller networks.Main results.Deep learning models outperform traditional methods by a large margin. Across 14 patients in a held-out testing set, an architecture with stacked convolutional and recurrent layers achieves an average mean absolute error (MAE) of 2.07 beat min-1, whereas the best-performing traditional method reaches 4.24 beat min-1. Besides smaller errors, deep learning models show more consistent performance across different patients, indicating the ability to better deal with inter-patient variability, a prevalent issue in BCG analysis. In addition, we develop a smaller version of the best-performing architecture, that only features 8283 parameters, yet still achieves an average MAE of 2.32 beat min-1on the testing set.Significance.This is the first study that applies and compares different deep learning architectures to heart rate estimation from bed-based BCG signals. Compared to signal processing algorithms, deep learning models show dramatically smaller errors and more consistent results across different individuals. The results show that using smaller models instead of excessively large ones can lead to sufficient performance for specific biosignal processing applications. Additionally, we investigate the use of fully convolutional networks for 1D signal processing, which is rarely applied in literature.

Ejection Wave Segmentation for Contact-Free Heart Rate Estimation from Ballistocardiographic Signals.

We present a new algorithm for peak detection in ballistocardiographic (BCG) signals and use it for heart rate estimation. Systolic complexes of the BCG signal are enhanced and coarse heart beat locations estimated. Ejection waves I, J and K are detected simultaneously around coarse locations, only using detection of local maxima and weighted summation of peak heights. Due to a lack of reference BCG annotations, the algorithm's performance is assessed by using the detected peaks for heart rate estimation. On a dataset acquired with a pneumatic BCG system, we evaluate the heart rate estimation performance and compare the introduced algorithm against other methods found in literature. The dataset is gathered from 42 patients in a clinical environment and provides low-quality signals taken from a realistic scenario. With a mean absolute percentage error of 2.58 % at 65 % coverage, the presented method is on par with the best-performing state-of-the-art algorithms investigated. Limits of agreement (5th/95th percentiles) in a comparison with ECG-based heart rate measurements lie within P5 = -3.63 and P95 = 5.78 beat/min.

Analysis of Vestibular Labyrinthine Geometry and Variation in the Human Temporal Bone.

Stable posture and body movement in humans is dictated by the precise functioning of the ampulla organs in the semi-circular canals. Statistical analysis of the interrelationship between bony and membranous compartments within the semi-circular canals is dependent on the visualization of soft tissue structures. Thirty-one human inner ears were prepared, post-fixed with osmium tetroxide and decalcified for soft tissue contrast enhancement. High resolution X-ray microtomography images at 15 µm voxel-size were manually segmented. This data served as templates for centerline generation and cross-sectional area extraction. Our estimates demonstrate the variability of individual specimens from averaged centerlines of both bony and membranous labyrinth. Centerline lengths and cross-sectional areas along these lines were identified from segmented data. Using centerlines weighted by the inverse squares of the cross-sectional areas, plane angles could be quantified. The fit planes indicate that the bony labyrinth resembles a Cartesian coordinate system more closely than the membranous labyrinth. A widening in the membranous labyrinth of the lateral semi-circular canal was observed in some of the specimens. Likewise, the cross-sectional areas in the perilymphatic spaces of the lateral canal differed from the other canals. For the first time we could precisely describe the geometry of the human membranous labyrinth based on a large sample size. Awareness of the variations in the canal geometry of the membranous and bony labyrinth would be a helpful reference in designing electrodes for future vestibular prosthesis and simulating fluid dynamics more precisely.

Evaluation of segmentation methods on head and neck CT: Auto-segmentation challenge 2015.

PURPOSE: Automated delineation of structures and organs is a key step in medical imaging. However, due to the large number and diversity of structures and the large variety of segmentation algorithms, a consensus is lacking as to which automated segmentation method works best for certain applications. Segmentation challenges are a good approach for unbiased evaluation and comparison of segmentation algorithms. METHODS: In this work, we describe and present the results of the Head and Neck Auto-Segmentation Challenge 2015, a satellite event at the Medical Image Computing and Computer Assisted Interventions (MICCAI) 2015 conference. Six teams participated in a challenge to segment nine structures in the head and neck region of CT images: brainstem, mandible, chiasm, bilateral optic nerves, bilateral parotid glands, and bilateral submandibular glands. RESULTS: This paper presents the quantitative results of this challenge using multiple established error metrics and a well-defined ranking system. The strengths and weaknesses of the different auto-segmentation approaches are analyzed and discussed. CONCLUSIONS: The Head and Neck Auto-Segmentation Challenge 2015 was a good opportunity to assess the current state-of-the-art in segmentation of organs at risk for radiotherapy treatment. Participating teams had the possibility to compare their approaches to other methods under unbiased and standardized circumstances. The results demonstrate a clear tendency toward more general purpose and fewer structure-specific segmentation algorithms.

Model-based Vestibular Afferent Stimulation: Modular Workflow for Analyzing Stimulation Scenarios in Patient Specific and Statistical Vestibular Anatomy.

Our sense of balance and spatial orientation strongly depends on the correct functionality of our vestibular system. Vestibular dysfunction can lead to blurred vision and impaired balance and spatial orientation, causing a significant decrease in quality of life. Recent studies have shown that vestibular implants offer a possible treatment for patients with vestibular dysfunction. The close proximity of the vestibular nerve bundles, the facial nerve and the cochlear nerve poses a major challenge to targeted stimulation of the vestibular system. Modeling the electrical stimulation of the vestibular system allows for an efficient analysis of stimulation scenarios previous to time and cost intensive in vivo experiments. Current models are based on animal data or CAD models of human anatomy. In this work, a (semi-)automatic modular workflow is presented for the stepwise transformation of segmented vestibular anatomy data of human vestibular specimens to an electrical model and subsequently analyzed. The steps of this workflow include (i) the transformation of labeled datasets to a tetrahedra mesh, (ii) nerve fiber anisotropy and fiber computation as a basis for neuron models, (iii) inclusion of arbitrary electrode designs, (iv) simulation of quasistationary potential distributions, and (v) analysis of stimulus waveforms on the stimulation outcome. Results obtained by the workflow based on human datasets and the average shape of a statistical model revealed a high qualitative agreement and a quantitatively comparable range compared to data from literature, respectively. Based on our workflow, a detailed analysis of intra- and extra-labyrinthine electrode configurations with various stimulation waveforms and electrode designs can be performed on patient specific anatomy, making this framework a valuable tool for current optimization questions concerning vestibular implants in humans.

Vision 20/20: perspectives on automated image segmentation for radiotherapy.

Due to rapid advances in radiation therapy (RT), especially image guidance and treatment adaptation, a fast and accurate segmentation of medical images is a very important part of the treatment. Manual delineation of target volumes and organs at risk is still the standard routine for most clinics, even though it is time consuming and prone to intra- and interobserver variations. Automated segmentation methods seek to reduce delineation workload and unify the organ boundary definition. In this paper, the authors review the current autosegmentation methods particularly relevant for applications in RT. The authors outline the methods' strengths and limitations and propose strategies that could lead to wider acceptance of autosegmentation in routine clinical practice. The authors conclude that currently, autosegmentation technology in RT planning is an efficient tool for the clinicians to provide them with a good starting point for review and adjustment. Modern hardware platforms including GPUs allow most of the autosegmentation tasks to be done in a range of a few minutes. In the nearest future, improvements in CT-based autosegmentation tools will be achieved through standardization of imaging and contouring protocols. In the longer term, the authors expect a wider use of multimodality approaches and better understanding of correlation of imaging with biology and pathology.

Automatic segmentation of head and neck CT images for radiotherapy treatment planning using multiple atlases, statistical appearance models, and geodesic active contours.

PURPOSE: Accurate delineation of organs at risk (OARs) is a precondition for intensity modulated radiation therapy. However, manual delineation of OARs is time consuming and prone to high interobserver variability. Because of image artifacts and low image contrast between different structures, however, the number of available approaches for autosegmentation of structures in the head-neck area is still rather low. In this project, a new approach for automated segmentation of head-neck CT images that combine the robustness of multiatlas-based segmentation with the flexibility of geodesic active contours and the prior knowledge provided by statistical appearance models is presented. METHODS: The presented approach is using an atlas-based segmentation approach in combination with label fusion in order to initialize a segmentation pipeline that is based on using statistical appearance models and geodesic active contours. An anatomically correct approximation of the segmentation result provided by atlas-based segmentation acts as a starting point for an iterative refinement of this approximation. The final segmentation result is based on using model to image registration and geodesic active contours, which are mutually influencing each other. RESULTS: 18 CT images in combination with manually segmented labels of parotid glands and brainstem were used in a leave-one-out cross validation scheme in order to evaluate the presented approach. For this purpose, 50 different statistical appearance models have been created and used for segmentation. Dice coefficient (DC), mean absolute distance and max. Hausdorff distance between the autosegmentation results and expert segmentations were calculated. An average Dice coefficient of DC = 0.81 (right parotid gland), DC = 0.84 (left parotid gland), and DC = 0.86 (brainstem) could be achieved. CONCLUSIONS: The presented framework provides accurate segmentation results for three important structures in the head neck area. Compared to a segmentation approach based on using multiple atlases in combination with label fusion, the proposed hybrid approach provided more accurate results within a clinically acceptable amount of time.

Hip fracture discrimination from dual-energy X-ray absorptiometry by statistical model registration.

Although the areal Bone Mineral Density (BMD) measurements from dual-energy X-ray absorptiometry (DXA) are able to discriminate between hip fracture cases and controls, the femoral strength is largely determined by the 3D bone structure. In a previous work a statistical model was presented which parameterizes the 3D shape and BMD distribution of the proximal femur. In this study the parameter values resulting from the registration of the model onto DXA images are evaluated for their hip fracture discrimination ability with respect to regular DXA derived areal BMD measurements. The statistical model was constructed from a large database of QCT scans of females with an average age of 67.8 ± 17.0 years. This model was subsequently registered onto the DXA images of a fracture and control group. The fracture group consisted of 175 female patients with an average age of 66.4 ± 9.9 years who suffered a fracture on the contra lateral femur. The control group consisted of 175 female subjects with an average age of 65.3 ± 10.0 years and no fracture history. The discrimination ability of the resulting model parameter values, as well as the areal BMD measurements extracted from the DXA images were evaluated using a logistic regression analysis. The area under the receiver operating curve (AUC) of the combined model parameters and areal BMD values was 0.840 (95% CI 0.799-0.881), whilst using only the areal BMD values resulted in an AUC of 0.802 (95% CI 0.757-0.848). These results indicate that the discrimination ability of the areal BMD values is improved by supplementing them with the model parameter values, which give a more complete representation of the subject specific shape and internal bone distribution. Thus, the presented method potentially allows for an improved hip fracture risk estimation whilst maintaining DXA as the current standard modality.

A statistical model of shape and bone mineral density distribution of the proximal femur for fracture risk assessment.

This work presents a statistical model of both the shape and Bone Mineral Density (BMD) distribution of the proximal femur for fracture risk assessment. The shape and density model was built from a dataset of Quantitative Computed Tomography scans of fracture patients and a control group. Principal Component Analysis and Horn's parallel analysis were used to reduce the dimensionality of the shape and density model to the main modes of variation. The input data was then used to analyze the model parameters for the optimal separation between the fracture and control group. Feature selection using the Fisher criterion determined the parameters with the best class separation, which were used in Fisher Linear Discriminant Analysis to find the direction in the parameter space that best separates the fracture and control group. This resulted in a Fisher criterion value of 6.70, while analyzing the Dual-energy X-ray Absorptiometry derived femur neck areal BMD of the same subjects resulted in a Fisher criterion value of 0.98. This indicates that a fracture risk estimation approach based on the presented model might improve upon the current standard clinical practice.

Texture analysis, bone mineral density, and cortical thickness of the proximal femur: fracture risk prediction.

OBJECTIVE: The objectives of this study were to perform a clinical study analyzing bone quality in multidetector computed tomographic images of the femur using bone mineral density (BMD), cortical thickness, and texture algorithms in differentiating osteoporotic fracture and control subjects; to differentiate fracture types. METHODS: Femoral head, trochanteric, intertrochanteric, and upper and lower neck were segmented (fracture, n = 30; control, n = 10). Cortical thickness, BMD, and texture analysis were obtained using co-occurrence matrices, Minkowski dimension, and functional and scaling index method. RESULTS: Bone mineral density and cortical thickness performed best in the neck region, and texture measures performed best in the trochanter. Only cortical thickness and texture measures differentiated femoral neck and intertrochanteric fractures. CONCLUSIONS: This study demonstrates that differentiation of osteoporotic fracture subjects and controls is achieved with texture measures, cortical thickness, and BMD; however, performance is region specific.

Assessment of the individual fracture risk of the proximal femur by using statistical appearance models.

PURPOSE: Standard diagnostic techniques to quantify bone mineral density (BMD) include dual-energy x-ray absorptiometry (DXA) and quantitative computed tomography. However, BMD alone is not sufficient to predict the fracture risk for an individual patient. Therefore, the development of tools, which can assess the bone quality in order to predict individual biomechanics of a bone, would mean a significant improvement for the prevention of fragility fractures. In this study, a new approach to predict the fracture risk of proximal femora using a statistical appearance model will be presented. METHODS: 100 CT data sets of human femur cadaver specimens are used to create statistical appearance models for the prediction of the individual fracture load (FL). Calculating these models offers the possibility to use information about the inner structure of the proximal femur, as well as geometric properties of the femoral bone for FL prediction. By applying principal component analysis, statistical models have been calculated in different regions of interest. For each of these models, the individual model parameters for each single data set were calculated and used as predictor variables in a multilinear regression model. By this means, the best working region of interest for the prediction of FL was identified. The accuracy of the FL prediction was evaluated by using a leave-one-out cross validation scheme. Performance of DXA in predicting FL was used as a standard of comparison. RESULTS: The results of the evaluative tests demonstrate that significantly better results for FL prediction can be achieved by using the proposed model-based approach (R = 0.91) than using DXA-BMD (R = 0.81) for the prediction of fracture load. CONCLUSIONS: The results of the evaluation show that the presented model-based approach is very promising and also comparable to studies that partly used higher image resolutions for bone quality assessment and fracture risk prediction.

Statistical model based analysis of bone mineral density of lumbar spine.

OBJECTIVE: For planning surgical interventions at the spine affected by osteoporosis, accurate information about the local bone quality in terms of anchorage strength for implants is very important. Based on previous work on automated bone quality assessment on the proximal femur with a completely automated model-based approach, this paper describes first applications and results on the lumbar vertebrae. MATERIALS AND METHODS: As basis for the analysis, CT datasets of 17 spinal specimens, with a resolution of 0.7 mm x 0.7 mm x 0.7 mm have been used. A combined statistical model of 3D shape and intensity value distribution was created for these datasets and used to predict the measured bone mineral density (BMD). Different regions of interest were tested, model parameters with high correlation with BMD were identified. Leave-one-out tests were performed to evaluate the capability for the BMD-prediction using regression models. RESULTS: High correlation values (R = 0.94) between measured and predicted BMD were achieved and the high predictive quality of the model could be shown. CONCLUSION: Although the results are only valid for an insufficient small sample size of specimen data, they show a clear potential for clinical application. Therefore, work in the future will focus on clinical validation with larger sample size and the inclusion of biomechanical properties in addition to BMD.