Deep Learning Segmentation of the Nucleus Basalis of Meynert on 3T MRI.

BACKGROUND AND PURPOSE: The nucleus basalis of Meynert is a key subcortical structure that is important in arousal and cognition and has been explored as a deep brain stimulation target but is difficult to study due to its small size, variability among patients, and lack of contrast on 3T MR imaging. Thus, our goal was to establish and evaluate a deep learning network for automatic, accurate, and patient-specific segmentations with 3T MR imaging. MATERIALS AND METHODS: Patient-specific segmentations can be produced manually; however, the nucleus basalis of Meynert is difficult to accurately segment on 3T MR imaging, with 7T being preferred. Thus, paired 3T and 7T MR imaging data sets of 21 healthy subjects were obtained. A test data set of 6 subjects was completely withheld. The nucleus was expertly segmented on 7T, providing accurate labels for the paired 3T MR imaging. An external data set of 14 patients with temporal lobe epilepsy was used to test the model on brains with neurologic disorders. A 3D-Unet convolutional neural network was constructed, and a 5-fold cross-validation was performed. RESULTS: The novel segmentation model demonstrated significantly improved Dice coefficients over the standard probabilistic atlas for both healthy subjects (mean, 0.68 [SD, 0.10] versus 0.45 [SD, 0.11], P = .002, t test) and patients (0.64 [SD, 0.10] versus 0.37 [SD, 0.22], P < .001). Additionally, the model demonstrated significantly decreased centroid distance in patients (1.18 [SD, 0.43] mm, 3.09 [SD, 2.56] mm, P = .007). CONCLUSIONS: We developed the first model, to our knowledge, for automatic and accurate patient-specific segmentation of the nucleus basalis of Meynert. This model may enable further study into the nucleus, impacting new treatments such as deep brain stimulation.

Laser range scanning for image-guided neurosurgery: investigation of image-to-physical space registrations.

In this article a comprehensive set of registration methods is utilized to provide image-to-physical space registration for image-guided neurosurgery in a clinical study. Central to all methods is the use of textured point clouds as provided by laser range scanning technology. The objective is to perform a systematic comparison of registration methods that include both extracranial (skin marker point-based registration (PBR), and face-based surface registration) and intracranial methods (feature PBR, cortical vessel-contour registration, a combined geometry/intensity surface registration method, and a constrained form of that method to improve robustness). The platform facilitates the selection of discrete soft-tissue landmarks that appear on the patient's intraoperative cortical surface and the preoperative gadolinium-enhanced magnetic resonance (MR) image volume, i.e., true corresponding novel targets. In an 11 patient study, data were taken to allow statistical comparison among registration methods within the context of registration error. The results indicate that intraoperative face-based surface registration is statistically equivalent to traditional skin marker registration. The four intracranial registration methods were investigated and the results demonstrated a target registration error of 1.6 +/- 0.5 mm, 1.7 +/- 0.5 mm, 3.9 +/- 3.4 mm, and 2.0 +/- 0.9 mm, for feature PBR, cortical vessel-contour registration, unconstrained geometric/intensity registration, and constrained geometric/intensity registration, respectively. When analyzing the results on a per case basis, the constrained geometric/intensity registration performed best, followed by feature PBR, and finally cortical vessel-contour registration. Interestingly, the best target registration errors are similar to targeting errors reported using bone-implanted markers within the context of rigid targets. The experience in this study as with others is that brain shift can compromise extracranial registration methods from the earliest stages. Based on the results reported here, organ-based approaches to registration would improve this, especially for shallow lesions.

Focused stimulation of dorsal subthalamic nucleus improves reactive inhibitory control of action impulses.

Frontal-basal ganglia circuitry dysfunction caused by Parkinson's disease impairs important executive cognitive processes, such as the ability to inhibit impulsive action tendencies. Subthalamic Nucleus Deep Brain Stimulation in Parkinson's disease improves the reactive inhibition of impulsive actions that interfere with goal-directed behavior. An unresolved question is whether this effect depends on stimulation of a particular Subthalamic Nucleus subregion. The current study aimed to 1) replicate previous findings and additionally investigate the effect of chronic versus acute Subthalamic Nucleus stimulation on inhibitory control in Parkinson's disease patients off dopaminergic medication 2) test whether stimulating Subthalamic Nucleus subregions differentially modulate proactive response control and the proficiency of reactive inhibitory control. In the first experiment, twelve Parkinson's disease patients completed three sessions of the Simon task, Off Deep brain stimulation and medication, on acute Deep Brain Stimulation and on chronic Deep Brain Stimulation. Experiment 2 consisted of 11 Parkinson's disease patients with Subthalamic Nucleus Deep Brain Stimulation (off medication) who completed two testing sessions involving of a Simon task either with stimulation of the dorsal or the ventral contact in the Subthalamic Nucleus. Our findings show that Deep Brain Stimulation improves reactive inhibitory control, regardless of medication and regardless of whether it concerns chronic or acute Subthalamic Nucleus stimulation. More importantly, selective stimulation of dorsal and ventral subregions of the Subthalamic Nucleus indicates that especially the dorsal Subthalamic Nucleus circuitries are crucial for modulating the reactive inhibitory control of motor actions.

Brain segmentation and white matter lesion detection in MR images.

This paper presents a review of methods and techniques that have been proposed for the segmentation of magnetic resonance (MR) images of the brain, with a special emphasis on the segmentation of white matter lesions. First, artifacts affecting MR images (noise, partial volume effect, and shading artifact) are reviewed and methods that have been proposed to correct for these artifacts are discussed. Next, a taxonomy of generic segmentation algorithms is presented, categorized as region-based, edge-based, and classification algorithms. For each category, the applications proposed in the literature are subdivided into 2-D, 3-D, or multimodal approaches. In each case, tables listing authors, bibliographic references, and methods used have been compiled and are presented. This description of segmentation algorithms is followed by a section on techniques proposed specifically for the analysis of white matter lesions. Finally, a section is dedicated to a review and a comparison of validation methods proposed to assess the accuracy and the reliability of the results obtained with various segmentation algorithms.

Neural-network-based segmentation of multi-modal medical images: a comparative and prospective study.

This work presents an investigation of the potential of artificial neural networks for classification of registered magnetic resonance and X-ray computer tomography images of the human brain. First, topological and learning parameters are established experimentally. Second, the learning and generalization properties of the neural networks are compared to those of a classical maximum likelihood classifier and the superiority of the neural network approach is demonstrated when small training sets are utilized. Third, the generalization properties of the neural networks are utilized to develop an adaptive learning scheme able to overcome interslice intensity variations typical of MR images. This approach permits the segmentation of image volumes based on training sets selected on a single slice. Finally, the segmentation results obtained both with the artificial neural network and the maximum likelihood classifiers are compared to contours drawn manually.

Correction of intensity variations in MR images for computer-aided tissue classification.

A number of supervised and unsupervised pattern recognition techniques have been proposed in recent years for the segmentation and the quantitative analysis of MR images. However, the efficacy of these techniques is affected by acquisition artifacts such as inter-slice, intra-slice, and inter-patient intensity variations. Here a new approach to the correction of intra-slice intensity variations is presented. Results demonstrate that the correction process enhances the performance of backpropagation neural network classifiers designed for the segmentation of the images. Two slightly different versions of the method are presented. The first version fits an intensity correction surface directly to reference points selected by the user in the images. The second version fits the surface to reference points obtained by an intermediate classification operation. Qualitative and quantitative evaluation of both methods reveals that the first one leads to a better correction of the images than the second but that it is more sensitive to operator errors.

The importance of ray pathlengths when measuring objects in maximum intensity projection images.

It is important to understand any process that affects medical data. Once the data have changed from the original form, one must consider the possibility that the information contained in the data has also changed. In general, false negative and false positive diagnoses caused by this post-processing must be minimized. Medical imaging is one area in which post-processing is commonly performed, but there is often little or no discussion of how these algorithms affect the data. This study uncovers some interesting properties of maximum intensity projection (MIP) algorithms which are commonly used in the post-processing of magnetic resonance (MR) and computed tomography (CT) angiographic data. The appearance of the width of vessels and the extent of malformations such as aneurysms is of interest to clinicians. This study will show how MIP algorithms interact with the shape of the object being projected. MIP's can make objects appear thinner in the projection than in the original data set and also alter the shape of the profile of the object seen in the original data. These effects have consequences for width-measuring algorithms which will be discussed. Each projected intensity is dependent upon the pathlength of the ray from which the projected pixel arises. The morphology (shape and intensity profile) of an object will change the pathlength that each ray experiences. This is termed the pathlength effect. In order to demonstrate the pathlength effect, simple computer models of an imaged vessel were created. Additionally, a static MR phantom verified that the derived equation for the projection-plane probability density function (pdf) predicts the projection-plane intensities well (R(2)=0.96). Finally, examples of projections through in vivo MR angiography and CT angiography data are presented.

Morphometric analysis of white matter lesions in MR images: method and validation.

The analysis of MR images is evolving from qualitative to quantitative. More and more, the question asked by clinicians is how much and where, rather than a simple statement on the presence or absence of abnormalities. The authors present a study in which the results obtained with a semiautomatic, multispectral segmentation technique are quantitatively compared to manually delineated regions. The core of the semiautomatic image analysis system is a supervised artificial neural network classifier augmented with dedicated preand postprocessing algorithms, including anisotropic noise filtering and a surface-fitting method for the correction of spatial intensity variations. The study was focused on the quantitation of white matter lesions in the human brain. A total of 36 images from six brain volumes was analyzed twice by each of two operators, under supervision of a neuroradiologist. Both the intra- and interrater variability of the methods were studied in terms of the average tissue area detected per slice, the correlation coefficients between area measurements, and a measure of similarity derived from the kappa statistic. The results indicate that, compared to a manual method, the use of the semiautomatic technique not only facilitates the analysis of the images, but also has similar or lower intra- and interrater variabilities.

Accurate localization of cortical convolutions in MR brain images.

Analysis of brain images often requires accurate localization of cortical convolutions. Although magnetic resonance (MR) brain images offer sufficient resolution for identifying convolutions in theory, the nature of tomographic imaging prevents clear definition of convolutions in individual slices. Existing methods for solving this problem rely on heuristic adaptation of brain atlases created from a small number of individuals. These methods do not usually provide high accuracy because of large biological variations among individuals. The authors propose to localize convolutions by linking realistic visualizations of the cortical surface with the original image volume. They have developed a system so that a user can quickly localize key convolutions in several visualizations of an entire brain surface. Because of the links between the visualizations and the original volume, these convolutions are simultaneously localized in the original image slices. In the process of the authors' development, they have implemented a fast and easy method for visualizing cortical surfaces in MR images, thereby making their scheme usable in practical applications.

Registration of 3-D images using weighted geometrical features.

The authors present a weighted geometrical feature (WGF) registration algorithm. Its efficacy is demonstrated by combining points and a surface. The technique is an extension of Besl and McKay's (1992) iterative closest point (ICP) algorithm. The authors use the WGF algorithm to register X-ray computed tomography (CT) and T2-weighted magnetic resonance (MR) volume head images acquired from eleven patients that underwent craniotomies in a neurosurgical clinical trial. Each patient had five external markers attached to transcutaneous posts screwed into the outer table of the skull. The authors define registration error as the distance between positions of corresponding markers that are not used for registration. The CT and MR images are registered using fiducial paints (marker positions) only, a surface only, and various weighted combinations of points and a surface. The CT surface is derived from contours corresponding to the inner surface of the skull. The MR surface is derived from contours corresponding to the cerebrospinal fluid (CSF)-dura interface. Registration using points and a surface is found to be significantly more accurate then registration using only points or a surface.

Automatic 3-D segmentation of internal structures of the head in MR images using a combination of similarity and free-form transformations: Part I, Methodology and validation on normal subjects.

The study presented in this paper tests the hypothesis that the combination of a global similarity transformation and local free-form deformations can be used for the accurate segmentation of internal structures in MR images of the brain. To quantitatively evaluate our approach, the entire brain, the cerebellum, and the head of the caudate have been segmented manually by two raters on one of the volumes (the reference volume) and mapped back onto all the other volumes, using the computed transformations. The contours so obtained have been compared to contours drawn manually around the structures of interest in each individual brain. Manual delineation was performed twice by the same two raters to test inter- and intrarater variability. For the brain and the cerebellum, results indicate that for each rater, contours obtained manually and contours obtained automatically by deforming his own atlas are virtually indistinguishable. Furthermore, contours obtained manually by one rater and contours obtained automatically by deforming this rater's own atlas are more similar than contours obtained manually by two raters. For the caudate, manual intra- and interrater similarity indexes remain slightly better than manual versus automatic indexes, mainly because of the spatial resolution of the images used in this study. Qualitative results also suggest that this method can be used for the segmentation of more complex structures, such as the hippocampus.

Automatic 3-D segmentation of internal structures of the head in MR images using a combination of similarity and free-form transformations: Part II, validation on severely atrophied brains.

Studies aimed at quantifying neuroanatomical differences between populations require the volume measurements of individual brain structures. If the study contains a large number of images, manual segmentation is not practical. This study tests the hypothesis that a fully automatic, atlas-based segmentation method can be used to quantify atrophy indexes derived from the brain and cerebellum volumes in normal subjects and chronic alcoholics. This is accomplished by registering an atlas volume with a subject volume, first using a global transformation, and then improving the registration using a local transformation. Segmented structures in the atlas volume are then mapped to the corresponding structures in the subject volume using the combined global and local transformations. This technique has been applied to seven normal and seven alcoholic subjects. Three magnetic resonance volumes were obtained for each subject and each volume was segmented automatically, using the atlas-based method. Accuracy was assessed by manually segmenting regions and measuring the similarity between corresponding regions obtained automatically. Repeatability was determined by comparing volume measurements of segmented structures from each acquisition of the same subject. Results demonstrate that the method is accurate, that the results are repeatable, and that it can provide a method for automatic quantification of brain atrophy, even when the degree of atrophy is large.

Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery.

While laparoscopes are used for numerous minimally invasive (MI) procedures, MI liver resection and ablative surgery is infrequently performed. The paucity of cases is due to the restriction of the field of view by the laparoscope and the difficulty in determining tumor location and margins under video guidance. By merging MI surgery with interactive, image-guided surgery (IIGS), we hope to overcome localization difficulties present in laparoscopic liver procedures. One key component of any IIGS system is the development of accurate registration techniques to map image space to physical or patient space. This manuscript focuses on the accuracy and analysis of the direct linear transformation (DLT) method to register physical space with laparoscopic image space on both distorted and distortion-corrected video images. Experiments were conducted on a liver-sized plastic phantom affixed with 20 markers at various depths. After localizing the points in both physical and laparoscopic image space, registration accuracy was assessed for different combinations and numbers of control points (n) to determine the quantity necessary to develop a robust registration matrix. For n = 11, average target registration error (TRE) was 0.70 +/- 0.20 mm. We also studied the effects of distortion correction on registration accuracy. For the particular distortion correction method and laparoscope used in our experiments, there was no statistical significance between physical to image registration error for distorted and corrected images. In cases where a minimum number of control points (n = 6) are acquired, the DLT is often not stable and the mathematical process can lead to high TRE values. Mathematical filters developed through the analysis of the DLT were used to prospectively eliminate outlier cases where the TRE was high. For n = 6, prefilter average TRE was 17.4 +/- 153 mm for all trials; when the filters were applied, average TRE decreased to 1.64 +/- 1.10 mm for the remaining trials.

Retrospective intermodality registration techniques for images of the head: surface-based versus volume-based.

The primary objective of this study is to perform a blinded evaluation of two groups of retrospective image registration techniques, using as a gold standard a prospective marker-based registration method, and to compare the performance of one group with the other. These techniques have already been evaluated individually [27]. In this paper, however, we find that by grouping the techniques as volume based or surface based, we can make some interesting conclusions which were not visible in the earlier study. In order to ensure blindness, all retrospective registrations were performed by participants who had no knowledge of the gold-standard results until after their results had been submitted. Image volumes of three modalities: X-ray computed tomography (CT), magnetic resonance (MR), and positron emission tomography (PET) were obtained from patients undergoing neurosurgery at Vanderbilt University Medical Center on whom bone-implanted fiducial markers were mounted. These volumes had all traces of the markers removed and were provided via the Internet to project collaborators outside Vanderbilt, who then performed retrospective registrations on the volumes, calculating transformations from CT to MR and/or from PET to MR. These investigators communicated their transformations, again via the Internet, to Vanderbilt, where the accuracy of each registration was evaluated. In this evaluation, the accuracy is measured at multiple volumes of interest (VOI's). Our results indicate that the volume-based techniques in this study tended to give substantially more accurate and reliable results than the surface-based ones for the CT-to-MR registration tasks, and slightly more accurate results for the PET-to-MR tasks. Analysis of these results revealed that the rotational component of error was more pronounced for the surface-based group. It was also apparent that all of the registration techniques we examined have the potential to produce satisfactory results much of the time, but that visual inspection is necessary to guard against large errors.

Surface-based registration of CT images to physical space for image-guided surgery of the spine: a sensitivity study.

This paper presents a method designed to register preoperative computed tomography (CT) images to vertebral surface points acquired intraoperatively from ultrasound (US) images or via a tracked probe. It also presents a comparison of the registration accuracy achievable with surface points acquired from the entire posterior surface of the vertebra to the accuracy achievable with points acquired only from the spinous process and central laminar regions. Using a marker-based method as a reference, this work shows that submillimetric registration accuracy can be obtained even when a small portion of the posterior vertebral surface is used for registration. It also shows that when selected surface patches are used, CT slice thickness is not a critical parameter in the registration process. Furthermore, the paper includes qualitative results of registering vertebral surface points in US images to multiple CT slices. The method has been tested with US points and physical points on a plastic spine phantom and with simulated data on a patient CT scan.

Knowledge-based approach to sleep EEG analysis--a feasibility study.

A knowledge-based approach to automated sleep EEG (electroencephalogram) analysis is described. In this system, an object-oriented approach is followed in which specific waveforms and sleep stages ("objects") are represented in terms of frames. The latter capture the morphological and spatio-temporal information for each object. An object detection module ("frame matcher"), operating on the frames, is employed to identify what features need to be extracted from the EEG and to trigger the appropriate "specialist"--specialized signal processing modules--to obtain values for these features. This leads to an opportunistic approach to EEG interpretation with quantitative information being extracted from the signal only when needed by the reasoning processes. The system has been tested on the detection of K complexes and sleep spindles. Its performance indicates that the approach followed is feasible and can become a powerful tool for automated EEG interpretation.

Model creation and deformation for the automatic segmentation of the brain in MR images.

In this paper a method for the automatic segmentation of the brain in magnetic resonance images is presented and validated. The proposed method involves two steps 1) the creation of an initial model and 2) the deformation of this model to fit the exact contours of the brain in the images. A new method to create the initial model has been developed and compared to a more traditional approach in which initial models are created by means of brain atlases. A comprehensive validation of the complete segmentation method has been conducted on a series of three-dimensional T1-weighted magnetization-prepared rapid gradient echo image volumes acquired both from control volunteers and patients suffering from Cushing's disease. This validation study compares results obtained with the method we propose and contours drawn manually. Averages differences between manual and automatic segmentation with the model creation method we propose are 1.7% and 2.7% for the control volunteers and the Cushing's patients, respectively. These numbers are 1.8% and 5.6% when the atlas-based method is used.

Model-based diagnosis in intensive care monitoring: the YAQ approach.

YAQ is an ontology for model-based reasoning in physiologic domains. YAQ is based on a hybrid algebra of qualitative and numerical values, and is designed to benefit from the rich and ever-changing nature of information available in a critical care monitoring environment. The focus of the project is on diagnosis of clinical conditions, prediction of the effects of therapy, and therapy management assistance. Two models of diagnosis are implemented in YAQ: diagnosis based on associations, and model-based diagnosis. The ontology is applied to the domain of ventilator management in infants with respiratory distress syndrome (RDS). The article describes the diagnostic capabilities of YAQ, illustrates these concepts on examples taken from actual patient records, and reports the results of an evaluation of the diagnostic performance on the RDS/assisted ventilation domain model.

Adaptive signal analysis and interpretation for real-time intelligent patient monitoring.

On-line intelligent monitoring, diagnosis, and control of dynamic systems such as patients in intensive care units necessitates the context-dependent acquisition, processing, analysis, and interpretation of large amounts of possibly noisy and incomplete data. The dynamic nature of the process also requires a continuous evaluation and adaptation of the monitoring strategy to respond to changes both in the monitored patient and in the monitoring equipment. Moreover, real-time constraints may imply data losses, the importance of which has to be minimized. This paper presents a computer architecture designed to accomplish these tasks. Its main components are a model and a data abstraction module. The model provides the system with a monitoring context related to the patient status. The data abstraction module relies on that information to adapt the monitoring strategy and provide the model with the necessary information. This paper focuses on the data abstraction module and its interaction with the model.

Automatic detection of intracranial contours in MR images.

Segmentation of the intracranial cavity in medical images is valuable in several research areas such as the quantitative analysis of normal and abnormal brain tissues, the registration of different imaging modalities (MRI, PET, CT) based on surface models of the brain, and the rendering of volume data. Because the manual delineation of the brain contour in the images can be demanding and error prone, an automatic procedure to perform this task is desirable. We have developed and tested a robust method that permits the automatic detection of the intracranial contour in transverse MR images. The method is described and its performance evaluated.