Deep-learning based fully automatic segmentation of the globus pallidus interna and externa using ultra-high 7 Tesla MRI.

Deep brain stimulation (DBS) surgery has been shown to dramatically improve the quality of life for patients with various motor dysfunctions, such as those afflicted with Parkinson's disease (PD), dystonia, and essential tremor (ET), by relieving motor symptoms associated with such pathologies. The success of DBS procedures is directly related to the proper placement of the electrodes, which requires the ability to accurately detect and identify relevant target structures within the subcortical basal ganglia region. In particular, accurate and reliable segmentation of the globus pallidus (GP) interna is of great interest for DBS surgery for PD and dystonia. In this study, we present a deep-learning based neural network, which we term GP-net, for the automatic segmentation of both the external and internal segments of the globus pallidus. High resolution 7 Tesla images from 101 subjects were used in this study; GP-net is trained on a cohort of 58 subjects, containing patients with movement disorders as well as healthy control subjects. GP-net performs 3D inference in a patient-specific manner, alleviating the need for atlas-based segmentation. GP-net was extensively validated, both quantitatively and qualitatively over 43 test subjects including patients with movement disorders and healthy control and is shown to consistently produce improved segmentation results compared with state-of-the-art atlas-based segmentations. We also demonstrate a postoperative lead location assessment with respect to a segmented globus pallidus obtained by GP-net.

Sparsity-based super-resolution microscopy from correlation information.

For more than a century, the wavelength of light was considered to be a fundamental limit on the spatial resolution of optical imaging. Particularly in light microscopy, this limit, known as Abbe's diffraction limit, places a fundamental constraint on the ability to image sub-cellular organelles with high resolution. However, modern microscopy techniques such as STED, PALM, and STORM, manage to recover sub-wavelength information, by relying on fluorescence imaging. Specifically, PALM/STORM acquire large sequences of fluorescence images from molecules attached to the organelles within the imaged specimen, such that in each frame only a small set of fluorophores are active. The position of each fluorophore can be found accurately in each frame, and the image is recovered by superimposing the points from all frames. The resulting grainy image is subsequently smoothed to produce the final super-resolved image with a resolution of tens of nano-meters. However, because PALM/STORM rely on many (>10,000) exposures, they suffer from poor temporal resolution. To address that, super-resolution optical fluctuation imaging (SOFI) was shown to produce sub-diffraction images with increased temporal resolution, by allowing for higher fluorophore density and exploiting the temporal statistics of the emissions. However, the improved temporal resolution of SOFI comes at the expense of its spatial resolution, which is not as high as that of PALM/STORM. Here, we present a new method called SPARCOM: sparsity-based super-resolution correlation microscopy, which combines a shorter integration time than previously reported with spatial resolution comparable to PALM and STORM. SPARCOM relies on sparsity in the correlation domain, exploiting the sparse distribution of fluorescent molecules and the lack of correlation between different emitters. We demonstrate our technique in simulations and in experiments and provide comparisons to state-of-the-art high density methods.

Sparsity-based super-resolution microscopy from correlation information: erratum.

Two references on sparse deconvolution of high-density fluorescence microscopy images are added to [Opt. Express26(14), 18238 (2018)].

Photoacoustic imaging beyond the acoustic diffraction-limit with dynamic speckle illumination and sparse joint support recovery.

In deep tissue photoacoustic imaging the spatial resolution is inherently limited by the acoustic wavelength. Recently, it was demonstrated that it is possible to surpass the acoustic diffraction limit by analyzing fluctuations in a set of photoacoustic images obtained under unknown speckle illumination patterns. Here, we purpose an approach to boost reconstruction fidelity and resolution, while reducing the number of acquired images by utilizing a compressed sensing computational reconstruction framework. The approach takes into account prior knowledge of the system response and sparsity of the target structure. We provide proof of principle experiments of the approach and demonstrate that improved performance is obtained when both speckle fluctuations and object priors are used. We numerically study the expected performance as a function of the measurement's signal to noise ratio and sample spatial-sparsity. The presented reconstruction framework can be applied to analyze existing photoacoustic experimental data sets containing dynamic fluctuations.

Motion robust magnetic resonance imaging via efficient Fourier aggregation.

We present a method for suppressing motion artifacts in anatomical magnetic resonance acquisitions. Our proposed technique, termed MOTOR-MRI, can recover and salvage images which are otherwise heavily corrupted by motion induced artifacts and blur which renders them unusable. Contrary to other techniques, MOTOR-MRI operates on the reconstructed images and not on k-space data. It relies on breaking the standard acquisition protocol into several shorter ones (while maintaining the same total acquisition time) and subsequent efficient aggregation in Fourier space of locally sharp and consistent information among them, producing a sharp and motion mitigated image. We demonstrate the efficacy of the technique on T2-weighted turbo spin echo magnetic resonance brain scans with severe motion corruption from both 3 T and 7 T scanners and show significant qualitative and quantitative improvement in image quality. MOTOR-MRI can operate independently, or in conjunction with additional motion correction methods.

Super-Resolution Ultrasound Localization Microscopy Through Deep Learning.

Ultrasound localization microscopy has enabled super-resolution vascular imaging through precise localization of individual ultrasound contrast agents (microbubbles) across numerous imaging frames. However, analysis of high-density regions with significant overlaps among the microbubble point spread responses yields high localization errors, constraining the technique to low-concentration conditions. As such, long acquisition times are required to sufficiently cover the vascular bed. In this work, we present a fast and precise method for obtaining super-resolution vascular images from high-density contrast-enhanced ultrasound imaging data. This method, which we term Deep Ultrasound Localization Microscopy (Deep-ULM), exploits modern deep learning strategies and employs a convolutional neural network to perform localization microscopy in dense scenarios, learning the nonlinear image-domain implications of overlapping RF signals originating from such sets of closely spaced microbubbles. Deep-ULM is trained effectively using realistic on-line synthesized data, enabling robust inference in-vivo under a wide variety of imaging conditions. We show that deep learning attains super-resolution with challenging contrast-agent densities, both in-silico as well as in-vivo. Deep-ULM is suitable for real-time applications, resolving about 70 high-resolution patches ( 128×128 pixels) per second on a standard PC. Exploiting GPU computation, this number increases to 1250 patches per second.

Deep Cerebellar Nuclei Segmentation via Semi-Supervised Deep Context-Aware Learning from 7T Diffusion MRI.

Deep cerebellar nuclei are a key structure of the cerebellum that are involved in processing motor and sensory information. It is thus a crucial step to accurately segment deep cerebellar nuclei for the understanding of the cerebellum system and its utility in deep brain stimulation treatment. However, it is challenging to clearly visualize such small nuclei under standard clinical magnetic resonance imaging (MRI) protocols and therefore precise segmentation is not feasible. Recent advances in 7 Tesla (T) MRI technology and great potential of deep neural networks facilitate automatic patient-specific segmentation. In this paper, we propose a novel deep learning framework (referred to as DCN-Net) for fast, accurate, and robust patient-specific segmentation of deep cerebellar dentate and interposed nuclei on 7T diffusion MRI. DCN-Net effectively encodes contextual information on the patch images without consecutive pooling operations and adding complexity via proposed dilated dense blocks. During the end-to-end training, label probabilities of dentate and interposed nuclei are independently learned with a hybrid loss, handling highly imbalanced data. Finally, we utilize self-training strategies to cope with the problem of limited labeled data. To this end, auxiliary dentate and interposed nuclei labels are created on unlabeled data by using DCN-Net trained on manual labels. We validate the proposed framework using 7T B0 MRIs from 60 subjects. Experimental results demonstrate that DCN-Net provides better segmentation than atlas-based deep cerebellar nuclei segmentation tools and other state-of-the-art deep neural networks in terms of accuracy and consistency. We further prove the effectiveness of the proposed components within DCN-Net in dentate and interposed nuclei segmentation.

Deep Unfolded Robust PCA With Application to Clutter Suppression in Ultrasound.

Contrast enhanced ultrasound is a radiation-free imaging modality which uses encapsulated gas microbubbles for improved visualization of the vascular bed deep within the tissue. It has recently been used to enable imaging with unprecedented subwavelength spatial resolution by relying on super-resolution techniques. A typical preprocessing step in super-resolution ultrasound is to separate the microbubble signal from the cluttering tissue signal. This step has a crucial impact on the final image quality. Here, we propose a new approach to clutter removal based on robust principle component analysis (PCA) and deep learning. We begin by modeling the acquired contrast enhanced ultrasound signal as a combination of low rank and sparse components. This model is used in robust PCA and was previously suggested in the context of ultrasound Doppler processing and dynamic magnetic resonance imaging. We then illustrate that an iterative algorithm based on this model exhibits improved separation of microbubble signal from the tissue signal over commonly practiced methods. Next, we apply the concept of deep unfolding to suggest a deep network architecture tailored to our clutter filtering problem which exhibits improved convergence speed and accuracy with respect to its iterative counterpart. We compare the performance of the suggested deep network on both simulations and in-vivo rat brain scans, with a commonly practiced deep-network architecture and with the fast iterative shrinkage algorithm. We show that our architecture exhibits better image quality and contrast.

Exploiting Flow Dynamics for Superresolution in Contrast-Enhanced Ultrasound.

Ultrasound (US) localization microscopy offers new radiation-free diagnostic tools for vascular imaging deep within the tissue. Sequential localization of echoes returned from inert microbubbles (MBs) with low concentration within the bloodstream reveals the vasculature with capillary resolution. Despite its high spatial resolution, low MB concentrations dictate the acquisition of tens of thousands of images, over the course of several seconds to tens of seconds, to produce a single superresolved image. Such long acquisition times and stringent constraints on MB concentration are undesirable in many clinical scenarios. To address these restrictions, sparsity-based approaches have recently been developed. These methods reduce the total acquisition time dramatically, while maintaining good spatial resolution in settings with considerable MB overlap. Here, we further improve the spatial resolution and visual vascular reconstruction quality of sparsity-based superresolution US imaging from low-frame rate acquisitions, by exploiting the inherent flow of MBs and utilize their motion kinematics. We also provide quantitative measurements of MB velocities and show that our approach achieves higher MB recall rate than the state-of-the-art techniques, while increasing contrast agents concentration. Our method relies on simultaneous tracking and sparsity-based detection of individual MBs in a frame-by-frame manner, and as such, may be suitable for real-time implementation. The effectiveness of the proposed approach is demonstrated on both simulations and an in vivo contrast-enhanced human prostate scan, acquired with a clinically approved scanner operating at a 10-Hz frame rate.

SUSHI: Sparsity-Based Ultrasound Super-Resolution Hemodynamic Imaging.

Identifying and visualizing vasculature within organs and tumors has major implications in managing cardiovascular diseases and cancer. Contrast-enhanced ultrasound scans detect slow-flowing blood, facilitating noninvasive perfusion measurements. However, their limited spatial resolution prevents the depiction of microvascular structures. Recently, super-localization ultrasonography techniques have surpassed this limit. However, they require long acquisition times of several minutes, preventing the detection of hemodynamic changes. We present a fast super-resolution method that exploits sparsity in the underlying vasculature and statistical independence within the measured signals. Similar to super-localization techniques, this approach improves the spatial resolution by up to an order of magnitude compared to standard scans. Unlike super-localization methods, it requires acquisition times of only tens of milliseconds. We demonstrate a temporal resolution of ~25 Hz, which may enable functional super-resolution imaging deep within the tissue, surpassing the temporal resolution limitations of current super-resolution methods, e.g., in neural imaging. The subsecond acquisitions make our approach robust to motion artifacts, simplifying in vivo use of super-resolution ultrasound.

Fast Vascular Ultrasound Imaging With Enhanced Spatial Resolution and Background Rejection.

Ultrasound super-localization microscopy techniques presented in the last few years enable non-invasive imaging of vascular structures at the capillary level by tracking the flow of ultrasound contrast agents (gas microbubbles). However, these techniques are currently limited by low temporal resolution and long acquisition times. Super-resolution optical fluctuation imaging (SOFI) is a fluorescence microscopy technique enabling sub-diffraction limit imaging with high temporal resolution by calculating high order statistics of the fluctuating optical signal. The aim of this work is to achieve fast acoustic imaging with enhanced resolution by applying the tools used in SOFI to contrast-enhance ultrasound (CEUS) plane-wave scans. The proposed method was tested using numerical simulations and evaluated using two in-vivo rabbit models: scans of healthy kidneys and VX-2 tumor xenografts. Improved spatial resolution was observed with a reduction of up to 50% in the full width half max of the point spread function. In addition, substantial reduction in the background level was achieved compared to standard mean amplitude persistence images, revealing small vascular structures within tumors. The scan duration of the proposed method is less than a second while current super-localization techniques require acquisition duration of several minutes. As a result, the proposed technique may be used to obtain scans with enhanced spatial resolution and high temporal resolution, facilitating flow-dynamics monitoring. Our method can also be applied during a breath-hold, reducing the sensitivity to motion artifacts.