A benchmark for 2D foetal brain ultrasound analysis.

Brain development involves a sequence of structural changes from early stages of the embryo until several months after birth. Currently, ultrasound is the established technique for screening due to its ability to acquire dynamic images in real-time without radiation and to its cost-efficiency. However, identifying abnormalities remains challenging due to the difficulty in interpreting foetal brain images. In this work we present a set of 104 2D foetal brain ultrasound images acquired during the 20th week of gestation that have been co-registered to a common space from a rough skull segmentation. The images are provided both on the original space and template space centred on the ellipses of all the subjects. Furthermore, the images have been annotated to highlight landmark points from structures of interest to analyse brain development. Both the final atlas template with probabilistic maps and the original images can be used to develop new segmentation techniques, test registration approaches for foetal brain ultrasound, extend our work to longitudinal datasets and to detect anomalies in new images.

An Analysis of Loss Functions for Heavily Imbalanced Lesion Segmentation.

Heavily imbalanced datasets are common in lesion segmentation. Specifically, the lesions usually comprise less than 5% of the whole image volume when dealing with brain MRI. A common solution when training with a limited dataset is the use of specific loss functions that rebalance the effect of background and foreground voxels. These approaches are usually evaluated running a single cross-validation split without taking into account other possible random aspects that might affect the true improvement of the final metric (i.e., random weight initialisation or random shuffling). Furthermore, the evolution of the effect of the loss on the heavily imbalanced class is usually not analysed during the training phase. In this work, we present an analysis of different common loss metrics during training on public datasets dealing with brain lesion segmentation in heavy imbalanced datasets. In order to limit the effect of hyperparameter tuning and architecture, we chose a 3D Unet architecture due to its ability to provide good performance on different segmentation applications. We evaluated this framework on two public datasets and we observed that weighted losses have a similar performance on average, even though heavily weighting the gradient of the foreground class gives better performance in terms of true positive segmentation.

Analysis of UAV-Acquired Wetland Orthomosaics Using GIS, Computer Vision, Computational Topology and Deep Learning.

Invasive blueberry species endanger the sensitive environment of wetlands and protection laws call for management measures. Therefore, methods are needed to identify blueberry bushes, locate them, and characterise their distribution and properties with a minimum of disturbance. UAVs (Unmanned Aerial Vehicles) and image analysis have become important tools for classification and detection approaches. In this study, techniques, such as GIS (Geographical Information Systems) and deep learning, were combined in order to detect invasive blueberry species in wetland environments. Images that were collected by UAV were used to produce orthomosaics, which were analysed to produce maps of blueberry location, distribution, and spread in each study site, as well as bush height and area information. Deep learning networks were used with transfer learning and unfrozen weights in order to automatically detect blueberry bushes reaching True Positive Values (TPV) of 93.83% and an Overall Accuracy (OA) of 98.83%. A refinement of the result masks reached a Dice of 0.624. This study provides an efficient and effective methodology to study wetlands while using different techniques.

Breast MRI and X-ray mammography registration using gradient values.

Breast magnetic resonance imaging (MRI) and X-ray mammography are two image modalities widely used for early detection and diagnosis of breast diseases in women. The combination of these modalities, traditionally done using intensity-based registration algorithms, leads to a more accurate diagnosis and treatment, due to the capability of co-localizing lesions and susceptibles areas between the two image modalities. In this work, we present the first attempt to register breast MRI and X-ray mammographic images using intensity gradients as the similarity measure. Specifically, a patient-specific biomechanical model of the breast, extracted from the MRI image, is used to mimic the mammographic acquisition. The intensity gradients of the glandular tissue are directly projected from the 3D MRI volume to the 2D mammographic space, and two different gradient-based metrics are tested to lead the registration, the normalized cross-correlation of the scalar gradient values and the gradient correlation of the vectoral gradients. We compare these two approaches to an intensity-based algorithm, where the MRI volume is transformed to a synthetic computed tomography (pseudo-CT) image using the partial volume effect obtained by the glandular tissue segmentation performed by means of an Expectation-Maximization algorithm. This allows us to obtain the digitally reconstructed radiographies by a direct intensity projection. The best results are obtained using the scalar gradient approach along with a transversal isotropic material model, obtaining a target registration error (TRE), in millimeters, of 5.65 ±â€¯2.76 for CC- and of 7.83 ±â€¯3.04 for MLO-mammograms, while the TRE is 7.33 ±â€¯3.62 in the 3D MRI. We also evaluate the effect of the glandularity of the breast as well as the landmark position on the TRE, obtaining moderated correlation values (0.65 and 0.77 respectively), concluding that these aspects need to be considered to increase the accuracy in further approaches.

A step-by-step review on patient-specific biomechanical finite element models for breast MRI to x-ray mammography registration.

Breast magnetic resonance imaging (MRI) and x-ray mammography are two image modalities widely used for the early detection and diagnosis of breast diseases in women. The combination of these modalities leads to a more accurate diagnosis and treatment of breast diseases. The aim of this paper is to review the registration between breast MRI and x-ray mammographic images using patient-specific finite element-based biomechanical models. Specifically, a biomechanical model is obtained from the patient's MRI volume and is subsequently used to mimic the mammographic acquisition. Due to the different patient positioning and movement restrictions applied in each image modality, the finite element analysis provides a realistic physics-based approach to perform the breast deformation. In contrast with other reviews, we do not only expose the overall process of compression and registration but we also include main ideas, describe challenges, and provide an overview of the used software in each step of the process. Extracting an accurate description from the MR images and preserving the stability during the finite element analysis require an accurate knowledge about the algorithms used, as well as the software and underlying physics. The wide perspective offered makes the paper suitable not only for expert researchers but also for graduate students and clinicians. We also include several medical applications in the paper, with the aim to fill the gap between the engineering and clinical performance.

Multimodal Breast Parenchymal Patterns Correlation Using a Patient-Specific Biomechanical Model.

In this paper, we aim to produce a realistic 2-D projection of the breast parenchymal distribution from a 3-D breast magnetic resonance image (MRI). To evaluate the accuracy of our simulation, we compare our results with the local breast density (i.e., density map) obtained from the complementary full-field digital mammogram. To achieve this goal, we have developed a fully automatic framework, which registers MRI volumes to X-ray mammograms using a subject-specific biomechanical model of the breast. The optimization step modifies the position, orientation, and elastic parameters of the breast model to perform the alignment between the images. When the model reaches an optimal solution, the MRI glandular tissue is projected and compared with the one obtained from the corresponding mammograms. To reduce the loss of information during the ray-casting, we introduce a new approach that avoids resampling the MRI volume. In the results, we focus our efforts on evaluating the agreement of the distributions of glandular tissue, the degree of structural similarity, and the correlation between the real and synthetic density maps. Our approach obtained a high-structural agreement regardless the glandularity of the breast, whilst the similarity of the glandular tissue distributions and correlation between both images increase in denser breasts. Furthermore, the synthetic images show continuity with respect to large structures in the density maps.

Local breast density assessment using reacquired mammographic images.

PURPOSE: The aim of this paper is to evaluate the spatial glandular volumetric tissue distribution as well as the density measures provided by Volpara™ using a dataset composed of repeated pairs of mammograms, where each pair was acquired in a short time frame and in a slightly changed position of the breast. MATERIALS AND METHODS: We conducted a retrospective analysis of 99 pairs of repeatedly acquired full-field digital mammograms from 99 different patients. The commercial software Volpara™ Density Maps (Volpara Solutions, Wellington, New Zealand) is used to estimate both the global and the local glandular tissue distribution in each image. The global measures provided by Volpara™, such as breast volume, volume of glandular tissue, and volumetric breast density are compared between the two acquisitions. The evaluation of the local glandular information is performed using histogram similarity metrics, such as intersection and correlation, and local measures, such as statistics from the difference image and local gradient correlation measures. RESULTS: Global measures showed a high correlation (breast volume R=0.99, volume of glandular tissue R=0.94, and volumetric breast density R=0.96) regardless the anode/filter material. Similarly, histogram intersection and correlation metric showed that, for each pair, the images share a high degree of information. Regarding the local distribution of glandular tissue, small changes in the angle of view do not yield significant differences in the glandular pattern, whilst changes in the breast thickness between both acquisition affect the spatial parenchymal distribution. CONCLUSIONS: This study indicates that Volpara™ Density Maps is reliable in estimating the local glandular tissue distribution and can be used for its assessment and follow-up. Volpara™ Density Maps is robust to small variations of the acquisition angle and to the beam energy, although divergences arise due to different breast compression conditions.

Automated quality assessment in three-dimensional breast ultrasound images.

Automated three-dimensional breast ultrasound (ABUS) is a valuable adjunct to x-ray mammography for breast cancer screening of women with dense breasts. High image quality is essential for proper diagnostics and computer-aided detection. We propose an automated image quality assessment system for ABUS images that detects artifacts at the time of acquisition. Therefore, we study three aspects that can corrupt ABUS images: the nipple position relative to the rest of the breast, the shadow caused by the nipple, and the shape of the breast contour on the image. Image processing and machine learning algorithms are combined to detect these artifacts based on 368 clinical ABUS images that have been rated manually by two experienced clinicians. At a specificity of 0.99, 55% of the images that were rated as low quality are detected by the proposed algorithms. The areas under the ROC curves of the single classifiers are 0.99 for the nipple position, 0.84 for the nipple shadow, and 0.89 for the breast contour shape. The proposed algorithms work fast and reliably, which makes them adequate for online evaluation of image quality during acquisition. The presented concept may be extended to further image modalities and quality aspects.

A subtraction pipeline for automatic detection of new appearing multiple sclerosis lesions in longitudinal studies.

INTRODUCTION: Time-series analysis of magnetic resonance images (MRI) is of great value for multiple sclerosis (MS) diagnosis and follow-up. In this paper, we present an unsupervised subtraction approach which incorporates multisequence information to deal with the detection of new MS lesions in longitudinal studies. METHODS: The proposed pipeline for detecting new lesions consists of the following steps: skull stripping, bias field correction, histogram matching, registration, white matter masking, image subtraction, automated thresholding, and postprocessing. We also combine the results of PD-w and T2-w images to reduce false positive detections. RESULTS: Experimental tests are performed in 20 MS patients with two temporal studies separated 12 (12M) or 48 (48M) months in time. The pipeline achieves very good performance obtaining an overall sensitivity of 0.83 and 0.77 with a false discovery rate (FDR) of 0.14 and 0.18 for the 12M and 48M datasets, respectively. The most difficult situation for the pipeline is the detection of very small lesions where the obtained sensitivity is lower and the FDR higher. CONCLUSION: Our fully automated approach is robust and accurate, allowing detection of new appearing MS lesions. We believe that the pipeline can be applied to large collections of images and also be easily adapted to monitor other brain pathologies.

Intensity based methods for brain MRI longitudinal registration. A study on multiple sclerosis patients.

Registration is a key step in many automatic brain Magnetic Resonance Imaging (MRI) applications. In this work we focus on longitudinal registration of brain MRI for Multiple Sclerosis (MS) patients. First of all, we analyze the effect that MS lesions have on registration by synthetically eliminating some of the lesions. Our results show how a widely used method for longitudinal registration such as rigid registration is practically unconcerned by the presence of MS lesions while several non-rigid registration methods produce outputs that are significantly different. We then focus on assessing which is the best registration method for longitudinal MRI images of MS patients. In order to analyze the results obtained for all studied criteria, we use both descriptive statistics and statistical inference: one way ANOVA, pairwise t-tests and permutation tests.

Revisiting intensity-based image registration applied to mammography.

The detection of architectural distortions and abnormal structures in mammographic images can be based on the analysis of bilateral and temporal cases using image registration. This paper presents a quantitative evaluation of state-of-the art intensity based image registration methods applied to mammographic images. These methods range from a global and rigid transformation to local deformable paradigms using various metrics and multiresolution approaches. The aim of this study is to assess the suitability of these methods for mammographic image analysis. Evaluation using temporal cases based on quantitative analysis and a multiobserver study is presented which gives an indication of the accuracy and robustness of the different algorithms. Although previous studies suggested that local deformable methods were not suitable due to the generation of unrealistic distortions, in this work we show that local deformable paradigms (multiresolution B-Spline deformations) obtain the most accurate registration results.

Improving a CAD system using bilateral information.

Computer Aided Detection (CAD) mammographic systems are used in medicine to assist radiologists in the evaluation of mammographic images. The aim of this work is to compare the results of a developed single-image CAD system with a new one, dual-image CAD, that adds registration information of bilateral mammographic images in the training step of the former system. The evaluation of the different registration methods is performed using similarity measures. Receiver Operating Characteristic (ROC) analysis and Free Receiver Operating Characteristics (FROC) analysis are used to compare the results of both CAD systems. At a sensitivity of 80%, the false positives per image was 1.68 for the single-image CAD system and 0.90 for the dual-image CAD system. The results shows the benefits of integrating bilateral information into the CAD system.