Structure Correction for Robust Volume Segmentation in Presence of Tumors.

CNN based lung segmentation models in absence of diverse training dataset fail to segment lung volumes in presence of severe pathologies such as large masses, scars, and tumors. To rectify this problem, we propose a multi-stage algorithm for lung volume segmentation from CT scans. The algorithm uses a 3D CNN in the first stage to obtain a coarse segmentation of the left and right lungs. In the second stage, shape correction is performed on the segmentation mask using a 3D structure correction CNN. A novel data augmentation strategy is adopted to train a 3D CNN which helps in incorporating global shape prior. Finally, the shape corrected segmentation mask is up-sampled and refined using a parallel flood-fill operation. The proposed multi-stage algorithm is robust in the presence of large nodules/tumors and does not require labeled segmentation masks for entire pathological lung volume for training. Through extensive experiments conducted on publicly available datasets such as NSCLC, LUNA, and LOLA11 we demonstrate that the proposed approach improves the recall of large juxtapleural tumor voxels by at least 15% over state-of-the-art models without sacrificing segmentation accuracy in case of normal lungs. The proposed method also meets the requirement of CAD software by performing segmentation within 5 seconds which is significantly faster than present methods.

Patchwork reconstruction with resolution modeling for digital breast tomosynthesis.

PURPOSE: Digital breast tomosynthesis is a relatively new diagnostic x-ray modality that allows high resolution breast imaging while suppressing interference from overlapping anatomical structures. However, proper visualization of microcalcifications remains a challenge. For the subset of systems considered by the authors, the main cause of deterioration is movement of the x-ray source during exposures. They propose a modified grouped coordinate ascent algorithm that includes a specific acquisition model to compensate for this deterioration. METHODS: A resolution model based on the movement of the x-ray source during image acquisition is created and combined with a grouped coordinate ascent algorithm. Choosing planes parallel to the detector surface as the groups enables efficient implementation of the position dependent resolution model. In the current implementation, the resolution model is approximated by a Gaussian smoothing kernel. The effect of the resolution model on the iterative reconstruction is evaluated by measuring contrast to noise ratio (CNR) of spherical microcalcifications in a homogeneous background. After this, the new reconstruction method is compared to the optimized filtered backprojection method for the considered system, by performing two observer studies: the first study simulates clusters of spherical microcalcifications in a power law background for a free search task; the second study simulates smooth or irregular microcalcifications in the same type of backgrounds for a classification task. RESULTS: Including the resolution model in the iterative reconstruction methods increases the CNR of microcalcifications. The first observer study shows a significant improvement in detection of microcalcifications (p = 0.029), while the second study shows that performance on a classification task remains the same (p = 0.935) compared to the filtered backprojection method. CONCLUSIONS: The new method shows higher CNR and improved visualization of microcalcifications in an observer experiment on synthetic data. Further study of the negative results of the classification task showed performance variations throughout the volume linked to the changing noise structure introduced by the combination of the resolution model and the smoothing prior.

Data-driven breast decompression and lesion mapping from digital breast tomosynthesis.

Digital breast tomosynthesis (DBT) emerges as a new 3D modality for breast cancer screening and diagnosis. Like in conventional 2D mammography the breast is scanned in a compressed state. For orientation during surgical planning, e.g., during presurgical ultrasound-guided anchor-wire marking, as well as for improving communication between radiologists and surgeons it is desirable to estimate an uncompressed model of the acquired breast along with a spatial mapping that allows localizing lesions marked in DBT in the uncompressed model. We therefore propose a method for 3D breast decompression and associated lesion mapping from 3D DBT data. The method is entirely data-driven and employs machine learning methods to predict the shape of the uncompressed breast from a DBT input volume. For this purpose a shape space has been constructed from manually annotated uncompressed breast surfaces and shape parameters are predicted by multiple multi-variate Random Forest regression. By exploiting point correspondences between the compressed and uncompressed breasts, lesions identified in DBT can be mapped to approximately corresponding locations in the uncompressed breast model. To this end, a thin-plate spline mapping is employed. Our method features a novel completely data-driven approach to breast shape prediction that does not necessitate prior knowledge about biomechanical properties and parameters of the breast tissue. Instead, a particular deformation behavior (decompression) is learned from annotated shape pairs, compressed and uncompressed, which are obtained from DBT and magnetic resonance image volumes, respectively. On average, shape prediction takes 26s and achieves a surface distance of 15.80 +/- 4.70 mm. The mean localization error for lesion mapping is 22.48 +/- 8.67 mm.

Segmentation of pulmonary nodules of various densities with morphological approaches and convexity models.

Accurate segmentation of a pulmonary nodule is an important and active area of research in medical image processing. Although many algorithms have been reported in literature for this problem, those that are applicable to various density types have not been available until recently. In this paper, we propose a new algorithm that is applicable to solid, non-solid and part-solid types and solitary, vascularized, and juxtapleural types. First, the algorithm separates lung parenchyma and radiographically denser anatomical structures with coupled competition and diffusion processes. The technique tends to derive a spatially more homogeneous foreground map than an adaptive thresholding based method. Second, it locates the core of a nodule in a manner that is applicable to juxtapleural types using a transformation applied on the Euclidean distance transform of the foreground. Third, it detaches the nodule from attached structures by a region growing on the Euclidean distance map followed by a procedure to delineate the surface of the nodule based on the patterns of the region growing and distance maps. Finally, convex hull of the nodule surface intersected with the foreground constitutes the final segmentation. The performance of the technique is evaluated with two Lung Imaging Database Consortium (LIDC) data sets with 23 and 82 nodules each, and another data set with 820 nodules with manual diameter measurements. The experiments show that the algorithm is highly reliable in segmenting nodules of various types in a computationally efficient manner.

Computer-aided detection of colorectal polyps: can it improve sensitivity of less-experienced readers? Preliminary findings.

PURPOSE: To determine whether computer-aided detection (CAD) applied to computed tomographic (CT) colonography can help improve sensitivity of polyp detection by less-experienced radiologist readers, with colonoscopy or consensus used as the reference standard. MATERIALS AND METHODS: The release of the CT colonographic studies was approved by the individual institutional review boards of each institution. Institutions from the United States were HIPAA compliant. Written informed consent was waived at all institutions. The CT colonographic studies in 30 patients from six institutions were collected; 24 images depicted at least one confirmed polyp 6 mm or larger (39 total polyps) and six depicted no polyps. By using an investigational software package, seven less-experienced readers from two institutions evaluated the CT colonographic images and marked or scored polyps by using a five-point scale before and after CAD. The time needed to interpret the CT colonographic findings without CAD and then to re-evaluate them with CAD was recorded. For each reader, the McNemar test, adjusted for clustered data, was used to compare sensitivities for readers without and with CAD; a Wilcoxon signed-rank test was used to analyze the number of false-positive results per patient. RESULTS: The average sensitivity of the seven readers for polyp detection was significantly improved with CAD-from 0.810 to 0.908 (P=.0152). The number of false-positive results per patient without and with CAD increased from 0.70 to 0.96 (95% confidence interval for the increase: -0.39, 0.91). The mean total time for the readings was 17 minutes 54 seconds; for interpretation of CT colonographic findings alone, the mean time was 14 minutes 16 seconds; and for review of CAD findings, the mean time was 3 minutes 38 seconds. CONCLUSION: Results of this feasibility study suggest that CAD for CT colonography significantly improves per-polyp detection for less-experienced readers.

Symmetric curvature patterns for colonic polyp detection.

A novel approach for generating a set of features derived from properties of patterns of curvature is introduced as a part of a computer aided colonic polyp detection system. The resulting sensitivity was 84% with 4.8 false positives per volume on an independent test set of 72 patients (56 polyps). When used in conjunction with other features, it allowed the detection system to reach an overall sensitivity of 94% with a false positive rate of 4.3 per volume.

Support vector machines committee classification method for computer-aided polyp detection in CT colonography.

RATIONALE AND OBJECTIVES: A new classification scheme for the computer-aided detection of colonic polyps in computed tomographic colonography is proposed. MATERIALS AND METHODS: The scheme involves an ensemble of support vector machines (SVMs) for classification, a smoothed leave-one-out (SLOO) cross-validation method for obtaining error estimates, and use of a bootstrap aggregation method for training and model selection. Our use of an ensemble of SVM classifiers with bagging (bootstrap aggregation), built on different feature subsets, is intended to improve classification performance compared with single SVMs and reduce the number of false-positive detections. The bootstrap-based model-selection technique is used for tuning SVM parameters. In our first experiment, two independent data sets were used: the first, for feature and model selection, and the second, for testing to evaluate the generalizability of our model. In the second experiment, the test set that contained higher resolution data was used for training and testing (using the SLOO method) to compare SVM committee and single SVM performance. RESULTS: The overall sensitivity on independent test set was 75%, with 1.5 false-positive detections/study, compared with 76%-78% sensitivity and 4.5 false-positive detections/study estimated using the SLOO method on the training set. The sensitivity of the SVM ensemble retrained on the former test set estimated using the SLOO method was 81%, which is 7%-10% greater than the sensitivity of a single SVM. The number of false-positive detections per study was 2.6, a 1.5 times reduction compared with a single SVM. CONCLUSION: Training an SVM ensemble on one data set and testing it on the independent data has shown that the SVM committee classification method has good generalizability and achieves high sensitivity and a low false-positive rate. The model selection and improved error estimation method are effective for computer-aided polyp detection.

Multiple neural network classification scheme for detection of colonic polyps in CT colonography data sets.

RATIONALE AND OBJECTIVES: A new classification system for colonic polyp detection, designed to increase sensitivity and reduce the number of false-positive findings with computed tomographic colonography, was developed and tested in this study. MATERIALS AND METHODS: The system involves classification by a committee of neural networks (NNs), each using largely distinct subsets of features selected from a general set. Back-propagation NNs trained with the Levenberg-Marquardt algorithm were used as primary classifiers (committee members). The set of features included region density, Gaussian and mean curvature and sphericity, lesion size, colon wall thickness, and the means and standard deviations of all of these values. Subsets of variables were initially selected because of their effectiveness according to training and test sample misclassification rates. The final decision for each case is based on the majority vote across the networks and reflects the weighted votes of all networks. The authors also introduce a smoothed cross-validation method designed to improve estimation of the true misclassification rates by reducing bias and variance. RESULTS: This committee method reduced the false-positive rate by 36%, a clinically meaningful reduction, and improved sensitivity by an average of 6.9% compared with decisions made by any single NN. The overall sensitivity and specificity were 82.9% and 95.3%, respectively, when sensitivity was estimated by means of smoothed cross-validation. CONCLUSION: The proposed method of using multiple classifiers and majority voting is recommended for classification tasks with large sets of input features, particularly when selected feature subsets may not be equally effective and do not provide satisfactory true- and false-positive rates. This approach reduces variance in estimates of misclassification rates.

Computer-assisted detection of colonic polyps with CT colonography using neural networks and binary classification trees.

Detection of colonic polyps in CT colonography is problematic due to complexities of polyp shape and the surface of the normal colon. Published results indicate the feasibility of computer-aided detection of polyps but better classifiers are needed to improve specificity. In this paper we compare the classification results of two approaches: neural networks and recursive binary trees. As our starting point we collect surface geometry information from three-dimensional reconstruction of the colon, followed by a filter based on selected variables such as region density, Gaussian and average curvature and sphericity. The filter returns sites that are candidate polyps, based on earlier work using detection thresholds, to which the neural nets or the binary trees are applied. A data set of 39 polyps from 3 to 25 mm in size was used in our investigation. For both neural net and binary trees we use tenfold cross-validation to better estimate the true error rates. The backpropagation neural net with one hidden layer trained with Levenberg-Marquardt algorithm achieved the best results: sensitivity 90% and specificity 95% with 16 false positives per study.

Colonic polyps: complementary role of computer-aided detection in CT colonography.

PURPOSE: To apply a computer-aided detection (CAD) algorithm to supine and prone multisection helical computed tomographic (CT) colonographic images to confirm if there is any added benefit provided by CAD over that of standard clinical interpretation. MATERIALS AND METHODS: CT colonography (with patients in both supine and prone positions) was performed with a multisection helical CT scanner in 40 asymptomatic high-risk patients. There were two consecutive series of patients, 20 of whom had at least one polyp 1.0 cm in size or larger and 20 of whom had normal colons at conventional colonoscopy performed the same day. The CT colonographic images were interpreted with an automated CAD algorithm and by two radiologists who were blinded to colonoscopy findings. RESULTS: For 25 polyps at least 1.0 cm in size ("large" polyps), sensitivity for detection by at least one radiologist was 48% (12 of 25). The sensitivity of CAD for detecting large polyps was also 48% (12 of 25), but the CAD algorithm detected four of 13 large polyps that were not detected by either radiologist (31%, 95% two-sided CI: 9, 61), increasing the potential sensitivity to 64% (16 of 25). For polyps identifiable retrospectively, sensitivity of CAD was 67% (12 of 18), and sensitivity of the combination of detection with the CAD algorithm or by at least one radiologist was 89% (16 of 18). There were an average of 11 false-positive detections per patient for CAD. CONCLUSION: In this series of patients in whom radiologists had difficulties detecting polyps (compared with sensitivities of 75%-90% reported in the literature), this CAD algorithm played a complementary role to conventional interpretation of CT colonographic images by detecting a number of large polyps missed by trained observers.