CT colonography: effect of computer-aided detection of colonic polyps as a second and concurrent reader for general radiologists with moderate experience in CT colonography.

OBJECTIVES: To assess the effectiveness of computer-aided detection (CAD) as a second reader or concurrent reader in helping radiologists who are moderately experienced in computed tomographic colonography (CTC) to detect colorectal polyps. METHODS: Seventy CTC datasets (34 patients: 66 polyps ≥6 mm; 36 patients: no abnormalities) were retrospectively reviewed by seven radiologists with moderate CTC experience. After primary unassisted evaluation, a CAD second read and, after a time interval of ≥4 weeks, a CAD concurrent read were performed. Areas under the receiver operating characteristic (ROC) curve (AUC), along with per-segment, per-polyp and per-patient sensitivities, and also reading times, were calculated for each reader with and without CAD. RESULTS: Of seven readers, 86% and 71% achieved a higher accuracy (segment-level AUC) when using CAD as second and concurrent reader respectively. Average segment-level AUCs with second and concurrent CAD (0.853 and 0.864) were significantly greater (p < 0.0001) than average AUC in the unaided evaluation (0.781). Per-segment, per-polyp, and per-patient sensitivities for polyps ≥6 mm were significantly higher in both CAD reading paradigms compared with unaided evaluation. Second-read CAD reduced readers' average segment and patient specificity by 0.007 and 0.036 (p = 0.005 and 0.011), respectively. CONCLUSIONS: CAD significantly improves the sensitivities of radiologists moderately experienced in CTC for polyp detection, both as second reader and concurrent reader. KEY POINTS: • CAD helps radiologists with moderate CTC experience to detect polyps ≥6 mm. • Second and concurrent read CAD increase the radiologist's sensitivity for detecting polyps ≥6 mm. • Second read CAD slightly decreases specificity compared with an unassisted read. • Concurrent read CAD is significantly more time-efficient than second read CAD.

Time-efficient CT colonography interpretation using an advanced image-gallery-based, computer-aided "first-reader" workflow for the detection of colorectal adenomas.

OBJECTIVES: To assess the performance of an advanced "first-reader" workflow for computer-aided detection (CAD) of colorectal adenomas ≥ 6 mm at computed tomographic colonography (CTC) in a low-prevalence cohort. METHODS: A total of 616 colonoscopy-validated CTC patient-datasets were retrospectively reviewed by a radiologist using a "first-reader" CAD workflow. CAD detections were presented as galleries of six automatically generated two-dimensional (2D) and three-dimensional (3D) images together with interactive 3D target views and 2D multiplanar views of the complete dataset. Each patient-dataset was interpreted by initially using CAD image-galleries followed by a fast 2D review to address unprompted colonic areas. Per-patient, per-polyp, and per-adenoma sensitivities were calculated for lesions ≥ 6 mm. Statistical testing employed Fisher's exact and McNemar tests. RESULTS: In 91/616 patients, 131 polyps (92 adenomas, 39 non-adenomas) ≥ 6 mm and two cancers were identified by reference standard. Using the CAD gallery-based first-reader workflow, the radiologist detected all adenomas ≥ 10 mm (34/34) and cancers. Per-patient and polyp sensitivities for lesions ≥ 6 mm were 84.3 % (75/89), and 83.2 % (109/131), respectively, with 89.1 % (57/64) and 85.9 % (79/92) for adenomas. Overall specificity was 95.6 % (504/527). Mean interpretation time was 3.1 min per patient. CONCLUSIONS: A CAD algorithm, applied in an image-gallery-based first-reader workflow, can substantially decrease reading times while enabling accurate detection of colorectal adenomas in a low-prevalence population. KEY POINTS: Computer-aided detection (CAD) is increasingly used to help interpret CT colonography (CTC). An image-gallery first-reader CAD-workflow is feasible for detection of colorectal adenomas ≥ 6 mm. Image-gallery first-reader CAD yields per-patient sensitivity of 89.1 % and specificity of 95.6 %. The mean reading time for CTC was 3.1 min, making screening feasible. No large adenoma was missed by the radiologist who reviewed with CAD galleries.

A fast algorithm for learning a ranking function from large-scale data sets.

We consider the problem of learning the ranking function that maximizes a generalization of the Wilcoxon-Mann-Whitney statistic on the training data. Relying on an $\epsilon$-accurate approximation for the error-function, we reduce the computational complexity of each iteration of a conjugate gradient algorithm for learning ranking functions from O(m2) to O(m2), where m is the number of training samples. Experiments on public benchmarks for ordinal regression and collaborative filtering indicate that the proposed algorithm is as accurate as the best available methods in terms of ranking accuracy, when the algorithms are trained on the same data. However, since it is several orders of magnitude faster than the current state-of-the-art approaches, it is able to leverage much larger training datasets.

Evaluation of computer-aided detection and diagnosis systems.

Computer-aided detection and diagnosis (CAD) systems are increasingly being used as an aid by clinicians for detection and interpretation of diseases. Computer-aided detection systems mark regions of an image that may reveal specific abnormalities and are used to alert clinicians to these regions during image interpretation. Computer-aided diagnosis systems provide an assessment of a disease using image-based information alone or in combination with other relevant diagnostic data and are used by clinicians as a decision support in developing their diagnoses. While CAD systems are commercially available, standardized approaches for evaluating and reporting their performance have not yet been fully formalized in the literature or in a standardization effort. This deficiency has led to difficulty in the comparison of CAD devices and in understanding how the reported performance might translate into clinical practice. To address these important issues, the American Association of Physicists in Medicine (AAPM) formed the Computer Aided Detection in Diagnostic Imaging Subcommittee (CADSC), in part, to develop recommendations on approaches for assessing CAD system performance. The purpose of this paper is to convey the opinions of the AAPM CADSC members and to stimulate the development of consensus approaches and "best practices" for evaluating CAD systems. Both the assessment of a standalone CAD system and the evaluation of the impact of CAD on end-users are discussed. It is hoped that awareness of these important evaluation elements and the CADSC recommendations will lead to further development of structured guidelines for CAD performance assessment. Proper assessment of CAD system performance is expected to increase the understanding of a CAD system's effectiveness and limitations, which is expected to stimulate further research and development efforts on CAD technologies, reduce problems due to improper use, and eventually improve the utility and efficacy of CAD in clinical practice.

Computer-aided detection of colorectal polyps in CT colonography with and without fecal tagging: a stand-alone evaluation.

PURPOSE: To evaluate the stand-alone performance of a computer-aided detection (CAD) algorithm for colorectal polyps in a large heterogeneous CT colonography (CTC) database that included both tagged and untagged datasets. METHODS: Written, informed consent was waived for this institutional review board-approved, HIPAA-compliant retrospective study. CTC datasets from 2063 patients were assigned to training (n = 374) and testing (n = 1689). The test set consisted of 836 untagged and 853 tagged examinations not used for CAD training. Examinations were performed at 15 sites in the United States, Asia, and Europe, using 4- to 64-multidetector-row computed tomography and various acquisition parameters. CAD sensitivities were calculated on a per-patient and per-polyp basis for polyps measuring ≥6 mm. The reference standard was colonoscopy in 1588 (94%) and consensus interpretation by expert radiologists in 101 (6%) patients. Statistical testing employed χ, logistic regression, and Mann-Whitney U tests. RESULTS: In 383 of 1689 individuals, 564 polyps measuring ≥6 mm were identified by the reference standard (347 polyps: 6-9 mm and 217 polyps: ≥10 mm). Overall, CAD per-patient sensitivity was 89.6% (343/383), with 89.0% (187/210) for untagged and 90.2% (156/173) for tagged datasets (P = 0.72). Overall, per-polyp sensitivity was 86.9% (490/564), with 84.4% (270/320) for untagged and 90.2% (220/244) for tagged examinations (P = 068). The mean false-positive rate per patient was 5.14 (median, 4) in untagged and 4.67 (median, 4) in tagged patient datasets (P = 0.353). CONCLUSION: Stand-alone CAD can be applied to both tagged and untagged CTC studies without significant performance differences. Detection rates are comparable to human readers at a relatively low false-positive rate, making CAD a useful tool in clinical practice.

Robust large scale prone-supine polyp matching using local features: a metric learning approach.

Computer aided detection (CAD) systems have emerged as noninvasive and effective tools, using 3D CT Colonography (CTC) for early detection of colonic polyps. In this paper, we propose a robust and automatic polyp prone-supine view matching method, to facilitate the regular CTC workflow where radiologists need to manually match the CAD findings in prone and supine CT scans for validation. Apart from previous colon registration approaches based on global geometric information, this paper presents a feature selection and metric distance learning approach to build a pairwise matching function (where true pairs of polyp detections have smaller distances than false pairs), learned using local polyp classification features. Thus our process can seamlessly handle collapsed colon segments or other severe structural artifacts which often exist in CTC, since only local features are used, whereas other global geometry dependent methods may become invalid for collapsed segmentation cases. Our automatic approach is extensively evaluated using a large multi-site dataset of 195 patient cases in training and 223 cases for testing. No external examination on the correctness of colon segmentation topology is needed. The results show that we achieve significantly superior matching accuracy than previous methods, on at least one order-of-magnitude larger CTC datasets.

Computerized classification of intraductal breast lesions using histopathological images.

In the diagnosis of preinvasive breast cancer, some of the intraductal proliferations pose a special challenge. The continuum of intraductal breast lesions includes the usual ductal hyperplasia (UDH), atypical ductal hyperplasia (ADH), and ductal carcinoma in situ (DCIS). The current standard of care is to perform percutaneous needle biopsies for diagnosis of palpable and image-detected breast abnormalities. UDH is considered benign and patients diagnosed UDH undergo routine follow-up, whereas ADH and DCIS are considered actionable and patients diagnosed with these two subtypes get additional surgical procedures. About 250,000 new cases of intraductal breast lesions are diagnosed every year. A conservative estimate would suggest that at least 50% of these patients are needlessly undergoing unnecessary surgeries. Thus, improvement in the diagnostic reproducibility and accuracy is critically important for effective clinical management of these patients. In this study, a prototype system for automatically classifying breast microscopic tissues to distinguish between UDH and actionable subtypes (ADH and DCIS) is introduced. This system automatically evaluates digitized slides of tissues for certain cytological criteria and classifies the tissues based on the quantitative features derived from the images. The system is trained using a total of 327 regions of interest (ROIs) collected across 62 patient cases and tested with a sequestered set of 149 ROIs collected across 33 patient cases. An overall accuracy of 87.9% is achieved on the entire test data. The test accuracy of 84.6% is obtained with borderline cases (26 of the 33 test cases) only, when compared against the diagnostic accuracies of nine pathologists on the same set (81.2% average), indicates that the system is highly competitive with the expert pathologists as a stand-alone diagnostic tool and has a great potential in improving diagnostic accuracy and reproducibility when used as a "second reader" in conjunction with the pathologists.

Extracting the frequencies of the pinna spectral notches in measured head related impulse responses.

The head related impulse response (HRIR) characterizes the auditory cues created by scattering of sound off a person's anatomy. The experimentally measured HRIR depends on several factors such as reflections from body parts (torso, shoulder, and knees), head diffraction, and reflection/ diffraction effects due to the pinna. Structural models (Algazi et al., 2002; Brown and Duda, 1998) seek to establish direct relationships between the features in the HRIR and the anatomy. While there is evidence that particular features in the HRIR can be explained by anthropometry, the creation of such models from experimental data is hampered by the fact that the extraction of the features in the HRIR is not automatic. One of the prominent features observed in the HRIR, and one that has been shown to be important for elevation perception, are the deep spectral notches attributed to the pinna. In this paper we propose a method to robustly extract the frequencies of the pinna spectral notches from the measured HRIR, distinguishing them from other confounding features. The method also extracts the resonances described by Shaw (1997). The techniques are applied to the publicly available CIPIC HRIR database (Algazi et al., 2001c). The extracted notch frequencies are related to the physical dimensions and shape of the pinna.