The role of an artificial intelligence software in clinical senology: a mammography multi-reader study.

PURPOSE: To evaluate the diagnostic role of a dedicated AI software in detecting anomalous breast findings on mammography and tomosynthesis images in the clinical setting, stand-alone and as aid of four readers. METHODS: A total of 210 patients with complete clinical and radiologic records were retrospectively analyzed. Pathology was used as the reference standard for patients undergoing surgery or biopsy, and a 1-year follow-up was used to confirm no change in the remaining patients. The image evaluation was performed by four readers with different levels of experience (a junior and three senior breast radiologists) using a 5-point Likert scale moving from 1 (definitively no cancer) to 5 (definitively cancer). The positivity of mammograms was assessed on the presence of any breast lesion (masses, architectural distortions, asymmetries, calcifications), including malignant and benign ones. A multi-reader multi-case analysis was performed. A p value < 0.05 was considered statistically significant. RESULTS: The stand-alone AI system achieved an accuracy of 71% (69% sensitivity and 73% specificity), which is overall lower than the value achieved by readers without AI. However, with the aid of AI, a significant increase of accuracy (p value = 0.004) and specificity (p value = 0.04) was achieved for the less experienced radiologist and a senior one. CONCLUSION: The use of AI software as a second reader for breast lesions assessment could play a crucial role in the clinical setting, by increasing sensitivity and specificity, especially for less experienced radiologists.

Enhanced characterization of solid solitary pulmonary nodules with Bayesian analysis-based computer-aided diagnosis.

The aim of this study was to prospectively assess the accuracy gain of Bayesian analysis-based computer-aided diagnosis (CAD) vs human judgment alone in characterizing solitary pulmonary nodules (SPNs) at computed tomography (CT). The study included 100 randomly selected SPNs with a definitive diagnosis. Nodule features at first and follow-up CT scans as well as clinical data were evaluated individually on a 1 to 5 points risk chart by 7 radiologists, firstly blinded then aware of Bayesian Inference Malignancy Calculator (BIMC) model predictions. Raters' predictions were evaluated by means of receiver operating characteristic (ROC) curve analysis and decision analysis. Overall ROC area under the curve was 0.758 before and 0.803 after the disclosure of CAD predictions (P = 0.003). A net gain in diagnostic accuracy was found in 6 out of 7 readers. Mean risk class of benign nodules dropped from 2.48 to 2.29, while mean risk class of malignancies rose from 3.66 to 3.92. Awareness of CAD predictions also determined a significant drop on mean indeterminate SPNs (15 vs 23.86 SPNs) and raised the mean number of correct and confident diagnoses (mean 39.57 vs 25.71 SPNs). This study provides evidence supporting the integration of the Bayesian analysis-based BIMC model in SPN characterization.