Performance and clinical utility of an artificial intelligence-enabled tool for pulmonary embolism detection.

PURPOSE: Diagnosing pulmonary embolism (PE) is still challenging due to other conditions that can mimic its appearance, leading to incomplete or delayed management and several inter-observer variabilities. This study evaluated the performance and clinical utility of an artificial intelligence (AI)-based application designed to assist clinicians in the detection of PE on CT pulmonary angiography (CTPA). PATIENTS AND METHODS: CTPAs from 230 US cities acquired on 57 scanner models from 6 different vendors were retrospectively collected. Three US board certified expert radiologists defined the ground truth by majority agreement. The same cases were analyzed by CINA-PE, an AI-driven algorithm capable of detecting and highlighting suspected PE locations. The algorithm's performance at a per-case and per-finding level was evaluated. Furthermore, cases with PE not mentioned in the clinical report but correctly detected by the algorithm were analyzed. RESULTS: A total of 1204 CTPAs (mean age 62.1 years ± 16.6[SD], 44.4 % female, 14.9 % positive) were included in the study. Per-case sensitivity and specificity were 93.9 % (95%CI: 89.3 %-96.9 %) and 94.8 % (95%CI: 93.3 %-96.1 %), respectively. Per-finding positive predictive value was 89.5 % (95%CI: 86.7 %-91.9 %). Among the 196 positive cases, 29 (15.6 %) were not mentioned in the clinical report. The algorithm detected 22/29 (76 %) of these cases, leading to a reduction in the miss rate from 15.6 % to 3.8 % (7/186). CONCLUSIONS: The AI-based application may improve diagnostic accuracy in detecting PE and enhance patient outcomes through timely intervention. Integrating AI tools in clinical workflows can reduce missed or delayed diagnoses, and positively impact healthcare delivery and patient care.

Deep Learning-Based ASPECTS Algorithm Enhances Reader Performance and Reduces Interpretation Time.

BACKGROUND AND PURPOSE: ASPECTS is a long-standing and well documented selection criteria for acute ischemic stroke treatment, however, the interpretation of ASPECTS is a challenging and time-consuming task for physicians with significant interobserver variabilities. We conducted a multi-reader, multi-case study in which readers assessed ASPECTS without and with the support of a deep learning (DL)-based algorithm in order to analyze the impact of the software on clinicians' performance and interpretation time. MATERIALS AND METHODS: A total of 200 NCCT scans from 5 clinical sites (27 scanner models, 4 different vendors) were retrospectively collected. Reference standard was established through the consensus of three expert neuroradiologists who had access to baseline CTA and CTP data. Subsequently, eight additional clinicians (four typical ASPECTS reader and four senior neuroradiologists) analyzed the NCCT scans without and with the assistance of CINA-ASPECTS (Avicenna.AI, La Ciotat, France), a DLbased FDA-cleared and CE-marked algorithm designed to automatically compute ASPECTS. Differences were evaluated in both performance and interpretation time between the assisted and unassisted assessments. RESULTS: With software aid, readers demonstrated increased region-based accuracy from 72.4% to 76.5% (p<0.05), and increased ROC AUC from 0.749 to 0.788 (p<0.05). Notably, all readers exhibited an improved ROC AUC when utilizing the software. Moreover, use of the algorithm improved the score-based inter-observer reliability and correlation coefficient of ASPECTS evaluation by 0.222 and 0.087 (p<0.0001), respectively. Additionally, the readers' mean time spent analyzing a case was significantly reduced by 6% (p<0.05) when aided by the algorithm. CONCLUSIONS: With the assistance of the algorithm, readers' analyses were not only more accurate but also faster. Additionally, the overall ASPECTS evaluation exhibited greater consistency, less variabilities and higher precision compared to the reference standard. This novel tool has the potential to enhance patient selection for appropriate treatment by enabling physicians to deliver accurate and timely diagnosis of acute ischemic stroke. ABBREVIATIONS: ASPECTS = Alberta Stroke Program Early Computed Tomography Score; DL = Deep Learning; EIC = Early Ischemic Changes; ICC = Intraclass Correlation Coefficient; IS = Ischemic Stroke; ROC AUC = Receiver Operating Characteristics Area Under the Curve.

Diagnostic Performance of a Deep Learning-Powered Application for Aortic Dissection Triage Prioritization and Classification.

This multicenter retrospective study evaluated the diagnostic performance of a deep learning (DL)-based application for detecting, classifying, and highlighting suspected aortic dissections (ADs) on chest and thoraco-abdominal CT angiography (CTA) scans. CTA scans from over 200 U.S. and European cities acquired on 52 scanner models from six manufacturers were retrospectively collected and processed by CINA-CHEST (AD) (Avicenna.AI, La Ciotat, France) device. The diagnostic performance of the device was compared with the ground truth established by the majority agreement of three U.S. board-certified radiologists. Furthermore, the DL algorithm's time to notification was evaluated to demonstrate clinical effectiveness. The study included 1303 CTAs (mean age 58.8 ± 16.4 years old, 46.7% male, 10.5% positive). The device demonstrated a sensitivity of 94.2% [95% CI: 88.8-97.5%] and a specificity of 97.3% [95% CI: 96.2-98.1%]. The application classified positive cases by the AD type with an accuracy of 99.5% [95% CI: 98.9-99.8%] for type A and 97.5 [95% CI: 96.4-98.3%] for type B. The application did not miss any type A cases. The device flagged 32 cases incorrectly, primarily due to acquisition artefacts and aortic pathologies mimicking AD. The mean time to process and notify of potential AD cases was 27.9 ± 8.7 s. This deep learning-based application demonstrated a strong performance in detecting and classifying aortic dissection cases, potentially enabling faster triage of these urgent cases in clinical settings.

Deep Learning-Based Algorithm for Automatic Detection of Pulmonary Embolism in Chest CT Angiograms.

PURPOSE: Since the prompt recognition of acute pulmonary embolism (PE) and the immediate initiation of treatment can significantly reduce the risk of death, we developed a deep learning (DL)-based application aimed to automatically detect PEs on chest computed tomography angiograms (CTAs) and alert radiologists for an urgent interpretation. Convolutional neural networks (CNNs) were used to design the application. The associated algorithm used a hybrid 3D/2D UNet topology. The training phase was performed on datasets adequately distributed in terms of vendors, patient age, slice thickness, and kVp. The objective of this study was to validate the performance of the algorithm in detecting suspected PEs on CTAs. METHODS: The validation dataset included 387 anonymized real-world chest CTAs from multiple clinical sites (228 U.S. cities). The data were acquired on 41 different scanner models from five different scanner makers. The ground truth (presence or absence of PE on CTA images) was established by three independent U.S. board-certified radiologists. RESULTS: The algorithm correctly identified 170 of 186 exams positive for PE (sensitivity 91.4% [95% CI: 86.4-95.0%]) and 184 of 201 exams negative for PE (specificity 91.5% [95% CI: 86.8-95.0%]), leading to an accuracy of 91.5%. False negative cases were either chronic PEs or PEs at the limit of subsegmental arteries and close to partial volume effect artifacts. Most of the false positive findings were due to contrast agent-related fluid artifacts, pulmonary veins, and lymph nodes. CONCLUSIONS: The DL-based algorithm has a high degree of diagnostic accuracy with balanced sensitivity and specificity for the detection of PE on CTAs.