Performance and clinical utility of an artificial intelligence-enabled tool for pulmonary embolism detection.

PURPOSE: Diagnosing pulmonary embolism (PE) is still challenging due to other conditions that can mimic its appearance, leading to incomplete or delayed management and several inter-observer variabilities. This study evaluated the performance and clinical utility of an artificial intelligence (AI)-based application designed to assist clinicians in the detection of PE on CT pulmonary angiography (CTPA). PATIENTS AND METHODS: CTPAs from 230 US cities acquired on 57 scanner models from 6 different vendors were retrospectively collected. Three US board certified expert radiologists defined the ground truth by majority agreement. The same cases were analyzed by CINA-PE, an AI-driven algorithm capable of detecting and highlighting suspected PE locations. The algorithm's performance at a per-case and per-finding level was evaluated. Furthermore, cases with PE not mentioned in the clinical report but correctly detected by the algorithm were analyzed. RESULTS: A total of 1204 CTPAs (mean age 62.1 years ± 16.6[SD], 44.4 % female, 14.9 % positive) were included in the study. Per-case sensitivity and specificity were 93.9 % (95%CI: 89.3 %-96.9 %) and 94.8 % (95%CI: 93.3 %-96.1 %), respectively. Per-finding positive predictive value was 89.5 % (95%CI: 86.7 %-91.9 %). Among the 196 positive cases, 29 (15.6 %) were not mentioned in the clinical report. The algorithm detected 22/29 (76 %) of these cases, leading to a reduction in the miss rate from 15.6 % to 3.8 % (7/186). CONCLUSIONS: The AI-based application may improve diagnostic accuracy in detecting PE and enhance patient outcomes through timely intervention. Integrating AI tools in clinical workflows can reduce missed or delayed diagnoses, and positively impact healthcare delivery and patient care.

Deep Learning-Based ASPECTS Algorithm Enhances Reader Performance and Reduces Interpretation Time.

BACKGROUND AND PURPOSE: ASPECTS is a long-standing and well documented selection criteria for acute ischemic stroke treatment, however, the interpretation of ASPECTS is a challenging and time-consuming task for physicians with significant interobserver variabilities. We conducted a multi-reader, multi-case study in which readers assessed ASPECTS without and with the support of a deep learning (DL)-based algorithm in order to analyze the impact of the software on clinicians' performance and interpretation time. MATERIALS AND METHODS: A total of 200 NCCT scans from 5 clinical sites (27 scanner models, 4 different vendors) were retrospectively collected. Reference standard was established through the consensus of three expert neuroradiologists who had access to baseline CTA and CTP data. Subsequently, eight additional clinicians (four typical ASPECTS reader and four senior neuroradiologists) analyzed the NCCT scans without and with the assistance of CINA-ASPECTS (Avicenna.AI, La Ciotat, France), a DLbased FDA-cleared and CE-marked algorithm designed to automatically compute ASPECTS. Differences were evaluated in both performance and interpretation time between the assisted and unassisted assessments. RESULTS: With software aid, readers demonstrated increased region-based accuracy from 72.4% to 76.5% (p<0.05), and increased ROC AUC from 0.749 to 0.788 (p<0.05). Notably, all readers exhibited an improved ROC AUC when utilizing the software. Moreover, use of the algorithm improved the score-based inter-observer reliability and correlation coefficient of ASPECTS evaluation by 0.222 and 0.087 (p<0.0001), respectively. Additionally, the readers' mean time spent analyzing a case was significantly reduced by 6% (p<0.05) when aided by the algorithm. CONCLUSIONS: With the assistance of the algorithm, readers' analyses were not only more accurate but also faster. Additionally, the overall ASPECTS evaluation exhibited greater consistency, less variabilities and higher precision compared to the reference standard. This novel tool has the potential to enhance patient selection for appropriate treatment by enabling physicians to deliver accurate and timely diagnosis of acute ischemic stroke. ABBREVIATIONS: ASPECTS = Alberta Stroke Program Early Computed Tomography Score; DL = Deep Learning; EIC = Early Ischemic Changes; ICC = Intraclass Correlation Coefficient; IS = Ischemic Stroke; ROC AUC = Receiver Operating Characteristics Area Under the Curve.

Diagnostic Performance of a Deep Learning-Powered Application for Aortic Dissection Triage Prioritization and Classification.

This multicenter retrospective study evaluated the diagnostic performance of a deep learning (DL)-based application for detecting, classifying, and highlighting suspected aortic dissections (ADs) on chest and thoraco-abdominal CT angiography (CTA) scans. CTA scans from over 200 U.S. and European cities acquired on 52 scanner models from six manufacturers were retrospectively collected and processed by CINA-CHEST (AD) (Avicenna.AI, La Ciotat, France) device. The diagnostic performance of the device was compared with the ground truth established by the majority agreement of three U.S. board-certified radiologists. Furthermore, the DL algorithm's time to notification was evaluated to demonstrate clinical effectiveness. The study included 1303 CTAs (mean age 58.8 ± 16.4 years old, 46.7% male, 10.5% positive). The device demonstrated a sensitivity of 94.2% [95% CI: 88.8-97.5%] and a specificity of 97.3% [95% CI: 96.2-98.1%]. The application classified positive cases by the AD type with an accuracy of 99.5% [95% CI: 98.9-99.8%] for type A and 97.5 [95% CI: 96.4-98.3%] for type B. The application did not miss any type A cases. The device flagged 32 cases incorrectly, primarily due to acquisition artefacts and aortic pathologies mimicking AD. The mean time to process and notify of potential AD cases was 27.9 ± 8.7 s. This deep learning-based application demonstrated a strong performance in detecting and classifying aortic dissection cases, potentially enabling faster triage of these urgent cases in clinical settings.

Deep Learning-Based Algorithm for Automatic Detection of Pulmonary Embolism in Chest CT Angiograms.

PURPOSE: Since the prompt recognition of acute pulmonary embolism (PE) and the immediate initiation of treatment can significantly reduce the risk of death, we developed a deep learning (DL)-based application aimed to automatically detect PEs on chest computed tomography angiograms (CTAs) and alert radiologists for an urgent interpretation. Convolutional neural networks (CNNs) were used to design the application. The associated algorithm used a hybrid 3D/2D UNet topology. The training phase was performed on datasets adequately distributed in terms of vendors, patient age, slice thickness, and kVp. The objective of this study was to validate the performance of the algorithm in detecting suspected PEs on CTAs. METHODS: The validation dataset included 387 anonymized real-world chest CTAs from multiple clinical sites (228 U.S. cities). The data were acquired on 41 different scanner models from five different scanner makers. The ground truth (presence or absence of PE on CTA images) was established by three independent U.S. board-certified radiologists. RESULTS: The algorithm correctly identified 170 of 186 exams positive for PE (sensitivity 91.4% [95% CI: 86.4-95.0%]) and 184 of 201 exams negative for PE (specificity 91.5% [95% CI: 86.8-95.0%]), leading to an accuracy of 91.5%. False negative cases were either chronic PEs or PEs at the limit of subsegmental arteries and close to partial volume effect artifacts. Most of the false positive findings were due to contrast agent-related fluid artifacts, pulmonary veins, and lymph nodes. CONCLUSIONS: The DL-based algorithm has a high degree of diagnostic accuracy with balanced sensitivity and specificity for the detection of PE on CTAs.

Validation of a Deep Learning Tool in the Detection of Intracranial Hemorrhage and Large Vessel Occlusion.

Purpose: Recently developed machine-learning algorithms have demonstrated strong performance in the detection of intracranial hemorrhage (ICH) and large vessel occlusion (LVO). However, their generalizability is often limited by geographic bias of studies. The aim of this study was to validate a commercially available deep learning-based tool in the detection of both ICH and LVO across multiple hospital sites and vendors throughout the U.S. Materials and Methods: This was a retrospective and multicenter study using anonymized data from two institutions. Eight hundred fourteen non-contrast CT cases and 378 CT angiography cases were analyzed to evaluate ICH and LVO, respectively. The tool's ability to detect and quantify ICH, LVO, and their various subtypes was assessed among multiple CT vendors and hospitals across the United States. Ground truth was based off imaging interpretations from two board-certified neuroradiologists. Results: There were 255 positive and 559 negative ICH cases. Accuracy was 95.6%, sensitivity was 91.4%, and specificity was 97.5% for the ICH tool. ICH was further stratified into the following subtypes: intraparenchymal, intraventricular, epidural/subdural, and subarachnoid with true positive rates of 92.9, 100, 94.3, and 89.9%, respectively. ICH true positive rates by volume [small (<5 mL), medium (5-25 mL), and large (>25 mL)] were 71.8, 100, and 100%, respectively. There were 156 positive and 222 negative LVO cases. The LVO tool demonstrated an accuracy of 98.1%, sensitivity of 98.1%, and specificity of 98.2%. A subset of 55 randomly selected cases were also assessed for LVO detection at various sites, including the distal internal carotid artery, middle cerebral artery M1 segment, proximal middle cerebral artery M2 segment, and distal middle cerebral artery M2 segment with an accuracy of 97.0%, sensitivity of 94.3%, and specificity of 97.4%. Conclusion: Deep learning tools can be effective in the detection of both ICH and LVO across a wide variety of hospital systems. While some limitations were identified, specifically in the detection of small ICH and distal M2 occlusion, this study highlights a deep learning tool that can assist radiologists in the detection of emergent findings in a variety of practice settings.

Three-dimensional reconstructions for asymptomatic and cerebral palsy children's lower limbs using a biplanar X-ray system: a feasibility study.

The aim of this study is to explore the feasibility of 3D subject-specific skeletal reconstructions of lower limb in children using stereoradiography, and to assess uncertainty of clinical and anatomical parameters for children with cerebral palsy and for healthy children. The stereoradiography technique, using the EOS(®) system (Eos-imaging(®)), is based on the acquisition of two simultaneous digital anteroposterior and lateral X-rays, from head to feet in standing position and at low radiation dose. This technique allows subject-specific skeletal 3D reconstructions. Five children with cerebral palsy (CP) and 5 typically developing children (TD) were included in the study. Two operators performed the lower limb reconstructions twice. Tridimensional reconstructions were feasible for children over the age of 5 years. The study of reproducibility of anatomical parameters defining skeletal alignment showed uncertainties under 3° for the neck shaft angle, the femoral mechanical angle, and for the femoral and tibial torsions. The maximum degree of uncertainty was obtained for the femoral tibial rotation (4° for healthy children and 3.5° for children with CP).