Diagnostic Performance of a Deep Learning-Powered Application for Aortic Dissection Triage Prioritization and Classification.

This multicenter retrospective study evaluated the diagnostic performance of a deep learning (DL)-based application for detecting, classifying, and highlighting suspected aortic dissections (ADs) on chest and thoraco-abdominal CT angiography (CTA) scans. CTA scans from over 200 U.S. and European cities acquired on 52 scanner models from six manufacturers were retrospectively collected and processed by CINA-CHEST (AD) (Avicenna.AI, La Ciotat, France) device. The diagnostic performance of the device was compared with the ground truth established by the majority agreement of three U.S. board-certified radiologists. Furthermore, the DL algorithm's time to notification was evaluated to demonstrate clinical effectiveness. The study included 1303 CTAs (mean age 58.8 ± 16.4 years old, 46.7% male, 10.5% positive). The device demonstrated a sensitivity of 94.2% [95% CI: 88.8-97.5%] and a specificity of 97.3% [95% CI: 96.2-98.1%]. The application classified positive cases by the AD type with an accuracy of 99.5% [95% CI: 98.9-99.8%] for type A and 97.5 [95% CI: 96.4-98.3%] for type B. The application did not miss any type A cases. The device flagged 32 cases incorrectly, primarily due to acquisition artefacts and aortic pathologies mimicking AD. The mean time to process and notify of potential AD cases was 27.9 ± 8.7 s. This deep learning-based application demonstrated a strong performance in detecting and classifying aortic dissection cases, potentially enabling faster triage of these urgent cases in clinical settings.

Deep Learning-Based ASPECTS Algorithm Enhances Reader Performance and Reduces Interpretation Time.

BACKGROUND AND PURPOSE: ASPECTS is a long-standing and well documented selection criteria for acute ischemic stroke treatment, however, the interpretation of ASPECTS is a challenging and time-consuming task for physicians with significant interobserver variabilities. We conducted a multi-reader, multi-case study in which readers assessed ASPECTS without and with the support of a deep learning (DL)-based algorithm in order to analyze the impact of the software on clinicians' performance and interpretation time. MATERIALS AND METHODS: A total of 200 NCCT scans from 5 clinical sites (27 scanner models, 4 different vendors) were retrospectively collected. Reference standard was established through the consensus of three expert neuroradiologists who had access to baseline CTA and CTP data. Subsequently, eight additional clinicians (four typical ASPECTS reader and four senior neuroradiologists) analyzed the NCCT scans without and with the assistance of CINA-ASPECTS (Avicenna.AI, La Ciotat, France), a DLbased FDA-cleared and CE-marked algorithm designed to automatically compute ASPECTS. Differences were evaluated in both performance and interpretation time between the assisted and unassisted assessments. RESULTS: With software aid, readers demonstrated increased region-based accuracy from 72.4% to 76.5% (p<0.05), and increased ROC AUC from 0.749 to 0.788 (p<0.05). Notably, all readers exhibited an improved ROC AUC when utilizing the software. Moreover, use of the algorithm improved the score-based inter-observer reliability and correlation coefficient of ASPECTS evaluation by 0.222 and 0.087 (p<0.0001), respectively. Additionally, the readers' mean time spent analyzing a case was significantly reduced by 6% (p<0.05) when aided by the algorithm. CONCLUSIONS: With the assistance of the algorithm, readers' analyses were not only more accurate but also faster. Additionally, the overall ASPECTS evaluation exhibited greater consistency, less variabilities and higher precision compared to the reference standard. This novel tool has the potential to enhance patient selection for appropriate treatment by enabling physicians to deliver accurate and timely diagnosis of acute ischemic stroke. ABBREVIATIONS: ASPECTS = Alberta Stroke Program Early Computed Tomography Score; DL = Deep Learning; EIC = Early Ischemic Changes; ICC = Intraclass Correlation Coefficient; IS = Ischemic Stroke; ROC AUC = Receiver Operating Characteristics Area Under the Curve.

Performance and clinical utility of an artificial intelligence-enabled tool for pulmonary embolism detection.

PURPOSE: Diagnosing pulmonary embolism (PE) is still challenging due to other conditions that can mimic its appearance, leading to incomplete or delayed management and several inter-observer variabilities. This study evaluated the performance and clinical utility of an artificial intelligence (AI)-based application designed to assist clinicians in the detection of PE on CT pulmonary angiography (CTPA). PATIENTS AND METHODS: CTPAs from 230 US cities acquired on 57 scanner models from 6 different vendors were retrospectively collected. Three US board certified expert radiologists defined the ground truth by majority agreement. The same cases were analyzed by CINA-PE, an AI-driven algorithm capable of detecting and highlighting suspected PE locations. The algorithm's performance at a per-case and per-finding level was evaluated. Furthermore, cases with PE not mentioned in the clinical report but correctly detected by the algorithm were analyzed. RESULTS: A total of 1204 CTPAs (mean age 62.1 years ± 16.6[SD], 44.4 % female, 14.9 % positive) were included in the study. Per-case sensitivity and specificity were 93.9 % (95%CI: 89.3 %-96.9 %) and 94.8 % (95%CI: 93.3 %-96.1 %), respectively. Per-finding positive predictive value was 89.5 % (95%CI: 86.7 %-91.9 %). Among the 196 positive cases, 29 (15.6 %) were not mentioned in the clinical report. The algorithm detected 22/29 (76 %) of these cases, leading to a reduction in the miss rate from 15.6 % to 3.8 % (7/186). CONCLUSIONS: The AI-based application may improve diagnostic accuracy in detecting PE and enhance patient outcomes through timely intervention. Integrating AI tools in clinical workflows can reduce missed or delayed diagnoses, and positively impact healthcare delivery and patient care.

Clinical, Cultural, Computational, and Regulatory Considerations to Deploy AI in Radiology: Perspectives of RSNA and MICCAI Experts.

The Radiological Society of North of America (RSNA) and the Medical Image Computing and Computer Assisted Intervention (MICCAI) Society have led a series of joint panels and seminars focused on the present impact and future directions of artificial intelligence (AI) in radiology. These conversations have collected viewpoints from multidisciplinary experts in radiology, medical imaging, and machine learning on the current clinical penetration of AI technology in radiology and how it is impacted by trust, reproducibility, explainability, and accountability. The collective points-both practical and philosophical-define the cultural changes for radiologists and AI scientists working together and describe the challenges ahead for AI technologies to meet broad approval. This article presents the perspectives of experts from MICCAI and RSNA on the clinical, cultural, computational, and regulatory considerations-coupled with recommended reading materials-essential to adopt AI technology successfully in radiology and, more generally, in clinical practice. The report emphasizes the importance of collaboration to improve clinical deployment, highlights the need to integrate clinical and medical imaging data, and introduces strategies to ensure smooth and incentivized integration. Keywords: Adults and Pediatrics, Computer Applications-General (Informatics), Diagnosis, Prognosis © RSNA, 2024.

Artificial Intelligence Efficacy as a Function of Trainee Interpreter Proficiency: Lessons from a Randomized Controlled Trial.

BACKGROUND AND PURPOSE: Recently, artificial intelligence tools have been deployed with increasing speed in educational and clinical settings. However, the use of artificial intelligence by trainees across different levels of experience has not been well-studied. This study investigates the impact of artificial intelligence assistance on the diagnostic accuracy for intracranial hemorrhage and large-vessel occlusion by medical students and resident trainees. MATERIALS AND METHODS: This prospective study was conducted between March 2023 and October 2023. Medical students and resident trainees were asked to identify intracranial hemorrhage and large-vessel occlusion in 100 noncontrast head CTs and 100 head CTAs, respectively. One group received diagnostic aid simulating artificial intelligence for intracranial hemorrhage only (n = 26); the other, for large-vessel occlusion only (n = 28). Primary outcomes included accuracy, sensitivity, and specificity for intracranial hemorrhage/large-vessel occlusion detection without and with aid. Study interpretation time was a secondary outcome. Individual responses were pooled and analyzed with the t test; differences in continuous variables were assessed with ANOVA. RESULTS: Forty-eight participants completed the study, generating 10,779 intracranial hemorrhage or large-vessel occlusion interpretations. With diagnostic aid, medical student accuracy improved 11.0 points (P < .001) and resident trainee accuracy showed no significant change. Intracranial hemorrhage interpretation time increased with diagnostic aid for both groups (P < .001), while large-vessel occlusion interpretation time decreased for medical students (P < .001). Despite worse performance in the detection of the smallest-versus-largest hemorrhages at baseline, medical students were not more likely to accept a true-positive artificial intelligence result for these more difficult tasks. Both groups were considerably less accurate when disagreeing with the artificial intelligence or when supplied with an incorrect artificial intelligence result. CONCLUSIONS: This study demonstrated greater improvement in diagnostic accuracy with artificial intelligence for medical students compared with resident trainees. However, medical students were less likely than resident trainees to overrule incorrect artificial intelligence interpretations and were less accurate, even with diagnostic aid, than the artificial intelligence was by itself.

Deep Learning Approach for Differentiating Etiologies of Pediatric Retinal Hemorrhages: A Multicenter Study.

Retinal hemorrhages in pediatric patients can be a diagnostic challenge for ophthalmologists. These hemorrhages can occur due to various underlying etiologies, including abusive head trauma, accidental trauma, and medical conditions. Accurate identification of the etiology is crucial for appropriate management and legal considerations. In recent years, deep learning techniques have shown promise in assisting healthcare professionals in making more accurate and timely diagnosis of a variety of disorders. We explore the potential of deep learning approaches for differentiating etiologies of pediatric retinal hemorrhages. Our study, which spanned multiple centers, analyzed 898 images, resulting in a final dataset of 597 retinal hemorrhage fundus photos categorized into medical (49.9%) and trauma (50.1%) etiologies. Deep learning models, specifically those based on ResNet and transformer architectures, were applied; FastViT-SA12, a hybrid transformer model, achieved the highest accuracy (90.55%) and area under the receiver operating characteristic curve (AUC) of 90.55%, while ResNet18 secured the highest sensitivity value (96.77%) on an independent test dataset. The study highlighted areas for optimization in artificial intelligence (AI) models specifically for pediatric retinal hemorrhages. While AI proves valuable in diagnosing these hemorrhages, the expertise of medical professionals remains irreplaceable. Collaborative efforts between AI specialists and pediatric ophthalmologists are crucial to fully harness AI's potential in diagnosing etiologies of pediatric retinal hemorrhages.

Impact of an automated large vessel occlusion detection tool on clinical workflow and patient outcomes.

Purpose: Automated large vessel occlusion (LVO) tools allow for prompt identification of positive LVO cases, but little is known about their role in acute stroke triage when implemented in a real-world setting. The purpose of this study was to evaluate the automated LVO detection tool's impact on acute stroke workflow and clinical outcomes. Materials and methods: Consecutive patients with a computed tomography angiography (CTA) presenting with suspected acute ischemic stroke were compared before and after the implementation of an AI tool, RAPID LVO (RAPID 4.9, iSchemaView, Menlo Park, CA). Radiology CTA report turnaround times (TAT), door-to-treatment times, and the NIH stroke scale (NIHSS) after treatment were evaluated. Results: A total of 439 cases in the pre-AI group and 321 cases in the post-AI group were included, with 62 (14.12%) and 43 (13.40%) cases, respectively, receiving acute therapies. The AI tool demonstrated a sensitivity of 0.96, a specificity of 0.85, a negative predictive value of 0.99, and a positive predictive value of 0.53. Radiology CTA report TAT significantly improved post-AI (mean 30.58 min for pre-AI vs. 22 min for post-AI, p < 0.0005), notably at the resident level (p < 0.0003) but not at higher levels of expertise. There were no differences in door-to-treatment times, but the NIHSS at discharge was improved for the pre-AI group adjusted for confounders (parameter estimate = 3.97, p < 0.01). Conclusion: Implementation of an automated LVO detection tool improved radiology TAT but did not translate to improved stroke metrics and outcomes in a real-world setting.

Artificial Intelligence for Improved Hepatosplenomegaly Diagnosis.

Hepatosplenomegaly is commonly diagnosed by radiologists based on single dimension measurements and heuristic cut-offs. Volumetric measurements may be more accurate for diagnosing organ enlargement. Artificial intelligence techniques may be able to automatically calculate liver and spleen volume and facilitate more accurate diagnosis. After IRB approval, 2 convolutional neural networks (CNN) were developed to automatically segment the liver and spleen on a training dataset comprised of 500 single-phase, contrast-enhanced CT abdomen and pelvis examinations. A separate dataset of ten thousand sequential examinations at a single institution was segmented with these CNNs. Performance was evaluated on a 1% subset and compared with manual segmentations using Sorensen-Dice coefficients and Pearson correlation coefficients. Radiologist reports were reviewed for diagnosis of hepatomegaly and splenomegaly and compared with calculated volumes. Abnormal enlargement was defined as greater than 2 standard deviations above the mean. Median Dice coefficients for liver and spleen segmentation were 0.988 and 0.981, respectively. Pearson correlation coefficients of CNN-derived estimates of organ volume against the gold-standard manual annotation were 0.999 for the liver and spleen (P < 0.001). Average liver volume was 1556.8 ± 498.7 cc and average spleen volume was 194.6 ± 123.0 cc. There were significant differences in average liver and spleen volumes between male and female patients. Thus, the volume thresholds for ground-truth determination of hepatomegaly and splenomegaly were determined separately for each sex. Radiologist classification of hepatomegaly was 65% sensitive, 91% specific, with a positive predictive value (PPV) of 23% and an negative predictive value (NPV) of 98%. Radiologist classification of splenomegaly was 68% sensitive, 97% specific, with a positive predictive value (PPV) of 50% and a negative predictive value (NPV) of 99%. Convolutional neural networks can accurately segment the liver and spleen and may be helpful to improve radiologist accuracy in the diagnosis of hepatomegaly and splenomegaly.

Deep Learning-Based Algorithm for Automatic Detection of Pulmonary Embolism in Chest CT Angiograms.

PURPOSE: Since the prompt recognition of acute pulmonary embolism (PE) and the immediate initiation of treatment can significantly reduce the risk of death, we developed a deep learning (DL)-based application aimed to automatically detect PEs on chest computed tomography angiograms (CTAs) and alert radiologists for an urgent interpretation. Convolutional neural networks (CNNs) were used to design the application. The associated algorithm used a hybrid 3D/2D UNet topology. The training phase was performed on datasets adequately distributed in terms of vendors, patient age, slice thickness, and kVp. The objective of this study was to validate the performance of the algorithm in detecting suspected PEs on CTAs. METHODS: The validation dataset included 387 anonymized real-world chest CTAs from multiple clinical sites (228 U.S. cities). The data were acquired on 41 different scanner models from five different scanner makers. The ground truth (presence or absence of PE on CTA images) was established by three independent U.S. board-certified radiologists. RESULTS: The algorithm correctly identified 170 of 186 exams positive for PE (sensitivity 91.4% [95% CI: 86.4-95.0%]) and 184 of 201 exams negative for PE (specificity 91.5% [95% CI: 86.8-95.0%]), leading to an accuracy of 91.5%. False negative cases were either chronic PEs or PEs at the limit of subsegmental arteries and close to partial volume effect artifacts. Most of the false positive findings were due to contrast agent-related fluid artifacts, pulmonary veins, and lymph nodes. CONCLUSIONS: The DL-based algorithm has a high degree of diagnostic accuracy with balanced sensitivity and specificity for the detection of PE on CTAs.

Automated detection of IVC filters on radiographs with deep convolutional neural networks.

PURPOSE: To create an algorithm able to accurately detect IVC filters on radiographs without human assistance, capable of being used to screen radiographs to identify patients needing IVC filter retrieval. METHODS: A primary dataset of 5225 images, 30% of which included IVC filters, was assembled and annotated. 85% of the data was used to train a Cascade R-CNN (Region Based Convolutional Neural Network) object detection network incorporating a pre-trained ResNet-50 backbone. The remaining 15% of the data, independently annotated by three radiologists, was used as a test set to assess performance. The algorithm was also assessed on an independently constructed 1424-image dataset, drawn from a different institution than the primary dataset. RESULTS: On the primary test set, the algorithm achieved a sensitivity of 96.2% (95% CI 92.7-98.1%) and a specificity of 98.9% (95% CI 97.4-99.5%). Results were similar on the external test set: sensitivity 97.9% (95% CI 96.2-98.9%), specificity 99.6 (95% CI 98.9-99.9%). CONCLUSION: Fully automated detection of IVC filters on radiographs with high sensitivity and excellent specificity required for an automated screening system can be achieved using object detection neural networks. Further work will develop a system for identifying patients for IVC filter retrieval based on this algorithm.

Diagnostic Roots Radiofrequency Sensory Stimulation Looking for Symptomatic Injured Roots in Multiple Lumbar Stenosis.

Objective: We present how to perform radiofrequency sensory stimulation (RFSS) and whether RFSS could be helpful in identifying symptomatic injured roots in multilevel lumbar stenosis. Methods: Consecutive patients who underwent RFSS from 2010 to 2012 were enrolled. To identify pathologic lesions, RFSS was performed for suspicious roots, as determined using lumbar magnetic resonance imaging (MRI). The RFSS procedure resembled transforaminal root block. During RFSS of the suspicious root, patients could indicate whether stimulation induced their usual pain and/or sensory changes and could indicate whether the same leg area was affected. The number of possible symptomatic roots on MRI was evaluated before and after RFSS. Based on the RFSS results, we confirmed the presence of symptomatic nerve root(s) and performed surgical decompression. Surgical results, such as numeric rating scale (NRS) scores for low back pain (LBP) and leg pain (LP), and Oswestry disability index (ODI), were evaluated. Results: Ten patients were enrolled in the study. Their mean age was 70.1±9.7 years. Clinically, NRS-LBP, NRS-LP, and ODI before surgery were 5.1%, 7.5%, and 53.2%, respectively. The mean number of suspicious roots was 2.6±0.8. After RFSS, the mean number of symptomatic roots was 1.6±1.0. On average, 1.4 lumbar segments were decompressed. The follow-up period was 35.3±12.8 months. At the last follow-up, NRS-LBP, NRS-LP, and ODI were 3.1%, 1.5%, and 35.3%, respectively. There was no recurrence or need for further surgical treatment for lumbar stenosis. Conclusion: RFSS is a potentially helpful diagnostic tool for verifying and localizing symptomatic injured root lesions, particularly in patients with multilevel spinal stenosis.

Head-to-head comparison of commercial artificial intelligence solutions for detection of large vessel occlusion at a comprehensive stroke center.

Purpose: Despite the availability of commercial artificial intelligence (AI) tools for large vessel occlusion (LVO) detection, there is paucity of data comparing traditional machine learning and deep learning solutions in a real-world setting. The purpose of this study is to compare and validate the performance of two AI-based tools (RAPID LVO and CINA LVO) for LVO detection. Materials and methods: This was a retrospective, single center study performed at a comprehensive stroke center from December 2020 to June 2021. CT angiography (n = 263) for suspected stroke were evaluated for LVO. RAPID LVO is a traditional machine learning model which primarily relies on vessel density threshold assessment, while CINA LVO is an end-to-end deep learning tool implemented with multiple neural networks for detection and localization tasks. Reasons for errors were also recorded. Results: There were 29 positive and 224 negative LVO cases by ground truth assessment. RAPID LVO demonstrated an accuracy of 0.86, sensitivity of 0.90, specificity of 0.86, positive predictive value of 0.45, and negative predictive value of 0.98, while CINA demonstrated an accuracy of 0.96, sensitivity of 0.76, specificity of 0.98, positive predictive value of 0.85, and negative predictive value of 0.97. Conclusion: Both tools successfully detected most anterior circulation occlusions. RAPID LVO had higher sensitivity while CINA LVO had higher accuracy and specificity. Interestingly, both tools were able to detect some, but not all M2 MCA occlusions. This is the first study to compare traditional and deep learning LVO tools in the clinical setting.

Histologic Screening of Malignant Melanoma, Spitz, Dermal and Junctional Melanocytic Nevi Using a Deep Learning Model.

OBJECTIVE: The integration of an artificial intelligence tool into pathologists' workflow may lead to a more accurate and timely diagnosis of melanocytic lesions, directly patient care. The objective of this study was to create and evaluate the performance of such a model in achieving clinical-grade diagnoses of Spitz nevi, dermal and junctional melanocytic nevi, and melanomas. METHODS: We created a beginner-level training environment by teaching our algorithm to perform cytologic inferences on 136,216 manually annotated tiles of hematoxylin and eosin-stained slides consisting of unequivocal melanocytic nevi, Spitz nevi, and invasive melanoma cases. We sequentially trained and tested our network to provide a final diagnosis-classification on 39 cases in total. Positive predictive value (precision) and sensitivity (recall) were used to measure our performance. RESULTS: The tile-classification algorithm predicted the 136,216 irrelevant, melanoma, melanocytic nevi, and Spitz nevi tiles at sensitivities of 96%, 93%, 94% and 73%, respectively. The final trained model was able to correctly classify and predict the correct diagnosis in 85.7% of unseen cases (n = 28), reporting at or near screening-level performances for precision and recall of melanoma (76.2%, 100.0%), melanocytic nevi (100.0%, 75.0%), and Spitz nevi (100.0%, 75.0%). CONCLUSIONS: Our pilot study proves that convolutional networks trained on cellular morphology to classify melanocytic proliferations can be used as a powerful tool to assist pathologists in screening for melanoma versus other benign lesions.

Point-of-Care Brain MRI: Preliminary Results from a Single-Center Retrospective Study.

Background Point-of-care (POC) MRI is a bedside imaging technology with fewer than five units in clinical use in the United States and a paucity of scientific studies on clinical applications. Purpose To evaluate the clinical and operational impacts of deploying POC MRI in emergency department (ED) and intensive care unit (ICU) patient settings for bedside neuroimaging, including the turnaround time. Materials and Methods In this preliminary retrospective study, all patients in the ED and ICU at a single academic medical center who underwent noncontrast brain MRI from January 2021 to June 2021 were investigated to determine the number of patients who underwent bedside POC MRI. Turnaround time, examination limitations, relevant findings, and potential CT and fixed MRI findings were recorded for patients who underwent POC MRI. Descriptive statistics were used to describe clinical variables. The Mann-Whitney U test was used to compare the turnaround time between POC MRI and fixed MRI examinations. Results Of 638 noncontrast brain MRI examinations, 36 POC MRI examinations were performed in 35 patients (median age, 66 years [IQR, 57-77 years]; 21 women), with one patient undergoing two POC MRI examinations. Of the 36 POC MRI examinations, 13 (36%) occurred in the ED and 23 (64%) in the ICU. There were 12 of 36 (33%) POC MRI examinations interpreted as negative, 14 of 36 (39%) with clinically significant imaging findings, and 10 of 36 (28%) deemed nondiagnostic for reasons such as patient motion. Of 23 diagnostic POC MRI examinations with comparison CT available, three (13%) demonstrated acute infarctions not apparent on CT scans. Of seven diagnostic POC MRI examinations with subsequent fixed MRI examinations, two (29%) demonstrated missed versus interval subcentimeter infarctions, while the remaining demonstrated no change. The median turnaround time of POC MRI was 3.4 hours in the ED and 5.3 hours in the ICU. Conclusion Point-of-care (POC) MRI was performed rapidly in the emergency department and intensive care unit. A few POC MRI examinations demonstrated acute infarctions not apparent at standard-of-care CT examinations. © RSNA, 2022 Online supplemental material is available for this article. See also the editorial by Anzai and Moy in this issue.

Artificial Intelligence Assessment of Renal Scarring (AIRS Study).

Background: The goal of the Artificial Intelligence in Renal Scarring (AIRS) study is to develop machine learning tools for noninvasive quantification of kidney fibrosis from imaging scans. Methods: We conducted a retrospective analysis of patients who had one or more abdominal computed tomography (CT) scans within 6 months of a kidney biopsy. The final cohort encompassed 152 CT scans from 92 patients, which included images of 300 native kidneys and 76 transplant kidneys. Two different convolutional neural networks (slice-level and voxel-level classifiers) were tested to differentiate severe versus mild/moderate kidney fibrosis (≥50% versus <50%). Interstitial fibrosis and tubular atrophy scores from kidney biopsy reports were used as ground-truth. Results: The two machine learning models demonstrated similar positive predictive value (0.886 versus 0.935) and accuracy (0.831 versus 0.879). Conclusions: In summary, machine learning algorithms are a promising noninvasive diagnostic tool to quantify kidney fibrosis from CT scans. The clinical utility of these prediction tools, in terms of avoiding renal biopsy and associated bleeding risks in patients with severe fibrosis, remains to be validated in prospective clinical trials.

Validation of a Deep Learning Tool in the Detection of Intracranial Hemorrhage and Large Vessel Occlusion.

Purpose: Recently developed machine-learning algorithms have demonstrated strong performance in the detection of intracranial hemorrhage (ICH) and large vessel occlusion (LVO). However, their generalizability is often limited by geographic bias of studies. The aim of this study was to validate a commercially available deep learning-based tool in the detection of both ICH and LVO across multiple hospital sites and vendors throughout the U.S. Materials and Methods: This was a retrospective and multicenter study using anonymized data from two institutions. Eight hundred fourteen non-contrast CT cases and 378 CT angiography cases were analyzed to evaluate ICH and LVO, respectively. The tool's ability to detect and quantify ICH, LVO, and their various subtypes was assessed among multiple CT vendors and hospitals across the United States. Ground truth was based off imaging interpretations from two board-certified neuroradiologists. Results: There were 255 positive and 559 negative ICH cases. Accuracy was 95.6%, sensitivity was 91.4%, and specificity was 97.5% for the ICH tool. ICH was further stratified into the following subtypes: intraparenchymal, intraventricular, epidural/subdural, and subarachnoid with true positive rates of 92.9, 100, 94.3, and 89.9%, respectively. ICH true positive rates by volume [small (<5 mL), medium (5-25 mL), and large (>25 mL)] were 71.8, 100, and 100%, respectively. There were 156 positive and 222 negative LVO cases. The LVO tool demonstrated an accuracy of 98.1%, sensitivity of 98.1%, and specificity of 98.2%. A subset of 55 randomly selected cases were also assessed for LVO detection at various sites, including the distal internal carotid artery, middle cerebral artery M1 segment, proximal middle cerebral artery M2 segment, and distal middle cerebral artery M2 segment with an accuracy of 97.0%, sensitivity of 94.3%, and specificity of 97.4%. Conclusion: Deep learning tools can be effective in the detection of both ICH and LVO across a wide variety of hospital systems. While some limitations were identified, specifically in the detection of small ICH and distal M2 occlusion, this study highlights a deep learning tool that can assist radiologists in the detection of emergent findings in a variety of practice settings.

Identification and Localization of Endotracheal Tube on Chest Radiographs Using a Cascaded Convolutional Neural Network Approach.

Rapid and accurate assessment of endotracheal tube (ETT) location is essential in the intensive care unit (ICU) setting, where timely identification of a mispositioned support device may prevent significant patient morbidity and mortality. This study proposes a series of deep learning-based algorithms which together iteratively identify and localize the position of an ETT relative to the carina on chest radiographs. Using the open-source MIMIC Chest X-Ray (MIMIC-CXR) dataset, a total of 16,000 patients were identified (8000 patients with an ETT and 8000 patients without an ETT). Three different convolutional neural network (CNN) algorithms were created. First, a regression loss function CNN was trained to estimate the coordinate location of the carina, which was then used to crop the original radiograph to the distal trachea and proximal bronchi. Second, a classifier CNN was trained using the cropped inputs to determine the presence or absence of an ETT. Finally, for radiographs containing an ETT, a third regression CNN was trained to both refine the coordinate location of the carina and identify the location of the distal ETT tip. Model accuracy was assessed by comparing the absolute distance of prediction and ground-truth coordinates as well as CNN predictions relative to measurements documented in original radiologic reports. Upon five-fold cross validation, binary classification for the presence or absence of ETT demonstrated an accuracy, sensitivity, specificity, PPV, NPV, and AUC of 97.14%, 97.37%, 96.89%, 97.12%, 97.15%, and 99.58% respectively. CNN predicted coordinate location of the carina, and distal ETT tip was estimated within a median error of 0.46 cm and 0.60 cm from ground-truth annotations respectively. Overall final CNN assessment of distance between the carina and distal ETT tip was predicted within a median error of 0.60 cm from manual ground-truth annotations, and a median error of 0.66 cm from measurements documented in the original radiology reports. A serial cascaded CNN approach demonstrates high accuracy for both identification and localization of ETT tip and carina on chest radiographs. High performance of the proposed multi-step strategy is in part related to iterative refinement of coordinate localization as well as explicit image cropping which focuses algorithm attention to key anatomic regions of interest.

Outcomes of Artificial Intelligence Volumetric Assessment of Kidneys and Renal Tumors for Preoperative Assessment of Nephron-Sparing Interventions.

Background: Renal-cell carcinoma is the most common kidney cancer and the 13th most common cause of cancer death worldwide. Partial nephrectomy and percutaneous ablation, increasingly utilized to treat small renal masses and preserve renal parenchyma, require precise preoperative imaging interpretation. We sought to develop and evaluate a convolutional neural network (CNN), a type of deep learning (DL) artificial intelligence (AI), to act as a surgical planning aid by determining renal tumor and kidney volumes through segmentation on single-phase CT. Materials and Methods: After Institutional Review Board approval, the CT images of 319 patients were retrospectively analyzed. Two distinct CNNs were developed for (1) bounding cube localization of the right and left hemiabdomen and (2) segmentation of the renal parenchyma and tumor within each bounding cube. Training was performed on a randomly selected cohort of 269 patients. CNN performance was evaluated on a separate cohort of 50 patients using Sorensen-Dice coefficients (which measures the spatial overlap between the manually segmented and neural network-derived segmentations) and Pearson correlation coefficients. Experiments were run on a graphics processing unit-optimized workstation with a single NVIDIA GeForce GTX Titan X (12GB, Maxwell Architecture). Results: Median Dice coefficients for kidney and tumor segmentation were 0.970 and 0.816, respectively; Pearson correlation coefficients between CNN-generated and human-annotated estimates for kidney and tumor volume were 0.998 and 0.993 (p < 0.001), respectively. End-to-end trained CNNs were able to perform renal parenchyma and tumor segmentation on a new test case in an average of 5.6 seconds. Conclusions: Initial experience with automated DL AI demonstrates that it is capable of rapidly and accurately segmenting kidneys and renal tumors on single-phase contrast-enhanced CT scans and calculating tumor and renal volumes.