Measurement Variability of Same-Day CT Quantification of Interstitial Lung Disease: A Multicenter Prospective Study.

Purpose To investigate quantitative CT (QCT) measurement variability in interstitial lung disease (ILD) on the basis of two same-day CT scans. Materials and Methods Participants with ILD were enrolled in this multicenter prospective study between March and October 2022. Participants underwent two same-day CT scans at an interval of a few minutes. Deep learning-based texture analysis software was used to segment ILD features. Fibrosis extent was defined as the sum of reticular opacity and honeycombing cysts. Measurement variability between scans was assessed with Bland-Altman analyses for absolute and relative differences with 95% limits of agreement (LOA). The contribution of fibrosis extent to variability was analyzed using a multivariable linear mixed-effects model while adjusting for lung volume. Eight readers assessed ILD fibrosis stability with and without QCT information for 30 randomly selected samples. Results Sixty-five participants were enrolled in this study (mean age, 68.7 years ± 10 [SD]; 47 [72%] men, 18 [28%] women). Between two same-day CT scans, the 95% LOA for the mean absolute and relative differences of quantitative fibrosis extent were -0.9% to 1.0% and -14.8% to 16.1%, respectively. However, these variabilities increased to 95% LOA of -11.3% to 3.9% and -123.1% to 18.4% between CT scans with different reconstruction parameters. Multivariable analysis showed that absolute differences were not associated with the baseline extent of fibrosis (P = .09), but the relative differences were negatively associated (ß = -0.252, P < .001). The QCT results increased readers' specificity in interpreting ILD fibrosis stability (91.7% vs 94.6%, P = .02). Conclusion The absolute QCT measurement variability of fibrosis extent in ILD was 1% in same-day CT scans. Keywords: CT, CT-Quantitative, Thorax, Lung, Lung Diseases, Interstitial, Pulmonary Fibrosis, Diagnosis, Computer Assisted, Diagnostic Imaging Supplemental material is available for this article. © RSNA, 2024.

Treatment Outcomes of Clofazimine-Containing Regimens in Severe Mycobacterium avium Complex Pulmonary Disease.

Background: Clofazimine is suggested as a promising drug for the treatment of nontuberculous mycobacterial pulmonary disease. However, the role of clofazimine in severe Mycobacterium avium complex pulmonary disease (MAC-PD) remains unclear. In this study, we investigated the treatment outcomes of patients with severe MAC-PD treated with regimens containing clofazimine. Methods: This study included patients diagnosed with severe MAC-PD at Seoul National University Hospital who underwent anti-mycobacterial treatment between 1 January 2011 and 31 December 2022. We assessed the rate of culture conversion within 6 months and microbiological cure in patients receiving clofazimine-containing regimens, considering the dose and duration of clofazimine administration. Results: A total of 170 patients with severe MAC-PD, treated with regimens containing clofazimine, were included in the analysis. The median age of patients was 68 years (interquartile range, 59-75 years), with a female predominance (n = 114 [67.1%]). Cavities were identified in 121 patients (71.2%). Within 6 months, 77 patients (45.3%) achieved culture conversion, and 84 of 154 (54.6%) patients attained microbiological cure. The dose of clofazimine (100 mg vs 50 mg) was not associated with culture conversion (adjusted odds ratio [aOR], 0.64 [95% confidence interval {CI}, .29-1.42]) or microbiological cure (aOR, 1.21 [95% CI, .52-2.81]). The microbiological cure rate reached 71.0% when clofazimine was administered for 6-12 months, compared to 23.1% when administered for <6 months. Conclusions: Clofazimine demonstrated a relatively favorable efficacy in severe MAC-PD, regardless of the maintenance dose. This effect was more pronounced when administered for a duration exceeding 6 months.

AI for Detection of Tuberculosis: Implications for Global Health.

Tuberculosis, which primarily affects developing countries, remains a significant global health concern. Since the 2010s, the role of chest radiography has expanded in tuberculosis triage and screening beyond its traditional complementary role in the diagnosis of tuberculosis. Computer-aided diagnosis (CAD) systems for tuberculosis detection on chest radiographs have recently made substantial progress in diagnostic performance, thanks to deep learning technologies. The current performance of CAD systems for tuberculosis has approximated that of human experts, presenting a potential solution to the shortage of human readers to interpret chest radiographs in low- or middle-income, high-tuberculosis-burden countries. This article provides a critical appraisal of developmental process reporting in extant CAD software for tuberculosis, based on the Checklist for Artificial Intelligence in Medical Imaging. It also explores several considerations to scale up CAD solutions, encompassing manufacturer-independent CAD validation, economic and political aspects, and ethical concerns, as well as the potential for broadening radiography-based diagnosis to other nontuberculosis diseases. Collectively, CAD for tuberculosis will emerge as a representative deep learning application, catalyzing advances in global health and health equity. Keywords: Computer-aided Diagnosis (CAD), Conventional Radiography, Thorax, Lung, Machine Learning Supplemental material is available for this article. © RSNA, 2024.

Deep Learning-Based Kernel Adaptation Enhances Quantification of Emphysema on Low-Dose Chest CT for Predicting Long-Term Mortality.

OBJECTIVES: The aim of this study was to ascertain the predictive value of quantifying emphysema using low-dose computed tomography (LDCT) post deep learning-based kernel adaptation on long-term mortality. MATERIALS AND METHODS: This retrospective study investigated LDCTs obtained from asymptomatic individuals aged 60 years or older during health checkups between February 2009 and December 2016. These LDCTs were reconstructed using a 1- or 1.25-mm slice thickness alongside high-frequency kernels. A deep learning algorithm, capable of generating CT images that resemble standard-dose and low-frequency kernel images, was applied to these LDCTs. To quantify emphysema, the lung volume percentage with an attenuation value less than or equal to -950 Hounsfield units (LAA-950) was gauged before and after kernel adaptation. Low-dose chest CTs with LAA-950 exceeding 6% were deemed emphysema-positive according to the Fleischner Society statement. Survival data were sourced from the National Registry Database at the close of 2021. The risk of nonaccidental death, excluding causes such as injury or poisoning, was explored according to the emphysema quantification results using multivariate Cox proportional hazards models. RESULTS: The study comprised 5178 participants (mean age ± SD, 66 ± 3 years; 3110 males). The median LAA-950 (18.2% vs 2.6%) and the proportion of LDCTs with LAA-950 exceeding 6% (96.3% vs 39.3%) saw a significant decline after kernel adaptation. There was no association between emphysema quantification before kernel adaptation and the risk of nonaccidental death. Nevertheless, after kernel adaptation, higher LAA-950 (hazards ratio for 1% increase, 1.01; P = 0.045) and LAA-950 exceeding 6% (hazards ratio, 1.36; P = 0.008) emerged as independent predictors of nonaccidental death, upon adjusting for age, sex, and smoking status. CONCLUSIONS: The application of deep learning for kernel adaptation proves instrumental in quantifying pulmonary emphysema on LDCTs, establishing itself as a potential predictive tool for long-term nonaccidental mortality in asymptomatic individuals.

Artificial Intelligence for Assessment of Endotracheal Tube Position on Chest Radiographs: Validation in Patients From Two Institutions.

BACKGROUND. Timely and accurate interpretation of chest radiographs obtained to evaluate endotracheal tube (ETT) position is important for facilitating prompt adjustment if needed. OBJECTIVE. The purpose of our study was to evaluate the performance of a deep learning (DL)-based artificial intelligence (AI) system for detecting ETT presence and position on chest radiographs in three patient samples from two different institutions. METHODS. This retrospective study included 539 chest radiographs obtained immediately after ETT insertion from January 1 to March 31, 2020, in 505 patients (293 men, 212 women; mean age, 63 years) from institution A (sample A); 637 chest radiographs obtained from January 1 to January 3, 2020, in 302 patients (157 men, 145 women; mean age, 66 years) in the ICU (with or without an ETT) from institution A (sample B); and 546 chest radiographs obtained from January 1 to January 20, 2020, in 83 patients (54 men, 29 women; mean age, 70 years) in the ICU (with or without an ETT) from institution B (sample C). A commercial DL-based AI system was used to identify ETT presence and measure ETT tip-to-carina distance (TCD). The reference standard for proper ETT position was TCD between greater than 3 cm and less than 7 cm, determined by human readers. Critical ETT position was separately defined as ETT tip below the carina or TCD of 1 cm or less. ROC analysis was performed. RESULTS. AI had sensitivity and specificity for identification of ETT presence of 100.0% and 98.7% (sample B) and 99.2% and 94.5% (sample C). AI had sensitivity and specificity for identification of improper ETT position of 72.5% and 92.0% (sample A), 78.9% and 100.0% (sample B), and 83.7% and 99.1% (sample C). At a threshold y-axis TCD of 2 cm or less, AI had sensitivity and specificity for critical ETT position of 100.0% and 96.7% (sample A), 100.0% and 100.0% (sample B), and 100.0% and 99.2% (sample C). CONCLUSION. AI identified improperly positioned ETTs on chest radiographs obtained after ETT insertion as well as on chest radiographs obtained of patients in the ICU at two institutions. CLINICAL IMPACT. Automated AI identification of improper ETT position on chest radiographs may allow earlier repositioning and thereby reduce complications.

Usual Interstitial Pneumonia: Associations With Complications After Percutaneous Transthoracic Needle Lung Biopsy.

BACKGROUND. Changes in lung parenchyma elasticity in usual interstitial pneumonia (UIP) may increase the risk for complications after percutaneous transthoracic needle biopsy (PTNB) of the lung. OBJECTIVE. The purpose of this article was to investigate the association of UIP findings on CT with complications after PTNB, including pneumothorax, pneumothorax requiring chest tube insertion, and hemoptysis. METHODS. This retrospective single-center study included 4187 patients (mean age, 63.8 ± 11.9 [SD] years; 2513 men, 1674 women) who underwent PTNB between January 2010 and December 2015. Patients were categorized into a UIP group and non-UIP group by review of preprocedural CT. In the UIP group, procedural CT images were reviewed to assess for traversal of UIP findings by needle. Multivariable logistic regression analyses were performed to identify associations between the UIP group and needle traversal with postbiopsy complications, controlling for a range of patient, lesion, and procedural characteristics. RESULTS. The UIP and non-UIP groups included 148 and 4039 patients, respectively; in the UIP group, traversal of UIP findings by needle was observed in 53 patients and not observed in 95 patients. The UIP group, in comparison with the non-UIP group, had a higher frequency of pneumothorax (35.1% vs 17.9%, p < .001) and pneumothorax requiring chest tube placement (6.1% vs 1.5%, p = .001) and lower frequency of hemoptysis (2.0% vs 6.1%, p = .03). In multivariable analyses, the UIP group with traversal of UIP findings by needle, relative to the non-UIP group, showed independent associations with pneumothorax (OR, 5.25; 95% CI, 2.94-9.37; p < .001) and pneumothorax requiring chest tube placement (OR, 9.55; 95% CI, 3.74-24.38; p < .001). The UIP group without traversal of UIP findings by needle, relative to the non-UIP group, was not independently associated with pneumothorax (OR, 1.18; 95% CI, 0.71-1.97; p = .51) or pneumothorax requiring chest tube placement (OR, 1.08; 95% CI, 0.25-4.72; p = .92). The UIP group, with or without traversal of UIP findings by needle, was not independently associated with hemoptysis. No patient experienced air embolism or procedure-related death. CONCLUSION. Needle traversal of UIP findings is a risk factor for pneumothorax and pneumothorax requiring chest tube placement after PTNB. CLINICAL IMPACT. When performing PTNB in patients with UIP, radiologists should plan a needle trajectory that does not traverse UIP findings, when possible.

Diagnostic performance and prognostic value of CT-defined visceral pleural invasion in early-stage lung adenocarcinomas.

OBJECTIVES: To analyze the diagnostic performance and prognostic value of CT-defined visceral pleural invasion (CT-VPI) in early-stage lung adenocarcinomas. METHODS: Among patients with clinical stage I lung adenocarcinomas, half of patients were randomly selected for a diagnostic study, in which five thoracic radiologists determined the presence of CT-VPI. Probabilities for CT-VPI were obtained using deep learning (DL). Areas under the receiver operating characteristic curve (AUCs) and binary diagnostic measures were calculated and compared. Inter-rater agreement was assessed. For all patients, the prognostic value of CT-VPI by two radiologists and DL (using high-sensitivity and high-specificity cutoffs) was investigated using Cox regression. RESULTS: In 681 patients (median age, 65 years [interquartile range, 58-71]; 382 women), pathologic VPI was positive in 130 patients. For the diagnostic study (n = 339), the pooled AUC of five radiologists was similar to that of DL (0.78 vs. 0.79; p = 0.76). The binary diagnostic performance of radiologists was variable (sensitivity, 45.3-71.9%; specificity, 71.6-88.7%). Inter-rater agreement was moderate (weighted Fleiss κ, 0.51; 95%CI: 0.43-0.55). For overall survival (n = 680), CT-VPI by radiologists (adjusted hazard ratio [HR], 1.27 and 0.99; 95%CI: 0.84-1.92 and 0.63-1.56; p = 0.26 and 0.97) or DL (HR, 1.44 and 1.06; 95%CI: 0.86-2.42 and 0.67-1.68; p = 0.17 and 0.80) was not prognostic. CT-VPI by an attending radiologist was prognostic only in radiologically solid tumors (HR, 1.82; 95%CI: 1.07-3.07; p = 0.03). CONCLUSION: The diagnostic performance and prognostic value of CT-VPI are limited in clinical stage I lung adenocarcinomas. This feature may be applied for radiologically solid tumors, but substantial reader variability should be overcome. CLINICAL RELEVANCE STATEMENT: Although the diagnostic performance and prognostic value of CT-VPI are limited in clinical stage I lung adenocarcinomas, this parameter may be applied for radiologically solid tumors with appropriate caution regarding inter-reader variability. KEY POINTS: • Use of CT-defined visceral pleural invasion in clinical staging should be cautious, because prognostic value of CT-defined visceral pleural invasion remains unexplored. • Diagnostic performance and prognostic value of CT-defined visceral pleural invasion varied among radiologists and deep learning. • Role of CT-defined visceral pleural invasion in clinical staging may be limited to radiologically solid tumors.

Effects of Implementing Artificial Intelligence-Based Computer-Aided Detection for Chest Radiographs in Daily Practice on the Rate of Referral to Chest Computed Tomography in Pulmonology Outpatient Clinic.

OBJECTIVE: The clinical impact of artificial intelligence-based computer-aided detection (AI-CAD) beyond diagnostic accuracy remains uncertain. We aimed to investigate the influence of the clinical implementation of AI-CAD for chest radiograph (CR) interpretation in daily practice on the rate of referral for chest computed tomography (CT). MATERIALS AND METHODS: AI-CAD was implemented in clinical practice at the Seoul National University Hospital. CRs obtained from patients who visited the pulmonology outpatient clinics before (January-December 2019) and after (January-December 2020) implementation were included in this study. After implementation, the referring pulmonologist requested CRs with or without AI-CAD analysis. We conducted multivariable logistic regression analyses to evaluate the associations between using AI-CAD and the following study outcomes: the rate of chest CT referral, defined as request and actual acquisition of chest CT within 30 days after CR acquisition, and the CT referral rates separately for subsequent positive and negative CT results. Multivariable analyses included various covariates such as patient age and sex, time of CR acquisition (before versus after AI-CAD implementation), referring pulmonologist, nature of the CR examination (baseline versus follow-up examination), and radiology reports presence at the time of the pulmonology visit. RESULTS: A total of 28546 CRs from 14565 patients (mean age: 67 years; 7130 males) and 25888 CRs from 12929 patients (mean age: 67 years; 6435 males) before and after AI-CAD implementation were included. The use of AI-CAD was independently associated with increased chest CT referrals (odds ratio [OR], 1.33; P = 0.008) and referrals with subsequent negative chest CT results (OR, 1.46; P = 0.005). Meanwhile, referrals with positive chest CT results were not significantly associated with AI-CAD use (OR, 1.08; P = 0.647). CONCLUSION: The use of AI-CAD for CR interpretation in pulmonology outpatients was independently associated with an increased frequency of overall referrals for chest CT scans and referrals with subsequent negative results.

A Deep Learning Model Using Chest Radiographs for Prediction of 30-Day Mortality in Patients With Community-Acquired Pneumonia: Development and External Validation.

BACKGROUND. Chest radiography is an essential tool for diagnosing community-acquired pneumonia (CAP), but it has an uncertain prognostic role in the care of patients with CAP. OBJECTIVE. The purpose of this study was to develop a deep learning (DL) model to predict 30-day mortality from diagnosis among patients with CAP by use of chest radiographs to validate the performance model in patients from different time periods and institutions. METHODS. In this retrospective study, a DL model was developed from data on 7105 patients from one institution from March 2013 to December 2019 (3:1:1 allocation to training, validation, and internal test sets) to predict the risk of all-cause mortality within 30 days after CAP diagnosis by use of patients' initial chest radiographs. The DL model was evaluated in a cohort of patients diagnosed with CAP during emergency department visits at the same institution from January 2020 to March 2020 (temporal test cohort [n = 947]) and in two additional cohorts from different institutions (external test cohort A [n = 467], January 2020 to December 2020; external test cohort B [n = 381], March 2019 to October 2021). AUCs were compared between the DL model and an established risk prediction tool based on the presence of confusion, blood urea nitrogen level, respiratory rate, blood pressure, and age 65 years or older (CURB-65 score). The combination of CURB-65 score and DL model was evaluated with a logistic regression model. RESULTS. The AUC for predicting 30-day mortality was significantly larger (p < .001) for the DL model than for CURB-65 score in the temporal test set (0.77 vs 0.67). The larger AUC for the DL model than for CURB-65 score was not significant (p > .05) in external test cohort A (0.80 vs 0.73) or external test cohort B (0.80 vs 0.72). In the three cohorts, the DL model, in comparison with CURB-65 score, had higher (p < .001) specificity (range, 61-69% vs 44-58%) at the sensitivity of CURB-65 score. The combination of DL model and CURB-65 score, in comparison with CURB-65 score, yielded a significant increase in AUC in the temporal test cohort (0.77, p < .001) and external test cohort B (0.80, p = .04) and a nonsignificant increase in AUC in external test cohort A (0.80, p = .16). CONCLUSION. A DL-based model consisting of initial chest radiographs was predictive of 30-day mortality among patients with CAP with improved performance over CURB-65 score. CLINICAL IMPACT. The DL-based model may guide clinical decision-making in the care of patients with CAP.

Effect of Human-AI Interaction on Detection of Malignant Lung Nodules on Chest Radiographs.

Background The factors affecting radiologists' diagnostic determinations in artificial intelligence (AI)-assisted image reading remain underexplored. Purpose To assess how AI diagnostic performance and reader characteristics influence detection of malignant lung nodules during AI-assisted reading of chest radiographs. Materials and Methods This retrospective study consisted of two reading sessions from April 2021 to June 2021. Based on the first session without AI assistance, 30 readers were assigned into two groups with equivalent areas under the free-response receiver operating characteristic curve (AUFROCs). In the second session, each group reinterpreted radiographs assisted by either a high or low accuracy AI model (blinded to the fact that two different AI models were used). Reader performance for detecting lung cancer and reader susceptibility (changing the original reading following the AI suggestion) were compared. A generalized linear mixed model was used to identify the factors influencing AI-assisted detection performance, including readers' attitudes and experiences of AI and Grit score. Results Of the 120 chest radiographs assessed, 60 were obtained in patients with lung cancer (mean age, 67 years ± 12 [SD]; 32 male; 63 cancers) and 60 in controls (mean age, 67 years ± 12; 36 male). Readers included 20 thoracic radiologists (5-18 years of experience) and 10 radiology residents (2-3 years of experience). Use of the high accuracy AI model improved readers' detection performance to a greater extent than use of the low accuracy AI model (area under the receiver operating characteristic curve, 0.77 to 0.82 vs 0.75 to 0.75; AUFROC, 0.71 to 0.79 vs 0.7 to 0.72). Readers who used the high accuracy AI showed a higher susceptibility (67%, 224 of 334 cases) to changing their diagnosis based on the AI suggestions than those using the low accuracy AI (59%, 229 of 386 cases). Accurate readings at the first session, correct AI suggestions, high accuracy Al, and diagnostic difficulty were associated with accurate AI-assisted readings, but readers' characteristics were not. Conclusion An AI model with high diagnostic accuracy led to improved performance of radiologists in detecting lung cancer on chest radiographs and increased radiologists' susceptibility to AI suggestions. © RSNA, 2023 Supplemental material is available for this article.

Deep Learning-Based Computer-Aided Detection System for Preoperative Chest Radiographs to Predict Postoperative Pneumonia.

RATIONALE AND OBJECTIVES: The role of preoperative chest radiography (CR) for prediction of postoperative pneumonia remains uncertain. We aimed to develop and validate a prediction model for postoperative pneumonia incorporating findings of preoperative CRs evaluated by a deep learning-based computer-aided detection (DL-CAD) system MATERIALS AND METHODS: This retrospective study included consecutive patients who underwent surgery between January 2019 and March 2020 and divided into development (surgery in 2019) and validation (surgery between January and March 2020) cohorts. Preoperative CRs obtained within 1-month before surgery were analyzed with a commercialized DL-CAD that provided probability values for the presence of 10 different abnormalities in CRs. Logistic regression models to predict postoperative pneumonia were built using clinical variables (clinical model), and both clinical variables and DL-CAD results for preoperative CRs (DL-CAD model). The discriminative performances of the models were evaluated by area under the receiver operating characteristic curves. RESULTS: In development cohort (n = 19,349; mean age, 57 years; 11,392 men), DL-CAD results for pulmonary nodules (odds ratio [OR, for 1% increase in probability value], 1.007; p = 0.021), consolidation (OR, 1.019; p < 0.001), and cardiomegaly (OR, 1.013; p < 0.001) were independent predictors of postoperative pneumonia and were included in the DL-CAD model. In validation cohort (n = 4957; mean age, 56 years; 2848 men), the DL-CAD model exhibited a higher AUROC than the clinical model (0.843 vs. 0.815; p = 0.012). CONCLUSION: Abnormalities in preoperative CRs evaluated by a DL-CAD were independent risk factors for postoperative pneumonia. Using DL-CAD results for preoperative CRs led to an improved prediction of postoperative pneumonia.

Methods of Visualizing the Results of an Artificial-Intelligence-Based Computer-Aided Detection System for Chest Radiographs: Effect on the Diagnostic Performance of Radiologists.

It is unclear whether the visualization methods for artificial-intelligence-based computer-aided detection (AI-CAD) of chest radiographs influence the accuracy of readers' interpretation. We aimed to evaluate the accuracy of radiologists' interpretations of chest radiographs using different visualization methods for the same AI-CAD. Initial chest radiographs of patients with acute respiratory symptoms were retrospectively collected. A commercialized AI-CAD using three different methods of visualizing was applied: (a) closed-line method, (b) heat map method, and (c) combined method. A reader test was conducted with five trainee radiologists over three interpretation sessions. In each session, the chest radiographs were interpreted using AI-CAD with one of the three visualization methods in random order. Examination-level sensitivity and accuracy, and lesion-level detection rates for clinically significant abnormalities were evaluated for the three visualization methods. The sensitivity (p = 0.007) and accuracy (p = 0.037) of the combined method are significantly higher than that of the closed-line method. Detection rates using the heat map method (p = 0.043) and the combined method (p = 0.004) are significantly higher than those using the closed-line method. The methods for visualizing AI-CAD results for chest radiographs influenced the performance of radiologists' interpretations. Combining the closed-line and heat map methods for visualizing AI-CAD results led to the highest sensitivity and accuracy of radiologists.

Identification of Active Pulmonary Tuberculosis Among Patients With Positive Interferon-Gamma Release Assay Results: Value of a Deep Learning-based Computer-aided Detection System in Different Scenarios of Implementation.

PURPOSE: To evaluate the accuracy of a deep learning-based computer-aided detection (CAD) system in identifying active pulmonary tuberculosis on chest radiographs (CRs) of patients with positive interferon-gamma release assay (IGRA) results in different scenarios of clinical implementation. MATERIALS AND METHODS: We collected the CRs of consecutive patients with positive IGRA results. Findings of active pulmonary tuberculosis on CRs were independently evaluated by the CAD and a thoracic radiologist, followed by interpretation using the CAD. Sensitivity and specificity were evaluated in different scenarios: (a) radiologists' interpretation, (b) radiologists' CAD-assisted interpretation, and (c) CAD-based prescreening (radiologists' interpretation for positive CAD results only). We conducted a reader test to compare the accuracy of the CAD with those of 5 radiologists. RESULTS: Among 1780 patients (men, 53.8%; median age, 56 y), 44 (2.5%) were diagnosed with active pulmonary tuberculosis. The CAD-assisted interpretation exhibited a higher sensitivity (81.8% vs. 72.7%; P =0.046) but lower specificity than the radiologists' interpretation (84.1% vs. 85.7%; P <0.001). The CAD-based prescreening exhibited a higher specificity than the radiologists' interpretation (88.8% vs. 85.7%; P <0.001) at the same sensitivity, with a workload reduction of 85.2% (1780 to 263). In the reader test, the CAD exhibited a higher sensitivity than radiologists (72.7% vs. 59.5%; P =0.005) at the same specificity (88.0%), and CAD-assisted interpretation significantly improved the sensitivity of radiologists' interpretation (72.3%; P <0.001). CONCLUSIONS: For identifying active pulmonary tuberculosis among patients with positive IGRA results, deep learning-based CAD can enhance the sensitivity of interpretation. CAD-based prescreening may reduce the radiologists' workload at an improved specificity.

Effects of Expert-Determined Reference Standards in Evaluating the Diagnostic Performance of a Deep Learning Model: A Malignant Lung Nodule Detection Task on Chest Radiographs.

OBJECTIVE: Little is known about the effects of using different expert-determined reference standards when evaluating the performance of deep learning-based automatic detection (DLAD) models and their added value to radiologists. We assessed the concordance of expert-determined standards with a clinical gold standard (herein, pathological confirmation) and the effects of different expert-determined reference standards on the estimates of radiologists' diagnostic performance to detect malignant pulmonary nodules on chest radiographs with and without the assistance of a DLAD model. MATERIALS AND METHODS: This study included chest radiographs from 50 patients with pathologically proven lung cancer and 50 controls. Five expert-determined standards were constructed using the interpretations of 10 experts: individual judgment by the most experienced expert, majority vote, consensus judgments of two and three experts, and a latent class analysis (LCA) model. In separate reader tests, additional 10 radiologists independently interpreted the radiographs and then assisted with the DLAD model. Their diagnostic performance was estimated using the clinical gold standard and various expert-determined standards as the reference standard, and the results were compared using the t test with Bonferroni correction. RESULTS: The LCA model (sensitivity, 72.6%; specificity, 100%) was most similar to the clinical gold standard. When expert-determined standards were used, the sensitivities of radiologists and DLAD model alone were overestimated, and their specificities were underestimated (all p-values < 0.05). DLAD assistance diminished the overestimation of sensitivity but exaggerated the underestimation of specificity (all p-values < 0.001). The DLAD model improved sensitivity and specificity to a greater extent when using the clinical gold standard than when using the expert-determined standards (all p-values < 0.001), except for sensitivity with the LCA model (p = 0.094). CONCLUSION: The LCA model was most similar to the clinical gold standard for malignant pulmonary nodule detection on chest radiographs. Expert-determined standards caused bias in measuring the diagnostic performance of the artificial intelligence model.

Evaluation of chest X-ray with automated interpretation algorithms for mass tuberculosis screening in prisons: a cross-sectional study.

Background: The World Health Organization (WHO) recommends systematic tuberculosis (TB) screening in prisons. Evidence is lacking for accurate and scalable screening approaches in this setting. We aimed to assess the accuracy of artificial intelligence-based chest x-ray interpretation algorithms for TB screening in prisons. Methods: We performed prospective TB screening in three male prisons in Brazil from October 2017 to December 2019. We administered a standardized questionnaire, performed a chest x-ray in a mobile unit, and collected sputum for confirmatory testing using Xpert MTB/RIF and culture. We evaluated x-ray images using three algorithms (CAD4TB version 6, Lunit version 3.1.0.0 and qXR version 3) and compared their accuracy. We utilized multivariable logistic regression to assess the effect of demographic and clinical characteristics on algorithm accuracy. Finally, we investigated the relationship between abnormality scores and Xpert semi-quantitative results. Findings: Among 2075 incarcerated individuals, 259 (12.5%) had confirmed TB. All three algorithms performed similarly overall with area under the receiver operating characteristic curve (AUC) of 0.88-0.91. At 90% sensitivity, only LunitTB and qXR met the WHO Target Product Profile requirements for a triage test, with specificity of 84% and 74%, respectively. All algorithms had variable performance by age, prior TB, smoking, and presence of TB symptoms. LunitTB was the most robust to this heterogeneity but nonetheless failed to meet the TPP for individuals with previous TB. Abnormality scores of all three algorithms were significantly correlated with sputum bacillary load. Interpretation: Automated x-ray interpretation algorithms can be an effective triage tool for TB screening in prisons. However, their specificity is insufficient in individuals with previous TB. Funding: This study was supported by the US National Institutes of Health (grant numbers R01 AI130058 and R01 AI149620) and the State Secretary of Health of Mato Grosso do Sul.

Conventional Versus Artificial Intelligence-Assisted Interpretation of Chest Radiographs in Patients With Acute Respiratory Symptoms in Emergency Department: A Pragmatic Randomized Clinical Trial.

OBJECTIVE: It is unknown whether artificial intelligence-based computer-aided detection (AI-CAD) can enhance the accuracy of chest radiograph (CR) interpretation in real-world clinical practice. We aimed to compare the accuracy of CR interpretation assisted by AI-CAD to that of conventional interpretation in patients who presented to the emergency department (ED) with acute respiratory symptoms using a pragmatic randomized controlled trial. MATERIALS AND METHODS: Patients who underwent CRs for acute respiratory symptoms at the ED of a tertiary referral institution were randomly assigned to intervention group (with assistance from an AI-CAD for CR interpretation) or control group (without AI assistance). Using a commercial AI-CAD system (Lunit INSIGHT CXR, version 2.0.2.0; Lunit Inc.). Other clinical practices were consistent with standard procedures. Sensitivity and false-positive rates of CR interpretation by duty trainee radiologists for identifying acute thoracic diseases were the primary and secondary outcomes, respectively. The reference standards for acute thoracic disease were established based on a review of the patient's medical record at least 30 days after the ED visit. RESULTS: We randomly assigned 3576 participants to either the intervention group (1761 participants; mean age ± standard deviation, 65 ± 17 years; 978 males; acute thoracic disease in 472 participants) or the control group (1815 participants; 64 ± 17 years; 988 males; acute thoracic disease in 491 participants). The sensitivity (67.2% [317/472] in the intervention group vs. 66.0% [324/491] in the control group; odds ratio, 1.02 [95% confidence interval, 0.70-1.49]; P = 0.917) and false-positive rate (19.3% [249/1289] vs. 18.5% [245/1324]; odds ratio, 1.00 [95% confidence interval, 0.79-1.26]; P = 0.985) of CR interpretation by duty radiologists were not associated with the use of AI-CAD. CONCLUSION: AI-CAD did not improve the sensitivity and false-positive rate of CR interpretation for diagnosing acute thoracic disease in patients with acute respiratory symptoms who presented to the ED.

AI Improves Nodule Detection on Chest Radiographs in a Health Screening Population: A Randomized Controlled Trial.

Background The impact of artificial intelligence (AI)-based computer-aided detection (CAD) software has not been prospectively explored in real-world populations. Purpose To investigate whether commercial AI-based CAD software could improve the detection rate of actionable lung nodules on chest radiographs in participants undergoing health checkups. Materials and Methods In this single-center, pragmatic, open-label randomized controlled trial, participants who underwent chest radiography between July 2020 and December 2021 in a health screening center were enrolled and randomized into intervention (AI group) and control (non-AI group) arms. One of three designated radiologists with 13-36 years of experience interpreted each radiograph, referring to the AI-based CAD results for the AI group. The primary outcome was the detection rate, that is, the number of true-positive radiographs divided by the total number of radiographs, of actionable lung nodules confirmed on CT scans obtained within 3 months. Actionable nodules were defined as solid nodules larger than 8 mm or subsolid nodules with a solid portion larger than 6 mm (Lung Imaging Reporting and Data System, or Lung-RADS, category 4). Secondary outcomes included the positive-report rate, sensitivity, false-referral rate, and malignant lung nodule detection rate. Clinical outcomes were compared between the two groups using univariable logistic regression analyses. Results A total of 10 476 participants (median age, 59 years [IQR, 50-66 years]; 5121 men) were randomized to an AI group (n = 5238) or non-AI group (n = 5238). The trial met the predefined primary outcome, demonstrating an improved detection rate of actionable nodules in the AI group compared with the non-AI group (0.59% [31 of 5238 participants] vs 0.25% [13 of 5238 participants], respectively; odds ratio, 2.4; 95% CI: 1.3, 4.7; P = .008). The detection rate for malignant lung nodules was higher in the AI group compared with the non-AI group (0.15% [eight of 5238 participants] vs 0.0% [0 of 5238 participants], respectively; P = .008). The AI and non-AI groups showed similar false-referral rates (45.9% [56 of 122 participants] vs 56.0% [56 of 100 participants], respectively; P = .14) and positive-report rates (2.3% [122 of 5238 participants] vs 1.9% [100 of 5238 participants]; P = .14). Conclusion In health checkup participants, artificial intelligence-based software improved the detection of actionable lung nodules on chest radiographs. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Auffermann in this isssue.

Determination of the optimum definition of growth evaluation for indeterminate pulmonary nodules detected in lung cancer screening.

OBJECTIVE: To determine the optimum definition of growth for indeterminate pulmonary nodules detected in lung cancer screening. MATERIALS AND METHODS: Individuals with indeterminate nodules as defined by volume of 50-500 mm3 (solid nodules) and solid component volume of 50-500 mm3 or average diameter of non-solid component ≥8 mm (part-solid nodules) on baseline lung cancer screening low-dose chest CT (LDCT) were included. The average diameters and volumes of the nodules were measured on baseline and follow-up LDCTs with semi-automated segmentation. Sensitivities and specificities for lung cancer diagnosis of nodule growth defined by a) percentage volume growth ≥25% (defined in the NELSON study); b) absolute diameter growth >1.5 mm (defined in the Lung-RADS version 1.1); and c) subjective decision by a radiologist were evaluated. Sensitivities and specificities of diagnostic referral based on various thresholds of volume doubling time (VDT) were also evaluated. RESULTS: Altogether, 115 nodules (one nodule per individual; 93 solid and 22 part-solid nodules; 105 men; median age, 68 years) were evaluated (median follow-up interval: 201 days; interquartile range: 127-371 days). Percentage volume growth ≥25% exhibited higher sensitivity but lower specificity than those of diametrical measurement compared to absolute diameter growth >1.5 mm (sensitivity, 69.2% vs. 42.3%, p = 0.023; specificity, 82.0% vs. 96.6%, p = 0.002). The radiologist had an equivalent sensitivity (53.9%; p = 0.289) but higher specificity (98.9%; p = 0.002) compared to those of volume growth, but did not differ from those of diameter growth (p>0.05 both in sensitivity and specificity). Compared to the VDT threshold of 600 days (sensitivity, 61.5%; specificity, 87.6%), VDT thresholds ≤200 and ≤300 days exhibited significantly lower sensitivity (30.8%, p = 0.013) and higher specificity (94.4%, p = 0.041), respectively. CONCLUSION: Growth evaluation of screening-detected indeterminate nodules with volumetric measurement exhibited higher sensitivity but lower specificity compared to diametric measurements.

A narrative review of deep learning applications in lung cancer research: from screening to prognostication.

Background and Objective: Deep learning (DL) algorithms have been developed for various tasks, including lung nodule detection on chest radiographs or lung cancer computed tomography screening, potential candidate selection in lung cancer screening, malignancy prediction for indeterminate pulmonary nodules, lung cancer staging, treatment response prediction, prognostication, and prediction of genetic mutations in lung cancer. Furthermore, these DL algorithms have been applied in various clinical settings in order for them to be generalized in real-world clinical practice. Multiple DL algorithms have been corroborated to be on par with experts or current clinical prediction models for several specific tasks. However, no article has yet comprehensively reviewed DL algorithms dedicated to lung cancer research. This narrative review presents an overview of the literature dealing with DL techniques applied in lung cancer research and briefly summarizes the results according to the DL algorithms' clinical use cases. Methods: we performed a narrative review by searching the Embase and OVID-MEDLINE databases for articles published in English from October, 2016 until September, 2021 and reviewing the bibliographies of key references to identify important literature related to DL in lung cancer research. The background, development, results, and clinical implications of each DL algorithm are briefly discussed. Lastly, we end this review article by highlighting future directions in lung cancer research using DL techniques. Key Content and Findings: DL algorithms have been introduced to show comparable or higher performance than human experts in various clinical settings. Specifically, they have been actively applied to detect lung nodules in chest radiographs or computed tomography (CT) examinations, optimize candidate selection for lung cancer screening (LCS), predict the malignancy of lung nodules, stage lung cancer, and predict treatment response, patients' prognoses, and genetic mutations in lung cancers. Conclusions: DL algorithms have corroborated their potential value for various tasks, ranging from lung cancer screening to prognostication of lung cancer patients. Future research is warranted for the clinical application of these algorithms in daily clinical practice and verification of their real-world clinical usefulness.