Usefulness of longitudinal nodule-matching algorithm in computer-aided diagnosis of new pulmonary metastases on cancer surveillance CT scans.

Background: Detecting new pulmonary metastases by comparing serial computed tomography (CT) scans is crucial, but a repetitive and time-consuming task that burdens the radiologists' workload. This study aimed to evaluate the usefulness of a nodule-matching algorithm with deep learning-based computer-aided detection (DL-CAD) in diagnosing new pulmonary metastases on cancer surveillance CT scans. Methods: Among patients who underwent pulmonary metastasectomy between 2014 and 2018, 65 new pulmonary metastases missed by interpreting radiologists on cancer surveillance CT (Time 2) were identified after a retrospective comparison with the previous CT (Time 1). First, DL-CAD detected nodules in Time 1 and Time 2 CT images. All nodules detected at Time 2 were initially considered metastasis candidates. Second, the nodule-matching algorithm was used to assess the correlation between the nodules from the two CT scans and to classify the nodules at Time 2 as "new" or "pre-existing". Pre-existing nodules were excluded from metastasis candidates. We evaluated the performance of DL-CAD with the nodule-matching algorithm, based on its sensitivity, false-metastasis candidates per scan, and positive predictive value (PPV). Results: A total of 475 lesions were detected by DL-CAD at Time 2. Following a radiologist review, the lesions were categorized as metastases (n=54), benign nodules (n=392), and non-nodules (n=29). Upon comparison of nodules at Time 1 and 2 using the nodule-matching algorithm, all metastases were classified as new nodules without any matching errors. Out of 421 benign lesions, 202 (48.0%) were identified as pre-existing and subsequently excluded from the pool of metastasis candidates through the nodule-matching algorithm. As a result, false-metastasis candidates per CT scan decreased by 47.9% (from 7.1 to 3.7, P<0.001) and the PPV increased from 11.4% to 19.8% (P<0.001), while maintaining sensitivity. Conclusions: The nodule-matching algorithm improves the diagnostic performance of DL-CAD for new pulmonary metastases, by lowering the number of false-metastasis candidates without compromising sensitivity.

Tumor grading of soft tissue sarcomas: Assessment with whole-tumor histogram analysis of apparent diffusion coefficient.

PURPOSE: To evaluate the usefulness of whole-tumor ADC histogram analysis based on entire tumor volume in determining the histologic grade of STS (soft tissue sarcoma)s. METHODS: From January 2015 to December 2020, 53 patients with STS who underwent preoperative magnetic resonance imaging, including diffusion weighted imaging and ADC maps (b = 0 and 1400 s/mm2), within 1 month before surgical resection were included in the study. Regions of interest were drawn on every section of the ADC map containing tumor and were summated to derive volume-based histogram data of the entire tumor. Histogram parameters were correlated with histologic tumor grade using Kruskal-Wallis test and compared between high-(grade II and III) and low-grade STSs (grade I) using Mann-Whitney U test. Multivariable logistic regression analysis was applied to identify significant histogram parameters for high-grade STS prediction, and receiver operating characteristic curves (AUC) were constructed to determine optimum threshold. RESULTS: Eight patients with low-grade STS (15.1%) and 45 with high-grade STS (26.4% [14/53] for grade II; 58.5% [31/53] for grade III) were included. High-grade STS showed positive skewness and low-grade STS showed negative skewness (0.503 vs -0.726, p=.001). High-grade STS showed lower mean ADC (p =.03) and 5th to 50th percentile values (p ≤. 03) than those of low-grade STS. Positive skewness was an independent predictor of high-grade STS (odds ratio: 6.704, p=.002) with 84.4% sensitivity and 87.5% specificity (cut-off values > -0.1757, AUC = 0.842). CONCLUSION: Skewness is the most promising histogram parameter for discriminating high-grade from low-grade STS. The mean ADC values and lower half of percentile values are helpful for differentiating high from low-grade STSs.

Volumetric analysis of pulmonary nodules: reducing the discrepancy between the diameter-based volume calculation and voxel-counting method.

Background: When assessing the volume of pulmonary nodules on computed tomography (CT) images, there is an inevitable discrepancy between values based on the diameter-based volume calculation and the voxel-counting method, which is derived from the Euclidean distance measurement method on pixel/voxel-based digital image. We aimed to evaluate the ability of a modified diameter measurement method to reduce the discrepancy, and we determined a conversion equation to equate volumes derived from different methods. Methods: Two different anthropomorphic phantoms with subsolid and solid nodules were repeatedly scanned under various settings. Nodules in CT images were detected and segmented using a fully automated algorithm and the volume was calculated using three methods: the voxel-counting method (Vvc ), diameter-based volume calculation (Vd ), and a modified diameter-based volume calculation (Vd+ 1), in which one pixel spacing was added to the diameters in the three axes (x-, y-, and z-axis). For each nodule, Vd and Vd +1 were compared to Vvc by computing the absolute percentage error (APE) as follows: APE =100 × (V - Vvc )/Vvc . Comparisons between APEd and APEd+1 according to CT parameter setting were performed using the Wilcoxon signed-rank test. The Jonckheere-Terpstra test was used to evaluate trends across the four different nodule sizes. Results: The deep learning-based computer-aided diagnosis (DL-CAD) successfully detected and segmented all nodules in a fully automatic manner. The APE was significantly less with Vd+1 than with Vd (Wilcoxon signed-rank test, P<0.05) regardless of CT parameters and nodule size. The APE median increased as the size of the nodule decreased. This trend was statistically significant (Jonckheere-Terpstra test, P<0.001) regardless of volume measurement method (diameter-based and modified diameter-based volume calculations). Conclusions: Our modified diameter-based volume calculation significantly reduces the discrepancy between the diameter-based volume calculation and voxel-counting method.

Evaluating subscapularis tendon tears on axillary lateral radiographs using deep learning.

OBJECTIVE: To develop a deep learning algorithm capable of evaluating subscapularis tendon (SSC) tears based on axillary lateral shoulder radiography. METHODS: A total of 2,779 axillary lateral shoulder radiographs (performed between February 2010 and December 2018) and the patients' corresponding clinical information (age, sex, dominant side, history of trauma, and degree of pain) were used to develop the deep learning algorithm. The radiographs were labeled based on arthroscopic findings, with the output being the probability of an SSC tear exceeding 50% of the tendon's thickness. The algorithm's performance was evaluated by determining the area under the receiver operating characteristic curve (AUC), sensitivity, specificity, negative predictive value (NPV), and negative likelihood ratio (LR-) at a predefined high-sensitivity cutoff point. Two different test sets were used, with radiographs obtained between January and December 2019; Test Set 1 used arthroscopic findings as the reference standard (n = 340), whereas Test Set 2 used MRI findings as the reference standard (n = 627). RESULTS: The AUCs were 0.83 (95% confidence interval, 0.79-0.88) and 0.82 (95% confidence interval, 0.79-0.86) for Test Sets 1 and 2, respectively. At the high-sensitivity cutoff point, the sensitivity, NPV, and LR- were 91.4%, 90.4%, and 0.21 in Test Set 1, and 90.2%, 89.5%, and 0.21 in Test Set 2, respectively. Gradient-weighted Class Activation Mapping identified the subscapularis insertion site at the lesser tuberosity as the most sensitive region. CONCLUSION: Our deep learning algorithm is capable of assessing SSC tears based on changes at the lesser tuberosity on axillary lateral radiographs with moderate accuracy. KEY POINTS: • We have developed a deep learning algorithm capable of assessing SSC tears based on changes at the lesser tuberosity on axillary lateral radiographs and previous clinical data with moderate accuracy. • Our deep learning algorithm could be used as an objective method to initially assess SSC integrity and to identify those who would and would not benefit from further investigation or treatment.

Incidence Lung Cancer after a Negative CT Screening in the National Lung Screening Trial: Deep Learning-Based Detection of Missed Lung Cancers.

We aimed to analyse the CT examinations of the previous screening round (CTprev) in NLST participants with incidence lung cancer and evaluate the value of DL-CAD in detection of missed lung cancers. Thoracic radiologists reviewed CTprev in participants with incidence lung cancer, and a DL-CAD analysed CTprev according to NLST criteria and the lung CT screening reporting & data system (Lung-RADS) classification. We calculated patient-wise and lesion-wise sensitivities of the DL-CAD in detection of missed lung cancers. As per the NLST criteria, 88% (100/113) of CTprev were positive and 74 of them had missed lung cancers. The DL-CAD reported 98% (98/100) of the positive screens as positive and detected 95% (70/74) of the missed lung cancers. As per the Lung-RADS classification, 82% (93/113) of CTprev were positive and 60 of them had missed lung cancers. The DL-CAD reported 97% (90/93) of the positive screens as positive and detected 98% (59/60) of the missed lung cancers. The DL-CAD made false positive calls in 10.3% (27/263) of controls, with 0.16 false positive nodules per scan (41/263). In conclusion, the majority of CTprev in participants with incidence lung cancers had missed lung cancers, and the DL-CAD detected them with high sensitivity and a limited false positive rate.

Effects of Hypertension, Diabetes, and Smoking on Age and Sex Prediction from Retinal Fundus Images.

Retinal fundus images are used to detect organ damage from vascular diseases (e.g. diabetes mellitus and hypertension) and screen ocular diseases. We aimed to assess convolutional neural network (CNN) models that predict age and sex from retinal fundus images in normal participants and in participants with underlying systemic vascular-altered status. In addition, we also tried to investigate clues regarding differences between normal ageing and vascular pathologic changes using the CNN models. In this study, we developed CNN age and sex prediction models using 219,302 fundus images from normal participants without hypertension, diabetes mellitus (DM), and any smoking history. The trained models were assessed in four test-sets with 24,366 images from normal participants, 40,659 images from hypertension participants, 14,189 images from DM participants, and 113,510 images from smokers. The CNN model accurately predicted age in normal participants; the correlation between predicted age and chronologic age was R2 = 0.92, and the mean absolute error (MAE) was 3.06 years. MAEs in test-sets with hypertension (3.46 years), DM (3.55 years), and smoking (2.65 years) were similar to that of normal participants; however, R2 values were relatively low (hypertension, R2 = 0.74; DM, R2 = 0.75; smoking, R2 = 0.86). In subgroups with participants over 60 years, the MAEs increased to above 4.0 years and the accuracies declined for all test-sets. Fundus-predicted sex demonstrated acceptable accuracy (area under curve > 0.96) in all test-sets. Retinal fundus images from participants with underlying vascular-altered conditions (hypertension, DM, or smoking) indicated similar MAEs and low coefficients of determination (R2) between the predicted age and chronologic age, thus suggesting that the ageing process and pathologic vascular changes exhibit different features. Our models demonstrate the most improved performance yet and provided clues to the relationship and difference between ageing and pathologic changes from underlying systemic vascular conditions. In the process of fundus change, systemic vascular diseases are thought to have a different effect from ageing. Research in context. Evidence before this study. The human retina and optic disc continuously change with ageing, and they share physiologic or pathologic characteristics with brain and systemic vascular status. As retinal fundus images provide high-resolution in-vivo images of retinal vessels and parenchyma without any invasive procedure, it has been used to screen ocular diseases and has attracted significant attention as a predictive biomarker for cerebral and systemic vascular diseases. Recently, deep neural networks have revolutionised the field of medical image analysis including retinal fundus images and shown reliable results in predicting age, sex, and presence of cardiovascular diseases. Added value of this study. This is the first study demonstrating how a convolutional neural network (CNN) trained using retinal fundus images from normal participants measures the age of participants with underlying vascular conditions such as hypertension, diabetes mellitus (DM), or history of smoking using a large database, SBRIA, which contains 412,026 retinal fundus images from 155,449 participants. Our results indicated that the model accurately predicted age in normal participants, while correlations (coefficient of determination, R2) in test-sets with hypertension, DM, and smoking were relatively low. Additionally, a subgroup analysis indicated that mean absolute errors (MAEs) increased and accuracies declined significantly in subgroups with participants over 60 years of age in both normal participants and participants with vascular-altered conditions. These results suggest that pathologic retinal vascular changes occurring in systemic vascular diseases are different form the changes in spontaneous ageing process, and the ageing process observed in retinal fundus images may saturate at age about 60 years. Implications of all available evidence. Based on this study and previous reports, the CNN could accurately and reliably predict age and sex using retinal fundus images. The fact that retinal changes caused by ageing and systemic vascular diseases occur differently motivates one to understand the retina deeper. Deep learning-based fundus image reading may be a more useful and beneficial tool for screening and diagnosing systemic and ocular diseases after further development.

Limited detection of small (≤ 10 mm) colorectal liver metastasis at preoperative CT in patients undergoing liver resection.

OBJECTIVE: To retrospectively determine the sensitivity of preoperative CT in the detection of small (≤ 10 mm) colorectal liver metastasis (CRLM) nodules in patients undergoing liver resection. METHODS: The institutional review board approved the study and waived informed consent. We included 461 pathologically confirmed CRLM nodules in 211 patients (including 71 women; mean age, 66.4 years) who underwent 229 liver resections following abdominal CT. Prior to 163 resections, gadoxetic acid-enhanced liver MR imaging was also performed. Nodules were matched between pathology reports and prospective CT reports following a predefined algorithm. Per-nodule sensitivity of CT was calculated by nodule-size category. Generalized estimating equations were used to adjust for within-case correlation. RESULTS: Fourteen nodule sizes were missing in the pathology report. Nodules of 1-5 mm and 6-10 mm accounted for 8.1% (n = 36) and 23.5% (n = 105) of the remaining 447 nodules, and the number of nodules gradually decreased as nodule size increased beyond 10 mm. The overall sensitivity of CT was 81.2% (95% confidence interval, 77.1%, 85.2%; 365/461). The sensitivity was 8% (0%, 17%; 3/36), 55% (45%, 65%; 59/105), 91%, 95%, and 100% for nodules of 1-5 mm, 6-10 mm, 11-15 mm, 16-20 mm, and >20 mm, respectively. The nodule-size distribution was similar between resections undergoing gadoxetic acid-enhanced MR imaging and those not undergoing the MR imaging. CONCLUSION: CT has limited sensitivity for nodules of ≤ 10 mm and particularly of ≤ 5 mm.

Computer-aided detection of brain metastasis on 3D MR imaging: Observer performance study.

PURPOSE: To assess the effect of computer-aided detection (CAD) of brain metastasis (BM) on radiologists' diagnostic performance in interpreting three-dimensional brain magnetic resonance (MR) imaging using follow-up imaging and consensus as the reference standard. MATERIALS AND METHODS: The institutional review board approved this retrospective study. The study cohort consisted of 110 consecutive patients with BM and 30 patients without BM. The training data set included MR images of 80 patients with 450 BM nodules. The test set included MR images of 30 patients with 134 BM nodules and 30 patients without BM. We developed a CAD system for BM detection using template-matching and K-means clustering algorithms for candidate detection and an artificial neural network for false-positive reduction. Four reviewers (two neuroradiologists and two radiology residents) interpreted the test set images before and after the use of CAD in a sequential manner. The sensitivity, false positive (FP) per case, and reading time were analyzed. A jackknife free-response receiver operating characteristic (JAFROC) method was used to determine the improvement in the diagnostic accuracy. RESULTS: The sensitivity of CAD was 87.3% with an FP per case of 302.4. CAD significantly improved the diagnostic performance of the four reviewers with a figure-of-merit (FOM) of 0.874 (without CAD) vs. 0.898 (with CAD) according to JAFROC analysis (p < 0.01). Statistically significant improvement was noted only for less-experienced reviewers (FOM without vs. with CAD, 0.834 vs. 0.877, p < 0.01). The additional time required to review the CAD results was approximately 72 sec (40% of the total review time). CONCLUSION: CAD as a second reader helps radiologists improve their diagnostic performance in the detection of BM on MR imaging, particularly for less-experienced reviewers.

Comparison Between CT and MR Images as More Favorable Reference Data Sets for Fusion Imaging-Guided Radiofrequency Ablation or Biopsy of Hepatic Lesions: A Prospective Study with Focus on Patient's Respiration.

PURPOSE: To identify the more accurate reference data sets for fusion imaging-guided radiofrequency ablation or biopsy of hepatic lesions between computed tomography (CT) and magnetic resonance (MR) images. MATERIALS AND METHODS: This study was approved by the institutional review board, and written informed consent was received from all patients. Twelve consecutive patients who were referred to assess the feasibility of radiofrequency ablation or biopsy were enrolled. Automatic registration using CT and MR images was performed in each patient. Registration errors during optimal and opposite respiratory phases, time required for image fusion and number of point locks used were compared using the Wilcoxon signed-rank test. RESULTS: The registration errors during optimal respiratory phase were not significantly different between image fusion using CT and MR images as reference data sets (p = 0.969). During opposite respiratory phase, the registration error was smaller with MR images than CT (p = 0.028). The time and the number of points locks needed for complete image fusion were not significantly different between CT and MR images (p = 0.328 and p = 0.317, respectively). CONCLUSION: MR images would be more suitable as the reference data set for fusion imaging-guided procedures of focal hepatic lesions than CT images.

Automatic image fusion of real-time ultrasound with computed tomography images: a prospective comparison between two auto-registration methods.

Background A major drawback of conventional manual image fusion is that the process may be complex, especially for less-experienced operators. Recently, two automatic image fusion techniques called Positioning and Sweeping auto-registration have been developed. Purpose To compare the accuracy and required time for image fusion of real-time ultrasonography (US) and computed tomography (CT) images between Positioning and Sweeping auto-registration. Material and Methods Eighteen consecutive patients referred for planning US for radiofrequency ablation or biopsy for focal hepatic lesions were enrolled. Image fusion using both auto-registration methods was performed for each patient. Registration error, time required for image fusion, and number of point locks used were compared using the Wilcoxon signed rank test. Results Image fusion was successful in all patients. Positioning auto-registration was significantly faster than Sweeping auto-registration for both initial (median, 11 s [range, 3-16 s] vs. 32 s [range, 21-38 s]; P < 0.001] and complete (median, 34.0 s [range, 26-66 s] vs. 47.5 s [range, 32-90]; P = 0.001] image fusion. Registration error of Positioning auto-registration was significantly higher for initial image fusion (median, 38.8 mm [range, 16.0-84.6 mm] vs. 18.2 mm [6.7-73.4 mm]; P = 0.029), but not for complete image fusion (median, 4.75 mm [range, 1.7-9.9 mm] vs. 5.8 mm [range, 2.0-13.0 mm]; P = 0.338]. Number of point locks required to refine the initially fused images was significantly higher with Positioning auto-registration (median, 2 [range, 2-3] vs. 1 [range, 1-2]; P = 0.012]. Conclusion Positioning auto-registration offers faster image fusion between real-time US and pre-procedural CT images than Sweeping auto-registration. The final registration error is similar between the two methods.

A prospective comparison between auto-registration and manual registration of real-time ultrasound with MR images for percutaneous ablation or biopsy of hepatic lesions.

PURPOSE: To compare the accuracy and required time for image fusion of real-time ultrasound (US) with pre-procedural magnetic resonance (MR) images between positioning auto-registration and manual registration for percutaneous radiofrequency ablation or biopsy of hepatic lesions. METHODS: This prospective study was approved by the institutional review board, and all patients gave written informed consent. Twenty-two patients (male/female, n = 18/n = 4; age, 61.0 ± 7.7 years) who were referred for planning US to assess the feasibility of radiofrequency ablation (n = 21) or biopsy (n = 1) for focal hepatic lesions were included. One experienced radiologist performed the two types of image fusion methods in each patient. The performance of auto-registration and manual registration was evaluated. The accuracy of the two methods, based on measuring registration error, and the time required for image fusion for both methods were recorded using in-house software and respectively compared using the Wilcoxon signed rank test. RESULTS: Image fusion was successful in all patients. The registration error was not significantly different between the two methods (auto-registration: median, 3.75 mm; range, 1.0-15.8 mm vs. manual registration: median, 2.95 mm; range, 1.2-12.5 mm, p = 0.242). The time required for image fusion was significantly shorter with auto-registration than with manual registration (median, 28.5 s; range, 18-47 s, vs. median, 36.5 s; range, 14-105 s, p = 0.026). CONCLUSION: Positioning auto-registration showed promising results compared with manual registration, with similar accuracy and even shorter registration time.

Automatic Registration between Real-Time Ultrasonography and Pre-Procedural Magnetic Resonance Images: A Prospective Comparison between Two Registration Methods by Liver Surface and Vessel and by Liver Surface Only.

The aim of this study was to compare the accuracy of and the time required for image fusion between real-time ultrasonography (US) and pre-procedural magnetic resonance (MR) images using automatic registration by a liver surface only method and automatic registration by a liver surface and vessel method. This study consisted of 20 patients referred for planning US to assess the feasibility of percutaneous radiofrequency ablation or biopsy for focal hepatic lesions. The first 10 consecutive patients were evaluated by an experienced radiologist using the automatic registration by liver surface and vessel method, whereas the remaining 10 patients were evaluated using the automatic registration by liver surface only method. For all 20 patients, image fusion was automatically executed after following the protocols and fused real-time US and MR images moved synchronously. The accuracy of each method was evaluated by measuring the registration error, and the time required for image fusion was assessed by evaluating the recorded data using in-house software. The results obtained using the two automatic registration methods were compared using the Mann-Whitney U-test. Image fusion was successful in all 20 patients, and the time required for image fusion was significantly shorter with the automatic registration by liver surface only method than with the automatic registration by liver surface and vessel method (median: 43.0 s, range: 29-74 s vs. median: 83.0 s, range: 46-101 s; p = 0.002). The registration error did not significantly differ between the two methods (median: 4.0 mm, range: 2.1-9.9 mm vs. median: 3.7 mm, range: 1.8-5.2 mm; p = 0.496). The automatic registration by liver surface only method offers faster image fusion between real-time US and pre-procedural MR images than does the automatic registration by liver surface and vessel method. However, the degree of accuracy was similar for the two methods.