Synthetic temporal bone CT generation from UTE-MRI using a cycleGAN-based deep learning model: advancing beyond CT-MR imaging fusion.

OBJECTIVES: The aim of this study is to develop a deep-learning model to create synthetic temporal bone computed tomography (CT) images from ultrashort echo-time magnetic resonance imaging (MRI) scans, thereby addressing the intrinsic limitations of MRI in localizing anatomic landmarks in temporal bone CT. MATERIALS AND METHODS: This retrospective study included patients who underwent temporal MRI and temporal bone CT within one month between April 2020 and March 2023. These patients were randomly divided into training and validation datasets. A CycleGAN model for generating synthetic temporal bone CT images was developed using temporal bone CT and pointwise encoding-time reduction with radial acquisition (PETRA). To assess the model's performance, the pixel count in mastoid air cells was measured. Two neuroradiologists evaluated the successful generation rates of 11 anatomical landmarks. RESULTS: A total of 102 patients were included in this study (training dataset, n = 54, mean age 58 ± 14, 34 females (63%); validation dataset, n = 48, mean age 61 ± 13, 29 females (60%)). In the pixel count of mastoid air cells, no difference was observed between synthetic and real images (679 ± 342 vs 738 ± 342, p = 0.13). For the six major anatomical sites, the positive generation rates were 97-100%, whereas those of the five major anatomical structures ranged from 24% to 83%. CONCLUSION: We developed a model to generate synthetic temporal bone CT images using PETRA MRI. This model can provide information regarding the major anatomic sites of the temporal bone using MRI. CLINICAL RELEVANCE STATEMENT: The proposed algorithm addresses the primary limitations of MRI in localizing anatomic sites within the temporal bone. KEY POINTS: CT is preferred for imaging the temporal bone, but has limitations in differentiating pathology there. The model achieved a high success rate in generating synthetic images of six anatomic sites. This can overcome the limitations of MRI in visualizing key anatomic sites in the temporal skull.

Development and multicenter validation of deep convolutional neural network-based detection of colorectal cancer on abdominal CT.

OBJECTIVES: This study aims to develop computer-aided detection (CAD) for colorectal cancer (CRC) using abdominal CT based on a deep convolutional neural network. METHODS: This retrospective study included consecutive patients with colorectal adenocarcinoma who underwent abdominal CT before CRC resection surgery (training set = 379, test set = 103). We customized the 3D U-Net of nnU-Net (CUNET) for CRC detection, which was trained with fivefold cross-validation using annotated CT images. CUNET was validated using datasets covering various clinical situations and institutions: an internal test set (n = 103), internal patients with CRC first determined by CT (n = 54) and asymptomatic CRC (n = 51), and an external validation set from two institutions (n = 60). During each validation, data from the healthy population were added (internal = 60; external = 130). CUNET was compared with other deep CNNs: residual U-Net and EfficientDet. The CAD performances were evaluated using per-CRC sensitivity (true positive/all CRCs), free-response receiver operating characteristic (FROC), and jackknife alternative FROC (JAFROC) curves. RESULTS: CUNET showed a higher maximum per-CRC sensitivity than residual U-Net and EfficientDet (internal test set 91.3% vs. 61.2%, and 64.1%). The per-CRC sensitivity of CUNET at false-positive rates of 3.0 was as follows: internal CRC determined by CT, 89.3%; internal asymptomatic CRC, 87.3%; and external validation, 89.6%. CUNET detected 69.2% (9/13) of CRCs missed by radiologists and 89.7% (252/281) of CRCs from all validation sets. CONCLUSIONS: CUNET can detect CRC on abdominal CT in patients with various clinical situations and from external institutions. KEY POINTS: • Customized 3D U-Net of nnU-Net (CUNET) can be applied to the opportunistic detection of colorectal cancer (CRC) in abdominal CT, helping radiologists detect unexpected CRC. • CUNET showed the best performance at false-positive rates ≥ 3.0, and 30.1% of false-positives were in the colorectum. CUNET detected 69.2% (9/13) of CRCs missed by radiologists and 87.3% (48/55) of asymptomatic CRCs. • CUNET detected CRCs in multiple validation sets composed of varying clinical situations and from different institutions, and CUNET detected 89.7% (252/281) of CRCs from all validation sets.

Deep learning model for differentiating nasal cavity masses based on nasal endoscopy images.

BACKGROUND: Nasal polyps and inverted papillomas often look similar. Clinically, it is difficult to distinguish the masses by endoscopic examination. Therefore, in this study, we aimed to develop a deep learning algorithm for computer-aided diagnosis of nasal endoscopic images, which may provide a more accurate clinical diagnosis before pathologic confirmation of the nasal masses. METHODS: By performing deep learning of nasal endoscope images, we evaluated our computer-aided diagnosis system's assessment ability for nasal polyps and inverted papilloma and the feasibility of their clinical application. We used curriculum learning pre-trained with patches of nasal endoscopic images and full-sized images. The proposed model's performance for classifying nasal polyps, inverted papilloma, and normal tissue was analyzed using five-fold cross-validation. RESULTS: The normal scores for our best-performing network were 0.9520 for recall, 0.7900 for precision, 0.8648 for F1-score, 0.97 for the area under the curve, and 0.8273 for accuracy. For nasal polyps, the best performance was 0.8162, 0.8496, 0.8409, 0.89, and 0.8273, respectively, for recall, precision, F1-score, area under the curve, and accuracy. Finally, for inverted papilloma, the best performance was obtained for recall, precision, F1-score, area under the curve, and accuracy values of 0.5172, 0.8125, 0.6122, 0.83, and 0.8273, respectively. CONCLUSION: Although there were some misclassifications, the results of gradient-weighted class activation mapping were generally consistent with the areas under the curve determined by otolaryngologists. These results suggest that the convolutional neural network is highly reliable in resolving lesion locations in nasal endoscopic images.

Identifying fragile calcifications of the aortic valve in transcatheter aortic valve replacement: iodine concentration of aortic valvular calcification by spectral CT.

OBJECTIVE: To demonstrate the relationship between spectral computed tomography (CT) measured iodine concentration and strength of aortic valvular calcification (AVC) in patients with aortic valve stenosis (AVS). METHODS: A retrospective study was performed on patients who underwent transcatheter aortic valve replacement (TAVR) for symptomatic AVS and underwent both pre and postprocedural electrocardiogram gated CT scans using a spectral CT system. Preprocedural CT was used to evaluate the volume and iodine concentration (IC) in the AVC. Postprocedural CT data were used to calculate the volume reduction percentage (VRP) of AVC. Multiple linear regression analysis was used to identify the independent variables related to the VRP in AVCs. RESULTS: A total of 94 AVCs were selected from 22 patients. The mean volume and IC of the AVCs before TAVR were 0.37 mL ± 0.15 mL and 7 mg/mL ± 10.5 mg/mL, respectively. After TAVR, a median VRP of all 94 AVCs was 18.5%. Multiple linear regression analysis showed that the IC was independently associated with the VRP (coefficient = 1.64, p < 0.001). When an optimal IC cutoff point was set at 4 mg/mL in the assessment of a fragile AVC which showed the VRP was > 18.5%, the sensitivity was 63%; specificity, 91%; positive predictive value, 88%; and negative predictive value, 71%. CONCLUSIONS: When using spectral CT to prepare the TAVR, measuring the IC of the AVC may be useful to assess the probability of AVC deformity after TAVR. KEY POINTS: • A dual-layer detector-based spectral CT enables quantifying iodine of contrast media in the aortic valve calcification (AVC) on contrast-enhanced CT images. • The AVC including iodine of contrast media on contrast-enhanced CT image may have loose compositions, associated with the deformity of AVC after TAVR. • Measuring the iodine concentration in AVC may have the potential to assess the probability of AVC deformity, which may be associated with the outcome and complications after TAVR.2.

Machine Learning-Based Magnetic Resonance Radiomics Analysis for Predicting Low- and High-Grade Clear Cell Renal Cell Carcinoma.

PURPOSE: To explore whether high- and low-grade clear cell renal cell carcinomas (ccRCC) can be distinguished using radiomics features extracted from magnetic resonance imaging. METHODS: In this retrospective study, 154 patients with pathologically proven clear ccRCC underwent contrast-enhanced 3 T magnetic resonance imaging and were assigned to the development (n = 122) and test (n = 32) cohorts in a temporal-split setup. A total of 834 radiomics features were extracted from whole-tumor volumes using 3 sequences: T2-weighted imaging (T2WI), diffusion-weighted imaging, and contrast-enhanced T1-weighted imaging. A random forest regressor was used to extract important radiomics features that were subsequently used for model development using the random forest algorithm. Tumor size, apparent diffusion coefficient value, and percentage of tumor-to-renal parenchymal signal intensity drop in the tumors were recorded by 2 radiologists for quantitative analysis. The area under the receiver operating characteristic curve (AUC) was generated to predict ccRCC grade. RESULTS: In the development cohort, the T2WI-based radiomics model demonstrated the highest performance (AUC, 0.82). The T2WI-based radiomics and radiologic feature hybrid model showed AUCs of 0.79 and 0.83, respectively. In the test cohort, the T2WI-based radiomics model achieved an AUC of 0.82. The range of AUCs of the hybrid model of T2WI-based radiomics and radiologic features was 0.73 to 0.80. CONCLUSION: Magnetic resonance imaging-based classifier models using radiomics features and machine learning showed satisfactory diagnostic performance in distinguishing between high- and low-grade ccRCC, thereby serving as a helpful noninvasive tool for predicting ccRCC grade.

Value of Breast MRI and Nomogram After Negative Axillary Ultrasound for Predicting Axillary Lymph Node Metastasis in Patients With Clinically T1-2 N0 Breast Cancer.

BACKGROUND: There are increasing concerns about that sentinel lymph node biopsy (SLNB) could be omitted in patients with clinically T1-2 N0 breast cancers who has negative axillary ultrasound (AUS). This study aims to assess the false negative result (FNR) of AUS, the rate of high nodal burden (HNB) in clinically T1-2 N0 breast cancer patients, and the diagnostic performance of breast magnetic resonance imaging (MRI) and nomogram. METHODS: We identified 948 consecutive patients with clinically T1-2 N0 cancers who had negative AUS, subsequent MRI, and breast conserving therapy between 2013 and 2020 from two tertiary medical centers. Patients from two centers were assigned to development and validation sets, respectively. Among 948 patients, 402 (mean age ± standard deviation, 57.61 ± 11.58) were within development cohort and 546 (54.43 ± 10.02) within validation cohort. Using logistic regression analyses, clinical-imaging factors associated with lymph node (LN) metastasis were analyzed in the development set from which nomogram was created. The performance of MRI and nomogram was assessed. HNB was defined as ≥ 3 positive LNs. RESULTS: The FNR of AUS was 20.1% (81 of 402) and 19.2% (105 of 546) and the rates of HNB were 1.2% (5/402) and 2.2% (12/546), respectively. Clinical and imaging features associated with LN metastasis were progesterone receptor positivity, outer tumor location on mammography, breast imaging reporting and data system category 5 assessment of cancer on ultrasound, and positive axilla on MRI. In validation cohorts, the positive predictive value (PPV) and negative predictive value (NPV) of MRI and clinical-imaging nomogram was 58.5% and 86.5%, and 56.0% and 82.0%, respectively. CONCLUSION: The FNR of AUS was approximately 20% but the rate of HNB was low. The diagnostic performance of MRI was not satisfactory with low PPV but MRI had merit in reaffirming negative AUS with high NPV. Patients who had low probability scores from our clinical-imaging nomogram might be possible candidates for the omission of SLNB.

Aortic Annulus Detection Based on Deep Learning for Transcatheter Aortic Valve Replacement Using Cardiac Computed Tomography.

BACKGROUND: To propose a deep learning architecture for automatically detecting the complex structure of the aortic annulus plane using cardiac computed tomography (CT) for transcatheter aortic valve replacement (TAVR). METHODS: This study retrospectively reviewed consecutive patients who underwent TAVR between January 2017 and July 2020 at a tertiary medical center. Annulus Detection Permuted AdaIN network (ADPANet) based on a three-dimensional (3D) U-net architecture was developed to detect and localize the aortic annulus plane using cardiac CT. Patients (N = 72) who underwent TAVR between January 2017 and July 2020 at a tertiary medical center were enrolled. Ground truth using a limited dataset was delineated manually by three cardiac radiologists. Training, tuning, and testing sets (70:10:20) were used to build the deep learning model. The performance of ADPANet for detecting the aortic annulus plane was analyzed using the root mean square error (RMSE) and dice similarity coefficient (DSC). RESULTS: In this study, the total dataset consisted of 72 selected scans from patients who underwent TAVR. The RMSE and DSC values for the aortic annulus plane using ADPANet were 55.078 ± 35.794 and 0.496 ± 0.217, respectively. CONCLUSION: Our deep learning framework was feasible to detect the 3D complex structure of the aortic annulus plane using cardiac CT for TAVR. The performance of our algorithms was higher than other convolutional neural networks.

Synthetic Time of Flight Magnetic Resonance Angiography Generation Model Based on Cycle-Consistent Generative Adversarial Network Using PETRA-MRA in the Patients With Treated Intracranial Aneurysm.

BACKGROUND: Pointwise encoding time reduction with radial acquisition (PETRA) magnetic resonance angiography (MRA) is useful for evaluating intracranial aneurysm recurrence, but the problem of severe background noise and low peripheral signal-to-noise ratio (SNR) remain. Deep learning could reduce noise using high- and low-quality images. PURPOSE: To develop a cycle-consistent generative adversarial network (cycleGAN)-based deep learning model to generate synthetic TOF (synTOF) using PETRA. STUDY TYPE: Retrospective. POPULATION: A total of 377 patients (mean age: 60 ± 11; 293 females) with treated intracranial aneurysms who underwent both PETRA and TOF from October 2017 to January 2021. Data were randomly divided into training (49.9%, 188/377) and validation (50.1%, 189/377) groups. FIELD STRENGTH/SEQUENCE: Ultra-short echo time and TOF-MRA on a 3-T MR system. ASSESSMENT: For the cycleGAN model, the peak SNR (PSNR) and structural similarity (SSIM) were evaluated. Image quality was compared qualitatively (5-point Likert scale) and quantitatively (SNR). A multireader diagnostic optimality evaluation was performed with 17 radiologists (experience of 1-18 years). STATISTICAL TESTS: Generalized estimating equation analysis, Friedman's test, McNemar test, and Spearman's rank correlation. P < 0.05 indicated statistical significance. RESULTS: The PSNR and SSIM between synTOF and TOF were 17.51 [16.76; 18.31] dB and 0.71 ± 0.02. The median values of overall image quality, noise, sharpness, and vascular conspicuity were significantly higher for synTOF than for PETRA (4.00 [4.00; 5.00] vs. 4.00 [3.00; 4.00]; 5.00 [4.00; 5.00] vs. 3.00 [2.00; 4.00]; 4.00 [4.00; 4.00] vs. 4.00 [3.00; 4.00]; 3.00 [3.00; 4.00] vs. 3.00 [2.00; 3.00]). The SNRs of the middle cerebral arteries were the highest for synTOF (synTOF vs. TOF vs. PETRA; 63.67 [43.25; 105.00] vs. 52.42 [32.88; 74.67] vs. 21.05 [12.34; 37.88]). In the multireader evaluation, there was no significant difference in diagnostic optimality or preference between synTOF and TOF (19.00 [18.00; 19.00] vs. 20.00 [18.00; 20.00], P = 0.510; 8.00 [6.00; 11.00] vs. 11.00 [9.00, 14.00], P = 1.000). DATA CONCLUSION: The cycleGAN-based deep learning model provided synTOF free from background artifact. The synTOF could be a versatile alternative to TOF in patients who have undergone PETRA for evaluating treated aneurysms. EVIDENCE LEVEL: 4 TECHNICAL EFFICACY: Stage 1.

Machine learning with multiparametric breast MRI for prediction of Ki-67 and histologic grade in early-stage luminal breast cancer.

OBJECTIVES: To investigate whether machine learning-based prediction models using 3-T multiparametric MRI (mpMRI) can predict Ki-67 and histologic grade in stage I-II luminal cancer. METHODS: Between 2013 and 2019, consecutive women with luminal cancers who underwent preoperative MRI with diffusion-weighted imaging (DWI) and surgery were included. For prediction models, morphology, kinetic features using computer-aided diagnosis (CAD), and apparent diffusion coefficient (ADC) at DWI were evaluated by two radiologists. Logistic regression analysis was used to identify mpMRI features for predicting Ki-67 and grade. Diagnostic performance was assessed using eight machine learning algorithms incorporating mpMRI features and compared using the DeLong method. RESULTS: Of 300 women, 203 (67.7%) had low Ki-67 and 97 (32.3%) had high Ki-67; 242 (80.7%) had low grade and 58 (19.3%) had high grade. In multivariate analysis, independent predictors for higher Ki-67 were washout component > 13.5% (odds ratio [OR] = 4.16; p < 0.001) and intratumoral high SI on T2-weighted image (OR = 1.89; p = 0.022). Those for higher grade were washout component > 15.5% (OR = 7.22; p < 0.001), rim enhancement (OR = 2.59; p = 0.022), and ADC value < 0.945 × 10-3 mm2/s (OR = 2.47; p = 0.015). Among eight models using these predictors, six models showed the equivalent performance for Ki-67 (area under the receiver operating characteristic curve [AUC]: 0.70) and Naive Bayes classifier showed the highest performance for grade (AUC: 0.79). CONCLUSIONS: A prediction model incorporating mpMRI features shows good diagnostic performance for predicting Ki-67 and histologic grade in patients with luminal breast cancers. KEY POINTS: • Among multiparametric MRI features, kinetic feature of washout component >13.5% and intratumoral high signal intensity on T2-weighted image were associated with higher Ki-67. • Washout component >15.5%, rim enhancement, and mean apparent diffusion coefficient value < 0.945 × 10-3 mm2/s were associated with higher histologic grade. • Machine learning-based prediction models incorporating multiparametric MRI features showed good diagnostic performance for Ki-67 and histologic grade in luminal breast cancers.

Diagnostic Feasibility of Magnetic Resonance Elastography Radiomics Analysis for the Assessment of Hepatic Fibrosis in Patients With Nonalcoholic Fatty Liver Disease.

OBJECTIVE: The aim of the study was to investigate the diagnostic feasibility of radiomics analysis using magnetic resonance elastography (MRE) to assess hepatic fibrosis in patients with nonalcoholic fatty liver disease (NAFLD). METHODS: One hundred patients with suspected NAFLD were retrospectively enrolled. All patients underwent a liver parenchymal biopsy. Magnetic resonance elastography was performed using a 3.0-T scanner. After multislice segmentation of MRE images, 834 radiomic features were analyzed using a commercial program. Radiologic features, such as median and mean values of the regions of interest and variable clinical features, were analyzed. A random forest regressor was used to extract important radiomic, radiological, and clinical features. A random forest classifier model was trained to use these features to classify the fibrosis stage. The area under the receiver operating characteristic curve was evaluated using a classifier for fibrosis stage diagnosis. RESULTS: The pathological hepatic fibrosis stage was classified as low-grade fibrosis (stages F0-F1, n = 82) or clinically significant fibrosis (stages F2-F4, n = 18). Eight important features were extracted from radiomics analysis, with the 2 most important being wavelet-high high low gray level dependence matrix dependence nonuniformity-normalized and wavelet-high high low gray level dependence matrix dependence entropy. The median value of the multiple small regions of interest was identified as the most important radiologic feature. Platelet count has been identified as an important clinical feature. The area under the receiver operating characteristic curve of the classifier using radiomics was comparable with that of radiologic measures (0.97 ± 0.07 and 0.96 ± 0.06, respectively). CONCLUSIONS: Magnetic resonance elastography radiomics analysis provides diagnostic performance comparable with conventional MRE analysis for the assessment of clinically significant hepatic fibrosis in patients with NAFLD.