Deep learning-assisted diagnosis of benign and malignant parotid tumors based on ultrasound: a retrospective study.

BACKGROUND: To develop a deep learning(DL) model utilizing ultrasound images, and evaluate its efficacy in distinguishing between benign and malignant parotid tumors (PTs), as well as its practicality in assisting clinicians with accurate diagnosis. METHODS: A total of 2211 ultrasound images of 980 pathologically confirmed PTs (Training set: n = 721; Validation set: n = 82; Internal-test set: n = 89; External-test set: n = 88) from 907 patients were retrospectively included in this study. The optimal model was selected and the diagnostic performance evaluation is conducted by utilizing the area under curve (AUC) of the receiver-operating characteristic(ROC) based on five different DL networks constructed at varying depths. Furthermore, a comparison of different seniority radiologists was made in the presence of the optimal auxiliary diagnosis model. Additionally, the diagnostic confusion matrix of the optimal model was calculated, and an analysis and summary of misjudged cases' characteristics were conducted. RESULTS: The Resnet18 demonstrated superior diagnostic performance, with an AUC value of 0.947, accuracy of 88.5%, sensitivity of 78.2%, and specificity of 92.7% in internal-test set, and with an AUC value of 0.925, accuracy of 89.8%, sensitivity of 83.3%, and specificity of 90.6% in external-test set. The PTs were subjectively assessed twice by six radiologists, both with and without the assisted of the model. With the assisted of the model, both junior and senior radiologists demonstrated enhanced diagnostic performance. In the internal-test set, there was an increase in AUC values by 0.062 and 0.082 for junior radiologists respectively, while senior radiologists experienced an improvement of 0.066 and 0.106 in their respective AUC values. CONCLUSIONS: The DL model based on ultrasound images demonstrates exceptional capability in distinguishing between benign and malignant PTs, thereby assisting radiologists of varying expertise levels to achieve heightened diagnostic performance, and serve as a noninvasive imaging adjunct diagnostic method for clinical purposes.

Deep learning approaches for differentiating thyroid nodules with calcification: a two-center study.

BACKGROUND: Calcification is a common phenomenon in both benign and malignant thyroid nodules. However, the clinical significance of calcification remains unclear. Therefore, we explored a more objective method for distinguishing between benign and malignant thyroid calcified nodules. METHODS: This retrospective study, conducted at two centers, involved a total of 631 thyroid nodules, all of which were pathologically confirmed. Ultrasound image sets were employed for analysis. The primary evaluation index was the area under the receiver-operator characteristic curve (AUROC). We compared the diagnostic performance of deep learning (DL) methods with that of radiologists and determined whether DL could enhance the diagnostic capabilities of radiologists. RESULTS: The Xception classification model exhibited the highest performance, achieving an AUROC of up to 0.970, followed by the DenseNet169 model, which attained an AUROC of up to 0.959. Notably, both DL models outperformed radiologists (P < 0.05). The success of the Xception model can be attributed to its incorporation of deep separable convolution, which effectively reduces the model's parameter count. This feature enables the model to capture features more effectively during the feature extraction process, resulting in superior performance, particularly when dealing with limited data. CONCLUSIONS: This study conclusively demonstrated that DL outperformed radiologists in differentiating between benign and malignant calcified thyroid nodules. Additionally, the diagnostic capabilities of radiologists could be enhanced with the aid of DL.

Leveraging deep learning to identify calcification and colloid in thyroid nodules.

Background: Both calcification and colloid in thyroid nodules are reflected as echogenic foci in ultrasound images. However, calcification and colloid have significantly different probabilities of malignancy. We explored the performance of a deep learning (DL) model in distinguishing the echogenic foci of thyroid nodules as calcification or colloid. Methods: We conducted a retrospective study using ultrasound image sets. The DL model was trained and tested on 30,388 images of 1127 nodules. All nodules were pathologically confirmed. The area under the receiver-operator characteristic curve (AUC) was employed as the primary evaluation index. Results: The YoloV5 (You Only Look Once Version 5) transfer learning model for thyroid nodules based on DL detection showed that the average sensitivity, specificity, and accuracy of distinguishing echogenic foci in the test 1 group (n = 192) was 78.41%, 91.36%, and 77.81%, respectively. The average sensitivity, specificity, and accuracy of the three radiologists were 51.14%, 82.58%, and 61.29%, respectively. The average sensitivity, specificity, and accuracy of distinguishing small echogenic foci in the test 2 group (n = 58) was 70.17%, 77.14%, and 73.33%, respectively. Correspondingly, the average sensitivity, specificity, and accuracy of the radiologists were 57.69%, 63.29%, and 59.38%. Conclusions: The study demonstrated that DL performed far better than radiologists in distinguishing echogenic foci of thyroid nodules as calcifications or colloid.

The auxiliary diagnosis of thyroid echogenic foci based on a deep learning segmentation model: A two-center study.

OBJECTIVE: The aim of this study is to develop AI-assisted software incorporating a deep learning (DL) model based on static ultrasound images. The software aims to aid physicians in distinguishing between malignant and benign thyroid nodules with echogenic foci and to investigate how the AI-assisted DL model can enhance radiologists' diagnostic performance. METHODS: For this retrospective study, a total of 2724 ultrasound (US) scans were collected from two independent institutions, encompassing 1038 echogenic foci nodules. All echogenic foci were confirmed by pathology. Three DL segmentation models (DeepLabV3+, U-Net, and PSPNet) were developed, with each model using two different backbones to extract features from the nodular regions with echogenic foci. Evaluation indexes such as Mean Intersection over Union (MIoU), Mean Pixel Accuracy (MPA), and Dice coefficients were employed to assess the performance of the segmentation model. The model demonstrating the best performance was selected to develop the AI-assisted diagnostic software, enabling radiologists to benefit from AI-assisted diagnosis. The diagnostic performance of radiologists with varying levels of seniority and beginner radiologists in assessing high-echo nodules was then compared, both with and without the use of auxiliary strategies. The area under the receiver operating characteristic curve (AUROC) was used as the primary evaluation index, both with and without the use of auxiliary strategies. RESULTS: In the analysis of Institution 2, the DeepLabV3+ (backbone is MobileNetV2 exhibited optimal segmentation performance, with MIoU = 0.891, MPA = 0.945, and Dice = 0.919. The combined AUROC (0.693 [95% CI 0.595-0.791]) of radiology beginners using AI-assisted strategies was significantly higher than those without such strategies (0.551 [0.445-0.657]). Additionally, the combined AUROC of junior physicians employing adjuvant strategies improved from 0.674 [0.574-0.774] to 0.757 [0.666-0.848]. Similarly, the combined AUROC of senior physicians increased slightly, rising from 0.745 [0.652-0.838] to 0.813 [0.730-0.896]. With the implementation of AI-assisted strategies, the accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of both senior physicians and beginners in the radiology department underwent varying degrees of improvement. CONCLUSIONS: This study demonstrates that the DL-based auxiliary diagnosis model using US static images can improve the performance of radiologists and radiology students in identifying thyroid echogenic foci.

Value of Artificial Intelligence in Improving the Accuracy of Diagnosing TI-RADS Category 4 Nodules.

OBJECTIVE: Considerable heterogeneity is observed in the malignancy rates of thyroid nodules classified as category 4 according to the Thyroid Imaging Reporting and Data System (TI-RADS). This study was aimed at comparing the diagnostic performance of artificial intelligence algorithms and radiologists with different experience levels in distinguishing benign and malignant TI-RADS 4 (TR4) nodules. METHODS: Between January 2019 and September 2022, 1117 TR4 nodules with well-defined pathological findings were collected for this retrospective study. An independent external data set of 125 TR4 nodules was incorporated for testing purposes. Traditional feature-based machine learning (ML) models, deep convolutional neural networks (DCNN) models and a fusion model that integrated the prediction outcomes from all models were used to classify benign and malignant TR4 nodules. A fivefold cross-validation approach was employed, and the diagnostic performance of each model and radiologists was compared. RESULTS: In the external test data set, the area under the receiver operating characteristic curve (AUROC) of the three DCNN-based secondary transfer learning models-InceptionV3, DenseNet121 and ResNet50-were 0.852, 0.837 and 0.856, respectively. These values were higher than those of the three traditional ML models-logistic regression, multilayer perceptron and random forest-at 0.782, 0.790, and 0.767, respectively, and higher than that of an experienced radiologist (0.815). The fusion diagnostic model we developed, with an AUROC of 0.880, was found to outperform the experienced radiologist in diagnosing TR4 nodules. CONCLUSION: The integration of artificial intelligence algorithms into medical imaging studies could improve the accuracy of identifying high-risk TR4 nodules pre-operatively and have significant clinical application potential.