Artificial intelligence - based ultrasound elastography for disease evaluation - a narrative review.

Ultrasound elastography (USE) provides complementary information of tissue stiffness and elasticity to conventional ultrasound imaging. It is noninvasive and free of radiation, and has become a valuable tool to improve diagnostic performance with conventional ultrasound imaging. However, the diagnostic accuracy will be reduced due to high operator-dependence and intra- and inter-observer variability in visual observations of radiologists. Artificial intelligence (AI) has great potential to perform automatic medical image analysis tasks to provide a more objective, accurate and intelligent diagnosis. More recently, the enhanced diagnostic performance of AI applied to USE have been demonstrated for various disease evaluations. This review provides an overview of the basic concepts of USE and AI techniques for clinical radiologists and then introduces the applications of AI in USE imaging that focus on the following anatomical sites: liver, breast, thyroid and other organs for lesion detection and segmentation, machine learning (ML) - assisted classification and prognosis prediction. In addition, the existing challenges and future trends of AI in USE are also discussed.

Ultrasound elastography.

Physicians have used palpation as a diagnostic examination to understand the elastic properties of pathology for a long time since they realized that tissue stiffness is closely related to its biological characteristics. US elastography provided new diagnostic information about elasticity comparing with the morphological feathers of traditional US, and thus expanded the scope of the application in clinic. US elastography is now widely used in the field of diagnosis and differential diagnosis of abnormality, evaluating the degree of fibrosis and assessment of treatment response for a range of diseases. The World Federation of Ultrasound Medicine and Biology divided elastographic techniques into strain elastography (SE), transient elastography and acoustic radiation force impulse (ARFI). The ARFI techniques can be further classified into point shear wave elastography (SWE), 2D SWE, and 3D SWE techniques. The SE measures the strain, while the shear wave-based techniques (including TE and ARFI techniques) measure the speed of shear waves in tissues. In this review, we discuss the various techniques separately based on their basic principles, clinical applications in various organs, and advantages and limitations and which might be most appropriate given that the majority of doctors have access to only one kind of machine.

The diagnostic performance of ultrasound computer-aided diagnosis system for distinguishing breast masses: a prospective multicenter study.

OBJECTIVES: To evaluate the diagnostic value of computer-aided diagnosis (CAD) software on ultrasound in distinguishing benign and malignant breast masses and avoiding unnecessary biopsy. METHODS: This prospective, multicenter study included patients who were scheduled for pathological diagnosis of breast masses between April 2019 and November 2020. Ultrasound images, videos, CAD analysis, and BI-RADS were obtained. The AUC, accuracy, sensitivity, specificity, PPV, and NPV were calculated and compared with radiologists. RESULTS: Overall, 901 breast masses in 901 patients were enrolled in this study. The accuracy, sensitivity, specificity, PPV and NPV of CAD software were 89.6%, 94.2%, 87.0%, 80.4%, and 96.3, respectively, in the long-axis section; 89.0%, 91.4%, 87.7%, 80.8%, and 94.7%, respectively, in the short-axis section. With BI-RADS 4a as the cut-off value, CAD software has a higher AUC (0.906 vs 0.734 vs 0.696, all p < 0.001) than both experienced and less experienced radiologists. With BI-RADS 4b as the cut-off value, CAD software showed better AUC than less experienced radiologists (0.906 vs 0.874, p < 0.001), but not superior to experienced radiologists (0.906 vs 0.883, p = 0.057). After the application of CAD software, the unnecessary biopsy rate of BI-RADS categories 4 and 5 was significantly decreased (33.0% vs 11.9%, 37.8% vs 14.5%), and the malignant rate of biopsy in category 4a was significantly increased (11.6% vs 40.7%, 7.4% vs 34.9%, all p < 0.001). CONCLUSIONS: CAD software on ultrasound can be used as an effective auxiliary diagnostic tool for differential diagnosis of benign and malignant breast masses and reducing unnecessary biopsy. CLINICAL TRIAL REGISTRATION: ClinicalTrials.gov (NCT03887598) KEY POINTS: • Prospective multicenter study showed that computer-aided diagnosis software provides greater diagnostic confidence for differentiating benign and malignant breast masses. • Computer-aided diagnosis software can help radiologists reduce unnecessary biopsy. • The management of patients with breast masses becomes more appropriate.

Added Value of a New Strain Elastography Technique in Conventional Ultrasound for the Diagnosis of Breast Masses: A Prospective Multicenter Study.

OBJECTIVE: This study aimed to explore the value of elasticity score (ES) and strain ratio (SR) combined with conventional ultrasound in distinguishing benign and malignant breast masses and reducing biopsy of BI-RADS (Breast Imaging Reporting and Data System) 4a lesions. METHODS: This prospective, multicenter study included 910 patients from nine different hospitals. The acquisition and analysis of conventional ultrasound and strain elastography (SE) were obtained by radiologists with more than 5 years of experience in breast ultrasound imaging. The diagnostic sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and area under curve (AUC) of conventional ultrasound alone and combined tests with ES and/or SR were calculated and compared. RESULTS: The optimal cutoff value of SR for differentiating benign from malignant masses was 2.27, with a sensitivity of 60.2% and a specificity of 84.8%. When combined with ES and SR, the AUC of the new BI-RADS classification increased from 0.733 to 0.824 (p < 0.001); the specificity increased from 48.1% to 68.5% (p < 0.001) without a decrease in the sensitivity (98.5% vs. 96.4%, p = 0.065); and the PPV increased from 52.2% to 63.7% (p < 0.001) without a loss in the NPV (98.2% vs. 97.1%, p = 0.327). All three combinations of conventional ultrasound, ES, and SR could reduce the biopsy rate of category 4a lesions without reducing the malignant rate of biopsy (from 100% to 68.3%, 34.9%, and 50.4%, respectively, all p < 0.001). CONCLUSIONS: SE can be used as a useful and non-invasive additional method to improve the diagnostic performance of conventional ultrasound by increasing AUC and specificity and reducing the unnecessary biopsy of BI-RADS 4a lesions.

A Review of the Role of the S-Detect Computer-Aided Diagnostic Ultrasound System in the Evaluation of Benign and Malignant Breast and Thyroid Masses.

Computer-aided diagnosis (CAD) systems have attracted extensive attention owing to their performance in the field of image diagnosis and are rapidly becoming a promising auxiliary tool in medical imaging tasks. These systems can quantitatively evaluate complex medical imaging features and achieve efficient and high-diagnostic accuracy. Deep learning is a representation learning method. As a major branch of artificial intelligence technology, it can directly process original image data by simulating the structure of the human brain neural network, thus independently completing the task of image recognition. S-Detect is a novel and interactive CAD system based on a deep learning algorithm, which has been integrated into ultrasound equipment and can help radiologists identify benign and malignant nodules, reduce physician workload, and optimize the ultrasound clinical workflow. S-Detect is becoming one of the most commonly used CAD systems for ultrasound evaluation of breast and thyroid nodules. In this review, we describe the S-Detect workflow and outline its application in breast and thyroid nodule detection. Finally, we discuss the difficulties and challenges faced by S-Detect as a precision medical tool in clinical practice and its prospects.

Preoperative Prediction of Microvascular Invasion in Patients With Hepatocellular Carcinoma Based on Radiomics Nomogram Using Contrast-Enhanced Ultrasound.

PURPOSE: This study aimed to develop a radiomics nomogram based on contrast-enhanced ultrasound (CEUS) for preoperatively assessing microvascular invasion (MVI) in hepatocellular carcinoma (HCC) patients. METHODS: A retrospective dataset of 313 HCC patients who underwent CEUS between September 20, 2016 and March 20, 2020 was enrolled in our study. The study population was randomly grouped as a primary dataset of 192 patients and a validation dataset of 121 patients. Radiomics features were extracted from the B-mode (BM), artery phase (AP), portal venous phase (PVP), and delay phase (DP) images of preoperatively acquired CEUS of each patient. After feature selection, the BM, AP, PVP, and DP radiomics scores (Rad-score) were constructed from the primary dataset. The four radiomics scores and clinical factors were used for multivariate logistic regression analysis, and a radiomics nomogram was then developed. We also built a preoperative clinical prediction model for comparison. The performance of the radiomics nomogram was evaluated via calibration, discrimination, and clinical usefulness. RESULTS: Multivariate analysis indicated that the PVP and DP Rad-score, tumor size, and AFP (alpha-fetoprotein) level were independent risk predictors associated with MVI. The radiomics nomogram incorporating these four predictors revealed a superior discrimination to the clinical model (based on tumor size and AFP level) in the primary dataset (AUC: 0.849 vs. 0.690; p < 0.001) and validation dataset (AUC: 0.788 vs. 0.661; p = 0.008), with a good calibration. Decision curve analysis also confirmed that the radiomics nomogram was clinically useful. Furthermore, the significant improvement of net reclassification index (NRI) and integrated discriminatory improvement (IDI) implied that the PVP and DP radiomics signatures may be very useful biomarkers for MVI prediction in HCC. CONCLUSION: The CEUS-based radiomics nomogram showed a favorable predictive value for the preoperative identification of MVI in HCC patients and could guide a more appropriate surgical planning.

Deep Learning Based on ACR TI-RADS Can Improve the Differential Diagnosis of Thyroid Nodules.

OBJECTIVE: The purpose of this study was to improve the differentiation between malignant and benign thyroid nodules using deep learning (DL) in category 4 and 5 based on the Thyroid Imaging Reporting and Data System (TI-RADS, TR) from the American College of Radiology (ACR). DESIGN AND METHODS: From June 2, 2017 to April 23, 2019, 2082 thyroid ultrasound images from 1396 consecutive patients with confirmed pathology were retrospectively collected, of which 1289 nodules were category 4 (TR4) and 793 nodules were category 5 (TR5). Ninety percent of the B-mode ultrasound images were applied for training and validation, and the residual 10% and an independent external dataset for testing purpose by three different deep learning algorithms. RESULTS: In the independent test set, the DL algorithm of best performance got an AUC of 0.904, 0.845, 0.829 in TR4, TR5, and TR4&5, respectively. The sensitivity and specificity of the optimal model was 0.829, 0.831 on TR4, 0.846, 0.778 on TR5, 0.790, 0.779 on TR4&5, versus the radiologists of 0.686 (P=0.108), 0.766 (P=0.101), 0.677 (P=0.211), 0.750 (P=0.128), and 0.680 (P=0.023), 0.761 (P=0.530), respectively. CONCLUSIONS: The study demonstrated that DL could improve the differentiation of malignant from benign thyroid nodules and had significant potential for clinical application on TR4 and TR5.

Lymph Node Metastasis Prediction from Primary Breast Cancer US Images Using Deep Learning.

Background Deep learning (DL) algorithms are gaining extensive attention for their excellent performance in image recognition tasks. DL models can automatically make a quantitative assessment of complex medical image characteristics and achieve increased accuracy in diagnosis with higher efficiency. Purpose To determine the feasibility of using a DL approach to predict clinically negative axillary lymph node metastasis from US images in patients with primary breast cancer. Materials and Methods A data set of US images in patients with primary breast cancer with clinically negative axillary lymph nodes from Tongji Hospital (974 imaging studies from 2016 to 2018, 756 patients) and an independent test set from Hubei Cancer Hospital (81 imaging studies from 2018 to 2019, 78 patients) were collected. Axillary lymph node status was confirmed with pathologic examination. Three different convolutional neural networks (CNNs) of Inception V3, Inception-ResNet V2, and ResNet-101 architectures were trained on 90% of the Tongji Hospital data set and tested on the remaining 10%, as well as on the independent test set. The performance of the models was compared with that of five radiologists. The models' performance was analyzed in terms of accuracy, sensitivity, specificity, receiver operating characteristic curves, areas under the receiver operating characteristic curve (AUCs), and heat maps. Results The best-performing CNN model, Inception V3, achieved an AUC of 0.89 (95% confidence interval [CI]: 0.83, 0.95) in the prediction of the final clinical diagnosis of axillary lymph node metastasis in the independent test set. The model achieved 85% sensitivity (35 of 41 images; 95% CI: 70%, 94%) and 73% specificity (29 of 40 images; 95% CI: 56%, 85%), and the radiologists achieved 73% sensitivity (30 of 41 images; 95% CI: 57%, 85%; P = .17) and 63% specificity (25 of 40 images; 95% CI: 46%, 77%; P = .34). Conclusion Using US images from patients with primary breast cancer, deep learning models can effectively predict clinically negative axillary lymph node metastasis. Artificial intelligence may provide an early diagnostic strategy for lymph node metastasis in patients with breast cancer with clinically negative lymph nodes. Published under a CC BY 4.0 license. Online supplemental material is available for this article. See also the editorial by Bae in this issue.

Artificial intelligence in breast ultrasound.

Artificial intelligence (AI) is gaining extensive attention for its excellent performance in image-recognition tasks and increasingly applied in breast ultrasound. AI can conduct a quantitative assessment by recognizing imaging information automatically and make more accurate and reproductive imaging diagnosis. Breast cancer is the most commonly diagnosed cancer in women, severely threatening women's health, the early screening of which is closely related to the prognosis of patients. Therefore, utilization of AI in breast cancer screening and detection is of great significance, which can not only save time for radiologists, but also make up for experience and skill deficiency on some beginners. This article illustrates the basic technical knowledge regarding AI in breast ultrasound, including early machine learning algorithms and deep learning algorithms, and their application in the differential diagnosis of benign and malignant masses. At last, we talk about the future perspectives of AI in breast ultrasound.

Artificial intelligence in medical imaging of the liver.

Artificial intelligence (AI), particularly deep learning algorithms, is gaining extensive attention for its excellent performance in image-recognition tasks. They can automatically make a quantitative assessment of complex medical image characteristics and achieve an increased accuracy for diagnosis with higher efficiency. AI is widely used and getting increasingly popular in the medical imaging of the liver, including radiology, ultrasound, and nuclear medicine. AI can assist physicians to make more accurate and reproductive imaging diagnosis and also reduce the physicians' workload. This article illustrates basic technical knowledge about AI, including traditional machine learning and deep learning algorithms, especially convolutional neural networks, and their clinical application in the medical imaging of liver diseases, such as detecting and evaluating focal liver lesions, facilitating treatment, and predicting liver treatment response. We conclude that machine-assisted medical services will be a promising solution for future liver medical care. Lastly, we discuss the challenges and future directions of clinical application of deep learning techniques.