Deep learning-based predictive model for pathological complete response to neoadjuvant chemotherapy in breast cancer from biopsy pathological images: a multicenter study.

Introduction: Early predictive pathological complete response (pCR) is beneficial for optimizing neoadjuvant chemotherapy (NAC) strategies for breast cancer. The hematoxylin and eosin (HE)-stained slices of biopsy tissues contain a large amount of information on tumor epithelial cells and stromal. The fusion of pathological image features and clinicopathological features is expected to build a model to predict pCR of NAC in breast cancer. Methods: We retrospectively collected a total of 440 breast cancer patients from three hospitals who underwent NAC. HE-stained slices of biopsy tissues were scanned to form whole-slide images (WSIs), and pathological images of representative regions of interest (ROI) of each WSI were selected at different magnifications. Based on several different deep learning models, we propose a novel feature extraction method on pathological images with different magnifications. Further, fused with clinicopathological features, a multimodal breast cancer NAC pCR prediction model based on a support vector machine (SVM) classifier was developed and validated with two additional validation cohorts (VCs). Results: Through experimental validation of several different deep learning models, we found that the breast cancer pCR prediction model based on the SVM classifier, which uses the VGG16 model for feature extraction of pathological images at ×20 magnification, has the best prediction efficacy. The area under the curve (AUC) of deep learning pathological model (DPM) were 0.79, 0.73, and 0.71 for TC, VC1, and VC2, respectively, all of which exceeded 0.70. The AUCs of clinical model (CM), a clinical prediction model established by using clinicopathological features, were 0.79 for TC, 0.73 for VC1, and 0.71 for VC2, respectively. The multimodal deep learning clinicopathological model (DPCM) established by fusing pathological images and clinicopathological features improved the AUC of TC from 0.79 to 0.84. The AUC of VC2 improved from 0.71 to 0.78. Conclusion: Our study reveals that pathological images of HE-stained slices of pre-NAC biopsy tissues can be used to build a pCR prediction model. Combining pathological images and clinicopathological features can further enhance the predictive efficacy of the model.

Prospective assessment of breast lesions AI classification model based on ultrasound dynamic videos and ACR BI-RADS characteristics.

Introduction: AI-assisted ultrasound diagnosis is considered a fast and accurate new method that can reduce the subjective and experience-dependent nature of handheld ultrasound. In order to meet clinical diagnostic needs better, we first proposed a breast lesions AI classification model based on ultrasound dynamic videos and ACR BI-RADS characteristics (hereafter, Auto BI-RADS). In this study, we prospectively verify its performance. Methods: In this study, the model development was based on retrospective data including 480 ultrasound dynamic videos equivalent to 18122 static images of pathologically proven breast lesions from 420 patients. A total of 292 breast lesions ultrasound dynamic videos from the internal and external hospital were prospectively tested by Auto BI-RADS. The performance of Auto BI-RADS was compared with both experienced and junior radiologists using the DeLong method, Kappa test, and McNemar test. Results: The Auto BI-RADS achieved an accuracy, sensitivity, and specificity of 0.87, 0.93, and 0.81, respectively. The consistency of the BI-RADS category between Auto BI-RADS and the experienced group (Kappa:0.82) was higher than that of the juniors (Kappa:0.60). The consistency rates between Auto BI-RADS and the experienced group were higher than those between Auto BI-RADS and the junior group for shape (93% vs. 80%; P = .01), orientation (90% vs. 84%; P = .02), margin (84% vs. 71%; P = .01), echo pattern (69% vs. 56%; P = .001) and posterior features (76% vs. 71%; P = .0046), While the difference of calcification was not significantly different. Discussion: In this study, we aimed to prospectively verify a novel AI tool based on ultrasound dynamic videos and ACR BI-RADS characteristics. The prospective assessment suggested that the AI tool not only meets the clinical needs better but also reaches the diagnostic efficiency of experienced radiologists.

Breast ultrasound tumor image classification using image decomposition and fusion based on adaptive multi-model spatial feature fusion.

BACKGROUND AND OBJECTIVE: Breast cancer is a fatal threat to the health of women. Ultrasonography is a common method for the detection of breast cancer. Computer-aided diagnosis of breast ultrasound images can help doctors in diagnosing benign and malignant lesions. In this paper, by combining image decomposition and fusion techniques with adaptive spatial feature fusion technology, a reliable classification method for breast ultrasound images of tumors is proposed. METHODS: First, fuzzy enhancement and bilateral filtering algorithms are used to process the original breast ultrasound image. Then, various decomposition images representing the clinical characteristics of breast tumors are obtained using the original and mask images. By considering the diversity of the benign and malignant characteristic information represented by each decomposition image, the decomposition images are fused through the RGB channel, and three types of fusion images are generated. Then, from a series of candidate deep learning models, transfer learning is used to select the best model as the base model to extract deep learning features. Finally, while training the classification network, adaptive spatial feature fusion technology is used to train the weight network to complete deep learning feature fusion and classification. RESULTS: In this study, 1328 breast ultrasound images were collected for training and testing. The experimental results show that the values of accuracy, precision, specificity, sensitivity/recall, F1 score, and area under the curve of the proposed method were 0.9548, 0.9811, 0.9833, 0.9392, 0.9571, and 0.9883, respectively. CONCLUSION: Our research can automate breast cancer detection and has strong clinical utility. When compared to previous methods, our proposed method is expected to be more effective while assisting doctors in diagnosing breast ultrasound images.

Multi-Features-Based Automated Breast Tumor Diagnosis Using Ultrasound Image and Support Vector Machine.

Breast ultrasound examination is a routine, fast, and safe method for clinical diagnosis of breast tumors. In this paper, a classification method based on multi-features and support vector machines was proposed for breast tumor diagnosis. Multi-features are composed of characteristic features and deep learning features of breast tumor images. Initially, an improved level set algorithm was used to segment the lesion in breast ultrasound images, which provided an accurate calculation of characteristic features, such as orientation, edge indistinctness, characteristics of posterior shadowing region, and shape complexity. Simultaneously, we used transfer learning to construct a pretrained model as a feature extractor to extract the deep learning features of breast ultrasound images. Finally, the multi-features were fused and fed to support vector machine for the further classification of breast ultrasound images. The proposed model, when tested on unknown samples, provided a classification accuracy of 92.5% for cancerous and noncancerous tumors.

Tumor classification in automated breast ultrasound (ABUS) based on a modified extracting feature network.

People can get consistent Automated Breast Ultrasound (ABUS) images due to the imaging mechanism of scanning. Therefore, it has unique advantages in breast tumor classification using artificial intelligence technology. This paper proposes a method for classifying benign and malignant breast tumors using ABUS sequence based on deep learning. First, Images of Interest (IOI) will be extracted and Region of Interest (ROI) will be cropped in ABUS sequence by two preprocessing deep learning models, Extracting-IOI model and Cropping-ROI model. Then, we propose a Shallowly Dilated Convolutional Branch Network (SDCB-Net). We combine this network with the VGG16 transfer learning network to construct a brand-new Shared Extracting Feature Network (SEF-Net) to extract ROI sequence features. Finally, the correlation features of ABUS images are extracted and integrated by using GRU Classified Network (GRUC-Net) to achieve the accurate breast tumors classification. The final results show that the accuracy of the test set for classifying benign and malignant ABUS sequence is 92.86 %. This method not only has high accuracy but also greatly improves the speed and efficiency of breast tumor classification. It has high clinical application significance that more women can discover breast tumors timely.

Effect of pyrolysis condition on the adsorption mechanism of heavy metals on tobacco stem biochar in competitive mode.

To clarify the adsorption mechanism of multi-ions on biochars in competitive environment is very important for the decontamination of co-existed heavy metals. Herein, tobacco stem was pyrolyzed in different temperatures with selected residences to obtain biochars with various surface chemistry. Then the adsorption of co-existed typical heavy-metal ions like lead, cadmium, and copper was studied, followed with systematic analysis of surface properties of the post-adsorption biochars. After carefully examining the adsorption performance and surface property alteration of the demineralized biochars, the adsorption mechanism of multi-ions in competitive environment was discovered. Lead showed the most competitive nature with co-existence of cadmium and copper, but the adsorption capacity reduced significantly with the removal of minerals. Combined with the observation of large amount of lead containing crystals on the post-adsorption biochars, the main adsorption mechanism of lead should be precipitation. The adsorb capability of copper barely changed for biochars with and without minerals, which suggests the best affinity of copper on surface functional groups even with large content of competitors. Biochar that pyrolyzed in 700 °C for 6 h that contained more aromatic structures showed the highest sorbing capability of cadmium, which suggested the dominant position of cation-π interaction in cadmium removal.