Non-invasive multimodal CT deep learning biomarker to predict pathological complete response of non-small cell lung cancer following neoadjuvant immunochemotherapy: a multicenter study.

OBJECTIVES: Although neoadjuvant immunochemotherapy has been widely applied in non-small cell lung cancer (NSCLC), predicting treatment response remains a challenge. We used pretreatment multimodal CT to explore deep learning-based immunochemotherapy response image biomarkers. METHODS: This study retrospectively obtained non-contrast enhanced and contrast enhancedbubu CT scans of patients with NSCLC who underwent surgery after receiving neoadjuvant immunochemotherapy at multiple centers between August 2019 and February 2023. Deep learning features were extracted from both non-contrast enhanced and contrast enhanced CT scans to construct the predictive models (LUNAI-uCT model and LUNAI-eCT model), respectively. After the feature fusion of these two types of features, a fused model (LUNAI-fCT model) was constructed. The performance of the model was evaluated using the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, positive predictive value, and negative predictive value. SHapley Additive exPlanations analysis was used to quantify the impact of CT imaging features on model prediction. To gain insights into how our model makes predictions, we employed Gradient-weighted Class Activation Mapping to generate saliency heatmaps. RESULTS: The training and validation datasets included 113 patients from Center A at the 8:2 ratio, and the test dataset included 112 patients (Center B n=73, Center C n=20, Center D n=19). In the test dataset, the LUNAI-uCT, LUNAI-eCT, and LUNAI-fCT models achieved AUCs of 0.762 (95% CI 0.654 to 0.791), 0.797 (95% CI 0.724 to 0.844), and 0.866 (95% CI 0.821 to 0.883), respectively. CONCLUSIONS: By extracting deep learning features from contrast enhanced and non-contrast enhanced CT, we constructed the LUNAI-fCT model as an imaging biomarker, which can non-invasively predict pathological complete response in neoadjuvant immunochemotherapy for NSCLC.

Protecting Prostate Cancer Classification From Rectal Artifacts via Targeted Adversarial Training.

Magnetic resonance imaging (MRI)-based deep neural networks (DNN) have been widely developed to perform prostate cancer (PCa) classification. However, in real-world clinical situations, prostate MRIs can be easily impacted by rectal artifacts, which have been found to lead to incorrect PCa classification. Existing DNN-based methods typically do not consider the interference of rectal artifacts on PCa classification, and do not design specific strategy to address this problem. In this study, we proposed a novel Targeted adversarial training with Proprietary Adversarial Samples (TPAS) strategy to defend the PCa classification model against the influence of rectal artifacts. Specifically, based on clinical prior knowledge, we generated proprietary adversarial samples with rectal artifact-pattern adversarial noise, which can severely mislead PCa classification models optimized by the ordinary training strategy. We then jointly exploited the generated proprietary adversarial samples and original samples to train the models. To demonstrate the effectiveness of our strategy, we conducted analytical experiments on multiple PCa classification models. Compared with ordinary training strategy, TPAS can effectively improve the single- and multi-parametric PCa classification at patient, slice and lesion level, and bring substantial gains to recent advanced models. In conclusion, TPAS strategy can be identified as a valuable way to mitigate the influence of rectal artifacts on deep learning models for PCa classification.

FedDUS: Lung tumor segmentation on CT images through federated semi-supervised with dynamic update strategy.

BACKGROUND AND OBJECTIVE: Lung tumor annotation is a key upstream task for further diagnosis and prognosis. Although deep learning techniques have promoted automation of lung tumor segmentation, there remain challenges impeding its application in clinical practice, such as a lack of prior annotation for model training and data-sharing among centers. METHODS: In this paper, we use data from six centers to design a novel federated semi-supervised learning (FSSL) framework with dynamic model aggregation and improve segmentation performance for lung tumors. To be specific, we propose a dynamically updated algorithm to deal with model parameter aggregation in FSSL, which takes advantage of both the quality and quantity of client data. Moreover, to increase the accessibility of data in the federated learning (FL) network, we explore the FAIR data principle while the previous federated methods never involve. RESULT: The experimental results show that the segmentation performance of our model in six centers is 0.9348, 0.8436, 0.8328, 0.7776, 0.8870 and 0.8460 respectively, which is superior to traditional deep learning methods and recent federated semi-supervised learning methods. CONCLUSION: The experimental results demonstrate that our method is superior to the existing FSSL methods. In addition, our proposed dynamic update strategy effectively utilizes the quality and quantity information of client data and shows efficiency in lung tumor segmentation. The source code is released on (https://github.com/GDPHMediaLab/FedDUS).

Development and Validation of a Deep Learning Model to Reduce the Interference of Rectal Artifacts in MRI-based Prostate Cancer Diagnosis.

Purpose To develop an MRI-based model for clinically significant prostate cancer (csPCa) diagnosis that can resist rectal artifact interference. Materials and Methods This retrospective study included 2203 male patients with prostate lesions who underwent biparametric MRI and biopsy between January 2019 and June 2023. Targeted adversarial training with proprietary adversarial samples (TPAS) strategy was proposed to enhance model resistance against rectal artifacts. The automated csPCa diagnostic models trained with and without TPAS were compared using multicenter validation datasets. The impact of rectal artifacts on the diagnostic performance of each model at the patient and lesion levels was compared using the area under the receiver operating characteristic curve (AUC) and the area under the precision-recall curve (AUPRC). The AUC between models was compared using the DeLong test, and the AUPRC was compared using the bootstrap method. Results The TPAS model exhibited diagnostic performance improvements of 6% at the patient level (AUC: 0.87 vs 0.81, P < .001) and 7% at the lesion level (AUPRC: 0.84 vs 0.77, P = .007) compared with the control model. The TPAS model demonstrated less performance decline in the presence of rectal artifact-pattern adversarial noise than the control model (ΔAUC: -17% vs -19%, ΔAUPRC: -18% vs -21%). The TPAS model performed better than the control model in patients with moderate (AUC: 0.79 vs 0.73, AUPRC: 0.68 vs 0.61) and severe (AUC: 0.75 vs 0.57, AUPRC: 0.69 vs 0.59) artifacts. Conclusion This study demonstrates that the TPAS model can reduce rectal artifact interference in MRI-based csPCa diagnosis, thereby improving its performance in clinical applications. Keywords: MR-Diffusion-weighted Imaging, Urinary, Prostate, Comparative Studies, Diagnosis, Transfer Learning Clinical trial registration no. ChiCTR23000069832 Supplemental material is available for this article. Published under a CC BY 4.0 license.

A computed tomography-based multitask deep learning model for predicting tumour stroma ratio and treatment outcomes in patients with colorectal cancer: a multicentre cohort study.

BACKGROUND: Tumour-stroma interactions, as indicated by tumour-stroma ratio (TSR), offer valuable prognostic stratification information. Current histological assessment of TSR is limited by tissue accessibility and spatial heterogeneity. The authors aimed to develop a multitask deep learning (MDL) model to noninvasively predict TSR and prognosis in colorectal cancer (CRC). MATERIALS AND METHODS: In this retrospective study including 2268 patients with resected CRC recruited from four centres, the authors developed an MDL model using preoperative computed tomography (CT) images for the simultaneous prediction of TSR and overall survival. Patients in the training cohort ( n =956) and internal validation cohort (IVC, n =240) were randomly selected from centre I. Patients in the external validation cohort 1 (EVC1, n =509), EVC2 ( n =203), and EVC3 ( n =360) were recruited from other three centres. Model performance was evaluated with respect to discrimination and calibration. Furthermore, the authors evaluated whether the model could predict the benefit from adjuvant chemotherapy. RESULTS: The MDL model demonstrated strong TSR discrimination, yielding areas under the receiver operating curves (AUCs) of 0.855 (95% CI, 0.800-0.910), 0.838 (95% CI, 0.802-0.874), and 0.857 (95% CI, 0.804-0.909) in the three validation cohorts, respectively. The MDL model was also able to predict overall survival and disease-free survival across all cohorts. In multivariable Cox analysis, the MDL score (MDLS) remained an independent prognostic factor after adjusting for clinicopathological variables (all P <0.05). For stage II and stage III disease, patients with a high MDLS benefited from adjuvant chemotherapy [hazard ratio (HR) 0.391 (95% CI, 0.230-0.666), P =0.0003; HR=0.467 (95% CI, 0.331-0.659), P <0.0001, respectively], whereas those with a low MDLS did not. CONCLUSION: The multitask DL model based on preoperative CT images effectively predicted TSR status and survival in CRC patients, offering valuable guidance for personalized treatment. Prospective studies are needed to confirm its potential to select patients who might benefit from chemotherapy.

PA-Net: A phase attention network fusing venous and arterial phase features of CT images for liver tumor segmentation.

BACKGROUND AND OBJECTIVE: Liver cancer seriously threatens human health. In clinical diagnosis, contrast-enhanced computed tomography (CECT) images provide important supplementary information for accurate liver tumor segmentation. However, most of the existing methods of liver tumor automatic segmentation focus only on single-phase image features. And the existing multi-modal methods have limited segmentation effect due to the redundancy of fusion features. In addition, the spatial misalignment of multi-phase images causes feature interference. METHODS: In this paper, we propose a phase attention network (PA-Net) to adequately aggregate multi-phase information of CT images and improve segmentation performance for liver tumors. Specifically, we design a PA module to generate attention weight maps voxel by voxel to efficiently fuse multi-phase CT images features to avoid feature redundancy. In order to solve the problem of feature interference in the multi-phase image segmentation task, we design a new learning strategy and prove its effectiveness experimentally. RESULTS: We conduct comparative experiments on the in-house clinical dataset and achieve the SOTA segmentation performance on multi-phase methods. In addition, our method has improved the mean dice score by 3.3% compared with the single-phase method based on nnUNet, and our learning strategy has improved the mean dice score by 1.51% compared with the ML strategy. CONCLUSION: The experimental results show that our method is superior to the existing multi-phase liver tumor segmentation method, and provides a scheme for dealing with missing modalities in multi-modal tasks. In addition, our proposed learning strategy makes more effective use of arterial phase image information and is proven to be the most effective in liver tumor segmentation tasks using thick-layer CT images. The source code is released on (https://github.com/Houjunfeng203934/PA-Net).

SwinHR: Hemodynamic-powered hierarchical vision transformer for breast tumor segmentation.

Accurate and automated segmentation of breast tumors in dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) plays a critical role in computer-aided diagnosis and treatment of breast cancer. However, this task is challenging, due to random variation in tumor sizes, shapes, appearances, and blurred boundaries of tumors caused by inherent heterogeneity of breast cancer. Moreover, the presence of ill-posed artifacts in DCE-MRI further complicate the process of tumor region annotation. To address the challenges above, we propose a scheme (named SwinHR) integrating prior DCE-MRI knowledge and temporal-spatial information of breast tumors. The prior DCE-MRI knowledge refers to hemodynamic information extracted from multiple DCE-MRI phases, which can provide pharmacokinetics information to describe metabolic changes of the tumor cells over the scanning time. The Swin Transformer with hierarchical re-parameterization large kernel architecture (H-RLK) can capture long-range dependencies within DCE-MRI while maintaining computational efficiency by a shifted window-based self-attention mechanism. The use of H-RLK can extract high-level features with a wider receptive field, which can make the model capture contextual information at different levels of abstraction. Extensive experiments are conducted in large-scale datasets to validate the effectiveness of our proposed SwinHR scheme, demonstrating its superiority over recent state-of-the-art segmentation methods. Also, a subgroup analysis split by MRI scanners, field strength, and tumor size is conducted to verify its generalization. The source code is released on (https://github.com/GDPHMediaLab/SwinHR).

Pathologic complete response prediction in breast cancer lesion segmentation and neoadjuvant therapy.

Objectives: Predicting whether axillary lymph nodes could achieve pathologic Complete Response (pCR) after breast cancer patients receive neoadjuvant chemotherapy helps make a quick follow-up treatment plan. This paper presents a novel method to achieve this prediction with the most effective medical imaging method, Dynamic Contrast-enhanced Magnetic Resonance Imaging (DCE-MRI). Methods: In order to get an accurate prediction, we first proposed a two-step lesion segmentation method to extract the breast cancer lesion region from DCE-MRI images. With the segmented breast cancer lesion region, we then used a multi-modal fusion model to predict the probability of axillary lymph nodes achieving pCR. Results: We collected 361 breast cancer samples from two hospitals to train and test the proposed segmentation model and the multi-modal fusion model. Both segmentation and prediction models obtained high accuracy. Conclusion: The results show that our method is effective in both the segmentation task and the pCR prediction task. It suggests that the presented methods, especially the multi-modal fusion model, can be used for the prediction of treatment response in breast cancer, given data from noninvasive methods only.

A robust and efficient AI assistant for breast tumor segmentation from DCE-MRI via a spatial-temporal framework.

Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) allows screening, follow up, and diagnosis for breast tumor with high sensitivity. Accurate tumor segmentation from DCE-MRI can provide crucial information of tumor location and shape, which significantly influences the downstream clinical decisions. In this paper, we aim to develop an artificial intelligence (AI) assistant to automatically segment breast tumors by capturing dynamic changes in multi-phase DCE-MRI with a spatial-temporal framework. The main advantages of our AI assistant include (1) robustness, i.e., our model can handle MR data with different phase numbers and imaging intervals, as demonstrated on a large-scale dataset from seven medical centers, and (2) efficiency, i.e., our AI assistant significantly reduces the time required for manual annotation by a factor of 20, while maintaining accuracy comparable to that of physicians. More importantly, as the fundamental step to build an AI-assisted breast cancer diagnosis system, our AI assistant will promote the application of AI in more clinical diagnostic practices regarding breast cancer.

MRI-based Quantification of Intratumoral Heterogeneity for Predicting Treatment Response to Neoadjuvant Chemotherapy in Breast Cancer.

Background Breast cancer is highly heterogeneous, resulting in different treatment responses to neoadjuvant chemotherapy (NAC) among patients. A noninvasive quantitative measure of intratumoral heterogeneity (ITH) may be valuable for predicting treatment response. Purpose To develop a quantitative measure of ITH on pretreatment MRI scans and test its performance for predicting pathologic complete response (pCR) after NAC in patients with breast cancer. Materials and Methods Pretreatment MRI scans were retrospectively acquired in patients with breast cancer who received NAC followed by surgery at multiple centers from January 2000 to September 2020. Conventional radiomics (hereafter, C-radiomics) and intratumoral ecological diversity features were extracted from the MRI scans, and output probabilities of imaging-based decision tree models were used to generate a C-radiomics score and ITH index. Multivariable logistic regression analysis was used to identify variables associated with pCR, and significant variables, including clinicopathologic variables, C-radiomics score, and ITH index, were combined into a predictive model for which performance was assessed using the area under the receiver operating characteristic curve (AUC). Results The training data set was comprised of 335 patients (median age, 48 years [IQR, 42-54 years]) from centers A and B, and 590, 280, and 384 patients (median age, 48 years [IQR, 41-55 years]) were included in the three external test data sets. Molecular subtype (odds ratio [OR] range, 4.76-8.39 [95% CI: 1.79, 24.21]; all P < .01), ITH index (OR, 30.05 [95% CI: 8.43, 122.64]; P < .001), and C-radiomics score (OR, 29.90 [95% CI: 12.04, 81.70]; P < .001) were independently associated with the odds of achieving pCR. The combined model showed good performance for predicting pCR to NAC in the training data set (AUC, 0.90) and external test data sets (AUC range, 0.83-0.87). Conclusion A model that combined an index created from pretreatment MRI-based imaging features quantitating ITH, C-radiomics score, and clinicopathologic variables showed good performance for predicting pCR to NAC in patients with breast cancer. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Rauch in this issue.

Artificial intelligence-quantified tumour-lymphocyte spatial interaction predicts disease-free survival in resected lung adenocarcinoma: A graph-based, multicentre study.

BACKGROUND AND OBJECTIVE: A high degree of lymphocyte infiltration is related to superior outcomes amongst patients with lung adenocarcinoma. Recent evidence indicates that the spatial interactions between tumours and lymphocytes also influence the anti-tumour immune responses, but the spatial analysis at the cellular level remains insufficient. METHODS: We proposed an artificial intelligence-quantified Tumour-Lymphocyte Spatial Interaction score (TLSI-score) by calculating the ratio between the number of spatial adjacent tumour-lymphocyte and the number of tumour cells based on topology cell graph constructed using H&E-stained whole-slide images. The association of TLSI-score with disease-free survival (DFS) was explored in 529 patients with lung adenocarcinoma across three independent cohorts (D1, 275; V1, 139; V2, 115). RESULTS: After adjusting for pTNM stage and other clinicopathologic risk factors, a higher TLSI-score was independently associated with longer DFS than a low TLSI-score in the three cohorts [D1, adjusted hazard ratio (HR), 0.674; 95% confidence interval (CI) 0.463-0.983; p = 0.040; V1, adjusted HR, 0.408; 95% CI 0.223-0.746; p = 0.004; V2, adjusted HR, 0.294; 95% CI 0.130-0.666; p = 0.003]. By integrating the TLSI-score with clinicopathologic risk factors, the integrated model (full model) improves the prediction of DFS in three independent cohorts (C-index, D1, 0.716 vs. 0.701; V1, 0.666 vs. 0.645; V2, 0.708 vs. 0.662) CONCLUSIONS: TLSI-score shows the second highest relative contribution to the prognostic prediction model, next to the pTNM stage. TLSI-score can assist in the characterising of tumour microenvironment and is expected to promote individualized treatment and follow-up decision-making in clinical practice.

HoVer-Trans: Anatomy-Aware HoVer-Transformer for ROI-Free Breast Cancer Diagnosis in Ultrasound Images.

Ultrasonography is an important routine examination for breast cancer diagnosis, due to its non-invasive, radiation-free and low-cost properties. However, the diagnostic accuracy of breast cancer is still limited due to its inherent limitations. Then, a precise diagnose using breast ultrasound (BUS) image would be significant useful. Many learning-based computer-aided diagnostic methods have been proposed to achieve breast cancer diagnosis/lesion classification. However, most of them require a pre-define region of interest (ROI) and then classify the lesion inside the ROI. Conventional classification backbones, such as VGG16 and ResNet50, can achieve promising classification results with no ROI requirement. But these models lack interpretability, thus restricting their use in clinical practice. In this study, we propose a novel ROI-free model for breast cancer diagnosis in ultrasound images with interpretable feature representations. We leverage the anatomical prior knowledge that malignant and benign tumors have different spatial relationships between different tissue layers, and propose a HoVer-Transformer to formulate this prior knowledge. The proposed HoVer-Trans block extracts the inter- and intra-layer spatial information horizontally and vertically. We conduct and release an open dataset GDPH&SYSUCC for breast cancer diagnosis in BUS. The proposed model is evaluated in three datasets by comparing with four CNN-based models and three vision transformer models via five-fold cross validation. It achieves state-of-the-art classification performance (GDPH&SYSUCC AUC: 0.924, ACC: 0.893, Spec: 0.836, Sens: 0.926) with the best model interpretability. In the meanwhile, our proposed model outperforms two senior sonographers on the breast cancer diagnosis when only one BUS image is given (GDPH&SYSUCC-AUC ours: 0.924 vs. reader1: 0.825 vs. reader2: 0.820).

Use of Pretreatment Multiparametric MRI to Predict Tumor Regression Pattern to Neoadjuvant Chemotherapy in Breast Cancer.

RATIONALE AND OBJECTIVES: To develop an easy-to-use model by combining pretreatment MRI and clinicopathologic features for early prediction of tumor regression pattern to neoadjuvant chemotherapy (NAC) in breast cancer. MATERIALS AND METHODS: We retrospectively analyzed 420 patients who received NAC and underwent definitive surgery in our hospital from February 2012 to August 2020. Pathologic findings of surgical specimens were used as the gold standard to classify tumor regression patterns into concentric and non-concentric shrinkage. Morphologic and kinetic MRI features were both analyzed. Univariable and multivariable analyses were performed to select the key clinicopathologic and MRI features for pretreatment prediction of regression pattern. Logistic regression and six machine learning methods were used to construct prediction models, and their performance were evaluated with receiver operating characteristic curve. RESULTS: Two clinicopathologic variables and three MRI features were selected as independent predictors to construct prediction models. The apparent area under the curve (AUC) of seven prediction models were in the range of 0.669-0.740. The logistic regression model yielded an AUC of 0.708 (95% confidence interval [CI]: 0.658-0.759), and the decision tree model achieved the highest AUC of 0.740 (95% CI: 0.691-0.787). For internal validation, the optimism-corrected AUCs of seven models were in the range of 0.592-0.684. There was no significant difference between the AUCs of the logistic regression model and that of each machine learning model. CONCLUSION: Prediction models combining pretreatment MRI and clinicopathologic features are useful for predicting tumor regression pattern in breast cancer, which can assist to select patients who can benefit from NAC for de-escalation of breast surgery and modify treatment strategy.

CKD-TransBTS: Clinical Knowledge-Driven Hybrid Transformer With Modality-Correlated Cross-Attention for Brain Tumor Segmentation.

Brain tumor segmentation (BTS) in magnetic resonance image (MRI) is crucial for brain tumor diagnosis, cancer management and research purposes. With the great success of the ten-year BraTS challenges as well as the advances of CNN and Transformer algorithms, a lot of outstanding BTS models have been proposed to tackle the difficulties of BTS in different technical aspects. However, existing studies hardly consider how to fuse the multi-modality images in a reasonable manner. In this paper, we leverage the clinical knowledge of how radiologists diagnose brain tumors from multiple MRI modalities and propose a clinical knowledge-driven brain tumor segmentation model, called CKD-TransBTS. Instead of directly concatenating all the modalities, we re-organize the input modalities by separating them into two groups according to the imaging principle of MRI. A dual-branch hybrid encoder with the proposed modality-correlated cross-attention block (MCCA) is designed to extract the multi-modality image features. The proposed model inherits the strengths from both Transformer and CNN with the local feature representation ability for precise lesion boundaries and long-range feature extraction for 3D volumetric images. To bridge the gap between Transformer and CNN features, we propose a Trans&CNN Feature Calibration block (TCFC) in the decoder. We compare the proposed model with six CNN-based models and six transformer-based models on the BraTS 2021 challenge dataset. Extensive experiments demonstrate that the proposed model achieves state-of-the-art brain tumor segmentation performance compared with all the competitors.

Using Machine Learning Methods to Assess Lymphovascular Invasion and Survival in Breast Cancer: Performance of Combining Preoperative Clinical and MRI Characteristics.

BACKGROUND: Preoperative assessment of lymphovascular invasion (LVI) in invasive breast cancer (IBC) is of high clinical relevance for treatment decision-making and prognosis. PURPOSE: To investigate the associations of preoperative clinical and magnetic resonance imaging (MRI) characteristics with LVI and disease-free survival (DFS) by using machine learning methods in patients with IBC. STUDY TYPE: Retrospective. POPULATION: Five hundred and seventy-five women (range: 24-79 years) with IBC who underwent preoperative MRI examinations at two hospitals, divided into the training (N = 386) and validation datasets (N = 189). FIELD STRENGTH/SEQUENCE: Axial fat-suppressed T2-weighted turbo spin-echo sequence and dynamic contrast-enhanced with fat-suppressed T1-weighted three-dimensional gradient echo imaging. ASSESSMENT: MRI characteristics (clinical T stage, breast edema score, MRI axillary lymph node status, multicentricity or multifocality, enhancement pattern, adjacent vessel sign, and increased ipsilateral vascularity) were reviewed independently by three radiologists. Logistic regression (LR), eXtreme Gradient Boosting (XGBoost), k-Nearest Neighbor (KNN), and Support Vector Machine (SVM) algorithms were used to establish the models by combing preoperative clinical and MRI characteristics for assessing LVI status in the training dataset, and the methods were further applied in the validation dataset. The LVI score was calculated using the best-performing of the four models to analyze the association with DFS. STATISTICAL TESTS: Chi-squared tests, variance inflation factors, receiver operating characteristics (ROC), Kaplan-Meier curve, log-rank, Cox regression, and intraclass correlation coefficient were performed. The area under the ROC curve (AUC) and hazard ratios (HR) were calculated. A P-value <0.05 was considered statistically significant. RESULTS: The model established by the XGBoost algorithm had better performance than LR, SVM, and KNN models, achieving an AUC of 0.832 (95% confidence interval [CI]: 0.789, 0.876) in the training dataset and 0.838 (95% CI: 0.775, 0.901) in the validation dataset. The LVI score established by the XGBoost model was an independent indicator of DFS (adjusted HR: 2.66, 95% CI: 1.22-5.80). DATA CONCLUSION: The XGBoost model based on preoperative clinical and MRI characteristics may help to investigate the LVI status and survival in patients with IBC. LEVEL OF EVIDENCE: 3 TECHNICAL EFFICACY: Stage 2.

An MRI-based Scoring System for Preoperative Prediction of Axillary Response to Neoadjuvant Chemotherapy in Node-Positive Breast Cancer: A Multicenter Retrospective Study.

RATIONALE AND OBJECTIVES: To develop and validate a simplified scoring system by integrating MRI and clinicopathologic features for preoperative prediction of axillary pathologic complete response (pCR) to neoadjuvant chemotherapy (NAC) in clinically node-positive breast cancer. MATERIALS AND METHODS: A total of 389 patients from three hospitals were retrospectively analyzed. To identify independent predictors for axillary pCR, univariable and multivariable logistic regression analyses were performed on pre- and post-NAC MRI and clinicopathologic features. Then, a simplified scoring system was constructed based on regression coefficients of predictors in the multivariable model, and its predictive performance was assessed with the receiver operating characteristic curve and calibration curve. The added value of the scoring system for reducing false-negative rate (FNR) of the sentinel lymph node biopsy (SLNB) was also evaluated. RESULTS: The simplified scoring system including seven predictors: progesterone receptor-negative (Three points), HER2-positive (Two points), post-NAC clinical T0-1 stage (Two points), pre-NAC higher ADC value of breast tumor (One point), absence of perinodal infiltration at pre-NAC (One point) and post-NAC MRI (Two points), and absence of enhancement in the tumor bed at post-NAC MRI (Two points), showed good calibration and discrimination, with AUCs of 0.835, 0.828 and 0.798 in the training, internal and external validation cohorts, respectively. The axillary pCR rates were increased with the total points of the scoring system, and patients with a score of ≥11 points had a pCR rate of 86%-100%. In test cohorts for simulating clinical application, the diagnostic accuracy for axillary pCR was 80%-90% among four different radiologists. Compared to standalone SLNB, combining the scoring system with SLNB reduced the FNR from 14.5% to 4.8%. CONCLUSION: The clinicopathologic-image scoring system with good predictive performance for axillary pCR in clinically node-positive breast cancer, may guide axillary management after NAC and improve patient selection for de-escalating axillary surgery to reduce morbidity.

Multi-scale pathology image texture signature is a prognostic factor for resectable lung adenocarcinoma: a multi-center, retrospective study.

BACKGROUND: Tumor histomorphology analysis plays a crucial role in predicting the prognosis of resectable lung adenocarcinoma (LUAD). Computer-extracted image texture features have been previously shown to be correlated with outcome. However, a comprehensive, quantitative, and interpretable predictor remains to be developed. METHODS: In this multi-center study, we included patients with resectable LUAD from four independent cohorts. An automated pipeline was designed for extracting texture features from the tumor region in hematoxylin and eosin (H&E)-stained whole slide images (WSIs) at multiple magnifications. A multi-scale pathology image texture signature (MPIS) was constructed with the discriminative texture features in terms of overall survival (OS) selected by the LASSO method. The prognostic value of MPIS for OS was evaluated through univariable and multivariable analysis in the discovery set (n = 111) and the three external validation sets (V1, n = 115; V2, n = 116; and V3, n = 246). We constructed a Cox proportional hazards model incorporating clinicopathological variables and MPIS to assess whether MPIS could improve prognostic stratification. We also performed histo-genomics analysis to explore the associations between texture features and biological pathways. RESULTS: A set of eight texture features was selected to construct MPIS. In multivariable analysis, a higher MPIS was associated with significantly worse OS in the discovery set (HR 5.32, 95%CI 1.72-16.44; P = 0.0037) and the three external validation sets (V1: HR 2.63, 95%CI 1.10-6.29, P = 0.0292; V2: HR 2.99, 95%CI 1.34-6.66, P = 0.0075; V3: HR 1.93, 95%CI 1.15-3.23, P = 0.0125). The model that integrated clinicopathological variables and MPIS had better discrimination for OS compared to the clinicopathological variables-based model in the discovery set (C-index, 0.837 vs. 0.798) and the three external validation sets (V1: 0.704 vs. 0.679; V2: 0.728 vs. 0.666; V3: 0.696 vs. 0.669). Furthermore, the identified texture features were associated with biological pathways, such as cytokine activity, structural constituent of cytoskeleton, and extracellular matrix structural constituent. CONCLUSIONS: MPIS was an independent prognostic biomarker that was robust and interpretable. Integration of MPIS with clinicopathological variables improved prognostic stratification in resectable LUAD and might help enhance the quality of individualized postoperative care.

Multi-layer pseudo-supervision for histopathology tissue semantic segmentation using patch-level classification labels.

Tissue-level semantic segmentation is a vital step in computational pathology. Fully-supervised models have already achieved outstanding performance with dense pixel-level annotations. However, drawing such labels on the giga-pixel whole slide images is extremely expensive and time-consuming. In this paper, we use only patch-level classification labels to achieve tissue semantic segmentation on histopathology images, finally reducing the annotation efforts. We propose a two-step model including a classification and a segmentation phases. In the classification phase, we propose a CAM-based model to generate pseudo masks by patch-level labels. In the segmentation phase, we achieve tissue semantic segmentation by our propose Multi-Layer Pseudo-Supervision. Several technical novelties have been proposed to reduce the information gap between pixel-level and patch-level annotations. As a part of this paper, we introduce a new weakly-supervised semantic segmentation (WSSS) dataset for lung adenocarcinoma (LUAD-HistoSeg). We conduct several experiments to evaluate our proposed model on two datasets. Our proposed model outperforms five state-of-the-art WSSS approaches. Note that we can achieve comparable quantitative and qualitative results with the fully-supervised model, with only around a 2% gap for MIoU and FwIoU. By comparing with manual labeling on a randomly sampled 100 patches dataset, patch-level labeling can greatly reduce the annotation time from hours to minutes. The source code and the released datasets are available at: https://github.com/ChuHan89/WSSS-Tissue.