Multimodal integration of radiology, pathology and genomics for prediction of response to PD-(L)1 blockade in patients with non-small cell lung cancer.

Immunotherapy is used to treat almost all patients with advanced non-small cell lung cancer (NSCLC); however, identifying robust predictive biomarkers remains challenging. Here we show the predictive capacity of integrating medical imaging, histopathologic and genomic features to predict immunotherapy response using a cohort of 247 patients with advanced NSCLC with multimodal baseline data obtained during diagnostic clinical workup, including computed tomography scan images, digitized programmed death ligand-1 immunohistochemistry slides and known outcomes to immunotherapy. Using domain expert annotations, we developed a computational workflow to extract patient-level features and used a machine-learning approach to integrate multimodal features into a risk prediction model. Our multimodal model (area under the curve (AUC) = 0.80, 95% confidence interval (CI) 0.74-0.86) outperformed unimodal measures, including tumor mutational burden (AUC = 0.61, 95% CI 0.52-0.70) and programmed death ligand-1 immunohistochemistry score (AUC = 0.73, 95% CI 0.65-0.81). Our study therefore provides a quantitative rationale for using multimodal features to improve prediction of immunotherapy response in patients with NSCLC using expert-guided machine learning.

Multimodal data integration using machine learning improves risk stratification of high-grade serous ovarian cancer.

Patients with high-grade serous ovarian cancer suffer poor prognosis and variable response to treatment. Known prognostic factors for this disease include homologous recombination deficiency status, age, pathological stage and residual disease status after debulking surgery. Recent work has highlighted important prognostic information captured in computed tomography and histopathological specimens, which can be exploited through machine learning. However, little is known about the capacity of combining features from these disparate sources to improve prediction of treatment response. Here, we assembled a multimodal dataset of 444 patients with primarily late-stage high-grade serous ovarian cancer and discovered quantitative features, such as tumor nuclear size on staining with hematoxylin and eosin and omental texture on contrast-enhanced computed tomography, associated with prognosis. We found that these features contributed complementary prognostic information relative to one another and clinicogenomic features. By fusing histopathological, radiologic and clinicogenomic machine-learning models, we demonstrate a promising path toward improved risk stratification of patients with cancer through multimodal data integration.

Kaiso (ZBTB33) subcellular partitioning functionally links LC3A/B, the tumor microenvironment, and breast cancer survival.

The use of digital pathology for the histomorphologic profiling of pathological specimens is expanding the precision and specificity of quantitative tissue analysis at an unprecedented scale; thus, enabling the discovery of new and functionally relevant histological features of both predictive and prognostic significance. In this study, we apply quantitative automated image processing and computational methods to profile the subcellular distribution of the multi-functional transcriptional regulator, Kaiso (ZBTB33), in the tumors of a large racially diverse breast cancer cohort from a designated health disparities region in the United States. Multiplex multivariate analysis of the association of Kaiso's subcellular distribution with other breast cancer biomarkers reveals novel functional and predictive linkages between Kaiso and the autophagy-related proteins, LC3A/B, that are associated with features of the tumor immune microenvironment, survival, and race. These findings identify effective modalities of Kaiso biomarker assessment and uncover unanticipated insights into Kaiso's role in breast cancer progression.

Radiomics of MRI for pretreatment prediction of pathologic complete response, tumor regression grade, and neoadjuvant rectal score in patients with locally advanced rectal cancer undergoing neoadjuvant chemoradiation: an international multicenter study.

OBJECTIVE: To investigate whether pretreatment MRI-based radiomics of locally advanced rectal cancer (LARC) and/or the surrounding mesorectal compartment (MC) can predict pathologic complete response (pCR), neoadjuvant rectal (NAR) score, and tumor regression grade (TRG). METHODS: One hundred thirty-two consecutive patients with LARC who underwent neoadjuvant chemoradiation and total mesorectal excision (TME) were retrospectively collected from 2 centers in the USA and Italy. The primary tumor and surrounding MC were segmented on the best available T2-weighted sequence (axial, coronal, or sagittal). Three thousand one hundred ninety radiomic features were extracted using a python package. The most salient radiomic features as well as MRI parameter and clinical-based features were selected using recursive feature elimination. A logistic regression classifier was built to distinguish between any 2 binned categories in the considered endpoints: pCR, NAR, and TRG. Repeated k-fold validation was performed and AUCs calculated. RESULTS: There were 24, 87, and 21 T4, T3, and T2 LARCs, respectively (median age 63 years, 32 to 86). For NAR and TRG, the best classification performance was obtained using both the tumor and MC segmentations. The AUCs for classifying NAR 0 versus 2, pCR, and TRG 0/1 versus 2/3 were 0.66 (95% CI, 0.60-0.71), 0.80 (95% CI, 0.74-0.85), and 0.80 (95% CI, 0.77-0.82), respectively. CONCLUSION: Radiomics of pretreatment MRIs can predict pCR, TRG, and NAR score in patients with LARC undergoing neoadjuvant treatment and TME with moderate accuracy despite extremely heterogenous image data. Both the tumor and MC contain important prognostic information. KEY POINTS: • Machine learning of rectal cancer on images from the pretreatment MRI can predict important patient outcomes with moderate accuracy. • The tumor and the tissue around it both contain important prognostic information.