Longitudinal Assessment of Tumor-Infiltrating Lymphocytes in Primary Breast Cancer Following Neoadjuvant Radiation Therapy.

PURPOSE: Tumor-infiltrating lymphocytes (TILs) have prognostic significance in several cancers, including breast cancer. Despite interest in combining radiation therapy with immunotherapy, little is known about the effect of radiation therapy itself on the tumor-immune microenvironment, including TILs. Here, we interrogated longitudinal dynamics of TILs and systemic lymphocytes in patient samples taken before, during, and after neoadjuvant radiation therapy (NART) from PRADA and Neo-RT breast clinical trials. METHODS AND MATERIALS: We manually scored stromal TILs (sTILs) from longitudinal tumor samples using standardized guidelines as well as deep learning-based scores at cell-level (cTIL) and cell- and tissue-level combination analyses (SuperTIL). In parallel, we interrogated absolute lymphocyte counts from routine blood tests at corresponding time points during treatment. Exploratory analyses studied the relationship between TILs and pathologic complete response (pCR) and long-term outcomes. RESULTS: Patients receiving NART experienced a significant and uniform decrease in sTILs that did not recover at the time of surgery (P < .0001). This lymphodepletive effect was also mirrored in peripheral blood. Our SuperTIL deep learning score showed good concordance with manual sTILs and importantly performed comparably to manual scores in predicting pCR from diagnostic biopsies. The analysis suggested an association between baseline sTILs and pCR, as well as sTILs at surgery and relapse, in patients receiving NART. CONCLUSIONS: This study provides novel insights into TIL dynamics in the context of NART in breast cancer and demonstrates the potential for artificial intelligence to assist routine pathology. We have identified trends that warrant further interrogation and have a bearing on future radioimmunotherapy trials.

Self-supervised deep learning for highly efficient spatial immunophenotyping.

BACKGROUND: Efficient biomarker discovery and clinical translation depend on the fast and accurate analytical output from crucial technologies such as multiplex imaging. However, reliable cell classification often requires extensive annotations. Label-efficient strategies are urgently needed to reveal diverse cell distribution and spatial interactions in large-scale multiplex datasets. METHODS: This study proposed Self-supervised Learning for Antigen Detection (SANDI) for accurate cell phenotyping while mitigating the annotation burden. The model first learns intrinsic pairwise similarities in unlabelled cell images, followed by a classification step to map learnt features to cell labels using a small set of annotated references. We acquired four multiplex immunohistochemistry datasets and one imaging mass cytometry dataset, comprising 2825 to 15,258 single-cell images to train and test the model. FINDINGS: With 1% annotations (18-114 cells), SANDI achieved weighted F1-scores ranging from 0.82 to 0.98 across the five datasets, which was comparable to the fully supervised classifier trained on 1828-11,459 annotated cells (-0.002 to -0.053 of averaged weighted F1-score, Wilcoxon rank-sum test, P = 0.31). Leveraging the immune checkpoint markers stained in ovarian cancer slides, SANDI-based cell identification reveals spatial expulsion between PD1-expressing T helper cells and T regulatory cells, suggesting an interplay between PD1 expression and T regulatory cell-mediated immunosuppression. INTERPRETATION: By striking a fine balance between minimal expert guidance and the power of deep learning to learn similarity within abundant data, SANDI presents new opportunities for efficient, large-scale learning for histology multiplex imaging data. FUNDING: This study was funded by the Royal Marsden/ICR National Institute of Health Research Biomedical Research Centre.

Spatial interplay of tissue hypoxia and T-cell regulation in ductal carcinoma in situ.

Hypoxia promotes aggressive tumor phenotypes and mediates the recruitment of suppressive T cells in invasive breast carcinomas. We investigated the role of hypoxia in relation to T-cell regulation in ductal carcinoma in situ (DCIS). We designed a deep learning system tailored for the tissue architecture complexity of DCIS, and compared pure DCIS cases with the synchronous DCIS and invasive components within invasive ductal carcinoma cases. Single-cell classification was applied in tandem with a new method for DCIS ductal segmentation in dual-stained CA9 and FOXP3, whole-tumor section digital pathology images. Pure DCIS typically has an intermediate level of colocalization of FOXP3+ and CA9+ cells, but in invasive carcinoma cases, the FOXP3+ (T-regulatory) cells may have relocated from the DCIS and into the invasive parts of the tumor, leading to high levels of colocalization in the invasive parts but low levels in the synchronous DCIS component. This may be due to invasive, hypoxic tumors evolving to recruit T-regulatory cells in order to evade immune predation. Our data support the notion that hypoxia promotes immune tolerance through recruitment of T-regulatory cells, and furthermore indicate a spatial pattern of relocalization of T-regulatory cells from DCIS to hypoxic tumor cells. Spatial colocalization of hypoxic and T-regulatory cells may be a key event and useful marker of DCIS progression.

Artificial intelligence and digital pathology: Opportunities and implications for immuno-oncology.

The field of immuno-oncology has expanded rapidly over the past decade, but key questions remain. How does tumour-immune interaction regulate disease progression? How can we prospectively identify patients who will benefit from immunotherapy? Identifying measurable features of the tumour immune-microenvironment which have prognostic or predictive value will be key to making meaningful gains in these areas. Recent developments in deep learning enable big-data analysis of pathological samples. Digital approaches allow data to be acquired, integrated and analysed far beyond what is possible with conventional techniques, and to do so efficiently and at scale. This has the potential to reshape what can be achieved in terms of volume, precision and reliability of output, enabling data for large cohorts to be summarised and compared. This review examines applications of artificial intelligence (AI) to important questions in immuno-oncology (IO). We discuss general considerations that need to be taken into account before AI can be applied in any clinical setting. We describe AI methods that have been applied to the field of IO to date and present several examples of their use.