SST-editing: in silico spatial transcriptomic editing at single-cell resolution.

MOTIVATION: Generative Adversarial Nets (GAN) achieve impressive performance for text-guided editing of natural images. However, a comparable utility of GAN remains understudied for spatial transcriptomics (ST) technologies with matched gene expression and biomedical image data. RESULTS: We propose In Silico Spatial Transcriptomic editing that enables gene expression-guided editing of immunofluorescence images. Using cell-level spatial transcriptomics data extracted from normal and tumor tissue slides, we train the approach under the framework of GAN (Inversion). To simulate cellular state transitions, we then feed edited gene expression levels to trained models. Compared to normal cellular images (ground truth), we successfully model the transition from tumor to normal tissue samples, as measured with quantifiable and interpretable cellular features. AVAILABILITY AND IMPLEMENTATION: https://github.com/CTPLab/SST-editing.

Multiplex analysis of intratumoural immune infiltrate and prognosis in patients with stage II-III colorectal cancer from the SCOT and QUASAR 2 trials: a retrospective analysis.

BACKGROUND: Tumour-infiltrating CD8+ cytotoxic T cells confer favourable prognosis in colorectal cancer. The added prognostic value of other infiltrating immune cells is unclear and so we sought to investigate their prognostic value in two large clinical trial cohorts. METHODS: We used multiplex immunofluorescent staining of tissue microarrays to assess the densities of CD8+, CD20+, FoxP3+, and CD68+ cells in the intraepithelial and intrastromal compartments from tumour samples of patients with stage II-III colorectal cancer from the SCOT trial (ISRCTN59757862), which examined 3 months versus 6 months of adjuvant oxaliplatin-based chemotherapy, and from the QUASAR 2 trial (ISRCTN45133151), which compared adjuvant capecitabine with or without bevacizumab. Both trials included patients aged 18 years or older with an Eastern Cooperative Oncology Group performance status of 0-1. Immune marker predictors were analysed by multiple regression, and the prognostic and predictive values of markers for colorectal cancer recurrence-free interval by Cox regression were assessed using the SCOT cohort for discovery and QUASAR 2 cohort for validation. FINDINGS: After exclusion of cases without tissue microarrays and with technical failures, and following quality control, we included 2340 cases from the SCOT trial and 1069 from the QUASAR 2 trial in our analysis. Univariable analysis of associations with recurrence-free interval in cases from the SCOT trial showed a strong prognostic value of intraepithelial CD8 (CD8IE) as a continuous variable (hazard ratio [HR] for 75th vs 25th percentile [75vs25] 0·73 [95% CI 0·68-0·79], p=2·5 × 10-16), and of intrastromal FoxP3 (FoxP3IS; 0·71 [0·64-0·78], p=1·5 × 10-13) but not as strongly in the epithelium (FoxP3IE; 0·89 [0·84-0·96], p=1·5 × 10-4). Associations of other markers with recurrence-free interval were moderate. CD8IE and FoxP3IS retained independent prognostic value in bivariable and multivariable analysis, and, compared with either marker alone, a composite marker including both markers (CD8IE-FoxP3IS) was superior when assessed as a continuous variable (adjusted [a]HR75 vs 25 0·70 [95% CI 0·63-0·78], p=5·1 × 10-11) and when categorised into low, intermediate, and high density groups using previously published cutpoints (aHR for intermediate vs high 1·68 [95% CI 1·29-2·20], p=1·3 × 10-4; low vs high 2·58 [1·91-3·49], p=7·9 × 10-10), with performance similar to the gold-standard Immunoscore. The prognostic value of CD8IE-FoxP3IS was confirmed in cases from the QUASAR 2 trial, both as a continuous variable (aHR75 vs 25 0·84 [95% CI 0·73-0·96], p=0·012) and as a categorical variable for low versus high density (aHR 1·80 [95% CI 1·17-2·75], p=0·0071) but not for intermediate versus high (1·30 [0·89-1·88], p=0·17). INTERPRETATION: Combined evaluation of CD8IE and FoxP3IS could help to refine risk stratification in colorectal cancer. Investigation of FoxP3IS cells as an immunotherapy target in colorectal cancer might be merited. FUNDING: Medical Research Council, National Institute for Health Research, Cancer Research UK, Swedish Cancer Society, Roche, and Promedica Foundation.

Prognostic impact and causality of age on oncological outcomes in women with endometrial cancer: a multimethod analysis of the randomised PORTEC-1, PORTEC-2, and PORTEC-3 trials.

BACKGROUND: Numerous studies have shown that older women with endometrial cancer have a higher risk of recurrence and cancer-related death. However, it remains unclear whether older age is a causal prognostic factor, or whether other risk factors become increasingly common with age. We aimed to address this question with a unique multimethod study design using state-of-the-art statistical and causal inference techniques on datasets of three large, randomised trials. METHODS: In this multimethod analysis, data from 1801 women participating in the randomised PORTEC-1, PORTEC-2, and PORTEC-3 trials were used for statistical analyses and causal inference. The cohort included 714 patients with intermediate-risk endometrial cancer, 427 patients with high-intermediate risk endometrial cancer, and 660 patients with high-risk endometrial cancer. Associations of age with clinicopathological and molecular features were analysed using non-parametric tests. Multivariable competing risk analyses were performed to determine the independent prognostic value of age. To analyse age as a causal prognostic variable, a deep learning causal inference model called AutoCI was used. FINDINGS: Median follow-up as estimated using the reversed Kaplan-Meier method was 12·3 years (95% CI 11·9-12·6) for PORTEC-1, 10·5 years (10·2-10·7) for PORTEC-2, and 6·1 years (5·9-6·3) for PORTEC-3. Both overall recurrence and endometrial cancer-specific death significantly increased with age. Moreover, older women had a higher frequency of deep myometrial invasion, serous tumour histology, and p53-abnormal tumours. Age was an independent risk factor for both overall recurrence (hazard ratio [HR] 1·02 per year, 95% CI 1·01-1·04; p=0·0012) and endometrial cancer-specific death (HR 1·03 per year, 1·01-1·05; p=0·0012) and was identified as a significant causal variable. INTERPRETATION: This study showed that advanced age was associated with more aggressive tumour features in women with endometrial cancer, and was independently and causally related to worse oncological outcomes. Therefore, our findings suggest that older women with endometrial cancer should not be excluded from diagnostic assessments, molecular testing, and adjuvant therapy based on their age alone. FUNDING: None.

B cells critical for outcome in high grade serous ovarian carcinoma.

Recent work has shown evidence for the prognostic significance of tumor infiltrating B cells (B-TIL) in high grade serous ovarian carcinoma (HGSOC), the predominant histological subtype of ovarian cancer. However, it remains unknown how the favorable prognosis associated with B-TIL relates to the current standard treatments of primary debulking surgery (PDS) followed by chemotherapy or (neo-)adjuvant chemotherapy (NACT) combined with interval debulking surgery. To address this, we analyzed the prognostic impact of B-TIL in relationship to primary treatment and tumor infiltrating T cell status in a highly homogenous cohort of HGSOC patients. This analysis involved a combined approach utilizing histological data and high-dimensional flow cytometry analysis. Our findings indicate that while HGSOC tumors pre-treated with NACT are infiltrated with tumor-reactive CD8+ and CD4+ TIL subsets, only B-TIL and IgA plasma blasts confer prognostic benefit in terms of overall survival. Importantly, the prognostic value of B-TIL and IgA plasma blasts was not restricted to patients treated with NACT, but was also evident in patients treated with PDS. Together, our data point to a critical prognostic role for B-TIL in HGSOC patients independent of T cell status, suggesting that alternative treatment approaches focused on the activation of B cells should be explored for HGSOC.

Poor Diagnostic Reproducibility in the Identification of Nonconventional Dysplasia in Colitis Impacts the Application of Histologic Stratification Tools.

Due to their increased cancer risk, patients with longstanding inflammatory bowel disease are offered endoscopic surveillance with concomitant histopathologic assessments, aimed at identifying dysplasia as a precursor lesion of colitis-associated colorectal cancer. However, this strategy is beset with difficulties and limitations. Recently, a novel classification criterion for colitis-associated low-grade dysplasia has been proposed, and an association between nonconventional dysplasia and progression was reported, suggesting the possibility of histology-based stratification of patients with colitis-associated lesions. Here, a cohort of colitis-associated lesions was assessed by a panel of 6 experienced pathologists to test the applicability of the published classification criteria and try and validate the association between nonconventional dysplasia and progression. While confirming the presence of different morphologic patterns of colitis-associated dysplasia, the study demonstrated difficulties concerning diagnostic reproducibility between pathologists and was unable to validate the association of nonconventional dysplasia with cancer progression. Our study highlights the overall difficulty of using histologic assessment of precursor lesions for cancer risk prediction in inflammatory bowel disease patients and suggests the need for a different diagnostic strategy that can objectively identify high-risk phenotypes.

GILEA: In silico phenome profiling and editing using GAN Inversion.

BACKGROUND: Modeling heterogeneous disease states by data-driven methods has great potential to advance biomedical research. However, a comprehensive analysis of phenotypic heterogeneity is often challenged by the complex nature of biomedical datasets and emerging imaging methodologies. METHODS: Here, we propose a novel GAN Inversion-enabled Latent Eigenvalue Analysis (GILEA) framework and apply it to in silico phenome profiling and editing. RESULTS: We show the performance of GILEA using cellular imaging datasets stained with the multiplexed fluorescence Cell Painting protocol. The quantitative results of GILEA can be biologically supported by editing of the latent representations and simulation of dynamic phenotype transitions between physiological and pathological states. CONCLUSION: In conclusion, GILEA represents a new and broadly applicable approach to the quantitative and interpretable analysis of biomedical image data. The GILEA code and video demos are available at https://github.com/CTPLab/GILEA.

CohortFinder: an open-source tool for data-driven partitioning of digital pathology and imaging cohorts to yield robust machine-learning models.

Batch effects (BEs) refer to systematic technical differences in data collection unrelated to biological variations whose noise is shown to negatively impact machine learning (ML) model generalizability. Here we release CohortFinder (http://cohortfinder.com), an open-source tool aimed at mitigating BEs via data-driven cohort partitioning. We demonstrate CohortFinder improves ML model performance in downstream digital pathology and medical image processing tasks. CohortFinder is freely available for download at cohortfinder.com.

Image-based consensus molecular subtyping in rectal cancer biopsies and response to neoadjuvant chemoradiotherapy.

The development of deep learning (DL) models to predict the consensus molecular subtypes (CMS) from histopathology images (imCMS) is a promising and cost-effective strategy to support patient stratification. Here, we investigate whether imCMS calls generated from whole slide histopathology images (WSIs) of rectal cancer (RC) pre-treatment biopsies are associated with pathological complete response (pCR) to neoadjuvant long course chemoradiotherapy (LCRT) with single agent fluoropyrimidine. DL models were trained to classify WSIs of colorectal cancers stained with hematoxylin and eosin into one of the four CMS classes using a multi-centric dataset of resection and biopsy specimens (n = 1057 WSIs) with paired transcriptional data. Classifiers were tested on a held out RC biopsy cohort (ARISTOTLE) and correlated with pCR to LCRT in an independent dataset merging two RC cohorts (ARISTOTLE, n = 114 and SALZBURG, n = 55 patients). DL models predicted CMS with high classification performance in multiple comparative analyses. In the independent cohorts (ARISTOTLE, SALZBURG), cases with WSIs classified as imCMS1 had a significantly higher likelihood of achieving pCR (OR = 2.69, 95% CI 1.01-7.17, p = 0.048). Conversely, imCMS4 was associated with lack of pCR (OR = 0.25, 95% CI 0.07-0.88, p = 0.031). Classification maps demonstrated pathologist-interpretable associations with high stromal content in imCMS4 cases, associated with poor outcome. No significant association was found in imCMS2 or imCMS3. imCMS classification of pre-treatment biopsies is a fast and inexpensive solution to identify patient groups that could benefit from neoadjuvant LCRT. The significant associations between imCMS1/imCMS4 with pCR suggest the existence of predictive morphological features that could enhance standard pathological assessment.

Swiss digital pathology recommendations: results from a Delphi process conducted by the Swiss Digital Pathology Consortium of the Swiss Society of Pathology.

Integration of digital pathology (DP) into clinical diagnostic workflows is increasingly receiving attention as new hardware and software become available. To facilitate the adoption of DP, the Swiss Digital Pathology Consortium (SDiPath) organized a Delphi process to produce a series of recommendations for DP integration within Swiss clinical environments. This process saw the creation of 4 working groups, focusing on the various components of a DP system (1) scanners, quality assurance and validation of scans, (2) integration of Whole Slide Image (WSI)-scanners and DP systems into the Pathology Laboratory Information System, (3) digital workflow-compliance with general quality guidelines, and (4) image analysis (IA)/artificial intelligence (AI), with topic experts for each recruited for discussion and statement generation. The work product of the Delphi process is 83 consensus statements presented here, forming the basis for "SDiPath Recommendations for Digital Pathology". They represent an up-to-date resource for national and international hospitals, researchers, device manufacturers, algorithm developers, and all supporting fields, with the intent of providing expectations and best practices to help ensure safe and efficient DP usage.

Domain generalization across tumor types, laboratories, and species - Insights from the 2022 edition of the Mitosis Domain Generalization Challenge.

Recognition of mitotic figures in histologic tumor specimens is highly relevant to patient outcome assessment. This task is challenging for algorithms and human experts alike, with deterioration of algorithmic performance under shifts in image representations. Considerable covariate shifts occur when assessment is performed on different tumor types, images are acquired using different digitization devices, or specimens are produced in different laboratories. This observation motivated the inception of the 2022 challenge on MItosis Domain Generalization (MIDOG 2022). The challenge provided annotated histologic tumor images from six different domains and evaluated the algorithmic approaches for mitotic figure detection provided by nine challenge participants on ten independent domains. Ground truth for mitotic figure detection was established in two ways: a three-expert majority vote and an independent, immunohistochemistry-assisted set of labels. This work represents an overview of the challenge tasks, the algorithmic strategies employed by the participants, and potential factors contributing to their success. With an F1 score of 0.764 for the top-performing team, we summarize that domain generalization across various tumor domains is possible with today's deep learning-based recognition pipelines. However, we also found that domain characteristics not present in the training set (feline as new species, spindle cell shape as new morphology and a new scanner) led to small but significant decreases in performance. When assessed against the immunohistochemistry-assisted reference standard, all methods resulted in reduced recall scores, with only minor changes in the order of participants in the ranking.

Stratification to Neoadjuvant Radiotherapy in Rectal Cancer by Regimen and Transcriptional Signatures.

Response to neoadjuvant radiotherapy (RT) in rectal cancer has been associated with immune and stromal features that are captured by transcriptional signatures. However, how such associations perform across different chemoradiotherapy regimens and within individual consensus molecular subtypes (CMS) and how they affect survival remain unclear. In this study, gene expression and clinical data of pretreatment biopsies from nine cohorts of primary rectal tumors were combined (N = 826). Exploratory analyses were done with transcriptomic signatures for the endpoint of pathologic complete response (pCR), considering treatment regimen or CMS subtype. Relevant findings were tested for overall survival and recurrence-free survival. Immune and stromal signatures were strongly associated with pCR and lack of pCR, respectively, in RT and capecitabine (Cap)/5-fluorouracil (5FU)-treated patients (N = 387), in which the radiosensitivity signature (RSS) showed the strongest association. Upon addition of oxaliplatin (Ox; N = 123), stromal signatures switched direction and showed higher chances to achieve pCR than without Ox (p for interaction 0.02). Among Cap/5FU patients, most signatures performed similarly across CMS subtypes, except cytotoxic lymphocytes that were associated with pCR in CMS1 and CMS4 cases compared with other CMS subtypes (p for interaction 0.04). The only variables associated with survival were pCR and RSS. Although the frequency of pCR across different chemoradiation regimens is relatively similar, our data suggest that response rates may differ depending on the biological landscape of rectal cancer. Response to neoadjuvant RT in stroma-rich tumors may potentially be improved by the addition of Ox. RSS in preoperative biopsies provides predictive information for response specifically to neoadjuvant RT with 5FU. SIGNIFICANCE: Rectal cancers with stromal features may respond better to RT and 5FU/Cap with the addition of Ox. Within patients not treated with Ox, high levels of cytotoxic lymphocytes associate with response only in immune and stromal tumors. Our analyses provide biological insights about the outcome by different radiotherapy regimens in rectal cancer.

Prediction of recurrence risk in endometrial cancer with multimodal deep learning.

Predicting distant recurrence of endometrial cancer (EC) is crucial for personalized adjuvant treatment. The current gold standard of combined pathological and molecular profiling is costly, hampering implementation. Here we developed HECTOR (histopathology-based endometrial cancer tailored outcome risk), a multimodal deep learning prognostic model using hematoxylin and eosin-stained, whole-slide images and tumor stage as input, on 2,072 patients from eight EC cohorts including the PORTEC-1/-2/-3 randomized trials. HECTOR demonstrated C-indices in internal (n = 353) and two external (n = 160 and n = 151) test sets of 0.789, 0.828 and 0.815, respectively, outperforming the current gold standard, and identified patients with markedly different outcomes (10-year distant recurrence-free probabilities of 97.0%, 77.7% and 58.1% for HECTOR low-, intermediate- and high-risk groups, respectively, by Kaplan-Meier analysis). HECTOR also predicted adjuvant chemotherapy benefit better than current methods. Morphological and genomic feature extraction identified correlates of HECTOR risk groups, some with therapeutic potential. HECTOR improves on the current gold standard and may help delivery of personalized treatment in EC.

Pathway level subtyping identifies a slow-cycling biological phenotype associated with poor clinical outcomes in colorectal cancer.

Molecular stratification using gene-level transcriptional data has identified subtypes with distinctive genotypic and phenotypic traits, as exemplified by the consensus molecular subtypes (CMS) in colorectal cancer (CRC). Here, rather than gene-level data, we make use of gene ontology and biological activation state information for initial molecular class discovery. In doing so, we defined three pathway-derived subtypes (PDS) in CRC: PDS1 tumors, which are canonical/LGR5+ stem-rich, highly proliferative and display good prognosis; PDS2 tumors, which are regenerative/ANXA1+ stem-rich, with elevated stromal and immune tumor microenvironmental lineages; and PDS3 tumors, which represent a previously overlooked slow-cycling subset of tumors within CMS2 with reduced stem populations and increased differentiated lineages, particularly enterocytes and enteroendocrine cells, yet display the worst prognosis in locally advanced disease. These PDS3 phenotypic traits are evident across numerous bulk and single-cell datasets, and demark a series of subtle biological states that are currently under-represented in pre-clinical models and are not identified using existing subtyping classifiers.