3D multiplexed tissue imaging reconstruction and optimized region of interest (ROI) selection through deep learning model of channels embedding.

Introduction: Tissue-based sampling and diagnosis are defined as the extraction of information from certain limited spaces and its diagnostic significance of a certain object. Pathologists deal with issues related to tumor heterogeneity since analyzing a single sample does not necessarily capture a representative depiction of cancer, and a tissue biopsy usually only presents a small fraction of the tumor. Many multiplex tissue imaging platforms (MTIs) make the assumption that tissue microarrays (TMAs) containing small core samples of 2-dimensional (2D) tissue sections are a good approximation of bulk tumors although tumors are not 2D. However, emerging whole slide imaging (WSI) or 3D tumor atlases that use MTIs like cyclic immunofluorescence (CyCIF) strongly challenge this assumption. In spite of the additional insight gathered by measuring the tumor microenvironment in WSI or 3D, it can be prohibitively expensive and time-consuming to process tens or hundreds of tissue sections with CyCIF. Even when resources are not limited, the criteria for region of interest (ROI) selection in tissues for downstream analysis remain largely qualitative and subjective as stratified sampling requires the knowledge of objects and evaluates their features. Despite the fact TMAs fail to adequately approximate whole tissue features, a theoretical subsampling of tissue exists that can best represent the tumor in the whole slide image. Methods: To address these challenges, we propose deep learning approaches to learn multi-modal image translation tasks from two aspects: 1) generative modeling approach to reconstruct 3D CyCIF representation and 2) co-embedding CyCIF image and Hematoxylin and Eosin (H&E) section to learn multi-modal mappings by a cross-domain translation for minimum representative ROI selection. Results and discussion: We demonstrate that generative modeling enables a 3D virtual CyCIF reconstruction of a colorectal cancer specimen given a small subset of the imaging data at training time. By co-embedding histology and MTI features, we propose a simple convex optimization for objective ROI selection. We demonstrate the potential application of ROI selection and the efficiency of its performance with respect to cellular heterogeneity.

GammaGateR: semi-automated marker gating for single-cell multiplexed imaging.

Motivation: Multiplexed immunofluorescence (mIF) is an emerging assay for multichannel protein imaging that can decipher cell-level spatial features in tissues. However, existing automated cell phenotyping methods, such as clustering, face challenges in achieving consistency across experiments and often require subjective evaluation. As a result, mIF analyses often revert to marker gating based on manual thresholding of raw imaging data. Results: To address the need for an evaluable semi-automated algorithm, we developed GammaGateR, an R package for interactive marker gating designed specifically for segmented cell-level data from mIF images. Based on a novel closed-form gamma mixture model, GammaGateR provides estimates of marker-positive cell proportions and soft clustering of marker-positive cells. The model incorporates user-specified constraints that provide a consistent but slide-specific model fit. We compared GammaGateR against the newest unsupervised approach for annotating mIF data, employing two colon datasets and one ovarian cancer dataset for the evaluation. We showed that GammaGateR produces highly similar results to a silver standard established through manual annotation. Furthermore, we demonstrated its effectiveness in identifying biological signals, achieved by mapping known spatial interactions between CD68 and MUC5AC cells in the colon and by accurately predicting survival in ovarian cancer patients using the phenotype probabilities as input for machine learning methods. GammaGateR is a highly efficient tool that can improve the replicability of marker gating results, while reducing the time of manual segmentation. Availability and Implementation: The R package is available at https://github.com/JiangmeiRubyXiong/GammaGateR.

Single-Cell and Spatial Analysis of Emergent Organoid Platforms.

Organoids have emerged as a promising advancement of the two-dimensional (2D) culture systems to improve studies in organogenesis, drug discovery, precision medicine, and regenerative medicine applications. Organoids can self-organize as three-dimensional (3D) tissues derived from stem cells and patient tissues to resemble organs. This chapter presents growth strategies, molecular screening methods, and emerging issues of the organoid platforms. Single-cell and spatial analysis resolve organoid heterogeneity to obtain information about the structural and molecular cellular states. Culture media diversity and varying lab-to-lab practices have resulted in organoid-to-organoid variability in morphology and cell compositions. An essential resource is an organoid atlas that can catalog protocols and standardize data analysis for different organoid types. Molecular profiling of individual cells in organoids and data organization of the organoid landscape will impact biomedical applications from basic science to translational use.

Lymphocyte networks are dynamic cellular communities in the immunoregulatory landscape of lung adenocarcinoma.

Lymphocytes are key for immune surveillance of tumors, but our understanding of the spatial organization and physical interactions that facilitate lymphocyte anti-cancer functions is limited. We used multiplexed imaging, quantitative spatial analysis, and machine learning to create high-definition maps of lung tumors from a Kras/Trp53-mutant mouse model and human resections. Networks of interacting lymphocytes ("lymphonets") emerged as a distinctive feature of the anti-cancer immune response. Lymphonets nucleated from small T cell clusters and incorporated B cells with increasing size. CXCR3-mediated trafficking modulated lymphonet size and number, but T cell antigen expression directed intratumoral localization. Lymphonets preferentially harbored TCF1+ PD-1+ progenitor CD8+ T cells involved in responses to immune checkpoint blockade (ICB) therapy. Upon treatment of mice with ICB or an antigen-targeted vaccine, lymphonets retained progenitor and gained cytotoxic CD8+ T cell populations, likely via progenitor differentiation. These data show that lymphonets create a spatial environment supportive of CD8+ T cell anti-tumor responses.

Flexible Cyclic Immunofluorescence (cyCIF) Using Oligonucleotide Barcoded Antibodies.

Advances in our understanding of the complex, multifaceted interactions between tumor epithelia, immune infiltrate, and tumor microenvironmental cells have been driven by highly multiplexed imaging technologies. These techniques are capable of labeling many more biomarkers than conventional immunostaining methods. However, multiplexed imaging techniques suffer from low detection sensitivity, cell loss-particularly in fragile samples-, and challenges with antibody labeling. Herein, we developed and optimized an oligonucleotide antibody barcoding strategy for cyclic immunofluorescence (cyCIF) that can be amplified to increase the detection efficiency of low-abundance antigens. Stained fluorescence signals can be readily removed using ultraviolet light treatment, preserving tissue and fragile cell sample integrity. We also extended the oligonucleotide barcoding strategy to secondary antibodies to enable the inclusion of difficult-to-label primary antibodies in a cyCIF panel. Using both the amplification oligonucleotides to label DNA barcoded antibodies and in situ hybridization of multiple fluorescently labeled oligonucleotides resulted in signal amplification and increased signal-to-background ratios. This procedure was optimized through the examination of staining parameters including staining oligonucleotide concentration, staining temperature, and oligonucleotide sequence design, resulting in a robust amplification technique. As a proof-of-concept, we demonstrate the flexibility of our cyCIF strategy by simultaneously imaging with the original oligonucleotide conjugated antibody (Ab-oligo) cyCIF strategy, the novel Ab-oligo cyCIF amplification strategy, as well as direct and indirect immunofluorescence to generate highly multiplexed images.

Mistic: An open-source multiplexed image t-SNE viewer.

Understanding the complex ecology of a tumor tissue and the spatiotemporal relationships between its cellular and microenvironment components is becoming a key component of translational research, especially in immuno-oncology. The generation and analysis of multiplexed images from patient samples is of paramount importance to facilitate this understanding. Here, we present Mistic, an open-source multiplexed image t-SNE viewer that enables the simultaneous viewing of multiple 2D images rendered using multiple layout options to provide an overall visual preview of the entire dataset. In particular, the positions of the images can be t-SNE or UMAP coordinates. This grouped view of all images allows an exploratory understanding of the specific expression pattern of a given biomarker or collection of biomarkers across all images, helps to identify images expressing a particular phenotype, and can help select images for subsequent downstream analysis. Currently, there is no freely available tool to generate such image t-SNEs.

Multimodal platform for assessing drug distribution and response in clinical trials.

BACKGROUND: Response to targeted therapy varies between patients for largely unknown reasons. Here, we developed and applied an integrative platform using mass spectrometry imaging (MSI), phosphoproteomics, and multiplexed tissue imaging for mapping drug distribution, target engagement, and adaptive response to gain insights into heterogeneous response to therapy. METHODS: Patient-derived xenograft (PDX) lines of glioblastoma were treated with adavosertib, a Wee1 inhibitor, and tissue drug distribution was measured with MALDI-MSI. Phosphoproteomics was measured in the same tumors to identify biomarkers of drug target engagement and cellular adaptive response. Multiplexed tissue imaging was performed on sister sections to evaluate spatial co-localization of drug and cellular response. The integrated platform was then applied on clinical specimens from glioblastoma patients enrolled in the phase 1 clinical trial. RESULTS: PDX tumors exposed to different doses of adavosertib revealed intra- and inter-tumoral heterogeneity of drug distribution and integration of the heterogeneous drug distribution with phosphoproteomics and multiplexed tissue imaging revealed new markers of molecular response to adavosertib. Analysis of paired clinical specimens from patients enrolled in the phase 1 clinical trial informed the translational potential of the identified biomarkers in studying patient's response to adavosertib. CONCLUSIONS: The multimodal platform identified a signature of drug efficacy and patient-specific adaptive responses applicable to preclinical and clinical drug development. The information generated by the approach may inform mechanisms of success and failure in future early phase clinical trials, providing information for optimizing clinical trial design and guiding future application into clinical practice.

Cyclic Immunofluorescence (CycIF), A Highly Multiplexed Method for Single-cell Imaging.

Cyclic Immunofluorescence (CycIF) is a public-domain method for performing highly multiplexed immunofluorescence imaging using a conventional epifluorescence microscope. It uses simple reagents and existing antibodies to construct images with up to 30 channels by sequential 4- to 6-channel imaging followed by fluorophore inactivation. Three variant methods are described, the most generally useful of which involves staining fixed cells with antibodies directly conjugated to Alexa Fluor dyes and imaging in four colors, inactivating fluorophores using a mild base in the presence of hydrogen peroxide and light, and then performing another round of staining and imaging. Cell morphology is preserved through multiple rounds of CycIF, and signal-to-noise ratios appear to increase. Unlike antibody-stripping methods, CycIF is gentle and optimized for monolayers of cultured cells. A second protocol involves indirect immunofluorescence and a third enables chemical inactivation of genetically encoded fluorescent proteins, allowing multiplex immunofluorescence to be combined with live-cell analysis of cells expressing fluorescent reporter proteins. © 2016 by John Wiley & Sons, Inc.