Addressing persistent challenges in digital image analysis of cancerous tissues.

The National Cancer Institute (NCI) supports many research programs and consortia, many of which use imaging as a major modality for characterizing cancerous tissue. A trans-consortia Image Analysis Working Group (IAWG) was established in 2019 with a mission to disseminate imaging-related work and foster collaborations. In 2022, the IAWG held a virtual hackathon focused on addressing challenges of analyzing high dimensional datasets from fixed cancerous tissues. Standard image processing techniques have automated feature extraction, but the next generation of imaging data requires more advanced methods to fully utilize the available information. In this perspective, we discuss current limitations of the automated analysis of multiplexed tissue images, the first steps toward deeper understanding of these limitations, what possible solutions have been developed, any new or refined approaches that were developed during the Image Analysis Hackathon 2022, and where further effort is required. The outstanding problems addressed in the hackathon fell into three main themes: 1) challenges to cell type classification and assessment, 2) translation and visual representation of spatial aspects of high dimensional data, and 3) scaling digital image analyses to large (multi-TB) datasets. We describe the rationale for each specific challenge and the progress made toward addressing it during the hackathon. We also suggest areas that would benefit from more focus and offer insight into broader challenges that the community will need to address as new technologies are developed and integrated into the broad range of image-based modalities and analytical resources already in use within the cancer research community.

An omic and multidimensional spatial atlas from serial biopsies of an evolving metastatic breast cancer.

Mechanisms of therapeutic resistance and vulnerability evolve in metastatic cancers as tumor cells and extrinsic microenvironmental influences change during treatment. To support the development of methods for identifying these mechanisms in individual people, here we present an omic and multidimensional spatial (OMS) atlas generated from four serial biopsies of an individual with metastatic breast cancer during 3.5 years of therapy. This resource links detailed, longitudinal clinical metadata that includes treatment times and doses, anatomic imaging, and blood-based response measurements to clinical and exploratory analyses, which includes comprehensive DNA, RNA, and protein profiles; images of multiplexed immunostaining; and 2- and 3-dimensional scanning electron micrographs. These data report aspects of heterogeneity and evolution of the cancer genome, signaling pathways, immune microenvironment, cellular composition and organization, and ultrastructure. We present illustrative examples of how integrative analyses of these data reveal potential mechanisms of response and resistance and suggest novel therapeutic vulnerabilities.

In Situ Detection of Complex DNA Damage Using Microscopy: A Rough Road Ahead.

Complexity of DNA damage is considered currently one if not the primary instigator of biological responses and determinant of short and long-term effects in organisms and their offspring. In this review, we focus on the detection of complex (clustered) DNA damage (CDD) induced for example by ionizing radiation (IR) and in some cases by high oxidative stress. We perform a short historical perspective in the field, emphasizing the microscopy-based techniques and methodologies for the detection of CDD at the cellular level. We extend this analysis on the pertaining methodology of surrogate protein markers of CDD (foci) colocalization and provide a unique synthesis of imaging parameters, software, and different types of microscopy used. Last but not least, we critically discuss the main advances and necessary future direction for the better detection of CDD, with important outcomes in biological and clinical setups.

Using Microarrays to Interrogate Microenvironmental Impact on Cellular Phenotypes in Cancer.

Understanding the impact of the microenvironment on the phenotype of cells is a difficult problem due to the complex mixture of both soluble growth factors and matrix-associated proteins in the microenvironment in vivo. Furthermore, readily available reagents for the modeling of microenvironments in vitro typically utilize complex mixtures of proteins that are incompletely defined and suffer from batch to batch variability. The microenvironment microarray (MEMA) platform allows for the assessment of thousands of simple combinations of microenvironment proteins for their impact on cellular phenotypes in a single assay. The MEMAs are prepared in well plates, which allows the addition of individual ligands to separate wells containing arrayed extracellular matrix (ECM) proteins. The combination of the soluble ligand with each printed ECM forms a unique combination. A typical MEMA assay contains greater than 2,500 unique combinatorial microenvironments that cells are exposed to in a single assay. As a test case, the breast cancer cell line MCF7 was plated on the MEMA platform. Analysis of this assay identified factors that both enhance and inhibit the growth and proliferation of these cells. The MEMA platform is highly flexible and can be extended for use with other biological questions beyond cancer research.

Microenvironment-Mediated Mechanisms of Resistance to HER2 Inhibitors Differ between HER2+ Breast Cancer Subtypes.

Extrinsic signals are implicated in breast cancer resistance to HER2-targeted tyrosine kinase inhibitors (TKIs). To examine how microenvironmental signals influence resistance, we monitored TKI-treated breast cancer cell lines grown on microenvironment microarrays composed of printed extracellular matrix proteins supplemented with soluble proteins. We tested ∼2,500 combinations of 56 soluble and 46 matrix microenvironmental proteins on basal-like HER2+ (HER2E) or luminal-like HER2+ (L-HER2+) cells treated with the TKIs lapatinib or neratinib. In HER2E cells, hepatocyte growth factor, a ligand for MET, induced resistance that could be reversed with crizotinib, an inhibitor of MET. In L-HER2+ cells, neuregulin1-ß1 (NRG1ß), a ligand for HER3, induced resistance that could be reversed with pertuzumab, an inhibitor of HER2-HER3 heterodimerization. The subtype-specific responses were also observed in 3D cultures and murine xenografts. These results, along with bioinformatic pathway analysis and siRNA knockdown experiments, suggest different mechanisms of resistance specific to each HER2+ subtype: MET signaling for HER2E and HER2-HER3 heterodimerization for L-HER2+ cells.

Phenotype clustering of breast epithelial cells in confocal images based on nuclear protein distribution analysis.

BACKGROUND: The distribution of chromatin-associated proteins plays a key role in directing nuclear function. Previously, we developed an image-based method to quantify the nuclear distributions of proteins and showed that these distributions depended on the phenotype of human mammary epithelial cells. Here we describe a method that creates a hierarchical tree of the given cell phenotypes and calculates the statistical significance between them, based on the clustering analysis of nuclear protein distributions. RESULTS: Nuclear distributions of nuclear mitotic apparatus protein were previously obtained for non-neoplastic S1 and malignant T4-2 human mammary epithelial cells cultured for up to 12 days. Cell phenotype was defined as S1 or T4-2 and the number of days in cultured. A probabilistic ensemble approach was used to define a set of consensus clusters from the results of multiple traditional cluster analysis techniques applied to the nuclear distribution data. Cluster histograms were constructed to show how cells in any one phenotype were distributed across the consensus clusters. Grouping various phenotypes allowed us to build phenotype trees and calculate the statistical difference between each group. The results showed that non-neoplastic S1 cells could be distinguished from malignant T4-2 cells with 94.19% accuracy; that proliferating S1 cells could be distinguished from differentiated S1 cells with 92.86% accuracy; and showed no significant difference between the various phenotypes of T4-2 cells corresponding to increasing tumor sizes. CONCLUSION: This work presents a cluster analysis method that can identify significant cell phenotypes, based on the nuclear distribution of specific proteins, with high accuracy.

Automated local bright feature image analysis of nuclear protein distribution identifies changes in tissue phenotype.

The organization of nuclear proteins is linked to cell and tissue phenotypes. When cells arrest proliferation, undergo apoptosis, or differentiate, distribution of nuclear proteins changes. Conversely, forced alteration of the distribution of nuclear proteins modifies cell phenotype. Immunostaining and fluorescence microscopy have been critical for such findings. However, there is increasing need for quantitative analysis of nuclear protein distribution to decipher epigenetic relationships between nuclear structure and cell phenotype and to unravel the mechanisms linking nuclear structure and function. We have developed imaging methods to quantify the distribution of fluorescently stained nuclear protein NuMA in different mammary phenotypes obtained using 3D cell culture. Automated image segmentation of DAPI-stained nuclei was generated to isolate thousands of nuclei from 3D confocal images. Prominent features of fluorescently stained NuMA were detected by using a previously undescribed local bright feature analysis technique, and their normalized spatial density was calculated as a function of the distance from the nuclear perimeter to its center. The results revealed marked changes in the distribution of the density of NuMA bright features when nonneoplastic cells underwent phenotypically normal acinar morphogenesis. Conversely, we did not detect any reorganization of NuMA during formation of tumor nodules by malignant cells. Importantly, the analysis also discriminated proliferating nonneoplastic from proliferating malignant cells, suggesting that these imaging methods are capable of identifying alterations linked not only to the proliferation status but also to the malignant character of cells. We believe that this quantitative analysis will have additional applications for classifying normal and pathological tissues.