Points2Regions: Fast, interactive clustering of imaging-based spatial transcriptomics data.

Imaging-based spatial transcriptomics techniques generate data in the form of spatial points belonging to different mRNA classes. A crucial part of analyzing the data involves the identification of regions with similar composition of mRNA classes. These biologically interesting regions can manifest at different spatial scales. For example, the composition of mRNA classes on a cellular scale corresponds to cell types, whereas compositions on a millimeter scale correspond to tissue-level structures. Traditional techniques for identifying such regions often rely on complementary data, such as pre-segmented cells, or lengthy optimization. This limits their applicability to tasks on a particular scale, restricting their capabilities in exploratory analysis. This article introduces "Points2Regions," a computational tool for identifying regions with similar mRNA compositions. The tool's novelty lies in its rapid feature extraction by rasterizing points (representing mRNAs) onto a pyramidal grid and its efficient clustering using a combination of hierarchical and k $$ k $$ -means clustering. This enables fast and efficient region discovery across multiple scales without relying on additional data, making it a valuable resource for exploratory analysis. Points2Regions has demonstrated performance similar to state-of-the-art methods on two simulated datasets, without relying on segmented cells, while being several times faster. Experiments on real-world datasets show that regions identified by Points2Regions are similar to those identified in other studies, confirming that Points2Regions can be used to extract biologically relevant regions. The tool is shared as a Python package integrated into TissUUmaps and a Napari plugin, offering interactive clustering and visualization, significantly enhancing user experience in data exploration.

Spatial Transcriptome Mapping of the Desmoplastic Growth Pattern of Colorectal Liver Metastases by In Situ Sequencing Reveals a Biologically Relevant Zonation of the Desmoplastic Rim.

PURPOSE: We describe the fibrotic rim formed in the desmoplastic histopathologic growth pattern (DHGP) of colorectal cancer liver metastasis (CLM) using in situ sequencing (ISS). The origin of the desmoplastic rim is still a matter of debate, and the detailed cellular organization has not yet been fully elucidated. Understanding the biology of the DHGP in CLM can lead to targeted treatment and improve survival. EXPERIMENTAL DESIGN: We used ISS, targeting 150 genes, to characterize the desmoplastic rim by unsupervised clustering of gene coexpression patterns. The cohort comprised 10 chemo-naïve liver metastasis resection samples with a DHGP. RESULTS: Unsupervised clustering of spatially mapped genes revealed molecular and cellular diversity within the desmoplastic rim. We confirmed the presence of the ductular reaction and cancer-associated fibroblasts. Importantly, we discovered angiogenesis and outer and inner zonation in the rim, characterized by nerve growth factor receptor and periostin expression. CONCLUSIONS: ISS enabled the analysis of the cellular organization of the fibrous rim surrounding CLM with a DHGP and suggests a transition from the outer part of the rim, with nonspecific liver injury response, into the inner part, with gene expression indicating collagen synthesis and extracellular matrix remodeling influenced by the interaction with cancer cells, creating a cancer cell-supportive environment. Moreover, we found angiogenic processes in the rim. Our results provide a potential explanation of the origin of the rim in DHGP and lead to exploring novel targeted treatments for patients with CLM to improve survival.

Harmonizing the Generation and Pre-publication Stewardship of FAIR Image Data.

Together with the molecular knowledge of genes and proteins, biological images promise to significantly enhance the scientific understanding of complex cellular systems and to advance predictive and personalized therapeutic products for human health. For this potential to be realized, quality-assured image data must be shared among labs at a global scale to be compared, pooled, and reanalyzed, thus unleashing untold potential beyond the original purpose for which the data was generated. There are two broad sets of requirements to enable image data sharing in the life sciences. One set of requirements is articulated in the companion White Paper entitled Enabling Global Image Data Sharing in the Life Sciences, which is published in parallel and addresses the need to build the cyberinfrastructure for sharing the digital array data. In this White Paper, we detail a broad set of requirements, which involves collecting, managing, presenting, and propagating contextual information essential to assess the quality, understand the content, interpret the scientific implications, and reuse image data in the context of the experimental details. We start by providing an overview of the main lessons learned to date through international community activities, which have recently made considerable progress toward generating community standard practices for imaging Quality Control (QC) and metadata. We then provide a clear set of recommendations for amplifying this work. The driving goal is to address remaining challenges and democratize access to everyday practices and tools for a spectrum of biomedical researchers, regardless of their expertise, access to resources, and geographical location.

DEPICTER: Deep representation clustering for histology annotation.

Automatic segmentation of histopathology whole-slide images (WSI) usually involves supervised training of deep learning models with pixel-level labels to classify each pixel of the WSI into tissue regions such as benign or cancerous. However, fully supervised segmentation requires large-scale data manually annotated by experts, which can be expensive and time-consuming to obtain. Non-fully supervised methods, ranging from semi-supervised to unsupervised, have been proposed to address this issue and have been successful in WSI segmentation tasks. But these methods have mainly been focused on technical advancements in algorithmic performance rather than on the development of practical tools that could be used by pathologists or researchers in real-world scenarios. In contrast, we present DEPICTER (Deep rEPresentatIon ClusTERing), an interactive segmentation tool for histopathology annotation that produces a patch-wise dense segmentation map at WSI level. The interactive nature of DEPICTER leverages self- and semi-supervised learning approaches to allow the user to participate in the segmentation producing reliable results while reducing the workload. DEPICTER consists of three steps: first, a pretrained model is used to compute embeddings from image patches. Next, the user selects a number of benign and cancerous patches from the multi-resolution image. Finally, guided by the deep representations, label propagation is achieved using our novel seeded iterative clustering method or by directly interacting with the embedding space via feature space gating. We report both real-time interaction results with three pathologists and evaluate the performance on three public cancer classification dataset benchmarks through simulations. The code and demos of DEPICTER are publicly available at https://github.com/eduardchelebian/depicter.

PACMan: A software package for automated single-cell chlorophyll fluorometry.

Microalgae, small photosynthetic unicells, are of great interest to ecology, ecotoxicology and biotechnology and there is a growing need to investigate the ability of cells to photosynthesize under variable conditions. Current strategies involve hand-operated pulse-amplitude-modulated (PAM) chlorophyll fluorimeters, which can provide detailed insights into the photophysiology of entire populations- or individual cells of microalgae but are typically limited in their throughput. To increase the throughput of a commercially available MICROSCOPY-PAM system, we present the PAM Automation Control Manager ('PACMan'), an open-source Python software package that automates image acquisition, microscopy stage control and the triggering of external hardware components. PACMan comes with a user-friendly graphical user interface and is released together with a stand-alone tool (PAMalysis) for the automated calculation of per-cell maximum quantum efficiencies (= Fv /Fm ). Using these two software packages, we successfully tracked the photophysiology of >1000 individual cells of green algae (Chlamydomonas reinhardtii) and dinoflagellates (genus Symbiodiniaceae) within custom-made microfluidic devices. Compared to the manual operation of MICROSCOPY-PAM systems, this represents a 10-fold increase in throughput. During experiments, PACMan coordinated the movement of the microscope stage and triggered the MICROSCOPY-PAM system to repeatedly capture high-quality image data across multiple positions. Finally, we analyzed single-cell Fv /Fm with the manufacturer-supplied software and PAMalysis, demonstrating a median difference <0.5% between both methods. We foresee that PACMan, and its auxiliary software package will help increase the experimental throughput in a range of microalgae studies currently relying on hand-operated MICROSCOPY-PAM technologies.

Label-free deep learning-based species classification of bacteria imaged by phase-contrast microscopy.

Reliable detection and classification of bacteria and other pathogens in the human body, animals, food, and water is crucial for improving and safeguarding public health. For instance, identifying the species and its antibiotic susceptibility is vital for effective bacterial infection treatment. Here we show that phase contrast time-lapse microscopy combined with deep learning is sufficient to classify four species of bacteria relevant to human health. The classification is performed on living bacteria and does not require fixation or staining, meaning that the bacterial species can be determined as the bacteria reproduce in a microfluidic device, enabling parallel determination of susceptibility to antibiotics. We assess the performance of convolutional neural networks and vision transformers, where the best model attained a class-average accuracy exceeding 98%. Our successful proof-of-principle results suggest that the methods should be challenged with data covering more species and clinically relevant isolates for future clinical use.

Evaluating the utility of brightfield image data for mechanism of action prediction.

Fluorescence staining techniques, such as Cell Painting, together with fluorescence microscopy have proven invaluable for visualizing and quantifying the effects that drugs and other perturbations have on cultured cells. However, fluorescence microscopy is expensive, time-consuming, labor-intensive, and the stains applied can be cytotoxic, interfering with the activity under study. The simplest form of microscopy, brightfield microscopy, lacks these downsides, but the images produced have low contrast and the cellular compartments are difficult to discern. Nevertheless, by harnessing deep learning, these brightfield images may still be sufficient for various predictive purposes. In this study, we compared the predictive performance of models trained on fluorescence images to those trained on brightfield images for predicting the mechanism of action (MoA) of different drugs. We also extracted CellProfiler features from the fluorescence images and used them to benchmark the performance. Overall, we found comparable and largely correlated predictive performance for the two imaging modalities. This is promising for future studies of MoAs in time-lapse experiments for which using fluorescence images is problematic. Explorations based on explainable AI techniques also provided valuable insights regarding compounds that were better predicted by one modality over the other.

TissUUmaps 3: Improvements in interactive visualization, exploration, and quality assessment of large-scale spatial omics data.

Background and objectives: Spatially resolved techniques for exploring the molecular landscape of tissue samples, such as spatial transcriptomics, often result in millions of data points and images too large to view on a regular desktop computer, limiting the possibilities in visual interactive data exploration. TissUUmaps is a free, open-source browser-based tool for GPU-accelerated visualization and interactive exploration of 107+ data points overlaying tissue samples. Methods: Herein we describe how TissUUmaps 3 provides instant multiresolution image viewing and can be customized, shared, and also integrated into Jupyter Notebooks. We introduce new modules where users can visualize markers and regions, explore spatial statistics, perform quantitative analyses of tissue morphology, and assess the quality of decoding in situ transcriptomics data. Results: We show that thanks to targeted optimizations the time and cost associated with interactive data exploration were reduced, enabling TissUUmaps 3 to handle the scale of today's spatial transcriptomics methods. Conclusion: TissUUmaps 3 provides significantly improved performance for large multiplex datasets as compared to previous versions. We envision TissUUmaps to contribute to broader dissemination and flexible sharing of largescale spatial omics data.

Roadmap on Deep Learning for Microscopy.

Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the past decade. This Roadmap is written collectively by prominent researchers and encompasses selected aspects of how machine learning is applied to microscopy image data, with the aim of gaining scientific knowledge by improved image quality, automated detection, segmentation, classification and tracking of objects, and efficient merging of information from multiple imaging modalities. We aim to give the reader an overview of the key developments and an understanding of possibilities and limitations of machine learning for microscopy. It will be of interest to a wide cross-disciplinary audience in the physical sciences and life sciences.

A topographic atlas defines developmental origins of cell heterogeneity in the human embryonic lung.

The lung contains numerous specialized cell types with distinct roles in tissue function and integrity. To clarify the origins and mechanisms generating cell heterogeneity, we created a comprehensive topographic atlas of early human lung development. Here we report 83 cell states and several spatially resolved developmental trajectories and predict cell interactions within defined tissue niches. We integrated single-cell RNA sequencing and spatially resolved transcriptomics into a web-based, open platform for interactive exploration. We show distinct gene expression programmes, accompanying sequential events of cell differentiation and maturation of the secretory and neuroendocrine cell types in proximal epithelium. We define the origin of airway fibroblasts associated with airway smooth muscle in bronchovascular bundles and describe a trajectory of Schwann cell progenitors to intrinsic parasympathetic neurons controlling bronchoconstriction. Our atlas provides a rich resource for further research and a reference for defining deviations from homeostatic and repair mechanisms leading to pulmonary diseases.