Machine learning-assisted mid-infrared spectrochemical fibrillar collagen imaging in clinical tissues.

Significance: Label-free multimodal imaging methods that can provide complementary structural and chemical information from the same sample are critical for comprehensive tissue analyses. These methods are specifically needed to study the complex tumor-microenvironment where fibrillar collagen's architectural changes are associated with cancer progression. To address this need, we present a multimodal computational imaging method where mid-infrared spectral imaging (MIRSI) is employed with second harmonic generation (SHG) microscopy to identify fibrillar collagen in biological tissues. Aim: To demonstrate a multimodal approach where a morphology-specific contrast mechanism guides an MIRSI method to detect fibrillar collagen based on its chemical signatures. Approach: We trained a supervised machine learning (ML) model using SHG images as ground truth collagen labels to classify fibrillar collagen in biological tissues based on their mid-infrared hyperspectral images. Five human pancreatic tissue samples (sizes are in the order of millimeters) were imaged by both MIRSI and SHG microscopes. In total, 2.8 million MIRSI spectra were used to train a random forest (RF) model. The other 68 million spectra were used to validate the collagen images generated by the RF-MIRSI model in terms of collagen segmentation, orientation, and alignment. Results: Compared with the SHG ground truth, the generated RF-MIRSI collagen images achieved a high average boundary F -score (0.8 at 4-pixel thresholds) in the collagen distribution, high correlation (Pearson's R 0.82) in the collagen orientation, and similarly high correlation (Pearson's R 0.66) in the collagen alignment. Conclusions: We showed the potential of ML-aided label-free mid-infrared hyperspectral imaging for collagen fiber and tumor microenvironment analysis in tumor pathology samples.

Multiphoton excited polymerized biomimetic models of collagen fiber morphology to study single cell and collective migration dynamics in pancreatic cancer.

The respective roles of aligned collagen fiber morphology found in the extracellular matrix (ECM) of pancreatic cancer patients and cellular migration dynamics have been gaining attention because of their connection with increased aggressive phenotypes and poor prognosis. To better understand how collagen fiber morphology influences cell-matrix interactions associated with metastasis, we used Second Harmonic Generation (SHG) images from patient biopsies with Pancreatic ductal adenocarcinoma (PDAC) as models to fabricate collagen scaffolds to investigate processes associated with motility. Using the PDAC BxPC-3 metastatic cell line, we investigated single and collective cell dynamics on scaffolds of varying collagen alignment. Collective or clustered cells grown on the scaffolds with the highest collagen fiber alignment had increased E-cadherin expression and larger focal adhesion sites compared to single cells, consistent with metastatic behavior. Analysis of single cell motility revealed that the dynamics were characterized by random walk on all substrates. However, examining collective motility over different time points showed that the migration was super-diffusive and enhanced on highly aligned fibers, whereas it was hindered and sub-diffusive on un-patterned substrates. This was further supported by the more elongated morphology observed in collectively migrating cells on aligned collagen fibers. Overall, this approach allows the decoupling of single and collective cell behavior as a function of collagen alignment and shows the relative importance of collective cell behavior as well as fiber morphology in PDAC metastasis. We suggest these scaffolds can be used for further investigations of PDAC cell biology. STATEMENT OF SIGNIFICANCE: Pancreatic ductal adenocarcinoma (PDAC) has a high mortality rate, where aligned collagen has been associated with poor prognosis. Biomimetic models representing this architecture are needed to understand complex cellular interactions. The SHG image-based models based on stromal collagen from human biopsies afford the measurements of cell morphology, cadherin and focal adhesion expression as well as detailed motility dynamics. Using a metastatic cell line, we decoupled the roles of single cell and collective cell behavior as well as that arising from aligned collagen. Our data suggests that metastatic characteristics are enhanced by increased collagen alignment and that collective cell behavior is more relevant to metastatic processes. These scaffolds provide new insight in this disease and can be a platform for further experiments such as testing drug efficacy.

Machine learning assisted mid-infrared spectrochemical fibrillar collagen imaging in clinical tissues.

Significance: Label-free multimodal imaging methods that can provide complementary structural and chemical information from the same sample are critical for comprehensive tissue analyses. These methods are specifically needed to study the complex tumor-microenvironment where fibrillar collagen's architectural changes are associated with cancer progression. To address this need, we present a multimodal computational imaging method where mid-infrared spectral imaging (MIRSI) is employed with second harmonic generation (SHG) microscopy to identify fibrillar collagen in biological tissues. Aim: To demonstrate a multimodal approach where a morphology-specific contrast mechanism guides a mid-infrared spectral imaging method to detect fibrillar collagen based on its chemical signatures. Approach: We trained a supervised machine learning (ML) model using SHG images as ground truth collagen labels to classify fibrillar collagen in biological tissues based on their mid-infrared hyperspectral images. Five human pancreatic tissue samples (sizes are in the order of millimeters) were imaged by both MIRSI and SHG microscopes. In total, 2.8 million MIRSI spectra were used to train a random forest (RF) model. The remaining 68 million spectra were used to validate the collagen images generated by the RF-MIRSI model in terms of collagen segmentation, orientation, and alignment. Results: Compared to the SHG ground truth, the generated MIRSI collagen images achieved a high average boundary F-score (0.8 at 4 pixels threshold) in the collagen distribution, high correlation (Pearson's R 0.82) in the collagen orientation, and similarly high correlation (Pearson's R 0.66) in the collagen alignment. Conclusions: We showed the potential of ML-aided label-free mid-infrared hyperspectral imaging for collagen fiber and tumor microenvironment analysis in tumor pathology samples.

A mouse model of TB-associated lung fibrosis reveals persistent inflammatory macrophage populations during treatment.

Post-TB lung disease (PTLD) causes a significant burden of global disease. Fibrosis is a central component of many clinical features of PTLD. To date, we have a limited understanding of the mechanisms of TB-associated fibrosis and how these mechanisms are similar to or dissimilar from other fibrotic lung pathologies. We have adapted a mouse model of TB infection to facilitate the mechanistic study of TB-associated lung fibrosis. We find that the morphologies of fibrosis that develop in the mouse model are similar to the morphologies of fibrosis observed in human tissue samples. Using Second Harmonic Generation (SHG) microscopy, we are able to quantify a major component of fibrosis, fibrillar collagen, over time and with treatment. Inflammatory macrophage subpopulations persist during treatment; matrix remodeling enzymes and inflammatory gene signatures remain elevated. Our mouse model suggests that there is a therapeutic window during which adjunctive therapies could change matrix remodeling or inflammatory drivers of tissue pathology to improve functional outcomes after treatment for TB infection.

Piximi - An Images to Discovery web tool for bioimages and beyond.

Deep learning has greatly accelerated research in biological image analysis yet it often requires programming skills and specialized tool installation. Here we present Piximi, a modern, no-programming image analysis tool leveraging deep learning. Implemented as a web application at Piximi.app, Piximi requires no installation and can be accessed by any modern web browser. Its client-only architecture preserves the security of researcher data by running all computation locally. Piximi offers four core modules: a deep learning classifier, an image annotator, measurement modules, and pre-trained deep learning segmentation modules. Piximi is interoperable with existing tools and workflows by supporting import and export of common data and model formats. The intuitive researcher interface and easy access to Piximi allows biological researchers to obtain insights into images within just a few minutes. Piximi aims to bring deep learning-powered image analysis to a broader community by eliminating barriers to entry.

Label-free fluorescence lifetime imaging for the assessment of cell viability in living tumor fragments.

Significance: To enable non-destructive longitudinal assessment of drug agents in intact tumor tissue without the use of disruptive probes, we have designed a label-free method to quantify the health of individual tumor cells in excised tumor tissue using multiphoton fluorescence lifetime imaging microscopy (MP-FLIM). Aim: Using murine tumor fragments which preserve the native tumor microenvironment, we seek to demonstrate signals generated by the intrinsically fluorescent metabolic co-factors nicotinamide adenine dinucleotide phosphate [NAD(P)H] and flavin adenine dinucleotide (FAD) correlate with irreversible cascades leading to cell death. Approach: We use MP-FLIM of NAD(P)H and FAD on tissues and confirm viability using standard apoptosis and live/dead (Caspase 3/7 and propidium iodide, respectively) assays. Results: Through a statistical approach, reproducible shifts in FLIM data, determined through phasor analysis, are shown to correlate with loss of cell viability. With this, we demonstrate that cell death achieved through either apoptosis/necrosis or necroptosis can be discriminated. In addition, specific responses to common chemotherapeutic treatment inducing cell death were detected. Conclusions: These data demonstrate that MP-FLIM can detect and quantify cell viability without the use of potentially toxic dyes, thus enabling longitudinal multi-day studies assessing the effects of therapeutic agents on tumor fragments.

Implementation of FRET Spectrometry Using Temporally Resolved Fluorescence: A Feasibility Study.

Förster resonance energy transfer (FRET) spectrometry is a method for determining the quaternary structure of protein oligomers from distributions of FRET efficiencies that are drawn from pixels of fluorescence images of cells expressing the proteins of interest. FRET spectrometry protocols currently rely on obtaining spectrally resolved fluorescence data from intensity-based experiments. Another imaging method, fluorescence lifetime imaging microscopy (FLIM), is a widely used alternative to compute FRET efficiencies for each pixel in an image from the reduction of the fluorescence lifetime of the donors caused by FRET. In FLIM studies of oligomers with different proportions of donors and acceptors, the donor lifetimes may be obtained by fitting the temporally resolved fluorescence decay data with a predetermined number of exponential decay curves. However, this requires knowledge of the number and the relative arrangement of the fluorescent proteins in the sample, which is precisely the goal of FRET spectrometry, thus creating a conundrum that has prevented users of FLIM instruments from performing FRET spectrometry. Here, we describe an attempt to implement FRET spectrometry on temporally resolved fluorescence microscopes by using an integration-based method of computing the FRET efficiency from fluorescence decay curves. This method, which we dubbed time-integrated FRET (or tiFRET), was tested on oligomeric fluorescent protein constructs expressed in the cytoplasm of living cells. The present results show that tiFRET is a promising way of implementing FRET spectrometry and suggest potential instrument adjustments for increasing accuracy and resolution in this kind of study.

Assessing cell viability with dynamic optical coherence microscopy.

Assessing cell viability is important in many fields of research. Current optical methods to assess cell viability typically involve fluorescent dyes, which are often less reliable and have poor permeability in primary tissues. Dynamic optical coherence microscopy (dOCM) is an emerging tool that provides label-free contrast reflecting changes in cellular metabolism. In this work, we compare the live contrast obtained from dOCM to viability dyes, and for the first time to our knowledge, demonstrate that dOCM can distinguish live cells from dead cells in murine syngeneic tumors. We further demonstrate a strong correlation between dOCM live contrast and optical redox ratio by metabolic imaging in primary mouse liver tissue. The dOCM technique opens a new avenue to apply label-free imaging to assess the effects of immuno-oncology agents, targeted therapies, chemotherapy, and cell therapies using live tumor tissues.

Real-time open-source FLIM analysis.

Fluorescence lifetime imaging microscopy (FLIM) provides valuable quantitative insights into fluorophores' chemical microenvironment. Due to long computation times and the lack of accessible, open-source real-time analysis toolkits, traditional analysis of FLIM data, particularly with the widely used time-correlated single-photon counting (TCSPC) approach, typically occurs after acquisition. As a result, uncertainties about the quality of FLIM data persist even after collection, frequently necessitating the extension of imaging sessions. Unfortunately, prolonged sessions not only risk missing important biological events but also cause photobleaching and photodamage. We present the first open-source program designed for real-time FLIM analysis during specimen scanning to address these challenges. Our approach combines acquisition with real-time computational and visualization capabilities, allowing us to assess FLIM data quality on the fly. Our open-source real-time FLIM viewer, integrated as a Napari plugin, displays phasor analysis and rapid lifetime determination (RLD) results computed from real-time data transmitted by acquisition software such as the open-source Micro-Manager-based OpenScan package. Our method facilitates early identification of FLIM signatures and data quality assessment by providing preliminary analysis during acquisition. This not only speeds up the imaging process, but it is especially useful when imaging sensitive live biological samples.

Collagen fiber centerline tracking in fibrotic tissue via deep neural networks with variational autoencoder-based synthetic training data generation.

The role of fibrillar collagen in the tissue microenvironment is critical in disease contexts ranging from cancers to chronic inflammations, as evidenced by many studies. Quantifying fibrillar collagen organization has become a powerful approach for characterizing the topology of collagen fibers and studying the role of collagen fibers in disease progression. We present a deep learning-based pipeline to quantify collagen fibers' topological properties in microscopy-based collagen images from pathological tissue samples. Our method leverages deep neural networks to extract collagen fiber centerlines and deep generative models to create synthetic training data, addressing the current shortage of large-scale annotations. As a part of this effort, we have created and annotated a collagen fiber centerline dataset, with the hope of facilitating further research in this field. Quantitative measurements such as fiber orientation, alignment, density, and length can be derived based on the centerline extraction results. Our pipeline comprises three stages. Initially, a variational autoencoder is trained to generate synthetic centerlines possessing controllable topological properties. Subsequently, a conditional generative adversarial network synthesizes realistic collagen fiber images from the synthetic centerlines, yielding a synthetic training set of image-centerline pairs. Finally, we train a collagen fiber centerline extraction network using both the original and synthetic data. Evaluation using collagen fiber images from pancreas, liver, and breast cancer samples collected via second-harmonic generation microscopy demonstrates our pipeline's superiority over several popular fiber centerline extraction tools. Incorporating synthetic data into training further enhances the network's generalizability. Our code is available at https://github.com/uw-loci/collagen-fiber-metrics.

CellProfiler plugins - An easy image analysis platform integration for containers and Python tools.

CellProfiler is a widely used software for creating reproducible, reusable image analysis workflows without needing to code. In addition to the >90 modules that make up the main CellProfiler program, CellProfiler has a plugins system that allows for the creation of new modules which integrate with other Python tools or tools that are packaged in software containers. The CellProfiler-plugins repository contains a number of these CellProfiler modules, especially modules that are experimental and/or dependency-heavy. Here, we present an upgraded CellProfiler-plugins repository, an example of accessing containerised tools, improved documentation and added citation/reference tools to facilitate the use and contribution of the community.

Bridging imaging users to imaging analysis - A community survey.

The 'Bridging Imaging Users to Imaging Analysis' survey was conducted in 2022 by the Center for Open Bioimage Analysis (COBA), BioImaging North America (BINA) and the Royal Microscopical Society Data Analysis in Imaging Section (RMS DAIM) to understand the needs of the imaging community. Through multichoice and open-ended questions, the survey inquired about demographics, image analysis experiences, future needs and suggestions on the role of tool developers and users. Participants of the survey were from diverse roles and domains of the life and physical sciences. To our knowledge, this is the first attempt to survey cross-community to bridge knowledge gaps between physical and life sciences imaging. Survey results indicate that respondents' overarching needs are documentation, detailed tutorials on the usage of image analysis tools, user-friendly intuitive software, and better solutions for segmentation, ideally in a format tailored to their specific use cases. The tool creators suggested the users familiarise themselves with the fundamentals of image analysis, provide constant feedback and report the issues faced during image analysis while the users would like more documentation and an emphasis on tool friendliness. Regardless of the computational experience, there is a strong preference for 'written tutorials' to acquire knowledge on image analysis. We also observed that the interest in having 'office hours' to get an expert opinion on their image analysis methods has increased over the years. The results also showed less-than-expected usage of online discussion forums in the imaging community for solving image analysis problems. Surprisingly, we also observed a decreased interest among the survey respondents in deep/machine learning despite the increasing adoption of artificial intelligence in biology. In addition, the community suggests the need for a common repository for the available image analysis tools and their applications. The opinions and suggestions of the community, released here in full, will help the image analysis tool creation and education communities to design and deliver the resources accordingly.

CellProfiler plugins -- an easy image analysis platform integration for containers and Python tools.

CellProfiler is a widely used software for creating reproducible, reusable image analysis workflows without needing to code. In addition to the >90 modules that make up the main CellProfiler program, CellProfiler has a plugins system that allows for the creation of new modules which integrate with other Python tools or tools that are packaged in software containers. The CellProfiler-plugins repository contains a number of these CellProfiler modules, especially modules that are experimental and/or dependency-heavy. Here, we present an upgraded CellProfiler-plugins repository, an example of accessing containerized tools, improved documentation, and added citation/reference tools to facilitate the use and contribution of the community.

Changes in carotid artery texture by ultrasound and elastin features in a murine model.

Objective: In humans, arterial grayscale ultrasound texture features independently predict adverse cardiovascular disease (CVD) events and change with medical interventions. We performed this study to examine how grayscale ultrasound texture features and elastin fibers change in plaque-free segments of the arterial wall in a murine model prone to atherosclerosis. Methods: A total of 10 Apoetm1Unc/J mice (n = 5 male, n = 5 female) were imaged at 6, 16, and 24 weeks of age. Two mice were euthanized at 6 and 16 weeks and the remaining mice at 24 weeks. Texture features were extracted from the ultrasound images of the distal 1.0 mm of the common carotid artery wall, and elastin measures were extracted from histology images. Two-way analysis of variance was used to evaluate associations between week, sex, and grayscale texture features. Texture feature and elastin number comparisons between weeks were conducted using the sex-by-week two-way interaction contrasts. Sex-specific correlations between the number of elastin fibers and grayscale texture features were analyzed by conducting non-parametric Spearman's rank correlation analyses. Results: Arterial wall homogeneity changed significantly in male mice from 6 to 24 weeks, with a mean (SD) of 0.14 (0.03) units at 6 weeks and 0.18 (0.03) units at 24 weeks (p = 0.026). Spatial gray level dependence matrices-homogeneity (SGLD-HOM) also correlated with carotid artery plaque score (rs = 0.707, p = 0.033). Elastin fibers in the region of interest decreased from 6 to 24 weeks for both male and female mice, although only significantly in male mice. The mean (SD) number of elastin fibers for male mice was 5.32 (1.50) at 6 weeks and 3.59 (0.38) at 24 weeks (p = 0.023). For female mice, the mean (SD) number of elastin fibers was 3.98 (0.38) at 6 weeks and 3.46 (0.19) at 24 weeks (p = 0.051). Conclusion: Grayscale ultrasound texture features that are associated with increased risk for CVD events in humans were used in a murine model, and the grayscale texture feature SGLD-HOM was shown to change in male mice from 6 weeks to 24 weeks. Structural alterations of the arterial wall (change in elastin fiber number) were observed during this time and may differ by sex.

Moving beyond the desktop: prospects for practical bioimage analysis via the web.

As biological imaging continues to rapidly advance, it results in increasingly complex image data, necessitating a reevaluation of conventional bioimage analysis methods and their accessibility. This perspective underscores our belief that a transition from desktop-based tools to web-based bioimage analysis could unlock immense opportunities for improved accessibility, enhanced collaboration, and streamlined workflows. We outline the potential benefits, such as reduced local computational demands and solutions to common challenges, including software installation issues and limited reproducibility. Furthermore, we explore the present state of web-based tools, hurdles in implementation, and the significance of collective involvement from the scientific community in driving this transition. In acknowledging the potential roadblocks and complexity of data management, we suggest a combined approach of selective prototyping and large-scale workflow application for optimal usage. Embracing web-based bioimage analysis could pave the way for the life sciences community to accelerate biological research, offering a robust platform for a more collaborative, efficient, and democratized science.

In Vivo Adaptive Bayesian Regularized Lagrangian Carotid Strain Imaging for Murine Carotid Arteries and Its Associations With Histological Findings.

OBJECTIVES: Non-invasive methods for monitoring arterial health and identifying early injury to optimize treatment for patients are desirable. The objective of this study was to demonstrate the use of an adaptive Bayesian regularized Lagrangian carotid strain imaging (ABR-LCSI) algorithm for monitoring of atherogenesis in a murine model and examine associations between the ultrasound strain measures and histology. METHODS: Ultrasound radiofrequency (RF) data were acquired from both the right and left common carotid artery (CCA) of 10 (5 male and 5 female) ApoE tm1Unc/J mice at 6, 16 and 24 wk. Lagrangian accumulated axial, lateral and shear strain images and three strain indices-maximum accumulated strain index (MASI), peak mean strain of full region of interest (ROI) index (PMSRI) and strain at peak axial displacement index (SPADI)-were estimated using the ABR-LCSI algorithm. Mice were euthanized (n = 2 at 6 and 16 wk, n = 6 at 24 wk) for histology examination. RESULTS: Sex-specific differences in strain indices of mice at 6, 16 and 24 wk were observed. For male mice, axial PMSRI and SPADI changed significantly from 6 to 24 wk (mean axial PMSRI at 6 wk = 14.10 ± 5.33% and that at 24 wk = -3.03 ± 5.61%, p < 0.001). For female mice, lateral MASI increased significantly from 6 to 24 wk (mean lateral MASI at 6 wk = 10.26 ± 3.13% and that at 24 wk = 16.42 ± 7.15%, p = 0.048). Both cohorts exhibited strong associations with ex vivo histological findings (male mice: correlation between number of elastin fibers and axial PMSRI: rs = 0.83, p = 0.01; female mice: correlation between shear MASI and plaque score: rs = 0.77, p = 0.009). CONCLUSION: The results indicate that ABR-LCSI can be used to measure arterial wall strain in a murine model and that changes in strain are associated with changes in arterial wall structure and plaque formation.

A biologist's guide to planning and performing quantitative bioimaging experiments.

Technological advancements in biology and microscopy have empowered a transition from bioimaging as an observational method to a quantitative one. However, as biologists are adopting quantitative bioimaging and these experiments become more complex, researchers need additional expertise to carry out this work in a rigorous and reproducible manner. This Essay provides a navigational guide for experimental biologists to aid understanding of quantitative bioimaging from sample preparation through to image acquisition, image analysis, and data interpretation. We discuss the interconnectedness of these steps, and for each, we provide general recommendations, key questions to consider, and links to high-quality open-access resources for further learning. This synthesis of information will empower biologists to plan and execute rigorous quantitative bioimaging experiments efficiently.