A high-throughput technique to map cell images to cell positions using a 3D imaging flow cytometer.

We develop a high-throughput technique to relate positions of individual cells to their three-dimensional (3D) imaging features with single-cell resolution. The technique is particularly suitable for nonadherent cells where existing spatial biology methodologies relating cell properties to their positions in a solid tissue do not apply. Our design consists of two parts, as follows: recording 3D cell images at high throughput (500 to 1,000 cells/s) using a custom 3D imaging flow cytometer (3D-IFC) and dispensing cells in a first-in-first-out (FIFO) manner using a robotic cell placement platform (CPP). To prevent errors due to violations of the FIFO principle, we invented a method that uses marker beads and DNA sequencing software to detect errors. Experiments with human cancer cell lines demonstrate the feasibility of mapping 3D side scattering and fluorescent images, as well as two-dimensional (2D) transmission images of cells to their locations on the membrane filter for around 100,000 cells in less than 10 min. While the current work uses our specially designed 3D imaging flow cytometer to produce 3D cell images, our methodology can support other imaging modalities. The technology and method form a bridge between single-cell image analysis and single-cell molecular analysis.

Interpretable unsupervised learning enables accurate clustering with high-throughput imaging flow cytometry.

A primary challenge of high-throughput imaging flow cytometry (IFC) is to analyze the vast amount of imaging data, especially in applications where ground truth labels are unavailable or hard to obtain. We present an unsupervised deep embedding algorithm, the Deep Convolutional Autoencoder-based Clustering (DCAEC) model, to cluster label-free IFC images without any prior knowledge of input labels. The DCAEC model first encodes the input images into the latent representations and then clusters based on the latent representations. Using the DCAEC model, we achieve a balanced accuracy of 91.9% for human white blood cell (WBC) clustering and 97.9% for WBC/leukemia clustering using the 3D IFC images and 3D DCAEC model. Above all, although no human recognizable features can separate the clusters of cells with protein localization, we demonstrate the fused DCAEC model can achieve a cluster balanced accuracy of 85.3% from the label-free 2D transmission and 3D side scattering images. To reveal how the neural network recognizes features beyond human ability, we use the gradient-weighted class activation mapping method to discover the cluster-specific visual patterns automatically. Evaluation results show that the automatically identified salient image regions have strong cluster-specific visual patterns for different clusters, which we believe is a stride for the interpretable neural network for cell analysis with high-throughput IFCs.

Low-latency label-free image-activated cell sorting using fast deep learning and AI inferencing.

Classification and sorting of cells using image-activated cell sorting (IACS) systems can bring significant insight to biomedical sciences. Incorporating deep learning algorithms into IACS enables cell classification and isolation based on complex and human-vision uninterpretable morphological features within a heterogeneous cell population. However, the limited capabilities and complicated implementation of deep learning-assisted IACS systems reported to date hinder the adoption of the systems for a wide range of biomedical research. Here, we present image-activated cell sorting by applying fast deep learning algorithms to conduct cell sorting without labeling. The overall sorting latency, including signal processing and AI inferencing, is less than 3 ms, and the training time for the deep learning model is less than 30 min with a training dataset of 20,000 images. Both values set the record for IACS with sorting by AI inference. . We demonstrated our system performance through a 2-part polystyrene beads sorting experiment with 96.6% sorting purity, and a 3-part human leukocytes sorting experiment with 89.05% sorting purity for monocytes, 92.00% sorting purity for lymphocytes, and 98.24% sorting purity for granulocytes. The above performance was achieved with simple hardware containing only 1 FPGA, 1 PC and GPU, as a result of an optimized custom CNN UNet and efficient use of computing power. The system provides a compact, sterile, low-cost, label-free, and low-latency cell sorting solution based on real-time AI inferencing and fast training of the deep learning model.

Multimodal NASH prognosis using 3D imaging flow cytometry and artificial intelligence to characterize liver cells.

To improve the understanding of the complex biological process underlying the development of non-alcoholic steatohepatitis (NASH), 3D imaging flow cytometry (3D-IFC) with transmission and side-scattered images were used to characterize hepatic stellate cell (HSC) and liver endothelial cell (LEC) morphology at single-cell resolution. In this study, HSC and LEC were obtained from biopsy-proven NASH subjects with early-stage NASH (F2-F3) and healthy controls. Here, we applied single-cell imaging and 3D digital reconstructions of healthy and diseased cells to analyze a spatially resolved set of morphometric cellular and texture parameters that showed regression with disease progression. By developing a customized autoencoder convolutional neural network (CNN) based on label-free cell transmission and side scattering images obtained from a 3D imaging flow cytometer, we demonstrated key regulated cell types involved in the development of NASH and cell classification performance superior to conventional machine learning methods.

High Sensitivity, Rapid Detection of Virus in High Traffic Environments.

The global pandemic caused by the SARS-CoV-2 virus has underscored the need for rapid, simple, scalable, and high-throughput multiplex diagnostics in non-laboratory settings. Here we demonstrate a multiplex reverse-transcription loop-mediated isothermal amplification (RT-LAMP) coupled with a gold nanoparticle-based lateral flow immunoassay (LFIA) capable of detecting up to three unique viral gene targets in 15 min. RT-LAMP primers associated with three separate gene targets from the SARS-CoV-2 virus (Orf1ab, Envelope, and Nucleocapsid) were added to a one-pot mix. A colorimetric change from red to yellow occurs in the presence of a positive sample. Positive samples are run through a LFIA to achieve specificity on a multiplex three-test line paper assay. Positive results are indicated by a characteristic crimson line. The device is almost fully automated and is deployable in any community setting with a power source.

Label-free image-encoded microfluidic cell sorter with a scanning Bessel beam.

The microfluidic-based, label-free image-guided cell sorter offers a low-cost, high information content, and disposable solution that overcomes many limitations in conventional cell sorters. However, flow confinement for most microfluidic devices is generally only one-dimensional using sheath flow. As a result, the equilibrium distribution of cells spreads beyond the focal plane of commonly used Gaussian laser excitation beams, resulting in a large number of blurred images that hinder subsequent cell sorting based on cell image features. To address this issue, we present a Bessel-Gaussian beam image-guided cell sorter with an ultra-long depth of focus, enabling focused images of >85% of passing cells. This system features label-free sorting capabilities based on features extracted from the output temporal waveform of a photomultiplier tube (PMT) detector. For the sorting of polystyrene beads, SKNO1 leukemia cells, and Scenedesmus green algae, our results indicate a sorting purity of 97%, 97%, and 98%, respectively, showing that the temporal waveforms from the PMT outputs have strong correlations with cell image features. These correlations are also confirmed by off-line reconstructed cell images from a temporal-spatial transformation algorithm tailored to the scanning Bessel-Gaussian beam.