Deep Learning in Image Cytometry: A Review.

Artificial intelligence, deep convolutional neural networks, and deep learning are all niche terms that are increasingly appearing in scientific presentations as well as in the general media. In this review, we focus on deep learning and how it is applied to microscopy image data of cells and tissue samples. Starting with an analogy to neuroscience, we aim to give the reader an overview of the key concepts of neural networks, and an understanding of how deep learning differs from more classical approaches for extracting information from image data. We aim to increase the understanding of these methods, while highlighting considerations regarding input data requirements, computational resources, challenges, and limitations. We do not provide a full manual for applying these methods to your own data, but rather review previously published articles on deep learning in image cytometry, and guide the readers toward further reading on specific networks and methods, including new methods not yet applied to cytometry data. © 2018 The Authors. Cytometry Part A published by Wiley Periodicals, Inc. on behalf of International Society for Advancement of Cytometry.

Masks in imaging flow cytometry.

Data analysis in imaging flow cytometry incorporates elements of flow cytometry together with other aspects of morphological analysis of images. A crucial early step in this analysis is the creation of a mask to distinguish the portion of the image upon which further examination of specified features can be performed. Default masks are provided by the manufacturer of the imaging flow cytometer but additional custom masks can be created by the individual user for specific applications. Flawed or inaccurate masks can have a substantial negative impact on the overall analysis of a sample, thus great care must be taken to ensure the accuracy of masks. Here we discuss various types of masks and cite examples of their use. Furthermore we provide our insight for how to approach selecting and assessing the optimal mask for a specific analysis.

Applications of imaging flow cytometry in the diagnostic assessment of acute leukaemia.

Automated imaging flow cytometry integrates flow cytometry with digital microscopy to produce high-resolution digital imaging with quantitative analysis. This enables cell identification based on morphology (cell size, shape), antigen expression, quantification of fluorescence signal intensity and localisation of detected signals (i.e. surface, cytoplasm, nuclear). We describe applications of imaging flow cytometry for the diagnostic assessment of acute leukaemia. These bone marrow malignancies are traditionally diagnosed and classified by cell morphology, phenotype and cytogenetic abnormalities. Traditionally morphology is assessed by light microscopy, phenotyping by conventional flow cytometry and genetics by karyotype and fluorescence in situ hybridisation (FISH) on interphase nuclei/metaphase spreads of cells on slides. Imaging flow cytometry adds a new dimension to the diagnostic assessment of these neoplasms. We describe three specific applications: From this we conclude that imaging flow cytometry offers benefits over conventional diagnostic methods. Specifically the ability to visualise the cells of interest, the pattern and localisation of expressed antigens and assess cytogenetic abnormalities in one integrated automated high-throughput test. Imaging flow cytometry presents a new paradigm for the diagnostic assessment of leukaemia.

Flow cytometry what you see matters: Enhanced clinical detection using image-based flow cytometry.

Image-based flow cytometry combines the throughput of traditional flow cytometry with the ability to visually confirm findings and collect novel data that would not be possible otherwise. Since image-based flow cytometry borrows measurement parameters and analysis techniques from microscopy, it is possible to collect unique measures (i.e. nuclear translocation, co-localization, cellular synapse, cellular endocytosis, etc.) that would not be possible with traditional flow cytometry. The ability to collect unique outcomes has led many researchers to develop novel assays for the monitoring and detection of a variety of clinical conditions and diseases. In many cases, investigators have innovated and expanded classical assays to provide new insight regarding clinical conditions and chronic disease. Beyond human clinical applications, image-based flow cytometry has been used to monitor marine biology changes, nano-particles for solar cell production, and particle quality in pharmaceuticals. This review article summarizes work from the major scientists working in the field of image-based flow cytometry.

Imaging flow cytometry in the assessment of leukocyte-platelet aggregates.

Platelets are subcellular blood elements with a well-established role in haemostasis. Upon activation platelets undergo granule exocytosis, resulting in α-granule P-Selectin being expressed on the cell membrane. This allows binding of activated platelets to P-Selectin glycoprotein ligand 1 (PSGL-1) expressing leukocytes, forming leukocyte-platelet aggregates (LPAs). Whole blood flow cytometry (FCM) has demonstrated that elevated circulating LPAs (especially monocyte LPAs) are linked to atherothrombosis in high risk patients, and that activated platelet binding influences monocytes towards a pro-adhesive and pro-atherogenic phenotype. However, a limitation of conventional FCM is the potential for coincident events to resemble LPAs despite no tethering. Imaging cytometry can be used to characterize LPA formation and distinguish circulating MPAs from coincidental events. Platelets and leukocyte subsets are identified by expression of surface markers (e.g. the lipopolysachharide receptor CD14 on monocytes, glycoprotein Ib CD42b on platelets). In conventional FCM, all events with both leukocyte and platelet characteristics are designated as LPAs. However, by using an 'internal' mask based on the brightfield image and the fluorescent platelet identifier, imaging flow cytometry is able to distinguish leukocytes with tethered platelets (genuine LPAs) from leukocyte with coincidental, untethered platelets nearby. Mechanisms (e.g. adhesion molecules) or consequences (e.g. signal transduction) can then be separately analysed in platelet tethered and untethered leukocytes. Imaging flow cytometry therefore provides a more accurate approach for both enumeration and analysis of LPAs than conventional FCM.

Imaging flow cytometry for the characterization of extracellular vesicles.

Extracellular Vesicles (EVs) are potent bio-activators and inter-cellular communicators that play an important role in both health and disease. It is for this reason there is a strong interest in understanding their composition and origin, with the hope of using them as important biomarkers or therapeutics. Due to their very small size, heterogeneity, and large numbers there has been a need for better tools to measure them in an accurate and high throughput manner. While traditional flow cytometry has been widely used for this purpose, there are inherent problems with this approach, as these instruments have traditionally been developed to measure whole cells, which are orders of magnitude larger and express many more molecules of identifying epitopes. Imaging flow cytometry, as performed with the ImagestreamX MKII, with its combination of increased fluorescence sensitivity, low background, image confirmation ability and powerful data analysis tools, provides a great tool to accurately evaluate EVs. We present here a comprehensive approach in applying this technology to the study of EVs.

Multi-parametric imaging of cell heterogeneity in apoptosis analysis.

Apoptosis is a multistep process of programmed cell death where different morphological and molecular events occur simultaneously and/or consequently. Recent progress in programmed cell death analysis uncovered large heterogeneity in response of individual cells to the apoptotic stimuli. Analysis of the complex and dynamic process of apoptosis requires a capacity to quantitate multiparametric data obtained from multicolor labeling and/or fluorescent reporters of live cells in conjunction with morphological analysis. Modern methods of multiparametric apoptosis study include but are not limited to fluorescent microscopy, flow cytometry and imaging flow cytometry. In the current review we discuss the image-based evaluation of apoptosis on the single-cell and population level by imaging flow cytometry in parallel with other techniques. The advantage of imaging flow cytometry is its ability to interrogate multiparametric morphometric and fluorescence quantitative data in statistically robust manner. Here we describe the current status and future perspectives of this emerging field, as well as some challenges and limitations. We also highlight a number of assays and multicolor labeling probes, utilizing both microscopy and different variants of imaging cytometry, including commonly based assays and novel developments in the field.

Foundations of identifying individual chromosomes by imaging flow cytometry with applications in radiation biodosimetry.

Biodosimetry is an important tool for triage in the case of large-scale radiological or nuclear emergencies, but traditional microscope-based methods can be tedious and prone to scorer fatigue. While the dicentric chromosome assay (DCA) has been adapted for use in triage situations, it is still time-consuming to create and score slides. Recent adaptations of traditional biodosimetry assays to imaging flow cytometry (IFC) methods have dramatically increased throughput. Additionally, recent improvements in image analysis algorithms in the IFC software have resulted in improved specificity for spot counting of small events. In the IFC method for the dicentric chromosome analysis (FDCA), lymphocytes isolated from whole blood samples are cultured with PHA and Colcemid. After incubation, lymphocytes are treated with a hypotonic solution and chromosomes are isolated in suspension, labelled with a centromere marker and stained for DNA content with DRAQ5. Stained individual chromosomes are analyzed on the ImageStream®X (EMD-Millipore, Billerica, MA) and mono- and dicentric chromosome populations are identified and enumerated using advanced image processing techniques. Both the preparation of the isolated chromosome suspensions as well as the image analysis methods were fine-tuned in order to optimize the FDCA. In this paper we describe the method to identify and score centromeres in individual chromosomes by IFC and show that the FDCA method may further improve throughput for triage biodosimetry in the case of large-scale radiological or nuclear emergencies.

Delineating stages of erythropoiesis using imaging flow cytometry.

Adult humans need to make 2.5million red blood cells (RBCs) every second to maintain a steady state level of 25trillion circulating RBCs. Understanding normal erythropoiesis as well as diseases that afflict the erythron, such as genetic anemias, hyperproliferative disorders, and myelodysplastic syndromes, requires a robust method to delineate erythropoietic intermediates. In order to apply the power of flow cytometry to these studies, challenges of limited immunophenotypic markers, incorporation of significant changes in morphology, and maturational changes that occur along a continuum need to be met. Imaging flow cytometry (IFC) provides a solution to address these challenges. Integration of changes in immunophenotype, loss of RNA (ribosomes), and enucleation, with morphological characteristics of cell and nuclear size, can be used to delineate erythroblasts that correlate with classical histological classifications. A protocol is described that demonstrates the basic approaches of staining panel selection, mask generation and selection of features to best sequentially refine erythroid intermediates and remove contaminating cells with overlapping immunophenotype. Ultimately erythroid cells in the murine bone marrow are divided into seven sub-populations using IFC including four erythroblasts (pro-, basophilic, polychromatophilic and orthochromatic), the pyrenocyte, which contains the eliminated nucleus, the enucleated reticulocyte and the mature RBC.

Imaging flow cytometry analysis of intracellular pathogens.

Imaging flow cytometry has been applied to address questions in infection biology, in particular, infections induced by intracellular pathogens. This methodology, which utilizes specialized analytic software makes it possible to analyze hundreds of quantified features for hundreds of thousands of individual cellular or subcellular events in a single experiment. Imaging flow cytometry analysis of host cell-pathogen interaction can thus quantitatively addresses a variety of biological questions related to intracellular infection, including cell counting, internalization score, and subcellular patterns of co-localization. Here, we provide an overview of recent achievements in the use of fluorescently labeled prokaryotic or eukaryotic pathogens in human cellular infections in analysis of host-pathogen interactions. Specifically, we give examples of Imagestream-based analysis of cell lines infected with Toxoplasma gondii or Mycobacterium tuberculosis. Furthermore, we illustrate the capabilities of imaging flow cytometry using a combination of standard IDEAS™ software and the more recently developed Feature Finder algorithm, which is capable of identifying statistically significant differences between researcher-defined image galleries. We argue that the combination of imaging flow cytometry with these software platforms provides a powerful new approach to understanding host control of intracellular pathogens.

Qualitative and quantitative analysis of PMN/T-cell interactions by InFlow and super-resolution microscopy.

Neutrophils or polymorphonuclear cells (PMN) eliminate bacteria via phagocytosis and/or NETosis. Apart from these conventional roles, PMN also have immune-regulatory functions. They can transdifferentiate and upregulate MHCII as well as ligands for costimulatory receptors which enables them to behave as antigen presenting cells (APC). The initial step for activating T-cells is the formation of an immune synapse between T-cells and antigen-presenting cells. However, the immune synapse that develops at the PMN/T-cell contact zone is as yet hardly investigated due to the non-availability of methods for analysis of large number of PMN interactions. In order to overcome these obstacles, we introduce here a workflow to analyse the immune synapse of primary human PMN and T-cells using multispectral imaging flow cytometry (InFlow microscopy) and super-resolution microscopy. For that purpose, we used CD3 and CD66b as the lineage markers for T-cells and PMN, respectively. Thereafter, we applied and critically discussed various "masks" for identification of T-cell PMN interactions. Using this approach, we found that a small fraction of transdifferentiated PMN (CD66b+CD86high) formed stable PMN/T-cell conjugates. Interestingly, while both CD3 and CD66b accumulation in the immune synapse was dependent on the maturation state of the PMN, only CD3 accumulation was greatly enhanced by the presence of superantigen. The actin cytoskeleton was weakly rearranged at the PMN side on the immune synapse upon contact with a T-cell in the presence of superantigen. A more detailed analysis using super-resolution microscopy (structured-illumination microscopy, SIM) confirmed this finding. Together, we present an InFlow microscopy based approach for the large scale analysis of PMN/T-cell interactions and - combined with SIM - a possibility for an in-depth analysis of protein translocation at the site of interactions.

Characterization of neutrophils and macrophages from ex vivo-cultured murine bone marrow for morphologic maturation and functional responses by imaging flow cytometry.

Neutrophils and macrophages differentiate from common myeloid progenitors in the bone marrow, where they undergo nuclear morphologic changes during maturation. During this process, both cell types acquire critical innate immune functions that include phagocytosis of pathogens, and for neutrophils the release of nuclear material called nuclear extracellular traps (NETs). Primary cells used to study these functions are typically purified from mature mouse tissues, but bone marrow-derived ex vivo cultures provide more abundant numbers of progenitors and functionally mature cells. Routine analyses of these cells use conventional microscopy and flow cytometry, which present limitations; microscopy is laborious and subjective, whereas flow cytometry lacks spatial resolution. Here we describe methods to generate enriched populations of neutrophils or macrophages from cryopreserved mouse bone marrow cultured ex vivo, and to use imaging flow cytometry that combines the resolution of microscopy with flow cytometry to analyze cells for morphologic features, phagocytosis, and NETosis.

Quantifying autophagy: Measuring LC3 puncta and autolysosome formation in cells using multispectral imaging flow cytometry.

The use of multispectral imaging flow cytometry has been gaining popularity due to its quantitative power, high throughput capabilities, multiplexing potential and its ability to acquire images of every cell. Autophagy is a process in which dysfunctional organelles and cellular components that accumulate during growth and differentiation are degraded via the lysosome and recycled. During autophagy, cytoplasmic LC3 is processed and recruited to the autophagosomal membranes; the autophagosome then fuses with the lysosome to form the autolysosome. Therefore, cells undergoing autophagy can be identified by visualizing fluorescently labeled LC3 puncta and/or the co-localization of fluorescently labeled LC3 and lysosomal markers. Multispectral imaging flow cytometry is able to collect imagery of large numbers of cells and assess autophagy in an objective, quantitative, and statistically robust manner. This review will examine the four predominant methods that have been used to measure autophagy via multispectral imaging flow cytometry.

Quantifying MHC dextramer-induced NFAT activation in antigen-specific T cells as a functional response parameter.

MHC-multimers are reagents used for the detection and enumeration of antigen-specific T cells (ASTs). These reagents exploit the mechanism by which T cell receptors (TCR) on cytotoxic CD8 T cells recognize specific antigens in the context of a major histocompatibility complex (MHC) molecule during antigen presentation. MHC-multimers are fluorescently-labeled dextran polymers that carry MHC Class I molecules and peptide sequences that can be modified to represent specific cognate sequences of the antigen of interest with dextramers having a 10-fold multiplicity of the MHC/peptide combination within a single multimer. Since the binding of antigen-specific dextramers mimics antigen presentation to the TCR, the present study sought to determine whether this TCR engagement on the AST was sufficient to elicit a functional T cell response. The effect of binding of CMV specific dextramers on the activation of the NFAT signal transduction cascade was assessed in peripheral blood from bone marrow transplant recipients previously determined to be positive for CMV-ASTs (CASTs). NFAT activation was quantified by measuring nuclear translocation of NFAT1 in CD8+ CASTs and CD8+ non-CASTs by imaging flow cytometry. Our results demonstrate that an increase in the nuclear localization of NFAT1 was detectable in the CASTs following the CMV-dextramer binding and could be observed as early as 10min post-exposure. The NFAT1 activation correlated with a downstream functional response in the form of interferon gamma production. Sample preparation, temperature, and duration of dextramer exposure were important parameters affecting the dextramer-induced NFAT activation with 2h exposure in whole blood at room temperature being the optimal of the conditions tested. Intra- and inter-individual heterogeneity was observed with regards to the NFAT activation in the CASTs. Importantly, no effect of the dextramers was observed in the CD8+ non-CASTs, and therefore dextramer negative cell populations. Exposure to PMA/ionomycin following dextramer exposure resulted in a homogeneous NFAT activation in both the dextramer-positive but NFAT1 nonresponsive CAST and non-CAST cells. Thus, the data demonstrate that binding of antigen-specific dextramers to ASTs specifically results in activation of NFAT, that the NFAT activation correlates with a downstream functional response and that the response can be heterogeneous. This functional parameter may provide insight to the issue whether enumeration alone of ASTs is a sufficient parameter to assess an individual's immune status against a specific antigen.

Advances in light microscopy for neuroscience.

Since the work of Golgi and Cajal, light microscopy has remained a key tool for neuroscientists to observe cellular properties. Ongoing advances have enabled new experimental capabilities using light to inspect the nervous system across multiple spatial scales, including ultrastructural scales finer than the optical diffraction limit. Other progress permits functional imaging at faster speeds, at greater depths in brain tissue, and over larger tissue volumes than previously possible. Portable, miniaturized fluorescence microscopes now allow brain imaging in freely behaving mice. Complementary progress on animal preparations has enabled imaging in head-restrained behaving animals, as well as time-lapse microscopy studies in the brains of live subjects. Mouse genetic approaches permit mosaic and inducible fluorescence-labeling strategies, whereas intrinsic contrast mechanisms allow in vivo imaging of animals and humans without use of exogenous markers. This review surveys such advances and highlights emerging capabilities of particular interest to neuroscientists.

Feature Analysis and Automatic Identification of Leukemic Lineage Blast Cells and Reactive Lymphoid Cells from Peripheral Blood Cell Images.

BACKGROUND: Automated peripheral blood (PB) image analyzers usually underestimate the total number of blast cells, mixing them up with reactive or normal lymphocytes. Therefore, they are not able to discriminate between myeloid or lymphoid blast cell lineages. The objective of the proposed work is to achieve automatic discrimination of reactive lymphoid cells (RLC), lymphoid and myeloid blast cells and to obtain their morphologic patterns through feature analysis. METHODS: In the training stage, a set of 696 blood cell images was selected in 32 patients (myeloid acute leukemia, lymphoid precursor neoplasms and viral or other infections). For classification, we used support vector machines, testing different combinations of feature categories and feature selection techniques. Further, a validation was implemented using the selected features over 220 images from 15 new patients (five corresponding to each category). RESULTS: Best discrimination accuracy in the training was obtained with feature selection from the whole feature set (90.1%). We selected 60 features, showing significant differences (P < 0.001) in the mean values of the different cell groups. Nucleus-cytoplasm ratio was the most important feature for the cell classification, and color-texture features from the cytoplasm were also important. In the validation stage, the overall classification accuracy and the true-positive rates for RLC, myeloid and lymphoid blast cells were 80%, 85%, 82% and 74%, respectively. CONCLUSION: The methodology appears to be able to recognize reactive lymphocytes well, especially between reactive lymphocytes and lymphoblasts.

Three-dimensional image cytometer based on widefield structured light microscopy and high-speed remote depth scanning.

A high throughput 3D image cytometer have been developed that improves imaging speed by an order of magnitude over current technologies. This imaging speed improvement was realized by combining several key components. First, a depth-resolved image can be rapidly generated using a structured light reconstruction algorithm that requires only two wide field images, one with uniform illumination and the other with structured illumination. Second, depth scanning is implemented using the high speed remote depth scanning. Finally, the large field of view, high NA objective lens and the high pixelation, high frame rate sCMOS camera enable high resolution, high sensitivity imaging of a large cell population. This system can image at 800 cell/sec in 3D at submicron resolution corresponding to imaging 1 million cells in 20 min. The statistical accuracy of this instrument is verified by quantitatively measuring rare cell populations with ratio ranging from 1:1 to 1:10(5) . © 2014 International Society for Advancement of Cytometry.

An image cytometer based on angular spatial frequency processing and its validation for rapid detection and quantification of waterborne microorganisms.

We introduce a new image cytometer design for the detection of very small particulates and demonstrate its capability in water analysis. The device is a compact microscope composed of off-the-shelf components, such as a light emitting diode (LED) source, a complementary metal-oxide-semiconductor (CMOS) image sensor, and a specific combination of optical lenses that allow, through an appropriate software, Fourier transform processing of the sample volume. Waterborne microorganisms, such as Escherichia coli (E. coli), Legionella pneumophila (L. pneumophila) and phytoplankton, are detected by interrogating the volume sample either in a fluorescent or label-free mode, i.e. with or without fluorescein isothiocyanate (FITC) molecules attached to the micro-organisms, respectively. We achieve a sensitivity of 50 cells per ml, which can be further increased to 0.2 cells per ml by pre-concentrating an initial sample volume of 500 ml with an ad hoc fluidic system. We also prove the capability of the proposed image cytometer of differentiating microbiological populations by size with a resolution of 3 µm and operating in real contaminated water.

Programmable bio-nanochip-based cytologic testing of oral potentially malignant disorders in Fanconi anemia.

Fanconi anemia (FA) is caused by mutations of DNA repair genes. The risk of oral squamous cell carcinoma (OSCC) among FA patients is 800-folds higher than in the general population. Early detection of OSCC, preferably at it precursor stage, is critical in FA patients to improve their survival. In an ongoing clinical trial, we are evaluating the effectiveness of the programmable bio-nanochip (p-BNC)-based oral cytology test in diagnosing oral potentially malignant disorders (OPMD) in non-FA patients. We used this test to compare cytomorphometric and molecular biomarkers in OSCC cell lines derived from FA and non-FA patients to brush biopsy samples of a FA patient with OPMD and normal mucosa of healthy volunteers. Our data showed that expression patterns of molecular biomarkers were not notably different between sporadic and FA-OSCC cell lines. The p-BNC assay revealed significant differences in cytometric parameters and biomarker MCM2 expression between cytobrush samples of the FA patient and cytobrush samples of normal oral mucosa obtained from healthy volunteers. Microscopic examination of the FA patient's OPMD confirmed the presence of dysplasia. Our pilot data suggests that the p-BNC brush biopsy test recognized dysplastic oral epithelial cells in a brush biopsy sample of a FA patient.

[THE VIRTUAL CYTOLOGIC SLIDES FOR EXTERNAL EVALUATION OF QUALITY OF IMPLEMENTATION OF CYTOLOGIC ANALYSES IN CLINICAL DIAGNOSTIC LABORATORIES: POSSIBILITIES AND PERSPECTIVES].

The article considers application of technology of analysis of cytological slides in external quality control of clinical diagnostic laboratories. The advantages of virtual slides are demonstrated against other applied technologies of external evaluation of quality i.e. slide plate and digital micro-photography. The conditions of formation of virtual slides for external evaluation of quality of clinical diagnostic laboratories. The technology of their application is described. The success of practical application of considered technology in the Federal system of external evaluation of quality is emphasized.