Automated Dual-Mode Cell Monitoring To Simultaneously Explore Calcium Dynamics and Contraction-Relaxation Kinetics within Drug-Treated Stem Cell-Derived Cardiomyocytes.

This manuscript proposes a new dual-mode cell imaging system for studying the relationships between calcium dynamics and the contractility process of cardiomyocytes derived from human-induced pluripotent stem cells. Practically, this dual-mode cell imaging system provides simultaneously both live cell calcium imaging and quantitative phase imaging based on digital holographic microscopy. Specifically, thanks to the development of a robust automated image analysis, simultaneous measurements of both intracellular calcium, a key player of excitation-contraction coupling, and the quantitative phase image-derived dry mass redistribution, reflecting the effective contractility, namely, the contraction and relaxation processes, were achieved. Practically, the relationships between calcium dynamics and the contraction-relaxation kinetics were investigated in particular through the application of two drugs─namely, isoprenaline and E-4031─known to act precisely on calcium dynamics. Specifically, this new dual-mode cell imaging system enabled us to establish that calcium regulation can be divided into two phases, an early phase influencing the occurrence of the relaxation process followed by a late phase, which although not having a significant influence on the relaxation process affects significantly the beat frequency. In combination with cutting-edge technologies allowing the generation of human stem cell-derived cardiomyocytes, this dual-mode cell monitoring approach therefore represents a very promising technique, particularly in the fields of drug discovery and personalized medicine, to identify compounds likely to act more selectively on specific steps that compose the cardiomyocyte contractility.

Unique Photoactivated Time-Resolved Response in 2D GeS for Selective Detection of Volatile Organic Compounds.

Volatile organic compounds (VOCs) sensors have a broad range of applications including healthcare, process control, and air quality analysis. There are a variety of techniques for detecting VOCs such as optical, acoustic, electrochemical, and chemiresistive sensors. However, existing commercial VOC detectors have drawbacks such as high cost, large size, or lack of selectivity. Herein, a new sensing mechanism is demonstrated based on surface interactions between VOC and UV-excited 2D germanium sulfide (GeS), which provides an effective solution to distinguish VOCs. The GeS sensor shows a unique time-resolved electrical response to different VOC species, facilitating identification and qualitative measurement of VOCs. Moreover, machine learning is utilized to distinguish VOC species from their dynamic response via visualization with high accuracy. The proposed approach demonstrates the potential of 2D GeS as a promising candidate for selective miniature VOCs sensors in critical applications such as non-invasive diagnosis of diseases and health monitoring.

HoloPhaseNet: fully automated deep-learning-based hologram reconstruction using a conditional generative adversarial model.

Quantitative phase imaging with off-axis digital holography in a microscopic configuration provides insight into the cells' intracellular content and morphology. This imaging is conventionally achieved by numerical reconstruction of the recorded hologram, which requires the precise setting of the reconstruction parameters, including reconstruction distance, a proper phase unwrapping algorithm, and component of wave vectors. This paper shows that deep learning can perform the complex light propagation task independent of the reconstruction parameters. We also show that the super-imposed twin-image elimination technique is not required to retrieve the quantitative phase image. The hologram at the single-cell level is fed into a trained image generator (part of a conditional generative adversarial network model), which produces the phase image. Also, the model's generalization is demonstrated by training it with holograms of size 512×512 pixels, and the resulting quantitative analysis is shown.

Extending Effective Dynamic Range of Hyperspectral Line Cameras for Short Wave Infrared Imaging.

In this work, a multi-exposure method is proposed to increase the dynamic range (DR) of hyperspectral imaging using an InGaAs-based short-wave infrared (SWIR) hyperspectral line camera. Spectral signatures of materials were captured for scenarios in which the DR of a scene was greater than the DR of a line camera. To demonstrate the problem and test the proposed multi-exposure method, plastic detection in food waste and polymer sorting were chosen as the test application cases. The DR of the hyperspectral camera and the test samples were calculated experimentally. A multi-exposure method is proposed to create high-dynamic-range (HDR) images of food waste and plastic samples. Using the proposed method, the DR of SWIR imaging was increased from 43 dB to 73 dB, with the lowest allowable signal-to-noise ratio (SNR) set to 20 dB. Principal Component Analysis (PCA) was performed on both HDR and non-HDR image data from each test case to prepare the training and testing data sets. Finally, two support vector machine (SVM) classifiers were trained for each test case to compare the classification performance of the proposed multi-exposure HDR method against the single-exposure non-HDR method. The HDR method was found to outperform the non-HDR method in both test cases, with the classification accuracies of 98% and 90% respectively, for the food waste classification, and with 95% and 35% for the polymer classification.

Automated analysis of human cardiomyocytes dynamics with holographic image-based tracking for cardiotoxicity screening.

This paper proposes a new non-invasive, low-cost, and fully automated platform to quantitatively analyze dynamics of human-induced pluripotent stem cell-derived cardiomyocytes (hiPS-CMs) at the single-cell level by holographic image-based tracking for cardiotoxicity screening. A dense Farneback optical flow method and holographic imaging informatics were combined to characterize the contractile motion of a single CM, which obviates the need for costly equipment to monitor a CM's mechanical beat activity. The reliability of the proposed platform was tested by single-cell motion characterization, synchronization analysis, motion speed measurement of fixed CMs versus live CMs, and noise sensitivity. The applicability of the motion characterization method was tested to determine the pharmacological effects of two cardiovascular drugs, isoprenaline (166 nM) and E-4031 (500 µM). The experiments were done using single CMs and multiple cells, and the results were compared to control conditions. Cardiomyocytes responded to isoprenaline by increasing the action potential (AP) speed and shortening the resting period, thus increasing the beat frequency. In the presence of E-4031, the AP speed was decreased, and the resting period was prolonged, thus decreasing the beat frequency. The findings offer insights into single hiPS-CMs' contractile motion and a deep understanding of their kinetics at the single-cell level for cardiotoxicity screening.

Calibration of a Hyper-Spectral Imaging System Using a Low-Cost Reference.

In this paper, we present a hyper-spectral imaging system and practical calibration procedure using a low-cost calibration reference made of polytetrafluoroethylene. The imaging system includes a hyperspectral camera and an active source of illumination with a variable spectral distribution of intensity. The calibration reference is used to measure the relative reflectance of any material surface independent of the spectral distribution of light and camera sensitivity. Winter road conditions are taken as a test application, and several spectral images of snow, icy asphalt, dry asphalt, and wet asphalt were made at different exposure times using different illumination spectra. Graphs showing measured relative reflectance for different road conditions support the conclusion that measurements are independent of illumination. Principal component analysis of the acquired spectral data for road conditions shows well separated data clusters, demonstrating the system's suitability for material classification.

Noise-free quantitative phase imaging in Gabor holography with conditional generative adversarial network.

This paper shows that deep learning can eliminate the superimposed twin-image noise in phase images of Gabor holographic setup. This is achieved by the conditional generative adversarial model (C-GAN), trained by input-output pairs of noisy phase images obtained from synthetic Gabor holography and the corresponding quantitative noise-free contrast-phase image obtained by the off-axis digital holography. To train the model, Gabor holograms are generated from digital off-axis holograms with spatial shifting of the real image and twin image in the frequency domain and then adding them with the DC term in the spatial domain. Finally, the digital propagation of the Gabor hologram with Fresnel approximation generates a super-imposed phase image for the C-GAN model input. Two models were trained: a human red blood cell model and an elliptical cancer cell model. Following the training, several quantitative analyses were conducted on the bio-chemical properties and similarity between actual noise-free phase images and the model output. Surprisingly, it is discovered that our model can recover other elliptical cell lines that were not observed during the training. Additionally, some misalignments can also be compensated with the trained model. Particularly, if the reconstruction distance is somewhat incorrect, this model can still retrieve in-focus images.

Automated single cardiomyocyte characterization by nucleus extraction from dynamic holographic images using a fully convolutional neural network.

Human-induced pluripotent stem cell-derived cardiomyocytes (hiPS-CMs) beating can be efficiently characterized by time-lapse quantitative phase imaging (QPIs) obtained by digital holographic microscopy. Particularly, the CM's nucleus section can precisely reflect the associated rhythmic beating pattern of the CM suitable for subsequent beating pattern characterization. In this paper, we describe an automated method to characterize single CMs by nucleus extraction from QPIs and subsequent beating pattern reconstruction and quantification. However, accurate CM's nucleus extraction from the QPIs is a challenging task due to the variations in shape, size, orientation, and lack of special geometry. To this end, we propose a novel fully convolutional neural network (FCN)-based network architecture for accurate CM's nucleus extraction using pixel classification technique and subsequent beating pattern characterization. Our experimental results show that the beating profile of multiple extracted single CMs is less noisy and more informative compared to the whole image slide. Applying this method allows CM characterization at the single-cell level. Consequently, several single CMs are extracted from the whole slide QPIs and multiple parameters regarding their beating profile of each isolated CM are efficiently measured.

Quantitative analysis of three-dimensional morphology and membrane dynamics of red blood cells during temperature elevation.

The optimal functionality of red blood cells is closely associated with the surrounding environment. This study was undertaken to analyze the changes in membrane profile, mean corpuscular hemoglobin (MCH), and cell membrane fluctuations (CMF) of healthy red blood cells (RBC) at varying temperatures. The temperature was elevated from 17 °C to 41 °C within a duration of less than one hour, and the holograms were recorded by an off-axis configuration. After hologram reconstruction, we extracted single RBCs and evaluated their morphologically related features (projected surface area and sphericity coefficient), MCH, and CMF. We observed that elevating the temperature results in changes in the three-dimensional (3D) profile. Since CMF amplitude is highly correlated to the bending curvature of RBC membrane, temperature-induced shape changes can alter CMF's map and amplitude; mainly larger fluctuations appear on dimple area at a higher temperature. Regardless of the shape changes, no alterations in MCH were seen with temperature variation.

No-search focus prediction at the single cell level in digital holographic imaging with deep convolutional neural network.

Digital propagation of an off-axis hologram can provide the quantitative phase-contrast image if the exact distance between the sensor plane (such as CCD) and the reconstruction plane is correctly provided. In this paper, we present a deep-learning convolutional neural network with a regression layer as the top layer to estimate the best reconstruction distance. The experimental results obtained using microsphere beads and red blood cells show that the proposed method can accurately predict the propagation distance from a filtered hologram. The result is compared with the conventional automatic focus-evaluation function. Additionally, our approach can be utilized at the single-cell level, which is useful for cell-to-cell depth measurement and cell adherent studies.

Automated quantification study of human cardiomyocyte synchronization using holographic imaging.

This paper investigates the rhythm strip and parameters of synchronization of human induced pluripotent stem cell (iPS) derived cardiomyocytes. The synchronization is evaluated from quantitative phase images of beating cardiomyocytes which are obtained using the time-lapse digital holographic imaging method. By quantitatively monitoring the dry mass redistribution, digital holography provides the physical contraction-relaxation signal caused by autonomous cardiac action potential. In order to analyze the synchronicity at the cell-to-cell level, we extracted single cardiac muscle cells, which contain the nuclei, from the phase images of cardiomyocytes containing multiple cells resulting from the fusion of k-means clustering and watershed segmentation algorithms. We demonstrate that mature cardiomyocyte cell synchronization can be automatically evaluated by time-lapse microscopic holographic imaging. Our proposed method can be applied for studies on cardiomyocyte disorders and drug safety testing systems.

Quantification of stored red blood cell fluctuations by time-lapse holographic cell imaging.

We propose methods to quantitatively calculate the fluctuation rate of red blood cells with nanometric axial and millisecond temporal sensitivity at the single-cell level by using time-lapse holographic cell imaging. For this quantitative analysis, cell membrane fluctuations (CMFs) were measured for RBCs stored at different storage times. Measurements were taken over the whole membrane for both the ring and dimple sections separately. The measurements show that healthy RBCs that maintain their discocyte shape become stiffer with storage time. The correlation analysis demonstrates a significant negative correlation between CMFs and the sphericity coefficient, which characterizes the morphological type of erythrocyte. In addition, we show the correlation results between CMFs and other morphological properties such as projected surface area, surface area, mean corpuscular volume, and mean corpuscular hemoglobin.

Automated quantitative analysis of multiple cardiomyocytes at the single-cell level with three-dimensional holographic imaging informatics.

Cardiomyocytes derived from human pluripotent stem cells are a promising tool for disease modeling, drug compound testing, and cardiac toxicity screening. Bio-image segmentation is a prerequisite step in cardiomyocyte image analysis by digital holography (DH) in microscopic configuration and has provided satisfactory results. In this study, we quantified multiple cardiac cells from segmented 3-dimensional DH images at the single-cell level and measured multiple parameters describing the beating profile of each individual cell. The beating profile is extracted by monitoring dry-mass distribution during the mechanical contraction-relaxation activity caused by cardiac action potential. We present a robust two-step segmentation method for cardiomyocyte low-contrast image segmentation based on region and edge information. The segmented single-cell contains mostly the nucleus of the cell since it is the best part of the cardiac cell, which can be perfectly segmented. Clustering accuracy was assessed by a silhouette index evaluation for k-means clustering and the Dice similarity coefficient (DSC) of the final segmented image. 3D representation of single of cardiomyocytes. The cell contains mostly the nucleus section and a small area of cytoplasm.

Automated three-dimensional morphology-based clustering of human erythrocytes with regular shapes: stomatocytes, discocytes, and echinocytes.

We present unsupervised clustering methods for automatic grouping of human red blood cells (RBCs) extracted from RBC quantitative phase images obtained by digital holographic microscopy into three RBC clusters with regular shapes, including biconcave, stomatocyte, and sphero-echinocyte. We select some good features related to the RBC profile and morphology, such as RBC average thickness, sphericity coefficient, and mean corpuscular volume, and clustering methods, including density-based spatial clustering applications with noise, k-medoids, and k-means, are applied to the set of morphological features. The clustering results of RBCs using a set of three-dimensional features are compared against a set of two-dimensional features. Our experimental results indicate that by utilizing the introduced set of features, two groups of biconcave RBCs and old RBCs (suffering from the sphero-echinocyte process) can be perfectly clustered. In addition, by increasing the number of clusters, the three RBC types can be effectively clustered in an automated unsupervised manner with high accuracy. The performance evaluation of the clustering techniques reveals that they can assist hematologists in further diagnosis.

Red blood cells ageing markers: a multi-parametric analysis.

BACKGROUND: Red blood cells collected in citrate-phosphate-dextrose can be stored for up to 42 days at 4 °C in saline-adenine-glucose-mannitol additive solution. During this controlled, but nevertheless artificial, ex vivo ageing, red blood cells accumulate lesions that can be reversible or irreversible upon transfusion. The aim of the present study is to follow several parameters reflecting cell metabolism, antioxidant defences, morphology and membrane dynamics during storage. MATERIALS AND METHODS: Five erythrocyte concentrates were followed weekly during 71 days. Extracellular glucose and lactate concentrations, total antioxidant power, as well as reduced and oxidised intracellular glutathione levels were quantified. Microvesiculation, percentage of haemolysis and haematologic parameters were also evaluated. Finally, morphological changes and membrane fluctuations were recorded using label-free digital holographic microscopy. RESULTS: The antioxidant power as well as the intracellular glutathione concentration first increased, reaching maximal values after one and two weeks, respectively. Irreversible morphological lesions appeared during week 5, where discocytes began to transform into transient echinocytes and finally spherocytes. At the same time, the microvesiculation and haemolysis started to rise exponentially. After six weeks (expiration date), intracellular glutathione was reduced by 25%, reflecting increasing oxidative stress. The membrane fluctuations showed decreased amplitudes during shape transition from discocytes to spherocytes. DISCUSSION: Various types of lesions accumulated at different chemical and cellular levels during storage, which could impact their in vivo recovery after transfusion. A marked effect was observed after four weeks of storage, which corroborates recent clinical data. The prolonged follow-up period allowed the capture of deep storage lesions. Interestingly, and as previously described, the severity of the changes differed among donors.

Human red blood cell recognition enhancement with three-dimensional morphological features obtained by digital holographic imaging.

The classification of erythrocytes plays an important role in the field of hematological diagnosis, specifically blood disorders. Since the biconcave shape of red blood cell (RBC) is altered during the different stages of hematological disorders, we believe that the three-dimensional (3-D) morphological features of erythrocyte provide better classification results than conventional two-dimensional (2-D) features. Therefore, we introduce a set of 3-D features related to the morphological and chemical properties of RBC profile and try to evaluate the discrimination power of these features against 2-D features with a neural network classifier. The 3-D features include erythrocyte surface area, volume, average cell thickness, sphericity index, sphericity coefficient and functionality factor, MCH and MCHSD, and two newly introduced features extracted from the ring section of RBC at the single-cell level. In contrast, the 2-D features are RBC projected surface area, perimeter, radius, elongation, and projected surface area to perimeter ratio. All features are obtained from images visualized by off-axis digital holographic microscopy with a numerical reconstruction algorithm, and four categories of biconcave (doughnut shape), flat-disc, stomatocyte, and echinospherocyte RBCs are interested. Our experimental results demonstrate that the 3-D features can be more useful in RBC classification than the 2-D features. Finally, we choose the best feature set of the 2-D and 3-D features by sequential forward feature selection technique, which yields better discrimination results. We believe that the final feature set evaluated with a neural network classification strategy can improve the RBC classification accuracy.

Lossless and lossy compression of quantitative phase images of red blood cells obtained by digital holographic imaging.

In this paper, we evaluate lossless and lossy compression techniques to compress quantitative phase images of red blood cells (RBCs) obtained by an off-axis digital holographic microscopy (DHM). The RBC phase images are numerically reconstructed from their digital holograms and are stored in 16-bit unsigned integer format. In the case of lossless compression, predictive coding of JPEG lossless (JPEG-LS), JPEG2000, and JP3D are evaluated, and compression ratio (CR) and complexity (compression time) are compared against each other. It turns out that JP2k can outperform other methods by having the best CR. In the lossy case, JP2k and JP3D with different CRs are examined. Because some data is lost in a lossy way, the degradation level is measured by comparing different morphological and biochemical parameters of RBC before and after compression. Morphological parameters are volume, surface area, RBC diameter, sphericity index, and the biochemical cell parameter is mean corpuscular hemoglobin (MCH). Experimental results show that JP2k outperforms JP3D not only in terms of mean square error (MSE) when CR increases, but also in compression time in the lossy compression way. In addition, our compression results with both algorithms demonstrate that with high CR values the three-dimensional profile of RBC can be preserved and morphological and biochemical parameters can still be within the range of reported values.

Quantitative investigation of red blood cell three-dimensional geometric and chemical changes in the storage lesion using digital holographic microscopy.

Quantitative phase information obtained by digital holographic microscopy (DHM) can provide new insight into the functions and morphology of single red blood cells (RBCs). Since the functionality of a RBC is related to its three-dimensional (3-D) shape, quantitative 3-D geometric changes induced by storage time can help hematologists realize its optimal functionality period. We quantitatively investigate RBC 3-D geometric changes in the storage lesion using DHM. Our experimental results show that the substantial geometric transformation of the biconcave-shaped RBCs to the spherocyte occurs due to RBC storage lesion. This transformation leads to progressive loss of cell surface area, surface-to-volume ratio, and functionality of RBCs. Furthermore, our quantitative analysis shows that there are significant correlations between chemical and morphological properties of RBCs.