Phase unwrapping using deep learning in holographic tomography.

Holographic tomography (HT) is a measurement technique that generates phase images, often containing high noise levels and irregularities. Due to the nature of phase retrieval algorithms within the HT data processing, the phase has to be unwrapped before tomographic reconstruction. Conventional algorithms lack noise robustness, reliability, speed, and possible automation. In order to address these problems, this work proposes a convolutional neural network based pipeline consisting of two steps: denoising and unwrapping. Both steps are carried out under the umbrella of a U-Net architecture; however, unwrapping is aided by introducing Attention Gates (AG) and Residual Blocks (RB) to the architecture. Through the experiments, the proposed pipeline makes possible the phase unwrapping of highly irregular, noisy, and complex experimental phase images captured in HT. This work proposes phase unwrapping carried out by segmentation with a U-Net network, that is aided by a pre-processing denoising step. It also discusses the implementation of the AGs and RBs in an ablation study. What is more, this is the first deep learning based solution that is trained solely on real images acquired with HT.

Influence of Yokukansan on the refractive index of neuroblastoma cells.

Yokukansan (YKS) is a traditional Japanese herbal medicine that is increasingly being studied for its effects on neurodegenerative diseases. In our study, we presented a novel methodology for a multimodal analysis of the effects of YKS on nerve cells. The measurements of 3D refractive index distribution and its changes performed by holographic tomography were supported with an investigation by Raman micro-spectroscopy and fluorescence microscopy to gather complementary morphological and chemical information about cells and YKS influence. It was shown that at the concentrations tested, YKS inhibits proliferation, possibly involving reactive oxygen species. Also substantial changes in the cell RI after few hours of YKS exposure were detected, followed by longer-term changes in cell lipid composition and chromatin state.

3D scattering microphantom sample to assess quantitative accuracy in tomographic phase microscopy techniques.

In this paper we present a structurally-complex biomimetic scattering structure, fabricated with two-photon polymerization, and utilize this object in order to benchmark a computational imaging system. The phantom allows to tailor the scattering by modifying its degrees of freedom i.e. refractive index contrast and scattering layer dimensions and incorporates a 3D imaging quality test, representing a single cell within tissue. While the sample may be used with multiple 3D microscopy techniques, we demonstrate the impact of scattering on three tomographic phase microscopy (TPM) reconstruction methods. One of these methods assumes the sample to be weak-scattering, while the other two take multiple scattering into account. The study is performed at two wavelengths (visible and near-infrared), which serve as a scaling factor for the scattering phenomenon. We find that changing the wavelength from visible into near-infrared impacts the applicability of TPM reconstruction methods. As a result of reduced scattering in near-infrared region, the multiple-scattering-oriented techniques perform in fact worse than a method aimed for weak-scattering samples. This implies a necessity of selecting proper approach depending on sample's scattering characteristics even in case of subtle changes in the object-light interaction.

Metrological Evaluation of the Demosaicking Effect on Colour Digital Image Correlation with Application in Monitoring of Paintings.

A modified 3D colour digital image correlation method (3D cDIC) is proposed for efficient displacement measurements of colour objects with natural texture. The method is using a separate analysis of correlation coefficient (sigma) value in the RGB channels of CCD cameras by utilising local information from the channel with the minimum sigma. In this way, merged U, V and W displacement maps are generated based on the local correlation quality. As the proposed method applies to colour filter array cameras, the images in RGB channels have to undergo a demosaicking procedure which directly influences the accuracy of displacement measurements. In the paper, the best performing demosaicking methods are selected. The metrological analysis of their influence on the results of canvas paintings investigations obtained by unmodified and modified 3D cDIC processing is presented.

Method to analyze effects of low-level laser therapy on biological cells with a digital holographic microscope.

Low-level laser therapy (LLLT) is a therapeutic tool that uses the photobiochemical interaction between light and tissue. Its effectiveness is controversial due to a strong dependence on dosimetric parameters. In this work, we demonstrate that digital holographic microscopy is an effective label-free imaging technique to analyze the effects of LLLT on biological cells, and we propose the full methodology to create correct synthetic aperture phase maps for further extensive, highly accurate statistical analysis. The proposed methodology has been designed to provide a basis for many other biological experiments using quantitative phase imaging. We use SHSY-5Y and HaCaT cells irradiated with different doses of red light for the experiment. The analysis shows quantitative changes in cell dry mass density and the projected cell surface in response to different radiation doses.

Preprocessing methods for quantitative phase image stitching.

Quantitative phase imaging of cell cultures and histopathological slides often requires measurements in large fields of view which is realized through the stitching of multiple high resolution phase maps. Due to the characteristic properties of phase images, careful preprocessing is crucial for maintaining the metrological value of the stitched phase image. In this work, we present various methods that address those properties. Our efforts are focused on increasing robustness to minimize error propagation in consecutive preprocessing steps.

Near-infrared, wavelength, and illumination scanning holographic tomography.

We present a holographic tomography technique in which the projections are acquired using both wavelength and illumination scanning in the near-infrared region. We show how to process the acquired data to obtain correct values of three-dimensional refractive index distributions in both single-wavelength and multi-wavelength data acquisition schemes and how to properly account for the dispersion of the sample. We perform numerical and experimental comparisons of different illumination scenarios to determine the most efficient measurement protocol. We show that the multi-wavelength protocol is advantageous in terms of signal-to-noise ratio and contrast-to-noise ratio over single-wavelength protocols, even for the same number of projections used for reconstructions. Finally, we show that this approach is suitable for providing high-quality refractive index distributions of relatively thick colon cancer samples.

Numerical refractive index correction for the stitching procedure in tomographic quantitative phase imaging.

Tomographic quantitative phase imaging (QPI) lacks an absolute refractive index value baseline, which poses a problem when large dense objects extending over multiple fields of view are measured volume by volume and stitched together. Some of the measurements lack the natural baseline value that is provided by the mounting medium with a known refractive index. In this work, we discuss the problem of the refractive index (RI) baseline of individual reconstructed volumes that are deprived of access to mounting medium due to the extent of the object. The solution of this problem is provided by establishing the RI offsets based on the overlapping regions. We have proven that the process of finding the offset RI values may be justifiably reduced to the analogous procedure in the 2D baseline correction (2D-BC). Finally, we proposed the enhancement of the state-of-the-art 2D-BC procedure previously introduced in the context of 2D QPI. The processing is validated at the examples of a synthetic dataset and a liver organoid.

Roadmap on Digital Holography-Based Quantitative Phase Imaging.

Quantitative Phase Imaging (QPI) provides unique means for the imaging of biological or technical microstructures, merging beneficial features identified with microscopy, interferometry, holography, and numerical computations. This roadmap article reviews several digital holography-based QPI approaches developed by prominent research groups. It also briefly discusses the present and future perspectives of 2D and 3D QPI research based on digital holographic microscopy, holographic tomography, and their applications.

Roadmap on digital holography [Invited].

This Roadmap article on digital holography provides an overview of a vast array of research activities in the field of digital holography. The paper consists of a series of 25 sections from the prominent experts in digital holography presenting various aspects of the field on sensing, 3D imaging and displays, virtual and augmented reality, microscopy, cell identification, tomography, label-free live cell imaging, and other applications. Each section represents the vision of its author to describe the significant progress, potential impact, important developments, and challenging issues in the field of digital holography.

Common-path intrinsically achromatic optical diffraction tomography.

In this work we propose an open-top like common-path intrinsically achromatic optical diffraction tomography system. It operates as a total-shear interferometer and employs Ronchi-type amplitude diffraction grating, positioned in between the camera and the tube lens without an additional 4f system, generating three-beam interferograms with achromatic second harmonic. Such configuration makes the proposed system low cost, compact and immune to vibrations. We present the results of the measurements of 3D-printed cell phantom using laser diode (coherent) and superluminescent diode (partially coherent) light sources. Broadband light sources can be naturally employed without the need for any cumbersome compensation because of the intrinsic achromaticity of the interferometric recording (holograms generated by -1st and +1st conjugated diffraction orders are not affected by the illumination wavelength). The results show that the decreased coherence offers much reduced coherent noise and higher fidelity tomographic reconstruction especially when applied nonnegativity constraint regularization procedure.

Holographic tomography: techniques and biomedical applications [Invited].

Holographic tomography (HT) is an advanced label-free optical microscopic imaging method used for biological studies. HT uses digital holographic microscopy to record the complex amplitudes of a biological sample as digital holograms and then numerically reconstruct the sample's refractive index (RI) distribution in three dimensions. The RI values are a key parameter for label-free bio-examination, which correlate with metabolic activities and spatiotemporal distribution of biophysical parameters of cells and their internal organelles, tissues, and small-scale biological objects. This article provides insight on this rapidly growing HT field of research and its applications in biology. We present a review summary of the HT principle and highlight recent technical advancement in HT and its applications.

Refractive Index Changes of Cells and Cellular Compartments Upon Paraformaldehyde Fixation Acquired by Tomographic Phase Microscopy.

Three-dimensional quantitative phase imaging is an emerging method, which provides the 3D distribution of the refractive index (RI) and the dry mass in live and fixed cells as well as in tissues. However, an insufficiently answered question is the influence of chemical cell fixation procedures on the results of RI reconstructions. Therefore, this work is devoted to systematic investigations on the RI in cellular organelles of live and fixed cells including nucleus, nucleolus, nucleoplasm, and cytoplasm. The research was carried out on four different cell lines using a common paraformaldehyde (PFA)-based fixation protocol. The selected cell types represent the diversity of mammalian cells and therefore the results presented provide a picture of fixation caused RI changes in a broader context. A commercial Tomocube HT-1S device was used for 3D RI acquisition. The changes in the RI values after the fixation process are detected in the reconstructed phase distributions and amount to the order of 10-3 . The RI values decrease and the observed RI changes are found to be different between various cell lines; however, all of them show the most significant loss in the nucleolus. In conclusion, our study demonstrates the evident need for standardized preparation procedures in phase tomographic measurements. © 2020 The Authors. Cytometry Part A published by Wiley Periodicals LLC. on behalf of International Society for Advancement of Cytometry.

Suitability analysis of holographic vs light field and 2D displays for subjective quality assessment of Fourier holograms.

Measuring the impact of compression on the reconstruction quality of holograms remains a challenge. A public subjectively-annotated holographic data set that allows for testing the performance of compression techniques and quality metrics is presented, in addition to a subjective visual quality assessment methodology. Moreover, the performance of the quality assessment procedures is compared for holographic, regular 2D and light field displays. For these experiments, a double-stimulus, multi-perspective, multi-depth testing methodology was designed and implemented. Analysis of the quality scores indicated that in the absence of a suitable holographic display and under the presented test conditions, non-holographic displays can be deployed to display numerically reconstructed holograms for visual quality assessment tasks.

3D-printed biological cell phantom for testing 3D quantitative phase imaging systems.

As the 3D quantitative phase imaging (QPI) methods mature, their further development calls for reliable tools and methods to characterize and compare their metrological parameters. We use refractive index engineering during two-photon laser photolithography to fabricate a life-scale phantom of a biological cell with internal structures that mimic optical and structural properties of mammalian cells. After verification with a number of reference techniques, the phantom is used to characterize the performance of a limited-angle holographic tomography microscope.

Reconstruction method for extended depth-of-field optical diffraction tomography.

In the paper we present a novel method of extended depth-of-field limited-angle optical diffraction tomography, in which the change of a focal plane position is performed with a liquid focus-tunable lens. One sinogram is acquired for each state of a focus-tunable lens. After acquisition process is complete, all sinograms are independently reconstructed and stitched to form the final tomographic reconstruction. The presented solution effectively extends the applicability of the Rytov approximation to relatively thick samples and provides uniform resolution of 3D tomographic reconstructions. The method is also combined with Generalized Total Variation Iterative Constraint algorithm, which minimizes distortion of the results due to the limited angular range of acquired projections. The combined solution is dedicated to investigation of transparent and semi-transparent biological micro-structures, like cells and tissue slices.

Holographic tomography with scanning of illumination: space-domain reconstruction for spatially invariant accuracy.

The paper presents two novel, space-domain reconstruction algorithms for holographic tomography utilizing scanning of illumination and a fixed detector that is highly suitable for imaging of living biomedical specimens. The first proposed algorithm is an adaptation of the filtered backpropagation to the scanning illumination tomography. Its space-domain implementation enables avoiding the error-prone interpolation in the Fourier domain, which is a significant problem of the state-of-the-art tomographic algorithm. The second proposed algorithm is a modified version of the former, which ensures the spatially invariant reconstruction accuracy. The utility of the proposed algorithms is demonstrated with numerical simulations and experimental measurement of a cancer cell.

Novel Perspectives on the Characterization of Species-Dependent Optical Signatures of Bacterial Colonies by Digital Holography.

The use of light diffraction for the microbiological diagnosis of bacterial colonies was a significant breakthrough with widespread implications for the food industry and clinical practice. We previously confirmed that optical sensors for bacterial colony light diffraction can be used for bacterial identification. This paper is focused on the novel perspectives of this method based on digital in-line holography (DIH), which is able to reconstruct the amplitude and phase properties of examined objects, as well as the amplitude and phase patterns of the optical field scattered/diffracted by the bacterial colony in any chosen observation plane behind the object from single digital hologram. Analysis of the amplitude and phase patterns inside a colony revealed its unique optical properties, which are associated with the internal structure and geometry of the bacterial colony. Moreover, on a computational level, it is possible to select the desired scattered/diffracted pattern within the entire observation volume that exhibits the largest amount of unique, differentiating bacterial features. These properties distinguish this method from the already proposed sensing techniques based on light diffraction/scattering of bacterial colonies. The reconstructed diffraction patterns have a similar spatial distribution as the recorded Fresnel patterns, previously applied for bacterial identification with over 98% accuracy, but they are characterized by both intensity and phase distributions. Our results using digital holography provide new optical discriminators of bacterial species revealed in one single step in form of new optical signatures of bacterial colonies: digital holograms, reconstructed amplitude and phase patterns, as well as diffraction patterns from all observation space, which exhibit species-dependent features. To the best of our knowledge, this is the first report on bacterial colony analysis via digital holography and our study represents an innovative approach to the subject.

Generalized total variation iterative constraint strategy in limited angle optical diffraction tomography.

Due to incompleteness of input data inherent to Limited Angle Tomography (LAT), specific additional constraints are usually employed to suppress image artifacts. In this work we demonstrate a new two-stage regularization strategy, named Generalized Total Variation Iterative Constraint (GTVIC), dedicated to semi-piecewise-constant objects. It has been successfully applied as a supplementary module for two different reconstruction algorithms: an X-ray type solver and a diffraction-wise solver. Numerical tests performed on a detailed phantom of a biological cell under conical illumination pattern show significant reduction of axial blurring in the reconstructed refractive index distribution after GTVIC is added. Analogous results were obtained with experimental data.

Active limited-angle tomographic phase microscope.

We demonstrate an active, holographic tomography system, working with limited angle of projections, realized by optical-only, diffraction-based beam steering. The system created for this purpose is a Mach­Zehnder interferometer modified to serve as a digital holographic microscope with a high numerical aperture illumination module and a spatial light modulator (SLM). Such a solution is fast and robust. Apart from providing an elegant solution to viewing angle shifting, it also adds new capabilities of the holographic microscope system. SLM, being an active optical element, allows wavefront correction in order to improve measurement accuracy. Integrated phase data captured with different illumination scenarios within a highly limited angular range are processed by a new tomographic reconstruction algorithm based on the compressed sensing technique: total variation minimization, which is applied here to reconstruct nonpiecewise constant samples. Finally, the accuracy of full measurement and the proposed processing path is tested for a calibrated three-dimensional micro-object as well as a biological object--C2C12 myoblast cell.