Improving the reliability of deep learning computational ghost imaging with prediction uncertainty based on neighborhood feature maps.

Defect inspection is required in various fields, and many researchers have attempted deep-learning algorithms for inspections. Deep-learning algorithms have advantages in terms of accuracy and measurement time; however, the reliability of deep-learning outputs is problematic in precision measurements. This study demonstrates that iterative estimation using neighboring feature maps can evaluate the uncertainty of the outputs and shows that unconfident error predictions have higher uncertainties. In ghost imaging using deep learning, the experimental results show that removing outputs with higher uncertainties improves the accuracy by approximately 15.7%.

3D fluorescence imaging through scattering medium using transport of intensity equation and iterative phase retrieval.

In this paper, we have proposed a method of three-dimensional (3D) fluorescence imaging through a scattering medium. The proposed method combines the numerical digital phase conjugation propagation after measurement of the complex amplitude distribution of scattered light waves by the transport of intensity equation (TIE) with followed iterative phase retrieval to achieve 3D fluorescence imaging through a scattering medium. In the experiment, we present the quantitative evaluation of the depth position of fluorescent beads. In addition, for time-lapse measurement, cell division of tobacco-cultured cells was observed. Numerical results presented the effective range of the phase amount in the scattering medium. From these results, the proposed method is capable of recovering images degraded by a thin scattering phase object beyond a small phase change approximation.

Live Cell Imaging by Single-Shot Common-Path Wide Field-of-View Reflective Digital Holographic Microscope.

Quantitative phase imaging by digital holographic microscopy (DHM) is a nondestructive and label-free technique that has been playing an indispensable role in the fields of science, technology, and biomedical imaging. The technique is competent in imaging and analyzing label-free living cells and investigating reflective surfaces. Herein, we introduce a new configuration of a wide field-of-view single-shot common-path off-axis reflective DHM for the quantitative phase imaging of biological cells that leverages several advantages, including being less-vibration sensitive to external perturbations due to its common-path configuration, also being compact in size, simple in optical design, highly stable, and cost-effective. A detailed description of the proposed DHM system, including its optical design, working principle, and capability for phase imaging, is presented. The applications of the proposed system are demonstrated through quantitative phase imaging results obtained from the reflective surface (USAF resolution test target) as well as transparent samples (living plant cells). The proposed system could find its applications in the investigation of several biological specimens and the optical metrology of micro-surfaces.

Quantitative phase imaging based on motionless optical scanning holography.

Optical scanning holography (OSH) can be applied to 3D fluorescent imaging. However, the optical setup for OSH is complicated due to the requirement of a phase shifter, a 2D mechanical scanner, and an interferometer. Although motionless optical scanning holography (MOSH) can overcome the problem, quantitative phase imaging (QPI) has not yet been realized because MOSH can only obtain incoherent holograms. If QPI in MOSH is realized, MOSH can be applied to various applications. In this Letter, MOSH-based QPI (MOSH-QPI) is proposed. In addition, a simple description of a coherent mode of OSH is presented. In the proof-of-principle experiment, the spatially divided phase-shifting technique is applied to reduce the number of measurements. The feasibility of MOSH-QPI is confirmed by measuring a phase distribution of a microlens array. MOSH-QPI is also applied to measure practical samples, and its results are compared with the experimental results of the conventional one using a Mach-Zehnder interferometer.

Focus Issue Introduction: 3D Image Acquisition and Display: Technology, Perception and Applications.

This Feature Issue of Optics Express is organized in conjunction with the 2022 Optica conference on 3D Image Acquisition and Display: Technology, Perception and Applications which was held in hybrid format from 11 to 15, July 2022 as part of the Imaging and Applied Optics Congress and Optical Sensors and Sensing Congress 2022 in Vancouver, Canada. This Feature Issue presents 31 articles which cover the topics and scope of the 2022 3D Image Acquisition and Display conference. This Introduction provides a summary of these published articles that appear in this Feature Issue.

Single-shot generalized Hanbury Brown-Twiss experiments using a polarization camera for target intensity reconstruction in scattering media.

To see through a random light field in real-time, single-shot generalized Hanbury Brown-Twiss experiments using a polarization camera are proposed. The target intensity distribution is obtained from a complex coherence function which is calculated from auto-correlation and cross correlation functions of phase-shifted speckle intensity distributions. The phase-shifted speckle intensity distributions are simultaneously obtained through a strategy of parallel phase-shifting digital holography. Experimental results show that the proposed method can image a moving object in a random light field using a measured complex coherence function through the van Cittert-Zernike theorem.

Aberration analysis of a projection-type CGH display with an expanded FOV based on the HOE screen.

This paper proposed a holographic optical element as a see-through screen for the computer-generated hologram projection system with 3D images. The proposed holographic screen consisted of a linear grating and a lens phase. The linear grating is used to redirect the information light and guide information into the observer's eye and achieve the see-through function. The lens phase is used to magnify the field of view of the holographic projection system. The aberration caused by the screen was analyzed in this paper and the aberration can be pre-corrected in the hologram calculation algorithm. Finally, the proposed system achieved 20.3 by 14.3 degrees field of view at 532 nm laser based on the spatial light modulator with 6.4 µm pixels.

Relationship between the kernel size of a convolutional layer and the optical point spread function in ghost imaging using deep learning for identifying defect locations.

We explore the contribution of convolutional neural networks to correcting for the effect of the point spread function (PSF) of the optics when applying ghost imaging (GI) combined with deep learning to identify defect positions in materials. GI can be accelerated by combining GI and deep learning. However, no method has been established for determining the relevant model parameters. A simple model with different kernel sizes was built. Its accuracy was evaluated for data containing the effects of different PSFs. Numerical analysis and empirical experiments demonstrate that the accuracy of defect identification improved by matching the kernel size with the PSF of the optics.

Three-dimensional dynamic measurement of unstable temperature fields by multi-view single-shot phase-shifting digital holography.

A multi-view phase measurement system based on single-shot phase-shifting digital holography is proposed to dynamically obtain three-dimensional (3-D) information of an unstable temperature field. The proposed system consists of a laser, three polarization imaging cameras, and the corresponding optical components. The laser beam emitted from the laser is separated by the fibers into three pairs that contain three object beams and three reference beams. The object beams pass through the object in three different directions and interfere with the reference beams at the image sensor plane respectively. The recording of the three cameras is triggered simultaneously, which enables the phase measurement of dynamic objects from different viewpoints. We successfully measured the 3-D distributions of an unstable temperature field in the experiments with the proposed system.

Evaluation and Manipulation of Neural Activity using Two-Photon Holographic Microscopy.

Recent advances in optical bioimaging and optogenetics have enabled the visualization and manipulation of biological phenomena, including cellular activities, in living animals. In the field of neuroscience, detailed neural activity related to brain functions, such as learning and memory, has now been revealed, and it has become feasible to artificially manipulate this activity to express brain functions. However, the conventional evaluation of neural activity by two-photon Ca2+ imaging has the problem of low temporal resolution. In addition, manipulation of neural activity by conventional optogenetics through the optic fiber can only simultaneously regulate the activity of neurons with the same genetic background, making it difficult to control the activity of individual neurons. To solve this issue, we recently developed a microscope with a high spatiotemporal resolution for biological applications by combining optogenetics with digital holographic technology that can modify femtosecond infrared laser beams. Here, we describe protocols for the visualization, evaluation, and manipulation of neural activity, including the preparation of samples and operation of a two-photon holographic microscope (Figure 1). These protocols provide accurate spatiotemporal information on neural activity, which may be useful for elucidating the pathogenesis of neuropsychiatric disorders that lead to abnormalities in neural activity.

Simultaneous imaging of sound propagations and spatial distribution of acoustic frequencies.

We propose a simultaneous imaging technique of both sound propagations and spatial distribution of acoustic frequencies. We experimentally demonstrated the proposed technique for the acoustic waves of frequencies 39,500 and 40,500 Hz, which have close sound pressure. The sounds were recorded at the framerate of 100,000 fps by parallel phase-shifting digital holography. To obtain the distribution of the acoustic frequencies, the short-time Fourier transform analysis was applied. The simultaneous imaging was carried out by assigning the frequencies and the pixel values of the phase-difference images to the components of HSL color space. The images obtained by the proposed technique represent the frequencies with the hue in addition to the sound propagations with the luminance. We succeeded in imaging the spatiotemporal evolution of the spatial frequencies of the sounds.

Noise-robust deep learning ghost imaging using a non-overlapping pattern for defect position mapping.

Defect detection requires highly sensitive and robust inspection methods. This study shows that non-overlapping illumination patterns can improve the noise robustness of deep learning ghost imaging (DLGI) without modifying the convolutional neural network (CNN). Ghost imaging (GI) can be accelerated by combining GI and deep learning. However, the robustness of DLGI decreases in exchange for higher speed. Using non-overlapping patterns can decrease the noise effects in the input data to the CNN. This study evaluates the DLGI robustness by using non-overlapping patterns generated based on binary notation. The results show that non-overlapping patterns improve the position accuracy by up to 51%, enabling the detection of defect positions with higher accuracy in noisy environments.

Holographic microscope and its biological application.

Holographic structured illumination combined with optogenetics enables patterned stimulation of neurons and glial cells in an intact living brain. Moreover, in vivo functional imaging of cellular activity with recent advanced microscope technologies allows for visualization of the cellular responses during learning, emotion and cognition. Integrating these techniques can be used to verify the link between cell function and behavior output. However, there are technical limitations to stimulate multiple cells with high spatial and temporal resolution with available techniques of optogenetic stimulation. Here, we summarized a two-photon microscope combined with holographic system to stimulate multiple cells with high spatial and temporal resolution for living mice and their biological application.

2D full-field displacement and vibration measurements of specularly reflecting surfaces by two-beam common-path digital holography.

A new, to the best of our knowledge, configuration of common-path off-axis digital holography is proposed for simultaneous evaluation of out-of-plane and in-plane displacements of the vibrating object. The object is illuminated from two different directions, and each illumination interferes with its corresponding reference beam generated near the object, resulting in two independent holograms that are spatially multiplexed in a single camera image. Two multiplexed holograms, at undeformed and deformed states of the object, are recorded and processed to obtain the out-of-plane and in-plane displacements simultaneously. The proposed digital holographic system has the advantage of a simple and compact optical setup, is less sensitive to environmental disturbances, and has high temporal phase stability. The two-dimensional (z,x) full-field amplitude and phase vibration analysis of a perfect specularly reflecting surface are also demonstrated by the proposed holographic system. The experimental results authenticate the feasibility of the proposed system and reveal its unique advantages. The proposed digital holographic system, owing to simple and compact geometry and providing several advantages over other two-channel holographic systems, may find a wide range of applications in investigating real-time dynamic phenomena.

Spatiotemporal observation of light propagation in a three-dimensional scattering medium.

Spatiotemporal information about light pulse propagation obtained with femtosecond temporal resolution plays an important role in understanding transient phenomena and light-matter interactions. Although ultrafast optical imaging techniques have been developed, it is still difficult to capture light pulse propagation spatiotemporally. Furthermore, imaging through a three-dimensional (3-D) scattering medium is a longstanding challenge due to the optical scattering caused by the interaction between light pulse and a 3-D scattering medium. Here, we propose a technique for ultrafast optical imaging of light pulses propagating inside a 3D scattering medium. We record an image of the light pulse propagation using the ultrashort light pulse even when the interaction between light pulse and a 3-D scattering medium causes the optical scattering. We demonstrated our proposed technique by recording converging, refracted, and diffracted propagating light for 59 ps with femtosecond temporal resolution.

Binocular dynamic holographic floating image display.

This paper proposes a binocular holographic floating display. The device consists of two phase-modulation spatial light modulators (SLM) and a dihedral corner reflector array (DCRA) element. The conjugate images of the SLMs generated by the DCRA become the system's exit pupils. Exit pupils that are larger than the pupils of human eyes are arranged to locate at the position of observer's eyes. Therefore, the dimension of the SLM will not limit the viewing angle, although the pixel pitch of the SLM still limits the maximum field of view. For the laser light source, the resolution of the images can achieve 3 arc minutes when the distance between images and DCRA is less than 20 cm. The full-color display function is also performed in the proposed device.

Multimodal sound field imaging using digital holography [Invited].

Sound is an important invisible physical phenomenon that needs to be explained in several physical and biological processes, along with visual phenomena. For this purpose, multiparameter digital holography (DH) has been proposed to visualize both features simultaneously due to the phase and amplitude reconstruction properties of DH. In this paper, we present a brief review on sound field imaging techniques with special focus on the multiparameter imaging capability of DH for visualizing sound and visual features. The basic theory and several experimental results with very high-speed recordings are also presented to demonstrate sound field imaging for the audible range as well as in the ultrasound range.

High-speed imaging of the sound field by parallel phase-shifting digital holography.

Sound field imaging techniques have been found very useful for acoustic designs. Building on this idea, innovative techniques are needed and presented in this paper, where we report on developed imaging of the sound field radiated from speakers by parallel phase-shifting digital holography. We adopted an ultrasonic wave radiated from a speaker for an object. The phase distribution of the light wave was modulated by the sound field radiated from the speaker. The modulated phase distribution was recorded in the form of multiplexed phase-shifted holograms at the frame rate of 100,000 fps. A 40,000 Hz sound field radiated from a speaker is used as an observation target. Our proposed method can implement the imaging of the sound field successfully. Also, in order to demonstrate the digital refocusing capability of digital holography, we set two speakers, whose difference in depth positions was 6.6 cm, as a long-depth object. We demonstrated the digital refocusing on the two speakers along with the capability of measuring the positions of the objects. Furthermore, we succeeded in imaging of 40,000 Hz and 41,000 Hz sound fields radiated from the two speakers. The presented experimental results showed that parallel phase-shifting digital holography is very useful and suitable for sound field imaging.

Single-shot common-path off-axis digital holography: applications in bioimaging and optical metrology [Invited].

The demand for single-shot and common-path holographic systems has become increasingly important in recent years, as such systems offer various advantages compared to their counterparts. Single-shot holographic systems, for example, reduce computational complexity as only a single hologram with the object information required to process, making them more suitable for the investigation of dynamic events; and common-path holographic systems are less vibration-sensitive, compact, inexpensive, and high in temporal phase stability. We have developed a single-shot common-path off-axis digital holographic setup based on a beam splitter and pinhole. In this paper, we present a concise review of the proposed digital holographic system for several applications, including the quantitative phase imaging to investigate the morphological and quantitative parameters, as a metrological tool for testing of micro-optics, industrial inspection and measurement, and sound field imaging and visualization.

Special Series Guest Editorial: Biomedical Imaging and Sensing III.

Guest editors Toyohiko Yatagai, Osamu Matoba, Yoshihisa Aizu, Yasuhiro Awatsuji, and Yuan Luo introduce the articles in the Special Series on Biomedical Imaging and Sensing.