Fast Three-Dimensional Profilometry with Large Depth of Field.

By applying a high projection rate, the binary defocusing technique can dramatically increase 3D imaging speed. However, existing methods are sensitive to the varied defocusing degree, and have limited depth of field (DoF). To this end, a time-domain Gaussian fitting method is proposed in this paper. The concept of a time-domain Gaussian curve is firstly put forward, and the procedure of determining projector coordinates with a time-domain Gaussian curve is illustrated in detail. The neural network technique is applied to rapidly compute peak positions of time-domain Gaussian curves. Relying on the computing power of the neural network, the proposed method can reduce the computing time greatly. The binary defocusing technique can be combined with the neural network, and fast 3D profilometry with a large depth of field is achieved. Moreover, because the time-domain Gaussian curve is extracted from individual image pixel, it will not deform according to a complex surface, so the proposed method is also suitable for measuring a complex surface. It is demonstrated by the experiment results that our proposed method can extends the system DoF by five times, and both the data acquisition time and computing time can be reduced to less than 35 ms.

Calculation and Analysis of Key Parameters of Underwater Optical Imaging System.

When photographing objects underwater, it is important to utilize an optical window to isolate the imaging device from the water. The properties of the entire imaging system will change, and the imaging quality will decrease due to the refraction impact of the water and the window. The theoretical calculation method for air imaging is no longer relevant in this context. To analyze the unique rule, this research derives the formulas for key parameters of underwater imaging systems under paraxial circumstances. First, the optical window is modeled, then the formula for the optical window's focal length in the underwater environment is derived, and the change rule for the focal length of various window forms underwater is condensed. For the ideal imaging system using a domed optical window, the equivalent two-optical group model of the imaging system is established, and the formula for calculating the focal length, working distance, and depth of field of the underwater imaging system is derived through paraxial ray tracing. The accuracy of the formula is verified through the comparative analysis of the formula calculation results and the Zemax modeling simulation results. It provides an important theoretical basis for the in-depth study of underwater imaging technology.

Compound Acoustic Radiation Force Impulse Imaging of Bovine Eye by Using Phase-Inverted Ultrasound Transducer.

In general, it is difficult to visualize internal ocular structure and detect a lesion such as a cataract or glaucoma using the current ultrasound brightness-mode (B-mode) imaging. This is because the internal structure of the eye is rich in moisture, resulting in a lack of contrast between tissues in the B-mode image, and the penetration depth is low due to the attenuation of the ultrasound wave. In this study, the entire internal ocular structure of a bovine eye was visualized in an ex vivo environment using the compound acoustic radiation force impulse (CARFI) imaging scheme based on the phase-inverted ultrasound transducer (PIUT). In the proposed method, the aperture of the PIUT is divided into four sections, and the PIUT is driven by the out-of-phase input signal capable of generating split-focusing at the same time. Subsequently, the compound imaging technique was employed to increase signal-to-noise ratio (SNR) and to reduce displacement error. The experimental results demonstrated that the proposed technique could provide an acoustic radiation force impulse (ARFI) image of the bovine eye with a broader depth-of-field (DOF) and about 80% increased SNR compared to the conventional ARFI image obtained using the in-phase input signal. Therefore, the proposed technique can be one of the useful techniques capable of providing the image of the entire ocular structure to diagnose various eye diseases.

Deep learning extended depth-of-field microscope for fast and slide-free histology.

Microscopic evaluation of resected tissue plays a central role in the surgical management of cancer. Because optical microscopes have a limited depth-of-field (DOF), resected tissue is either frozen or preserved with chemical fixatives, sliced into thin sections placed on microscope slides, stained, and imaged to determine whether surgical margins are free of tumor cells-a costly and time- and labor-intensive procedure. Here, we introduce a deep-learning extended DOF (DeepDOF) microscope to quickly image large areas of freshly resected tissue to provide histologic-quality images of surgical margins without physical sectioning. The DeepDOF microscope consists of a conventional fluorescence microscope with the simple addition of an inexpensive (less than $10) phase mask inserted in the pupil plane to encode the light field and enhance the depth-invariance of the point-spread function. When used with a jointly optimized image-reconstruction algorithm, diffraction-limited optical performance to resolve subcellular features can be maintained while significantly extending the DOF (200 µm). Data from resected oral surgical specimens show that the DeepDOF microscope can consistently visualize nuclear morphology and other important diagnostic features across highly irregular resected tissue surfaces without serial refocusing. With the capability to quickly scan intact samples with subcellular detail, the DeepDOF microscope can improve tissue sampling during intraoperative tumor-margin assessment, while offering an affordable tool to provide histological information from resected tissue specimens in resource-limited settings.

Integral Imaging Display System Based on Human Visual Distance Perception Model.

In an integral imaging (II) display system, the self-adjustment ability of the human eye can result in blurry observations when viewing 3D targets outside the focal plane within a specific range. This can impact the overall imaging quality of the II system. This research examines the visual characteristics of the human eye and analyzes the path of light from a point source to the eye in the process of capturing and reconstructing the light field. Then, an overall depth of field (DOF) model of II is derived based on the human visual system (HVS). On this basis, an II system based on the human visual distance (HVD) perception model is proposed, and an interactive II display system is constructed. The experimental results confirm the effectiveness of the proposed method. The display system improves the viewing distance range, enhances spatial resolution and provides better stereoscopic display effects. When comparing our method with three other methods, it is clear that our approach produces better results in optical experiments and objective evaluations: the cumulative probability of blur detection (CPBD) value is 38.73%, the structural similarity index (SSIM) value is 86.56%, and the peak signal-to-noise ratio (PSNR) value is 31.12. These values align with subjective evaluations based on the characteristics of the human visual system.

Depth of field and visual performance after implantation of a new hydrophobic trifocal intraocular lens.

PURPOSE: To assess the depth of field (DOF) by means of defocus curve analysis applying different visual acuity criteria in patients following cataract surgery and bilateral implantation of a new trifocal diffractive intraocular lens (IOL). METHODS: Fifty eyes of 25 consecutive patients who underwent implantation of the Asqelio™ trifocal IOL (AST Products Inc., USA) were enrolled in this observational prospective study. Monocular subjective DOF was obtained from defocus curves with absolute and relative criteria of tolerance for different visual acuities values. Patient's visual satisfaction, postoperative refraction and visual acuity at far, intermediate (67 cm) and near (40 cm) distances were also measured at 1 and 3-months post-surgery. Analysis of variance was used to assess differences in refractive error after the surgical procedure, and paired t-tests were used to assess differences in VA. Patient satisfaction results were reported as percentages. RESULTS: Spherical equivalent was 0.05 ± 0.23 D and residual cylinder 0.01 ± 0.23 D 3-months after the surgery. Absolute DOF obtained was 3.29 ± 0.91 D considering 0.1 LogMAR as cut-off value, and 4.82 ± 0.69 D when 0.3 logMAR as cutoff value. Relative DOF considering a drop of 0.1 logMAR from maximum visual acuity was 2.57 ± 0.82 D, and 1.27 ± 0.70 D when a drop of 0.04 logMAR was considered. Visual acuities obtained 3-months after the surgery were 0.03 ± 0.13, - 0.05 ± 0.06, 0.03 ± 0.08 and 0.04 ± 0.08 logMAR for uncorrected and best-corrected for distance, and best distance-corrected for intermediate and near distances, respectively. Average response to visual satisfaction queries was 8.24/10 at distance, 8.04/10 at intermediate, and 7.88/10 at near. CONCLUSIONS: Patients implanted with this trifocal IOL showed a significant improvement in visual acuity at different distances providing wide absolute and relative DOF values. The outcomes demonstrate that this lens is predictable yielding good patient satisfaction rates.

[Imaging quality of the robotic visualization 4K3D system and its application in microscopic vasectomy reversal in rats].

OBJECTIVE: To quantitatively assess the performance of the new robotic visualization system (Zeiss, KINEVO 900) in terms of visual imaging effect and evaluate its potential application in microscopic vasectomy reversal. METHODS: We made a parallel comparison between the effects of the plane and stereo visual images of KINEVO 900 and optical surgical microscopy (Zeiss, S7), and performed microscopic vasectomy reversal on the rat model using KINEVO 900. RESULTS: Compared with S7, KINEVO 900 provided an even longer working distance (200－625 mm), a 3－4 times larger effective field area and a 1.5－2 times deeper front depth of field with the same working distance of 200 mm. No statistically significant difference was observed in the average anastomosis time and immediate patency rate between the two platforms (P > 0.05). CONCLUSION: The 4K3D video image stream outputted by KINEVO 900 is not inferior to that of the optical surgical microscope represented by S7 and is sufficient for microsurgeries in urology and andrology. More prospective randomized clinical animal experiments are needed to further evaluate its application value in andrology.

Multi-Focus Image Fusion Using Focal Area Extraction in a Large Quantity of Microscopic Images.

The non-invasive examination of conjunctival goblet cells using a microscope is a novel procedure for the diagnosis of ocular surface diseases. However, it is difficult to generate an all-in-focus image due to the curvature of the eyes and the limited focal depth of the microscope. The microscope acquires multiple images with the axial translation of focus, and the image stack must be processed. Thus, we propose a multi-focus image fusion method to generate an all-in-focus image from multiple microscopic images. First, a bandpass filter is applied to the source images and the focus areas are extracted using Laplacian transformation and thresholding with a morphological operation. Next, a self-adjusting guided filter is applied for the natural connections between local focus images. A window-size-updating method is adopted in the guided filter to reduce the number of parameters. This paper presents a novel algorithm that can operate for a large quantity of images (10 or more) and obtain an all-in-focus image. To quantitatively evaluate the proposed method, two different types of evaluation metrics are used: "full-reference" and "no-reference". The experimental results demonstrate that this algorithm is robust to noise and capable of preserving local focus information through focal area extraction. Additionally, the proposed method outperforms state-of-the-art approaches in terms of both visual effects and image quality assessments.

Ranking-Based Salient Object Detection and Depth Prediction for Shallow Depth-of-Field.

Shallow depth-of-field (DoF), focusing on the region of interest by blurring out the rest of the image, is challenging in computer vision and computational photography. It can be achieved either by adjusting the parameters (e.g., aperture and focal length) of a single-lens reflex camera or computational techniques. In this paper, we investigate the latter one, i.e., explore a computational method to render shallow DoF. The previous methods either rely on portrait segmentation or stereo sensing, which can only be applied to portrait photos and require stereo inputs. To address these issues, we study the problem of rendering shallow DoF from an arbitrary image. In particular, we propose a method that consists of a salient object detection (SOD) module, a monocular depth prediction (MDP) module, and a DoF rendering module. The SOD module determines the focal plane, while the MDP module controls the blur degree. Specifically, we introduce a label-guided ranking loss for both salient object detection and depth prediction. For salient object detection, the label-guided ranking loss comprises two terms: (i) heterogeneous ranking loss that encourages the sampled salient pixels to be different from background pixels; (ii) homogeneous ranking loss penalizes the inconsistency of salient pixels or background pixels. For depth prediction, the label-guided ranking loss mainly relies on multilevel structural information, i.e., from low-level edge maps to high-level object instance masks. In addition, we introduce a SOD and depth-aware blur rendering method to generate shallow DoF images. Comprehensive experiments demonstrate the effectiveness of our proposed method.

Mitigating Cybersickness in Virtual Reality Systems through Foveated Depth-of-Field Blur.

Cybersickness is one of the major roadblocks in the widespread adoption of mixed reality devices. Prolonged exposure to these devices, especially virtual reality devices, can cause users to feel discomfort and nausea, spoiling the immersive experience. Incorporating spatial blur in stereoscopic 3D stimuli has shown to reduce cybersickness. In this paper, we develop a technique to incorporate spatial blur in VR systems inspired by the human physiological system. The technique makes use of concepts from foveated imaging and depth-of-field. The developed technique can be applied to any eye tracker equipped VR system as a post-processing step to provide an artifact-free scene. We verify the usefulness of the proposed system by conducting a user study on cybersickness evaluation. We used a custom-built rollercoaster VR environment developed in Unity and an HTC Vive Pro Eye headset to interact with the user. A Simulator Sickness Questionnaire was used to measure the induced sickness while gaze and heart rate data were recorded for quantitative analysis. The experimental analysis highlighted the aptness of our foveated depth-of-field effect in reducing cybersickness in virtual environments by reducing the sickness scores by approximately 66%.

Use of Miniature Step Gauges to Assess the Performance of 3D Optical Scanners and to Evaluate the Accuracy of a Novel Additive Manufacture Process.

In this work, we show how miniature step gauges featuring unidirectional and bidirectional lengths can be used to assess the performance of 3D optical scanners as well as the accuracy of novel Additive Manufacturing (AM) processes. A miniature step gauge made of black polyphenylene sulfide (PPS) was used for the performance verification of three different optical scanners: a structured light scanner (SLS), a laser line scanner (LLS), and a photogrammetry-based scanner (PSSRT), having comparable resolutions and working volumes. Results have shown a good agreement between the involved scanners, with errors below 5 µm and expanded uncertainties below 10 µm. The step gauge geometry due to the bidirectional lengths, highlights that there is a different interaction between the optical properties of the step gauge under measurement and each optical instrument involved and this aspect has to be considered in the uncertainty budget. The same geometry, due to its great significance in the detection of systematic errors, was used, as a novelty, to evaluate the accuracy of Lithography-based Ceramics Manufacturing (LCM), a proprietary additive manufacturing technology used for the fabrication of medical implants. In particular, two miniature step gauges made of Tricalcium Phosphate (TCP) were produced. Measurements conducted with the SLS scanner were characterized by a negligible error and by an uncertainty of about 5 µm. Deviations of the manufactured step gauges with respect to the Computer Aided Designed (CAD) model were comprised between ±50 µm, with positive deviations in the order of 100 µm on vertical sides. Differences in the order of 50 µm between the two step gauges were registered.

Depth-of-Field-Extended Plenoptic Camera Based on Tunable Multi-Focus Liquid-Crystal Microlens Array.

Plenoptic cameras have received a wide range of research interest because it can record the 4D plenoptic function or radiance including the radiation power and ray direction. One of its important applications is digital refocusing, which can obtain 2D images focused at different depths. To achieve digital refocusing in a wide range, a large depth of field (DOF) is needed, but there are fundamental optical limitations to this. In this paper, we proposed a plenoptic camera with an extended DOF by integrating a main lens, a tunable multi-focus liquid-crystal microlens array (TMF-LCMLA), and a complementary metal oxide semiconductor (CMOS) sensor together. The TMF-LCMLA was fabricated by traditional photolithography and standard microelectronic techniques, and its optical characteristics including interference patterns, focal lengths, and point spread functions (PSFs) were experimentally analyzed. Experiments demonstrated that the proposed plenoptic camera has a wider range of digital refocusing compared to the plenoptic camera based on a conventional liquid-crystal microlens array (LCMLA) with only one corresponding focal length at a certain voltage, which is equivalent to the extension of DOF. In addition, it also has a 2D/3D switchable function, which is not available with conventional plenoptic cameras.

Subjective and objective depth of field measures in pseudophakic eyes: comparison between extended depth of focus, trifocal and bifocal intraocular lenses.

PURPOSE: To evaluate different intraocular lens (IOL) designs and to determine whether extended depth of focus (EDOF) lenses provide a higher depth of field (DOF) than the rest considering both subjective and objective measurements. METHODS: A total of 100 eyes undergoing cataract surgery were divided into six groups depending on the IOL implanted: bifocal designs were Tecnis ZMB and ZLB (Abbott Laboratories, Illinois, USA), trifocal designs were Finevision (PhysIOL, Liège, Belgium) and AT LISA Tri (Carl Zeiss Meditec., Jena, Germany) and EDOF designs were Symfony (Abbott Laboratories, Illinois, USA) and MiniWell (SIFI MedTech, Catania, Italy). Subjective DOF was obtained from defocus curves for the range of vergences which provide a VA over 0.1 LogMAR and 0.2 LogMAR. Aberrometry was measured and Visual Strehl Optical Transference Function (90%) was used to quantify objectively the DOF. RESULTS: Symfony IOL group showed better subjective and objective DOF compared to the rest of IOL groups, with statistically significant differences (p < 0.001). Comparison between subjective and objective DOF showed that subjective measures were higher for all IOLs, being these differences statistically significant for all groups when compared with objective measures (p < 0.001). CONCLUSION: Objective and subjective measures of DOF are not comparable due to differences in methodologies and criterions to define the level of degradation acceptance. Nevertheless, both objective and subjective measures demonstrate a greater DOF for EDOF designs compared to bifocal and trifocal IOLs, being the Symfony IOL the one providing higher levels of subjective and objective DOF.

Reconstruction method for extended depth-of-field optical diffraction tomography.

In the paper we present a novel method of extended depth-of-field limited-angle optical diffraction tomography, in which the change of a focal plane position is performed with a liquid focus-tunable lens. One sinogram is acquired for each state of a focus-tunable lens. After acquisition process is complete, all sinograms are independently reconstructed and stitched to form the final tomographic reconstruction. The presented solution effectively extends the applicability of the Rytov approximation to relatively thick samples and provides uniform resolution of 3D tomographic reconstructions. The method is also combined with Generalized Total Variation Iterative Constraint algorithm, which minimizes distortion of the results due to the limited angular range of acquired projections. The combined solution is dedicated to investigation of transparent and semi-transparent biological micro-structures, like cells and tissue slices.

The clinical depth of field achievable with trifocal and monofocal intraocular lenses: theoretical considerations and proof of concept clinical results.

BACKGROUND: To estimate the depth of field (DOF) achievable with multi-and monofocal intraocular lenses (IOLs) and compare with actual measurements of DOF in cases implanted with a trifocal IOL and biconvex monofocal IOL METHODS: I) Computer simulations were produced to describe the relationship between DOF, pupil size, preoperative ametropia, and retinal blur tolerance limit for a model eye implanted with either multi- or monofocal IOLs. II) Monocular DOF and pupil size were measured under distance viewing conditions between 3 and 6 months postoperative following uneventful cataract surgery. Cases were implanted with either i) trifocal aspheric IOL (n = 36), or ii) biconvex aspheric monofocal IOL (n = 26). DOF was also measured at 0.33 m in cases implanted with i). RESULTS: Simulations revealed significant associations between DOF, pupil size, and retinal blur tolerance limit. The mean (±SD) DOF & pupil sizes were at distance for i)  above 2.59D (0.68) & 3.54 mm (0.377), and for ii) above 1.67D (0.51) & 2.90 mm (0.351), and for i) above 3.16D (0.46) at near. The difference between groups were significant for DOF and pupil size at distance (p < 0.001). DOF was significantly greater at near compared with distance in i) above (p < 0.001). For a pupil size of 3 mm, the simulations produce similar DOF values when the tolerance limit of retinal blur is 10 µ. CONCLUSIONS: The DOF was significantly better after implanting the trifocal IOL compared with the monofocal IOL, and DOF is increased under near viewing conditions. The clinical results are similar to calculated DOF values when the tolerance limit of retinal blur is 10 µ.

The effect of longitudinal chromatic aberration on the lag of accommodation and depth of field.

PURPOSE: Longitudinal chromatic aberration is present in all states of accommodation and may play a role in the accommodation response and the emmetropisation process. We study the change of the depth of field (DOFi) with the state of accommodation, taking into account the longitudinal chromatic aberration. METHODS: Subjective DOFi was defined as the range of defocus beyond which the blur of the target (one line of optotypes of 0.1 logMAR shown on a black-and-white microdisplay, seen through different colour filters) was perceived as objectionable. The subject's eye was paralysed and different, previously-measured accommodative states (corresponding to the accommodative demands of 0D, 2D and 4D) were simulated with a deformable mirror. Different colour conditions (monochromatic red, green and blue and polychromatic (white) were tested. The DOFi was measured subjectively, using a motorised Badal system. RESULTS: Taking as reference the average accommodative response for the white stimulus, the blue response exhibits on average a lead of 0.45 ± 0.09D, the green a negligible lead of 0.07 ± 0.02D and red a lag of 0.49 ± 0.10D. The monochromatic DOFi, calculated by averaging DOFi over the red, green and blue colour conditions for each accommodative demand was 1.10 ± 0.10D for 0D, 1.20 ± 0.08D for 2D, and 1.26 ± 0.40D for 4D. The polychromatic white DOFi were greater than the average monochromatic DOFi by 19%, 9% and 14% for 0D, 2D, and 4D of accommodative demand, respectively. CONCLUSION: The longitudinal chromatic aberration causes a dioptric shift of the monochromatic accommodation response. The study did not reveal this shift to depend on the accommodative demand or to have an effect on the DOFi.

Test of the Practicality and Feasibility of EDoF-Empowered Image Sensors for Long-Range Biometrics.

For many practical applications of image sensors, how to extend the depth-of-field (DoF) is an important research topic; if successfully implemented, it could be beneficial in various applications, from photography to biometrics. In this work, we want to examine the feasibility and practicability of a well-known "extended DoF" (EDoF) technique, or "wavefront coding," by building real-time long-range iris recognition and performing large-scale iris recognition. The key to the success of long-range iris recognition includes long DoF and image quality invariance toward various object distance, which is strict and harsh enough to test the practicality and feasibility of EDoF-empowered image sensors. Besides image sensor modification, we also explored the possibility of varying enrollment/testing pairs. With 512 iris images from 32 Asian people as the database, 400-mm focal length and F/6.3 optics over 3 m working distance, our results prove that a sophisticated coding design scheme plus homogeneous enrollment/testing setups can effectively overcome the blurring caused by phase modulation and omit Wiener-based restoration. In our experiments, which are based on 3328 iris images in total, the EDoF factor can achieve a result 3.71 times better than the original system without a loss of recognition accuracy.

Geometric and Optic Characterization of a Hemispherical Dome Port for Underwater Photogrammetry.

The popularity of automatic photogrammetric techniques has promoted many experiments in underwater scenarios leading to quite impressive visual results, even by non-experts. Despite these achievements, a deep understanding of camera and lens behaviors as well as optical phenomena involved in underwater operations is fundamental to better plan field campaigns and anticipate the achievable results. The paper presents a geometric investigation of a consumer grade underwater camera housing, manufactured by NiMAR and equipped with a 7'' dome port. After a review of flat and dome ports, the work analyzes, using simulations and real experiments, the main optical phenomena involved when operating a camera underwater. Specific aspects which deal with photogrammetric acquisitions are considered with some tests in laboratory and in a swimming pool. Results and considerations are shown and commented.

Optical microscopy with flexible axial capabilities using a vari-focus liquid lens.

The axial imaging range of optical microscopy is restricted by its fixed working plane and limited depth of field. In this paper, the axial capabilities of an off-the-shelf microscope is improved by inserting a liquid lens, which can be controlled by a driving electrical voltage, into the optical path of the microscope. First, the numerical formulas of the working distance and the magnification with the variation of the focus of the liquid lens are inferred using a ray tracing method and conclusion is obtained that the best position for inserting a liquid lens with consistent magnification is the aperture plane and the rear focal plane of the objective lens. Second, with the liquid lens embedded in the microscope, the numerical relationship between the magnification and the working distance of the proposed flexible-axial-capability microscope and the liquid lens driving voltage is calibrated and fitted using the inferred numerical formulas. Third, techniques including autofocus, extending depth of field and three-dimensional imaging are researched and applied, improving the designed microscope to not only flexibly control its working distance, but also to extend the depth of field near the variable working plane. Experiments show that the presented flexible-axial-capability microscope has a long working distance range of 8 mm, and by calibrating the magnification curve within the working distance range, samples can be observed and measured precisely. The depth of field can be extended to 400 µm from the variable working plane and is 20 times that of the off-the-shelf microscope.

Matched Backprojection Operator for Combined Scanning Transmission Electron Microscopy Tilt- and Focal Series.

Combined tilt- and focal series scanning transmission electron microscopy is a recently developed method to obtain nanoscale three-dimensional (3D) information of thin specimens. In this study, we formulate the forward projection in this acquisition scheme as a linear operator and prove that it is a generalization of the Ray transform for parallel illumination. We analytically derive the corresponding backprojection operator as the adjoint of the forward projection. We further demonstrate that the matched backprojection operator drastically improves the convergence rate of iterative 3D reconstruction compared to the case where a backprojection based on heuristic weighting is used. In addition, we show that the 3D reconstruction is of better quality.