Angular uniformity improvement of diffractive waveguide display based on region geometry optimization.

Augmented reality (AR) near-eye displays have significantly progressed due to advances in nanostructure fabrication. However, for diffractive waveguide AR displays requiring exit pupil expansion, the angular uniformity of each exit pupil position still needs to improve. In this paper, an angular uniformity improvement method based on region geometry optimization is proposed. This optimization method essentially introduces the interaction number of the light with the grating as one of the variables to manipulate the energy distribution. This distribution is obtained by the rigorous coupled wave analysis (RCWA) method and ray tracing process and is further optimized by a multi-objective genetic algorithm. A model is built, and the feasibility of the proposed method is verified. The diffractive waveguide system has a 10m m×10m m exit pupil size at the eye relief of 25 mm and a field of view (FOV) of 21∘×12∘. After the optimization, the overall optical efficiency of the central field and the angular uniformity at the center exit pupil position increased from 0.9% and 66% to 3.1% and 80%, respectively.

Single-image-source binocular waveguide display based on polarization volume gratings and lenses.

Waveguide displays, a highly competitive solution for augmented reality (AR), have attracted a lot of interest. A polarization-dependent binocular waveguide display using polarization volume lenses (PVLs) and polarization volume gratings (PVGs) as input and output couplers, respectively, is proposed. Light from a single image source is delivered to the left and right eyes independently according to its polarization state. Compared with traditional waveguide display systems, no additional collimation system is needed due to the deflection and collimation capabilities of PVLs. Leveraging the high efficiency, wide angular bandwidth, and polarization selectivity of liquid crystal elements, different images can be independently and accurately produced in the two eyes when the polarization of the image source is modulated. The proposed design paves the way for a compact and lightweight binocular AR near-eye display.

Design and fabricate freeform holographic optical elements on curved optical surfaces using holographic printing.

Freeform holographic optical elements (HOEs), due to the high degrees of design freedom, can be used to enhance performance of display systems. In this Letter, we propose a method for designing and fabricating freeform HOEs on curved optical surfaces that can be utilized to implement curved augmented reality (AR) displays. In our method, the phase profile of the freeform HOE laminated on a curved surface is first optimized to achieve a good image performance. Then, two recording wavefronts are optimized to produce the phase profile of the freeform HOE on the curved surface with a high uniformity of diffraction efficiency. The two recording wavefronts used for a curved substrate are converted into two wavefronts for a planar substrate based on a conversion relationship between the curved HOE and the planar HOE. A home-built holographic printer is used to fabricate freeform HOEs on a flat substrate, and then the freeform HOEs are laminated onto a curved optical surface. Two interesting AR display systems are presented to demonstrate the effectiveness of the proposed design and fabrication method.

Wide-spectrum laser beam shaping for full-color volume holographic optical element recording.

For homogeneous diffraction efficiency of the recorded volume holographic optical element (vHOE), a recording beam of uniform intensity is required. A multicolor vHOE is recorded by an RGB laser source with Gaussian intensity distribution; during equal exposure time, recording beams of different intensities would result in different diffraction efficiencies in different recording areas. In this paper, we present a wide-spectrum laser beam shaping system design method, by which the incident RGB laser beam can be controlled into uniform intensity distribution with a spherical wavefront. This beam shaping system can be added to any recording system to obtain uniform intensity distribution without altering the beam shaping effect of the original recording system. The proposed beam shaping system is composed of two aspherical lens groups, and the design method with an initial point design and optimization design method is given. An example is built to demonstrate the feasibility of the proposed beam shaping system.

Portable autostereoscopic display based on multi-directional backlight.

A multi-directional backlight autostereoscopic display system with high resolution, low crosstalk, and motion parallax is developed in this paper. The proposed multi-directional backlight system is based on the Bragg mismatched reconstruction of volume holographic optical element (VHOE), and includes a set of light sources which are uniformly arrayed along one direction. Each light source produces its corresponding directional lighting to follow the human eye position detected by an eye tracker. Two scenarios are presented to build the multi-directional backlight system. The prism-type backlight system which guides the incident beam with a prism is relatively simple and easy to implement. The waveguide-type one which employs a transflective film to expand the incident light beam within the waveguide and modulate the intensity of the incident beam, is relatively thin and is applicable to large-area display. Two prototypes are built and the effectiveness of the proposed autostereoscopic display system is verified by the experimental results.

Compact full-color augmented reality near-eye display using freeform optics and a holographic optical combiner.

We develop a compact full-color augmented reality near-eye display system with a multicolor holographic optical combiner and a freeform relay system. The digital image is produced by a full-color micro organic light-emitting diode (Micro-OLED) display module. The freeform relay system includes four freeform optics and a holographic optical mirror, which are employed to correct both the monochromatic and chromatic aberrations caused by the holographic optical combiner. The two multicolor holographic mirrors have a three-layer laminated structure and are delicately fabricated to yield an improved diffractive efficiency and a reduced efficiency difference for red, green, and blue colors. The high degrees of freedom of freeform optics, and the thin and light nature of the holographic optical combiner yield a compact form factor near-eye display system with a diagonal field of view (FOV) of 20° and the eye-box of 5 mm × 5 mm. Two prototypes are built to demonstrate the feasibility of the proposed display system.

High-performance imaging with an advanced non-imaging lens based on full-path optical diffraction calculation in two-dimensional space.

High-performance image-forming systems often require high system complexity due to the overdetermined nature of optical aberration correction. What we present here is a novel computational imaging modality which can achieve high-performance imaging using a simple non-image-forming optical system. The presented optical system contains an aspherical non-imaging lens which is designed with the optimal transfer of light radiation between an object and a detector. All spatial frequencies of the object collected by the non-imaging lens are delivered to the detector. No image is formed on the detector, and a full-path optical diffraction calculation method is developed to recover a high-quality image of the object from multiple intensity measurements. The effectiveness and high performance of the proposed imaging modality is verified by the examples.

Calculation of aberration fields for freeform imaging systems using field-dependent footprints on local tangent planes.

Aberration theory is a fundamental understanding of the optical aberrations and remains the best way to guide optical system design. The nodal aberration theory, which can be used to describe the aberration fields of freeform imaging systems, is limited by the small field of view (FOV) of the imaging system. In this paper, we propose a method to predict the induced aberration of Fringe Zernike terms with field-dependent footprints. The footprint of each field point is calculated in its corresponding local tangent plane of the optical surface; therefore, a more accurate prediction of the induced aberrations of Fringe Zernike terms can be achieved. Both the FOV and highly tilted architecture of freeform imaging systems are considered when calculating the footprints. Two examples are presented to verify the effectiveness of the proposed method, which we believe can provide good guidance for the design of freeform imaging systems with a relatively large FOV.

Tailoring high-performance illumination lenses for extended non-Lambertian sources.

A key challenge in tailoring compact and high-performance illumination lenses for extended non-Lambertian sources is to take both the étendue and the radiance distribution of an extended non-Lambertian source into account when redirecting the light rays from the source. We develop a direct method to tailor high-performance illumination lenses with prescribed irradiance properties for extended non-Lambertian sources. A relationship between the irradiance distribution on a given observation plane and the radiance distribution of the non-Lambertian source is established. Both edge rays and internal rays emanating from the extended light source are considered in the numerical calculation of lens profiles. Three examples are given to illustrate the effectiveness and characteristics of the proposed method. The results show that the proposed method can yield compact and high-performance illumination systems in both the near field and far field.

Compressive single-pixel hyperspectral imaging using RGB sensors.

Hyperspectral imaging that obtains the spatial-spectral information of a scene has been extensively applied in various fields but usually requires a complex and costly system. A single-pixel detector based hyperspectral system mitigates the complexity problem but simultaneously brings new difficulties on the spectral dispersion device. In this work, we propose a low-cost compressive single-pixel hyperspectral imaging system with RGB sensors. Based on the structured illumination single-pixel imaging configuration, the lens-free system directly captures data by the RGB sensors without dispersion in the spectral dimension. The reconstruction is performed with a pre-trained spatial-spectral dictionary, and the hyperspectral images are obtained through compressive sensing. In addition, the spatial patterns for the structured illumination and the dictionary for the sparse representation are optimized by coherence minimization, which further improve the reconstruction quality. In both spatial and spectral dimensions, the intrinsic sparse properties of the hyperspectral images are made full use of for high sampling efficiency and low reconstruction cost. This work may introduce opportunities for optimization of computational imaging systems and reconstruction algorithms towards high speed, high resolution, and low cost future.

Freeform optical design of beam shaping systems with variable illumination properties.

Freeform optics constitutes a new technology that is currently driving substantial changes in beam shaping. Most of the current beam shaping systems are elaborately tailored for fixed optical properties, which means the output light distribution of a beam shaping system usually cannot be changed. What we present here is a class of beam shaping systems, the optical properties of which can be changed to meet the requirements for different applications. The proposed beam shaping system is composed of a freeform lens and a non-classical zoom system which is designed by ray aiming and the conservation of energy instead of aberration control. The freeform lens includes two elaborately designed freeform optical surfaces, by which both the intensity distribution and wave-front of an incident light beam are manipulated in a desired manner. The light beam after propagating through the non-classical zoom system produces an illumination pattern on a fixed observation plane with a variable pattern size and an unchanged irradiance distribution at different zoom positions. Two design examples are presented to demonstrate the effectiveness of the proposed beam shaping systems.

Improved optical camera communication systems using a freeform lens.

Optical camera communication (OCC) systems, which utilize image sensors embedded in commercial-off-the-shelf devices to detect time and spatial variations in light intensity for enabling data communications, have stirred up researchers' interest. Compared to a direct OCC system whose maximum data rate is strongly determined by the LED source size, a reflected OCC system can break that limitation since the camera captures the light rays reflecting off an observation plane (e.g., a wall) instead of those light rays directly emanated from the light source. However, the low signal-to-noise ratio caused by the non-uniform irradiance distribution produced by LED luminaire on the observation plane in current reflected OCC systems cannot be avoided, hence low complexity and accurate demodulation are hard to achieve. In this paper, we present a FreeOCC system, which employs a dedicatedly tailored freeform lens to precisely control the propagation of modulated light. A desired uniform rectangular illumination is produced on the observation plane by the freeform lens, yielding a uniform grayscale distribution within the received frame captured by the camera in the proposed FreeOCC system. Then, the received signal can be easily demodulated with high accuracy by a simple thresholding scheme. A prototype of the FreeOCC system demonstrates the high performance of the proposed system, and two pulse amplitude modulation schemes (4-order and 8-order) are performed. By using the freeform lens, the packet reception rate is increased by 35% and 32%, respectively; the bit error rate is decreased by 72% and 59%, respectively, at a transmission frequency of 5 kHz. The results clearly show that the FreeOCC system outperforms the common reflected OCC system.

Continuous-zoom bifocal metalens by mutual motion of cascaded bilayer metasurfaces in the visible.

Metalens, a subcategory of metasurfaces, has been widely investigated by virtue of its miniature and ultrathin characteristics as well as versatile functionalities. In this study, a tunable bifocal metalens with two continuous-zoom foci is proposed and numerically verified. This design utilizes two cascaded layers of metasurfaces, and different phase profiles for incidences of opposite helicities are imparted on each layer by the combination of geometric phase and propagation phase. When two layers of metasurfaces are actuated laterally, focal lengths of both foci are tuned continuously, with the difference of both focal lengths increasing or decreasing. Additionally, the zoom range for each focus can be designed at will, and the relative intensity of both foci can be modulated by altering the ellipticity of incidence, with the focusing efficiency of the bifocal metalens varying from 19.8% to 32.7% for numerical apertures in a range from 0.53 to 0.78. The proposed device is anticipated to find applications in multi-plane imaging, optical tomography technique, optical data storage, and so on.

Simultaneous coded aperture and dictionary optimization in compressive spectral imaging via coherence minimization.

Coded aperture snapshot spectral imaging (CASSI) reconstructs a hyperspectral image from several two-dimensional (2D) projections via compressive sensing. The reconstruction quality and the sampling efficiency of CASSI can be effectively improved by decreasing the coherence of the underlying sensing matrix. Efforts have been made to minimize the coherence with individual optimization on coded aperture or sparse basis. In this paper, a simultaneous optimization on the system projection and the over-complete dictionary is introduced to minimize the Frobenius norm coherence. The dual-disperser structure and the RGB image sensor are adopted for the lowest coherence in terms of system configuration. The coded aperture and the dictionary are optimized with genetic algorithm and gradient descent respectively, and simultaneous optimization is conducted iteratively. Low coherence of sensing matrix is acquired after the simultaneous optimization, with both reconstruction quality and sampling efficiency significantly improved. Compared to the non-optimized system and state-of-the-art systems with individually optimized coded aperture or dictionary, the simultaneous optimization promotes the peak signal-to-noise ratio by more than 5dB. The coherence minimization via simultaneous optimization on the system matrix and the sparse representation basis may open opportunities for further development of other compressive-sensing-based computational imaging systems.

Forward imaging neural network with correction of positional misalignment for Fourier ptychographic microscopy.

Fourier ptychographic microscopy (FPM) is a computational imaging technology used to achieve high-resolution imaging with a wide field-of-view. The existing methods of FPM suffer from the positional misalignment in the system, by which the quality of the recovered high-resolution image is determined. In this paper, a forward neural network method with correction of the positional misalignment (FNN-CP) is proposed based on TensorFlow, which consists of two models. Both the spectrum of the sample and four global position factors, which are introduced to describe the positions of the LED elements, are treated as the learnable weights in layers in the first model. By minimizing the loss function in the training process, the positional error can be corrected based on the trained position factors. In order to fit the wavefront aberrations caused by optical components in the FPM system for better recovery results, the second model is designed, in which the spectrum of the sample and coefficients of different Zernike modes are treated as the learnable weights in layers. After the training process of the second model, the wavefront aberration can be fit according to the coefficients of different Zernike modes and the high-resolution complex image can be obtained based on the trained spectrum of the sample. Both the simulation and experiment have been performed to verify the effectiveness of our proposed method. Compared with the state-of-art FPM methods based on forward neural network, FNN-CP can achieve the best reconstruction results.

Design of freeform lenses for illuminating hard-to-reach areas through a light-guiding system.

Designing freeform optics for illuminating hard-to-reach areas is a challenging and rewarding issue. The current designs of freeform illumination optics are mostly valid in the applications in which the region of interest is easily accessible. What we present here is a general formulation of designing freeform lenses for illuminating hard-to-reach areas. In this method, the freeform lens consists of two elaborately designed surfaces, by which both the intensity distribution and wave-front of the light beam are manipulated in a desired manner. The light beam after refraction by the freeform lens is further guided through a light-guiding system to produce a prescribed illumination on a target plane which is inaccessible. The properties of the light-guiding system are taken into account in the tailoring of the freeform lens profiles to guarantee the prescribed illumination on the target plane. Two examples are presented to demonstrate the elegance of this method in designing freeform optics for illuminating hard-to-reach areas.

Tunable beam splitter using bilayer geometric metasurfaces in the visible spectrum.

Metasurfaces have been widely investigated for their capabilities of manipulating wavefront versatilely and miniaturizing traditional optical elements into ultrathin devices. In this study, a nanoscale tunable beam splitter utilizing a bilayer of geometric metasurfaces in the visible spectrum is proposed and numerically examined. Inspired by the diffractive Alvarez lens and multilayer geometric metasurfaces, opposite quadratic phase distributions are imparted on both layers, and a varying linear phase gradient will arise through relatively lateral displacement between two layers, generating tunable angles of deflection. In addition, such geometric metasurfaces offer opposite directions of phase gradients for orthogonal circularly polarized incidences, leading to effective polarization beam splitting. Results prove that the splitting angles can be tuned precisely, and the energy split ratio can be effectively changed according to the ellipticity of the polarized incidence. This design could find significant applications in optical communication, measurement, display, and so on.

Light-field-depth-estimation network based on epipolar geometry and image segmentation.

In this paper, we propose a convolutional neural network based on epipolar geometry and image segmentation for light-field depth estimation. Epipolar geometry is utilized to estimate the initial disparity map. Multi-orientation epipolar images are selected as input data, and the convolutional blocks are adopted based on the disparity of different-direction epipolar images. Image segmentation is used to obtain the edge information of the central sub-aperture image. By concatenating the output of the two parts, an accurate depth map could be generated with fast speed. Our method achieves a high rank on most quality assessment metrics in the HCI 4D Light Field Benchmark and also shows effectiveness in estimating accurate depth on real-world light-field images.

Generation of propagation-invariant and intensity-controlled dark hollow beams by a refractive beam shaping system.

Dark hollow beams (DHBs) have great potential in the applications of optical manipulation, and the generation of DHBs is still a challenging and rewarding issue. In this paper, we present a beam shaping system for generating DHBs. The proposed system is composed of a freeform lens array and a non-classical zoom system which has a constant focal length but various image locations. The DHBs with a well-controlled intensity profile generated by the proposed system is not sensitive to the change of the intensity distribution of the incident beam, which allows flexible choices of light sources. Moreover, the annular pattern produced by the DHB remains unchanged when the image plane is moved a long distance of 17mm, and the energy efficiency of the beam shaping system is greater than 90% when Fresnel loss is considered. The proposed beam shaping system endows the generated DHBs with new properties and may have great potential in the field of optical tweezers and atom guides.

Formulating the design of two freeform lens surfaces for point-like light sources.

Two freeform surfaces provide more degrees of freedom in designing illumination optics and can yield a better solution. The existing methods for point-like sources are mostly valid in designing one freeform surface. Designing two freeform surfaces for point-like sources still remains a challenging issue. In this Letter, we develop a general formulation of designing two freeform lens surfaces for point-like sources. The proposed method is very robust in designing freeform lenses with two elaborately designed surfaces. The examples clearly show that using two freeform surfaces yields better solutions to challenging illumination problems with ultra-high energy efficiency.