Perspective clipping and fast rendering of light field images for holographic stereograms using RGBD data.

The production of holographic stereogram (HS) requires a huge amount of light field data. How to efficiently clip and render these image data remains a challenge in the field. This work focuses on the perspective clipping and fast rendering algorithm for light field images using RGBD data without explicit 3D reconstruction. The RGBD data is expanded to RGBDθ data by introducing a light cone for each point, which gives a new degree of freedom for light field image rendering. Using the light cone and perspective coherence, the visibility of 3D image points can be clipped programmatically. Optical imaging effects including mirror imaging and half mirror imaging effects of 3D images can also be rendered with the help of light cones during the light field rendering process. The perspective coherence is also used to accelerate the rendering, which has been shown to be on average 168% faster than traditional DIBR algorithms. A homemade holographic printing system was developed to make the HSs using the rendered light field images. The vivid 3D effects of the HS have validated the effectiveness of the proposed method. It can also be used in holographic dynamic 3D display, augmented reality, virtual reality, and other fields.

Simplified retinal 3D projection rendering method and system.

A simplified rendering method and system for retinal 3D projection using view and depth information is proposed and demonstrated. Instead of vertex calculations, image-based techniques, including sub-image shifting, image fusion, and hole filling, combined with the depth information, are used to render the multi-view images in a display space with specific discrete depth coordinates. A set of time-division multiplexing retinal 3D projection systems with dense viewpoints is built. A near-eye display of a 3D scene with complex occlusion relationships is realized using the rendering method and system. The eye box of the retinal projection system is enlarged, and the accommodation response of the eyes is evoked at the same time, which improves the visual experience. Rendering tests are carried out using simple and complex models, which proves the effectiveness of this method. Comparative experiments prove that the proposed retinal projection method can obtain high-performance 3D images comparable to the super multi-view display method while simplifying the rendering process. Additionally, the depth of field of the experimental system can cover most of the vergence accommodation conflict sensitive range of the human eye.

Fast rendering and display of light field images with a controllable lighting mechanism.

A fast light field (LF) image rendering method with controllable lighting mechanism is proposed and demonstrated. It solves the issue that previous image-based methods could not render and edit lighting effects for LF images. In contrast to previous methods, light cones and normal maps are defined and used to expand the RGBD images into RGBDNθ data, which gives more degrees of freedom to render LF images. Conjugate cameras are used to capture the RGBDN data, which simultaneously solve the pseudoscopic imaging problem. Perspective coherence is used to accelerate the RGBDNθ-based LF rendering process, which has been shown to be on average 30 times faster than the traditional per-viewpoint rendering (PVR) method. Vivid three-dimensional (3D) images with Lambertian reflection and non-Lambertian reflection effects including specular lighting and compound lighting have been reconstructed in 3D space using a homemade LF display system. The proposed method injects more flexibility into the rendering of LF images and can also be used in holographic display, augmented reality, virtual reality, and other fields.

Augmented reality display system using modulated moiré imaging technique.

To enhance the depth rendering ability of augmented reality (AR) display systems, a modulated moiré imaging technique is used to render the true three-dimensional (3D) images for AR display systems. 3D images with continuous depth information and large depth of field are rendered and superimposed on the real scene. The proposed AR system consists of a modulated moiré imaging subsystem and an optical combiner. The modulated moiré imaging subsystem employs modulated point light sources, a display device, and a microlens array to generate 3D images. A defocussing equal period moiré imaging structure is used, which gives a chance for the point light sources to modulate the depth position of 3D images continuously. The principles of the imaging system are deduced analytically. A custom-designed transparent off-axis spherical reflective lens is used as an optical combiner to project the 3D images into the real world. An experimental AR system that provides continuous 3D images with depth information ranging from 0.5 to 2.5 m is made to verify the feasibility of the proposed technique.

Enhancing integral imaging performance using time-multiplexed convergent backlight.

A method to enhance the performance of an integral imaging system is demonstrated using the time-multiplexed convergent backlight technique. The backlight increases the space bandwidth of the integral imaging system. As a result, the resolution, depth of field, and viewing angle of the integral imaging system are increased simultaneously. The cross-talk noise is also decreased without using any optical barrier. One part of the added space bandwidth comes from the optimized illumination. The other part is converted from the time bandwidth of the system by time-multiplexing. The time-multiplexed convergent backlight modulates the direction of the backlight in time sequence to illuminate the elemental images. Then, the elemental images synthesize the 3D images using a microlens array. An elemental images rendering method using a conjugate pinhole camera and pinhole projector model is designed to dynamically match the illumination direction. The rendering method eliminates the distortion and maximizes the viewing angle and viewing zone. A field programmable gate array (FPGA)-based controller is used to manage and synchronize the time sequence of the backlight and the display devices. Using this technique, high-performance 3D images are realized. Comparison experiments of the integral imaging system using diffused backlight and convergent backlight are performed. The results show the effectiveness of the proposed technique.

Bandwidth-enhanced depth priority integral imaging using a band-limited diffusing illumination technique.

The display bandwidth and display mechanism determine the performance of the three-dimensional (3D) display system. In this paper, a bandwidth-enhanced depth priority integral imaging (DPII) technique is proposed. Information transmission efficiency (ITE) defined as the output display bandwidth divided by the input display bandwidth is used to assess the II system. By analyzing the ITE, we find that only a part of the input display bandwidth is used efficiently to present the 3D image in the traditional DPII system. The DPII system sacrifices the ITE for depth enhancement. The low ITE that fundamentally limits the 3D performance of the DPII system is ascribed to the diffusing illumination mechanism of the display system. To enhance the 3D performance, a collimated illumination DPII system as a special case of band-limited diffusing illumination technique has been proposed and demonstrated first. The bandwidth and ITE of such a DPII system are increased. The depth of field (DOF) of the system is doubled. The resolution of the 3D image is increased to the level of the resolution priority II system without sacrificing the viewing angle. A more general case, band-limited illumination DPII system is also demonstrated. By modulating the divergence angle of the illumination system, the 3D image's resolution and DOF can be controlled. The bandwidth and ITE of the DPII system using band-limited illumination are also higher than that of the traditional DPII system. Experiments are presented to prove the bandwidth-enhanced mechanism of the DPII system.

Improved Intracellular Delivery of Polyarginine Peptides with Cargoes.

Complementary to endocytosis, cell-penetrating peptides (CPPs) at high concentrations can penetrate the cell membrane in a direct way, which further makes CPPs popular candidates for delivering therapeutic or diagnostic agents. Although featured as rapid uptake, the translocation efficiency and potential toxicity of the direct penetration are usually affected by cargoes, which is still unclear. Here, using coarse-grained molecular dynamics simulations, we show that the polyarginine (R8) peptides penetrate the membrane through a water pore in the membrane, and the transmembrane efficiency is improved by conjugating to small nanoparticles (NPs) with proper linkers. It can be attributed to both the extension of the lifetime of the water pore by the NPs and outward diffusion of negative lipids in the asymmetry membrane, which induces the surrounding R8-NP conjugates to the water pore before it is closed. The translocation efficiency is closely related to the length of the linkers, and it gets the maximum value when the length of the linkers is around half of the membrane thickness. Overlong linkers not only decrease the transmembrane efficiency because of the blockage of NPs in the water pore but may also cause cytotoxicity because of the unclosed water pore. The results provide insights into the internalization of CPPs and facilitate the design of CPP and drug conjugates with high efficiency and low toxicity.

Twin imaging phenomenon of integral imaging.

The imaging principles and phenomena of integral imaging technique have been studied in detail using geometrical optics, wave optics, or light filed theory. However, most of the conclusions are only suit for the integral imaging systems using diffused illumination. In this work, a kind of twin imaging phenomenon and mechanism has been observed in a non-diffused illumination reflective integral imaging system. Interactive twin images including a real and a virtual 3D image of one object can be activated in the system. The imaging phenomenon is similar to the conjugate imaging effect of hologram, but it base on the refraction and reflection instead of diffraction. The imaging characteristics and mechanisms different from traditional integral imaging are deduced analytically. Thin film integral imaging systems with 80µm thickness have also been made to verify the imaging phenomenon. Vivid lighting interactive twin 3D images have been realized using a light-emitting diode (LED) light source. When the LED is moving, the twin 3D images are moving synchronously. This interesting phenomenon shows a good application prospect in interactive 3D display, argument reality, and security authentication.

Batch affinity adsorption of His-tagged proteins with EDTA-based chitosan.

Affinity adsorption purification of hexahistidine-tagged (His-tagged) proteins using EDTA-chitosan-based adsorption was designed and carried out. Chitosan was elaborated with ethylenediaminetetraacetic acid (EDTA), and the resulting polymer was characterized by FTIR, TGA, and TEM. Different metals including Ni(2+), Cu(2+), and Zn(2+) were immobilized with EDTA-chitosan, and their capability to the specific adsorption of His-tagged proteins were then investigated. The results showed that Ni(2+)-EDTA-chitosan and Zn(2+)-EDTA-chitosan had high affinity toward the His-tagged proteins, thus isolating them from protein mixture. The target fluorescent-labeled hexahistidine protein remained its fluorescent characteristic throughout the purification procedure when Zn(2+)-EDTA-chitosan was used as a sorbent, wherein the real-time monitor was performed to examine the immigration of fluorescent-labeled His-tagged protein. Comparatively, Zn(2+)-EDTA-chitosan showed more specific binding ability for the target protein, but with less binding capacity. It was further proved that this purification system could be recovered and reused at least for 5 times and could run on large scales. The presented M(2+)-EDTA-chitosan system, with the capability to specifically bind His-tagged proteins, make the purification of His-tagged proteins easy to handle, leaving out fussy preliminary treatment, and with the possibility of continuous processing and a reduction in operational cost in relation to the costs of conventional processes.

Superlens imaging with a surface plasmon polariton cavity in imaging space.

We investigate the ultradeep subwavelength imaging of a superlens with a surface plasmon polariton (SPP) cavity. A silver layer is added in the imaging region of the superlens to form an Ag film lens/photoresist/Ag layer cavity, in which the long-range plasmon mode is drastically suppressed and the field of the imaging is significantly amplified and extended over to the entire imaging region due to the SPP resonance inside the cavity. Results show that much improved quality of image with much suppressed sidelobes and much extended depth of focus can be obtained with the cavity structure when compared with the conventional open structure. This is confirmed by the transfer function of the system, which becomes flatter with the cavity structure. The proposed method provides a novel and practically feasible way to achieve images with both high resolution and large depth of field.

Realization of Glass patterns by a microlens array.

A homogeneous randomly distributed microlens array (MLA) and a corresponding micropattern array are integrated onto a layer of polyester film aiming to give rise to a special dynamic Glass pattern. Integrating an MLA and a micropattern array, and applying a small geometrical transformation, it is possible to show the parallactic or the orthoparallactic motion effect when varying the viewing angle. Both numerical simulation and experimental results are present in this Letter. Such devices can find potential applications in precision optical alignment, image registration, and document security and authentication.

Analysis and fabrication of corner cube array based on laser direct writing technology.

A detailed analysis of corner cube array (CCA) structure is carried out using the commercially available ray-tracing software ZEMAX. The retroreflective properties of CCA for short-range and long-range propagation are compared. An improved CCA structure with a relatively low structural depth (compared with rectangular CCA) is designed and analyzed. Higher retroreflectance (compared with triangular CCA) at a specific incident angle is proved by ray tracing. Two kinds of CCA structures, including the improved CCA, have been fabricated using laser direct writing technology. The fabrication results are qualified by three-dimensional shape measurement and ray tracing.

Rapid fabrication of an electrically switchable liquid crystal Fresnel zone lens.

Based on a nanoimprint technique, a new method is proposed for the rapid fabrication of an electrically switchable liquid crystal Fresnel zone lens (SLCFZL). The flow chart of the proposed fabrication method for a SLCFZL is given and a binary SLCFZL is experimentally demonstrated using the proposed method. The diffraction efficiency of the SLCFZL is continuously tunable through an external electric field, and the driving voltage is relatively low (<15V(rms)). The measured maximal diffraction efficiency reaches ∼35% for a linearly polarized light, which is close to the theoretical value of 40.5%. The focusing and imaging properties of the SLCFZL are also experimentally tested.