Glaucoma screening using an attention-guided stereo ensemble network.

Glaucoma is a chronic eye disease, which causes gradual vision loss and eventually blindness. Accurate glaucoma screening at early stage is critical to mitigate its aggravation. Extracting high-quality features are critical in training of classification models. In this paper, we propose a deep ensemble network with attention mechanism that detects glaucoma using optic nerve head stereo images. The network consists of two main sub-components, a deep Convolutional Neural Network that obtains global information and an Attention-Guided Network that localizes optic disc while maintaining beneficial information from other image regions. Both images in a stereo pair are fed into these sub-components, the outputs are fused together to generate the final prediction result. Abundant image features from different views and regions are being extracted, providing compensation when one of the stereo images is of poor quality. The attention-based localization method is trained in a weakly-supervised manner and only image-level annotation is required, which avoids expensive segmentation labelling. Results from real patient images show that our approach increases recall (sensitivity) from the state-of-the-art 88.89% to 95.48%, while maintaining precision and performance stability. The marked reduction in false-negative rate can significantly enhance the chance of successful early diagnosis of glaucoma.

A Review of Machine Learning for Near-Infrared Spectroscopy.

The analysis of infrared spectroscopy of substances is a non-invasive measurement technique that can be used in analytics. Although the main objective of this study is to provide a review of machine learning (ML) algorithms that have been reported for analyzing near-infrared (NIR) spectroscopy from traditional machine learning methods to deep network architectures, we also provide different NIR measurement modes, instruments, signal preprocessing methods, etc. Firstly, four different measurement modes available in NIR are reviewed, different types of NIR instruments are compared, and a summary of NIR data analysis methods is provided. Secondly, the public NIR spectroscopy datasets are briefly discussed, with links provided. Thirdly, the widely used data preprocessing and feature selection algorithms that have been reported for NIR spectroscopy are presented. Then, the majority of the traditional machine learning methods and deep network architectures that are commonly employed are covered. Finally, we conclude that developing the integration of a variety of machine learning algorithms in an efficient and lightweight manner is a significant future research direction.

Full-color retinal-projection near-eye display using a multiplexing-encoding holographic method.

We propose a novel method to construct an optical see-through retinal-projection near-eye display using the Maxwellian view and a holographic method. To provide a dynamic full-color virtual image, a single phase-only spatial light modulator (SLM) was employed in conjunction with a multiplexing-encoding holographic method. Holographic virtual images can be directly projected onto the retina using an optical see-through eyepiece. The virtual image is sufficiently clear when the crystal lens can focus at different depths; the presented method can resolve convergence and accommodation conflict during the use of near-eye displays. To verify the proposed method, a proof-of-concept prototype was developed to provide vivid virtual images alongside real-world ones.

Time-domain photoacoustic waveform analysis for glucose measurement.

Photoacoustic (PA) effect is the product of light-ultrasound interactions and its time-domain waveform contains rich information. Besides optical absorption, the PA waveform inherently consists of other mechanical and thermal properties of the sample. They also have correlation with the target composition but have not been utilized in conventional PA spectroscopy. In this article, we propose a new concept named time-domain photoacoustic waveform spectroscopy (tPAWS) for chemical component quantification. It employs multiple variables inherently contained in the PA waveform excited by a single wavelength laser to extract informative features. The demonstration of glucose measurement in human blood serum (HBS) shows superior sensitivity and accuracy enhancement, compared to conventional amplitude-based PA measurement and NIR spectroscopy. Thanks to the sensitivity and accuracy of tPAWS, multiple wavelength sources and complex instrumentation used in conventional spectroscopic sensing methods can be avoided. TPAWS, as a novel physics-inspired sensing method, shows great potential for complementing or surpassing the current spectroscopic methods as a new sensing technique for chemical analysis.

Design of a light-field near-eye display using random pinholes.

Light-field near-eye displays can solve the accommodation/convergence conflict problem that can cause severe discomfort to the user. However, in actual systems, convergence depth and accommodation depth may not match each other due to the repeated zones or flipped images produced by traditional light-field methods. Also, Moiré fringes are another problem which is caused by interaction between two periodic structures. We present a method of constructing a light-field near-eye display based on random pinholes, where the random structure is employed as a spatial light modulator to break the periodicity of elemental images. Light-field images for a unique view zone in space without Moiré fringes can be provided. A proof-of-concept prototype has been developed to verify the proposed method.

Noninvasive Electromagnetic Wave Sensing of Glucose.

Diabetic patients need long-term and frequent glucose monitoring to assist in insulin intake. The current finger-prick devices are painful and costly, which places noninvasive glucose sensors in high demand. In this review paper, we list several advanced electromagnetic (EM)-wave-based technologies for noninvasive glucose measurement, including infrared (IR) spectroscopy, photoacoustic (PA) spectroscopy, Raman spectroscopy, fluorescence, optical coherence tomography (OCT), Terahertz (THz) spectroscopy, and microwave sensing. The development of each method is discussed regarding the fundamental principle, system setup, and experimental results. Despite the promising achievements that have been previously reported, no established product has obtained FDA approval or survived a marketing test. The limitations of, and prospects for, these techniques are presented at the end of this review.

Time-multiplexed multi-view three-dimensional display with projector array and steering screen.

A novel time-multiplexed multi-view three-dimensional (3D) display has been implemented using a projector array to provide the image source and an angular steering-screen module to generate multiple high density horizontal views. The liquid crystal (LC)-based steering screen was specially developed to deflect light beams over a small range and operate in synchronism with the projector array with the use of a customized FPGA driver. The prototype produces vivid color 3D scenes with smooth parallax to multiple viewers. The experimental results verify the proposed multi-projection time-multiplexed multi-view 3D display method that uses a steering screen to produce dense views. Displaying both static and dynamic 3D contents is achieved in our implemented 36-view 3D display prototype. The results of crosstalk measurements are given and analyzed to evaluate the display performance.

One-stop measurement model for fast and accurate tensor display characterization.

Many light field displays are fundamentally different from other displays in that they do not have quantized pixels, quantized angular outputs, or a physical screen position, which can make definitions and characterization problematic. We have determined that it is more appropriate to express the spatial resolution in terms of spatial cutoff frequency rather than a physical distance as in the case of a display with actual quantized pixels. This concept is then extended to also encompass angular resolution. The technique exploits the fact that when spatial resolution of a sinusoidal grating pattern is halved, its contrast ratio is reduced by a known proportion. An improved model, based on an earlier design concept, has been developed. It not only can be used to measure spatial and angular cutoff frequencies, but also can enable comprehensive characterization of the display. This model provides fast, simple measurement with good accuracy. It does not use special equipment or require time-consuming subjective evaluations. Using the model to characterize images in a rapid, accurate manner validates the effectiveness of this technique.

Addressable spatial light modulators for eye-tracking autostereoscopic three-dimensional display using a scanning laser.

A scanning laser-based back light three-dimensional (3D) display capable of rendering full-resolution, low crosstalk, and vivid 3D depth perception has been developed by incorporating time-sequential multiplexing and eye-tracking technologies. This system includes three main subsystems: a scanning laser module, a relay transfer unit created by combining multiple transmissive-type electrically addressed ferroelectric liquid crystal spatial light modulators (FLC-SLMs), and a dual-directional transmission screen (DDTS) unit that can produce different angular magnification factors in both the tangential and sagittal planes. The light beam is directed by the DDTS after transmission through FLC-SLMs, and left and right eye viewing zones are produced sequentially in accordance with the locations of clear apertures in the FLC-SLM that are controlled based on data from the eye-tracking system. Owing to the persistence of human vision, 3D images are formed as a result of the high-speed scanning backlight and fast response characteristics of the FLC-SLM. A prototype of the proposed 3D display was designed and built, and experiments were carried out. The experimental results verify the feasibility of the proposed scheme, and full-resolution images with natural 3D perception are demonstrated by the prototype.

Design and assessment of a 360° panoramic and high-performance capture system with two tiled catadioptric imaging channels.

It has always been a challenge to obtain a 360° panoramic imaging system with a high-resolution and non-visible seam. In this study, a 360° panoramic and high-performance system has been developed based on two tiled imaging channels with a field of view of 190° and F/# of 2.0. In this study, some issues regarding 360° panoramic tiled methods, such as relative illuminance and ghost images, were analyzed in detail and taken into consideration during the design procedure. In the final design, the stop has been fulfilled for each field angle, and the ghost images have also been well optimized. A proof-of-concept prototype producing a high-performance 360° panoramic video has been developed.

Electromagnetic⁻Acoustic Sensing for Biomedical Applications.

This paper reviews the theories and applications of electromagnetic⁻acoustic (EMA) techniques (covering light-induced photoacoustic, microwave-induced thermoacoustic, magnetic-modulated thermoacoustic, and X-ray-induced thermoacoustic) belonging to the more general area of electromagnetic (EM) hybrid techniques. The theories cover excitation of high-power EM field (laser, microwave, magnetic field, and X-ray) and subsequent acoustic wave generation. The applications of EMA methods include structural imaging, blood flowmetry, thermometry, dosimetry for radiation therapy, hemoglobin oxygen saturation (SO2) sensing, fingerprint imaging and sensing, glucose sensing, pH sensing, etc. Several other EM-related acoustic methods, including magnetoacoustic, magnetomotive ultrasound, and magnetomotive photoacoustic are also described. It is believed that EMA has great potential in both pre-clinical research and medical practice.

Noninvasive photoacoustic measurement of glucose by data fusion.

We proposed a novel noninvasive method for glucose detection using a photoacoustic (PA) technique utilizing both the peak-to-peak value and peak arrival time delay information. Without increasing apparatus and system complexity, we demonstrated the accuracy enhancement of 29.5% and 33.63% for high (0-7 g dL-1) and low (0-350 mg dL-1) concentration of glucose solution, compared to conventional amplitude-based prediction.

Subpixel area-based evaluation for crosstalk suppression in quasi-three-dimensional displays.

A subpixel area-based evaluation method for an improved slanted lenticular film that minimizes the crosstalk in a quasi-three-dimensional (Q3D) display is proposed in this paper. To identify an optimal slant angle of the film, a subpixel area-based measurement is derived to evaluate the crosstalk among viewing regions of the intended subpixel and adjacent unintended subpixel by taking the real subpixel shape and black matrix into consideration. The subpixel mapping, which corresponds to the optimal slant angle of the film, can then be determined. Meanwhile, the viewing zone characteristics are analyzed to balance the light intensity in both right and left eye channels. A compact and portable Q3D system has been built and appropriate experiments have been applied. The results indicate that significant improvements in both crosstalk and resolution can be obtained with the proposed technique.

Remarkable In Vivo Nonlinear Photoacoustic Imaging Based on Near-Infrared Organic Dyes.

Two near-infrared dyes featuring good dispersion and light-harvesting property present a remarkable nonlinear photoacoustic response in vitro and in vivo comparing with conventional gold nanorods. This study benefits the fabrication of drug delivery platforms with accurate targeting and control effect under photoacoustic image guidance.

Directional view method for a time-sequential autostereoscopic display with full resolution.

A time-sequential autostereoscopic three-dimensional (3D) display using a set of cylindrical optical elements (COEs) as the backlight steering is proposed. The operation principle of the system and its detailed design are described. In our system, the COEs control the direction of the backlight for the proposed system of the user's right and left views. Additionally, the displayed images can be observed under ambient lighting by implementing the high density light-emitting diode (LED) arrays. Compared to the first-generation array display, the image resolution is greatly improved by the addition of the time multiplexing technique. A prototype system using a set of COEs, LED arrays, two linear Fresnel lenses, and an elliptical diffuser is constructed. Here, the directional backlight beams are synchronized with the right and left images alternately displayed on the liquid crystal display (LCD) screen, and two convergent viewing zones are formed alternately in front of the user's eyes; then 3D images are perceived because of persistence of the vision of human eye. The experimental results show that the proposed method is a potential technology for 3D applications such as 3D television.

Large-aperture transparent beam steering screen based on LCMPA.

A large aperture transmissive step-steering screen composed of a liquid crystal microprism array (LCMPA) deflector and a 90° twisted nematic liquid crystal (TN LC) polarization modulator is developed. The designed 3 in. (7.62 cm) device provides a steering angle of 0.95° that differs from the projected value by only 1.26% and the angular difference caused by dispersion is less than 5%. Using two-layer cascaded screens a three-direction beam steering system for stereoscopic displays is achieved with a steering step of 0.95°, undesired residual polarization contrast less than 2%, and high optical uniformity.

Photoacoustic elastic oscillation and characterization.

Photoacoustic imaging and sensing have been studied extensively to probe the optical absorption of biological tissue in multiple scales ranging from large organs to small molecules. However, its elastic oscillation characterization is rarely studied and has been an untapped area to be explored. In literature, photoacoustic signal induced by pulsed laser is commonly modelled as a bipolar "N-shape" pulse from an optical absorber. In this paper, the photoacoustic damped oscillation is predicted and modelled by an equivalent mass-spring system by treating the optical absorber as an elastic oscillator. The photoacoustic simulation incorporating the proposed oscillation model shows better agreement with the measured signal from an elastic phantom, than conventional photoacoustic simulation model. More interestingly, the photoacoustic damping oscillation effect could potentially be a useful characterization approach to evaluate biological tissue's mechanical properties in terms of relaxation time, peak number and ratio beyond optical absorption only, which is experimentally demonstrated in this paper.

Self temperature regulation of photothermal therapy by laser-shared photoacoustic feedback.

This article describes a laser-shared photothermal system that achieves tight temperature regulation by frequency-domain photoacoustic (FD-PA) feedback. To this end, a continuous-wave laser system was designed with arbitrarily modulatable laser intensity. And, by fast alternating in the time domain between a constant laser intensity for photothermal heating and a modulated laser intensity for FD-PA temperature measurement, photothermal temperature variations are captured by FD-PA in real time. A proportional-integral-derivative (PID) controller monitors the feedback from FD-PA measurements and controls photothermal heating dose accordingly, thus stabilizing the temperature at preset values. The proposed system is demonstrated to achieve ultrafast temperature measurement at a 4 kHz rate, and with proper averaging, the measurement and regulation accuracy are 0.75 deg and 0.9 deg respectively.

Fast photoacoustic-guided depth-resolved Raman spectroscopy: a feasibility study.

In this Letter, photoacoustic-guided Raman spectroscopy (PARS) is proposed for a fast depth-resolved Raman measurement with accurate depth localization. The approach was experimentally demonstrated to receive both photoacoustic and Raman signals from a three-layer agar phantom based on a developed synergic photoacoustic-Raman probe, showing strong depth correlation and achieving magnitude of faster operation speed due to photoacoustic time-of-flight measurement and guidance, compared with the conventional depth-resolved Raman spectroscopy method. In addition, further combination with advanced optical-focusing techniques in biological-scattering medium could potentially enable the proposed approach for cancer diagnostics with both tight and fast optical focusing at the desired depth of tumor.

Thermally modulated photoacoustic imaging with super-paramagnetic iron oxide nanoparticles.

Thermally modulated photoacoustic imaging (TMPI) is reported here for contrast enhancement when using nanoparticles as contrast agents. Exploiting the excellent sensitivity of the photoacoustic (PA) process on temperature and the highly selective heating capability of nanoparticles under electromagnetic field, the PA signals stemming from the nanoparticles labeled region can be efficiently modulated whereas those from highly light absorptive backgrounds are minimally affected. A coherent difference imaging procedure reduces the background signal and thus improves the imaging contrast. Phantom experiments with super-paramagnetic iron oxide nanoparticles (SPIONs) as contrast agents and alternating magnetic fields for heating are demonstrated. Further improvements toward clinical applications are also discussed.