Waveguide holography for 3D augmented reality glasses.

Near-eye displays are fundamental technology in the next generation computing platforms for augmented reality and virtual reality. However, there are remaining challenges to deliver immersive and comfortable visual experiences to users, such as compact form factor, solving vergence-accommodation conflict, and achieving a high resolution with a large eyebox. Here we show a compact holographic near-eye display concept that combines the advantages of waveguide displays and holographic displays to overcome the challenges towards true 3D holographic augmented reality glasses. By modeling the coherent light interactions and propagation via the waveguide combiner, we demonstrate controlling the output wavefront using a spatial light modulator located at the input coupler side. The proposed method enables 3D holographic displays via exit-pupil expanding waveguide combiners, providing a large software-steerable eyebox. It also offers additional advantages such as resolution enhancement capability by suppressing phase discontinuities caused by pupil replication process. We build prototypes to verify the concept with experimental results and conclude the paper with discussion.

The impact of comorbid anxiety on quantitative EEG heterogeneity in children with attention-deficit/hyperactivity disorder.

Objective: The objective of this study was to compare quantitative electroencephalography (Q-EEG) characteristics of children with Attention-deficit/hyperactivity disorder (ADHD), taking into account the presence of a comorbidity for anxiety disorder. It also sought to investigate the impact of comorbid anxiety on the Q-EEG heterogeneity of children with ADHD. Method: A total of 141 children with ADHD but without comorbid anxiety (ADHD-Only), 25 children with a comorbidity for anxiety disorder (ADHD-ANX) and 43 children in the control group were assessed. To compare Q-EEG characteristics between groups, we performed ANCOVA (Analysis of Covariance) on relative power and theta/beta ratio (TBR) controlling for covariates such as age, sex, and FSIQ. Relative power values from 19 electrodes were averaged for three regions (frontal, central and posterior). Furthermore, cluster analysis (Ward's method) using the squared Euclidian distance was conducted on participants with ADHD to explore the impact of anxiety on the heterogeneity of Q-EEG characteristics in ADHD. Results: There were no significant group differences in cognitive and behavioral measures. However, significant differences between groups were observed in the theta values in the central region, and the beta values in the frontal, central and posterior regions. In post hoc analyses, It was found that the ADHD-ANX group has significantly higher beta power values than the ADHD-Only group in all regions. For the theta/beta ratio, the ADHD-Only group had significantly higher values than the ADHD-ANX group in frontal, central and posterior regions. However, the control group did not show significant differences compared to both the ADHD-Only and ADHD-ANX group. Through clustering analysis, the participants in the ADHD-Only and ADHD-ANX groups were classified into four clusters. The ratios of children with comorbidities for anxiety disorder within each cluster were significantly different (χ2 = 10.018, p = 0.019). Conclusion: Attention-deficit/hyperactivity disorder children with comorbid anxiety disorder showed lower theta power in the central region, higher beta power in all regions and lower TBR in all regions compared to those without comorbid anxiety disorder. The ratios of children with comorbidities for anxiety disorder within each cluster were significantly different.

Neural compression for hologram images and videos.

Holographic near-eye displays can deliver high-quality three-dimensional (3D) imagery with focus cues. However, the content resolution required to simultaneously support a wide field of view and a sufficiently large eyebox is enormous. The consequent data storage and streaming overheads pose a big challenge for practical virtual and augmented reality (VR/AR) applications. We present a deep-learning-based method for efficiently compressing complex-valued hologram images and videos. We demonstrate superior performance over the conventional image and video codecs.

Foveated near-eye display for mixed reality using liquid crystal photonics.

Foveated near-eye display is one of the most promising approaches to deliver immersive experience of mixed reality. However, it is challenged to conceive a compact optical system. Here, we introduce a method to use polarization optics via liquid crystal photonics to improve the foveated display performance. We demonstrate a benchtop prototype of this idea. We implement and combine two display modules for peripheral and foveal visions. A peripheral display consists of a polarization selective lens (PSL) module, a polarization selective diffuser (PSD), and a slanted projection system. An 80[Formula: see text] diagonal field of view is achieved by on-axis optical configuration of the PSL module and the PSD. A foveal holographic display is composed of a spatial light modulator (SLM), a volume grating lens, and a microelectromechanical system mirror possibly in combination with a switchable polarization selective grating module. The holographic reconstruction using the SLM enables accurate focus cue generation and high resolution above 30 cycles per degree within 15[Formula: see text] by 15[Formula: see text] field of view. We explore and discuss the liquid crystal photonics in the prototype that has a novel optical design using volume gratings with polarization selectivity.

Augmented reality near-eye display using Pancharatnam-Berry phase lenses.

An augmented reality (AR) near-eye display using Pancharatnam-Berry (PB) phase lenses is proposed. PB phase lenses provide different optical effects depending on the polarization state of the incident light. By exploiting this characteristic, it is possible to manufacture an AR combiner with a small form factor and a large numerical aperture value. The AR combiner adopted in the proposed system operates as a convex lens for right-handed circularly polarized light and operates as transparent glass for left-handed circularly polarized light. By merging this combiner with a transparent screen, such as diffuser-holographic optical elements (DHOEs), it is possible to make an AR near-eye display with a small form factor and a wide field of view. In addition, the proposed AR system compensates the chromatic aberration that occurs in PB phase lens by adopting three-layered DHOEs. The operating principle of the proposed system is covered, and its feasibility is verified with experiments and analysis.

Compact noise-filtering volume gratings for holographic displays.

A compact noise filtering method for holographic head-mounted displays (HMDs) is proposed. Conventionally, twin, DC and high-order noise from the spatial light modulators is filtered by a spatial stop filter with a 4-f system. Since the 4-f system requires a long optical path length, the noise filtering system usually occupies most of the volume in holographic displays. In the proposed method, only thin angular stop filters (ASFs) are used for noise filtering. The ASFs do not require a bulky 4-f system while performing the same function as the conventional method. The proposed method is verified experimentally. Our study provides an important solution for realization of compact holographic HMDs.

Dual-focal waveguide see-through near-eye display with polarization-dependent lenses.

A waveguide near-eye display (NED) with a dual-focal plane using a polarization-dependent lens device is proposed. The novel optical device is composed of a geometric phase holographic lens, a wave plate, and a circular polarizer, which is operating as a concave lens or a see-through optical window, depending on the polarization state of the input beam. Such property and ultra-thinness of about 1.5 mm can be applied to a combiner-eyepiece lens for augmented reality. This optical device attached to the waveguide provides two depth planes with polarization multiplexing. We have demonstrated that our proof-of-concept system has image planes at infinity and 20 diopters. The devised system can be expected to offer a better immersive experience, compared to a NED system with a single-focal plane.

Neurofeedback learning for mental practice rather than repetitive practice improves neural pattern consistency and functional network efficiency in the subsequent mental motor execution.

During brain modulation, repeated mental practice may not always result in efficient learning. Particularly, the effectiveness of mental motor practice depends on how well one induces neural activity in a desired state consistently across mental trials, which calls for feedbacks to adjust one's performance. We hypothesized that even a brief experience of neurofeedback learning enhances trial-by-trial neural pattern consistency during subsequent mental motor execution and that this experience would change recruitment of functional connectivity in the motor imagery and default mode networks. To test this hypothesis, we conducted an experiment with two sessions of mental motor practice before and after a neurofeedback training session, in which participants conducted four types of first-person mental motor execution tasks (walking forward, turning left, turning right, and touching a tree). During the neurofeedback training session, in which participants conducted a virtual navigation game, 10 experimental participants received real-time fMRI neuro-feedbacks, while 10 control participants simply repeated the same mental task according to given cues without feedbacks. The experimental group showed significantly higher effects of neuro-feedback training on trial-by-trial consistencies and classification accuracies of activated neural patterns than the control group. Task-performing global node strength and network efficiency were increased in the motor imagery network but decreased in the default mode network only in the experimental group. These results demonstrate that even a brief experience of feedback learning is more effective than simple practice repetitions without evaluation, which was reflected in increased neural pattern consistency and task-dependent functional connectivity during a mental motor execution task.

Dual-dimensional microscopy: real-time in vivo three-dimensional observation method using high-resolution light-field microscopy and light-field display.

Here, we present dual-dimensional microscopy that captures both two-dimensional (2-D) and light-field images of an in-vivo sample simultaneously, synthesizes an upsampled light-field image in real time, and visualizes it with a computational light-field display system in real time. Compared with conventional light-field microscopy, the additional 2-D image greatly enhances the lateral resolution at the native object plane up to the diffraction limit and compensates for the image degradation at the native object plane. The whole process from capturing to displaying is done in real time with the parallel computation algorithm, which enables the observation of the sample's three-dimensional (3-D) movement and direct interaction with the in-vivo sample. We demonstrate a real-time 3-D interactive experiment with Caenorhabditis elegans.

Repellency of zerumbone identified in Cyperus rotundus rhizome and other constituents to Blattella germanica.

The compounds 1,8-cineole and zerumbone (ZER) from the Cyperus rotundus rhizome along with another 11 previously identified rhizome essential oil constituents and α-humulene, which lacks the only carbonyl group present in ZER, as well as binary mixtures of ZER and seven active compounds were tested for repellency to male B. germanica. The results were compared to N,N-diethyl-3-methylbenzamide (deet). In filter-paper choice tests, ZER was the most repellent compound, and α-humulene was ineffective, which indicates that the α,ß-unsaturated carbonyl group of ZER is a prerequisite component for repellency. At 81.5 µg cm-2, enhanced repellency was produced by binary mixtures of ZER and 1,8-cineole, (+)-dihydrocarvone or (R)-(+)-limonene (70:30, 50:50 and 30:70 ratios by weight). These mixtures were very effective against male B. germanica within 24 h and were more repellent than a single compound or deet alone. The optimum ZER content was determined to be more than 50%. In Ebeling choice box tests at 652.4 µg cm-2, these compounds and deet resulted in complete repellency to intact male B. germanica, while they exhibited 35-47% repellency to antennectomized male one. Mixtures formulated from the active constituents of the C. rotundus rhizome could be useful as potential repellents for controlling B. germanica.

Hierarchical Dynamic Causal Modeling of Resting-State fMRI Reveals Longitudinal Changes in Effective Connectivity in the Motor System after Thalamotomy for Essential Tremor.

Thalamotomy at the ventralis intermedius nucleus for essential tremor is known to cause changes in motor circuitry, but how a focal lesion leads to progressive changes in connectivity is not clear. To understand the mechanisms by which thalamotomy exerts enduring effects on motor circuitry, a quantitative analysis of directed or effective connectivity among motor-related areas is required. We characterized changes in effective connectivity of the motor system following thalamotomy using (spectral) dynamic causal modeling (spDCM) for resting-state fMRI. To differentiate long-lasting treatment effects from transient effects, and to identify symptom-related changes in effective connectivity, we subject longitudinal resting-state fMRI data to spDCM, acquired 1 day prior to, and 1 day, 7 days, and 3 months after thalamotomy using a non-cranium-opening MRI-guided focused ultrasound ablation technique. For the group-level (between subject) analysis of longitudinal (between-session) effects, we introduce a multilevel parametric empirical Bayes (PEB) analysis for spDCM. We found remarkably selective and consistent changes in effective connectivity from the ventrolateral nuclei and the supplementary motor area to the contralateral dentate nucleus after thalamotomy, which may be mediated via a polysynaptic thalamic-cortical-cerebellar motor loop. Crucially, changes in effective connectivity predicted changes in clinical motor-symptom scores after thalamotomy. This study speaks to the efficacy of thalamotomy in regulating the dentate nucleus in the context of treating essential tremor. Furthermore, it illustrates the utility of PEB for group-level analysis of dynamic causal modeling in quantifying longitudinal changes in effective connectivity; i.e., measuring long-term plasticity in human subjects non-invasively.

Multivariate Bayesian decoding of single-trial event-related fMRI responses for memory retrieval of voluntary actions.

This study proposes a method for classifying event-related fMRI responses in a specialized setting of many known but few unknown stimuli presented in a rapid event-related design. Compared to block design fMRI signals, classification of the response to a single or a few stimulus trial(s) is not a trivial problem due to contamination by preceding events as well as the low signal-to-noise ratio. To overcome such problems, we proposed a single trial-based classification method of rapid event-related fMRI signals utilizing sparse multivariate Bayesian decoding of spatio-temporal fMRI responses. We applied the proposed method to classification of memory retrieval processes for two different classes of episodic memories: a voluntarily conducted experience and a passive experience induced by watching a video of others' actions. A cross-validation showed higher classification performance of the proposed method compared to that of a support vector machine or of a classifier based on the general linear model. Evaluation of classification performances for one, two, and three stimuli from the same class and a correlation analysis between classification accuracy and target stimulus positions among trials suggest that presenting two target stimuli at longer inter-stimulus intervals is optimal in the design of classification experiments to identify the target stimuli. The proposed method for decoding subject-specific memory retrieval of voluntary behavior using fMRI would be useful in forensic applications in a natural environment, where many known trials can be extracted from a simulation of everyday tasks and few target stimuli from a crime scene.

See-through optical combiner for augmented reality head-mounted display: index-matched anisotropic crystal lens.

A novel see-through optical device to combine the real world and the virtual image is proposed which is called an index-matched anisotropic crystal lens (IMACL). The convex lens made of anisotropic crystal is enveloped with the isotropic material having same refractive index with the extraordinary refractive index of the anisotropic crystal. This optical device functions as the transparent glass or lens according to the polarization state of the incident light. With the novel optical property, IMACL can be utilized in the see-through near eye display, or head-mounted display for augmented reality. The optical property of the proposed optical device is analyzed and aberration by the anisotropic property of the index-matched anisotropic crystal lens is described with the simulation. The concept of the head-mounted display using IMACL is introduced and various optical performances such as field of view, form factor and transmittance are analyzed. The prototype is implemented to verify the proposed system and experimental results show the mixture between the virtual image and real world scene.

Individuality manifests in the dynamic reconfiguration of large-scale brain networks during movie viewing.

Individuality, the uniqueness that distinguishes one person from another, may manifest as diverse rearrangements of functional connectivity during heterogeneous cognitive demands; yet, the neurobiological substrates of individuality, reflected in inter-individual variations of large-scale functional connectivity, have not been fully evidenced. Accordingly, we explored inter-individual variations of functional connectivity dynamics, subnetwork patterns and modular architecture while subjects watched identical video clips designed to induce different arousal levels. How inter-individual variations are manifested in the functional brain networks was examined with respect to four contrasting divisions: edges within the anterior versus posterior part of the brain, edges with versus without corresponding anatomically-defined structural pathways, inter- versus intra-module connections, and rich club edge types. Inter-subject variation in dynamic functional connectivity occurred to a greater degree within edges localized to anterior rather than posterior brain regions, without adhering to structural connectivity, between modules as opposed to within modules, and in weak-tie local edges rather than strong-tie rich-club edges. Arousal level significantly modulates inter-subject variability in functional connectivity, edge patterns, and modularity, and particularly enhances the synchrony of rich-club edges. These results imply that individuality resides in the dynamic reconfiguration of large-scale brain networks in response to a stream of cognitive demands.

Immediate and Longitudinal Alterations of Functional Networks after Thalamotomy in Essential Tremor.

Thalamotomy at the ventralis intermedius nucleus has been an effective treatment method for essential tremor, but how the brain network changes immediately responding to this deliberate lesion and then reorganizes afterwards are not clear. Taking advantage of a non-cranium-opening MRI-guided focused ultrasound ablation technique, we investigated functional network changes due to a focal lesion. To classify the diverse time courses of those network changes with respect to symptom-related long-lasting treatment effects and symptom-unrelated transient effects, we applied graph-theoretic analyses to longitudinal resting-state functional magnetic resonance imaging data before and 1 day, 7 days, and 3 months after thalamotomy with essential tremor. We found reduced average connections among the motor-related areas, reduced connectivity between substantia nigra and external globus pallidum and reduced total connection in the thalamus after thalamotomy, which are all associated with clinical rating scales. The average connectivity among whole brain regions and inter-hemispheric network asymmetry show symptom-unrelated transient increases, indicating temporary reconfiguration of the whole brain network. In summary, thalamotomy regulates interactions over the motor network via symptom-related connectivity changes but accompanies transient, symptom-unrelated diaschisis in the global brain network. This study suggests the significance of longitudinal network analysis, combined with minimal-invasive treatment techniques, in understanding time-dependent diaschisis in the brain network due to a focal lesion.

Signal enhanced holographic fluorescence microscopy with guide-star reconstruction.

We propose a signal enhanced guide-star reconstruction method for holographic fluorescence microscopy. In the late 00's, incoherent digital holography started to be vigorously studied by several groups to overcome the limitations of conventional digital holography. The basic concept of incoherent digital holography is to acquire the complex hologram from incoherent light by utilizing temporal coherency of a spatially incoherent light source. The advent of incoherent digital holography opened new possibility of holographic fluorescence microscopy (HFM), which was difficult to achieve with conventional digital holography. However there has been an important issue of low and noisy signal in HFM which slows down the system speed and degrades the imaging quality. When guide-star reconstruction is adopted, the image reconstruction gives an improved result compared to the conventional propagation reconstruction method. The guide-star reconstruction method gives higher imaging signal-to-noise ratio since the acquired complex point spread function provides optimal system-adaptive information and can restore the signal buried in the noise more efficiently. We present theoretical explanation and simulation as well as experimental results.

Recent progress in see-through three-dimensional displays using holographic optical elements [Invited].

The principles and characteristics of see-through 3D displays are presented. We especially focus on the integral-imaging display system using a holographic optical element (IDHOE), which is able to display 3D images and satisfy the see-through property at the same time. The technique has the advantage of the high transparency and capability of displaying autostereoscopic 3D images. We have analyzed optical properties of IDHOE for both recording and displaying stages. Furthermore, various studies of new applications and system improvements for IDHOE are introduced. Thanks to the characteristics of holographic volume grating, it is possible to implement a full-color lens-array holographic optical element and conjugated reconstruction as well as 2D/3D convertible IDHOE. Studies on the improvements of viewing characteristics including a viewing angle, fill factor, and resolution are also presented. Lastly, essential issues and their possible solutions are discussed as future work.

Viewing angle enhancement of an integral imaging display using Bragg mismatched reconstruction of holographic optical elements.

Holographic-optical-element (HOE)-based integral imaging display can be applied to augmented reality. However, a narrow viewing angle is a bottleneck for commercialization. Here, we propose a method to enhance the viewing angle of the integral imaging display using Bragg mismatched reconstruction of HOEs. The viewing angle of the integral imaging display can be enlarged with two probe waves, which form two different viewing zones. The effect of Bragg mismatched reconstruction is analyzed with simulation and experiment. In order to show feasibility of the proposed method, a display experiment is demonstrated.

Three-dimensional/two-dimensional convertible projection screen using see-through integral imaging based on holographic optical element.

We propose a 3D/2D convertible screen using a holographic optical element and angular multiplexing method of volume hologram. The proposed screen, named a multiplexed holographic optical element screen (MHOES), is composed of passive optical components, and displaying modes between 3D and 2D modes are converted according to projection directions. In a recording process, the angular multiplexing method by using two reference waves with different incidence angles enables the functions of 3D and 2D screens to be recorded in a single holographic material. Also, in order to avoid the bulky experimental setup due to adopting different projectors for the 3D and 2D modes, the projection part is realized based on a prism. The designed projection part enables the single projector to present 3D on 2D mode, where the 3D and 2D contents are simultaneously displayed in one scene, without active components. The optical characteristics of MHOES are experimentally analyzed, and displaying experiments with a full-color MHOES are presented in order to verify the 3D/2D convertibility and see-through properties.

Holographic fluorescence microscopy with incoherent digital holographic adaptive optics.

Introduction of adaptive optics technology into astronomy and ophthalmology has made great contributions in these fields, allowing one to recover images blurred by atmospheric turbulence or aberrations of the eye. Similar adaptive optics improvement in microscopic imaging is also of interest to researchers using various techniques. Current technology of adaptive optics typically contains three key elements: a wavefront sensor, wavefront corrector, and controller. These hardware elements tend to be bulky, expensive, and limited in resolution, involving, for example, lenslet arrays for sensing or multiactuator deformable mirrors for correcting. We have previously introduced an alternate approach based on unique capabilities of digital holography, namely direct access to the phase profile of an optical field and the ability to numerically manipulate the phase profile. We have also demonstrated that direct access and compensation of the phase profile are possible not only with conventional coherent digital holography, but also with a new type of digital holography using incoherent light: selfinterference incoherent digital holography (SIDH). The SIDH generates a complex­i.e., amplitude plus phase­hologram from one or several interferograms acquired with incoherent light, such as LEDs, lamps, sunlight, or fluorescence. The complex point spread function can be measured using guide star illumination and it allows deterministic deconvolution of the full-field image. We present experimental demonstration of aberration compensation in holographic fluorescence microscopy using SIDH. Adaptive optics by SIDH provides new tools for improved cellular fluorescence microscopy through intact tissue layers or other types of aberrant media.