Webcam eye tracking close to laboratory standards: Comparing a new webcam-based system and the EyeLink 1000.

This paper aims to compare a new webcam-based eye-tracking system, integrated into the Labvanced platform for online experiments, to a "gold standard" lab-based eye tracker (EyeLink 1000 - SR Research). Specifically, we simultaneously recorded data with both eye trackers in five different tasks, analyzing their real-time performance. These tasks were a subset of a standardized test battery for eye trackers, including a Large Grid task, Smooth Pursuit eye movements, viewing natural images, and two Head Movements tasks (roll, yaw). The results show that the webcam-based system achieved an overall accuracy of 1.4°, and a precision of 1.1° (standard deviation (SD) across subjects), an error of about 0.5° larger than the EyeLink system. Interestingly, both accuracy (1.3°) and precision (0.9°) were slightly better for centrally presented targets, the region of interest in many psychophysical experiments. Remarkably, the correlation of raw gaze samples between the EyeLink and webcam-based was at about 90% for the Large Grid task and about 80% for Free View and Smooth Pursuit. Overall, these results put the performance of the webcam-based system roughly on par with mobile eye-tracking devices (Ehinger et al. PeerJ, 7, e7086, 2019; Tonsen et al., 2020) and demonstrate substantial improvement compared to existing webcam eye-tracking solutions (Papoutsaki et al., 2017).

Probing neural networks for dynamic switches of communication pathways.

Dynamic communication and routing play important roles in the human brain in order to facilitate flexibility in task solving and thought processes. Here, we present a network perturbation methodology that allows investigating dynamic switching between different network pathways based on phase offsets between two external oscillatory drivers. We apply this method in a computational model of the human connectome with delay-coupled neural masses. To analyze dynamic switching of pathways, we define four new metrics that measure dynamic network response properties for pairs of stimulated nodes. Evaluating these metrics for all network pathways, we found a broad spectrum of pathways with distinct dynamic properties and switching behaviors. We show that network pathways can have characteristic timescales and thus specific preferences for the phase lag between the regions they connect. Specifically, we identified pairs of network nodes whose connecting paths can either be (1) insensitive to the phase relationship between the node pair, (2) turned on and off via changes in the phase relationship between the node pair, or (3) switched between via changes in the phase relationship between the node pair. Regarding the latter, we found that 33% of node pairs can switch their communication from one pathway to another depending on their phase offsets. This reveals a potential mechanistic role that phase offsets and coupling delays might play for the dynamic information routing via communication pathways in the brain.

Neuronal Oscillations Indicate Sleep-dependent Changes in the Cortical Memory Trace.

Sleep promotes the consolidation of newly acquired associative memories. Here we used neuronal oscillations in the human EEG to investigate sleep-dependent changes in the cortical memory trace. The retrieval activity for object-color associations was assessed immediately after encoding and after 3 hr of sleep or wakefulness. Sleep had beneficial effects on memory performance and led to reduced event-related theta and gamma power during the retrieval of associative memories. Furthermore, event-related alpha suppression was attenuated in the wake group for memorized and novel stimuli. There were no sleep-dependent changes in retrieval activity for missed items or items retrieved without color. Thus, the sleep-dependent reduction in theta and gamma oscillations was specific for the retrieval of associative memories. In line with theoretical accounts on sleep-dependent memory consolidation, decreased theta may indicate reduced mediotemporal activity because of a transfer of information into neocortical networks during sleep, whereas reduced parietal gamma may reflect effects of synaptic downscaling. Changes in alpha suppression in the wake group possibly index reduced attentional resources that may also contribute to a lower memory performance in this group. These findings indicate that the consolidation of associative memories during sleep is associated with profound changes in the cortical memory trace and relies on multiple neuronal processes working in concert.

Modeling of Large-Scale Functional Brain Networks Based on Structural Connectivity from DTI: Comparison with EEG Derived Phase Coupling Networks and Evaluation of Alternative Methods along the Modeling Path.

In this study, we investigate if phase-locking of fast oscillatory activity relies on the anatomical skeleton and if simple computational models informed by structural connectivity can help further to explain missing links in the structure-function relationship. We use diffusion tensor imaging data and alpha band-limited EEG signal recorded in a group of healthy individuals. Our results show that about 23.4% of the variance in empirical networks of resting-state functional connectivity is explained by the underlying white matter architecture. Simulating functional connectivity using a simple computational model based on the structural connectivity can increase the match to 45.4%. In a second step, we use our modeling framework to explore several technical alternatives along the modeling path. First, we find that an augmentation of homotopic connections in the structural connectivity matrix improves the link to functional connectivity while a correction for fiber distance slightly decreases the performance of the model. Second, a more complex computational model based on Kuramoto oscillators leads to a slight improvement of the model fit. Third, we show that the comparison of modeled and empirical functional connectivity at source level is much more specific for the underlying structural connectivity. However, different source reconstruction algorithms gave comparable results. Of note, as the fourth finding, the model fit was much better if zero-phase lag components were preserved in the empirical functional connectome, indicating a considerable amount of functionally relevant synchrony taking place with near zero or zero-phase lag. The combination of the best performing alternatives at each stage in the pipeline results in a model that explains 54.4% of the variance in the empirical EEG functional connectivity. Our study shows that large-scale brain circuits of fast neural network synchrony strongly rely upon the structural connectome and simple computational models of neural activity can explain missing links in the structure-function relationship.

Theta-gamma coupling binds visual perceptual features in an associative memory task.

It is an integral function of the human brain to sample novel information from the environment and to integrate them into existing representations. Recent evidence suggests a specific role for the theta rhythm (4-8 Hz) in mnemonic processes and the coupling between the theta and the gamma rhythm (40-120 Hz) in ordering and binding perceptual features during encoding. Furthermore, decreases in the alpha rhythm (8-12 Hz) are assumed to gate perceptual information processes in semantic networks. In the present study, we used an associative memory task (object-color combinations) with pictures versus words as stimuli (high versus low visual information) to separate associative memory from visual perceptual processes during memory formation. We found increased theta power for later remembered versus later forgotten items (independent of the color judgement) and an increase in phase-amplitude coupling between frontal theta and fronto-temporal gamma oscillations, specific for the formation of picture-color associations. Furthermore, parietal alpha suppression and gamma power were higher for pictures compared to words. These findings support the idea of a theta-gamma code in binding visual perceptual features during encoding. Furthermore, alpha suppression likely reflects perceptual gating processes in semantic networks and is insensitive to mnemonic and associative binding processes. Gamma oscillations may promote visual perceptual information in visual cortical networks, which is integrated into existing representations by prefrontal control processes, working at a theta pace.

Bayesian Alternation during Tactile Augmentation.

A large number of studies suggest that the integration of multisensory signals by humans is well-described by Bayesian principles. However, there are very few reports about cue combination between a native and an augmented sense. In particular, we asked the question whether adult participants are able to integrate an augmented sensory cue with existing native sensory information. Hence for the purpose of this study, we build a tactile augmentation device. Consequently, we compared different hypotheses of how untrained adult participants combine information from a native and an augmented sense. In a two-interval forced choice (2 IFC) task, while subjects were blindfolded and seated on a rotating platform, our sensory augmentation device translated information on whole body yaw rotation to tactile stimulation. Three conditions were realized: tactile stimulation only (augmented condition), rotation only (native condition), and both augmented and native information (bimodal condition). Participants had to choose one out of two consecutive rotations with higher angular rotation. For the analysis, we fitted the participants' responses with a probit model and calculated the just notable difference (JND). Then, we compared several models for predicting bimodal from unimodal responses. An objective Bayesian alternation model yielded a better prediction (χred2 = 1.67) than the Bayesian integration model (χred2 = 4.34). Slightly higher accuracy showed a non-Bayesian winner takes all (WTA) model (χred2 = 1.64), which either used only native or only augmented values per subject for prediction. However, the performance of the Bayesian alternation model could be substantially improved (χred2 = 1.09) utilizing subjective weights obtained by a questionnaire. As a result, the subjective Bayesian alternation model predicted bimodal performance most accurately among all tested models. These results suggest that information from augmented and existing sensory modalities in untrained humans is combined via a subjective Bayesian alternation process. Therefore, we conclude that behavior in our bimodal condition is explained better by top down-subjective weighting than by bottom-up weighting based upon objective cue reliability.

Phase synchrony facilitates binding and segmentation of natural images in a coupled neural oscillator network.

Synchronization has been suggested as a mechanism of binding distributed feature representations facilitating segmentation of visual stimuli. Here we investigate this concept based on unsupervised learning using natural visual stimuli. We simulate dual-variable neural oscillators with separate activation and phase variables. The binding of a set of neurons is coded by synchronized phase variables. The network of tangential synchronizing connections learned from the induced activations exhibits small-world properties and allows binding even over larger distances. We evaluate the resulting dynamic phase maps using segmentation masks labeled by human experts. Our simulation results show a continuously increasing phase synchrony between neurons within the labeled segmentation masks. The evaluation of the network dynamics shows that the synchrony between network nodes establishes a relational coding of the natural image inputs. This demonstrates that the concept of binding by synchrony is applicable in the context of unsupervised learning using natural visual stimuli.