Electrophysiological correlates of sustained conscious perception.

Previous research on the neural correlates of consciousness (NCC) in visual perception revealed an early event-related potential (ERP), the visual awareness negativity (VAN), to be associated with stimulus awareness. However, due to the use of brief stimulus presentations in previous studies, it remains unclear whether awareness-related negativities represent a transient onset-related response or correspond to the duration of a conscious percept. Studies are required that allow prolonged stimulus presentation under aware and unaware conditions. The present ERP study aimed to tackle this challenge by using a novel stimulation design. Male and female human participants (n = 62) performed a visual task while task-irrelevant line stimuli were presented in the background for either 500 or 1000 ms. The line stimuli sometimes contained a face, which needed so-called visual one-shot learning to be seen. Half of the participants were informed about the presence of the face, resulting in faces being perceived by the informed but not by the uninformed participants. Comparing ERPs between the informed and uninformed group revealed an enhanced negativity over occipitotemporal electrodes that persisted for the entire duration of stimulus presentation. Our results suggest that sustained visual awareness negativities (SVAN) are associated with the duration of stimulus presentation.

An edge-simplicity bias in the visual input to young infants.

The development of sparse edge coding in the mammalian visual cortex depends on early visual experience. In humans, there are multiple indicators that the statistics of early visual experiences has unique properties that may support these developments. However, there are no direct measures of the edge statistics of infant daily-life experience. Using head-mounted cameras to capture egocentric images of young infants and adults in the home, we found infant images to have distinct edge statistics relative to adults. For infants, scenes with sparse edge patterns-few edges and few orientations-dominate. The findings implicate biased early input at the scale of daily life that is likely specific to the early months after birth and provide insights into the quality, amount, and timing of the visual experiences during the foundational developmental period for human vision.

Virtual dynamic interaction games reveal impaired multisensory integration in women with migraine.

OBJECTIVE: In this cross-sectional observational study, we aimed to investigate sensory profiles and multisensory integration processes in women with migraine using virtual dynamic interaction systems. BACKGROUND: Compared to studies on unimodal sensory processing, fewer studies show that multisensory integration differs in patients with migraine. Multisensory integration of visual, auditory, verbal, and haptic modalities has not been evaluated in migraine. METHODS: A 12-min virtual dynamic interaction game consisting of four parts was played by the participants. During the game, the participants were exposed to either visual stimuli only or multisensory stimuli in which auditory, verbal, and haptic stimuli were added to the visual stimuli. A total of 78 women participants (28 with migraine without aura and 50 healthy controls) were enrolled in this prospective exploratory study. Patients with migraine and healthy participants who met the inclusion criteria were randomized separately into visual and multisensory groups: Migraine multisensory (14 adults), migraine visual (14 adults), healthy multisensory (25 adults), and healthy visual (25 adults). The Sensory Profile Questionnaire was utilized to assess the participants' sensory profiles. The game scores and survey results were analyzed. RESULTS: In visual stimulus, the gaming performance scores of patients with migraine without aura were similar to the healthy controls, at a median (interquartile range [IQR]) of 81.8 (79.5-85.8) and 80.9 (77.1-84.2) (p = 0.149). Error rate of visual stimulus in patients with migraine without aura were comparable to healthy controls, at a median (IQR) of 0.11 (0.08-0.13) and 0.12 (0.10-0.14), respectively (p = 0,166). In multisensory stimulation, average gaming score was lower in patients with migraine without aura compared to healthy individuals (median [IQR] 82.2 [78.8-86.3] vs. 78.6 [74.0-82.4], p = 0.028). In women with migraine, exposure to new sensory modality upon visual stimuli in the fourth, seventh, and tenth rounds (median [IQR] 78.1 [74.1-82.0], 79.7 [77.2-82.5], 76.5 [70.2-82.1]) exhibited lower game scores compared to visual stimuli only (median [IQR] 82.3 [77.9-87.8], 84.2 [79.7-85.6], 80.8 [79.0-85.7], p = 0.044, p = 0.049, p = 0.016). According to the Sensory Profile Questionnaire results, sensory sensitivity, and sensory avoidance scores of patients with migraine (median [IQR] score 45.5 [41.0-54.7] and 47.0 [41.5-51.7]) were significantly higher than healthy participants (median [IQR] score 39.0 [34.0-44.2] and 40.0 [34.0-48.0], p < 0.001, p = 0.001). CONCLUSION: The virtual dynamic game approach showed for the first time that the gaming performance of patients with migraine without aura was negatively affected by the addition of auditory, verbal, and haptic stimuli onto visual stimuli. Multisensory integration of sensory modalities including haptic stimuli is disturbed even in the interictal period in women with migraine. Virtual games can be employed to assess the impact of sensory problems in the course of the disease. Also, sensory training could be a potential therapy target to improve multisensory processing in migraine.

What Fechner could not do: Separating perceptual encoding and decoding with difference scaling.

A key question in perception research is how stimulus variations translate into perceptual magnitudes, that is, the perceptual encoding process. As experimenters, we cannot probe perceptual magnitudes directly, but infer the encoding process from responses obtained in a psychophysical experiment. The most prominent experimental technique to measure perceptual appearance is matching, where observers adjust a probe stimulus to match a target in its appearance along the dimension of interest. The resulting data quantify the perceived magnitude of the target in physical units of the probe, and are thus an indirect expression of the underlying encoding process. In this paper, we show analytically and in simulation that data from matching tasks do not sufficiently constrain perceptual encoding functions, because there exist an infinite number of pairs of encoding functions that generate the same matching data. We use simulation to demonstrate that maximum likelihood conjoint measurement (Ho, Landy, & Maloney, 2008; Knoblauch & Maloney, 2012) does an excellent job of recovering the shape of ground truth encoding functions from data that were generated with these very functions. Finally, we measure perceptual scales and matching data for White's effect (White, 1979) and show that the matching data can be predicted from the estimated encoding functions, down to individual differences.

The Parameters Governing the Anti-Myopia Efficacy of Chromatically Simulated Myopic Defocus in Tree Shrews.

Purpose: We previously showed that exposing tree shrews (Tupaia belangeri, small diurnal mammals closely related to primates) to chromatically simulated myopic defocus (CSMD) counteracted small-cage myopia and instead induced hyperopia (approximately +4 diopters [D]). Here, we explored the parameters of this effect. Methods: Tree shrews were exposed to the following interventions for 11 days: (1) rearing in closed (n = 7) or open (n = 6) small cages; (2) exposed to a video display of Maltese cross images with CSMD combined with overhead lighting (n = 4); (3) exposed to a video display of Maltese cross images with zero blue contrast ("flat blue," n = 8); and (4) exposed to a video display of black and white grayscale tree images with different spatial filtering (blue pixels lowpass <1 and <2 cycles per degree [CPD]) for the CSMD. Results: (1) Tree shrews kept in closed cages, but not open cages, developed myopia. (2) Overhead illumination reduced the hyperopia induced by CSMD. (3) Zero-blue contrast produced hyperopia but slightly less than the CSMD. (4) Both of the CSMD tree images counteracted small cage myopia, but the one low pass filtering blue <1 CPD was more effective at inducing hyperopia. Conclusions: Any pattern with reduced blue contrast at and below approximately 1 CPD counteracts myopia/promotes hyperopia, but maximal effectiveness may require that the video display be the brightest object in the environment. Translational Relevance: Chromatically simulated myopic blur might be a powerful anti-myopia therapy in children, but the parameter selection could be critical. Issues for translation to humans are discussed.

The resolution of face perception varies systematically across the visual field.

Visual abilities tend to vary predictably across the visual field-for simple low-level stimuli, visibility is better along the horizontal vs. vertical meridian and in the lower vs. upper visual field. In contrast, face perception abilities have been reported to show either distinct or entirely idiosyncratic patterns of variation in peripheral vision, suggesting a dissociation between the spatial properties of low- and higher-level vision. To assess this link more clearly, we extended methods used in low-level vision to develop an acuity test for face perception, measuring the smallest size at which facial gender can be reliably judged in peripheral vision. In 3 experiments, we show the characteristic inversion effect, with better acuity for upright faces than inverted, demonstrating the engagement of high-level face-selective processes in peripheral vision. We also observe a clear advantage for gender acuity on the horizontal vs. vertical meridian and a smaller-but-consistent lower- vs. upper-field advantage. These visual field variations match those of low-level vision, indicating that higher-level face processing abilities either inherit or actively maintain the characteristic patterns of spatial selectivity found in early vision. The commonality of these spatial variations throughout the visual hierarchy means that the location of faces in our visual field systematically influences our perception of them.

Greater utilization of executive functions networks when listening to stories with visual stimulation is related to lower reading abilities in children.

Narrative comprehension relies on basic sensory processing abilities, such as visual and auditory processing, with recent evidence for utilizing executive functions (EF), which are also engaged during reading. EF was previously related to the "supporter" of engaging the auditory and visual modalities in different cognitive tasks, with evidence of lower efficiency in this process among those with reading difficulties in the absence of a visual stimulus (i.e. while listening to stories). The current study aims to fill out the gap related to the level of reliance on these neural circuits while visual aids (pictures) are involved during story listening in relation to reading skills. Functional MRI data were collected from 44 Hebrew-speaking children aged 8-12 years while listening to stories with vs without visual stimuli (i.e., pictures). Functional connectivity of networks supporting reading was defined in each condition and compared between the conditions against behavioral reading measures. Lower reading skills were related to greater functional connectivity values between EF networks (default mode and memory networks), and between the auditory and memory networks for the stories with vs without the visual stimulation. A greater difference in functional connectivity between the conditions was related to lower reading scores. We conclude that lower reading skills in children may be related to a need for greater scaffolding, i.e., visual stimulation such as pictures describing the narratives when listening to stories, which may guide future intervention approaches.

Movement trajectories as a window into the dynamics of emerging neural representations.

The rapid transformation of sensory inputs into meaningful neural representations is critical to adaptive human behaviour. While non-invasive neuroimaging methods are the de-facto method for investigating neural representations, they remain expensive, not widely available, time-consuming, and restrictive. Here we show that movement trajectories can be used to measure emerging neural representations with fine temporal resolution. By combining online computer mouse-tracking and publicly available neuroimaging data via representational similarity analysis (RSA), we show that movement trajectories track the unfolding of stimulus- and category-wise neural representations along key dimensions of the human visual system. We demonstrate that time-resolved representational structures derived from movement trajectories overlap with those derived from M/EEG (albeit delayed) and those derived from fMRI in functionally-relevant brain areas. Our findings highlight the richness of movement trajectories and the power of the RSA framework to reveal and compare their information content, opening new avenues to better understand human perception.

Toward a push-pull strategy against invasive snails using chemical and visual stimuli.

Four invasive Mediterranean snails, i.e., Theba pisana (Müller, 1774), Cernuella virgata (da Costa, 1778), Cochlicella acuta (Müller, 1774) and Cochlicella barbara (Linnaeus, 1758) cost $170 million yearly to the grain industry in Australia. Their impact is mainly due to their estivation behavior: snails climb on cereal and legume stalks to rest during summer, which coincides with harvest, causing grain contamination issues in crops such as wheat, barley and canola. Diverse management methods have been developed to regulate snail populations, with limited success. Our study investigates the potential for a push-pull strategy to divert invasive snails from cultivated fields. A "push" part (i.e. using a repellent stimuli) was based on the use of a chemical deterrent repelling snails from the cultivated field, and a "pull" part (i.e. using an attractive stimuli) was based on offering attractive estivation supports for snails to aggregate outside the cultivated field. First, artificial estivation supports of different colors were tested under laboratory and field conditions and showed that red supports were the most attractive for these snails. Second, different substances were tested as potential snail deterrents (garlic, coffee, coffee grounds, copper). Garlic extracts were the most powerful snail deterrent and were shown to effectively protect an estivation support and food source from snails under laboratory conditions. These results, which were highly consistent for the four species, illustrate the potential of a push-pull strategy against invasive snails in Australia. It is the first attempt to develop a push-pull strategy relying on both visual and chemical stimuli to achieve results, as well as manipulating the estivation behavior of a pest.

Noninvasive Light Flicker Stimulation Promotes Optic Nerve Regeneration by Activating Microglia and Enhancing Neural Plasticity in Zebrafish.

Purpose: Forty-hertz light flicker stimulation has been proven to reduce neurodegeneration, but its effect on optic nerve regeneration is unclear. This study explores the effect of 40-Hz light flicker in promoting optic nerve regeneration in zebrafish and investigates the underlying mechanisms. Methods: Wild-type and mpeg1:EGFP zebrafish were used to establish a model of optic nerve crush. Biocytin tracing and hematoxylin and eosin staining were employed to observe whether 40-Hz light flicker promotes regeneration of retinal ganglion cell axons and dendrites. Optomotor and optokinetic responses were evaluated to assess recovery of visual function. Immunofluorescence staining of mpeg1:EGFP zebrafish was performed to observe changes in microglia. Differentially expressed genes that promote optic nerve regeneration following 40-Hz light flicker stimulation were identified and validated through RNA-sequencing analysis and quantitative real-time PCR (qRT-PCR). Results: Zebrafish exhibited spontaneous optic nerve regeneration after optic nerve injury and restored visual function. We observed that 40-Hz light flicker significantly activated microglia following optic nerve injury and promoted regeneration of retinal ganglion cell axons and dendrites, as well as recovery of visual function. Transcriptomics and qRT-PCR analyses revealed that 40-Hz light flicker increased the expression of genes associated with neuronal plasticity, including bdnf, npas4a, fosab, fosb, egr4, and ier2a. Conclusions: To our knowledge, this study is the first to demonstrate that 40-Hz light flicker stimulation promotes regeneration of retinal ganglion cell axons and dendrites and recovery of visual function in zebrafish, which is associated with microglial activation and enhancement of neural plasticity.

Oculomotor routines for perceptual judgments.

In everyday life we frequently make simple visual judgments about object properties, for example, how big or wide is a certain object? Our goal is to test whether there are also task-specific oculomotor routines that support perceptual judgments, similar to the well-established exploratory routines for haptic perception. In a first study, observers saw different scenes with two objects presented in a photorealistic virtual reality environment. Observers were asked to judge which of two objects was taller or wider while gaze was tracked. All tasks were performed with the same set of virtual objects in the same scenes, so that we can compare spatial characteristics of exploratory gaze behavior to quantify oculomotor routines for each task. Width judgments showed fixations around the center of the objects with larger horizontal spread. In contrast, for height judgments, gaze was shifted toward the top of the objects with larger vertical spread. These results suggest specific strategies in gaze behavior that presumably are used for perceptual judgments. To test the causal link between oculomotor behavior and perception, in a second study, observers could freely gaze at the object or we introduced a gaze-contingent setup forcing observers to fixate specific positions on the object. Discrimination performance was similar between free-gaze and the gaze-contingent conditions for width and height judgments. These results suggest that although gaze is adapted for different tasks, performance seems to be based on a perceptual strategy, independent of potential cues that can be provided by the oculomotor system.

Feature variability determines specificity and transfer in multiorientation feature detection learning.

Historically, in many perceptual learning experiments, only a single stimulus is practiced, and learning is often specific to the trained feature. Our prior work has demonstrated that multi-stimulus learning (e.g., training-plus-exposure procedure) has the potential to achieve generalization. Here, we investigated two important characteristics of multi-stimulus learning, namely, roving and feature variability, and their impacts on multi-stimulus learning and generalization. We adopted a feature detection task in which an oddly oriented target bar differed by 16° from the background bars. The stimulus onset asynchrony threshold between the target and the mask was measured with a staircase procedure. Observers were trained with four target orientation search stimuli, either with a 5° deviation (30°-35°-40°-45°) or with a 45° deviation (30°-75°-120°-165°), and the four reference stimuli were presented in a roving manner. The transfer of learning to the swapped target-background orientations was evaluated after training. We found that multi-stimulus training with a 5° deviation resulted in significant learning improvement, but learning failed to transfer to the swapped target-background orientations. In contrast, training with a 45° deviation slowed learning but produced a significant generalization to swapped orientations. Furthermore, a modified training-plus-exposure procedure, in which observers were trained with four orientation search stimuli with a 5° deviation and simultaneously passively exposed to orientations with high feature variability (45° deviation), led to significant orientation learning generalization. Learning transfer also occurred when the four orientation search stimuli with a 5° deviation were presented in separate blocks. These results help us to specify the condition under which multistimuli learning produces generalization, which holds potential for real-world applications of perceptual learning, such as vision rehabilitation and expert training.

Learning to Choose: Behavioral Dynamics Underlying the Initial Acquisition of Decision-Making.

Current theories of decision-making propose that decisions arise through competition between choice options. Computational models of the decision process estimate how quickly information about choice options is integrated and how much information is needed to trigger a choice. Experiments using this approach typically report data from well-trained participants. As such, we do not know how the decision process evolves as a decision-making task is learned for the first time. To address this gap, we used a behavioral design separating learning the value of choice options from learning to make choices. We trained male rats to respond to single visual stimuli with different reward values. Then, we trained them to make choices between pairs of stimuli. Initially, the rats responded more slowly when presented with choices. However, as they gained experience in making choices, this slowing reduced. Response slowing on choice trials persisted throughout the testing period. We found that it was specifically associated with increased exponential variability when the rats chose the higher value stimulus. Additionally, our analysis using drift diffusion modeling revealed that the rats required less information to make choices over time. These reductions in the decision threshold occurred after just a single session of choice learning. These findings provide new insights into the learning process of decision-making tasks. They suggest that the value of choice options and the ability to make choices are learned separately and that experience plays a crucial role in improving decision-making performance.

Training-induced changes in population receptive field properties in visual cortex: Impact of eccentric vision training on population receptive field properties and the crowding effect.

This study aimed to investigate the impact of eccentric-vision training on population receptive field (pRF) estimates to provide insights into brain plasticity processes driven by practice. Fifteen participants underwent functional magnetic resonance imaging (fMRI) measurements before and after behavioral training on a visual crowding task, where the relative orientation of the opening (gap position: up/down, left/right) in a Landolt C optotype had to be discriminated in the presence of flanking ring stimuli. Drifting checkerboard bar stimuli were used for pRF size estimation in multiple regions of interest (ROIs): dorsal-V1 (dV1), dorsal-V2 (dV2), ventral-V1 (vV1), and ventral-V2 (vV2), including the visual cortex region corresponding to the trained retinal location. pRF estimates in V1 and V2 were obtained along eccentricities from 0.5° to 9°. Statistical analyses revealed a significant decrease of the crowding anisotropy index (p = 0.009) after training, indicating improvement on crowding task performance following training. Notably, pRF sizes at and near the trained location decreased significantly (p = 0.005). Dorsal and ventral V2 exhibited significant pRF size reductions, especially at eccentricities where the training stimuli were presented (p < 0.001). In contrast, no significant changes in pRF estimates were found in either vV1 (p = 0.181) or dV1 (p = 0.055) voxels. These findings suggest that practice on a crowding task can lead to a reduction of pRF sizes in trained visual cortex, particularly in V2, highlighting the plasticity and adaptability of the adult visual system induced by prolonged training.

Continuous psychophysics shows millisecond-scale visual processing delays are faithfully preserved in movement dynamics.

Image differences between the eyes can cause interocular discrepancies in the speed of visual processing. Millisecond-scale differences in visual processing speed can cause dramatic misperceptions of the depth and three-dimensional direction of moving objects. Here, we develop a monocular and binocular continuous target-tracking psychophysics paradigm that can quantify such tiny differences in visual processing speed. Human observers continuously tracked a target undergoing Brownian motion with a range of luminance levels in each eye. Suitable analyses recover the time course of the visuomotor response in each condition, the dependence of visual processing speed on luminance level, and the temporal evolution of processing differences between the eyes. Importantly, using a direct within-observer comparison, we show that continuous target-tracking and traditional forced-choice psychophysical methods provide estimates of interocular delays that agree on average to within a fraction of a millisecond. Thus, visual processing delays are preserved in the movement dynamics of the hand. Finally, we show analytically, and partially confirm experimentally, that differences between the temporal impulse response functions in the two eyes predict how lateral target motion causes misperceptions of motion in depth and associated tracking responses. Because continuous target tracking can accurately recover millisecond-scale differences in visual processing speed and has multiple advantages over traditional psychophysics, it should facilitate the study of temporal processing in the future.

Delineating memory reactivation in sleep with verbal and non-verbal retrieval cues.

Sleep supports memory consolidation via the reactivation of newly formed memory traces. One way to investigate memory reactivation in sleep is by exposing the sleeping brain to auditory retrieval cues; a paradigm known as targeted memory reactivation. To what extent the acoustic properties of memory cues influence the effectiveness of targeted memory reactivation, however, has received limited attention. We addressed this question by exploring how verbal and non-verbal memory cues affect oscillatory activity linked to memory reactivation in sleep. Fifty-one healthy male adults learned to associate visual stimuli with spoken words (verbal cues) and environmental sounds (non-verbal cues). Subsets of the verbal and non-verbal memory cues were then replayed during sleep. The voice of the verbal cues was either matched or mismatched to learning. Memory cues (relative to unheard control cues) prompted an increase in theta/alpha and spindle power, which have been heavily implicated in sleep-associated memory processing. Moreover, verbal memory cues were associated with a stronger increase in spindle power than non-verbal memory cues. There were no significant differences between the matched and mismatched verbal cues. Our findings suggest that verbal memory cues may be most effective for triggering memory reactivation in sleep, as indicated by an amplified spindle response.

A non-canonical visual cortical-entorhinal pathway contributes to spatial navigation.

Visual information is important for accurate spatial coding and memory-guided navigation. As a crucial area for spatial cognition, the medial entorhinal cortex (MEC) harbors diverse spatially tuned cells and functions as the major gateway relaying sensory inputs to the hippocampus containing place cells. However, how visual information enters the MEC has not been fully understood. Here, we identify a pathway originating in the secondary visual cortex (V2) and directly targeting MEC layer 5a (L5a). L5a neurons served as a network hub for visual processing in the MEC by routing visual inputs from multiple V2 areas to other local neurons and hippocampal CA1. Interrupting this pathway severely impaired visual stimulus-evoked neural activity in the MEC and performance of mice in navigation tasks. These observations reveal a visual cortical-entorhinal pathway highlighting the role of MEC L5a in sensory information transmission, a function typically attributed to MEC superficial layers before.

Brain2GAN: Feature-disentangled neural encoding and decoding of visual perception in the primate brain.

A challenging goal of neural coding is to characterize the neural representations underlying visual perception. To this end, multi-unit activity (MUA) of macaque visual cortex was recorded in a passive fixation task upon presentation of faces and natural images. We analyzed the relationship between MUA and latent representations of state-of-the-art deep generative models, including the conventional and feature-disentangled representations of generative adversarial networks (GANs) (i.e., z- and w-latents of StyleGAN, respectively) and language-contrastive representations of latent diffusion networks (i.e., CLIP-latents of Stable Diffusion). A mass univariate neural encoding analysis of the latent representations showed that feature-disentangled w representations outperform both z and CLIP representations in explaining neural responses. Further, w-latent features were found to be positioned at the higher end of the complexity gradient which indicates that they capture visual information relevant to high-level neural activity. Subsequently, a multivariate neural decoding analysis of the feature-disentangled representations resulted in state-of-the-art spatiotemporal reconstructions of visual perception. Taken together, our results not only highlight the important role of feature-disentanglement in shaping high-level neural representations underlying visual perception but also serve as an important benchmark for the future of neural coding.

Color constancy mechanisms in virtual reality environments.

Prior research has demonstrated high levels of color constancy in real-world scenarios featuring single light sources, extensive fields of view, and prolonged adaptation periods. However, exploring the specific cues humans rely on becomes challenging, if not unfeasible, with actual objects and lighting conditions. To circumvent these obstacles, we employed virtual reality technology to craft immersive, realistic settings that can be manipulated in real time. We designed forest and office scenes illuminated by five colors. Participants selected a test object most resembling a previously shown achromatic reference. To study color constancy mechanisms, we modified scenes to neutralize three contributors: local surround (placing a uniform-colored leaf under test objects), maximum flux (keeping the brightest object constant), and spatial mean (maintaining a neutral average light reflectance), employing two methods for the latter: changing object reflectances or introducing new elements. We found that color constancy was high in conditions with all cues present, aligning with past research. However, removing individual cues led to varied impacts on constancy. Local surrounds significantly reduced performance, especially under green illumination, showing strong interaction between greenish light and rose-colored contexts. In contrast, the maximum flux mechanism barely affected performance, challenging assumptions used in white balancing algorithms. The spatial mean experiment showed disparate effects: Adding objects slightly impacted performance, while changing reflectances nearly eliminated constancy, suggesting human color constancy relies more on scene interpretation than pixel-based calculations.