Tactile shape discrimination for moving stimuli.

In this study, we explored spatial-temporal dependencies and their impact on the tactile perception of moving objects. Building on previous research linking visual perception and human movement, we examined if an imputed motion mechanism operates within the tactile modality. We focused on how biological coherence between space and time, characteristic of human movement, influences tactile perception. An experiment was designed wherein participants were stimulated on their right palm with tactile patterns, either ambiguous (incongruent conditions) or non-ambiguous (congruent conditions) relative to a biological motion law (two-thirds power law) and asked to report perceived shape and associated confidence. Our findings reveal that introducing ambiguous tactile patterns (1) significantly diminishes tactile discrimination performance, implying motor features of shape recognition in vision are also observed in the tactile modality, and (2) undermines participants' response confidence, uncovering the accessibility degree of information determining the tactile percept's conscious representation. Analysis based on the Hierarchical Drift Diffusion Model unveiled the sensitivity of the evidence accumulation process to the stimulus's informational ambiguity and provides insight into tactile perception as predictive dynamics for reducing uncertainty. These discoveries deepen our understanding of tactile perception mechanisms and underscore the criticality of predictions in sensory information processing.

Individuals vary in their overt attention preference for positive images consistently across time and stimulus types.

What humans look at strongly determines what they see. We show that individual differences in the tendency to look at positive stimuli are stable across time and across contents, establishing gaze positivity preference as a perceptual trait that determines the amount of positively valence stimuli individuals select for visual processing. Furthermore, we show that patients with major depressive disorder exhibit consistently low positivity preference before treatment. In a subset of patients, we also assessed the positivity preference after two months of treatment in which positivity gaze preference increased to levels similar to healthy individuals. We discuss the possible practical diagnostic applications of these findings, as well as how this general gaze-related trait may influence other behavioral and psychological aspects.

Eye blinks as a visual processing stage.

Humans blink their eyes frequently during normal viewing, more often than it seems necessary for keeping the cornea well lubricated. Since the closure of the eyelid disrupts the image on the retina, eye blinks are commonly assumed to be detrimental to visual processing. However, blinks also provide luminance transients rich in spatial information to neural pathways highly sensitive to temporal changes. Here, we report that the luminance modulations from blinks enhance visual sensitivity. By coupling high-resolution eye tracking in human observers with modeling of blink transients and spectral analysis of visual input signals, we show that blinking increases the power of retinal stimulation and that this effect significantly enhances visibility despite the time lost in exposure to the external scene. We further show that, as predicted from the spectral content of input signals, this enhancement is selective for stimuli at low spatial frequencies and occurs irrespective of whether the luminance transients are actively generated or passively experienced. These findings indicate that, like eye movements, blinking acts as a computational component of a visual processing strategy that uses motor behavior to reformat spatial information into the temporal domain.

Figure-ground segmentation based on motion in the archerfish.

Figure-ground segmentation is a fundamental process in visual perception that involves separating visual stimuli into distinct meaningful objects and their surrounding context, thus allowing the brain to interpret and understand complex visual scenes. Mammals exhibit varying figure-ground segmentation capabilities, ranging from primates that can perform well on figure-ground segmentation tasks to rodents that perform poorly. To explore figure-ground segmentation capabilities in teleost fish, we studied how the archerfish, an expert visual hunter, performs figure-ground segmentation. We trained archerfish to discriminate foreground objects from the background, where the figures were defined by motion as well as by discontinuities in intensity and texture. Specifically, the figures were defined by grating, naturalistic texture, and random noise moving in counterphase with the background. The archerfish performed the task well and could distinguish between all three types of figures and grounds. Their performance was comparable to that of primates and outperformed rodents. These findings suggest the existence of a complex visual process in the archerfish visual system that enables the delineation of figures as distinct from backgrounds, and provide insights into object recognition in this animal.

Visual perception of highly memorable images is mediated by a distributed network of ventral visual regions that enable a late memorability response.

Behavioral and neuroscience studies in humans and primates have shown that memorability is an intrinsic property of an image that predicts its strength of encoding into and retrieval from memory. While previous work has independently probed when or where this memorability effect may occur in the human brain, a description of its spatiotemporal dynamics is missing. Here, we used representational similarity analysis (RSA) to combine functional magnetic resonance imaging (fMRI) with source-estimated magnetoencephalography (MEG) to simultaneously measure when and where the human cortex is sensitive to differences in image memorability. Results reveal that visual perception of High Memorable images, compared to Low Memorable images, recruits a set of regions of interest (ROIs) distributed throughout the ventral visual cortex: a late memorability response (from around 300 ms) in early visual cortex (EVC), inferior temporal cortex, lateral occipital cortex, fusiform gyrus, and banks of the superior temporal sulcus. Image memorability magnitude results are represented after high-level feature processing in visual regions and reflected in classical memory regions in the medial temporal lobe (MTL). Our results present, to our knowledge, the first unified spatiotemporal account of visual memorability effect across the human cortex, further supporting the levels-of-processing theory of perception and memory.

Short communication: Binocular rivalry dynamics during locomotion.

Locomotion has been shown to impact aspects of visual processing in both humans and animal models. In the current study, we assess the impact of locomotion on the dynamics of binocular rivalry. We presented orthogonal gratings, one contrast-modulating at 0.8 Hz (matching average step frequency) and the other at 3.2 Hz, to participants using a virtual reality headset. We compared two conditions: stationary and walking. We continuously monitored participants' foot position using tracking devices to measure the step cycle. During the walking condition, participants viewed the rivaling gratings for 60-second trials while walking on a circular path in a virtual reality environment. During the stationary condition, observers viewed the same stimuli and environment while standing still. The task was to continuously indicate the dominant percept via button press using handheld controllers. We found no significant differences between walking and standing for normalized dominance duration distributions, mean normalized dominance distributions, mean alternation rates, or mean fitted frequencies. Although our findings do not align with prior research highlighting distinctions in normalized dominance distributions between walking and standing, our study contributes unique evidence indicating that alternation rates vary across the step cycle. Specifically, we observed that the number of alternations is at its lowest during toe-off phases and reaches its peak at heel strike. This novel insight enhances our understanding of the dynamic nature of alternation patterns throughout the step cycle.

Reduced spatial attentional distribution in older adults.

Older adults show decline in visual search performance, but the underlying cause remains unclear. It has been suggested that older adults' altered performance may be related to reduced spatial attention to peripheral visual information compared with younger adults. In this study, 18 younger (M = 21.6 years) and 16 older (M = 69.1 years) participants performed pop-out and serial visual search tasks with variously sized gaze-contingent artificial central scotomas (3°, 5°, or 7° diameter). By occluding central vision, we measured how attention to the periphery was contributing to the search performance. We also tested the effect of target eccentricity on search times and eye movements. We hypothesized that, if attention is reduced primarily in the periphery in older adults, we would observe longer search times for more eccentric targets and with central occlusion. During the pop-out search, older adults showed a steeper decline in search performance with increasing eccentricity and central scotoma size compared with younger adults. In contrast, during the serial search, older adults had longer search times than younger adults overall, independent of target eccentricity and scotoma size. Longer search times were attributed to higher cost-per-item slopes, indicating increased difficulty in simultaneously processing complex symbols made up of separable features in aging, possibly stemming from challenges in spatially binding individual features. Altogether, our findings point to fewer attentional resources of simultaneous visual processing to distribute over space or separable features of objects, consistent with decreased dorsal visual stream functioning in aging.

A bionic self-driven retinomorphic eye with ionogel photosynaptic retina.

Bioinspired bionic eyes should be self-driving, repairable and conformal to arbitrary geometries. Such eye would enable wide-field detection and efficient visual signal processing without requiring external energy, along with retinal transplantation by replacing dysfunctional photoreceptors with healthy ones for vision restoration. A variety of artificial eyes have been constructed with hemispherical silicon, perovskite and heterostructure photoreceptors, but creating zero-powered retinomorphic system with transplantable conformal features remains elusive. By combining neuromorphic principle with retinal and ionoelastomer engineering, we demonstrate a self-driven hemispherical retinomorphic eye with elastomeric retina made of ionogel heterojunction as photoreceptors. The receptor driven by photothermoelectric effect shows photoperception with broadband light detection (365 to 970 nm), wide field-of-view (180°) and photosynaptic (paired-pulse facilitation index, 153%) behaviors for biosimilar visual learning. The retinal photoreceptors are transplantable and conformal to any complex surface, enabling visual restoration for dynamic optical imaging and motion tracking.

Art perception is affected by negative knowledge about famous and unknown artists.

The biographies of some celebrated artists are marked by accounts that paint a far from beautiful portrait. Does this negative-social knowledge influence the aesthetic experience of an artwork? Does an artist's fame protect their paintings from such an influence? We present two preregistered experiments examining the effect of social-emotional biographical knowledge about famous and unknown artists on the reception and perception of their paintings, using aesthetic ratings and neurocognitive measures. In Experiment 1, paintings attributed to artists characterised by negative biographical information were liked less, evoked greater feelings of arousal and were judged lower in terms of quality, than paintings by artists associated with neutral information. No modulation of artist renown was found. Experiment 2 fully replicated these behavioural results and revealed that paintings by artists associated with negative social-emotional knowledge also elicited enhanced early brain activity related to visual perception (P1) and early emotional arousal (early posterior negativity; EPN). Together, the findings suggest that negative knowledge about famous artists can shape not only explicit aesthetic evaluations, but may also penetrate the perception of the artwork itself.

Alterations of the alpha rhythm in visual snow syndrome: a case-control study.

BACKGROUND: Visual snow syndrome is a disorder characterized by the combination of typical perceptual disturbances. The clinical picture suggests an impairment of visual filtering mechanisms and might involve primary and secondary visual brain areas, as well as higher-order attentional networks. On the level of cortical oscillations, the alpha rhythm is a prominent EEG pattern that is involved in the prioritisation of visual information. It can be regarded as a correlate of inhibitory modulation within the visual network. METHODS: Twenty-one patients with visual snow syndrome were compared to 21 controls matched for age, sex, and migraine. We analysed the resting-state alpha rhythm by identifying the individual alpha peak frequency using a Fast Fourier Transform and then calculating the power spectral density around the individual alpha peak (+/- 1 Hz). We anticipated a reduced power spectral density in the alpha band over the primary visual cortex in participants with visual snow syndrome. RESULTS: There were no significant differences in the power spectral density in the alpha band over the occipital electrodes (O1 and O2), leading to the rejection of our primary hypothesis. However, the power spectral density in the alpha band was significantly reduced over temporal and parietal electrodes. There was also a trend towards increased individual alpha peak frequency in the subgroup of participants without comorbid migraine. CONCLUSIONS: Our main finding was a decreased power spectral density in the alpha band over parietal and temporal brain regions corresponding to areas of the secondary visual cortex. These findings complement previous functional and structural imaging data at a electrophysiological level. They underscore the involvement of higher-order visual brain areas, and potentially reflect a disturbance in inhibitory top-down modulation. The alpha rhythm alterations might represent a novel target for specific neuromodulation. TRIAL REGISTRATION: we preregistered the study before preprocessing and data analysis on the platform osf.org (DOI: https://doi.org/10.17605/OSF.IO/XPQHF , date of registration: November 19th 2022).

Crowding under scotopic and photopic vision in albino and normal-sighted participants.

Crowding is a phenomenon in which the ability to recognize an object in a clutter deteriorates. It is, therefore, a fundamental aspect of object recognition and crucial in deciphering resolution. For visually impaired individuals, deficiency in crowding has a tremendous effect on vision and may reflect and predict the amount of deterioration in vision. It is well established that albinos suffer much more from crowding than normally sighted individuals under daylight luminance conditions. However, to our knowledge, this study is the first to investigate crowding in albino participants under low light conditions. In this study, we explored the crowding effect in a group of albino participants (n = 9) and a control group of normally sighted participants (n = 9). Crowding was conducted under daylight (photopic vision) and low light (scotopic vision). We measured the visual acuity threshold under crowding in three-letter spacing (0.5, 1, and 1.5) and compared it to a single target. Results indicate that albino participants experienced stronger crowding than the control under the photopic condition, while crowding under the scotopic condition was apparent in the albino but abolished for the control group. These findings highlight the importance of considering luminance when discussing the visually impaired population in general. In particular, it suggests that crowding in albinism is based on a peripheral-like mechanism and may indicate a cessation in visual development.

Alpha desynchronization during the filtering initiation phase reflects active processing of distractors.

The ability to select task-relevant information and filter out task-irrelevant information is critical to our success in daily goal-directed behavior. Researchers call this ability filtering efficiency and divide it into three cognitive processing stages: detection of distractors, initiation of filtering, and unnecessary storage. Although researchers have conducted more studies on ERP components related to filtration efficiency, there are few studies related to neural oscillations. Alpha oscillation activity is related to the active processing of information and the suppression of distractors. In the current EEG study, we used the change detection task with distracted items to examine whether alpha activity during filtering initiation reflects reactive suppression of distractors by manipulating memory load levels and the presence or absence of distractors. Results showed that, the presence of the distractors caused an increase in the degree of desynchronization of the alpha oscillations, and in the subsequent time, the alpha activity level returned to a level consistent with the absence of interference conditions. Phase synchronization between frontal and posterior brain regions in the upper alpha oscillations found no effects associated with distractors. Based on these results, we believed that the alpha activity during the filtering initiation phase reflected the active processing of distractors, but this may also be due to lower perceptual load of the target items. In addition, we observed a dominance effect of the right hemisphere in both time-frequency results and connectivity results. We speculate that this effect is related to the activation of the right ventral frontoparietal network.

High visual salience of alert signals can lead to a counterintuitive increase of reaction times.

It is often assumed that rendering an alert signal more salient yields faster responses to this alert. Yet, there might be a trade-off between attracting attention and distracting from task execution. Here we tested this in four behavioral experiments with eye-tracking using an abstract alert-signal paradigm. Participants performed a visual discrimination task (primary task) while occasional alert signals occurred in the visual periphery accompanied by a congruently lateralized tone. Participants had to respond to the alert before proceeding with the primary task. When visual salience (contrast) or auditory salience (tone intensity) of the alert were increased, participants directed their gaze to the alert more quickly. This confirms that more salient alerts attract attention more efficiently. Increasing auditory salience yielded quicker responses for the alert and primary tasks, apparently confirming faster responses altogether. However, increasing visual salience did not yield similar benefits: instead, it increased the time between fixating the alert and responding, as high-salience alerts interfered with alert-task execution. Such task interference by high-salience alert-signals counteracts their more efficient attentional guidance. The design of alert signals must be adapted to a "sweet spot" that optimizes this stimulus-dependent trade-off between maximally rapid attentional orienting and minimal task interference.

Perceptography unveils the causal contribution of inferior temporal cortex to visual perception.

Neurons in the inferotemporal (IT) cortex respond selectively to complex visual features, implying their role in object perception. However, perception is subjective and cannot be read out from neural responses; thus, bridging the causal gap between neural activity and perception demands independent characterization of perception. Historically, though, the complexity of the perceptual alterations induced by artificial stimulation of IT cortex has rendered them impossible to quantify. To address this old problem, we tasked male macaque monkeys to detect and report optical impulses delivered to their IT cortex. Combining machine learning with high-throughput behavioral optogenetics, we generated complex and highly specific images that were hard for the animal to distinguish from the state of being cortically stimulated. These images, named "perceptograms" for the first time, reveal and depict the contents of the complex hallucinatory percepts induced by local neural perturbation in IT cortex. Furthermore, we found that the nature and magnitude of these hallucinations highly depend on concurrent visual input, stimulation location, and intensity. Objective characterization of stimulation-induced perceptual events opens the door to developing a mechanistic theory of visual perception. Further, it enables us to make better visual prosthetic devices and gain a greater understanding of visual hallucinations in mental disorders.

Beyond visual integration: sensitivity of the temporal-parietal junction for objects, places, and faces.

One important role of the TPJ is the contribution to perception of the global gist in hierarchically organized stimuli where individual elements create a global visual percept. However, the link between clinical findings in simultanagnosia and neuroimaging in healthy subjects is missing for real-world global stimuli, like visual scenes. It is well-known that hierarchical, global stimuli activate TPJ regions and that simultanagnosia patients show deficits during the recognition of hierarchical stimuli and real-world visual scenes. However, the role of the TPJ in real-world scene processing is entirely unexplored. In the present study, we first localized TPJ regions significantly responding to the global gist of hierarchical stimuli and then investigated the responses to visual scenes, as well as single objects and faces as control stimuli. All three stimulus classes evoked significantly positive univariate responses in the previously localized TPJ regions. In a multivariate analysis, we were able to demonstrate that voxel patterns of the TPJ were classified significantly above chance level for all three stimulus classes. These results demonstrate a significant involvement of the TPJ in processing of complex visual stimuli that is not restricted to visual scenes and that the TPJ is sensitive to different classes of visual stimuli with a specific signature of neuronal activations.

Willed Attentional Selection of Visual Features: An EEG Study.

Visual selective attention studies generally tend to apply cuing paradigms to instructively direct observers' attention to certain locations, features or objects. However, in real situations, attention in humans often flows spontaneously without any specific instructions. Recently, a concept named "willed attention" was raised in visuospatial attention, in which participants are free to make volitional attention decisions. Several ERP components during willed attention were found, along with a perspective that ongoing alpha activity may bias the subsequent attentional choice. However, it remains unclear whether similar neural mechanisms exist in feature- or object-based willed attention. Here, we included choice cues and instruct cues in a feature-based selective attention paradigm, allowing participants to freely choose or to be instructed to attend a color for the subsequent target detection task. Pre-cue ongoing alpha oscillations, cue-evoked potentials and target-related steady-state visual evoked potentials (SSVEPs) were simultaneously measured as markers of attentional processing. As expected, SSVEP responses were similarly modulated by attention between choice and instruct cue trials. Similar to the case of spatial attention, a willed-attention component (Willed Attention Component, WAC) was isolated during the cue-related choice period by comparing choice and instruct cues. However, pre-cue ongoing alpha oscillations did not predict the color choice (yellow vs blue), as indicated by the chance level decoding accuracy (50%). Overall, our results revealed both similarities and differences between spatial and feature-based willed attention, and thus extended the understanding toward the neural mechanisms of volitional attention.

Randomness impacts the building of specific priors, visual exploration, and perception in object recognition.

Recognising objects is a vital skill on which humans heavily rely to respond quickly and adaptively to their environment. Yet, we lack a full understanding of the role visual information sampling plays in this process, and its relation to the individual's priors. To bridge this gap, the eye-movements of 18 adult participants were recorded during a free-viewing object-recognition task using Dots stimuli1. Participants viewed the stimuli in one of three orders: from most visible to least (Descending), least visible to most (Ascending), or in a randomised order (Random). This dictated the strength of their priors along the experiment. Visibility order influenced the participants' recognition performance and visual exploration. In addition, we found that while orders allowing for stronger priors generally led participants to visually sample more informative locations, this was not the case of Random participants. Indeed, they appeared to behave naïvely, and their use of specific object-related priors was fully impaired, while they maintained the ability to use general, task-related priors to guide their exploration. These findings have important implications for our understanding of perception, which appears to be influenced by complex cognitive processes, even at the basic level of visual sampling during object recognition.

Hierarchical Perceptual Noise Injection for Social Media Fingerprint Privacy Protection.

Billions of people share images from their daily lives on social media every day. However, their biometric information (e.g., fingerprints) could be easily stolen from these images. The threat of fingerprint leakage from social media has created a strong desire to anonymize shared images while maintaining image quality, since fingerprints act as a lifelong individual biometric password. To guard the fingerprint leakage, adversarial attack that involves adding imperceptible perturbations to fingerprint images have emerged as a feasible solution. However, existing works of this kind are either weak in black-box transferability or cause the images to have an unnatural appearance. Motivated by the visual perception hierarchy (i.e., high-level perception exploits model-shared semantics that transfer well across models while low-level perception extracts primitive stimuli that result in high visual sensitivity when a suspicious stimulus is provided), we propose FingerSafe, a hierarchical perceptual protective noise injection framework to address the above mentioned problems. For black-box transferability, we inject protective noises into the fingerprint orientation field to perturb the model-shared high-level semantics (i.e., fingerprint ridges). Considering visual naturalness, we suppress the low-level local contrast stimulus by regularizing the response of the Lateral Geniculate Nucleus. Our proposed FingerSafe is the first to provide feasible fingerprint protection in both digital (up to 94.12%) and realistic scenarios (Twitter and Facebook, up to 68.75%). Our code can be found at https://github.com/nlsde-safety-team/FingerSafe.

Auditory cortex conveys non-topographic sound localization signals to visual cortex.

Spatiotemporally congruent sensory stimuli are fused into a unified percept. The auditory cortex (AC) sends projections to the primary visual cortex (V1), which could provide signals for binding spatially corresponding audio-visual stimuli. However, whether AC inputs in V1 encode sound location remains unknown. Using two-photon axonal calcium imaging and a speaker array, we measured the auditory spatial information transmitted from AC to layer 1 of V1. AC conveys information about the location of ipsilateral and contralateral sound sources to V1. Sound location could be accurately decoded by sampling AC axons in V1, providing a substrate for making location-specific audiovisual associations. However, AC inputs were not retinotopically arranged in V1, and audio-visual modulations of V1 neurons did not depend on the spatial congruency of the sound and light stimuli. The non-topographic sound localization signals provided by AC might allow the association of specific audiovisual spatial patterns in V1 neurons.

An open platform for visual stimulation of insects.

To study how the nervous system processes visual information, experimenters must record neural activity while delivering visual stimuli in a controlled fashion. In animals with a nearly panoramic field of view, such as flies, precise stimulation of the entire visual field is challenging. We describe a projector-based device for stimulation of the insect visual system under a microscope. The device is based on a bowl-shaped screen that provides a wide and nearly distortion-free field of view. It is compact, cheap, easy to assemble, and easy to operate using the included open-source software for stimulus generation. We validate the virtual reality system technically and demonstrate its capabilities in a series of experiments at two levels: the cellular, by measuring the membrane potential responses of visual interneurons; and the organismal, by recording optomotor and fixation behavior of Drosophila melanogaster in tethered flight. Our experiments reveal the importance of stimulating the visual system of an insect with a wide field of view, and we provide a simple solution to do so.