Alerting effects require the absence of surprise.

Ongoing actions are interrupted for a brief period of time whenever salient and expectancy-discrepant stimuli (surprise stimuli) interfere with the present task set. By contrast, salient stimuli (alerting cues) preceding targets can facilitate behaviour by reducing time to initiate actions. Both phenomena seem to be at odds with each other as actions are either impaired or facilitated. Therefore, in the present study, we asked how surprise and alerting effects interact. In two experiments, participants performed choice reaction tasks without any prior knowledge of the impending alerting cue. After a baseline period of trials without an alerting cue, the alerting cue was presented for the first time. It was found that the initial presentation of the alerting cue significantly slowed down reaction times. However, after just a single trial this impairment went away. This reveals that the beneficial effects of alerting for action presuppose that alerting cues are expected and represented in the top-down task set. As such, the present findings challenge the standard view of phasic alerting as a bottom-up and entirely stimulus-driven phenomenon.

Eye blinks as a visual processing stage.

Humans blink their eyes frequently during normal viewing, more often than it seems necessary for keeping the cornea well lubricated. Since the closure of the eyelid disrupts the image on the retina, eye blinks are commonly assumed to be detrimental to visual processing. However, blinks also provide luminance transients rich in spatial information to neural pathways highly sensitive to temporal changes. Here, we report that the luminance modulations from blinks enhance visual sensitivity. By coupling high-resolution eye tracking in human observers with modeling of blink transients and spectral analysis of visual input signals, we show that blinking increases the power of retinal stimulation and that this effect significantly enhances visibility despite the time lost in exposure to the external scene. We further show that, as predicted from the spectral content of input signals, this enhancement is selective for stimuli at low spatial frequencies and occurs irrespective of whether the luminance transients are actively generated or passively experienced. These findings indicate that, like eye movements, blinking acts as a computational component of a visual processing strategy that uses motor behavior to reformat spatial information into the temporal domain.

Functional OCT reveals anisotropic changes of retinal flicker-evoked vasodilation.

The purpose of this study is to verify the effect of anisotropic property of retinal biomechanics on vasodilation measurement. A custom-built optical coherence tomography (OCT) was used for time-lapse imaging of flicker stimulation-evoked vessel lumen changes in mouse retinas. A comparative analysis revealed significantly larger (18.21%) lumen dilation in the axial direction compared to the lateral (10.77%) direction. The axial lumen dilation predominantly resulted from the top vessel wall movement toward the vitreous direction, whereas the bottom vessel wall remained stable. This observation indicates that the traditional vasodilation measurement in the lateral direction may result in an underestimated value.

Short communication: Binocular rivalry dynamics during locomotion.

Locomotion has been shown to impact aspects of visual processing in both humans and animal models. In the current study, we assess the impact of locomotion on the dynamics of binocular rivalry. We presented orthogonal gratings, one contrast-modulating at 0.8 Hz (matching average step frequency) and the other at 3.2 Hz, to participants using a virtual reality headset. We compared two conditions: stationary and walking. We continuously monitored participants' foot position using tracking devices to measure the step cycle. During the walking condition, participants viewed the rivaling gratings for 60-second trials while walking on a circular path in a virtual reality environment. During the stationary condition, observers viewed the same stimuli and environment while standing still. The task was to continuously indicate the dominant percept via button press using handheld controllers. We found no significant differences between walking and standing for normalized dominance duration distributions, mean normalized dominance distributions, mean alternation rates, or mean fitted frequencies. Although our findings do not align with prior research highlighting distinctions in normalized dominance distributions between walking and standing, our study contributes unique evidence indicating that alternation rates vary across the step cycle. Specifically, we observed that the number of alternations is at its lowest during toe-off phases and reaches its peak at heel strike. This novel insight enhances our understanding of the dynamic nature of alternation patterns throughout the step cycle.

Effectiveness of binaural beat music combined with rhythmical photic stimulation on older people with depressive symptoms in long-term care institution: a quasi-experimental pilot study.

BACKGROUND: Many older adults residing in long-term care often face issues like poor sleep, reduced vitality, and depression. Non-pharmacological approaches, specifically Binaural Beat Music (BBM) and Rhythmic Photic Stimulation (RPS), may alleviate these symptoms, yet their efficacy in this demographic has not been extensively explored. AIMS: This study investigated the effects of combined BBM and RPS interventions on sleep quality, vitality, and depression among older residents with depressive symptoms in long-term care facilities. METHODS: Using a quasi-experimental design, a total of 88 older adults with depressive symptoms from Taiwanese daytime care centers were divided into the BBM with RPS, and Sham groups (44 each). They underwent 20-minute daily sessions of their assigned treatment for two weeks. The BBM with RPS group listened to 10 Hz binaural beat music with 10 Hz photic stimulation glasses, and the Sham group received non-stimulating music and glasses. RESULTS: After the intervention, participants in the BBM with RPS groups showed significant improvements in vitality and depressive mood, with a notable increase in sympathetic nervous system activity. Conversely, the Sham group exhibited significant deterioration in vitality and mental health, with a significant increase in parasympathetic activity. Additionally, compared with the Sham group, the BBM and RPS groups showed significant improvements in vitality, mental health, and depression, with a significant increase in sympathetic nervous activity. CONCLUSION: The two-week intervention suggests that the combination of BBM and RPS, as a non-invasive intervention, can potentially improve vitality, mental health, and depressive mood among older adults in long-term care institutions.

Optical imaging of the intrinsic signal as a tool to characterize orientation sensitivity in the primary visual cortex of the young mouse.

We employed intrinsic signal optical imaging (ISOI) to investigate orientation sensitivity bias in the visual cortex of young mice. Optical signals were recorded in response to the moving light gratings stimulating ipsi­, contra­ and binocular eye inputs. ISOI allowed visualization of cortical areas activated by gratings of specific orientation and temporal changes of light scatter during visual stimulation. These results confirmed ISOI as a reliable technique for imaging the activity of large populations of neurons in the mouse visual cortex. Our results revealed that the contralateral ocular input activated a larger area of the primary visual cortex than the ipsilateral input, and caused the highest response amplitudes of light scatter signals to all ocular inputs. Horizontal gratings moved in vertical orientation induced the most significant changes in light scatter when presented contralaterally and binocularly, surpassing stimulations by vertical or oblique gratings. These observations suggest dedicated integration mechanisms for the combined inputs from both eyes. We also explored the relationship between point luminance change (PLC) of grating stimuli and ISOI time courses under various orientations of movements of the gratings and ocular inputs, finding higher cross-correlation values for cardinal orientations and ipsilateral inputs. These findings suggested specific activation of different neuronal assemblies within the mouse's primary visual cortex by grating stimuli of the corresponding orientation. However, further investigations are needed to examine this summation hypothesis. Our study highlights the potential of optical imaging as a valuable tool for exploring functional­anatomical relationships in the mouse visual system.

The time course of feature-selective attention inside and outside the focus of spatial attention.

Research on attentional selection of stimulus features has yielded seemingly contradictory results. On the one hand, many experiments in humans and animals have observed a "global" facilitation of attended features across the entire visual field, even when spatial attention is focused on a single location. On the other hand, several event-related potential studies in humans reported that attended features are enhanced at the attended location only. The present experiment demonstrates that these conflicting results can be explained by differences in the timing of attentional allocation inside and outside the spatial focus of attention. Participants attended to fields of either red or blue randomly moving dots on either the left or right side of fixation with the task of detecting brief coherent motion targets. Recordings of steady-state visual evoked potentials elicited by the flickering stimuli allowed concurrent measurement of the time course of feature-selective attention in visual cortex on both the attended and the unattended sides. The onset of feature-selective attentional modulation on the attended side occurred around 150 ms earlier than on the unattended side. This finding that feature-selective attention is not spatially global from the outset but extends to unattended locations after a temporal delay resolves previous contradictions between studies finding global versus hierarchical selection of features and provides insight into the fundamental relationship between feature-based and location-based (spatial) attention mechanisms.

Perceptography unveils the causal contribution of inferior temporal cortex to visual perception.

Neurons in the inferotemporal (IT) cortex respond selectively to complex visual features, implying their role in object perception. However, perception is subjective and cannot be read out from neural responses; thus, bridging the causal gap between neural activity and perception demands independent characterization of perception. Historically, though, the complexity of the perceptual alterations induced by artificial stimulation of IT cortex has rendered them impossible to quantify. To address this old problem, we tasked male macaque monkeys to detect and report optical impulses delivered to their IT cortex. Combining machine learning with high-throughput behavioral optogenetics, we generated complex and highly specific images that were hard for the animal to distinguish from the state of being cortically stimulated. These images, named "perceptograms" for the first time, reveal and depict the contents of the complex hallucinatory percepts induced by local neural perturbation in IT cortex. Furthermore, we found that the nature and magnitude of these hallucinations highly depend on concurrent visual input, stimulation location, and intensity. Objective characterization of stimulation-induced perceptual events opens the door to developing a mechanistic theory of visual perception. Further, it enables us to make better visual prosthetic devices and gain a greater understanding of visual hallucinations in mental disorders.

Beyond visual integration: sensitivity of the temporal-parietal junction for objects, places, and faces.

One important role of the TPJ is the contribution to perception of the global gist in hierarchically organized stimuli where individual elements create a global visual percept. However, the link between clinical findings in simultanagnosia and neuroimaging in healthy subjects is missing for real-world global stimuli, like visual scenes. It is well-known that hierarchical, global stimuli activate TPJ regions and that simultanagnosia patients show deficits during the recognition of hierarchical stimuli and real-world visual scenes. However, the role of the TPJ in real-world scene processing is entirely unexplored. In the present study, we first localized TPJ regions significantly responding to the global gist of hierarchical stimuli and then investigated the responses to visual scenes, as well as single objects and faces as control stimuli. All three stimulus classes evoked significantly positive univariate responses in the previously localized TPJ regions. In a multivariate analysis, we were able to demonstrate that voxel patterns of the TPJ were classified significantly above chance level for all three stimulus classes. These results demonstrate a significant involvement of the TPJ in processing of complex visual stimuli that is not restricted to visual scenes and that the TPJ is sensitive to different classes of visual stimuli with a specific signature of neuronal activations.

Willed Attentional Selection of Visual Features: An EEG Study.

Visual selective attention studies generally tend to apply cuing paradigms to instructively direct observers' attention to certain locations, features or objects. However, in real situations, attention in humans often flows spontaneously without any specific instructions. Recently, a concept named "willed attention" was raised in visuospatial attention, in which participants are free to make volitional attention decisions. Several ERP components during willed attention were found, along with a perspective that ongoing alpha activity may bias the subsequent attentional choice. However, it remains unclear whether similar neural mechanisms exist in feature- or object-based willed attention. Here, we included choice cues and instruct cues in a feature-based selective attention paradigm, allowing participants to freely choose or to be instructed to attend a color for the subsequent target detection task. Pre-cue ongoing alpha oscillations, cue-evoked potentials and target-related steady-state visual evoked potentials (SSVEPs) were simultaneously measured as markers of attentional processing. As expected, SSVEP responses were similarly modulated by attention between choice and instruct cue trials. Similar to the case of spatial attention, a willed-attention component (Willed Attention Component, WAC) was isolated during the cue-related choice period by comparing choice and instruct cues. However, pre-cue ongoing alpha oscillations did not predict the color choice (yellow vs blue), as indicated by the chance level decoding accuracy (50%). Overall, our results revealed both similarities and differences between spatial and feature-based willed attention, and thus extended the understanding toward the neural mechanisms of volitional attention.

A Time-Local Weighted Transformation Recognition Framework for Steady State Visual Evoked Potentials Based Brain-Computer Interfaces.

Canonical correlation analysis (CCA), Multivariate synchronization index (MSI), and their extended methods have been widely used for target recognition in Brain-computer interfaces (BCIs) based on Steady State Visual Evoked Potentials (SSVEP), and covariance calculation is an important process for these algorithms. Some studies have proved that embedding time-local information into the covariance can optimize the recognition effect of the above algorithms. However, the optimization effect can only be observed from the recognition results and the improvement principle of time-local information cannot be explained. Therefore, we propose a time-local weighted transformation (TT) recognition framework that directly embeds the time-local information into the electroencephalography signal through weighted transformation. The influence mechanism of time-local information on the SSVEP signal can then be observed in the frequency domain. Low-frequency noise is suppressed on the premise of sacrificing part of the SSVEP fundamental frequency energy, the harmonic energy of SSVEP is enhanced at the cost of introducing a small amount of high-frequency noise. The experimental results show that the TT recognition framework can significantly improve the recognition ability of the algorithms and the separability of extracted features. Its enhancement effect is significantly better than the traditional time-local covariance extraction method, which has enormous application potential.

Multi-Stimulus Least-Squares Transformation With Online Adaptation Scheme to Reduce Calibration Effort for SSVEP-Based BCIs.

Steady-state visual evoked potential (SSVEP), one of the most popular electroencephalography (EEG)-based brain-computer interface (BCI) paradigms, can achieve high performance using calibration-based recognition algorithms. As calibration-based recognition algorithms are time-consuming to collect calibration data, the least-squares transformation (LST) has been used to reduce the calibration effort for SSVEP-based BCI. However, the transformation matrices constructed by current LST methods are not precise enough, resulting in large differences between the transformed data and the real data of the target subject. This ultimately leads to the constructed spatial filters and reference templates not being effective enough. To address these issues, this paper proposes multi-stimulus LST with online adaptation scheme (ms-LST-OA). METHODS: The proposed ms-LST-OA consists of two parts. Firstly, to improve the precision of the transformation matrices, we propose the multi-stimulus LST (ms-LST) using cross-stimulus learning scheme as the cross-subject data transformation method. The ms-LST uses the data from neighboring stimuli to construct a higher precision transformation matrix for each stimulus to reduce the differences between transformed data and real data. Secondly, to further optimize the constructed spatial filters and reference templates, we use an online adaptation scheme to learn more features of the EEG signals of the target subject through an iterative process trial-by-trial. RESULTS: ms-LST-OA performance was measured for three datasets (Benchmark Dataset, BETA Dataset, and UCSD Dataset). Using few calibration data, the ITR of ms-LST-OA achieved 210.01±10.10 bits/min, 172.31±7.26 bits/min, and 139.04±14.90 bits/min for all three datasets, respectively. CONCLUSION: Using ms-LST-OA can reduce calibration effort for SSVEP-based BCIs.

Plastic vasomotion entrainment.

The presence of global synchronization of vasomotion induced by oscillating visual stimuli was identified in the mouse brain. Endogenous autofluorescence was used and the vessel 'shadow' was quantified to evaluate the magnitude of the frequency-locked vasomotion. This method allows vasomotion to be easily quantified in non-transgenic wild-type mice using either the wide-field macro-zoom microscopy or the deep-brain fiber photometry methods. Vertical stripes horizontally oscillating at a low temporal frequency (0.25 Hz) were presented to the awake mouse, and oscillatory vasomotion locked to the temporal frequency of the visual stimulation was induced not only in the primary visual cortex but across a wide surface area of the cortex and the cerebellum. The visually induced vasomotion adapted to a wide range of stimulation parameters. Repeated trials of the visual stimulus presentations resulted in the plastic entrainment of vasomotion. Horizontally oscillating visual stimulus is known to induce horizontal optokinetic response (HOKR). The amplitude of the eye movement is known to increase with repeated training sessions, and the flocculus region of the cerebellum is known to be essential for this learning to occur. Here, we show a strong correlation between the average HOKR performance gain and the vasomotion entrainment magnitude in the cerebellar flocculus. Therefore, the plasticity of vasomotion and neuronal circuits appeared to occur in parallel. Efficient energy delivery by the entrained vasomotion may contribute to meeting the energy demand for increased coordinated neuronal activity and the subsequent neuronal circuit reorganization.

Auditory cortex conveys non-topographic sound localization signals to visual cortex.

Spatiotemporally congruent sensory stimuli are fused into a unified percept. The auditory cortex (AC) sends projections to the primary visual cortex (V1), which could provide signals for binding spatially corresponding audio-visual stimuli. However, whether AC inputs in V1 encode sound location remains unknown. Using two-photon axonal calcium imaging and a speaker array, we measured the auditory spatial information transmitted from AC to layer 1 of V1. AC conveys information about the location of ipsilateral and contralateral sound sources to V1. Sound location could be accurately decoded by sampling AC axons in V1, providing a substrate for making location-specific audiovisual associations. However, AC inputs were not retinotopically arranged in V1, and audio-visual modulations of V1 neurons did not depend on the spatial congruency of the sound and light stimuli. The non-topographic sound localization signals provided by AC might allow the association of specific audiovisual spatial patterns in V1 neurons.

An open platform for visual stimulation of insects.

To study how the nervous system processes visual information, experimenters must record neural activity while delivering visual stimuli in a controlled fashion. In animals with a nearly panoramic field of view, such as flies, precise stimulation of the entire visual field is challenging. We describe a projector-based device for stimulation of the insect visual system under a microscope. The device is based on a bowl-shaped screen that provides a wide and nearly distortion-free field of view. It is compact, cheap, easy to assemble, and easy to operate using the included open-source software for stimulus generation. We validate the virtual reality system technically and demonstrate its capabilities in a series of experiments at two levels: the cellular, by measuring the membrane potential responses of visual interneurons; and the organismal, by recording optomotor and fixation behavior of Drosophila melanogaster in tethered flight. Our experiments reveal the importance of stimulating the visual system of an insect with a wide field of view, and we provide a simple solution to do so.

Statistical Evaluation of ERG Responses: A New Method to Validate Cycle-by-Cycle Recordings in Advanced Retinal Degenerations.

Purpose: To describe and evaluate a novel method to determine the validity of measurements made using cycle-by-cycle (CxC) recording techniques in patients with advanced retinal degenerations (RD) having low-amplitude flicker electroretinogram (ERG) responses. Methods: The method extends the original CxC recording algorithm introduced by Sieving et al., retaining the original recording setup and the preliminary analysis of raw data. Novel features include extended use of spectrum analysis, reduction of errors due to known sources, and a comprehensive statistical assessment using three different tests. The method was applied to ERG recordings from seven patients with RD and two patients with CNGB3 achromatopsia. Results: The method was implemented as a Windows application to processes raw data obtained from a commercial ERG system, and it features a computational toolkit for statistical assessment of ERG recordings with amplitudes as low as 1 µV, commonly found in advanced RD patients. When recorded using conditions specific for eliciting cone responses, none of the CNGB3 patients had a CxC validated response, indicating that no signal artifacts were present with our recording conditions. A comparison of the presented method with conventional 30 Hz ERG was performed. Bland-Altman plots indicated good agreement (mean difference, -0.045 µV; limits of agreement, 0.193 to -0.282 µV) between the resulting amplitudes. Within-session test-retest variability was 15%, comparing favorably to the variability of standard ERG amplitudes. Conclusions: This novel method extracts highly reliable clinical recordings of low-amplitude flicker ERGs and effectively detects artifactual responses. It has potential value both as a cone outcome variable and planning tool in clinical trials on natural history and treatment of advanced RDs.

Smooth pursuit inhibition reveals audiovisual enhancement of fast movement control.

The sudden onset of a visual object or event elicits an inhibition of eye movements at latencies approaching the minimum delay of visuomotor conductance in the brain. Typically, information presented via multiple sensory modalities, such as sound and vision, evokes stronger and more robust responses than unisensory information. Whether and how multisensory information affects ultra-short latency oculomotor inhibition is unknown. In two experiments, we investigate smooth pursuit and saccadic inhibition in response to multisensory distractors. Observers tracked a horizontally moving dot and were interrupted by an unpredictable visual, auditory, or audiovisual distractor. Distractors elicited a transient inhibition of pursuit eye velocity and catch-up saccade rate within ∼100 ms of their onset. Audiovisual distractors evoked stronger oculomotor inhibition than visual- or auditory-only distractors, indicating multisensory response enhancement. Multisensory response enhancement magnitudes were equal to the linear sum of responses to component stimuli. These results demonstrate that multisensory information affects eye movements even at ultra-short latencies, establishing a lower time boundary for multisensory-guided behavior. We conclude that oculomotor circuits must have privileged access to sensory information from multiple modalities, presumably via a fast, subcortical pathway.

Dissecting abstract, modality-specific and experience-dependent coding of affect in the human brain.

Emotion and perception are tightly intertwined, as affective experiences often arise from the appraisal of sensory information. Nonetheless, whether the brain encodes emotional instances using a sensory-specific code or in a more abstract manner is unclear. Here, we answer this question by measuring the association between emotion ratings collected during a unisensory or multisensory presentation of a full-length movie and brain activity recorded in typically developed, congenitally blind and congenitally deaf participants. Emotional instances are encoded in a vast network encompassing sensory, prefrontal, and temporal cortices. Within this network, the ventromedial prefrontal cortex stores a categorical representation of emotion independent of modality and previous sensory experience, and the posterior superior temporal cortex maps the valence dimension using an abstract code. Sensory experience more than modality affects how the brain organizes emotional information outside supramodal regions, suggesting the existence of a scaffold for the representation of emotional states where sensory inputs during development shape its functioning.

Assistance Device Based on SSVEP-BCI Online to Control a 6-DOF Robotic Arm.

This paper explores the potential benefits of integrating a brain-computer interface (BCI) utilizing the visual-evoked potential paradigm (SSVEP) with a six-degrees-of-freedom (6-DOF) robotic arm to enhance rehabilitation tools. The SSVEP-BCI employs electroencephalography (EEG) as a method of measuring neural responses inside the occipital lobe in reaction to pre-established visual stimulus frequencies. The BCI offline and online studies yielded accuracy rates of 75% and 83%, respectively, indicating the efficacy of the system in accurately detecting and capturing user intent. The robotic arm achieves planar motion by utilizing a total of five control frequencies. The results of this experiment exhibited a high level of precision and consistency, as indicated by the recorded values of ±0.85 and ±1.49 cm for accuracy and repeatability, respectively. Moreover, during the performance tests conducted with the task of constructing a square within each plane, the system demonstrated accuracy of 79% and 83%. The use of SSVEP-BCI and a robotic arm together shows promise and sets a solid foundation for the development of assistive technologies that aim to improve the health of people with amyotrophic lateral sclerosis, spina bifida, and other related diseases.

Toward viewing behavior for aerial scene categorization.

Previous work has demonstrated similarities and differences between aerial and terrestrial image viewing. Aerial scene categorization, a pivotal visual processing task for gathering geoinformation, heavily depends on rotation-invariant information. Aerial image-centered research has revealed effects of low-level features on performance of various aerial image interpretation tasks. However, there are fewer studies of viewing behavior for aerial scene categorization and of higher-level factors that might influence that categorization. In this paper, experienced subjects' eye movements were recorded while they were asked to categorize aerial scenes. A typical viewing center bias was observed. Eye movement patterns varied among categories. We explored the relationship of nine image statistics to observers' eye movements. Results showed that if the images were less homogeneous, and/or if they contained fewer or no salient diagnostic objects, viewing behavior became more exploratory. Higher- and object-level image statistics were predictive at both the image and scene category levels. Scanpaths were generally organized and small differences in scanpath randomness could be roughly captured by critical object saliency. Participants tended to fixate on critical objects. Image statistics included in this study showed rotational invariance. The results supported our hypothesis that the availability of diagnostic objects strongly influences eye movements in this task. In addition, this study provides supporting evidence for Loschky et al.'s (Journal of Vision, 15(6), 11, 2015) speculation that aerial scenes are categorized on the basis of image parts and individual objects. The findings were discussed in relation to theories of scene perception and their implications for automation development.