Visual Perceptual Echo Reflects Learning of Regularities in Rapid Luminance Sequences.

A novel neural signature of active visual processing has recently been described in the form of the "perceptual echo", in which the cross-correlation between a sequence of randomly fluctuating luminance values and occipital electrophysiological signals exhibits a long-lasting periodic (∼100 ms cycle) reverberation of the input stimulus (VanRullen and Macdonald, 2012). As yet, however, the mechanisms underlying the perceptual echo and its function remain unknown. Reasoning that natural visual signals often contain temporally predictable, though nonperiodic features, we hypothesized that the perceptual echo may reflect a periodic process associated with regularity learning. To test this hypothesis, we presented subjects with successive repetitions of a rapid nonperiodic luminance sequence, and examined the effects on the perceptual echo, finding that echo amplitude linearly increased with the number of presentations of a given luminance sequence. These data suggest that the perceptual echo reflects a neural signature of regularity learning.Furthermore, when a set of repeated sequences was followed by a sequence with inverted luminance polarities, the echo amplitude decreased to the same level evoked by a novel stimulus sequence. Crucially, when the original stimulus sequence was re-presented, the echo amplitude returned to a level consistent with the number of presentations of this sequence, indicating that the visual system retained sequence-specific information, for many seconds, even in the presence of intervening visual input. Altogether, our results reveal a previously undiscovered regularity learning mechanism within the human visual system, reflected by the perceptual echo.SIGNIFICANCE STATEMENT How the brain encodes and learns fast-changing but nonperiodic visual input remains unknown, even though such visual input characterizes natural scenes. We investigated whether the phenomenon of "perceptual echo" might index such learning. The perceptual echo is a long-lasting reverberation between a rapidly changing visual input and evoked neural activity, apparent in cross-correlations between occipital EEG and stimulus sequences, peaking in the alpha (∼10 Hz) range. We indeed found that perceptual echo is enhanced by repeatedly presenting the same visual sequence, indicating that the human visual system can rapidly and automatically learn regularities embedded within fast-changing dynamic sequences. These results point to a previously undiscovered regularity learning mechanism, operating at a rate defined by the alpha frequency.

Neural correlates of merging number words.

Complex number words (e.g., "twenty two") are formed by merging together several simple number words (e.g., "twenty" and "two"). In the present study, we explored the neural correlates of this operation and investigated to what extent it engages brain areas involved processing numerical quantity and linguistic syntactic structure. Participants speaking two typologically distinct languages, French and Chinese, were required to read aloud sequences of simple number words while their cerebral activity was recorded by functional magnetic resonance imaging. Each number word could either be merged with the previous ones (e.g., 'twenty three') or not (e.g., 'three twenty'), thus forming four levels ranging from lists of number words to complex numerals. When a number word could be merged with the preceding ones, it was named faster than when it could not. Neuroimaging results showed that the number of merges correlated with activation in the left inferior frontal gyrus and in the left inferior parietal lobule. Consistent findings across Chinese and French participants suggest that these regions serve as the neural bases for forming complex number words in different languages.

Cross-modal prediction changes the timing of conscious access during the motion-induced blindness.

Despite accumulating evidence that perceptual predictions influence perceptual content, the relations between these predictions and conscious contents remain unclear, especially for cross-modal predictions. We examined whether predictions of visual events by auditory cues can facilitate conscious access to the visual stimuli. We trained participants to learn associations between auditory cues and colour changes. We then asked whether congruency between auditory cues and target colours would speed access to consciousness. We did this by rendering a visual target subjectively invisible using motion-induced blindness and then gradually changing its colour while presenting congruent or incongruent auditory cues. Results showed that the visual target gained access to consciousness faster in congruent than in incongruent trials; control experiments excluded potentially confounding effects of attention and motor response. The expectation effect was gradually established over blocks suggesting a role for extensive training. Overall, our findings show that predictions learned through cross-modal training can facilitate conscious access to visual stimuli.

The sensitivity and criterion of sense of agency.

The sense of agency, which refers to the subjective feeling of control, is an essential aspect of self-consciousness. We argue that distinguishing between the sensitivity and criterion of this feeling is important for discussing individual differences in the sense of agency and its connections with other cognitive functions.

Hierarchical analysis of the sense of agency in schizophrenia: motor control, control detection, and self-attribution.

The sense of agency refers to the feeling of initiating and controlling one's actions and their resulting effects on the external environment. Previous studies have uncovered behavioral evidence of excessive self-attribution and, conversely, a reduction in the sense of agency in patients with schizophrenia. We hypothesize that this apparent paradox is likely to result from impairment in lower-level processes underlying the sense of agency, combined with a higher-level compensational bias. The present study employed three behavioral tasks utilizing the same stimuli and experimental design to systematically evaluate multiple factors that influence the sense of agency, including motor control, sensorimotor processing, and self-attribution. Participants' real-time mouse movements were combined with prerecorded motions of others in ratios of 30/70, 55/45, or 80/20, with an additional angular bias of either 0° or 90°. Twenty-six patients with schizophrenia and 27 health control volunteers participated in the three tasks. Patients with schizophrenia performed significantly worse in the reaching and control detection tasks than healthy controls. However, their self-attribution in the control judgment task was comparable to that of the healthy controls. Patients with schizophrenia were impaired in motor control components and in the detection of control using sensorimotor information, but their evaluation of agency remained relatively less affected. This underscores the importance of distinguishing between different subcomponents when addressing the abnormal sense of agency in patients with schizophrenia. Subsequent cluster analysis revealed that the combined task performance accurately distinguished between the patients and healthy control participants.

Control over self and others' face: exploitation and exploration.

The face serves as a crucial cue for self-identification, while the sense of agency plays a significant role in determining our influence through actions in the environment. The current study investigates how self-identification through facial recognition may influence the perception of control via motion. We propose that self-identification might engender a belief in having control over one's own face, leading to a more acute detection and greater emphasis on discrepancies between their actions and the sensory feedback in control judgments. We refer to the condition governed by the belief in having control as the exploitation mode. Conversely, when manipulating another individual's face, the belief in personal control is absent. In such cases, individuals are likely to rely on the regularity between actions and sensory input for control judgments, exhibiting behaviors that are exploratory in nature to glean such information. This condition is termed the explorative mode. The study utilized a face-motion mixing paradigm, employing a deep generative model to enable participants to interact with either their own or another person's face through facial and head movements. During the experiment, participants observed either their own face or someone else's face (self-face vs. other-face) on the screen. The motion of the face was driven either purely by their own facial and head motion or by an average of the participant's and the experimenter's motion (full control vs. partial control). The results showed that participants reported a higher sense of agency over the other-face than the self-face, while their self-identification rating was significantly higher for the self-face. More importantly, controlling someone else's face resulted in more movement diversity than controlling one's own face. These findings support our exploration-exploitation theory: When participants had a strong belief in control triggered by the self-face, they became highly sensitive to any sensorimotor prediction errors, leading to a lower sense of agency. In contrast, when the belief of control was absent, the exploration mode triggered more explorative behaviors, allowing participants to efficiently gather information to establish a sense of agency.

Induction and stabilization of delta frequency brain oscillations by phase-synchronized rTMS and tACS.

BACKGROUND: Brain oscillations in the delta frequency band have been linked with deep sleep and consolidation of declarative memory during sleep. However, the causal relationship of these associations remains not competely clarified, primarily due to constraints by technical limitations of brain stimulation approaches suited to induce and stabilize respective oscillatory activity in the human brain. The objective of this study was to establish a non-invasive brain stimulation protocol capable of reliably inducing, and stabilizing respective oscillatory activity in the delta frequency range. HYPOTHESIS: We aimed to develop an efficient non-invasive brain stimulation (NIBS) protocol for delta frequency induction and stabilization via concurrent, phase-locked repetitive transcranial magnetic stimulation (rTMS) and transcranial alternating current stimulation (tACS). We hypothesized that rTMS induces oscillatory resting-state activity in the delta frequency and that tACS stabilizes this effect, as has been shown before for alpha and theta frequencies. METHODS: 19 healthy participants took part in a repeated-measures experimental protocol. We applied rTMS pulses synchronized with the peak or trough phase of 0.75Hz tACS over the bilateral prefrontal cortex. Resting state EEG in eyes-open (EO) and eyes-closed (EC) conditions was recorded before, immediately after and every 10 min for up to 1 h after intervention. RESULTS: rTMS phase-synchronized to the trough of the tACS waveform significantly increased delta frequency activity for up to 60 min in both EO and EC conditions after stimulation. The effects extended from frontal to temporal regions and this enhancement of oscillatory activity was shown to be specific for the delta frequency range. CONCLUSION: Concurrent, trough-synchronized 0.75 Hz rTMS combined with tACS may be a reliable protocol to induce long-lasting oscillatory activity in the delta frequency range. The results of the current study might perspectively be relevant for clinical treatment of sleep disturbances which are accompanied by pathologically altered brain oscillations, and enhancement of memory consolidation.

Big time is not always long: numerical magnitude automatically affects time reproduction.

To reproduce the duration of an event precisely, one needs to represent the temporal information without being influenced by other magnitude attributes (e.g., size) of the event. In the present study, however, task-irrelevant numerical magnitude automatically affected participants' reproduction of the duration of a stimulus. In Experiment 1, participants made key-press responses to reproduce the duration of numbers. Reproduced durations were shorter for small numbers (e.g., 1) than for large numbers (e.g., 9). In contrast, in Experiment 2, participants' reproductions of a standard duration were longer when their key-press response was accompanied by visual presentation of a small number than when it was accompanied by presentation of a large number. These results clearly demonstrate that number-time interference extends beyond simple mapping between stimulus categories and response alternatives. The findings support the notion that either a common magnitude representation or closely connected magnitude representations underlie numerical and temporal processing.

Information Closure Theory of Consciousness.

Information processing in neural systems can be described and analyzed at multiple spatiotemporal scales. Generally, information at lower levels is more fine-grained but can be coarse-grained at higher levels. However, only information processed at specific scales of coarse-graining appears to be available for conscious awareness. We do not have direct experience of information available at the scale of individual neurons, which is noisy and highly stochastic. Neither do we have experience of more macro-scale interactions, such as interpersonal communications. Neurophysiological evidence suggests that conscious experiences co-vary with information encoded in coarse-grained neural states such as the firing pattern of a population of neurons. In this article, we introduce a new informational theory of consciousness: Information Closure Theory of Consciousness (ICT). We hypothesize that conscious processes are processes which form non-trivial informational closure (NTIC) with respect to the environment at certain coarse-grained scales. This hypothesis implies that conscious experience is confined due to informational closure from conscious processing to other coarse-grained scales. Information Closure Theory of Consciousness (ICT) proposes new quantitative definitions of both conscious content and conscious level. With the parsimonious definitions and a hypothesize, ICT provides explanations and predictions of various phenomena associated with consciousness. The implications of ICT naturally reconcile issues in many existing theories of consciousness and provides explanations for many of our intuitions about consciousness. Most importantly, ICT demonstrates that information can be the common language between consciousness and physical reality.

Information generation as a functional basis of consciousness.

What is the biological advantage of having consciousness? Functions of consciousness have been elusive due to the subjective nature of consciousness and ample empirical evidence showing the presence of many nonconscious cognitive performances in the human brain. Drawing upon empirical literature, here, we propose that a core function of consciousness be the ability to internally generate representations of events possibly detached from the current sensory input. Such representations are constructed by generative models learned through sensory-motor interactions with the environment. We argue that the ability to generate information underlies a variety of cognitive functions associated with consciousness such as intention, imagination, planning, short-term memory, attention, curiosity, and creativity, all of which contribute to non-reflexive behavior. According to this view, consciousness emerged in evolution when organisms gained the ability to perform internal simulations using internal models, which endowed them with flexible intelligent behavior. To illustrate the notion of information generation, we take variational autoencoders (VAEs) as an analogy and show that information generation corresponds the decoding (or decompression) part of VAEs. In biological brains, we propose that information generation corresponds to top-down predictions in the predictive coding framework. This is compatible with empirical observations that recurrent feedback activations are linked with consciousness whereas feedforward processing alone seems to occur without evoking conscious experience. Taken together, the information generation hypothesis captures many aspects of existing ideas about potential functions of consciousness and provides new perspectives on the functional roles of consciousness.

Boredom-Driven Curious Learning by Homeo-Heterostatic Value Gradients.

This paper presents the Homeo-Heterostatic Value Gradients (HHVG) algorithm as a formal account on the constructive interplay between boredom and curiosity which gives rise to effective exploration and superior forward model learning. We offer an instrumental view of action selection, in which an action serves to disclose outcomes that have intrinsic meaningfulness to an agent itself. This motivated two central algorithmic ingredients: devaluation and devaluation progress, both underpin agent's cognition concerning intrinsically generated rewards. The two serve as an instantiation of homeostatic and heterostatic intrinsic motivation. A key insight from our algorithm is that the two seemingly opposite motivations can be reconciled-without which exploration and information-gathering cannot be effectively carried out. We supported this claim with empirical evidence, showing that boredom-enabled agents consistently outperformed other curious or explorative agent variants in model building benchmarks based on self-assisted experience accumulation.

The structure of inter-individual differences in visual ability: Evidence from the general population and synaesthesia.

This study considers how inter-individual differences in visual ability are structured. Visual ability could be a single entity (along the lines of general intelligence, or 'g'), or could be structured according to major anatomical or physiological pathways (dorsal v. ventral streams; magno- v. parvo-cellular systems); or may be a finer-grained mosaic of abilities. To test this, we employed seven visual psychophysical tests (generating 16 measures) on a large (100+) sample of neurotypical participants. A Varimax-rotated PCA (Principal Component Analysis) revealed a two-factor solution that broadly corresponds to a high and low spatial frequency division (consistent with a magno/parvo distinction). Over and above this, two measures (temporal order judgments; gain in contrast sensitivity) correlated with most others, and loaded on both factors, suggesting that they tap broad visual processing demands. These analyses open up further possibilities for exploring the genetic and neuroscientific foundations of differences in visual ability. The tests were also run on a group of individuals with different types of visually-based synaesthesia, given that previous research have suggested they possess a distinct profile of visual abilities. Synaesthesia was linked to enhanced processing of colour and shape/curvature information (amongst others), that may relate to differences in V4 in this group. In conclusion, individual differences in vision are both striking and meaningful, despite our difficulty to imagine seeing the world any differently.

Fractionation of parietal function in bistable perception probed with concurrent TMS-EEG.

When visual input has conflicting interpretations, conscious perception can alternate spontaneously between these possible interpretations. This is called bistable perception. Previous neuroimaging studies have indicated the involvement of two right parietal areas in resolving perceptual ambiguity (ant-SPLr and post-SPLr). Transcranial magnetic stimulation (TMS) studies that selectively interfered with the normal function of these regions suggest that they play opposing roles in this type of perceptual switch. In the present study, we investigated this fractionation of parietal function by use of combined TMS with electroencephalography (EEG). Specifically, while participants viewed either a bistable stimulus, a replay stimulus, or resting-state fixation, we applied single pulse TMS to either location independently while simultaneously recording EEG. Combined with participant's individual structural magnetic resonance imaging (MRI) scans, this dataset allows for complex analyses of the effect of TMS on neural time series data, which may further elucidate the causal role of the parietal cortex in ambiguous perception.