Human Replay Spontaneously Reorganizes Experience.

Knowledge abstracted from previous experiences can be transferred to aid new learning. Here, we asked whether such abstract knowledge immediately guides the replay of new experiences. We first trained participants on a rule defining an ordering of objects and then presented a novel set of objects in a scrambled order. Across two studies, we observed that representations of these novel objects were reactivated during a subsequent rest. As in rodents, human "replay" events occurred in sequences accelerated in time, compared to actual experience, and reversed their direction after a reward. Notably, replay did not simply recapitulate visual experience, but followed instead a sequence implied by learned abstract knowledge. Furthermore, each replay contained more than sensory representations of the relevant objects. A sensory code of object representations was preceded 50 ms by a code factorized into sequence position and sequence identity. We argue that this factorized representation facilitates the generalization of a previously learned structure to new objects.

Neuroscientific Evidence for Processing Without Awareness.

The extent to which we are affected by perceptual input of which we are unaware is widely debated. By measuring neural responses to sensory stimulation, neuroscientific data could complement behavioral results with valuable evidence. Here we review neuroscientific findings of processing of high-level information, as well as interactions with attention and memory. Although the results are mixed, we find initial support for processing object categories and words, possibly to the semantic level, as well as emotional expressions. Robust neural evidence for face individuation and integration of sentences or scenes is lacking. Attention affects the processing of stimuli that are not consciously perceived, and such stimuli may exogenously but not endogenously capture attention when relevant, and be maintained in memory over time. Sources of inconsistency in the literature include variability in control for awareness as well as individual differences, calling for future studies that adopt stricter measures of awareness and probe multiple processes within subjects.

Neurophysiology of Human Perceptual Decision-Making.

The discovery of neural signals that reflect the dynamics of perceptual decision formation has had a considerable impact. Not only do such signals enable detailed investigations of the neural implementation of the decision-making process but they also can expose key elements of the brain's decision algorithms. For a long time, such signals were only accessible through direct animal brain recordings, and progress in human neuroscience was hampered by the limitations of noninvasive recording techniques. However, recent methodological advances are increasingly enabling the study of human brain signals that finely trace the dynamics of the unfolding decision process. In this review, we highlight how human neurophysiological data are now being leveraged to furnish new insights into the multiple processing levels involved in forming decisions, to inform the construction and evaluation of mathematical models that can explain intra- and interindividual differences, and to examine how key ancillary processes interact with core decision circuits.

Caenorhabditis elegans germ granules accumulate hundreds of low translation mRNAs with no systematic preference for germ cell fate regulators.

In animals with germ plasm, embryonic germline precursors inherit germ granules, condensates proposed to regulate mRNAs coding for germ cell fate determinants. In Caenorhabditis elegans, mRNAs are recruited to germ granules by MEG-3, a sequence non-specific RNA-binding protein that forms stabilizing interfacial clusters on germ granules. Using fluorescence in situ hybridization, we confirmed that 441 MEG-3-bound transcripts are distributed in a pattern consistent with enrichment in germ granules. Thirteen are related to transcripts reported in germ granules in Drosophila or Nasonia. The majority, however, are low-translation maternal transcripts required for embryogenesis that are not maintained preferentially in the nascent germline. Granule enrichment raises the concentration of certain transcripts in germ plasm but is not essential to regulate mRNA translation or stability. Our findings suggest that only a minority of germ granule-associated transcripts contribute to germ cell fate in C. elegans and that the vast majority function as non-specific scaffolds for MEG-3.

Phase-dependent word perception emerges from region-specific sensitivity to the statistics of language.

Neural oscillations reflect fluctuations in excitability, which biases the percept of ambiguous sensory input. Why this bias occurs is still not fully understood. We hypothesized that neural populations representing likely events are more sensitive, and thereby become active on earlier oscillatory phases, when the ensemble itself is less excitable. Perception of ambiguous input presented during less-excitable phases should therefore be biased toward frequent or predictable stimuli that have lower activation thresholds. Here, we show such a frequency bias in spoken word recognition using psychophysics, magnetoencephalography (MEG), and computational modelling. With MEG, we found a double dissociation, where the phase of oscillations in the superior temporal gyrus and medial temporal gyrus biased word-identification behavior based on phoneme and lexical frequencies, respectively. This finding was reproduced in a computational model. These results demonstrate that oscillations provide a temporal ordering of neural activity based on the sensitivity of separable neural populations.

Neural representations of the content and production of human vocalization.

Speech, as the spoken form of language, is fundamental for human communication. The phenomenon of covert inner speech implies functional independence of speech content and motor production. However, it remains unclear how a flexible mapping between speech content and production is achieved on the neural level. To address this, we recorded magnetoencephalography in humans performing a rule-based vocalization task. On each trial, vocalization content (one of two vowels) and production form (overt or covert) were instructed independently. Using multivariate pattern analysis, we found robust neural information about vocalization content and production, mostly originating from speech areas of the left hemisphere. Production signals dynamically transformed upon presentation of the content cue, whereas content signals remained largely stable throughout the trial. In sum, our results show dissociable neural representations of vocalization content and production in the human brain and provide insights into the neural dynamics underlying human vocalization.

Neural tracking measures of speech intelligibility: Manipulating intelligibility while keeping acoustics unchanged.

Neural speech tracking has advanced our understanding of how our brains rapidly map an acoustic speech signal onto linguistic representations and ultimately meaning. It remains unclear, however, how speech intelligibility is related to the corresponding neural responses. Many studies addressing this question vary the level of intelligibility by manipulating the acoustic waveform, but this makes it difficult to cleanly disentangle the effects of intelligibility from underlying acoustical confounds. Here, using magnetoencephalography recordings, we study neural measures of speech intelligibility by manipulating intelligibility while keeping the acoustics strictly unchanged. Acoustically identical degraded speech stimuli (three-band noise-vocoded, ~20 s duration) are presented twice, but the second presentation is preceded by the original (nondegraded) version of the speech. This intermediate priming, which generates a "pop-out" percept, substantially improves the intelligibility of the second degraded speech passage. We investigate how intelligibility and acoustical structure affect acoustic and linguistic neural representations using multivariate temporal response functions (mTRFs). As expected, behavioral results confirm that perceived speech clarity is improved by priming. mTRFs analysis reveals that auditory (speech envelope and envelope onset) neural representations are not affected by priming but only by the acoustics of the stimuli (bottom-up driven). Critically, our findings suggest that segmentation of sounds into words emerges with better speech intelligibility, and most strongly at the later (~400 ms latency) word processing stage, in prefrontal cortex, in line with engagement of top-down mechanisms associated with priming. Taken together, our results show that word representations may provide some objective measures of speech comprehension.

MEG Evidence That Modality-Independent Conceptual Representations Contain Semantic and Visual Features.

The semantic knowledge stored in our brains can be accessed from different stimulus modalities. For example, a picture of a cat and the word "cat" both engage similar conceptual representations. While existing research has found evidence for modality-independent representations, their content remains unknown. Modality-independent representations could be semantic, or they might also contain perceptual features. We developed a novel approach combining word/picture cross-condition decoding with neural network classifiers that learned latent modality-independent representations from MEG data (25 human participants, 15 females, 10 males). We then compared these representations to models representing semantic, sensory, and orthographic features. Results show that modality-independent representations correlate both with semantic and visual representations. There was no evidence that these results were due to picture-specific visual features or orthographic features automatically activated by the stimuli presented in the experiment. These findings support the notion that modality-independent concepts contain both perceptual and semantic representations.

Suspending the Embodied Self in Meditation Attenuates Beta Oscillations in the Posterior Medial Cortex.

Human experience is imbued by the sense of being an embodied agent. The investigation of such basic self-consciousness has been hampered by the difficulty of comprehensively modulating it in the laboratory while reliably capturing ensuing subjective changes. The present preregistered study fills this gap by combining advanced meditative states with principled phenomenological interviews: 46 long-term meditators (19 female, 27 male) were instructed to modulate and attenuate their embodied self-experience during magnetoencephalographic monitoring. Results showed frequency-specific (high-beta band) activity reductions in frontoparietal and posterior medial cortices (PMC). Importantly, PMC reductions were driven by a subgroup describing radical embodied self-disruptions, including suspension of agency and dissolution of a localized first-person perspective. Neural changes were correlated with lifetime meditation and interview-derived experiential changes, but not with classical self-reports. The results demonstrate the potential of integrating in-depth first-person methods into neuroscientific experiments. Furthermore, they highlight neural oscillations in the PMC as a central process supporting the embodied sense of self.

40†Hz Steady-State Response in Human Auditory Cortex Is Shaped by Gabaergic Neuronal Inhibition.

The 40 Hz auditory steady-state response (ASSR), an oscillatory brain response to periodically modulated auditory stimuli, is a promising, noninvasive physiological biomarker for schizophrenia and related neuropsychiatric disorders. The 40 Hz ASSR might be amplified by synaptic interactions in cortical circuits, which are, in turn, disturbed in neuropsychiatric disorders. Here, we tested whether the 40 Hz ASSR in the human auditory cortex depends on two key synaptic components of neuronal interactions within cortical circuits: excitation via N-methyl-aspartate glutamate (NMDA) receptors and inhibition via gamma-amino-butyric acid (GABA) receptors. We combined magnetoencephalography (MEG) recordings with placebo-controlled, low-dose pharmacological interventions in the same healthy human participants (13 males, 7 females). All participants exhibited a robust 40 Hz ASSR in auditory cortices, especially in the right hemisphere, under a placebo. The GABAA receptor-agonist lorazepam increased the amplitude of the 40 Hz ASSR, while no effect was detectable under the NMDA blocker memantine. Our findings indicate that the 40 Hz ASSR in the auditory cortex involves synaptic (and likely intracortical) inhibition via the GABAA receptor, thus highlighting its utility as a mechanistic signature of cortical circuit dysfunctions involving GABAergic inhibition.

Predicting Cued and Oddball Visual Search Performance from fMRI, MEG, and DNN Neural Representational Similarity.

Capacity limitations in visual tasks can be observed when the number of task-related objects increases. An influential idea is that such capacity limitations are determined by competition at the neural level: two objects that are encoded by shared neural populations interfere more in behavior (e.g., visual search) than two objects encoded by separate neural populations. However, the neural representational similarity of objects varies across brain regions and across time, raising the questions of where and when competition determines task performance. Furthermore, it is unclear whether the association between neural representational similarity and task performance is common or unique across tasks. Here, we used neural representational similarity derived from fMRI, MEG, and a deep neural network (DNN) to predict performance on two visual search tasks involving the same objects and requiring the same responses but differing in instructions: cued visual search and oddball visual search. Separate groups of human participants (both sexes) viewed the individual objects in neuroimaging experiments to establish the neural representational similarity between those objects. Results showed that performance on both search tasks could be predicted by neural representational similarity throughout the visual system (fMRI), from 80 ms after onset (MEG), and in all DNN layers. Stepwise regression analysis, however, revealed task-specific associations, with unique variability in oddball search performance predicted by early/posterior neural similarity and unique variability in cued search task performance predicted by late/anterior neural similarity. These results reveal that capacity limitations in superficially similar visual search tasks may reflect competition at different stages of visual processing.

Neuronal Modeling of Cross-Sensory Visual Evoked Magnetoencephalography Responses in the Auditory Cortex.

Previous studies have demonstrated that auditory cortex activity can be influenced by cross-sensory visual inputs. Intracortical laminar recordings in nonhuman primates have suggested a feedforward (FF) type profile for auditory evoked but feedback (FB) type for visual evoked activity in the auditory cortex. To test whether cross-sensory visual evoked activity in the auditory cortex is associated with FB inputs also in humans, we analyzed magnetoencephalography (MEG) responses from eight human subjects (six females) evoked by simple auditory or visual stimuli. In the estimated MEG source waveforms for auditory cortex regions of interest, auditory evoked response showed peaks at 37 and 90 ms and visual evoked response at 125 ms. The inputs to the auditory cortex were modeled through FF- and FB-type connections targeting different cortical layers using the Human Neocortical Neurosolver (HNN), which links cellular- and circuit-level mechanisms to MEG signals. HNN modeling suggested that the experimentally observed auditory response could be explained by an FF input followed by an FB input, whereas the cross-sensory visual response could be adequately explained by just an FB input. Thus, the combined MEG and HNN results support the hypothesis that cross-sensory visual input in the auditory cortex is of FB type. The results also illustrate how the dynamic patterns of the estimated MEG source activity can provide information about the characteristics of the input into a cortical area in terms of the hierarchical organization among areas.

Complexity Matters: Normalization to Prototypical Viewpoint Induces Memory Distortion along the Vertical Axis of Scenes.

Scene memory is prone to systematic distortions potentially arising from experience with the external world. Boundary transformation, a well-known memory distortion effect along the near-far axis of the three-dimensional space, represents the observer's erroneous recall of scenes' viewing distance. Researchers argued that normalization to the prototypical viewpoint with the high-probability viewing distance influenced this phenomenon. Herein, we hypothesized that the prototypical viewpoint also exists in the vertical angle of view (AOV) dimension and could cause memory distortion along scenes' vertical axis. Human subjects of both sexes were recruited to test this hypothesis, and two behavioral experiments were conducted, revealing a systematic memory distortion in the vertical AOV in both the forced choice (n = 79) and free adjustment (n = 30) tasks. Furthermore, the regression analysis implied that the complexity information asymmetry in scenes' vertical axis and the independent subjective AOV ratings from a large set of online participants (n = 1,208) could jointly predict AOV biases. Furthermore, in a functional magnetic resonance imaging experiment (n = 24), we demonstrated the involvement of areas in the ventral visual pathway (V3/V4, PPA, and OPA) in AOV bias judgment. Additionally, in a magnetoencephalography experiment (n = 20), we could significantly decode the subjects' AOV bias judgments ∼140 ms after scene onset and the low-level visual complexity information around the similar temporal interval. These findings suggest that AOV bias is driven by the normalization process and associated with the neural activities in the early stage of scene processing.

Attention Drives Visual Processing and Audiovisual Integration During Multimodal Communication.

During communication in real-life settings, our brain often needs to integrate auditory and visual information and at the same time actively focus on the relevant sources of information, while ignoring interference from irrelevant events. The interaction between integration and attention processes remains poorly understood. Here, we use rapid invisible frequency tagging and magnetoencephalography to investigate how attention affects auditory and visual information processing and integration, during multimodal communication. We presented human participants (male and female) with videos of an actress uttering action verbs (auditory; tagged at 58 Hz) accompanied by two movie clips of hand gestures on both sides of fixation (attended stimulus tagged at 65 Hz; unattended stimulus tagged at 63 Hz). Integration difficulty was manipulated by a lower-order auditory factor (clear/degraded speech) and a higher-order visual semantic factor (matching/mismatching gesture). We observed an enhanced neural response to the attended visual information during degraded speech compared to clear speech. For the unattended information, the neural response to mismatching gestures was enhanced compared to matching gestures. Furthermore, signal power at the intermodulation frequencies of the frequency tags, indexing nonlinear signal interactions, was enhanced in the left frontotemporal and frontal regions. Focusing on the left inferior frontal gyrus, this enhancement was specific for the attended information, for those trials that benefitted from integration with a matching gesture. Together, our results suggest that attention modulates audiovisual processing and interaction, depending on the congruence and quality of the sensory input.

Long-Horizon Associative Learning Explains Human Sensitivity to Statistical and Network Structures in Auditory Sequences.

Networks are a useful mathematical tool for capturing the complexity of the world. In a previous behavioral study, we showed that human adults were sensitive to the high-level network structure underlying auditory sequences, even when presented with incomplete information. Their performance was best explained by a mathematical model compatible with associative learning principles, based on the integration of the transition probabilities between adjacent and nonadjacent elements with a memory decay. In the present study, we explored the neural correlates of this hypothesis via magnetoencephalography (MEG). Participants (N = 23, 16 females) passively listened to sequences of tones organized in a sparse community network structure comprising two communities. An early difference (∼150 ms) was observed in the brain responses to tone transitions with similar transition probability but occurring either within or between communities. This result implies a rapid and automatic encoding of the sequence structure. Using time-resolved decoding, we estimated the duration and overlap of the representation of each tone. The decoding performance exhibited exponential decay, resulting in a significant overlap between the representations of successive tones. Based on this extended decay profile, we estimated a long-horizon associative learning novelty index for each transition and found a correlation of this measure with the MEG signal. Overall, our study sheds light on the neural mechanisms underlying human sensitivity to network structures and highlights the potential role of Hebbian-like mechanisms in supporting learning at various temporal scales.

The binding of PKCε and MEG2 to STAT3 regulates IL-6-mediated microglial hyperalgesia during inflammatory pain.

Studies have suggested that microglial IL-6 modulates inflammatory pain; however, the exact mechanism of action remains unclear. We therefore hypothesized that PKCε and MEG2 competitively bind to STAT3 and contribute to IL-6-mediated microglial hyperalgesia during inflammatory pain. Freund's complete adjuvant (FCA) and lipopolysaccharide (LPS) were used to induce hyperalgesia model mice and microglial inflammation. Mechanical allodynia was evaluated using von Frey tests in vivo. The interaction among PKCε, MEG2, and STAT3 was determined using ELISA and immunoprecipitation assay in vitro. The PKCε, MEG2, t-STAT3, pSTAT3Tyr705, pSTAT3Ser727, IL-6, GLUT3, and TREM2 were assessed by Western blot. IL-6 promoter activity and IL-6 concentration were examined using dual luciferase assays and ELISA. Overexpression of PKCε and MEG2 promoted and attenuated inflammatory pain, accompanied by an increase and decrease in IL-6 expression, respectively. PKCε displayed a stronger binding ability to STAT3 when competing with MEG2. STAT3Ser727 phosphorylation increased STAT3 interaction with both PKCε and MEG2. Moreover, LPS increased PKCε, MEG2, pSTAT3Tyr705, pSTAT3Ser727, IL-6, and GLUT3 levels and decreased TREM2 during microglia inflammation. IL-6 promoter activity was enhanced or inhibited by PKCε or MEG2 in the presence of STAT3 and LPS stimulation, respectively. In microglia, overexpression of PKCε and/or MEG2 resulted in the elevation of tSTAT3, pSTAT3Tyr705, pSTAT3Ser727, IL-6, and TREM2, and the reduction of GLUT3. PKCε is more potent than MEG2 when competitively binding to STAT3, displaying dual modulatory effects of IL-6 production, thus regulating the GLUT3 and TREM2 in microglia during inflammatory pain sensation.

Strengthening of alpha synchronization is a neural correlate of cognitive transfer.

Cognitive training can lead to improvements in both task-specific strategies and general capacities, such as visuo-spatial working memory (VSWM). The latter emerge slowly and linearly throughout training, in contrast to strategy where changes typically occur within the first days of training. Changes in strategy and capacity have not been separated in prior neuroimaging studies. Here, we used a within-participants design with dense temporal sampling to capture the time dynamics of neural mechanisms associated with change in capacity. In four participants, neural activity was recorded with magnetoencephalography on seven occasions over two months of visuo-spatial working memory training. During scanning, the participants performed a trained visuo-spatial working memory task, a transfer task, and a control task. First, we extracted an individual visuo-spatial working memory-load-dependent synchronization network for each participant. Next, we identified linear changes over time in the network, congruent with the temporal dynamics of capacity change. Three out of four participants showed a gradual strengthening of alpha synchronization. Strengthening of the same connections was also found in the transfer task but not in the control task. This suggests that cognitive transfer occurs through slow, gradual strengthening of alpha synchronization between cortical regions that are vital for both the trained task and the transfer task.

The effect of voice familiarity on attention to speech in a cocktail party scenario.

Selective attention to one speaker in multi-talker environments can be affected by the acoustic and semantic properties of speech. One highly ecological feature of speech that has the potential to assist in selective attention is voice familiarity. Here, we tested how voice familiarity interacts with selective attention by measuring the neural speech-tracking response to both target and non-target speech in a dichotic listening "Cocktail Party" paradigm. We measured Magnetoencephalography from n = 33 participants, presented with concurrent narratives in two different voices, and instructed to pay attention to one ear ("target") and ignore the other ("non-target"). Participants were familiarized with one of the voices during the week prior to the experiment, rendering this voice familiar to them. Using multivariate speech-tracking analysis we estimated the neural responses to both stimuli and replicate their well-established modulation by selective attention. Importantly, speech-tracking was also affected by voice familiarity, showing enhanced response for target speech and reduced response for non-target speech in the contra-lateral hemisphere, when these were in a familiar vs. an unfamiliar voice. These findings offer valuable insight into how voice familiarity, and by extension, auditory-semantics, interact with goal-driven attention, and facilitate perceptual organization and speech processing in noisy environments.

A Multivariate analysis on evoked components of Chinese semantic congruity: an OP-MEG study with EEG.

The application of wearable magnetoencephalography using optically-pumped magnetometers has drawn extensive attention in the field of neuroscience. Electroencephalogram system can cover the whole head and reflect the overall activity of a large number of neurons. The efficacy of optically-pumped magnetometer in detecting event-related components can be validated through electroencephalogram results. Multivariate pattern analysis is capable of tracking the evolution of neurocognitive processes over time. In this paper, we adopted a classical Chinese semantic congruity paradigm and separately collected electroencephalogram and optically-pumped magnetometer signals. Then, we verified the consistency of optically-pumped magnetometer and electroencephalogram in detecting N400 using mutual information index. Multivariate pattern analysis revealed the difference in decoding performance of these two modalities, which can be further validated by dynamic/stable coding analysis on the temporal generalization matrix. The results from searchlight analysis provided a neural basis for this dissimilarity at the magnetoencephalography source level and the electroencephalogram sensor level. This study opens a new avenue for investigating the brain's coding patterns using wearable magnetoencephalography and reveals the differences in sensitivity between the two modalities in reflecting neuron representation patterns.

A hierarchy of linguistic predictions during natural language comprehension.

Understanding spoken language requires transforming ambiguous acoustic streams into a hierarchy of representations, from phonemes to meaning. It has been suggested that the brain uses prediction to guide the interpretation of incoming input. However, the role of prediction in language processing remains disputed, with disagreement about both the ubiquity and representational nature of predictions. Here, we address both issues by analyzing brain recordings of participants listening to audiobooks, and using a deep neural network (GPT-2) to precisely quantify contextual predictions. First, we establish that brain responses to words are modulated by ubiquitous predictions. Next, we disentangle model-based predictions into distinct dimensions, revealing dissociable neural signatures of predictions about syntactic category (parts of speech), phonemes, and semantics. Finally, we show that high-level (word) predictions inform low-level (phoneme) predictions, supporting hierarchical predictive processing. Together, these results underscore the ubiquity of prediction in language processing, showing that the brain spontaneously predicts upcoming language at multiple levels of abstraction.