Neural event segmentation of continuous experience in human infants.

How infants experience the world is fundamental to understanding their cognition and development. A key principle of adult experience is that, despite receiving continuous sensory input, we perceive this input as discrete events. Here we investigate such event segmentation in infants and how it differs from adults. Research on event cognition in infants often uses simplified tasks in which (adult) experimenters help solve the segmentation problem for infants by defining event boundaries or presenting discrete actions/vignettes. This presupposes which events are experienced by infants and leaves open questions about the principles governing infant segmentation. We take a different, data-driven approach by studying infant event segmentation of continuous input. We collected whole-brain functional MRI (fMRI) data from awake infants (and adults, for comparison) watching a cartoon and used a hidden Markov model to identify event states in the brain. We quantified the existence, timescale, and organization of multiple-event representations across brain regions. The adult brain exhibited a known hierarchical gradient of event timescales, from shorter events in early visual regions to longer events in later visual and associative regions. In contrast, the infant brain represented only longer events, even in early visual regions, with no timescale hierarchy. The boundaries defining these infant events only partially overlapped with boundaries defined from adult brain activity and behavioral judgments. These findings suggest that events are organized differently in infants, with longer timescales and more stable neural patterns, even in sensory regions. This may indicate greater temporal integration and reduced temporal precision during dynamic, naturalistic perception.

Hippocampal Mechanisms Support Cortisol-Induced Memory Enhancements.

Stress can powerfully influence episodic memory, often enhancing memory encoding for emotionally salient information. These stress-induced memory enhancements stand at odds with demonstrations that stress and the stress-related hormone cortisol can negatively affect the hippocampus, a brain region important for episodic memory encoding. To resolve this apparent conflict and determine whether and how the hippocampus supports memory encoding under cortisol, we combined behavioral assays of associative memory, high-resolution fMRI, and pharmacological manipulation of cortisol in a within-participant, double-blinded procedure (in both sexes). Behaviorally, hydrocortisone promoted the encoding of subjectively arousing, positive associative memories. Neurally, hydrocortisone led to enhanced functional connectivity between hippocampal subregions, which predicted subsequent memory enhancements for emotional associations. Cortisol also modified the relationship between hippocampal representations and associative memory: whereas hippocampal signatures of distinctiveness predicted memory under placebo, relative integration predicted memory under cortisol. Together, these data provide novel evidence that the human hippocampus contains the necessary machinery to support emotional associative memory enhancements under cortisol.SIGNIFICANCE STATEMENT Our daily lives are filled with stressful events, which powerfully shape the way we form episodic memories. For example, stress and stress-related hormones can enhance our memory for emotional events. However, the mechanisms underlying these memory benefits are unclear. In the current study, we combined functional neuroimaging, behavioral tests of memory, and double-blind, placebo-controlled hydrocortisone administration to uncover the effects of the stress-related hormone cortisol on the function of the human hippocampus, a brain region important for episodic memory. We identified novel ways in which cortisol can enhance hippocampal function to promote emotional memories, highlighting the adaptive role of cortisol in shaping memory formation.

Acute Stress Effects on Statistical Learning and Episodic Memory.

Stress is widely considered to negatively impact hippocampal function, thus impairing episodic memory. However, the hippocampus is not merely the seat of episodic memory. Rather, it also (via distinct circuitry) supports statistical learning. On the basis of rodent work suggesting that stress may impair the hippocampal pathway involved in episodic memory while sparing or enhancing the pathway involved in statistical learning, we developed a behavioral experiment to investigate the effects of acute stress on both episodic memory and statistical learning in humans. Participants were randomly assigned to one of three conditions: stress (socially evaluated cold pressor) immediately before learning, stress ∼15 min before learning, or no stress. In the learning task, participants viewed a series of trial-unique scenes (allowing for episodic encoding of each image) in which certain scene categories reliably followed one another (allowing for statistical learning of associations between paired categories). Memory was assessed 24 hr later to isolate stress effects on encoding/learning rather than retrieval. We found modest support for our hypothesis that acute stress can amplify statistical learning: Only participants stressed ∼15 min in advance exhibited reliable evidence of learning across multiple measures. Furthermore, stress-induced cortisol levels predicted statistical learning retention 24 hr later. In contrast, episodic memory did not differ by stress condition, although we did find preliminary evidence that acute stress promoted memory for statistically predictable information and attenuated competition between statistical and episodic encoding. Together, these findings provide initial insights into how stress may differentially modulate learning processes within the hippocampus.

Statistical learning in epilepsy: Behavioral and anatomical mechanisms in the human brain.

OBJECTIVE: Statistical learning, the fundamental cognitive ability of humans to extract regularities across experiences over time, engages the medial temporal lobe (MTL) in the healthy brain. This leads to the hypothesis that statistical learning (SL) may be impaired in patients with epilepsy (PWE) involving the temporal lobe, and that this impairment could contribute to their varied memory deficits. In turn, studies done in collaboration with PWE, that evaluate the necessity of MTL circuitry through disease and causal perturbations, provide an opportunity to advance basic understanding of SL. METHODS: We implemented behavioral testing, volumetric analysis of the MTL substructures, and direct electrical brain stimulation to examine SL across a cohort of 61 PWE and 28 healthy controls. RESULTS: We found that behavioral performance in an SL task was negatively associated with seizure frequency irrespective of seizure origin. The volume of hippocampal subfields CA1 and CA2/3 correlated with SL performance, suggesting a more specific role of the hippocampus. Transient direct electrical stimulation of the hippocampus disrupted SL. Furthermore, the relationship between SL and seizure frequency was selective, as behavioral performance in an episodic memory task was not impacted by seizure frequency. SIGNIFICANCE: Overall, these results suggest that SL may be hippocampally dependent and that the SL task could serve as a clinically useful behavioral assay of seizure frequency that may complement existing approaches such as seizure diaries. Simple and short SL tasks may thus provide patient-centered endpoints for evaluating the efficacy of novel treatments in epilepsy.

Functional networks in the infant brain during sleep and wake states.

Functional brain networks are assessed differently earlier versus later in development: infants are almost universally scanned asleep, whereas adults are typically scanned awake. Observed differences between infant and adult functional networks may thus reflect differing states of consciousness rather than or in addition to developmental changes. We explore this question by comparing functional networks in functional magnetic resonance imaging (fMRI) scans of infants during natural sleep and awake movie-watching. As a reference, we also scanned adults during awake rest and movie-watching. Whole-brain functional connectivity was more similar within the same state (sleep and movie in infants; rest and movie in adults) compared with across states. Indeed, a classifier trained on patterns of functional connectivity robustly decoded infant state and even generalized to adults; interestingly, a classifier trained on adult state did not generalize as well to infants. Moreover, overall similarity between infant and adult functional connectivity was modulated by adult state (stronger for movie than rest) but not infant state (same for sleep and movie). Nevertheless, the connections that drove this similarity, particularly in the frontoparietal control network, were modulated by infant state. In sum, infant functional connectivity differs between sleep and movie states, highlighting the value of awake fMRI for studying functional networks over development.

Neural signatures of second language proficiency in narrative processing.

Making sense of speech in a second language relies on multiple abilities. Differences in brain activity related to proficiency in language tasks have often been attributed to processing demands. However, during naturalistic narrative comprehension, listeners at different proficiency levels may form different representations of the same speech. We hypothesized that the intersubject synchronization of these representations could be used to measure second-language proficiency. Using a searchlight-shared response model, we found highly proficient participants showed synchronization in regions similar to those of native speakers, including in the default mode network and the lateral prefrontal cortex. In contrast, participants with low proficiency showed more synchronization in auditory cortex and word-level semantic processing areas in the temporal lobe. Moderate proficiency showed the greatest neural diversity, suggesting lower consistency in the source of this partial proficiency. Based on these synchronization differences, we were able to classify the proficiency level or predict behavioral performance on an independent English test in held-out participants, suggesting the identified neural systems represented proficiency-sensitive information that was generalizable to other individuals. These findings suggest higher second-language proficiency leads to more native-like neural processing of naturalistic language, including in systems beyond the cognitive control network or the core language network.

Attention recruits frontal cortex in human infants.

Young infants learn about the world by overtly shifting their attention to perceptually salient events. In adults, attention recruits several brain regions spanning the frontal and parietal lobes. However, it is unclear whether these regions are sufficiently mature in infancy to support attention and, more generally, how infant attention is supported by the brain. We used event-related functional magnetic resonance imaging (fMRI) in 24 sessions from 20 awake behaving infants 3 mo to 12 mo old while they performed a child-friendly attentional cuing task. A target was presented to either the left or right of the infant's fixation, and offline gaze coding was used to measure the latency with which they saccaded to the target. To manipulate attention, a brief cue was presented before the target in three conditions: on the same side as the upcoming target (valid), on the other side (invalid), or on both sides (neutral). All infants were faster to look at the target on valid versus invalid trials, with valid faster than neutral and invalid slower than neutral, indicating that the cues effectively captured attention. We then compared the fMRI activity evoked by these trial types. Regions of adult attention networks activated more strongly for invalid than valid trials, particularly frontal regions. Neither behavioral nor neural effects varied by infant age within the first year, suggesting that these regions may function early in development to support the orienting of attention. Together, this furthers our mechanistic understanding of how the infant brain controls the allocation of attention.

Temporal Dynamics of Competition between Statistical Learning and Episodic Memory in Intracranial Recordings of Human Visual Cortex.

The function of long-term memory is not just to reminisce about the past, but also to make predictions that help us behave appropriately and efficiently in the future. This predictive function of memory provides a new perspective on the classic question from memory research of why we remember some things but not others. If prediction is a key outcome of memory, then the extent to which an item generates a prediction signifies that this information already exists in memory and need not be encoded. We tested this principle using human intracranial EEG as a time-resolved method to quantify prediction in visual cortex during a statistical learning task and link the strength of these predictions to subsequent episodic memory behavior. Epilepsy patients of both sexes viewed rapid streams of scenes, some of which contained regularities that allowed the category of the next scene to be predicted. We verified that statistical learning occurred using neural frequency tagging and measured category prediction with multivariate pattern analysis. Although neural prediction was robust overall, this was driven entirely by predictive items that were subsequently forgotten. Such interference provides a mechanism by which prediction can regulate memory formation to prioritize encoding of information that could help learn new predictive relationships.SIGNIFICANCE STATEMENT When faced with a new experience, we are rarely at a loss for what to do. Rather, because many aspects of the world are stable over time, we rely on past experiences to generate expectations that guide behavior. Here we show that these expectations during a new experience come at the expense of memory for that experience. From intracranial recordings of visual cortex, we decoded what humans expected to see next in a series of photographs based on patterns of neural activity. Photographs that generated strong neural expectations were more likely to be forgotten in a later behavioral memory test. Prioritizing the storage of experiences that currently lead to weak expectations could help improve these expectations in future encounters.

Intracranial Entrainment Reveals Statistical Learning across Levels of Abstraction.

We encounter the same people, places, and objects in predictable sequences and configurations. Humans efficiently learn these regularities via statistical learning. Importantly, statistical learning creates knowledge not only of specific regularities but also of regularities that apply more generally across related experiences (i.e., across members of a category). Prior evidence for different levels of learning comes from post-exposure behavioral tests, leaving open the question of whether more abstract regularities are detected online during initial exposure. We address this question by measuring neural entrainment in intracranial recordings. Neurosurgical patients viewed a stream of photographs with regularities at one of two levels: In the exemplar-level structured condition, the same photographs appeared repeatedly in pairs. In the category-level structured condition, the photographs were trial-unique but their categories were paired across repetitions. In a baseline random condition, the same photographs repeated but in a scrambled order. We measured entrainment at the frequency of individual photographs, which was expected in all conditions, but critically also at half that frequency-the rate at which to-be-learned pairs appeared in the two structured (but not random) conditions. Entrainment to both exemplar and category pairs emerged within minutes throughout visual cortex and in frontal and temporal regions. Many electrode contacts were sensitive to only one level of structure, but a significant number encoded both levels. These findings suggest that the brain spontaneously uncovers category-level regularities during statistical learning, providing insight into the brain's unsupervised mechanisms for building flexible and robust knowledge that generalizes across input variation and conceptual hierarchies.

Perception and memory retrieval states are reflected in distributed patterns of background functional connectivity.

The same visual input can serve as the target of perception or as a trigger for memory retrieval depending on whether cognitive processing is externally oriented (perception) or internally oriented (memory retrieval). While numerous human neuroimaging studies have characterized how visual stimuli are differentially processed during perception versus memory retrieval, perception and memory retrieval may also be associated with distinct neural states that are independent of stimulus-evoked neural activity. Here, we combined human fMRI with full correlation matrix analysis (FCMA) to reveal potential differences in "background" functional connectivity across perception and memory retrieval states. We found that perception and retrieval states could be discriminated with high accuracy based on patterns of connectivity across (1) the control network, (2) the default mode network (DMN), and (3) retrosplenial cortex (RSC). In particular, clusters in the control network increased connectivity with each other during the perception state, whereas clusters in the DMN were more strongly coupled during the retrieval state. Interestingly, RSC switched its coupling between networks as the cognitive state shifted from retrieval to perception. Finally, we show that background connectivity (1) was fully independent from stimulus-related variance in the signal and, further, (2) captured distinct aspects of cognitive states compared to traditional classification of stimulus-evoked responses. Together, our results reveal that perception and memory retrieval are associated with sustained cognitive states that manifest as distinct patterns of connectivity among large-scale brain networks.