A smartphone intervention that enhances real-world memory and promotes differentiation of hippocampal activity in older adults.

The act of remembering an everyday experience influences how we interpret the world, how we think about the future, and how we perceive ourselves. It also enhances long-term retention of the recalled content, increasing the likelihood that it will be recalled again. Unfortunately, the ability to recollect event-specific details and reexperience the past tends to decline with age. This decline in recollection may reflect a corresponding decrease in the distinctiveness of hippocampal memory representations. Despite these well-established changes, there are few effective cognitive behavioral interventions that target real-world episodic memory. We addressed this gap by developing a smartphone-based application called HippoCamera that allows participants to record labeled videos of everyday events and subsequently replay, high-fidelity autobiographical memory cues. In two experiments, we found that older adults were able to easily integrate this noninvasive intervention into their daily lives. Using HippoCamera to repeatedly reactivate memories for real-world events improved episodic recollection and it evoked more positive autobiographical sentiment at the time of retrieval. In both experiments, these benefits were observed shortly after the intervention and again after a 3-mo delay. Moreover, more detailed recollection was associated with more differentiated memory signals in the hippocampus. Thus, using this smartphone application to systematically reactivate memories for recent real-world experiences can help to maintain a bridge between the present and past in older adults.

Transformation of speech sequences in human sensorimotor circuits.

After we listen to a series of words, we can silently replay them in our mind. Does this mental replay involve a reactivation of our original perceptual dynamics? We recorded electrocorticographic (ECoG) activity across the lateral cerebral cortex as people heard and then mentally rehearsed spoken sentences. For each region, we tested whether silent rehearsal of sentences involved reactivation of sentence-specific representations established during perception or transformation to a distinct representation. In sensorimotor and premotor cortex, we observed reliable and temporally precise responses to speech; these patterns transformed to distinct sentence-specific representations during mental rehearsal. In contrast, we observed less reliable and less temporally precise responses in prefrontal and temporoparietal cortex; these higher-order representations, which were sensitive to sentence semantics, were shared across perception and rehearsal of the same sentence. The mental rehearsal of natural speech involves the transformation of stimulus-locked speech representations in sensorimotor and premotor cortex, combined with diffuse reactivation of higher-order semantic representations.

Temporal integration of narrative information in a hippocampal amnesic patient.

Default network regions appear to integrate information over time windows of 30 â€‹s or more during narrative listening. Does this long-timescale capability require the hippocampus? Amnesic behavior suggests that regions other than the hippocampus can independently support some online processing when input is continuous and semantically rich: amnesics can participate in conversations and tell stories spanning minutes, and when tested immediately on recently heard prose they are able to retain some information. We hypothesized that default network regions can integrate the semantically coherent information of a narrative across long time windows, even in the absence of an intact hippocampus. To test this prediction, we measured BOLD activity in the brain of a hippocampal amnesic patient (D.A.) and healthy control participants while they listened to a 7 min narrative. The narrative was played either in its intact form, or as a paragraph-scrambled version, which has been previously shown to interfere with the long-range temporal dependencies in default network activity. In the intact story condition, D.A.'s moment-by-moment BOLD activity spatial patterns were similar to those of controls in low-level auditory cortex as well as in some high-level default network regions (including lateral and medial posterior parietal cortex). Moreover, as in controls, D.A.'s response patterns in medial and lateral posterior parietal cortex were disrupted when paragraphs of the story were presented in a shuffled order, suggesting that activity in these areas did depend on information from 30 â€‹s or more in the past. Together, these results suggest that some default network cortical areas can integrate information across long timescales, even when the hippocampus is severely damaged.

Phase and amplitude dynamics of coupled oscillator systems on complex networks.

We investigated locking behaviors of coupled limit-cycle oscillators with phase and amplitude dynamics. We focused on how the dynamics are affected by inhomogeneous coupling strength and by angular and radial shifts in coupling functions. We performed mean-field analyses of oscillator systems with inhomogeneous coupling strength, testing Gaussian, power-law, and brain-like degree distributions. Even for oscillators with identical intrinsic frequencies and intrinsic amplitudes, we found that the coupling strength distribution and the coupling function generated a wide repertoire of phase and amplitude dynamics. These included fully and partially locked states in which high-degree or low-degree nodes would phase-lead the network. The mean-field analytical findings were confirmed via numerical simulations. The results suggest that, in oscillator systems in which individual nodes can independently vary their amplitude over time, qualitatively different dynamics can be produced via shifts in the coupling strength distribution and the coupling form. Of particular relevance to information flows in oscillator networks, changes in the non-specific drive to individual nodes can make high-degree nodes phase-lag or phase-lead the rest of the network.

Induction and Quantification of Excitability Changes in Human Cortical Networks.

How does human brain stimulation result in lasting changes in cortical excitability? Uncertainty on this question hinders the development of personalized brain stimulation therapies. To characterize how cortical excitability is altered by stimulation, we applied repetitive direct electrical stimulation in eight human subjects (male and female) undergoing intracranial monitoring. We evaluated single-pulse corticocortical-evoked potentials (CCEPs) before and after repetitive stimulation across prefrontal (n = 4), temporal (n = 1), and motor (n = 3) cortices. We asked whether a single session of repetitive stimulation was sufficient to induce excitability changes across distributed cortical sites. We found a subset of regions at which 10 Hz prefrontal repetitive stimulation resulted in both potentiation and suppression of excitability that persisted for at least 10 min. We then asked whether these dynamics could be modeled by the prestimulation connectivity profile of each subject. We found that cortical regions (1) anatomically close to the stimulated site and (2) exhibiting high-amplitude CCEPs underwent changes in excitability following repetitive stimulation. We demonstrate high accuracy (72-95%) and discriminability (81-99%) in predicting regions exhibiting changes using individual subjects' prestimulation connectivity profile, and show that adding prestimulation connectivity features significantly improved model performance. The same features predicted regions of modulation following motor and temporal cortices stimulation in an independent dataset. Together, baseline connectivity profile can be used to predict regions susceptible to brain changes and provides a basis for personalizing brain stimulation.SIGNIFICANCE STATEMENT Brain stimulation is increasingly used to treat neuropsychiatric disorders by inducing excitability changes at specific brain regions. However, our understanding of how, when, and where these changes are induced is critically lacking. We inferred plasticity in the human brain after applying electrical stimulation to the brain's surface and measuring changes in excitability. We observed excitability changes in regions anatomically and functionally closer to the stimulation site. Those in responsive regions were accurately predicted using a classifier trained on baseline brain network characteristics. Finally, we showed that the excitability changes can potentially be monitored in real-time. These results begin to fill basic gaps in our understanding of stimulation-induced brain dynamics in humans and offer pathways to optimize stimulation protocols.

Elucidating relations between fMRI, ECoG, and EEG through a common natural stimulus.

Human brain mapping relies heavily on fMRI, ECoG and EEG, which capture different physiological signals. Relationships between these signals have been established in the context of specific tasks or during resting state, often using spatially confined concurrent recordings in animals. But it is not certain whether these correlations generalize to other contexts relevant for human cognitive neuroscience. Here, we address the case of complex naturalistic stimuli and ask two basic questions. First, how reliable are the responses evoked by a naturalistic audio-visual stimulus in each of these imaging methods, and second, how similar are stimulus-related responses across methods? To this end, we investigated a wide range of brain regions and frequency bands. We presented the same movie clip twice to three different cohorts of subjects (NEEG = 45, NfMRI = 11, NECoG = 5) and assessed stimulus-driven correlations across viewings and between imaging methods, thereby ruling out task-irrelevant confounds. All three imaging methods had similar repeat-reliability across viewings when fMRI and EEG data were averaged across subjects, highlighting the potential to achieve large signal-to-noise ratio by leveraging large sample sizes. The fMRI signal correlated positively with high-frequency ECoG power across multiple task-related cortical structures but positively with low-frequency EEG and ECoG power. In contrast to previous studies, these correlations were as strong for low-frequency as for high frequency ECoG. We also observed links between fMRI and infra-slow EEG voltage fluctuations. These results extend previous findings to the case of natural stimulus processing.

Same Story, Different Story.

Differences in people's beliefs can substantially impact their interpretation of a series of events. In this functional MRI study, we manipulated subjects' beliefs, leading two groups of subjects to interpret the same narrative in different ways. We found that responses in higher-order brain areas-including the default-mode network, language areas, and subsets of the mirror neuron system-tended to be similar among people who shared the same interpretation, but different from those of people with an opposing interpretation. Furthermore, the difference in neural responses between the two groups at each moment was correlated with the magnitude of the difference in the interpretation of the narrative. This study demonstrates that brain responses to the same event tend to cluster together among people who share the same views.

Coupled neural systems underlie the production and comprehension of naturalistic narrative speech.

Neuroimaging studies of language have typically focused on either production or comprehension of single speech utterances such as syllables, words, or sentences. In this study we used a new approach to functional MRI acquisition and analysis to characterize the neural responses during production and comprehension of complex real-life speech. First, using a time-warp based intrasubject correlation method, we identified all areas that are reliably activated in the brains of speakers telling a 15-min-long narrative. Next, we identified areas that are reliably activated in the brains of listeners as they comprehended that same narrative. This allowed us to identify networks of brain regions specific to production and comprehension, as well as those that are shared between the two processes. The results indicate that production of a real-life narrative is not localized to the left hemisphere but recruits an extensive bilateral network, which overlaps extensively with the comprehension system. Moreover, by directly comparing the neural activity time courses during production and comprehension of the same narrative we were able to identify not only the spatial overlap of activity but also areas in which the neural activity is coupled across the speaker's and listener's brains during production and comprehension of the same narrative. We demonstrate widespread bilateral coupling between production- and comprehension-related processing within both linguistic and nonlinguistic areas, exposing the surprising extent of shared processes across the two systems.

How long is now? The multiple timescales of language processing.

Christiansen & Chater (C&C) envision language function as a hierarchical chain of transformations, enabling rapid, continuous processing of input. Their notion of a "Now-or-Never" bottleneck may be elaborated by recognizing that timescales become longer at successive levels of the sensory processing hierarchy - that is, the window of "Now" expands. We propose that a hierarchical "process memory" is intrinsic to language processing.

Corticocortical evoked potentials reveal projectors and integrators in human brain networks.

The cerebral cortex is composed of subregions whose functional specialization is largely determined by their incoming and outgoing connections with each other. In the present study, we asked which cortical regions can exert the greatest influence over other regions and the cortical network as a whole. Previous research on this question has relied on coarse anatomy (mapping large fiber pathways) or functional connectivity (mapping inter-regional statistical dependencies in ongoing activity). Here we combined direct electrical stimulation with recordings from the cortical surface to provide a novel insight into directed, inter-regional influence within the cerebral cortex of awake humans. These networks of directed interaction were reproducible across strength thresholds and across subjects. Directed network properties included (1) a decrease in the reciprocity of connections with distance; (2) major projector nodes (sources of influence) were found in peri-Rolandic cortex and posterior, basal and polar regions of the temporal lobe; and (3) major receiver nodes (receivers of influence) were found in anterolateral frontal, superior parietal, and superior temporal regions. Connectivity maps derived from electrical stimulation and from resting electrocorticography (ECoG) correlations showed similar spatial distributions for the same source node. However, higher-level network topology analysis revealed differences between electrical stimulation and ECoG that were partially related to the reciprocity of connections. Together, these findings inform our understanding of large-scale corticocortical influence as well as the interpretation of functional connectivity networks.

Contextual alignment of cognitive and neural dynamics.

Effective real-world communication requires the alignment of multiple individuals to a common perspective or mental framework. To study how this alignment occurs at the level of the brain, we measured BOLD response during fMRI while participants (n = 24) listened to a series of vignettes either in the presence or absence of a valid contextual cue. The valid contextual cue was necessary to understand the information in each vignette. We then examined where and to what extent the shared valid context led to greater intersubject similarity of neural processing. Regions of the default mode network including posterior cingulate cortex and medial pFC became more aligned when participants shared a valid contextual framework, whereas other regions, including primary sensory cortices, responded to the stimuli reliably regardless of contextual factors. Taken in conjunction with previous research, the present results suggest that default mode regions help the brain to organize incoming verbal information in the context of previous knowledge.

Selective and invariant neural responses to spoken and written narratives.

Linguistic content can be conveyed both in speech and in writing. But how similar is the neural processing when the same real-life information is presented in spoken and written form? Using functional magnetic resonance imaging, we recorded neural responses from human subjects who either listened to a 7 min spoken narrative or read a time-locked presentation of its transcript. Next, within each brain area, we directly compared the response time courses elicited by the written and spoken narrative. Early visual areas responded selectively to the written version, and early auditory areas to the spoken version of the narrative. In addition, many higher-order parietal and frontal areas demonstrated strong selectivity, responding far more reliably to either the spoken or written form of the narrative. By contrast, the response time courses along the superior temporal gyrus and inferior frontal gyrus were remarkably similar for spoken and written narratives, indicating strong modality-invariance of linguistic processing in these circuits. These results suggest that our ability to extract the same information from spoken and written forms arises from a mixture of selective neural processes in early (perceptual) and high-order (control) areas, and modality-invariant responses in linguistic and extra-linguistic areas.

Neural correlates of risk perception during real-life risk communication.

During global health crises, such as the recent H1N1 pandemic, the mass media provide the public with timely information regarding risk. To obtain new insights into how these messages are received, we measured neural data while participants, who differed in their preexisting H1N1 risk perceptions, viewed a TV report about H1N1. Intersubject correlation (ISC) of neural time courses was used to assess how similarly the brains of viewers responded to the TV report. We found enhanced intersubject correlations among viewers with high-risk perception in the anterior cingulate, a region which classical fMRI studies associated with the appraisal of threatening information. By contrast, neural coupling in sensory-perceptual regions was similar for the high and low H1N1-risk perception groups. These results demonstrate a novel methodology for understanding how real-life health messages are processed in the human brain, with particular emphasis on the role of emotion and differences in risk perceptions.

Neurophysiological investigation of spontaneous correlated and anticorrelated fluctuations of the BOLD signal.

Analyses of intrinsic fMRI BOLD signal fluctuations reliably reveal correlated and anticorrelated functional networks in the brain. Because the BOLD signal is an indirect measure of neuronal activity and anticorrelations can be introduced by preprocessing steps, such as global signal regression, the neurophysiological significance of correlated and anticorrelated BOLD fluctuations is a source of debate. Here, we address this question by examining the correspondence between the spatial organization of correlated BOLD fluctuations and correlated fluctuations in electrophysiological high γ power signals recorded directly from the cortical surface of 5 patients. We demonstrate that both positive and negative BOLD correlations have neurophysiological correlates reflected in fluctuations of spontaneous neuronal activity. Although applying global signal regression to BOLD signals results in some BOLD anticorrelations that are not apparent in the ECoG data, it enhances the neuronal-hemodynamic correspondence overall. Together, these findings provide support for the neurophysiological fidelity of BOLD correlations and anticorrelations.

Broadband changes in the cortical surface potential track activation of functionally diverse neuronal populations.

We illustrate a general principal of electrical potential measurements from the surface of the cerebral cortex, by revisiting and reanalyzing experimental work from the visual, language and motor systems. A naive decomposition technique of electrocorticographic power spectral measurements reveals that broadband spectral changes reliably track task engagement. These broadband changes are shown to be a generic correlate of local cortical function across a variety of brain areas and behavioral tasks. Furthermore, they fit a power-law form that is consistent with simple models of the dendritic integration of asynchronous local population firing. Because broadband spectral changes covary with diverse perceptual and behavioral states on the timescale of 20-50 ms, they provide a powerful and widely applicable experimental tool.

Not lost in translation: neural responses shared across languages.

How similar are the brains of listeners who hear the same content expressed in different languages? We directly compared the fMRI response time courses of English speakers and Russian speakers who listened to a real-life Russian narrative and its English translation. In the translation, we tried to preserve the content of the narrative while reducing the structural similarities across languages. The story evoked similar brain responses, invariant to the structural changes across languages, beginning just outside early auditory areas and extending through temporal, parietal, and frontal cerebral cortices. The similarity of responses across languages was nearly equal to the similarity of responses within each language group. The present results demonstrate that the human brain processes real-life information in a manner that is largely insensitive to the language in which that information is conveyed. The methods introduced here can potentially be used to quantify the transmission of meaning across cultural and linguistic boundaries.

A place for time: the spatiotemporal structure of neural dynamics during natural audition.

We use functional magnetic resonance imaging (fMRI) to analyze neural responses to natural auditory stimuli. We characterize the fMRI time series through the shape of the voxel power spectrum and find that the timescales of neural dynamics vary along a spatial gradient, with faster dynamics in early auditory cortex and slower dynamics in higher order brain regions. The timescale gradient is observed through the unsupervised clustering of the power spectra of individual brains, both in the presence and absence of a stimulus, and is enhanced in the stimulus-locked component that is shared across listeners. Moreover, intrinsically faster dynamics occur in areas that respond preferentially to momentary stimulus features, while the intrinsically slower dynamics occur in areas that integrate stimulus information over longer timescales. These observations connect the timescales of intrinsic neural dynamics to the timescales of information processing, suggesting a temporal organizing principle for neural computation across the cerebral cortex.

Human motor cortical activity is selectively phase-entrained on underlying rhythms.

The functional significance of electrical rhythms in the mammalian brain remains uncertain. In the motor cortex, the 12-20 Hz beta rhythm is known to transiently decrease in amplitude during movement, and to be altered in many motor diseases. Here we show that the activity of neuronal populations is phase-coupled with the beta rhythm on rapid timescales, and describe how the strength of this relation changes with movement. To investigate the relationship of the beta rhythm to neuronal dynamics, we measured local cortical activity using arrays of subdural electrocorticographic (ECoG) electrodes in human patients performing simple movement tasks. In addition to rhythmic brain processes, ECoG potentials also reveal a spectrally broadband motif that reflects the aggregate neural population activity beneath each electrode. During movement, the amplitude of this broadband motif follows the dynamics of individual fingers, with somatotopically specific responses for different fingers at different sites on the pre-central gyrus. The 12-20 Hz beta rhythm, in contrast, is widespread as well as spatially coherent within sulcal boundaries and decreases in amplitude across the pre- and post-central gyri in a diffuse manner that is not finger-specific. We find that the amplitude of this broadband motif is entrained on the phase of the beta rhythm, as well as rhythms at other frequencies, in peri-central cortex during fixation. During finger movement, the beta phase-entrainment is diminished or eliminated. We suggest that the beta rhythm may be more than a resting rhythm, and that this entrainment may reflect a suppressive mechanism for actively gating motor function.

Psychological Momentum.

Our mental experience is largely continuous on the scale of seconds and minutes. However, this continuity does not always arise from a volitional carrying forward of ideas. Instead, recent actions, thoughts, dispositions, and emotions can persist in mind, continually shaping our later experience. Aspects of this fundamental property of human cognition - psychological momentum - have been studied under the rubrics of memory, task set, mood, mind-wandering, and mindset. Reviewing these largely independent threads of research, we argue that psychological momentum is best understood from an integrated perspective, as an adaptation that helps us meet the current demands of our environment and to form lasting memories.

Topographic mapping of a hierarchy of temporal receptive windows using a narrated story.

Real-life activities, such as watching a movie or engaging in conversation, unfold over many minutes. In the course of such activities, the brain has to integrate information over multiple time scales. We recently proposed that the brain uses similar strategies for integrating information across space and over time. Drawing a parallel with spatial receptive fields, we defined the temporal receptive window (TRW) of a cortical microcircuit as the length of time before a response during which sensory information may affect that response. Our previous findings in the visual system are consistent with the hypothesis that TRWs become larger when moving from low-level sensory to high-level perceptual and cognitive areas. In this study, we mapped TRWs in auditory and language areas by measuring fMRI activity in subjects listening to a real-life story scrambled at the time scales of words, sentences, and paragraphs. Our results revealed a hierarchical topography of TRWs. In early auditory cortices (A1+), brain responses were driven mainly by the momentary incoming input and were similarly reliable across all scrambling conditions. In areas with an intermediate TRW, coherent information at the sentence time scale or longer was necessary to evoke reliable responses. At the apex of the TRW hierarchy, we found parietal and frontal areas that responded reliably only when intact paragraphs were heard in a meaningful sequence. These results suggest that the time scale of processing is a functional property that may provide a general organizing principle for the human cerebral cortex.