Narrative simulation of social experiences in naturalistic context - A neurocinematic approach.

Narratives may be regarded as simulations of everyday social situations. They are key to studying the human mind in socio-culturally determined contexts as they allow anchoring to the common ground of embodied and environmentally-engaged cognition. Here we review recent findings from naturalistic neuroscience on neural functions in conditions that mimic lifelike situations. We will focus particularly on neurocinematics, a research field that applies mediated narratives as stimuli for neuroimaging experiments. During the last two decades, this paradigm has contributed to an accumulation of insights about the neural underpinnings of behavior and sense-making in various narratively contextualized situations particularly pertaining to socio-emotional encounters. One of the key questions in neurocinematics is, how do intersubjectively synchronized brain activations relate to subjective experiences? Another question we address is how to bring natural contexts into experimental studies. Seeking to respond to both questions, we suggest neurocinematic studies to examine three manifestations of the same phenomenon side-by-side: subjective experiences of narrative situations, unfolding of narrative stimulus structure, and neural processes that co-constitute the experience. This approach facilitates identifying experientially meaningful activity patterns in the brain and points out what they may mean in relation to shared and communicable contents. Via rich-featured and temporally contextualized narrative stimuli, neurocinematics attempts to contribute to emerging holistic theories of neural dynamics and connectomics explaining typical and atypical interindividual variability.

ADHD desynchronizes brain activity during watching a distracted multi-talker conversation.

Individuals with attention-deficit/hyperactivity disorder (ADHD) have difficulties navigating dynamic everyday situations that contain multiple sensory inputs that need to either be attended to or ignored. As conventional experimental tasks lack this type of everyday complexity, we administered a film-based multi-talker condition with auditory distractors in the background. ADHD-related aberrant brain responses to this naturalistic stimulus were identified using intersubject correlations (ISCs) in functional magnetic resonance imaging (fMRI) data collected from 51 adults with ADHD and 29 healthy controls. A novel permutation-based approach introducing studentized statistics and subject-wise voxel-level null-distributions revealed that several areas in cerebral attention networks and sensory cortices were desynchronized in participants with ADHD (n = 20) relative to healthy controls (n = 20). Specifically, desynchronization of the posterior parietal cortex occurred when irrelevant speech or music was presented in the background, but not when irrelevant white noise was presented, or when there were no distractors. We also show regionally distinct ISC signatures for inattention and impulsivity. Finally, post-scan recall of the film contents was associated with stronger ISCs in the default-mode network for the ADHD and in the dorsal attention network for healthy controls. The present study shows that ISCs can further our understanding of how a complex environment influences brain states in ADHD.

Out of focus - Brain attention control deficits in adult ADHD.

Modern environments are full of information, and place high demands on the attention control mechanisms that allow the selection of information from one (focused attention) or multiple (divided attention) sources, react to changes in a given situation (stimulus-driven attention), and allocate effort according to demands (task-positive and task-negative activity). We aimed to reveal how attention deficit hyperactivity disorder (ADHD) affects the brain functions associated with these attention control processes in constantly demanding tasks. Sixteen adults with ADHD and 17 controls performed adaptive visual and auditory discrimination tasks during functional magnetic resonance imaging (fMRI). Overlapping brain activity in frontoparietal saliency and default-mode networks, as well as in the somato-motor, cerebellar, and striatal areas were observed in all participants. In the ADHD participants, we observed exclusive activity enhancement in the brain areas typically considered to be primarily involved in other attention control functions: During auditory-focused attention, we observed higher activation in the sensory cortical areas of irrelevant modality and the default-mode network (DMN). DMN activity also increased during divided attention in the ADHD group, in turn decreasing during a simple button-press task. Adding irrelevant stimulation resulted in enhanced activity in the salience network. Finally, the irrelevant distractors that capture attention in a stimulus-driven manner activated dorsal attention networks and the cerebellum. Our findings suggest that attention control deficits involve the activation of irrelevant sensory modality, problems in regulating the level of attention on demand, and may encumber top-down processing in cases of irrelevant information.

Brain activity associated with selective attention, divided attention and distraction.

Top-down controlled selective or divided attention to sounds and visual objects, as well as bottom-up triggered attention to auditory and visual distractors, has been widely investigated. However, no study has systematically compared brain activations related to all these types of attention. To this end, we used functional magnetic resonance imaging (fMRI) to measure brain activity in participants performing a tone pitch or a foveal grating orientation discrimination task, or both, distracted by novel sounds not sharing frequencies with the tones or by extrafoveal visual textures. To force focusing of attention to tones or gratings, or both, task difficulty was kept constantly high with an adaptive staircase method. A whole brain analysis of variance (ANOVA) revealed fronto-parietal attention networks for both selective auditory and visual attention. A subsequent conjunction analysis indicated partial overlaps of these networks. However, like some previous studies, the present results also suggest segregation of prefrontal areas involved in the control of auditory and visual attention. The ANOVA also suggested, and another conjunction analysis confirmed, an additional activity enhancement in the left middle frontal gyrus related to divided attention supporting the role of this area in top-down integration of dual task performance. Distractors expectedly disrupted task performance. However, contrary to our expectations, activations specifically related to the distractors were found only in the auditory and visual cortices. This suggests gating of the distractors from further processing perhaps due to strictly focused attention in the current demanding discrimination tasks.

Top-down controlled and bottom-up triggered orienting of auditory attention to pitch activate overlapping brain networks.

A number of previous studies have suggested segregated networks of brain areas for top-down controlled and bottom-up triggered orienting of visual attention. However, the corresponding networks involved in auditory attention remain less studied. Our participants attended selectively to a tone stream with either a lower pitch or higher pitch in order to respond to infrequent changes in duration of attended tones. The participants were also required to shift their attention from one stream to the other when guided by a visual arrow cue. In addition to these top-down controlled cued attention shifts, infrequent task-irrelevant louder tones occurred in both streams to trigger attention in a bottom-up manner. Both cued shifts and louder tones were associated with enhanced activity in the superior temporal gyrus and sulcus, temporo-parietal junction, superior parietal lobule, inferior and middle frontal gyri, frontal eye field, supplementary motor area, and anterior cingulate gyrus. Thus, the present findings suggest that in the auditory modality, unlike in vision, top-down controlled and bottom-up triggered attention activate largely the same cortical networks. Comparison of the present results with our previous results from a similar experiment on spatial auditory attention suggests that fronto-parietal networks of attention to location or pitch overlap substantially. However, the auditory areas in the anterior superior temporal cortex might have a more important role in attention to the pitch than location of sounds. This article is part of a Special Issue entitled SI: Prediction and Attention.

Cognitive and motor loops of the human cerebro-cerebellar system.

We applied fMRI and diffusion-weighted MRI to study the segregation of cognitive and motor functions in the human cerebro-cerebellar system. Our fMRI results show that a load increase in a nonverbal auditory working memory task is associated with enhanced brain activity in the parietal, dorsal premotor, and lateral prefrontal cortices and in lobules VII-VIII of the posterior cerebellum, whereas a sensory-motor control task activated the motor/somatosensory, medial prefrontal, and posterior cingulate cortices and lobules V/VI of the anterior cerebellum. The load-dependent activity in the crus I/II had a specific relationship with cognitive performance: This activity correlated negatively with load-dependent increase in RTs. This correlation between brain activity and RTs was not observed in the sensory-motor task in the activated cerebellar regions. Furthermore, probabilistic tractography analysis of the diffusion-weighted MRI data suggests that the tracts between the cerebral and the cerebellar areas exhibiting cognitive load-dependent and sensory-motor activity are mainly projected via separated pontine (feed-forward tracts) and thalamic (feedback tracts) nuclei. The tractography results also indicate that the crus I/II in the posterior cerebellum is linked with the lateral prefrontal areas activated by cognitive load increase, whereas the anterior cerebellar lobe is not. The current results support the view that cognitive and motor functions are segregated in the cerebellum. On the basis of these results and theories of the function of the cerebellum, we suggest that the posterior cerebellar activity during a demanding cognitive task is involved with optimization of the response speed.

Brain networks of bottom-up triggered and top-down controlled shifting of auditory attention.

During functional magnetic resonance imaging (fMRI), our participants selectively attended to tone streams at the left or right, and occasionally shifted their attention from one stream to another as guided by a centrally presented visual cue. Duration changes in the to-be-attended stream served as targets. Loudness deviating tones (LDTs) occurred infrequently in both streams to catch attention in a bottom-up manner, as indicated by their effects on reaction times to targets. LDTs activated the right temporo-parietal junction (TPJ), posterior parts of the left inferior/middle frontal gyrus (IFG/MFG), ventromedial parts of the superior parietal lobule (SPL), and left frontal eye field/premotor cortex (FEF/PMC). In addition, LDTs in the to-be-ignored sound stream were associated with enhanced activity in the ventromedial prefrontal cortex (VMPFC) possibly related to evaluation of the distracting event. Top-down controlled cue-guided attention shifts (CASs) activated bilateral areas in the SPL, intraparietal sulcus (IPS), FEF/PMC, TPJ, IFG/MFG, and cingulate/medial frontal gyrus, and crus I/II of the cerebellum. Thus, our results suggest that in audition top-down controlled and bottom-up triggered shifting of attention activate largely overlapping temporo-parietal, superior parietal and frontal areas. As the IPS, superior parts of the SPL, and crus I/II were activated specifically by top-down controlled attention shifts, and the VMPFC was specifically activated by bottom-up triggered attention shifts, our results also suggest some differences between auditory top-down controlled and bottom-up triggered shifting of attention.

Selective attention to sound location or pitch studied with event-related brain potentials and magnetic fields.

Event-related brain potentials (ERPs) and magnetic fields (ERFs) were used to compare brain activity associated with selective attention to sound location or pitch in humans. Sixteen healthy adults participated in the ERP experiment, and 11 adults in the ERF experiment. In different conditions, the participants focused their attention on a designated sound location or pitch, or pictures presented on a screen, in order to detect target sounds or pictures among the attended stimuli. In the Attend Location condition, the location of sounds varied randomly (left or right), while their pitch (high or low) was kept constant. In the Attend Pitch condition, sounds of varying pitch (high or low) were presented at a constant location (left or right). Consistent with previous ERP results, selective attention to either sound feature produced a negative difference (Nd) between ERPs to attended and unattended sounds. In addition, ERPs showed a more posterior scalp distribution for the location-related Nd than for the pitch-related Nd, suggesting partially different generators for these Nds. The ERF source analyses found no source distribution differences between the pitch-related Ndm (the magnetic counterpart of the Nd) and location-related Ndm in the superior temporal cortex (STC), where the main sources of the Ndm effects are thought to be located. Thus, the ERP scalp distribution differences between the location-related and pitch-related Nd effects may have been caused by activity of areas outside the STC, perhaps in the inferior parietal regions.

Orienting and maintenance of spatial attention in audition and vision: multimodal and modality-specific brain activations.

We studied orienting and maintenance of spatial attention in audition and vision. Functional magnetic resonance imaging (fMRI) in nine healthy subjects revealed activations in the same superior and inferior parietal, and posterior prefrontal areas in the auditory and visual orienting tasks when these tasks were compared with the corresponding maintenance tasks. Attention-related activations in the thalamus and cerebellum were observed during the auditory orienting and maintenance tasks and during the visual orienting task. In addition to the supratemporal auditory cortices, auditory orienting, and maintenance produced stronger activity than the respective visual tasks in the inferior parietal and prefrontal cortices, whereas only the occipital visual cortex and the superior parietal cortex showed stronger activity during the visual tasks than during the auditory tasks. Differences between the brain networks involved in auditory and visual spatial attention could be, for example, due to different encoding of auditory and visual spatial information or differences in stimulus-driven (bottom-up triggered) and voluntary (top-down controlled) attention between the auditory and visual modalities, or both.

Orienting and maintenance of spatial attention in audition and vision: an event-related brain potential study.

We examined the effects of orienting and maintenance of attention on performance and event-related brain potentials (ERPs) in audition and vision. Our subjects selectively attended to sounds or pictures in one location (Maintenance of attention) or alternated the focus of their auditory or visual attention between left and right locations (Orienting of attention) in order to detect and press a response button to infrequent targets among the attended stimuli. Reaction times were longer in the Auditory Orienting condition and hit rates were lower and false alarm rates higher in the Visual Orienting condition than in the corresponding Maintenance conditions. Comparison of ERPs to the attended and unattended stimuli in the Auditory and Visual Orienting and Maintenance conditions revealed attention-related modulations of ERPs. In each modality, ERPs to attended stimuli were negatively displaced in relation to unattended stimuli at 100-250 ms from stimulus onset. These negative differences (Nds) showed modality-specific distributions and they were larger over the hemisphere contralateral to the attended sounds and pictures than over the ipsilateral hemisphere. Moreover, the Nd was larger in the Auditory Orienting condition than in the Auditory Maintenance condition, while no such difference was observed in the visual modality. In addition to the Nd, attended visual stimuli elicited a late positive response (LPR) in both Orienting and Maintenance conditions. In contrast to our recent functional magnetic resonance imaging (fMRI) study employing the same experimental paradigm and indicating orienting-related activity in the frontal and parietal cortices, no ERP responses specifically related to orienting were found in either modality.