Emergence of Emotion Selectivity in Deep Neural Networks Trained to Recognize Visual Objects.

Recent neuroimaging studies have shown that the visual cortex plays an important role in representing the affective significance of visual input. The origin of these affect-specific visual representations is debated: they are intrinsic to the visual system versus they arise through reentry from frontal emotion processing structures such as the amygdala. We examined this problem by combining convolutional neural network (CNN) models of the human ventral visual cortex pre-trained on ImageNet with two datasets of affective images. Our results show that in all layers of the CNN models, there were artificial neurons that responded consistently and selectively to neutral, pleasant, or unpleasant images and lesioning these neurons by setting their output to zero or enhancing these neurons by increasing their gain led to decreased or increased emotion recognition performance respectively. These results support the idea that the visual system may have the intrinsic ability to represent the affective significance of visual input and suggest that CNNs offer a fruitful platform for testing neuroscientific theories.

Transcranial stimulation of alpha oscillations up-regulates the default mode network.

The default mode network (DMN) is the most-prominent intrinsic connectivity network, serving as a key architecture of the brain's functional organization. Conversely, dysregulated DMN is characteristic of major neuropsychiatric disorders. However, the field still lacks mechanistic insights into the regulation of the DMN and effective interventions for DMN dysregulation. The current study approached this problem by manipulating neural synchrony, particularly alpha (8 to 12 Hz) oscillations, a dominant intrinsic oscillatory activity that has been increasingly associated with the DMN in both function and physiology. Using high-definition alpha-frequency transcranial alternating current stimulation (α-tACS) to stimulate the cortical source of alpha oscillations, in combination with simultaneous electroencephalography and functional MRI (EEG-fMRI), we demonstrated that α-tACS (versus Sham control) not only augmented EEG alpha oscillations but also strengthened fMRI and (source-level) alpha connectivity within the core of the DMN. Importantly, increase in alpha oscillations mediated the DMN connectivity enhancement. These findings thus identify a mechanistic link between alpha oscillations and DMN functioning. That transcranial alpha modulation can up-regulate the DMN further highlights an effective noninvasive intervention to normalize DMN functioning in various disorders.

Top-down control of the left visual field bias in cued visual spatial attention.

A left visual field (LVF) bias in perceptual judgments, response speed, and discrimination accuracy has been reported in humans. Cognitive factors, such as visual spatial attention, are known to modulate or even eliminate this bias. We investigated this problem by recording pupillometry together with functional magnetic resonance imaging (fMRI) in a cued visual spatial attention task. We observed that (i) the pupil was significantly more dilated following attend-right than attend-left cues, (ii) the task performance (e.g. reaction time [RT]) did not differ between attend-left and attend-right trials, and (iii) the difference in cue-related pupil dilation between attend-left and attend-right trials was inversely related to the corresponding difference in RT. Neuroscientically, correlating the difference in cue-related pupil dilation with the corresponding cue-related fMRI difference yielded activations primarily in the right hemisphere, including the right intraparietal sulcus and the right ventrolateral prefrontal cortex. These results suggest that (i) there is an asymmetry in visual spatial attention control, with the rightward attention control being more effortful than the leftward attention control, (ii) this asymmetry underlies the reduction or the elimination of the LVF bias, and (iii) the components of the attentional control networks in the right hemisphere are likely part of the neural substrate of the observed asymmetry in attentional control.

Time Courses of Attended and Ignored Object Representations.

Selective attention prioritizes information that is relevant to behavioral goals. Previous studies have shown that attended visual information is processed and represented more efficiently, but distracting visual information is not fully suppressed, and may also continue to be represented in the brain. In natural vision, to-be-attended and to-be-ignored objects may be present simultaneously in the scene. Understanding precisely how each is represented in the visual system, and how these neural representations evolve over time, remains a key goal in cognitive neuroscience. In this study, we recorded EEG while participants performed a cued object-based attention task that involved attending to target objects and ignoring simultaneously presented and spatially overlapping distractor objects. We performed support vector machine classification on the stimulus-evoked EEG data to separately track the temporal dynamics of target and distractor representations. We found that (1) both target and distractor objects were decodable during the early phase of object processing (∼100 msec to ∼200 msec after target onset), and (2) the representations of both objects were sustained over time, remaining decodable above chance until ∼1000-msec latency. However, (3) the distractor object information faded significantly beginning after about 300-msec latency. These findings provide information about the fate of attended and ignored visual information in complex scene perception.

Role of Inferior Frontal Junction (IFJ) in the Control of Feature versus Spatial Attention.

Feature-based visual attention refers to preferential selection and processing of visual stimuli based on their nonspatial attributes, such as color or shape. Recent studies have highlighted the inferior frontal junction (IFJ) as a control region for feature but not spatial attention. However, the extent to which IFJ contributes to spatial versus feature attention control remains a topic of debate. We investigated in humans of both sexes the role of IFJ in the control of feature versus spatial attention in a cued visual spatial (attend-left or attend-right) and feature (attend-red or attend-green) attention task using fMRI. Analyzing cue-related fMRI using both univariate activation and multivoxel pattern analysis, we found the following results in IFJ. First, in line with some prior studies, the univariate activations were not different between feature and spatial attentional control. Second, in contrast, the multivoxel pattern analysis decoding accuracy was above chance level for feature attention (attend-red vs attend-green) but not for spatial attention (attend-left vs attend-right). Third, while the decoding accuracy for feature attention was above chance level during attentional control in the cue-to-target interval, it was not during target processing. Fourth, the right IFJ and visual cortex (V4) were observed to be functionally connected during feature but not during spatial attention control, and this functional connectivity was positively associated with subsequent attentional selection of targets in V4, as well as with behavioral performance. These results support a model in which IFJ plays a crucial role in top-down control of visual feature but not visual spatial attention.SIGNIFICANCE STATEMENT Past work has shown that the inferior frontal junction (IFJ), a prefrontal structure, is activated by both attention-to-feature (e.g., color) and attention-to-location, but the precise role of IFJ in the control of feature- versus spatial-attention is debated. We investigated this issue in a cued visual spatial (attend-left or attend-right) and feature (attend-red or attend-green) attention task using fMRI, multivoxel pattern analysis, and functional connectivity methods. The results show that (1) attend-red versus attend-green can be decoded in single-trial cue-evoked BOLD activity in IFJ but not attend-left versus attend-right and (2) only right IFJ modulates V4 to enhance task performance. This study sheds light on the function and hemispheric specialization of IFJ in the control of visual attention.

Decoding the temporal dynamics of affective scene processing.

Natural images containing affective scenes are used extensively to investigate the neural mechanisms of visual emotion processing. Functional fMRI studies have shown that these images activate a large-scale distributed brain network that encompasses areas in visual, temporal, and frontal cortices. The underlying spatial and temporal dynamics, however, remain to be better characterized. We recorded simultaneous EEG-fMRI data while participants passively viewed affective images from the International Affective Picture System (IAPS). Applying multivariate pattern analysis to decode EEG data, and representational similarity analysis to fuse EEG data with simultaneously recorded fMRI data, we found that: (1) ∼80 ms after picture onset, perceptual processing of complex visual scenes began in early visual cortex, proceeding to ventral visual cortex at ∼100 ms, (2) between ∼200 and ∼300 ms (pleasant pictures: ∼200 ms; unpleasant pictures: ∼260 ms), affect-specific neural representations began to form, supported mainly by areas in occipital and temporal cortices, and (3) affect-specific neural representations were stable, lasting up to ∼2 s, and exhibited temporally generalizable activity patterns. These results suggest that affective scene representations in the brain are formed temporally in a valence-dependent manner and may be sustained by recurrent neural interactions among distributed brain areas.

Decoding Neural Representations of Affective Scenes in Retinotopic Visual Cortex.

The perception of opportunities and threats in complex visual scenes represents one of the main functions of the human visual system. The underlying neurophysiology is often studied by having observers view pictures varying in affective content. It has been shown that viewing emotionally engaging, compared with neutral, pictures (1) heightens blood flow in limbic, frontoparietal, and anterior visual structures and (2) enhances the late positive event-related potential (LPP). The role of retinotopic visual cortex in this process has, however, been contentious, with competing theories predicting the presence versus absence of emotion-specific signals in retinotopic visual areas. Recording simultaneous electroencephalography-functional magnetic resonance imaging while observers viewed pleasant, unpleasant, and neutral affective pictures, and applying multivariate pattern analysis, we found that (1) unpleasant versus neutral and pleasant versus neutral decoding accuracy were well above chance level in retinotopic visual areas, (2) decoding accuracy in ventral visual cortex (VVC), but not in early or dorsal visual cortex, was correlated with LPP, and (3) effective connectivity from amygdala to VVC predicted unpleasant versus neutral decoding accuracy, whereas effective connectivity from ventral frontal cortex to VVC predicted pleasant versus neutral decoding accuracy. These results suggest that affective scenes evoke valence-specific neural representations in retinotopic visual cortex and that these representations are influenced by reentry signals from anterior brain regions.

Neural Mechanisms of Attentional Control for Objects: Decoding EEG Alpha When Anticipating Faces, Scenes,and Tools.

Attentional selection mechanisms in visual cortex involve changes in oscillatory activity in the EEG alpha band (8-12 Hz), with decreased alpha indicating focal cortical enhancement and increased alpha indicating suppression. This has been observed for spatial selective attention and attention to stimulus features such as color versus motion. We investigated whether attention to objects involves similar alpha-mediated changes in focal cortical excitability. In experiment 1, 20 volunteers (8 males; 12 females) were cued (80% predictive) on a trial-by-trial basis to different objects (faces, scenes, or tools). Support vector machine decoding of alpha power patterns revealed that late (>500 ms latency) in the cue-to-target foreperiod, only EEG alpha differed with the to-be-attended object category. In experiment 2, to eliminate the possibility that decoding of the physical features of cues led to our results, 25 participants (9 males; 16 females) performed a similar task where cues were nonpredictive of the object category. Alpha decoding was now only significant in the early (<200 ms) foreperiod. In experiment 3, to eliminate the possibility that task set differences between the different object categories led to our experiment 1 results, 12 participants (5 males; 7 females) performed a predictive cuing task where the discrimination task for different objects was identical across object categories. The results replicated experiment 1. Together, these findings support the hypothesis that the neural mechanisms of visual selective attention involve focal cortical changes in alpha power not only for simple spatial and feature attention, but also for high-level object attention in humans.SIGNIFICANCE STATEMENT Attention is the cognitive function that enables relevant information to be selected from sensory inputs so it can be processed in the support of goal-directed behavior. Visual attention is widely studied, yet the neural mechanisms underlying the selection of visual information remain unclear. Oscillatory EEG activity in the alpha range (8-12 Hz) of neural populations receptive to target visual stimuli may be part of the mechanism, because alpha is thought to reflect focal neural excitability. Here, we show that alpha-band activity, as measured by scalp EEG from human participants, varies with the specific category of object selected by attention. This finding supports the hypothesis that alpha-band activity is a fundamental component of the neural mechanisms of attention.

The Microstructure of Attentional Control in the Dorsal Attention Network.

The top-down control of attention involves command signals arising chiefly in the dorsal attention network (DAN) in frontal and parietal cortex and propagating to sensory cortex to enable the selective processing of incoming stimuli based on their behavioral relevance. Consistent with this view, the DAN is active during preparatory (anticipatory) attention for relevant events and objects, which, in vision, may be defined by different stimulus attributes including their spatial location, color, motion, or form. How this network is organized to support different forms of preparatory attention to different stimulus attributes remains unclear. We propose that, within the DAN, there exist functional microstructures (patterns of activity) specific for controlling attention based on the specific information to be attended. To test this, we contrasted preparatory attention to stimulus location (spatial attention) and to stimulus color (feature attention), and used multivoxel pattern analysis to characterize the corresponding patterns of activity within the DAN. We observed different multivoxel patterns of BOLD activation within the DAN for the control of spatial attention (attending left vs. right) and feature attention (attending red vs. green). These patterns of activity for spatial and feature attentional control showed limited overlap with each other within the DAN. Our findings thus support a model in which the DAN has different functional microstructures for distinctive forms of top-down control of visual attention.

The functional hierarchy of the task-positive networks indicates a core control system of top-down regulation in visual attention.

The cingulo-opercular network (CON), dorsal attention network (DAN), and ventral attention network (VAN) are prominently activated during attention tasks. The function of these task-positive networks and their interplay mechanisms in attention is one of the central issues in understanding how the human brain manipulates attention to better adapt to the external environment. This study aimed to clarify the CON, DAN, and VAN's functional hierarchy by assessing causal interactions. Functional magnetic resonance imaging (fMRI) data from human participants performing a visual-spatial attention task and correlating Granger causal influences with behavioral performance revealed that CON exerts behavior-enhancing influences upon DAN and VAN, indicating a higher level of CON in top-down attention control. By contrast, the VAN exerts a behavior-degrading influence on CON, indicating external disruption of the CON's control set.

Decoding attention control and selection in visual spatial attention.

Event-related potentials (ERPs) are used extensively to investigate the neural mechanisms of attention control and selection. The univariate ERP approach, however, has left important questions inadequately answered. We addressed two questions by applying multivariate pattern classification to multichannel ERPs in two cued visual spatial attention experiments (N = 56): (a) impact of cueing strategies (instructional vs. probabilistic) on attention control and selection and (b) neural and behavioral effects of individual differences. Following cue onset, the decoding accuracy (cue left vs. cue right) began to rise above chance level earlier and remained higher in instructional cueing (~80 ms) than in probabilistic cueing (~160 ms), suggesting that unilateral attention focus leads to earlier and more distinct formation of the attention control set. A similar temporal sequence was also found for target-related processing (cued target vs. uncued target), suggesting earlier and stronger attention selection under instructional cueing. Across the two experiments: (a) individuals with higher cue-related decoding accuracy showed higher magnitude of attentional modulation of target-evoked N1 amplitude, suggesting that better formation of anticipatory attentional state leads to stronger modulation of target processing, and (b) individuals with higher target-related decoding accuracy showed faster reaction times (or larger cueing effects), suggesting that stronger selection of task-relevant information leads to better behavioral performance. Taken together, multichannel ERPs combined with machine learning decoding yields new insights into attention control and selection that complement the univariate ERP approach, and along with the univariate ERP approach, provides a more comprehensive methodology to the study of visual spatial attention.

Theta Oscillations Index Frontal Decision-Making and Mediate Reciprocal Frontal-Parietal Interactions in Willed Attention.

Attention can be attracted reflexively by sensory signals, biased by learning or reward, or focused voluntarily based on momentary goals. When voluntary attention is focused by purely internal decision processes (will), rather than instructions via external cues, we call this "willed attention." In prior work, we reported ERP and fMRI correlates of willed spatial attention in trial-by-trial cuing tasks. Here we further investigated the oscillatory mechanisms of willed attention by contrasting the event-related EEG spectrogram between instructional and choice cues. Two experiments were conducted at 2 different sites using the same visuospatial attention paradigm. Consistent between the 2 experiments, we found increases in frontal theta power (starting at ~500 ms post cue) for willed attention relative to instructed attention. This frontal theta increase was accompanied by increased frontal-parietal theta-band coherence and bidirectional Granger causality. Additionally, the onset of attention-related posterior alpha power lateralization was delayed in willed attention relative to instructed attention, and the amount of delay was related to the timing of frontal theta increase. These results, replicated across 2 experiments, suggest that theta oscillations are the neuronal signals indexing decision-making in the frontal cortex, and mediating reciprocal communications between the frontal executive and parietal attentional control regions during willed attention.

Brain-to-Brain Synchrony and Learning Outcomes Vary by Student-Teacher Dynamics: Evidence from a Real-world Classroom Electroencephalography Study.

How does the human brain support real-world learning? We used wireless electroencephalography to collect neurophysiological data from a group of 12 senior high school students and their teacher during regular biology lessons. Six scheduled classes over the course of the semester were organized such that class materials were presented using different teaching styles (videos and lectures), and students completed a multiple-choice quiz after each class to measure their retention of that lesson's content. Both students' brain-to-brain synchrony and their content retention were higher for videos than lectures across the six classes. Brain-to-brain synchrony between the teacher and students varied as a function of student engagement as well as teacher likeability: Students who reported greater social closeness to the teacher showed higher brain-to-brain synchrony with the teacher, but this was only the case for lectures-that is, when the teacher is an integral part of the content presentation. Furthermore, students' retention of the class content correlated with student-teacher closeness, but not with brain-to-brain synchrony. These findings expand on existing social neuroscience research by showing that social factors such as perceived closeness are reflected in brain-to-brain synchrony in real-world group settings and can predict cognitive outcomes such as students' academic performance.

Working Memory Capacity Is Negatively Associated with Memory Load Modulation of Alpha Oscillations in Retention of Verbal Working Memory.

Working memory capacity (WMC) measures the amount of information that can be maintained online in the face of distraction. Past work has shown that the efficiency with which the frontostriatal circuit filters out task-irrelevant distracting information is positively correlated with WMC. Recent work has demonstrated a role of posterior alpha oscillations (8-13 Hz) in providing a sensory gating mechanism. We investigated the relationship between memory load modulation of alpha power and WMC in two verbal working memory experiments. In both experiments, we found that posterior alpha power increased with memory load during memory, in agreement with previous reports. Across individuals, the degree of alpha power modulation by memory load was negatively associated with WMC, namely, the higher the WMC, the less alpha power was modulated by memory load. After the administration of topiramate, a drug known to affect alpha oscillations and have a negative impact on working memory function, the negative correlation between memory load modulation of alpha power and WMC was no longer statistically significant but still somewhat detectable. These results suggest that (1) individuals with low WMC demonstrate stronger alpha power modulation by memory load, reflecting possibly an increased reliance on sensory gating to suppress task-irrelevant information in these individuals, in contrast to their high WMC counterparts who rely more on frontal areas to perform this function and (2) this negative association between memory load modulation of alpha oscillations and WMC is vulnerable to drug-related cognitive disruption.

From eyes-closed to eyes-open: Role of cholinergic projections in EC-to-EO alpha reactivity revealed by combining EEG and MRI.

Alpha rhythm (8 to 12 Hz) observed in EEG over human posterior cortex is prominent during eyes-closed (EC) resting and attenuates during eyes-open (EO) resting. Research shows that the degree of EC-to-EO alpha blocking or alpha desynchronization, termed alpha reactivity here, is a neural marker of cognitive health. We tested the role of acetylcholine in EC-to-EO alpha reactivity by applying a multimodal neuroimaging approach to a cohort of young adults and a cohort of older adults. In the young cohort, simultaneous EEG-fMRI was recorded from twenty-one young adults during both EO and EC resting. In the older cohort, functional MRI was recorded from forty older adults during EO and EC resting, along with FLAIR and diffusion MRI. For a subset of twenty older adults, EEG was recorded during EO and EC resting in a separate session. In both young and older adults, functional connectivity between the basal nucleus of Meynert (BNM), the major source of cortical acetylcholine, and the visual cortex increased from EC to EO, and this connectivity increase was positively associated with alpha reactivity; namely, the stronger the BNM-visual cortex functional connectivity increase from EC to EO, the larger the EC-to-EO alpha desynchronization. In older adults, lesions of the fiber tracts linking BNM and visual cortex quantified by leukoaraiosis volume, associated with reduced alpha reactivity. These findings support a role of acetylcholine and particularly cholinergic pathways in mediating EC-to-EO alpha reactivity and suggest that impaired alpha reactivity could serve as a marker of the integrity of the cholinergic system.

The frequency of alpha oscillations: Task-dependent modulation and its functional significance.

Power (amplitude) and frequency are two important characteristics of EEG alpha oscillations (8-12 Hz). There is an extensive literature showing that alpha power can be modulated in a goal-oriented manner to either enhance or suppress sensory information processing. Only a few studies to date have examined the task-dependent modulation of alpha frequency. Instead, alpha frequency is often viewed as a trait variable, and used to characterize individual differences in cognitive functioning. We performed two experiments to examine the task-dependent modulation of alpha frequency and its functional significance. In the first experiment, high-density EEG was recorded from 21 participants performing a Sternberg working memory task. The results showed that: (1) during memory encoding, alpha frequency decreased with increasing memory load, whereas during memory retention and retrieval, alpha frequency increased with increasing memory load, (2) higher alpha frequency prior to the onset of probe was associated with longer reaction time, and (3) higher alpha frequency prior to the onset of cue or probe was associated with weaker early cue-evoked or probe-evoked neural responses. In the second experiment, simultaneous EEG-fMRI was recorded from 59 participants during resting state. An EEG-informed fMRI analysis revealed that the spontaneous fluctuations of alpha frequency, but not alpha power, were inversely associated with BOLD activity in the visual cortex. Taken together, these findings suggest that alpha frequency is task-dependent, may serve as an indicator of cortical excitability, and along with alpha power, provides more comprehensive indexing of sensory gating.

Granger-Geweke causality: Estimation and interpretation.

In a recent PNAS article1, Stokes and Purdon performed numerical simulations to argue that Granger-Geweke causality (GGC) estimation is severely biased, or of high variance, and GGC application to neuroscience is problematic because the GGC measure is independent of 'receiver' dynamics. Here, we use the same simulation examples to show that GGC measures, when properly estimated either via the spectral factorization-enabled nonparametric approach or the VAR-model based parametric approach, do not have the claimed bias and high variance problems. Further, the receiver-independence property of GGC does not present a problem for neuroscience applications. When the nature and context of experimental measurements are taken into consideration, GGC, along with other spectral quantities, yield neurophysiologically interpretable results.

Restless 'rest': intrinsic sensory hyperactivity and disinhibition in post-traumatic stress disorder.

Post-traumatic stress disorder is characterized by exaggerated threat response, and theoretical accounts to date have focused on impaired threat processing and dysregulated prefrontal-cortex-amygdala circuitry. Nevertheless, evidence is accruing for broad, threat-neutral sensory hyperactivity in post-traumatic stress disorder. As low-level, sensory processing impacts higher-order operations, such sensory anomalies can contribute to widespread dysfunctions, presenting an additional aetiological mechanism for post-traumatic stress disorder. To elucidate a sensory pathology of post-traumatic stress disorder, we examined intrinsic visual cortical activity (based on posterior alpha oscillations) and bottom-up sensory-driven causal connectivity (Granger causality in the alpha band) during a resting state (eyes open) and a passive, serial picture viewing state. Compared to patients with generalized anxiety disorder (n = 24) and healthy control subjects (n = 20), patients with post-traumatic stress disorder (n = 25) demonstrated intrinsic sensory hyperactivity (suppressed posterior alpha power, source-localized to the visual cortex-cuneus and precuneus) and bottom-up inhibition deficits (reduced posterior→frontal Granger causality). As sensory input increased from resting to passive picture viewing, patients with post-traumatic stress disorder failed to demonstrate alpha adaptation, highlighting a rigid, set mode of sensory hyperactivity. Interestingly, patients with post-traumatic stress disorder also showed heightened frontal processing (augmented frontal gamma power, source-localized to the superior frontal gyrus and dorsal cingulate cortex), accompanied by attenuated top-down inhibition (reduced frontal→posterior causality). Importantly, not only did suppressed alpha power and bottom-up causality correlate with heightened frontal gamma power, they also correlated with increased severity of sensory and executive dysfunctions (i.e. hypervigilance and impulse control deficits, respectively). Therefore, sensory aberrations help construct a vicious cycle in post-traumatic stress disorder that is in action even at rest, implicating dysregulated triangular sensory-prefrontal-cortex-amygdala circuitry: intrinsic sensory hyperactivity and disinhibition give rise to frontal overload and disrupt executive control, fuelling and perpetuating post-traumatic stress disorder symptoms. Absent in generalized anxiety disorder, these aberrations highlight a unique sensory pathology of post-traumatic stress disorder (ruling out effects merely reflecting anxious hyperarousal), motivating new interventions targeting sensory processing and the sensory brain in these patients.

Compensatory Neural Activity in Response to Cognitive Fatigue.

Prolonged continuous performance of a cognitively demanding task induces cognitive fatigue and is associated with a time-related deterioration of objective performance, the degree of which is referred to cognitive fatigability. Although the neural underpinnings of cognitive fatigue are poorly understood, prior studies report changes in neural activity consistent with deterioration of task-related networks over time. While compensatory brain activity is reported to maintain motor task performance in the face of motor fatigue and cognitive performance in the face of other stressors (e.g., aging) and structural changes, there are no studies to date demonstrating compensatory activity for cognitive fatigue. High-density electroencephalography was recorded from human subjects during a 160 min continuous performance of a cognitive control task. While most time-varying neural activity showed a linear decline over time, we identified an evoked potential over the anterior frontal region which demonstrated an inverted U-shaped time-on-task profile. This evoked brain activity peaked between 60 and 100 min into the task and was positively associated with better behavioral performance only during this interval. Following the peak and during subsequent decline of this anterior frontal activity, the rate of performance decline also accelerated. These findings demonstrate that this anterior frontal brain activity, which is not part of the primary task-related activity at baseline, is recruited to compensate for fatigue-induced impairments in the primary task-related network, and that this compensation terminates as cognitive fatigue further progresses. These findings may be relevant to understanding individual differences in cognitive fatigability and developing interventions for clinical conditions afflicted by fatigue. SIGNIFICANCE STATEMENT: Fatigue refers to changes in objective performance and subjective effort induced by continuous task performance. We examined the neural underpinnings of cognitive fatigue in humans using a prolonged continuous performance task and high-density electroencephalography with the goal of determining whether compensatory processes exist to maintain performance in the face of fatigue. We identified brain activity demonstrating an inverted U-shaped time-on-task profile. This brain activity showed features consistent with a compensatory role including: peaking between 60 and 100 min into the task, a positive association with behavioral performance only during this interval, and accelerated performance decline following its peak. These findings may be relevant to understanding individual differences in cognitive fatigue and developing interventions for clinical conditions afflicted by fatigue.

Multimodal Imaging Evidence for a Frontoparietal Modulation of Visual Cortex during the Selective Processing of Conditioned Threat.

Emotionally salient cues are detected more readily, remembered better, and evoke greater visual cortical responses compared with neutral stimuli. The current study used concurrent EEG-fMRI recordings to identify large-scale network interactions involved in the amplification of visual cortical activity when viewing aversively conditioned cues. To generate a continuous neural signal from pericalcarine visual cortex, we presented rhythmic (10/sec) phase-reversing gratings, the orientation of which predicted the presence (CS+) or absence (CS-) of a cutaneous electric shock (i.e., the unconditioned stimulus). The resulting single trial steady-state visual evoked potential (ssVEP) amplitude was regressed against the whole-brain BOLD signal, resulting in a measure of ssVEP-BOLD coupling. Across all trial types, ssVEP-BOLD coupling was observed in both primary and extended visual cortical regions, the rolandic operculum, as well as the thalamus and bilateral hippocampus. For CS+ relative to CS- trials during the conditioning phase, BOLD-alone analyses showed CS+ enhancement at the occipital pole, superior temporal sulci, and the anterior insula bilaterally, whereas ssVEP-BOLD coupling was greater in the pericalcarine cortex, inferior parietal cortex, and middle frontal gyrus. Dynamic causal modeling analyses supported connectivity models in which heightened activity in pericalcarine cortex for threat (CS+) arises from cortico-cortical top-down modulation, specifically from the middle frontal gyrus. No evidence was observed for selective pericalcarine modulation by deep cortical structures such as the amygdala or anterior insula, suggesting that the heightened engagement of pericalcarine cortex for threat stimuli is mediated by cortical structures that constitute key nodes of canonical attention networks.