Failure to engage the temporoparietal junction/posterior superior temporal sulcus predicts impaired naturalistic social cognition in schizophrenia.

Schizophrenia is associated with marked impairments in social cognition. However, the neural correlates of these deficits remain unclear. Here we use naturalistic stimuli to examine the role of the right temporoparietal junction/posterior superior temporal sulcus (TPJ-pSTS)-an integrative hub for the cortical networks pertinent to the understanding complex social situations-in social inference, a key component of social cognition, in schizophrenia. Twenty-seven schizophrenia participants and 21 healthy control subjects watched a clip of the film The Good, the Bad and the Ugly while high resolution multiband functional MRI images were collected. We used inter-subject correlation to measure the evoked activity, which we then compared to social cognition as measured by The Awareness of Social Inference Test (TASIT). We also compared between groups the TPJ-pSTS blood oxygen level-dependent activity (i) relationship with the motion content in the film; (ii) synchronization with other cortical areas involved in the viewing of the movie; and (iii) relationship with the frequency of saccades made during the movie. Activation deficits were greatest in middle TPJ (TPJm) and correlated significantly with impaired TASIT performance across groups. Follow-up analyses of the TPJ-pSTS revealed decreased synchronization with other cortical areas, decreased correlation with the motion content of the movie, and decreased correlation with the saccades made during the movie. The functional impairment of the TPJm, a hub area in the middle of the TPJ-pSTS, predicts deficits in social inference in schizophrenia participants by disrupting the integration of visual motion processing into the TPJ. This disrupted integration then affects the use of the TPJ to guide saccades during the visual scanning of the movie clip. These findings suggest that the TPJ may be a treatment target for improving deficits in a key component of social cognition in schizophrenia participants.

What you see is what you get: visual scanning failures of naturalistic social scenes in schizophrenia.

BACKGROUND: Impairments in social cognition contribute significantly to disability in schizophrenia patients (SzP). Perception of facial expressions is critical for social cognition. Intact perception requires an individual to visually scan a complex dynamic social scene for transiently moving facial expressions that may be relevant for understanding the scene. The relationship of visual scanning for these facial expressions and social cognition remains unknown. METHODS: In 39 SzP and 27 healthy controls (HC), we used eye-tracking to examine the relationship between performance on The Awareness of Social Inference Test (TASIT), which tests social cognition using naturalistic video clips of social situations, and visual scanning, measuring each individual's relative to the mean of HC. We then examined the relationship of visual scanning to the specific visual features (motion, contrast, luminance, faces) within the video clips. RESULTS: TASIT performance was significantly impaired in SzP for trials involving sarcasm (p < 10-5). Visual scanning was significantly more variable in SzP than HC (p < 10-6), and predicted TASIT performance in HC (p = 0.02) but not SzP (p = 0.91), differing significantly between groups (p = 0.04). During the visual scanning, SzP were less likely to be viewing faces (p = 0.0001) and less likely to saccade to facial motion in peripheral vision (p = 0.008). CONCLUSIONS: SzP show highly significant deficits in the use of visual scanning of naturalistic social scenes to inform social cognition. Alterations in visual scanning patterns may originate from impaired processing of facial motion within peripheral vision. Overall, these results highlight the utility of naturalistic stimuli in the study of social cognition deficits in schizophrenia.

Impaired Fixation-Related Theta Modulation Predicts Reduced Visual Span and Guided Search Deficits in Schizophrenia.

During normal visual behavior, individuals scan the environment through a series of saccades and fixations. At each fixation, the phase of ongoing rhythmic neural oscillations is reset, thereby increasing efficiency of subsequent visual processing. This phase-reset is reflected in the generation of a fixation-related potential (FRP). Here, we evaluate the integrity of theta phase-reset/FRP generation and Guided Visual Search task in schizophrenia. Subjects performed serial and parallel versions of the task. An initial study (15 healthy controls (HC)/15 schizophrenia patients (SCZ)) investigated behavioral performance parametrically across stimulus features and set-sizes. A subsequent study (25-HC/25-SCZ) evaluated integrity of search-related FRP generation relative to search performance and evaluated visual span size as an index of parafoveal processing. Search times were significantly increased for patients versus controls across all conditions. Furthermore, significantly, deficits were observed for fixation-related theta phase-reset across conditions, that fully predicted impaired reduced visual span and search performance and correlated with impaired visual components of neurocognitive processing. By contrast, overall search strategy was similar between groups. Deficits in theta phase-reset mechanisms are increasingly documented across sensory modalities in schizophrenia. Here, we demonstrate that deficits in fixation-related theta phase-reset during naturalistic visual processing underlie impaired efficiency of early visual function in schizophrenia.

Network-level mechanisms underlying effects of transcranial direct current stimulation (tDCS) on visuomotor learning.

Transcranial direct current stimulation (tDCS) is a non-invasive brain stimulation approach in which low level currents are administered over the scalp to influence underlying brain function. Prevailing theories of tDCS focus on modulation of excitation-inhibition balance at the local stimulation location. However, network level effects are reported as well, and appear to depend upon differential underlying mechanisms. Here, we evaluated potential network-level effects of tDCS during the Serial Reaction Time Task (SRTT) using convergent EEG- and fMRI-based connectivity approaches. Motor learning manifested as a significant (p<.0001) shift from slow to fast responses and corresponded to a significant increase in beta-coherence (p<.0001) and fMRI connectivity (p<.01) particularly within the visual-motor pathway. Differential patterns of tDCS effect were observed within different parametric task versions, consistent with network models. Overall, these findings demonstrate objective physiological effects of tDCS at the network level that result in effective behavioral modulation when tDCS parameters are matched to network-level requirements of the underlying task.

Joint Estimation of Effective Brain Wave Activation Modes Using EEG/MEG Sensor Arrays and Multimodal MRI Volumes.

In this letter, we present a new method for integration of sensor-based multifrequency bands of electroencephalography and magnetoencephalography data sets into a voxel-based structural-temporal magnetic resonance imaging analysis by utilizing the general joint estimation using entropy regularization (JESTER) framework. This allows enhancement of the spatial-temporal localization of brain function and the ability to relate it to morphological features and structural connectivity. This method has broad implications for both basic neuroscience research and clinical neuroscience focused on identifying disease-relevant biomarkers by enhancing the spatial-temporal resolution of the estimates derived from current neuroimaging modalities, thereby providing a better picture of the normal human brain in basic neuroimaging experiments and variations associated with disease states.

Involuntary orienting of attention to a sound desynchronizes the occipital alpha rhythm and improves visual perception.

Directing attention voluntarily to the location of a visual target results in an amplitude reduction (desynchronization) of the occipital alpha rhythm (8-14Hz), which is predictive of improved perceptual processing of the target. Here we investigated whether modulations of the occipital alpha rhythm triggered by the involuntary orienting of attention to a salient but spatially non-predictive sound would similarly influence perception of a subsequent visual target. Target discrimination was more accurate when a sound preceded the target at the same location (validly cued trials) than when the sound was on the side opposite to the target (invalidly cued trials). This behavioral effect was accompanied by a sound-induced desynchronization of the alpha rhythm over the lateral occipital scalp. The magnitude of alpha desynchronization over the hemisphere contralateral to the sound predicted correct discriminations of validly cued targets but not of invalidly cued targets. These results support the conclusion that cue-induced alpha desynchronization over the occipital cortex is a manifestation of a general priming mechanism that improves visual processing and that this mechanism can be activated either by the voluntary or involuntary orienting of attention. Further, the observed pattern of alpha modulations preceding correct and incorrect discriminations of valid and invalid targets suggests that involuntary orienting to the non-predictive sound has a rapid and purely facilitatory influence on processing targets on the cued side, with no inhibitory influence on targets on the opposite side.

Salient, Irrelevant Sounds Reflexively Induce Alpha Rhythm Desynchronization in Parallel with Slow Potential Shifts in Visual Cortex.

Recent findings suggest that a salient, irrelevant sound attracts attention to its location involuntarily and facilitates processing of a colocalized visual event [McDonald, J. J., Störmer, V. S., Martinez, A., Feng, W. F., & Hillyard, S. A. Salient sounds activate human visual cortex automatically. Journal of Neuroscience, 33, 9194-9201, 2013]. Associated with this cross-modal facilitation is a sound-evoked slow potential over the contralateral visual cortex termed the auditory-evoked contralateral occipital positivity (ACOP). Here, we further tested the hypothesis that a salient sound captures visual attention involuntarily by examining sound-evoked modulations of the occipital alpha rhythm, which has been strongly associated with visual attention. In two purely auditory experiments, lateralized irrelevant sounds triggered a bilateral desynchronization of occipital alpha-band activity (10-14 Hz) that was more pronounced in the hemisphere contralateral to the sound's location. The timing of the contralateral alpha-band desynchronization overlapped with that of the ACOP (∼240-400 msec), and both measures of neural activity were estimated to arise from neural generators in the ventral-occipital cortex. The magnitude of the lateralized alpha desynchronization was correlated with ACOP amplitude on a trial-by-trial basis and between participants, suggesting that they arise from or are dependent on a common neural mechanism. These results support the hypothesis that the sound-induced alpha desynchronization and ACOP both reflect the involuntary cross-modal orienting of spatial attention to the sound's location.

Sounds activate visual cortex and improve visual discrimination.

A recent study in humans (McDonald et al., 2013) found that peripheral, task-irrelevant sounds activated contralateral visual cortex automatically as revealed by an auditory-evoked contralateral occipital positivity (ACOP) recorded from the scalp. The present study investigated the functional significance of this cross-modal activation of visual cortex, in particular whether the sound-evoked ACOP is predictive of improved perceptual processing of a subsequent visual target. A trial-by-trial analysis showed that the ACOP amplitude was markedly larger preceding correct than incorrect pattern discriminations of visual targets that were colocalized with the preceding sound. Dipole modeling of the scalp topography of the ACOP localized its neural generators to the ventrolateral extrastriate visual cortex. These results provide direct evidence that the cross-modal activation of contralateral visual cortex by a spatially nonpredictive but salient sound facilitates the discriminative processing of a subsequent visual target event at the location of the sound. Recordings of event-related potentials to the targets support the hypothesis that the ACOP is a neural consequence of the automatic orienting of visual attention to the location of the sound.

Salient sounds activate human visual cortex automatically.

Sudden changes in the acoustic environment enhance perceptual processing of subsequent visual stimuli that appear in close spatial proximity. Little is known, however, about the neural mechanisms by which salient sounds affect visual processing. In particular, it is unclear whether such sounds automatically activate visual cortex. To shed light on this issue, this study examined event-related brain potentials (ERPs) that were triggered either by peripheral sounds that preceded task-relevant visual targets (Experiment 1) or were presented during purely auditory tasks (Experiments 2-4). In all experiments the sounds elicited a contralateral ERP over the occipital scalp that was localized to neural generators in extrastriate visual cortex of the ventral occipital lobe. The amplitude of this cross-modal ERP was predictive of perceptual judgments about the contrast of colocalized visual targets. These findings demonstrate that sudden, intrusive sounds reflexively activate human visual cortex in a spatially specific manner, even during purely auditory tasks when the sounds are not relevant to the ongoing task.

Gamma band activity and the P3 reflect post-perceptual processes, not visual awareness.

A primary goal in cognitive neuroscience is to identify neural correlates of conscious perception (NCC). By contrasting conditions in which subjects are aware versus unaware of identical visual stimuli, a number of candidate NCCs have emerged; among them are induced gamma band activity in the EEG and the P3 event-related potential. In most previous studies, however, the critical stimuli were always directly relevant to the subjects' task, such that aware versus unaware contrasts may well have included differences in post-perceptual processing in addition to differences in conscious perception per se. Here, in a series of EEG experiments, visual awareness and task relevance were manipulated independently. Induced gamma activity and the P3 were absent for task-irrelevant stimuli regardless of whether subjects were aware of such stimuli. For task-relevant stimuli, gamma and the P3 were robust and dissociable, indicating that each reflects distinct post-perceptual processes necessary for carrying-out the task but not for consciously perceiving the stimuli. Overall, this pattern of results challenges a number of previous proposals linking gamma band activity and the P3 to conscious perception.

Earliest stages of visual cortical processing are not modified by attentional load.

This study investigated the effects of attentional load on neural responses to attended and irrelevant visual stimuli by recording high-density event-related potentials (ERPs) from the scalp in normal adult subjects. Peripheral (upper and lower visual field) and central stimuli were presented in random order at a rapid rate while subjects responded to targets among the central stimuli. Color detection and color-orientation conjunction search tasks were used as the low- and high-load tasks, respectively. Behavioral results showed significant load effects on both accuracy and reaction time for target detections. ERP results revealed no significant load effect on the initial C1 component (60-100 ms) evoked by either central-relevant or peripheral-irrelevant stimuli. Source analysis with dipole modeling confirmed previous reports that the C1 includes the initial evoked response in primary visual cortex. Source analyses indicated that high attentional load enhanced the early (70-140 ms) neural response to central-relevant stimuli in ventral-lateral extrastriate cortex, whereas load effects on peripheral-irrelevant stimulus processing started at 110 ms and were localized to more dorsal and anterior extrastriate cortical areas. These results provide evidence that the earliest stages of visual cortical processing are not modified by attentional load and show that attentional load affects the processing of task relevant and irrelevant stimuli in different ways.

Contributions of low and high spatial frequency processing to impaired object recognition circuitry in schizophrenia.

Patients with schizophrenia exhibit cognitive and sensory impairment, and object recognition deficits have been linked to sensory deficits. The "frame and fill" model of object recognition posits that low spatial frequency (LSF) information rapidly reaches the prefrontal cortex (PFC) and creates a general shape of an object that feeds back to the ventral temporal cortex to assist object recognition. Visual dysfunction findings in schizophrenia suggest a preferential loss of LSF information. This study used functional magnetic resonance imaging (fMRI) and resting state functional connectivity (RSFC) to investigate the contribution of visual deficits to impaired object "framing" circuitry in schizophrenia. Participants were shown object stimuli that were intact or contained only LSF or high spatial frequency (HSF) information. For controls, fMRI revealed preferential activation to LSF information in precuneus, superior temporal, and medial and dorsolateral PFC areas, whereas patients showed a preference for HSF information or no preference. RSFC revealed a lack of connectivity between early visual areas and PFC for patients. These results demonstrate impaired processing of LSF information during object recognition in schizophrenia, with patients instead displaying increased processing of HSF information. This is consistent with findings of a preference for local over global visual information in schizophrenia.

Imaging of brain electric field networks.

We present a method for direct imaging of the electric field networks in the human brain from electroencephalography (EEG) data with much higher temporal and spatial resolution than functional MRI (fMRI), without the concomitant distortions. The method is validated using simultaneous EEG/fMRI data in healthy subjects, intracranial EEG data in epilepsy patients, and in a direct comparison with standard EEG analysis in a well-established attention paradigm. The method is then demonstrated on a very large cohort of subjects performing a standard gambling task designed to activate the brain's 'reward circuit'. The technique uses the output from standard EEG systems and thus has potential for immediate benefit to a broad range of important basic scientific and clinical questions concerning brain electrical activity, but also provides an inexpensive and portable alternative to function MRI (fMRI).

Disrupted third visual pathway function in schizophrenia: Evidence from real and implied motion processing.

Impaired motion perception in schizophrenia has been associated with deficits in social-cognitive processes and with reduced activation of visual sensory regions, including the middle temporal area (MT+) and posterior superior temporal sulcus (pSTS). These findings are consistent with the recent proposal of the existence of a specific 'third visual pathway' specialized for social perception in which motion is a fundamental component. The third visual pathway transmits visual information from early sensory visual processing areas to the STS, with MT+ acting as a critical intermediary. We used functional magnetic resonance imaging to investigate functioning of this pathway during processing of naturalistic videos with explicit (real) motion and static images with implied motion cues. These measures were related to face emotion recognition and motion-perception, as measured behaviorally. Participants were 28 individuals with schizophrenia (Sz) and 20 neurotypical controls. Compared to controls, individuals with Sz showed reduced activation of third visual pathway regions (MT+, pSTS) in response to both real- and implied-motion stimuli. Dysfunction of early visual cortex and pulvinar were also associated with aberrant real-motion processing. Implied-motion stimuli additionally engaged a wide network of brain areas including parietal, motor and frontal nodes of the human mirror neuron system. The findings support concepts of MT+ as a mediator between visual sensory areas and higher-order brain and argue for greater focus on MT+ contributions to social-cognitive processing, in addition to its well-documented role in visual motion processing.

Comparison of psychophysical, electrophysiological, and fMRI assessment of visual contrast responses in patients with schizophrenia.

Perception has been identified by the NIMH-sponsored Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS) group as a useful domain for assessing cognitive deficits in patients with schizophrenia. Specific measures of contrast gain derived from recordings of steady-state visual evoked potentials (ssVEP) have demonstrated neural deficits within the visual pathways of patients with schizophrenia. Psychophysical measures of contrast sensitivity have also shown functional loss in these patients. In the current study, functional magnetic resonance imaging (fMRI) was used in conjunction with ssVEP and contrast sensitivity testing to elucidate the neural underpinnings of these deficits. During fMRI scanning, participants viewed 1) the same low and higher spatial frequency stimuli used in the psychophysical contrast sensitivity task, at both individual detection threshold contrast and at a high contrast; and 2) the same stimuli used in the ssVEP paradigm, which were designed to be biased toward either the magnocellular or parvocellular visual pathway. Patients showed significant impairment in contrast sensitivity at both spatial frequencies in the psychophysical task, but showed reduced occipital activation volume for low, but not higher, spatial frequency at the low and high contrasts tested in the magnet. As expected, patients exhibited selective deficits under the magnocellular-biased ssVEP condition. However, occipital lobe fMRI responses demonstrated the same general pattern for magnocellular- and parvocellular-biased stimuli across groups. These results indicate dissociation between the fMRI measures and the psychophysical/ssVEP measures. These latter measures appear to have greater value for the functional assessment of the contrast deficits explored here.

Consequences of magnocellular dysfunction on processing attended information in schizophrenia.

Schizophrenia is associated with perceptual and cognitive dysfunction including impairments in visual attention. These impairments may be related to deficits in early stages of sensory/perceptual processing, particularly within the magnocellular/dorsal visual pathway. In the present study, subjects viewed high and low spatial frequency (SF) gratings designed to test functioning of the parvocellular/magnocellular pathways, respectively. Schizophrenia patients and healthy controls attended to either the low SF (magnocellularly biased) or high SF (parvocellularly biased) gratings. Functional magnetic resonance imaging (fMRI) and recordings of event-related potentials (ERPs) were carried out during task performance. Patients were impaired at detecting low-frequency targets. ERP amplitudes to low-frequency gratings were diminished, both for the early sensory-evoked components and for the attend minus unattend difference component (the selection negativity), which is regarded as a neural index of feature-selective attention. Similarly, fMRI revealed that activity in extrastriate visual cortex was reduced in patients during attention to low, but not high, SF. In contrast, activity in frontal and parietal areas, previously implicated in the control of attention, did not differ between patients and controls. These findings suggest that impaired sensory processing of magnocellularly biased stimuli lead to impairments in the effective processing of attended stimuli, even when the attention control systems themselves are intact.

Neural substrates of perceptual integration during bistable object perception.

The way we perceive an object depends both on feedforward, bottom-up processing of its physical stimulus properties and on top-down factors such as attention, context, expectation, and task relevance. Here we compared neural activity elicited by varying perceptions of the same physical image--a bistable moving image in which perception spontaneously alternates between dissociated fragments and a single, unified object. A time-frequency analysis of EEG changes associated with the perceptual switch from object to fragment and vice versa revealed a greater decrease in alpha (8-12 Hz) accompanying the switch to object percept than to fragment percept. Recordings of event-related potentials elicited by irrelevant probes superimposed on the moving image revealed an enhanced positivity between 184 and 212 ms when the probes were contained within the boundaries of the perceived unitary object. The topography of the positivity (P2) in this latency range elicited by probes during object perception was distinct from the topography elicited by probes during fragment perception, suggesting that the neural processing of probes differed as a function of perceptual state. Two source localization algorithms estimated the neural generator of this object-related difference to lie in the lateral occipital cortex, a region long associated with object perception. These data suggest that perceived objects attract attention, incorporate visual elements occurring within their boundaries into unified object representations, and enhance the visual processing of elements occurring within their boundaries. Importantly, the perceived object in this case emerged as a function of the fluctuating perceptual state of the viewer.

Bottom-up and top-down contributions to impaired motion processing in schizophrenia.

Background and Hypothesis: Motion processing deficits in schizophrenia have been linked to impairments in higher-order social-cognitive processes. The neural underpinnings are not fully understood but it has been hypothesized that middle temporal area (MT+) may serve as a bridge between purely sensory and more cognitive proceseses. We investigated the interrelationship between MT+ sensory processing deficits and impairments in higher-order processing using naturalistic videos with explicit motion and static images with implied-motion cues. Study Design: Functional magnetic resonance imaging was used to evaluate cortical and subcortical brain regions associated with real- and implied-motion processing in 28 individuals with schizophrenia and 20 neurotypical controls. These measures were related to face emotion recognition and motion-perception deficits, as measured behaviorally. Study Results: Activation of MT+ was abnormal in schizophrenia during both real- and implied-motion processing. Dysfunction of early visual cortex and pulvinar were also associated with impaired real-motion processing. During implied-motion-perception, MT+ participated in a wider network involving sensorimotor and prefrontal nodes of the human mirror neuron system, known to play a role in social-cognitive processes. Perception of both real- and implied-motion engaged the posterior superior temporal sulcus, a key node of the social brain network. Conclusions: The findings support concepts of MT+ as a bridge between visual sensory areas and higher-order brain regions especially in relationship to face emotion recognition and social cognition. Our data argue for greater focus on MT+ contributions to social-cognitive processing, in addition to its well-documented role in visual motion processing.

Network-level mechanisms underlying effects of transcranial direct current stimulation (tDCS) on visuomotor learning impairments in schizophrenia.

Motor learning is a fundamental skill to our daily lives. Dysfunction in motor performance in schizophrenia (Sz) is associated with poor social and functional outcomes, but nevertheless remains understudied relative to other neurocognitive domains. Moreover, transcranial direct current stimulation (tDCS) can influence underlying brain function in Sz and may be especially useful in enhancing local cortical plasticity, but underlying neural mechanisms remain incompletely understood. Here, we evaluated performance of Sz individuals on the Serial Reaction Time Task (SRTT), which has been extensively used in prior tDCS research, in combination with concurrent tDCS and EEG source localization first to evaluate the integrity of visuomotor learning in Sz relative to other cognitive domains and second to investigate underlying neural mechanisms. Twenty-seven individuals with Sz and 21 healthy controls (HC) performed the SRTT task as they received sham or active tDCS and simultaneous EEG recording. Measures of motor, neuropsychological and global functioning were also assessed. Impaired SRTT performance correlated significantly with deficits in motor performance, working memory, and global functioning. Time-frequency ("Beamformer") EEG source localization showed beta-band coherence across supplementary-motor, primary-motor and visual cortex regions, with reduced visuomotor coherence in Sz relative to HC. Cathodal tDCS targeting both visual and motor regions resulted in significant modulation in coherence particularly across the motor-visual nodes of the network accompanied by significant improvement in motor learning in both controls and patients. Overall, these findings demonstrate the utility of the SRTT to study mechanisms of visuomotor impairment in Sz and demonstrate significant tDCS effects on both learning and connectivity when applied over either visual or motor regions. The findings support continued study of dysfunctional dorsal-stream visual connectivity and motor plasticity as components of cognitive impairment in Sz, of local tDCS administration for enhancement of plasticity, and of source-space EEG-based biomarkers for evaluation of underlying neural mechanisms.

Early auditory processing dysfunction in schizophrenia: Mechanisms and implications.

Schizophrenia is a major mental disorder that affects approximately 1% of the population worldwide. Cognitive deficits are a key feature of the disorder and a primary cause of long-term disability. Over the past decades, significant literature has accumulated demonstrating impairments in early auditory perceptual processes in schizophrenia. In this review, we first describe early auditory dysfunction in schizophrenia from both a behavioral and neurophysiological perspective and examine their interrelationship with both higher order cognitive constructs and social cognitive processes. Then, we provide insights into underlying pathological processes, especially in relationship to glutamatergic and N-methyl-D-aspartate receptor (NMDAR) dysfunction models. Finally, we discuss the utility of early auditory measures as both treatment targets for precision intervention and as translational biomarkers for etiological investigation. Altogether, this review points out the crucial role of early auditory deficits in the pathophysiology of schizophrenia, in addition to major implications for early intervention and auditory-targeted approaches.