Attention Strongly Modulates Reliability of Neural Responses to Naturalistic Narrative Stimuli.

Attentional engagement is a major determinant of how effectively we gather information through our senses. Alongside the sheer growth in the amount and variety of information content that we are presented with through modern media, there is increased variability in the degree to which we "absorb" that information. Traditional research on attention has illuminated the basic principles of sensory selection to isolated features or locations, but it provides little insight into the neural underpinnings of our attentional engagement with modern naturalistic content. Here, we show in human subjects that the reliability of an individual's neural responses with respect to a larger group provides a highly robust index of the level of attentional engagement with a naturalistic narrative stimulus. Specifically, fast electroencephalographic evoked responses were more strongly correlated across subjects when naturally attending to auditory or audiovisual narratives than when attention was directed inward to a mental arithmetic task during stimulus presentation. This effect was strongest for audiovisual stimuli with a cohesive narrative and greatly reduced for speech stimuli lacking meaning. For compelling audiovisual narratives, the effect is remarkably strong, allowing perfect discrimination between attentional state across individuals. Control experiments rule out possible confounds related to altered eye movement trajectories or order of presentation. We conclude that reliability of evoked activity reproduced across subjects viewing the same movie is highly sensitive to the attentional state of the viewer and listener, which is aided by a cohesive narrative.

A supramodal accumulation-to-bound signal that determines perceptual decisions in humans.

In theoretical accounts of perceptual decision-making, a decision variable integrates noisy sensory evidence and determines action through a boundary-crossing criterion. Signals bearing these very properties have been characterized in single neurons in monkeys, but have yet to be directly identified in humans. Using a gradual target detection task, we isolated a freely evolving decision variable signal in human subjects that exhibited every aspect of the dynamics observed in its single-neuron counterparts. This signal could be continuously tracked in parallel with fully dissociable sensory encoding and motor preparation signals, and could be systematically perturbed mid-flight during decision formation. Furthermore, we found that the signal was completely domain general: it exhibited the same decision-predictive dynamics regardless of sensory modality and stimulus features and tracked cumulative evidence even in the absence of overt action. These findings provide a uniquely clear view on the neural determinants of simple perceptual decisions in humans.

Oscillatory sensory selection mechanisms during intersensory attention to rhythmic auditory and visual inputs: a human electrocorticographic investigation.

Oscillatory entrainment mechanisms are invoked during attentional processing of rhythmically occurring stimuli, whereby their phase alignment regulates the excitability state of neurons coding for anticipated inputs. These mechanisms have been examined in the delta band (1-3 Hz), where entrainment frequency matches the stimulation rate. Here, we investigated entrainment for subdelta rhythmic stimulation, recording from intracranial electrodes over human auditory cortex during an intersensory audiovisual task. Audiovisual stimuli were presented at 0.67 Hz while participants detected targets within one sensory stream and ignored the other. It was found that entrainment operated at twice the stimulation rate (1.33 Hz), and this was reflected by higher amplitude values in the FFT spectrum, cyclic modulation of alpha-amplitude, and phase-amplitude coupling between delta phase and alpha power. In addition, we found that alpha-amplitude was relatively increased in auditory cortex coincident with to-be-ignored auditory stimuli during attention to vision. Thus, the data suggest that entrainment mechanisms operate within a delimited passband such that for subdelta task rhythms, oscillatory harmonics are invoked. The phase of these delta-entrained oscillations modulates alpha-band power. This may in turn increase or decrease responsiveness to relevant and irrelevant stimuli, respectively.

The N1 auditory evoked potential component as an endophenotype for schizophrenia: high-density electrical mapping in clinically unaffected first-degree relatives, first-episode, and chronic schizophrenia patients.

The N1 component of the auditory evoked potential (AEP) is a robust and easily recorded metric of auditory sensory-perceptual processing. In patients with schizophrenia, a diminution in the amplitude of this component is a near-ubiquitous finding. A pair of recent studies has also shown this N1 deficit in first-degree relatives of schizophrenia probands, suggesting that the deficit may be linked to the underlying genetic risk of the disease rather than to the disease state itself. However, in both these studies, a significant proportion of the relatives had other psychiatric conditions. As such, although the N1 deficit represents an intriguing candidate endophenotype for schizophrenia, it remains to be shown whether it is present in a group of clinically unaffected first-degree relatives. In addition to testing first-degree relatives, we also sought to replicate the N1 deficit in a group of first-episode patients and in a group of chronic schizophrenia probands. Subject groups consisted of 35 patients with schizophrenia, 30 unaffected first-degree relatives, 13 first-episode patients, and 22 healthy controls. Subjects sat in a dimly lit room and listened to a series of simple 1,000-Hz tones, indicating with a button press whenever they heard a deviant tone (1,500 Hz; 17% probability), while the AEP was recorded from 72 scalp electrodes. Both chronic and first-episode patients showed clear N1 amplitude decrements relative to healthy control subjects. Crucially, unaffected first-degree relatives also showed a clear N1 deficit. This study provides further support for the proposal that the auditory N1 deficit in schizophrenia is linked to the underlying genetic risk of developing this disorder. In light of recent studies, these results point to the N1 deficit as an endophenotypic marker for schizophrenia. The potential future utility of this metric as one element of a multivariate endophenotype is discussed.

Multisensory processing of naturalistic objects in motion: a high-density electrical mapping and source estimation study.

In everyday life, we continuously and effortlessly integrate the multiple sensory inputs from objects in motion. For instance, the sound and the visual percept of vehicles in traffic provide us with complementary information about the location and motion of vehicles. Here, we used high-density electrical mapping and local auto-regressive average (LAURA) source estimation to study the integration of multisensory objects in motion as reflected in event-related potentials (ERPs). A randomized stream of naturalistic multisensory-audiovisual (AV), unisensory-auditory (A), and unisensory-visual (V) "splash" clips (i.e., a drop falling and hitting a water surface) was presented among non-naturalistic abstract motion stimuli. The visual clip onset preceded the "splash" onset by 100 ms for multisensory stimuli. For naturalistic objects early multisensory integration effects beginning 120-140 ms after sound onset were observed over posterior scalp, with distributed sources localized to occipital cortex, temporal lobule, insular, and medial frontal gyrus (MFG). These effects, together with longer latency interactions (210-250 and 300-350 ms) found in a widespread network of occipital, temporal, and frontal areas, suggest that naturalistic objects in motion are processed at multiple stages of multisensory integration. The pattern of integration effects differed considerably for non-naturalistic stimuli. Unlike naturalistic objects, no early interactions were found for non-naturalistic objects. The earliest integration effects for non-naturalistic stimuli were observed 210-250 ms after sound onset including large portions of the inferior parietal cortex (IPC). As such, there were clear differences in the cortical networks activated by multisensory motion stimuli as a consequence of the semantic relatedness (or lack thereof) of the constituent sensory elements.