Generalizable EEG Encoding Models with Naturalistic Audiovisual Stimuli.

In natural conversations, listeners must attend to what others are saying while ignoring extraneous background sounds. Recent studies have used encoding models to predict electroencephalography (EEG) responses to speech in noise-free listening situations, sometimes referred to as "speech tracking." Researchers have analyzed how speech tracking changes with different types of background noise. It is unclear, however, whether neural responses from acoustically rich, naturalistic environments with and without background noise can be generalized to more controlled stimuli. If encoding models for acoustically rich, naturalistic stimuli are generalizable to other tasks, this could aid in data collection from populations of individuals who may not tolerate listening to more controlled and less engaging stimuli for long periods of time. We recorded noninvasive scalp EEG while 17 human participants (8 male/9 female) listened to speech without noise and audiovisual speech stimuli containing overlapping speakers and background sounds. We fit multivariate temporal receptive field encoding models to predict EEG responses to pitch, the acoustic envelope, phonological features, and visual cues in both stimulus conditions. Our results suggested that neural responses to naturalistic stimuli were generalizable to more controlled datasets. EEG responses to speech in isolation were predicted accurately using phonological features alone, while responses to speech in a rich acoustic background were more accurate when including both phonological and acoustic features. Our findings suggest that naturalistic audiovisual stimuli can be used to measure receptive fields that are comparable and generalizable to more controlled audio-only stimuli.SIGNIFICANCE STATEMENT Understanding spoken language in natural environments requires listeners to parse acoustic and linguistic information in the presence of other distracting stimuli. However, most studies of auditory processing rely on highly controlled stimuli with no background noise, or with background noise inserted at specific times. Here, we compare models where EEG data are predicted based on a combination of acoustic, phonetic, and visual features in highly disparate stimuli-sentences from a speech corpus and speech embedded within movie trailers. We show that modeling neural responses to highly noisy, audiovisual movies can uncover tuning for acoustic and phonetic information that generalizes to simpler stimuli typically used in sensory neuroscience experiments.

Acute separate and combined effects of cannabinoid and nicotinic receptor agonists on MMN-indexed auditory deviance detection in healthy humans.

The high prevalence of concomitant cannabis and nicotine use has implications for sensory and cognitive processing. While nicotine tends to enhance function in these domains, cannabis use has been associated with both sensory and cognitive impairments, though the underlying mechanisms are unclear. Additionally, the interaction of the nicotinic (nAChR) and cannabinoid (CB1) receptor systems has received limited study in terms of sensory/cognitive processes. This study involving healthy volunteers assessed the acute separate and combined effects of nabilone (a CB1 agonist) and nicotine on sensory processing as assessed by auditory deviance detection and indexed by the mismatch negativity (MMN) event-related potential. It was hypothesized that nabilone would impair auditory discriminability as shown by diminished MMN amplitudes, but not when administered in combination with nicotine. 20 male non-smokers and non-cannabis-users were assessed using a 5-stimulus 'optimal' multi-feature MMN paradigm within a randomized, placebo controlled design (placebo; nabilone [0.5 mg]; nicotine [6 mg]; and nicotine + nabilone). Treatment effects were region- and deviant-dependent. At the temporal regions (mastoid sites), MMN was reduced by nabilone and nicotine separately, whereas co-administration resulted in no impairment. At the frontal region, MMN was enhanced by co-administration of nicotine and nabilone, with no MMN effects being found with separate treatment. These neural effects have relevance for sensory/cognitive processes influenced by separate and simultaneous use of cannabis and tobacco and may have treatment implications for disorders associated with sensory dysfunction and impairments in endocannabinoid and nicotinic cholinergic neurotransmission.

Qualitative modeling of the decision-making process using electrooculography.

A novel method based on electrooculography (EOG) has been introduced in this work to study the decision-making process. An experiment was designed and implemented wherein subjects were asked to choose between two items from the same category that were presented within a limited time. The EOG and voice signals of the subjects were recorded during the experiment. A calibration task was performed to map the EOG signals to their corresponding gaze positions on the screen by using an artificial neural network. To analyze the data, 16 parameters were extracted from the response time and EOG signals of the subjects. Evaluation and comparison of the parameters, together with subjects' choices, revealed functional information. On the basis of this information, subjects switched their eye gazes between items about three times on average. We also found, according to statistical hypothesis testing-that is, a t test, t(10) = 71.62, SE = 1.25, p < .0001-that the correspondence rate of a subjects' gaze at the moment of selection with the selected item was significant. Ultimately, on the basis of these results, we propose a qualitative choice model for the decision-making task.

P300 latency Jitter occurrence in patients with disorders of consciousness: Toward a better design for Brain Computer Interface applications.

In this study the P300 latency jitter has been explored in an EEG data set collected from a group of patients with disorders of consciousness (DOC; n=13) that was administered with an auditory Oddball paradigm under passive and active conditions. A method based on wavelet transform was applied to estimate single trial P300 waveforms. Preliminary results showed that 5 Vegetative State (VS) and 8 Minimally Conscious Staten (MCS) patients exhibited significantly higher values of P300 latency jitter as compared to those obtained from a control group of 12 healthy subjects. In addition, the magnitude of the P300 latency jitter negatively correlated with patients' clinical status. The existence of such phenomenon might substantially limit an effective use of Brain Computer Interface systems for communication.

Ocular and cardiac artifact rejection for real-time analysis in MEG.

BACKGROUND: Recently, magnetoencephalography (MEG) based real-time brain computing interfaces (BCI) have been developed to enable novel and promising methods for neuroscience research. It is well known that artifact rejection prior to source localization largely enhances the localization accuracy. However, many BCI approaches neglect real-time artifact removal due to its time consuming process. NEW METHOD: The method (referred to as ocular and cardiac artifact rejection for real-time analysis, OCARTA) is based on constrained independent component analysis (cICA), where a priori information of the underlying source signals is used to optimize and accelerate signal decomposition. Thereby, prior information is incorporated by using the subject's individual cardiac and ocular activity. The algorithm automatically uses different separation strategies depending on the underlying source activity. RESULTS: OCARTA was tested and applied to data from three different but most commonly used MEG systems (4D-Neuroimaging, VSM MedTech Inc. and Elekta Neuromag). Ocular and cardiac artifacts were effectively reduced within one iteration at a time delay of 1ms performed on a standard PC (Intel Core i5-2410M). COMPARISON WITH EXISTING METHODS: The artifact rejection results achieved with OCARTA are in line with the results reported for offline ICA-based artifact rejection methods. CONCLUSION: Due to the fast and subject-specific signal decomposition the new approach introduced here is capable of real-time ocular and cardiac artifact rejection.

Methods to eliminate stimulus transduction artifact from insert earphones during electroencephalography.

OBJECTIVE: To reduce stimulus transduction artifacts in EEG while using insert earphones. DESIGN: Reference Equivalent Threshold SPLs were assessed for Etymotic ER-4B earphones in 15 volunteers. Auditory brainstem responses (ABRs) and middle latency responses (MLRs)-as well as long-duration complex ABRs-to click and /dα/ speech stimuli were recorded in a single-case design. RESULTS: Transduction artifacts occurred in raw EEG responses, but they were eliminated by shielding, counter-phasing (averaging across stimuli 180° out of phase), or rereferencing. CONCLUSIONS: Clinical grade ABRs, MLRs, and cABRs can be recorded with a standard digital EEG system and high-fidelity insert earphones, provided one or more techniques are used to remove the stimulus transduction artifact.

Understanding of spoken language under challenging listening conditions in younger and older listeners: a combined behavioral and electrophysiological study.

Numerous studies suggested an age-related decline in speech perception under difficult listening conditions. Here, spoken language understanding of two age groups of listeners was investigated in a naturalistic "stock price monitoring" task. Stock prices of listed companies were simultaneously recited by three speakers at different positions in space and presented via headphones to 14 younger and 14 older listeners (age ranges 19-25 and 54-64 years, respectively). The listeners had to respond when prices of target companies exceeded a specific value, but to ignore all other prices as well as beep sounds randomly interspersed within the stock prices. Older listeners did not produce more missing responses, or longer response times than younger listeners. However, differences in event-related potentials indicated a reduced parietal P3b of older, relative to younger, listeners. Separate analyses for those listeners who performed relatively high or low in the behavioral task revealed a right-frontal P3a that was pronounced especially in the group of high-performing older listeners. Correlational analyses indicated a direct relationship between P3a amplitude and spoken language comprehension in older, but not younger, listeners. Furthermore, younger (especially, low-performing) listeners showed a more pronounced P2 on irrelevant beep sounds than older listeners. These subtle differences in cortical processing between age groups suggest that high performance of older middle-aged listeners in demanding listening situations is associated with increased engagement of frontal brain areas, and thus the allocation of mental resources for compensation of potential declines in spoken language understanding.

Motor imagery effectiveness for mirror reversed movements.

Physical practice is known to enhance motor adaptation skills, which refer to the individual ability to compensate for environmental changes. So far, it is still unknown whether a similar effect can be observed following motor imagery (MI). Thirty-nine participants were tested during a joystick tracking task under both normal and mirror conditions (i.e., the inductive direction of the joystick was reversed), before and after a physical practice or MI training phase. Eye movements and electromyographic activity were recorded during MI. Motor performance was also evaluated after a 6 h interval during daytime. As compared to the control group, the results revealed that both MI and physical practice improved motor performance in the mirror condition, during the post-training test. Furthermore, the time to complete the task was further reduced after 6 hours, both in the normal and mirror conditions. These results demonstrate the effectiveness of MI for learning mirror-reversed movements, and for the consolidation process that follows motor adaptation.

The influence of dichotical fusion on the redundant signals effect, localization performance, and the mismatch negativity.

In two experiments, each including a simple reaction time (RT) task, a localization task, and a passive oddball paradigm, the physical similarity between two dichotically presented auditory stimuli was manipulated. In both experiments, a redundant signals effect (RSE), high localization performance, and a reliable mismatch negativity (MMN) was observed for largely differing stimuli, suggesting that these are coded separately in auditory memory. In contrast, no RSE and a localization rate close to chance level (experiment 1) or at chance (experiment 2) were observed for stimuli differing to a lesser degree. Crucially, for such stimuli a small (experiment 1) or no (experiment 2) MMN were observed. These MMN results indicate that such stimuli tend to fuse into a single percept and that this fusion occurs rather early within information processing.

Event-related potential correlates of the expectancy violation effect during emotional prosody processing.

The present study investigated the expectancy violation effects evoked by deviation in sentential emotional prosody (EP), and their association with the deviation patterns. Event-related potentials (ERPs) were recorded for mismatching EPs with different patterns of deviation and for matching control EPs while subjects performed emotional congruousness judgment in Experiment 1 and visual probe detection tasks in Experiment 2. In the control experiment, EPs and acoustically matched non-emotional materials were presented and ERPs were recorded while participants judged the sound intensity congruousness. It was found that an early negativity, whose peak latency varied with deviation pattern, was elicited by mismatching EPs relative to matching ones, irrespective of task-relevance. A late positivity was specifically induced by mismatching EPs, and was modulated by both deviation pattern and task-relevance. Moreover, these effects cannot be simply attributed to the change in non-emotional acoustic properties. These findings suggest that the brain detects the EP deviation rapidly, and then integrates it with context for comprehension, during which the emotionality plays a role of speeding up the perception and enhancing vigilance.

The electrophysiological effect of working memory load on involuntary attention in an auditory-visual distraction paradigm: an ERP study.

Event-related brain potentials (ERPs) were used to examine the electrophysiological effect of working memory (WM) load on involuntary attention caused by a task-irrelevant sound in an auditory-visual distraction paradigm. The different WM loads were manipulated by requiring subjects to remember the order of either three digits (low-load condition) or seven digits (high-load condition), and the irrelevant auditory stimuli consisted of repetitive standard sounds (80%) and environmental novel sounds (20%). We found that the difference waves (novel-minus-standard) showed significant MMN and Novelty-P3 components in the two WM load conditions. The amplitude of MMN increased with increasing the WM load, which indicated a more engaged change detection process under high-load condition. Then, the amplitude of Novelty-P3 was attenuated under high-load condition, which indicated a much reduced involuntary orienting of attention to novel sounds when increasing the WM load. These results indicated the top-down control of involuntary attention might be mainly active at the early change detection stage and the control of the later involuntary orienting of attention might be passive.

The relation of lead neurotoxicity to the event-related potential P3b component in Inuit children from arctic Québec.

The event-related potential (ERP) P3b, a cognitive electrophysiological measure that has been linked to working memory processing in many experimental paradigms, was measured in Inuit children from Nunavik (Arctic Québec, Canada) to assess lead (Pb) neurotoxicity. Visual and auditory oddball paradigms were administered at 5 (N=27) and 11 (N=110) years of age, respectively, to elicit this ERP component. Pearson correlations and multiple regression analyses were performed to examine the associations between Pb levels and P3b parameters (peak latency and amplitude). Greater prenatal Pb exposure was related to a decrease in P3b amplitude at 5 years of age, and early childhood Pb exposure was associated with delayed P3b latency at 5 years. No significant association was observed at 11 years. These results, in line with those from previous neurobehavioral studies, suggest that Pb exposure affects cognitive processing in children even though the Pb levels measured in a large majority of our sample were below the threshold value for public health intervention used by federal agencies. This study strengthens the arguments for reducing sources of Pb exposure in Nunavik and for lowering the blood Pb concentrations considered "acceptable" in governmental policies.

Haloperidol counteracts the ketamine-induced disruption of processing negativity, but not that of the P300 amplitude.

Antagonists of the N-methyl-D-aspartate (NMDA) receptors such as ketamine, induce abnormalities in healthy subjects similar to those found in schizophrenia. However, recent evidence, suggests that most of the currently known NMDA antagonists have a broader receptor profile than originally thought. Besides exerting an antagonistic effect on NMDA receptors, they have agonistic effects on dopamine D2 receptors. Can haloperidol (D2 antagonist) counteract the disruptive effects of ketamine on psychophysiological parameters of human attention? In a randomized, double-blind, placebo-controlled experiment 18 healthy male volunteers received placebo/placebo, placebo/ketamine (0.3 mg/kg i.v.) and haloperidol (2 mg)/ketamine (0.3 mg/kg i.v.) on three separate test days, after which they were tested in an auditory selective-attention paradigm. Haloperidol/ketamine reduced task performance compared to placebo/placebo, while the task performance in these two treatments did not differ from placebo/ketamine. Furthermore, placebo/ketamine reduced processing negativity compared to both placebo/placebo and haloperidol/ketamine, while processing negativity did not differ between placebo/placebo and haloperidol/ketamine treatments. However, both placebo/ketamine and haloperidol/ketamine reduced P300 amplitude compared to placebo/placebo, while P300 amplitude did not differ between placebo/ketamine and haloperidol/ketamine treatments. The combined effects of haloperidol and ketamine reduced task performance, suggesting that this is dependent on dopaminergic D2 activity, probably in the prefrontal cortex. In addition, ketamine reduced both P300 amplitude and processing negativity. In contrast to the P300 amplitude, the disruptive effects of ketamine on processing negativity could be prevented by pretreatment with haloperidol. The current results suggest that ketamine reduced P300 amplitude by its antagonistic effect on glutamatergic activity, while it reduced processing negativity by its agonistic effect on dopaminergic D2 activity.

The neural correlates of intending not to do something.

There has been plenty of research concerning the representation of voluntary action in the human brain. However, the question of how we represent the voluntary omission of an action has been largely neglected. Therefore this study aimed at investigating the representation of intentionally not doing something by means of event-related potentials (ERPs). Free-choice nonactions elicit similar evoked potentials as free-choice actions and instructed actions (augmented P2 and attenuated N2), which leads us to assume that the voluntary intention, not the overt nonaction, is the characteristic feature of free-choice nonaction. Beyond that we reveal differences between free-choice nonactions and instructed nonactions that resemble the typical N2 and P3 augmentation usually seen for NoGo trials in Go/NoGo paradigms, with the difference that the free-choice nonaction ERP takes the place of the typical Go ERP.

Sympathetic nerve and cardiovascular responses to auditory startle and prepulse inhibition.

While sudden (startling) sensory stimuli are generally thought of as inducing sympathetic excitation, in humans there is a short-lasting inhibition of limb muscle sympathetic nerve activity (MSNA). This study is the first to examine and contrast the effects of acoustic startle and the prepulse inhibition of startle (PPI) on MSNA, blood pressure, heart rate, and eye blinks. Startle elicited a two-component withdrawal of MSNA: an early inhibition of one sympathetic burst followed by a second inhibition. PPI abolished the early, but not the late MSNA inhibition. Prepulse stimuli alone had no early inhibitory effects on MSNA. Early MSNA inhibition, which may occur at latencies of approximately 100 ms, appears to be part of a CNS-generated startle reflex which subserves automatic defensive responses to potential threats. The late MSNA inhibition coincided with the stimulus-induced blood pressure increase and is probably an inhibitory reflex response.

Auditory-evoked potentials to frequency increase and decrease of high- and low-frequency tones.

OBJECTIVE: To define cortical brain responses to large and small frequency changes (increase and decrease) of high- and low-frequency tones. METHODS: Event-Related Potentials (ERPs) were recorded in response to a 10% or a 50% frequency increase from 250 or 4000 Hz tones that were approximately 3 s in duration and presented at 500-ms intervals. Frequency increase was followed after 1 s by a decrease back to base frequency. Frequency changes occurred at least 1 s before or after tone onset or offset, respectively. Subjects were not attending to the stimuli. Latency, amplitude and source current density estimates of ERPs were compared across frequency changes. RESULTS: All frequency changes evoked components P(50), N(100), and P(200). N(100) and P(200) had double peaks at bilateral and right temporal sites, respectively. These components were followed by a slow negativity (SN). The constituents of N(100) were predominantly localized to temporo-parietal auditory areas. The potentials and their intracranial distributions were affected by both base frequency (larger potentials to low frequency) and direction of change (larger potentials to increase than decrease), as well as by change magnitude (larger potentials to larger change). The differences between frequency increase and decrease depended on base frequency (smaller difference to high frequency) and were localized to frontal areas. CONCLUSIONS: Brain activity varies according to frequency change direction and magnitude as well as base frequency. SIGNIFICANCE: The effects of base frequency and direction of change may reflect brain networks involved in more complex processing such as speech that are differentially sensitive to frequency modulations of high (consonant discrimination) and low (vowels and prosody) frequencies.

The auditory P50 component to onset and offset of sound.

OBJECTIVE: The auditory Event-Related Potentials (ERP) of component P50 to sound onset and offset have been reported to be similar, but their magnetic homologue has been reported absent to sound offset. We compared the spatio-temporal distribution of cortical activity during P50 to sound onset and offset, without confounds of spectral change. METHODS: ERPs were recorded in response to onsets and offsets of silent intervals of 0.5 s (gaps) appearing randomly in otherwise continuous white noise and compared to ERPs to randomly distributed click pairs with half second separation presented in silence. Subjects were awake and distracted from the stimuli by reading a complicated text. Measures of P50 included peak latency and amplitude, as well as source current density estimates to the clicks and sound onsets and offsets. RESULTS: P50 occurred in response to noise onsets and to clicks, while to noise offset it was absent. Latency of P50 was similar to noise onset (56 ms) and to clicks (53 ms). Sources of P50 to noise onsets and clicks included bilateral superior parietal areas. In contrast, noise offsets activated left inferior temporal and occipital areas at the time of P50. Source current density was significantly higher to noise onset than offset in the vicinity of the temporo-parietal junction. CONCLUSIONS: P50 to sound offset is absent compared to the distinct P50 to sound onset and to clicks, at different intracranial sources. P50 to stimulus onset and to clicks appears to reflect preattentive arousal by a new sound in the scene. Sound offset does not involve a new sound and hence the absent P50. SIGNIFICANCE: Stimulus onset activates distinct early cortical processes that are absent to offset.

Effect of genioglossus contraction on pharyngeal lumen and airflow in sleep apnoea patients.

The purpose of the present study was to quantify the mechanical effect of genioglossus stimulation on flow mechanics and pharyngeal cross-sectional area in patients with obstructive sleep apnoea, and to identify variables that determine the magnitude of the respiratory effect of tongue protrusion. The pressure/flow and pressure/cross-sectional area relationships of the velo- and oropharynx were assessed in spontaneously breathing propofol-anaesthetised subjects before and during genioglossus stimulation. Genioglossus contraction decreased the critical pressure significantly from 1.2+/-3.3 to -0.7+/-3.8 cmH(2)O, with individual decreases ranging -0.6-5.9 cmH(2)O. Pharyngeal compliance was not affected by genioglossus contraction. The pharyngeal response to genioglossus stimulation was related to the magnitude of advancement of the posterior side of the tongue, but not to the severity of sleep apnoea, critical pressure, compliance or the shape and other characteristics of the velopharynx. Genioglossus contraction enlarges both the velo- and the oropharynx and lowers the critical pressure without affecting pharyngeal stiffness. The response to genioglossus stimulation depends upon the magnitude of tongue protrusion achieved rather than on inherent characteristics of the patient and their airway.

Neural effects of nicotine during auditory selective attention in smokers: an event-related potential study.

Acute nicotine has been found to improve task performance in smokers after smoking abstinence, but the attentional processes mediating these improvements are unclear. Since scalp-recorded event-related potentials (ERPs) have been shown to be sensitive indicators of selective attention, the effects of acutely administered nicotine were examined on ERPs and concomitant behavioural performance measures in an auditory selective attention task. Ten (6 males) overnight smoking-abstinent cigarette smokers received nicotine gum (4 mg) in a randomized, double-blind, placebo-controlled, crossover design. In a dichotic listening task [which required participants to attend and detect (target) deviant stimuli in one ear and to ignore similar stimuli in the other ear] which included ERP recordings and assessment of response speed and accuracy measures, nicotine gum failed to alter behavioural performance or amplitudes of ERP components sensitive to selective attention [reflected in the N100 and negative difference (Nd) component] or to pre-attentive detection of acoustic change [reflected in the mismatch negativity (MMN) component]. However, nicotine did influence the speed of these voluntary selective processes, as reflected by shortened latencies of the early Nd component. The findings are discussed in relation to the stimulus filter theory of smoking, and with respect to nicotine's actions on involuntary and controlled aspects of selective attention processes.

Event-related potentials in people at risk for vascular dementia.

This study examined the relationship between the integrity of cerebrovascular microcirculation, neuropsychological testing and event-related potential indices of cognitive functioning in a nonclinical group of participants being at risk for vascular dementia. Sonographic measures, magnetic resonance (MR) scans and ERPs were recorded in 30 participants treated for arterial hypertension, with no report of neurological or psychiatric disorders. As a sonographic measure of cerebral microcirculation, the arteriorvenous cerebral transit time (cTT) was recorded. While neuropsychological measures of memory functions and general mental ability functions did not show systematic correlations with the cTT and other measures of vascular pathology, a pronounced correlation was obtained between P3a latency and cTT. Participants with long cTT showed a delayed P3a. These findings suggest that the P3a is a sensitive measure for reduced cognitive functions even at early stages of cerebrovascular pathology and by this may be a valuable tool for the early identification of cognitive deficits in individuals being at risk for vascular dementia.