Measuring auditory event-related potentials at the external ear canal: A demonstrative study using a new electrode and error-feedback paradigm.

Although ear canal electroencephalogram (EEG) recording has received interest from basic and applied research communities, evidence on how it can be implemented in practice is limited. The present study involving eight male participants including the authors presents the utility of our ear canal electrode and method by demonstrating both comparability of ear canal EEG to those at nearby sites and distinctiveness that ear canal event-related potentials (ERPs) could have. For this purpose, we used the balanced noncephalic electrode reference and an experimental paradigm with an error-feedback sound. Clear auditory ERPs were detected at the ear canal sites with a sufficiently low noise level comparable with those at conventional sites. The N1c, a temporal maximum subcomponent, spread over the bilateral temporal sites, including the ear canals and earlobes. While consecutive signals are generally highly similar between the ear canal and the earlobe, the N1c was larger at the ear canal than the earlobe, as demonstrated by the conventional frequentist and the hierarchical Bayesian modelling approaches. Although an evident caveat is that our sample was limited in terms of size and sex, the general capability indicates that the structure of our ear canal electrode provides EEG measurement that can be used in basic and applied settings. Our experimental method can also be an ERP-based test that conveniently assesses the capability of existing and future ear canal electrodes. The distinctive nature of the ERPs to the error-feedback sound may be utilized to examine the basic aspects of auditory ERPs and to test the processes involved in feedback-guided behaviour of participants.

My view on your actions: Dynamic changes in viewpoint-dependent auditory ERP attenuation during action observation.

It has been suggested that during action observation, a sensory representation of the observed action is mapped onto one's own motor system. However, it is largely unexplored what this may imply for the early processing of the action's sensory consequences, whether the observational viewpoint exerts influence on this and how such a modulatory effect might change over time. We tested whether the event-related potential of auditory effects of actions observed from a first- versus third-person perspective show amplitude reductions compared with externally generated sounds, as revealed for self-generated sounds. Multilevel modeling on trial-level data showed distinct dynamic patterns for the two viewpoints on reductions of the N1, P2, and N2 components. For both viewpoints, an N1 reduction for sounds generated by observed actions versus externally generated sounds was observed. However, only during first-person observation, we found a temporal dynamic within experimental runs (i.e., the N1 reduction only emerged with increasing trial number), indicating time-variant, viewpoint-dependent processes involved in sensorimotor prediction during action observation. For the P2, only a viewpoint-independent reduction was found for sounds elicited by observed actions, which disappeared in the second half of the experiment. The opposite pattern was found in an exploratory analysis concerning the N2, revealing a reduction that increased in the second half of the experiment, and, moreover, a temporal dynamic within experimental runs for the first-person perspective, possibly reflecting an agency-related process. Overall, these results suggested that the processing of auditory outcomes of observed actions is dynamically modulated by the viewpoint over time.

A Systematic Comparison of High-End and Low-Cost EEG Amplifiers for Concealed, Around-the-Ear EEG Recordings.

Wearable electroencephalography (EEG) has the potential to improve everyday life through brain-computer interfaces (BCI) for applications such as sleep improvement, adaptive hearing aids, or thought-based digital device control. To make these innovations more practical for everyday use, researchers are looking to miniaturized, concealed EEG systems that can still collect neural activity precisely. For example, researchers are using flexible EEG electrode arrays that can be attached around the ear (cEEGrids) to study neural activations in everyday life situations. However, the use of such concealed EEG approaches is limited by measurement challenges such as reduced signal amplitudes and high recording system costs. In this article, we compare the performance of a lower-cost open-source amplification system, the OpenBCI Cyton+Daisy boards, with a benchmark amplifier, the MBrainTrain Smarting Mobi. Our results show that the OpenBCI system is a viable alternative for concealed EEG research, with highly similar noise performance, but slightly lower timing precision. This system can be a great option for researchers with a smaller budget and can, therefore, contribute significantly to advancing concealed EEG research.

An early perceptual locus of absolute pitch.

Absolute pitch (AP) refers to the naming of musical tone without external reference. The influential two-component model states that AP is limited by the late-emerging pitch labeling process only and not the earlier perceptual and memory processes. Over the years, however, support for this model at the neural level has been mixed with various methodological limitations. Here, the electroencephalography responses of 27 AP possessors and 27 non-AP possessors were recorded. During both name verification and passive listening, event-related potential analyses showed a difference between AP and non-AP possessors at about 200 ms in their response toward tones compared with noise stimuli. Multivariate pattern analyses suggested that pitch naming was subserved by a series of transient processes for the first 250 ms, followed by a stage-like process for both AP and non-AP possessors with no group differences between them. These findings are inconsistent with the predictions of the two-component model, and instead suggest the existence of an early perceptual locus of AP.

Non-rapid eye movement sleep and wake neurophysiology in schizophrenia.

Motivated by the potential of objective neurophysiological markers to index thalamocortical function in patients with severe psychiatric illnesses, we comprehensively characterized key non-rapid eye movement (NREM) sleep parameters across multiple domains, their interdependencies, and their relationship to waking event-related potentials and symptom severity. In 72 schizophrenia (SCZ) patients and 58 controls, we confirmed a marked reduction in sleep spindle density in SCZ and extended these findings to show that fast and slow spindle properties were largely uncorrelated. We also describe a novel measure of slow oscillation and spindle interaction that was attenuated in SCZ. The main sleep findings were replicated in a demographically distinct sample, and a joint model, based on multiple NREM components, statistically predicted disease status in the replication cohort. Although also altered in patients, auditory event-related potentials elicited during wake were unrelated to NREM metrics. Consistent with a growing literature implicating thalamocortical dysfunction in SCZ, our characterization identifies independent NREM and wake EEG biomarkers that may index distinct aspects of SCZ pathophysiology and point to multiple neural mechanisms underlying disease heterogeneity. This study lays the groundwork for evaluating these neurophysiological markers, individually or in combination, to guide efforts at treatment and prevention as well as identifying individuals most likely to benefit from specific interventions.

Illusion of control affects ERP amplitude reductions for auditory outcomes of self-generated actions.

The reduction of neural responses to self-generated stimuli compared to external stimuli is thought to result from the matching of motor-based sensory predictions and sensory reafferences and to serve the identification of changes in the environment as caused by oneself. The amplitude of the auditory event-related potential (ERP) component N1 seems to closely reflect this matching process, while the later positive component (P2/ P3a) has been associated with judgments of agency, which are also sensitive to contextual top-down information. In this study, we examined the effect of perceived control over sound production on the processing of self-generated and external stimuli, as reflected in these components. We used a new version of a classic two-button choice task to induce different degrees of the illusion of control (IoC) and recorded ERPs for the processing of self-generated and external sounds in a subsequent task. N1 amplitudes were reduced for self-generated compared to external sounds, but not significantly affected by IoC. P2/3a amplitudes were affected by IoC: We found reduced P2/3a amplitudes after a high compared to a low IoC induction training, but only for self-generated, not for external sounds. These findings suggest that prior contextual belief information induced by an IoC affects later processing as reflected in the P2/P3a, possibly for the formation of agency judgments, while early processing reflecting motor-based predictions is not affected.

Action-related auditory ERP attenuation is not modulated by action effect relevance.

Event-related potentials (ERPs) elicited by self-induced sounds are often smaller than ERPs elicited by identical, but externally generated sounds. This action-related auditory ERP attenuation is more pronounced when self-induced sounds are intermixed with similar sounds generated by an external source. The current study explored whether attentional factors contributed to this phenomenon. Participants performed tone-eliciting actions, while the action-tone contingency and the set of additional action effects (tactile only, tactile and visual) were manipulated in a blocked manner. Previous action-tone contingence-effects were replicated, but the addition of other sensory action consequences did not influence the magnitude of auditory ERP attenuation. This suggests that the amount of attention allocated to concurrent non-auditory action effects does not substantially affect the magnitude of action-related auditory ERP attenuation and is on a par with the assumption that action-related auditory ERP attenuation might be related to the process of distinguishing self-induced stimuli from externally generated ones.

Processing and utilization of auditory action effects in individual and social tasks.

The influence of action-effect integration on motor control and sensory processing is often investigated in arrangements featuring human-machine interactions. Such experiments focus on predictable sensory events produced through participants' interactions with simple response devices. Action-effect integration may, however, also occur when we interact with human partners. The current study examined the similarities and differences in perceptual and motor control processes related to generating sounds with or without the involvement of a human partner. We manipulated the complexity of the causal chain of events between the initial motor and the final sensory event. In the self-induced condition participants generated sounds directly by pressing a button, while in the interactive condition sounds resulted from a paired reaction-time task, that is, the final sound was generated indirectly, by relying on the contribution of the partner. Auditory event-related potentials (ERPs) and force application patterns were similar in the two conditions, suggesting that social action effects produced with the involvement of a second human agent in the causal sequence are processed, and utilized as action feedback in the same way as direct consequences of one's actions. The only reflection of a processing difference between the two conditions was a slow, posterior ERP waveform that started before the presentation of the auditory stimulus, which may reflect differences in stimulus expectancy or task difficulty.

Efference copy/corollary discharge function and targeted cognitive training in patients with schizophrenia.

INTRODUCTION: During vocalization, efference copy/corollary discharge mechanisms suppress the auditory cortical response to self-generated sounds as reflected in the N1 component of the auditory event-related potential (ERP). N1 suppression during talking is reduced in patients with schizophrenia. We hypothesized that these deficits would recover with auditory training that targets the speech processing system. METHODS: Forty-nine individuals early in the course of a schizophrenia-spectrum illness (ESZ) were randomly assigned to 40 h of Targeted Auditory Training (TAT; n = 23) or Computer Games (CG; n = 26). The N1 ERP component was elicited during production (Talk) and playback (Listen) of vocalization. Effects of Treatment on Global Cognition, N1 suppression (Talk-Listen), N1 during Talking and Listening were assessed. Simple effects of the passage of time were also assessed in the HC after 28 weeks. RESULTS: There was a Treatment × Time interaction revealing that N1 suppression was improved with TAT, but not with CG. TAT, but not CG, also improved Global Cognition. However, TAT and CG groups differed in their pre-treatment N1 suppression, and greater N1-suppression abnormalities were strongly associated with greater improvement in N1 suppression. CONCLUSIONS: In this sample of ESZ individuals, targeted auditory training appeared to improve the function of the efference copy/corollary discharge mechanism which tended to deteriorate with computer games. It remains to be determined if baseline N1 suppression abnormalities are necessary for TAT treatment to have a positive effect on efference copy/corollary discharge function or if improvements observed in this study represent a regression to the mean N1 suppression in ESZ. TRIAL REGISTRATION: ClinicalTrials.govNCT00694889. Registered 1 August 2007.

Human Novelty Response to Emotional Animal Vocalizations: Effects of Phylogeny and Familiarity.

Darwin (1872) postulated that emotional expressions contain universals that are retained across species. We recently showed that human rating responses were strongly affected by a listener's familiarity with vocalization types, whereas evidence for universal cross-taxa emotion recognition was limited. To disentangle the impact of evolutionarily retained mechanisms (phylogeny) and experience-driven cognitive processes (familiarity), we compared the temporal unfolding of event-related potentials (ERPs) in response to agonistic and affiliative vocalizations expressed by humans and three animal species. Using an auditory oddball novelty paradigm, ERPs were recorded in response to task-irrelevant novel sounds, comprising vocalizations varying in their degree of phylogenetic relationship and familiarity to humans. Vocalizations were recorded in affiliative and agonistic contexts. Offline, participants rated the vocalizations for valence, arousal, and familiarity. Correlation analyses revealed a significant correlation between a posteriorly distributed early negativity and arousal ratings. More specifically, a contextual category effect of this negativity was observed for human infant and chimpanzee vocalizations but absent for other species vocalizations. Further, a significant correlation between the later and more posteriorly P3a and P3b responses and familiarity ratings indicates a link between familiarity and attentional processing. A contextual category effect of the P3b was observed for the less familiar chimpanzee and tree shrew vocalizations. Taken together, these findings suggest that early negative ERP responses to agonistic and affiliative vocalizations may be influenced by evolutionary retained mechanisms, whereas the later orienting of attention (positive ERPs) may mainly be modulated by the prior experience.

Auditory ERP response to successive stimuli in infancy.

Background. Auditory Event-Related Potentials (ERPs) are useful for understanding early auditory development among infants, as it allows the collection of a relatively large amount of data in a short time. So far, studies that have investigated development in auditory ERPs in infancy have mainly used single sounds as stimuli. Yet in real life, infants must decode successive rather than single acoustic events. In the present study, we tested 4-, 8-, and 12-month-old infants' auditory ERPs to musical melodies comprising three piano notes, and examined ERPs to each individual note in the melody. Methods. Infants were presented with 360 repetitions of a three-note melody while EEG was recorded from 128 channels on the scalp through a Geodesic Sensor Net. For each infant, both latency and amplitude of auditory components P1 and N2 were measured from averaged ERPs for each individual note. Results. Analysis was restricted to response collected at frontal central site. For all three notes, there was an overall reduction in latency for both P1 and N2 over age. For P1, latency reduction was significant from 4 to 8 months, but not from 8 to 12 months. N2 latency, on the other hand, decreased significantly from 4 to 8 to 12 months. With regard to amplitude, no significant change was found for either P1 or N2. Nevertheless, the waveforms of the three age groups were qualitatively different: for the 4-month-olds, the P1-N2 deflection was attenuated for the second and the third notes; for the 8-month-olds, such attenuation was observed only for the middle note; for the 12-month-olds, the P1 and N2 peaks show relatively equivalent amplitude and peak width across all three notes. Conclusion. Our findings indicate that the infant brain is able to register successive acoustic events in a stream, and ERPs become better time-locked to each composite event over age. Younger infants may have difficulties in responding to late occurring events in a stream, and the onset response to the late events may overlap with the incomplete response to preceding events.

A Meta-analytic Review of Auditory Event-Related Potential Components as Endophenotypes for Schizophrenia: Perspectives From First-Degree Relatives.

INTRODUCTION: As endophenotypes bridge the gap between genetics and phenotypic disease expression, identifying reliable markers is important for fostering understanding of pathophysiology. The present aim was to conduct current meta-analyses of 3 key auditory event-related potential (ERP) components that have been held as potential endophenotypes for schizophrenia: P50, P300 amplitude and latency, and mismatch negativity (MMN), reflective of sensory gating, attention and classification speed, and perceptual discrimination ability, respectively. In order to assess endophenotype viability, these components were examined in unaffected relatives of patients with schizophrenia and healthy controls. METHODS: Effect sizes (ES) were examined between relatives and controls for P50 suppression (10 studies, n = 360 relatives, 473 controls), P300 amplitude (20 studies, n = 868 relatives, 961 controls), P300 latency (17 studies, n = 674 relatives, 792 controls), and MMN (11 studies, n = 377 relatives, 552 controls). RESULTS: Reliable differences in P50 suppression (ES = 0.86, P < .001), P300 amplitude (ES = -0.52, P < .001), and P300 latency (ES = 0.44, P < .05) were found between unaffected relatives and controls. A trend was found between relatives and controls for MMN (ES = 0.21, P = 0.06), and the use of extraneous channels was found to be a significant moderator (P = 0.01). When MMN was analyzed using frontocentral channel Fz, a significant difference was found (ES = 0.26, P < 0.01). DISCUSSION: The results indicate that P50 suppression, P300 amplitude and P300 latency, and MMN may serve as viable endophenotypes for schizophrenia.

Similar sound intensity dependence of the N1 and P2 components of the auditory ERP: Averaged and single trial evidence.

OBJECTIVE: The literature suggests that the N1 and P2 waves of the auditory ERP are dissociable at the developmental, experimental, and source levels. At the experimental level, inconsistent findings suggest different effects of intensity on the amplitudes of the auditory N1 and P2. Our main goal was to analyze the intensity dependence of the auditory N1 and P2 while controlling for habituation effects. METHODS: We examined the intensity dependence of both averaged and single-trial auditory N1 and P2 waves elicited in a repeated-stimulation protocol. RESULTS: N1 and P2 revealed similar intensity dependence on both standard and filter denoised ERP, with a linear tendency for higher intensities to elicit higher absolute peak amplitudes. At the single-trial level, both waves covary irrespective of stimulus intensity and trial order. CONCLUSIONS: Our results suggest that stimulus intensity variation induces similar effects on both and N1 and P2 and partially contradict previous data that classified the P2 as a non-habituating component. SIGNIFICANCE: Our findings contribute to the ongoing discussion on the functional significance of the auditory P2 deflection. In addition, the present work demonstrated the applicability of a filter denoising method for single-trial estimation in the analysis of the experimental effects on auditory ERP components.

Effect of mental fatigue caused by mobile 3D viewing on selective attention: an ERP study.

This study investigated behavioral responses to and auditory event-related potential (ERP) correlates of mental fatigue caused by mobile three-dimensional (3D) viewing. Twenty-six participants (14 women) performed a selective attention task in which they were asked to respond to the sounds presented at the attended side while ignoring sounds at the ignored side before and after mobile 3D viewing. Considering different individual susceptibilities to 3D, participants' subjective fatigue data were used to categorize them into two groups: fatigued and unfatigued. The amplitudes of d-ERP components were defined as differences in amplitudes between time-locked brain oscillations of the attended and ignored sounds, and these values were used to calculate the degree to which spatial selective attention was impaired by 3D mental fatigue. The fatigued group showed significantly longer response times after mobile 3D viewing compared to before the viewing. However, response accuracy did not significantly change between the two conditions, implying that the participants used a behavioral strategy to cope with their performance accuracy decrement by increasing their response times. No significant differences were observed for the unfatigued group. Analysis of covariance revealed group differences with significant and trends toward significant decreases in the d-P200 and d-late positive potential (LPP) amplitudes at the occipital electrodes of the fatigued and unfatigued groups. Our findings indicate that mentally fatigued participants did not effectively block out distractors in their information processing mechanism, providing support for the hypothesis that 3D mental fatigue impairs spatial selective attention and is characterized by changes in d-P200 and d-LPP amplitudes.

Smooth pursuit eye movement, prepulse inhibition, and auditory paired stimuli processing endophenotypes across the schizophrenia-bipolar disorder psychosis dimension.

BACKGROUND: This study examined smooth pursuit eye movement (SPEM), prepulse inhibition (PPI), and auditory event-related potentials (ERP) to paired stimuli as putative endophenotypes of psychosis across the schizophrenia-bipolar disorder dimension. METHODS: Sixty-four schizophrenia probands (SZP), 40 psychotic bipolar I disorder probands (BDP), 31 relatives of SZP (SZR), 26 relatives of BDP (BDR), and 53 healthy controls (HC) were tested. Standard clinical characterization, SPEM, PPI, and ERP measures were administered. RESULTS: There were no differences between either SZP and BDP or SZR and BDR on any of the SPEM, PPI, or ERP measure. Compared with HC, SZP and BDP had lower SPEM maintenance and predictive pursuit gain and ERP theta/alpha and beta magnitudes to the initial stimulus. PPI did not differ between the psychosis probands and HC. Compared with HC, SZR and BDR had lower predictive pursuit gain and ERP theta/alpha and beta magnitudes to the first stimulus with differences ranging from a significant to a trend level. Neither active symptoms severity nor concomitant medications were associated with neurophysiological outcomes. SPEM, PPI, and ERP scores had low intercorrelations. CONCLUSION: These findings support SPEM predictive pursuit and lower frequency auditory ERP activity in a paired stimuli paradigm as putative endophenotypes of psychosis common to SZ and BD probands and relatives. PPI did not differ between the psychosis probands and HC. Future studies in larger scale psychosis family samples targeting putative psychosis endophenotypes and underlying molecular and genetic mediators may aid in the development of biology-based diagnostic definitions.

Successful measurement of the mismatch negativity despite a concurrent movie soundtrack: reduced amplitude but normal component morphology.

OBJECTIVE: To examine the mechanisms responsible for the reduction of the mismatch negativity (MMN) ERP component observed in response to pitch changes when the soundtrack of a movie is presented while recording the MMN. METHODS: In three experiments we measured the MMN to tones that differed in pitch from a repeated standard tone presented with a silent subtitled movie, with the soundtrack played forward or backward, or with soundtracks set at different intensity levels. RESULTS: MMN amplitude was reduced when the soundtrack was presented either forward or backward compared to the silent subtitled movie. With the soundtrack, MMN amplitude increased proportionally to the increments in the sound-to-noise intensity ratio. CONCLUSION: MMN was reduced in amplitude but had normal morphology with a concurrent soundtrack, most likely because of basic acoustical interference from the soundtrack with MMN-critical tones rather than from attentional effects. SIGNIFICANCE: A normal MMN can be recorded with a concurrent movie soundtrack, but signal amplitudes need to be set with caution to ensure a sufficiently high sound-to-noise ratio between MMN stimuli and the soundtrack.

A Novel 9-Class Auditory ERP Paradigm Driving a Predictive Text Entry System.

Brain-computer interfaces (BCIs) based on event related potentials (ERPs) strive for offering communication pathways which are independent of muscle activity. While most visual ERP-based BCI paradigms require good control of the user's gaze direction, auditory BCI paradigms overcome this restriction. The present work proposes a novel approach using auditory evoked potentials for the example of a multiclass text spelling application. To control the ERP speller, BCI users focus their attention to two-dimensional auditory stimuli that vary in both, pitch (high/medium/low) and direction (left/middle/right) and that are presented via headphones. The resulting nine different control signals are exploited to drive a predictive text entry system. It enables the user to spell a letter by a single nine-class decision plus two additional decisions to confirm a spelled word. This paradigm - called PASS2D - was investigated in an online study with 12 healthy participants. Users spelled with more than 0.8 characters per minute on average (3.4 bits/min) which makes PASS2D a competitive method. It could enrich the toolbox of existing ERP paradigms for BCI end users like people with amyotrophic lateral sclerosis disease in a late stage.