[The EEG N400 component as a marker of language acquisition and processing in cochlear implant users]. / Die N400-Komponente im EEG als Marker für Spracherwerb und Wortverarbeitung nach CI-Versorgung.

Language processing can be measured objectively using late components in the evoked brain potential. The most established component in this area of research is the N400 component, a negativity that peaks at about 400 ms after stimulus onset with a centro-parietal maximum. It reflects semantic processing. Its presence, as well as its temporal and quantitative expression, allows to conclude about the quality of processing. It is therefore suitable for measuring speech comprehension in special populations, such as cochlear implant (CI) users. The following is an overview of the use of the N400 component as a tool for studying language processes in CI users. We present studies with adult CI users, where the N400 reflects the quality of speech comprehension with the new hearing device and we present studies with children where the emergence of the N400 component reflects the acquisition of their very first vocabulary.

Language Without Speech: Segregating Distinct Circuits in the Human Brain.

Language is a fundamental part of human cognition. The question of whether language is processed independently of speech, however, is still heavily discussed. The absence of speech in deaf signers offers the opportunity to disentangle language from speech in the human brain. Using probabilistic tractography, we compared brain structural connectivity of adult deaf signers who had learned sign language early in life to that of matched hearing controls. Quantitative comparison of the connectivity profiles revealed that the core language tracts did not differ between signers and controls, confirming that language is independent of speech. In contrast, pathways involved in the production and perception of speech displayed lower connectivity in deaf signers compared to hearing controls. These differences were located in tracts towards the left pre-supplementary motor area and the thalamus when seeding in Broca's area, and in ipsilateral parietal areas and the precuneus with seeds in left posterior temporal regions. Furthermore, the interhemispheric connectivity between the auditory cortices was lower in the deaf than in the hearing group, underlining the importance of the transcallosal connection for early auditory processes. The present results provide evidence for a functional segregation of the neural pathways for language and speech.

The Basis for Language Acquisition: Congenitally Deaf Infants Discriminate Vowel Length in the First Months after Cochlear Implantation.

One main incentive for supplying hearing impaired children with a cochlear implant is the prospect of oral language acquisition. Only scarce knowledge exists, however, of what congenitally deaf children actually perceive when receiving their first auditory input, and specifically what speech-relevant features they are able to extract from the new modality. We therefore presented congenitally deaf infants and young children implanted before the age of 4 years with an oddball paradigm of long and short vowel variants of the syllable /ba/. We measured the EEG in regular intervals to study their discriminative ability starting with the first activation of the implant up to 8 months later. We were thus able to time-track the emerging ability to differentiate one of the most basic linguistic features that bears semantic differentiation and helps in word segmentation, namely, vowel length. Results show that already 2 months after the first auditory input, but not directly after implant activation, these early implanted children differentiate between long and short syllables. Surprisingly, after only 4 months of hearing experience, the ERPs have reached the same properties as those of the normal hearing control group, demonstrating the plasticity of the brain with respect to the new modality. We thus show that a simple but linguistically highly relevant feature such as vowel length reaches age-appropriate electrophysiological levels as fast as 4 months after the first acoustic stimulation, providing an important basis for further language acquisition.

Syntactic and auditory spatial processing in the human temporal cortex: an MEG study.

Processing syntax is believed to be a higher cognitive function involving cortical regions outside sensory cortices. In particular, previous studies revealed that early syntactic processes at around 100-200 ms affect brain activations in anterior regions of the superior temporal gyrus (STG), while independent studies showed that pure auditory perceptual processing is related to sensory cortex activations. However, syntax-related modulations of sensory cortices were reported recently, thereby adding diverging findings to the previous studies. The goal of the present magnetoencephalography study was to localize the cortical regions underlying early syntactic processes and those underlying perceptual processes using a within-subject design. Sentences varying the factors syntax (correct vs. incorrect) and auditory space (standard vs. change of interaural time difference (ITD)) were auditorily presented. Both syntactic and auditory spatial anomalies led to very early activations (40-90 ms) in the STG. Around 135 ms after violation onset, differential effects were observed for syntax and auditory space, with syntactically incorrect sentences leading to activations in the anterior STG, whereas ITD changes elicited activations more posterior in the STG. Furthermore, our observations strongly indicate that the anterior and the posterior STG are activated simultaneously when a double violation is encountered. Thus, the present findings provide evidence of a dissociation of speech-related processes in the anterior STG and the processing of auditory spatial information in the posterior STG, compatible with the view of different processing streams in the temporal cortex.

Combined Brain-Perfusion SPECT and EEG Measurements Suggest Distinct Strategies for Speech Comprehension in CI Users With Higher and Lower Performance.

Cochlear implantation constitutes a successful therapy of inner ear deafness, with the majority of patients showing good outcomes. There is, however, still some unexplained variability in outcomes with a number of cochlear-implant (CI) users, showing major limitations in speech comprehension. The current study used a multimodal diagnostic approach combining single-photon emission computed tomography (SPECT) and electroencephalography (EEG) to examine the mechanisms underlying speech processing in postlingually deafened CI users (N = 21). In one session, the participants performed a speech discrimination task, during which a 96-channel EEG was recorded and the perfusions marker 99mTc-HMPAO was injected intravenously. The SPECT scan was acquired 1.5 h after injection to measure the cortical activity during the speech task. The second session included a SPECT scan after injection without stimulation at rest. Analysis of EEG and SPECT data showed N400 and P600 event-related potentials (ERPs) particularly evoked by semantic violations in the sentences, and enhanced perfusion in a temporo-frontal network during task compared to rest, involving the auditory cortex bilaterally and Broca's area. Moreover, higher performance in testing for word recognition and verbal intelligence strongly correlated to the activation in this network during the speech task. However, comparing CI users with lower and higher speech intelligibility [median split with cutoff + 7.6 dB signal-to-noise ratio (SNR) in the Göttinger sentence test] revealed for CI users with higher performance additional activations of parietal and occipital regions and for those with lower performance stronger activation of superior frontal areas. Furthermore, SPECT activity was tightly coupled with EEG and cognitive abilities, as indicated by correlations between (1) cortical activation and the amplitudes in EEG, N400 (temporal and occipital areas)/P600 (parietal and occipital areas) and (2) between cortical activation in left-sided temporal and bilateral occipital/parietal areas and working memory capacity. These results suggest the recruitment of a temporo-frontal network in CI users during speech processing and a close connection between ERP effects and cortical activation in CI users. The observed differences in speech-evoked cortical activation patterns for CI users with higher and lower speech intelligibility suggest distinct processing strategies during speech rehabilitation with CI.

Conflict monitoring engages the mediofrontal cortex during nonword processing.

The current study investigated the role played by conflict monitoring in a lexical-decision task involving competing word representations, using event-related potentials. We extended the multiple read-out model (Grainger and Jacobs, 1996), a connectionist model of word recognition, to quantify conflict by means of Hopfield Energy, which is defined as the sum of the products of all orthographic word node pair activations within the artificial mental lexicon of this model. With increasing conflict levels in nonwords, a late negativity increased in amplitude (400-600 ms) accompanied by activation of the anterior cingulate cortex and the medial frontal gyrus. The simulated conflict predicted the amplitudes associated with this mediofrontal conflict-monitoring network on an item level, and is consistent with the conflict-monitoring theory.

Establishing a mental lexicon with cochlear implants: an ERP study with young children.

In the present study we explore the implications of acquiring language when relying mainly or exclusively on input from a cochlear implant (CI), a device providing auditory input to otherwise deaf individuals. We focus on the time course of semantic learning in children within the second year of implant use; a period that equals the auditory age of normal hearing children during which vocabulary emerges and extends dramatically. 32 young bilaterally implanted children saw pictures paired with either matching or non-matching auditory words. Their electroencephalographic responses were recorded after 12, 18 and 24 months of implant use, revealing a large dichotomy: Some children failed to show semantic processing throughout their second year of CI use, which fell in line with their poor language outcomes. The majority of children, though, demonstrated semantic processing in form of the so-called N400 effect already after 12 months of implant use, even when their language experience relied exclusively on the implant. This is slightly earlier than observed for normal hearing children of the same auditory age, suggesting that more mature cognitive faculties at the beginning of language acquisition lead to faster semantic learning.

Neurodynamics of sentence interpretation: ERP evidence from French.

Sentence interpretation was examined with event-related brain potentials (ERPs). The ERPs were recorded while participants listened to French sentences containing a subject-modifying relative clause (SRC). These were either correct, semantically incorrect, syntactically incorrect, or doubly (syntactically and semantically) incorrect. The semantic anomaly realized as a selectional restriction violation was associated with an N400. The syntactic anomaly realized as a phrase structure violation in the SRC elicited a frontal negativity between 150 and 600 ms. This negativity was more pronounced in the left than in the right hemisphere in the early time window (150-300 ms). In a later time window (300-600 ms), it was more broadly distributed including anterior and posterior regions, but with a maximum over the anterior recording sites. Finally, a centro-parietal late positivity (P600) was found between 600 and 1000 ms. While syntactic and semantic information in the double violation condition did not interact between 150 and 300 ms, they did interact between 300 and 600 ms. This finding supports serial models of sentence processing that postulate an initial autonomous stage of phrase structure building and a late stage of interaction.

Lexical-semantic processes in children with specific language impairment.

The current study used event-related brain potentials to investigate lexical-semantic processing of words in sentences spoken by children with specific language impairment and children with normal language development. Children heard correct sentences and sentences with a violation of the selectional restriction of the verb. Control children showed an N400 effect followed by a late positivity for the incorrect sentences. In contrast, children with specific language impairment showed no N400 effect but did show a late, broadly distributed positivity. This absence of the N400 effect is due to a relatively large negativity for correct sentences, suggesting weaker lexical-semantic representations of the verbs and their selectional restrictions in children with specific language impairment.

Brain potentials to morphologically complex words during listening.

This study uses event-related brain potentials (ERPs) to investigate the processing of morphologically regular and irregular words during auditory comprehension. ERPs were recorded, while 23 German-speaking subjects listened to correctly and incorrectly inflected noun plural forms presented in sentential contexts. ERP responses to violations of morphological structure were different to those of lexical (word-level) violations: the former elicited LAN/P600 effects, and the latter an enhanced N400 component relative to the correctly inflected plural forms. This difference replicates previous results from visual ERP studies and supports the distinction between combinatorial and memory-based processing of morphologically complex words. In addition, LAN/P600 effects were found to be more prominent in the auditory domain than in a previous visual study using similar materials.

Localizing the distributed language network responsible for the N400 measured by MEG during auditory sentence processing.

We studied auditory sentence comprehension using magnetoencephalography while subjects listened to sentences whose correctness they had to judge subsequently. The localization and the time course of brain electrical activity during processing of correct and semantically incorrect sentences were estimated by computing a brain surface current density within a cortical layer for both conditions. Finally, a region of interest (ROI) analysis was conducted to determine the time course of specific locations. A magnetic N400 was present in six spatially different ROIs. Semantic anomalies caused an exclusive involvement of the ventral portion of the left inferior frontal gyrus (BA 47) and left pars triangularis (BA 45). The anterior parts of the superior (BA 22) and inferior (BA 20/21) temporal gyri bilaterally were activated by both conditions. The activation for the correct condition, however, peaked earlier in both left temporal regions (approximately 32 ms). In general, activation due to semantic violations was more pronounced, started later, and lasted longer as compared to correct sentences. The findings reveal a clear left-hemispheric dominance during language processing indicated firstly by the mere number of activated regions (four in the left vs. two in the right hemisphere) and secondly by the observed specificity of the left inferior frontal ROIs to semantic violations. The temporal advantage observed for the correct condition in the left temporal regions is supporting the notion that the established context eases the processing of the final word. Semantically incorrect words that do not fit into the context result in longer integration times.

Model-generated lexical activity predicts graded ERP amplitudes in lexical decision.

Recent neurocognitive studies of visual word recognition provide information about neuronal networks correlated with processes involved in lexical access and their time course (e.g., [Holcomb, Ph.J., Grainger J. and O'Rourke, T. (2002). An Electrophysiological Study of the Effects of Orthographic Neighborhood Size on Printed Word Perception, J. of Cogn. Neurosci. 14 938-950; Binder, J.R., McKiernan, K.A., Parsons, M.E., Westbury, C.F., Possing, E.T., Kaufman, J.N. and Buchanan, L. (2003). Neural Correlates of Lexical Access during Visual Word Recognition, J. Cogn. Neurosci. 15 372-393.]). These studies relate the orthographic neighborhood density of letter strings to the amount of global lexical activity in the brain, generated by a hypothetical mental lexicon as speculated in an early paper by [Jacobs, A.M. and Carr, T.H. (1995). Mind mappers and cognitive modelers: Toward cross-fertilization, Behav. Brain. Sci. 18 362-363]. The present study uses model-generated stimuli theoretically eliciting graded global lexical activity and relates this activity to activation of lexical processing networks using event-related potentials (ERPs). The results from a lexical decision task provide evidence for an effect of lexicality around 350 ms post-stimulus and also a graded effect of global lexical activity for nonwords around 500 ms post-stimulus. The data are interpreted as reflecting two different decision processes: an identification process based on local lexical activity underlying the 'yes' response to words and a temporal deadline process underlying the 'no' response to nonwords based on global lexical activity.

Phonological activation of category coordinates during speech planning is observable in children but not in adults: evidence for cascaded processing.

There is a long-standing debate in the area of speech production on the question of whether only words selected for articulation are phonologically activated (as maintained by serial-discrete models) or whether this is also true for their semantic competitors (as maintained by forward-cascading and interactive models). Past research has addressed this issue by testing whether retrieval of a target word (e.g., cat) affects--or is affected by--the processing of a word that is phonologically related to a semantic category coordinate of the target (e.g., doll, related to dog) and has consistently failed to obtain such mediated effects in adult speakers. The authors present a series of experiments demonstrating that mediated effects are present in children (around age 7) and diminish with increasing age. This observation provides further evidence for cascaded models of lexical retrieval.

Improvements of sensorimotor processes during action cascading associated with changes in sensory processing architecture-insights from sensory deprivation.

In most everyday situations sensorimotor processes are quite complex because situations often require to carry out several actions in a specific temporal order; i.e. one has to cascade different actions. While it is known that changes to stimuli affect action cascading mechanisms, it is unknown whether action cascading changes when sensory stimuli are not manipulated, but the neural architecture to process these stimuli is altered. In the current study we test this hypothesis using prelingually deaf subjects as a model to answer this question. We use a system neurophysiological approach using event-related potentials (ERPs) and source localization techniques. We show that prelingually deaf subjects show improvements in action cascading. However, this improvement is most likely not due to changes at the perceptual (P1-ERP) and attentional processing level (N1-ERP), but due to changes at the response selection level (P3-ERP). It seems that the temporo-parietal junction (TPJ) is important for these effects to occur, because the TPJ comprises overlapping networks important for the processing of sensory information and the selection of responses. Sensory deprivation thus affects cognitive processes downstream of sensory processing and only these seem to be important for behavioral improvements in situations requiring complex sensorimotor processes and action cascading.

Understanding music with cochlear implants.

Direct stimulation of the auditory nerve via a Cochlear Implant (CI) enables profoundly hearing-impaired people to perceive sounds. Many CI users find language comprehension satisfactory, but music perception is generally considered difficult. However, music contains different dimensions which might be accessible in different ways. We aimed to highlight three main dimensions of music processing in CI users which rely on different processing mechanisms: (1) musical discrimination abilities, (2) access to meaning in music, and (3) subjective music appreciation. All three dimensions were investigated in two CI user groups (post- and prelingually deafened CI users, all implanted as adults) and a matched normal hearing control group. The meaning of music was studied by using event-related potentials (with the N400 component as marker) during a music-word priming task while music appreciation was gathered by a questionnaire. The results reveal a double dissociation between the three dimensions of music processing. Despite impaired discrimination abilities of both CI user groups compared to the control group, appreciation was reduced only in postlingual CI users. While musical meaning processing was restorable in postlingual CI users, as shown by a N400 effect, data of prelingual CI users lack the N400 effect and indicate previous dysfunctional concept building.

Adult Cochlear Implant Users Are Able to Discriminate Basic Tonal Features in Musical Patterns: Evidence From Event-related Potentials.

OBJECTIVE: Measurement of electrophysiological correlates of discrimination abilities of basic musical features in pre- and postlingually deafened adult cochlear implant (CI) users. STUDY DESIGN: Electroencephalographic study. Comparison between CI users and matched normal hearing controls. PATIENTS: Thirty-six hearing impaired adults using a cochlear implant for 4 to 15 months. Profound hearing impairment was acquired either before (N = 12) or after language acquisition (N = 17). Seven patients suffered from a single-sided deafness. METHODS: Presentation of auditory stimuli consisting of musical four tone standard patterns and deviant patterns varying with regard to tone pitch, timbre, intensity, and rhythm of two different degrees. Analysis of electrophysiological, event-related mismatch responses. RESULTS: Cochlear implant users elicited significant mismatch responses on most deviant features. Comparison to controls revealed significantly smaller mismatch negativity amplitudes. Except for one parameter (pitch) there were no reliable differences between pre- and postlingually deafened CI users. CONCLUSION: Despite a highly reduced complexity of neural auditory stimulation by the cochlear implant device in comparison to the physiological cochlear input, CI users exhibit cortical discriminatory responses to relatively subtle basic tonal alterations.

The Perception of Stress Pattern in Young Cochlear Implanted Children: An EEG Study.

Children with sensorineural hearing loss may (re)gain hearing with a cochlear implant-a device that transforms sounds into electric pulses and bypasses the dysfunctioning inner ear by stimulating the auditory nerve directly with an electrode array. Many implanted children master the acquisition of spoken language successfully, yet we still have little knowledge of the actual input they receive with the implant and specifically which language sensitive cues they hear. This would be important however, both for understanding the flexibility of the auditory system when presented with stimuli after a (life-) long phase of deprivation and for planning therapeutic intervention. In rhythmic languages the general stress pattern conveys important information about word boundaries. Infant language acquisition relies on such cues and can be severely hampered when this information is missing, as seen for dyslexic children and children with specific language impairment. Here we ask whether children with a cochlear implant perceive differences in stress patterns during their language acquisition phase and if they do, whether it is present directly following implant stimulation or if and how much time is needed for the auditory system to adapt to the new sensory modality. We performed a longitudinal ERP study, testing in bimonthly intervals the stress pattern perception of 17 young hearing impaired children (age range: 9-50 months; mean: 22 months) during their first 6 months of implant use. An additional session before the implantation served as control baseline. During a session they passively listened to an oddball paradigm featuring the disyllable "baba," which was stressed either on the first or second syllable (trochaic vs. iambic stress pattern). A group of age-matched normal hearing children participated as controls. Our results show, that within the first 6 months of implant use the implanted children develop a negative mismatch response for iambic but not for trochaic deviants, thus showing the same result as the normal hearing controls. Even congenitally deaf children show the same developing pattern. We therefore conclude (a) that young implanted children have early access to stress pattern information and (b) that they develop ERP responses similar to those of normal hearing children.

Reduced stress pattern discrimination in 5-month-olds as a marker of risk for later language impairment: neurophysiologial evidence.

The study at hand investigates prosodic abilities of infants as early predictors of Specific Language Impairment (SLI), which is commonly diagnosed at a later age. The study is based on the hypothesis that the prosodic abilities of infants at risk for SLI are less elaborated than those of controls due to less efficient processing of the relevant acoustic cues. One of the most critical prosodic cues for word segmentation is stress pattern. In German as well as in English, the most frequent stress pattern of bisyllabics is the trochee, in which stress is placed on the first syllable. Using a passive oddball design, German 5-month-olds were examined with respect to their ability to discriminate different stress patterns of bisyllabics. Infants were grouped retrospectively based on their production performance at the ages of 12 and 24 months. In contrast to matched controls, infants with very low word production displayed event-related brain potentials with a significantly reduced amplitude of the discrimination response, i.e. a Mismatch Negativity (MMN), to the trochaic stress pattern. This amplitude difference indicates impaired prosodic processing of word stress during early development and may thus be taken as an early marker of risk for SLI.

When word category information encounters morphosyntax: an ERP study.

The present study investigated the relationship between two different syntactic information types, namely word category and morphosyntax. The event-related brain potential (ERP) pattern of acoustically presented sentences containing two syntactic anomalies (word category and subject-verb agreement) was compared to the ERP response to sentences containing a single violation. The ERPs for the agreement violation revealed a left anterior negativity (LAN) indicating the detection of the morphosyntactic error, followed by a P600 reflecting processes of reanalysis. The ERPs for both the category and the combined violation showed an early negativity reflecting processes of phrase structure building, followed by a P600 indicating syntactic reanalysis. Additionally, a broadly distributed negativity following the early negativity and preceding the P600 was observed. This ERP component is suggested to reflect reference specification processes arising from the specific sentence structure used in the present study. The ERP pattern for the combined violation suggests no additivity or interaction between the two syntactic anomalies in the early time windows (early negativity, reference-related negativity, and LAN), whereas interactive effects are observed in a late time range (P600).

Word category and verb--argument structure information in the dynamics of parsing.

One of the core issues in psycholinguistic research concerns the relationship between word category information and verb-argument structure (e.g. transitivity) information of verbs in the process of sentence parsing. In two experiments (visual versus auditory presentation) using event-related brain potentials (ERPs), we addressed this question by presenting sentences in which the critical word simultaneously realized both a word category and a transitivity violation. ERPs for sentences with both types of violation clustered with the patterns for sentences with a word category violation only, but were different from the patterns elicited by argument structure violations in isolation, since only the latter elicited an N400 ERP component. The finding that an argument structure violation evoked an N400 only if the phrase structure of the respective sentence was correct suggests that a successful integration of the word category information of a verb functionally precedes the application of its argument structure information.