Native and non-native speech sound processing and the neural mismatch responses: A longitudinal study on classroom-based foreign language learning.

Learning a foreign language in a natural immersion context with high exposure to the new language has been shown to change the way speech sounds of that language are processed at the neural level. It remains unclear, however, to what extent this is also the case for classroom-based foreign language learning, particularly in children. To this end, we presented a mismatch negativity (MMN) experiment during EEG recordings as part of a longitudinal developmental study: 38 monolingual (Swiss-) German speaking children (7.5 years) were tested shortly before they started to learn English at school and followed up one year later. Moreover, 22 (Swiss-) German adults were recorded. Instead of the originally found positive mismatch response in children, an MMN emerged when applying a high-pass filter of 3 Hz. The overlap of a slow-wave positivity with the MMN indicates that two concurrent mismatch processes were elicited in children. The children's MMN in response to the non-native speech contrast was smaller compared to the native speech contrast irrespective of foreign language learning, suggesting that no additional neural resources were committed to processing the foreign language speech sound after one year of classroom-based learning.

The level of audiovisual print-speech integration deficits in dyslexia.

The classical phonological deficit account of dyslexia is increasingly linked to impairments in grapho-phonological conversion, and to dysfunctions in superior temporal regions associated with audiovisual integration. The present study investigates mechanisms of audiovisual integration in typical and impaired readers at the critical developmental stage of adolescence. Congruent and incongruent audiovisual as well as unimodal (visual only and auditory only) material was presented. Audiovisual presentations were single letters and three-letter (consonant-vowel-consonant) stimuli accompanied by matching or mismatching speech sounds. Three-letter stimuli exhibited fast phonetic transitions as in real-life language processing and reading. Congruency effects, i.e. different brain responses to congruent and incongruent stimuli were taken as an indicator of audiovisual integration at a phonetic level (grapho-phonological conversion). Comparisons of unimodal and audiovisual stimuli revealed basic, more sensory aspects of audiovisual integration. By means of these two criteria of audiovisual integration, the generalizability of audiovisual deficits in dyslexia was tested. Moreover, it was expected that the more naturalistic three-letter stimuli are superior to single letters in revealing group differences. Electrophysiological and hemodynamic (EEG and fMRI) data were acquired simultaneously in a simple target detection task. Applying the same statistical models to event-related EEG potentials and fMRI responses allowed comparing the effects detected by the two techniques at a descriptive level. Group differences in congruency effects (congruent against incongruent) were observed in regions involved in grapho-phonological processing, including the left inferior frontal and angular gyri and the inferotemporal cortex. Importantly, such differences also emerged in superior temporal key regions. Three-letter stimuli revealed stronger group differences than single letters. No significant differences in basic measures of audiovisual integration emerged. Convergence of hemodynamic and electrophysiological signals appeared to be limited and mainly occurred for highly significant and large effects in visual cortices. The findings suggest efficient superior temporal tuning to audiovisual congruency in controls. In impaired readers, however, grapho-phonological conversion is effortful and inefficient, although basic audiovisual mechanisms seem intact. This unprecedented demonstration of audiovisual deficits in adolescent dyslexics provides critical evidence that the phonological deficit might be explained by impaired audiovisual integration at a phonetic level, especially for naturalistic and word-like stimulation.

Effects of rhyme and spelling patterns on auditory word ERPs depend on selective attention to phonology.

ERP responses to spoken words are sensitive to both rhyming effects and effects of associated spelling patterns. Are such effects automatically elicited by spoken words or dependent on selectively attending to phonology? To address this question, ERP responses to spoken word pairs were investigated under two equally demanding listening tasks that directed selective attention either to sub-syllabic phonology (i.e., rhyme judgments) or to melodies embedded within the words. ERPs elicited when participants selectively attended to phonology demonstrated a rhyming effect that was concurrent with online stimulus encoding and an orthographic effect that emerged later. ERP responses to the same stimuli presented under melodic focus, however, showed no evidence of sensitivity to rhyme or spelling patterns. Results reveal limitations to the automaticity of such ERP effects, suggesting that rhyme effects may depend, at least to some degree, on allocation of attention to phonology, which may in turn activate task-incidental orthographic information.

Auditory selective attention to speech modulates activity in the visual word form area.

Selective attention to speech versus nonspeech signals in complex auditory input could produce top-down modulation of cortical regions previously linked to perception of spoken, and even visual, words. To isolate such top-down attentional effects, we contrasted 2 equally challenging active listening tasks, performed on the same complex auditory stimuli (words overlaid with a series of 3 tones). Instructions required selectively attending to either the speech signals (in service of rhyme judgment) or the melodic signals (tone-triplet matching). Selective attention to speech, relative to attention to melody, was associated with blood oxygenation level-dependent (BOLD) increases during functional magnetic resonance imaging (fMRI) in left inferior frontal gyrus, temporal regions, and the visual word form area (VWFA). Further investigation of the activity in visual regions revealed overall deactivation relative to baseline rest for both attention conditions. Topographic analysis demonstrated that while attending to melody drove deactivation equivalently across all fusiform regions of interest examined, attending to speech produced a regionally specific modulation: deactivation of all fusiform regions, except the VWFA. Results indicate that selective attention to speech can topographically tune extrastriate cortex, leading to increased activity in VWFA relative to surrounding regions, in line with the well-established connectivity between areas related to spoken and visual word perception in skilled readers.

Development of the automatic mismatch response: from frontal positivity in kindergarten children to the mismatch negativity.

OBJECTIVE: The automatic event-related potential (ERP) response to auditory deviance typically consists of a frontocentral mismatch negativity (MMN), which has been shown to be quite stable during development. Whereas in some infant studies, positive frontal mismatch responses have been reported instead of a MMN; to date, such positivities have not been reported for older children. METHODS: Oddball sequences with small frequency and phoneme deviance (standard: 1000 Hz, 'ba'; larger deviance: 1060 Hz, 'ta'; smaller deviance: 1030 Hz, 'da') and short intervals (every 0.38 s) were presented to 6-7-year-old children and adults during 43-channel ERP recordings. RESULTS: Children showed a consistent frontal positive mismatch response with posterior negativity (179-207 ms), and adults a frontocentral MMN with mastoid positivity (129-199 ms). This map polarity reversal was reflected by significantly different 3D centroid distributions. Low-resolution electromagnetic tomography (LORETA) revealed temporal mismatch response sources for both age groups and conditions. CONCLUSIONS: Major developmental changes characterise the automatic mismatch response for the small deviances and short intervals used. Source localisation suggests that children's and adults' mismatch responses originated from superior temporal plane generators with similar localisation but opposite polarity. This indicates qualitatively different neurophysiological functioning of the automatic bi-temporal auditory change detectors in children and adults.