Individual differences in the consistency of neural and behavioural responses to speech sounds.

There are documented individual differences among adults in the consistency of speech sound processing, both at neural and behavioural levels. Some adults show more consistent neural responses to speech sounds than others, as measured by an event-related potential called the frequency-following response (FFR); similarly, some adults show more consistent behavioural responses to native speech sounds than others, as measured by two-alternative forced choice (2AFC) and visual analog scaling (VAS) tasks. Adults also differ in how successfully they can perceive non-native speech sounds. Interestingly, it remains unclear whether these differences are related within individuals. In the current study, native English-speaking adults completed native phonetic perception tasks (2AFC and VAS), a non-native (German) phonetic perception task, and an FFR recording session. From these tasks, we derived measures of the consistency of participants' neural and behavioural responses to native speech as well as their non-native perception ability. We then examined the relationships among individual differences in these measures. Analysis of the behavioural measures revealed that more consistent responses to native sounds predicted more successful perception of unfamiliar German sounds. Analysis of neural and behavioural data did not reveal clear relationships between FFR consistency and our phonetic perception measures. This multimodal work furthers our understanding of individual differences in speech processing among adults, and may eventually lead to individualized approaches for enhancing non-native language acquisition in adulthood.

Exploring individual differences in native phonetic perception and their link to nonnative phonetic perception.

Adults differ considerably in their perception of both native and nonnative phonemes. For instance, when presented with continua of native phonemes on two-alternative forced choice (2AFC) or visual analog scaling (VAS) tasks, some people show sudden changes in responses (i.e., steep identification slopes) and others show gradual changes (i.e., shallow identification slopes). Moreover, some adults are more successful than others at learning unfamiliar phonemes. The predictors of these individual differences and the relationships between them are poorly understood. It also remains unclear to what extent different tasks (2AFC vs. VAS) may reflect distinct individual differences in perception. In two experiments, we addressed these questions by examining the relationships between individual differences in performance on native and nonnative phonetic perception tasks. We found that shallow 2AFC identification slopes were not related to shallow VAS identification slopes but were related to inconsistent VAS responses. Additionally, our results suggest that consistent native perception may play a role in promoting successful nonnative perception. These findings help characterize the nature of individual differences in phonetic perception and contribute to our understanding of how to measure such differences. This work also has implications for encouraging successful acquisition of new languages in adulthood. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Phrase parsing in a second language as indexed by the closure positive shift: The impact of language experience and acoustic cue salience.

Despite the importance of prosodic processing in utterance parsing, a majority of studies investigating boundary localization in a second language focus on word segmentation. The goal of the present study was to investigate the parsing of phrase boundaries in first and second languages from different prosodic typologies (stress-timed vs. syllable-timed). Fifty English-French bilingual adults who varied in native language (French or English) and second language proficiency listened to English and French utterances with different prosodic structures while event-related brain potentials were recorded. The utterances were built around target words presented either in phrase-final position (bearing phrase-final lengthening) or in penultimate position. Each participant listened to both English and French stimuli, providing data in their native language (used as reference) and their second language. Target words in phrase-final position elicited closure positive shifts across listeners in both languages, regardless of the language-specific acoustic cues associated with phrase-final lengthening (shorter phrase-final lengthening in English compared to French). Interestingly, directional effects were observed, where learning to parse English as a second language in a native-like manner seemed to require a higher proficiency level than learning to parse French as a second language. This pattern of results supports the idea that L2 listeners need to learn to recognize L2-specific phrase-final lengthening regardless of the apparent similarity across languages and that some language combinations might present greater challenges than others.

Age of Acquisition Modulates Alpha Power During Bilingual Speech Comprehension in Noise.

Research on bilingualism has grown exponentially in recent years. However, the comprehension of speech in noise, given the ubiquity of both bilingualism and noisy environments, has seen only limited focus. Electroencephalogram (EEG) studies in monolinguals show an increase in alpha power when listening to speech in noise, which, in the theoretical context where alpha power indexes attentional control, is thought to reflect an increase in attentional demands. In the current study, English/French bilinguals with similar second language (L2) proficiency and who varied in terms of age of L2 acquisition (AoA) from 0 (simultaneous bilinguals) to 15 years completed a speech perception in noise task. Participants were required to identify the final word of high and low semantically constrained auditory sentences such as "Stir your coffee with a spoon" vs. "Bob could have known about the spoon" in both of their languages and in both noise (multi-talker babble) and quiet during electrophysiological recording. We examined the effects of language, AoA, semantic constraint, and listening condition on participants' induced alpha power during speech comprehension. Our results show an increase in alpha power when participants were listening in their L2, suggesting that listening in an L2 requires additional attentional control compared to the first language, particularly early in processing during word identification. Additionally, despite similar proficiency across participants, our results suggest that under difficult processing demands, AoA modulates the amount of attention required to process the second language.

Early auditory responses to speech sounds in Parkinson's disease: preliminary data.

Parkinson's disease (PD), as a manifestation of basal ganglia dysfunction, is associated with a number of speech deficits, including reduced voice modulation and vocal output. Interestingly, previous work has shown that participants with PD show an increased feedback-driven motor response to unexpected fundamental frequency perturbations during speech production, and a heightened ability to detect differences in vocal pitch relative to control participants. Here, we explored one possible contributor to these enhanced responses. We recorded the frequency-following auditory brainstem response (FFR) to repetitions of the speech syllable [da] in PD and control participants. Participants with PD displayed a larger amplitude FFR related to the fundamental frequency of speech stimuli relative to the control group. The current preliminary results suggest the dysfunction of the basal ganglia in PD contributes to the early stage of auditory processing and may reflect one component of a broader sensorimotor processing impairment associated with the disease.

Bilingual language experience and the neural underpinnings of working memory.

A longstanding question in cognitive neuroscience and in the bilingualism literature is how early language experience influences brain development and cognitive outcomes, and whether these effects are global or specific to language-related processes. The current investigation examined the effect of the timing of language learning on the performance and neural correlates of phonological and non-verbal working memory, subcomponents of executive function. Three groups of bilinguals, who varied in terms of the timing of second language learning (i.e., simultaneous bilinguals learned their two languages from birth; early and late bilinguals who learned their second language before or after 5 years of age, respectively), performed phonological and non-verbal working memory tasks in the magnetic resonance imaging scanner. Results showed that there were no group differences in performance on either of the tasks, or in the neural correlates of performance of the non-verbal task. However, critically, we showed that despite similar behavioural performance, the groups differed in the patterns of neural recruitment during performance of the phonological working memory task. The pattern of group differences was non-linear, demonstrating similar neural recruitment for simultaneous and late bilinguals that differed from early bilinguals. Findings from the current study suggest a dynamic mapping between the brain and cognition, contributing to our current understanding of the effect of the timing of language learning on cognitive processes and demonstrating a specific effect on language-related executive function.

Spoken Word Segmentation in First and Second Language: When ERP and Behavioral Measures Diverge.

Previous studies of word segmentation in a second language have yielded equivocal results. This is not surprising given the differences in the bilingual experience and proficiency of the participants and the varied experimental designs that have been used. The present study tried to account for a number of relevant variables to determine if bilingual listeners are able to use native-like word segmentation strategies. Here, 61 French-English bilingual adults who varied in L1 (French or English) and language dominance took part in an audiovisual integration task while event-related brain potentials (ERPs) were recorded. Participants listened to sentences built around ambiguous syllable strings (which could be disambiguated based on different word segmentation patterns), during which an illustration was presented on screen. Participants were asked to determine if the illustration was related to the heard utterance or not. Each participant listened to both English and French utterances, providing segmentation patterns that included both their native language (used as reference) and their L2. Interestingly, different patterns of results were observed in the event-related potentials (online) and behavioral (offline) results, suggesting that L2 participants showed signs of being able to adapt their segmentation strategies to the specifics of the L2 (online ERP results), but that the extent of the adaptation varied as a function of listeners' language experience (offline behavioral results).

Visual feedback of the tongue influences speech adaptation to a physical modification of the oral cavity.

Studies examining sensorimotor adaptation of speech to changing sensory conditions have demonstrated a central role for both auditory and somatosensory feedback in speech motor learning. The potential influence of visual feedback of oral articulators, which is not typically available during speech production but may nonetheless enhance oral motor control, remains poorly understood. The present study explores the influence of ultrasound visual feedback of the tongue on adaptation of speech production (focusing on the sound /s/) to a physical perturbation of the oral articulators (prosthesis altering the shape of the hard palate). Two visual feedback groups were tested that differed in the two-dimensional plane being imaged (coronal or sagittal) during practice producing /s/ words, along with a no-visual-feedback control group. Participants in the coronal condition were found to adapt their speech production across a broader range of acoustic spectral moments and syllable contexts than the no-feedback controls. In contrast, the sagittal group showed reduced adaptation compared to no-feedback controls. The results indicate that real-time visual feedback of the tongue is spontaneously integrated during speech motor adaptation, with effects that can enhance or interfere with oral motor learning depending on compatibility of the visual articulatory information with requirements of the speaking task.

Near native-like stress pattern perception in English-French bilinguals as indexed by the mismatch negativity.

We examined lexical stress processing in English-French bilinguals. Auditory mismatch negativity (MMN) responses were recorded in response to English and French pseudowords, whose primary stress occurred either on a language-consistent "usual" or language-inconsistent "unusual" syllable. In most conditions, the pseudowords elicited two consecutive MMNs, and somewhat surprisingly, these MMNs were not systematically modulated by bilingual experience. This suggests that it is possible to achieve native-like pre-attentive processing of lexical stress, even in a language that one has not learned since birth.

Earlier age of second language learning induces more robust speech encoding in the auditory brainstem in adults, independent of amount of language exposure during early childhood.

Learning a second language (L2) at a young age is a driving factor of functional neuroplasticity in the auditory brainstem. To date, it remains unclear whether these effects remain stable until adulthood and to what degree the amount of exposure to the L2 in early childhood might affect their outcome. We compared three groups of adult English-French bilinguals in their ability to categorize English vowels in relation to their frequency following responses (FFR) evoked by the same vowels. At the time of testing, cognitive abilities as well as fluency in both languages were matched between the (1) simultaneous bilinguals (SIM, N = 18); (2) sequential bilinguals with L1-English (N = 14); and (3) sequential bilinguals with L1-French (N = 11). Our results show that the L1-English group show sharper category boundaries in identification of the vowels compared to the L1-French group. Furthermore, the same pattern was reflected in the FFRs (i.e., larger FFR responses in L1-English > SIM > L1-French), while again only the difference between the L1-English and the L1-French group was statistically significant; nonetheless, there was a trend towards larger FFR in SIM compared to L1-French. Our data extends previous literature showing that exposure to a language during the first years of life induces functional neuroplasticity in the auditory brainstem that remains stable until at least young adulthood. Furthermore, the findings suggest that amount of exposure (i.e., 100% vs. 50%) to that language does not differentially shape the robustness of the perceptual abilities or the auditory brainstem encoding of phonetic categories of the language. Statement of significance: Previous studies have indicated that early age of L2 acquisition induces functional neuroplasticity in the auditory brainstem during processing of the L2. This study compared three groups of adult bilinguals who differed in their age of L2 acquisition as well as the amount of exposure to the L2 during early childhood. We demonstrate for the first time that the neuroplastic effect in the brainstem remains stable until young adulthood and that the amount of L2 exposure does not influence behavioral or brainstem plasticity. Our study provides novel insights into low-level auditory plasticity as a function of varying bilingual experience.

Sensorimotor adaptation across the speech production workspace in response to a palatal perturbation.

Talkers have been shown to adapt the production of multiple vowel sounds simultaneously in response to altered auditory feedback. The present study extends this work by exploring the adaptation of speech production to a physical alteration of the vocal tract involving a palatal prosthesis that impacts both somatosensory and auditory feedback during the production of a range of consonants and vowels. Acoustic and kinematic measures of the tongue were used to examine the impact of the physical perturbation across the various speech sounds, and to assess learned changes following 20 min of speech practice involving the production of complex, variable sentences. As in prior studies, acoustic analyses showed perturbation and adaptation effects primarily for sounds directly involving interaction with the palate. Analyses of tongue kinematics, however, revealed systematic, robust effects of the perturbation and subsequent motor learning across the full range of speech sounds. The results indicate that speakers are able to reconfigure oral motor patterns during the production of multiple speech sounds spanning the articulatory workspace following a physical alteration of the vocal tract.

The Relationship Between Speech Perceptual Discrimination and Speech Production in Parkinson's Disease.

Purpose We recently demonstrated that individuals with Parkinson's disease (PD) respond differentially to specific altered auditory feedback parameters during speech production. Participants with PD respond more robustly to pitch and less robustly to formant manipulations compared to control participants. In this study, we investigated whether differences in perceptual processing may in part underlie these compensatory differences in speech production. Methods Pitch and formant feedback manipulations were presented under 2 conditions: production and listening. In the production condition, 15 participants with PD and 15 age- and gender-matched healthy control participants judged whether their own speech output was manipulated in real time. During the listening task, participants judged whether paired tokens of their previously recorded speech samples were the same or different. Results Under listening, 1st formant manipulation discrimination was significantly reduced for the PD group compared to the control group. There was a trend toward better discrimination of pitch in the PD group, but the group difference was not significant. Under the production condition, the ability of participants with PD to identify pitch manipulations was greater than that of the controls. Conclusion The findings suggest perceptual processing differences associated with acoustic parameters of fundamental frequency and 1st formant perturbations in PD. These findings extend our previous results, indicating that different patterns of compensation to pitch and 1st formant shifts may reflect a combination of sensory and motor mechanisms that are differentially influenced by basal ganglia dysfunction.

Adaptive and selective production of syllable duration and fundamental frequency as word segmentation cues by French-English bilinguals.

Despite the significant impact of prosody on L2 speakers' intelligibility, few studies have examined the production of prosodic cues associated with word segmentation in non-native or non-dominant languages. Here, 62 French-English bilingual adults, who varied in L1 (French or English) and language dominance, produced sentences built around syllable strings that can be produced either as one bisyllabic word or two monosyllabic words. Each participant produced both English and French utterances, providing both native productions (used as reference) and L2 productions. Acoustic analyses of the mean fundamental frequency (F0) and duration of both syllables of the ambiguous string revealed that speakers' relative language dominance affected the speakers' prosodic cue production over and above L1. Speakers also produced different prosodic patterns in English and French, suggesting that the production of prosodic cues associated with word-segmentation is both adaptive (modified by language experience) and selective (specific to each language).

How Do French-English Bilinguals Pull Verb Particle Constructions Off? Factors Influencing Second Language Processing of Unfamiliar Structures at the Syntax-Semantics Interface.

An important challenge in bilingualism research is to understand the mechanisms underlying sentence processing in a second language and whether they are comparable to those underlying native processing. Here, we focus on verb-particle constructions (VPCs) that are among the most difficult elements to acquire in L2 English. The verb and the particle form a unit, which often has a non-compositional meaning (e.g., look up or chew out), making the combined structure semantically opaque. However, bilinguals with higher levels of English proficiency can develop a good knowledge of the semantic properties of VPCs (Blais and Gonnerman, 2013). A second difficulty is that in a sentence context, the particle can be shifted after the direct object of the verb (e.g., The professor looked it up). The processing is more challenging when the object is long (e.g., The professor looked the student's last name up). This shifted structure favors syntactic processing at the expense of VPC semantic processing. We sought to determine whether or not bilinguals' reading time (RT) patterns would be similar to those observed for native monolinguals (Gonnerman and Hayes, 2005) when reading VPCs in sentential contexts. French-English bilinguals were tested for English language proficiency, working memory and explicit VPC semantic knowledge. During a self-paced reading task, participants read 78 sentences with VPCs that varied according to parameters that influence native speakers' reading dynamics: verb-particle transparency, particle adjacency and length of the object noun phrase (NP; 2, 3, or 5 words). RTs in a critical region that included verbs, NPs and particles were measured. Results revealed that RTs were modulated by participants' English proficiency, with higher proficiency associated with shorter RTs. Examining participants' explicit semantic knowledge of VPCs and working memory, only readers with more native-like knowledge of VPCs and a high working memory presented RT patterns that were similar to those of monolinguals. Therefore, given the necessary lexical and computational resources, bilingual processing of novel structures at the syntax-semantics interface follows the principles influencing native processing. The findings are in keeping with theories that postulate similar representations and processing in L1 and L2 modulated by processing difficulty.

Punctuation and Implicit Prosody in Silent Reading: An ERP Study Investigating English Garden-Path Sentences.

This study presents the first two ERP reading studies of comma-induced effects of covert (implicit) prosody on syntactic parsing decisions in English. The first experiment used a balanced 2 × 2 design in which the presence/absence of commas determined plausibility (e.g., John, said Mary, was the nicest boy at the party vs. John said Mary was the nicest boy at the party). The second reading experiment replicated a previous auditory study investigating the role of overt prosodic boundaries in closure ambiguities (Pauker et al., 2011). In both experiments, commas reliably elicited CPS components and generally played a dominant role in determining parsing decisions in the face of input ambiguity. The combined set of findings provides further evidence supporting the claim that mechanisms subserving speech processing play an active role during silent reading.

The role of the ventro-lateral prefrontal cortex in idiom comprehension: An rTMS study.

Previous research is equivocal with respect to the neural substrates of idiom processing. Particularly elusive is the role of the left ventro-lateral prefrontal cortex (VLPFC), a region implicated in semantic control generally. Although fMRI studies have shown that the left VLPFC is active during idiom processing (see Rapp et al. (2012), for review), rTMS studies have failed to corroborate a clear role of this prefrontal region (e.g., Oliveri et al., 2004). We investigated this issue using a semantic meaningfulness judgment task that compared idiom comprehension following rTMS-stimulation to the left VLPFC relative to a control site (vertex). We also investigated whether individual differences in general cognitive capacity among comprehenders modulated the effects of rTMS. The results indicate that left VLPFC stimulation particularly affected the processing of low-familiar idioms, possibly because these items involve a maximal semantic conflict between a salient literal and less-known figurative meaning. Of note, this pattern only emerged for comprehenders with higher cognitive control capacity, possibly because they were more likely to activate or maintain multiple semantic representations during idiom processing, which required VLPFC integrity. Taken together, the results support the importance of the left VLPFC to idiom processing.

Sensorimotor control of vocal pitch and formant frequencies in Parkinson's disease.

BACKGROUND: Auditory feedback reflects information on multiple speech parameters including fundamental frequency (pitch) and formant properties. Inducing auditory errors in these acoustic parameters during speech production has been used to examine the manner in which auditory feedback is integrated with ongoing speech motor processes. This integration has been shown to be impaired in disorders such as Parkinson's disease (PD), in which individuals exhibit difficulty adjusting to altered sensory-motor relationships. The current investigation examines whether such sensorimotor impairments affect fundamental frequency and formant parameters of speech differentially. METHODS: We employed a sensorimotor compensation paradigm to investigate the mechanisms underlying the control of vocal pitch and formant parameters. Individuals with PD and age-matched controls prolonged a speech vowel in the context of a word while the fundamental or first formant frequency of their auditory feedback was altered unexpectedly on random trials, using two magnitudes of perturbation. RESULTS: Compared with age-matched controls, individuals with PD exhibited a larger compensatory response to fundamental frequency perturbations, in particular in response to the smaller magnitude alteration. In contrast, the group with PD showed reduced compensation to first formant frequency perturbations. CONCLUSIONS: The results demonstrate that the neural processing impairment of PD differentially affects the processing of auditory feedback for the control of fundamental and formant frequency. The heightened modulation of fundamental frequency in response to auditory perturbations may reflect a change in sensory weighting due to somatosensory deficits associated with the larynx, while the reduced ability to modulate vowel formants may result from impaired activation of the oral articulatory musculature.

Please say what this word is-Vowel-extrinsic normalization in the sensorimotor control of speech.

The extent to which the adaptive nature of speech perception influences the acoustic targets underlying speech production is not well understood. For example, listeners can rapidly accommodate to talker-dependent phonetic properties-a process known as vowel-extrinsic normalization-without altering their speech output. Recent evidence, however, shows that reinforcement-based learning in vowel perception alters the processing of speech auditory feedback, impacting sensorimotor control during vowel production. This suggests that more automatic and ubiquitous forms of perceptual plasticity, such as those characterizing perceptual talker normalization, may also impact the sensorimotor control of speech. To test this hypothesis, we set out to examine the possible effects of vowel-extrinsic normalization on experimental subjects' interpretation of their own speech outcomes. By combining a well-known manipulation of vowel-extrinsic normalization with speech auditory-motor adaptation, we show that exposure to different vowel spectral properties subsequently alters auditory feedback processing during speech production, thereby influencing speech motor adaptation. These findings extend the scope of perceptual normalization processes to include auditory feedback and support the idea that naturally occurring adaptations found in speech perception impact speech production. (PsycINFO Database Record

Phonological processing in speech perception: What do sonority differences tell us?

Previous research has associated the inferior frontal and posterior temporal brain regions with a number of phonological processes. In order to identify how these specific brain regions contribute to phonological processing, we manipulated subsyllabic phonological complexity and stimulus modality during speech perception using fMRI. Subjects passively attended to visual or auditory pseudowords. Similar to previous studies, a bilateral network of cortical regions was recruited during the presentation of visual and auditory stimuli. Moreover, pseudowords recruited a similar network of regions as words and letters. Few regions in the whole-brain results revealed neural processing differences associated with phonological complexity independent of modality of presentation. In an ROI analysis, the only region sensitive to phonological complexity was the posterior part of the inferior frontal gyrus (IFGpo), with the complexity effect only present for print. In sum, the sensitivity of phonological brain areas depends on the modality of stimulus presentation and task demands.

Misleading Bias-Driven Expectations in Referential Processing and the Facilitative Role of Contrastive Accent.

Probabilistic preferences are often facilitative in language processing and may assist in discourse prediction. However, occasionally these sources of information may lead to inaccurate expectations. The current study investigated a test case of this scenario. An eye-tracking experiment examined the interpretation of ambiguous personal pronouns in the context of implicit causality biases. We tested whether reference resolution may be facilitated online by contrastive accent in cases of a bias-inconsistent referent. Implicit causality biases directed looks to the biased noun phrase; however, when the name of the bias-inconsistent antecedent was accented (e.g., JOHN envied Bill because he ...), this tendency was modulated. Contrastive accent seems to dampen the occasionally confusing prediction of implicit causality biases in referential processing. This demonstrates one way in which the spoken language comprehension system copes with occasional misguidance of otherwise helpful probabilistic information.