Individual differences in the consistency of neural and behavioural responses to speech sounds.

There are documented individual differences among adults in the consistency of speech sound processing, both at neural and behavioural levels. Some adults show more consistent neural responses to speech sounds than others, as measured by an event-related potential called the frequency-following response (FFR); similarly, some adults show more consistent behavioural responses to native speech sounds than others, as measured by two-alternative forced choice (2AFC) and visual analog scaling (VAS) tasks. Adults also differ in how successfully they can perceive non-native speech sounds. Interestingly, it remains unclear whether these differences are related within individuals. In the current study, native English-speaking adults completed native phonetic perception tasks (2AFC and VAS), a non-native (German) phonetic perception task, and an FFR recording session. From these tasks, we derived measures of the consistency of participants' neural and behavioural responses to native speech as well as their non-native perception ability. We then examined the relationships among individual differences in these measures. Analysis of the behavioural measures revealed that more consistent responses to native sounds predicted more successful perception of unfamiliar German sounds. Analysis of neural and behavioural data did not reveal clear relationships between FFR consistency and our phonetic perception measures. This multimodal work furthers our understanding of individual differences in speech processing among adults, and may eventually lead to individualized approaches for enhancing non-native language acquisition in adulthood.

The child the apple eats: processing of argument structure in Mandarin verb-final sentences.

Mandarin Chinese is typologically unusual among the world's languages in having flexible word order despite a near absence of inflectional morphology. These features of Mandarin challenge conventional linguistic notions such as subject and object and the divide between syntax and semantics. In the present study, we tested monolingual processing of argument structure in Mandarin verb-final sentences, where word order alone is not a reliable cue. We collected participants' responses to a forced agent-assignment task while measuring their electroencephalography data to capture real-time processing throughout each sentence. We found that sentence interpretation was not informed by word order in the absence of other cues, and while the coverbs BA and BEI were strong signals for agent selection, comprehension was a result of multiple cues. These results challenge previous reports of a linear ranking of cue strength. Event-related potentials showed that BA and BEI impacted participants' processing even before the verb was read and that role reversal anomalies elicited an N400 effect without a subsequent semantic P600. This study demonstrates that Mandarin sentence comprehension requires online interaction among cues in a language-specific manner, consistent with models that predict crosslinguistic differences in core sentence processing mechanisms.

Native and non-native parsing of adjective placement - An ERP study of Mandarin and English sentence processing.

Adjectives in English and Mandarin are typically prenominal, but the corresponding grammatical rules vary in subtle ways. Our event-related potential (ERP) study shows that native speakers of both languages rely on similar processing mechanisms when reading sentences with anomalous noun-adjective order (e.g., the vase *white) in their first language, reflected by a biphasic N400-P600 profile. Only Mandarin native speakers showed an additional N400 on grammatical adjectives (e.g., the white vase), potentially due to atypical word-by-word presentation of lexicalized compounds. English native speakers with advanced Mandarin proficiency were tested in both languages. They processed ungrammatical noun-adjective pairs in English like English monolinguals (N400-P600), but only exhibited an N400 in Mandarin. The absent P600 effect corresponded to their (surprisingly) low proficiency with noun-adjective violations in Mandarin, questioning simple rule transfer from English grammar.

Exploring individual differences in native phonetic perception and their link to nonnative phonetic perception.

Adults differ considerably in their perception of both native and nonnative phonemes. For instance, when presented with continua of native phonemes on two-alternative forced choice (2AFC) or visual analog scaling (VAS) tasks, some people show sudden changes in responses (i.e., steep identification slopes) and others show gradual changes (i.e., shallow identification slopes). Moreover, some adults are more successful than others at learning unfamiliar phonemes. The predictors of these individual differences and the relationships between them are poorly understood. It also remains unclear to what extent different tasks (2AFC vs. VAS) may reflect distinct individual differences in perception. In two experiments, we addressed these questions by examining the relationships between individual differences in performance on native and nonnative phonetic perception tasks. We found that shallow 2AFC identification slopes were not related to shallow VAS identification slopes but were related to inconsistent VAS responses. Additionally, our results suggest that consistent native perception may play a role in promoting successful nonnative perception. These findings help characterize the nature of individual differences in phonetic perception and contribute to our understanding of how to measure such differences. This work also has implications for encouraging successful acquisition of new languages in adulthood. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Phrase parsing in a second language as indexed by the closure positive shift: The impact of language experience and acoustic cue salience.

Despite the importance of prosodic processing in utterance parsing, a majority of studies investigating boundary localization in a second language focus on word segmentation. The goal of the present study was to investigate the parsing of phrase boundaries in first and second languages from different prosodic typologies (stress-timed vs. syllable-timed). Fifty English-French bilingual adults who varied in native language (French or English) and second language proficiency listened to English and French utterances with different prosodic structures while event-related brain potentials were recorded. The utterances were built around target words presented either in phrase-final position (bearing phrase-final lengthening) or in penultimate position. Each participant listened to both English and French stimuli, providing data in their native language (used as reference) and their second language. Target words in phrase-final position elicited closure positive shifts across listeners in both languages, regardless of the language-specific acoustic cues associated with phrase-final lengthening (shorter phrase-final lengthening in English compared to French). Interestingly, directional effects were observed, where learning to parse English as a second language in a native-like manner seemed to require a higher proficiency level than learning to parse French as a second language. This pattern of results supports the idea that L2 listeners need to learn to recognize L2-specific phrase-final lengthening regardless of the apparent similarity across languages and that some language combinations might present greater challenges than others.

Interhemispheric functional brain connectivity predicts new language learning success in adults.

Investigating interhemispheric interactions between homologous cortical regions during language processing is of interest. Despite prevalent left hemisphere lateralization of language, the right hemisphere also plays an important role and interhemispheric connectivity is influenced by language experience and is implicated in second language (L2) acquisition. Regions involved in language processing have differential connectivity to other cortical regions and to each other, and play specific roles in language. We examined the interhemispheric interactions of subregions of the inferior frontal gyrus (areas 44 and 45), the adjacent area 9/46v in the middle frontal gyrus, the superior temporal gyrus (STG), and the posterior inferior parietal lobule (pIPL) in relation to distinct and specific aspects of L2 learning success. The results indicated that the connectivity between left and right areas 44 and 9/46v predicted improvement in sentence repetition, connectivity between left and right area 45 and mid-STG predicted improvement in auditory comprehension, and connectivity between left and right pIPL predicted improvement in reading speed. We show interhemispheric interactions in the specific context of facilitating performance in adult L2 acquisition that follow an anterior to posterior gradient in the brain, and are consistent with the respective roles of these regions in language processing.

Age of Acquisition Modulates Alpha Power During Bilingual Speech Comprehension in Noise.

Research on bilingualism has grown exponentially in recent years. However, the comprehension of speech in noise, given the ubiquity of both bilingualism and noisy environments, has seen only limited focus. Electroencephalogram (EEG) studies in monolinguals show an increase in alpha power when listening to speech in noise, which, in the theoretical context where alpha power indexes attentional control, is thought to reflect an increase in attentional demands. In the current study, English/French bilinguals with similar second language (L2) proficiency and who varied in terms of age of L2 acquisition (AoA) from 0 (simultaneous bilinguals) to 15 years completed a speech perception in noise task. Participants were required to identify the final word of high and low semantically constrained auditory sentences such as "Stir your coffee with a spoon" vs. "Bob could have known about the spoon" in both of their languages and in both noise (multi-talker babble) and quiet during electrophysiological recording. We examined the effects of language, AoA, semantic constraint, and listening condition on participants' induced alpha power during speech comprehension. Our results show an increase in alpha power when participants were listening in their L2, suggesting that listening in an L2 requires additional attentional control compared to the first language, particularly early in processing during word identification. Additionally, despite similar proficiency across participants, our results suggest that under difficult processing demands, AoA modulates the amount of attention required to process the second language.

Early auditory responses to speech sounds in Parkinson's disease: preliminary data.

Parkinson's disease (PD), as a manifestation of basal ganglia dysfunction, is associated with a number of speech deficits, including reduced voice modulation and vocal output. Interestingly, previous work has shown that participants with PD show an increased feedback-driven motor response to unexpected fundamental frequency perturbations during speech production, and a heightened ability to detect differences in vocal pitch relative to control participants. Here, we explored one possible contributor to these enhanced responses. We recorded the frequency-following auditory brainstem response (FFR) to repetitions of the speech syllable [da] in PD and control participants. Participants with PD displayed a larger amplitude FFR related to the fundamental frequency of speech stimuli relative to the control group. The current preliminary results suggest the dysfunction of the basal ganglia in PD contributes to the early stage of auditory processing and may reflect one component of a broader sensorimotor processing impairment associated with the disease.

Frontoparietal Anatomical Connectivity Predicts Second Language Learning Success.

There is considerable individual variability in second language (L2) learning abilities in adulthood. The inferior parietal lobule, important in L2 learning success, is anatomically connected to language areas in the frontal lobe via the superior longitudinal fasciculus (SLF). The second and third branches of the SLF (SLF II and III) have not been examined separately in the context of language, yet they are known to have dissociable frontoparietal connections. Studying these pathways and their functional contributions to L2 learning is thus of great interest. Using diffusion MRI tractography, we investigated individuals undergoing language training to explore brain structural predictors of L2 learning success. We dissected SLF II and III using gold-standard anatomical definitions and related prelearning white matter integrity to language improvements corresponding with hypothesized tract functions. SLF II properties predicted improvement in lexical retrieval, while SLF III properties predicted improvement in articulation rate. Finer grained separation of these pathways enables better understanding of their distinct roles in language, which is essential for studying how anatomical connectivity relates to L2 learning abilities.

Bilingual language experience and the neural underpinnings of working memory.

A longstanding question in cognitive neuroscience and in the bilingualism literature is how early language experience influences brain development and cognitive outcomes, and whether these effects are global or specific to language-related processes. The current investigation examined the effect of the timing of language learning on the performance and neural correlates of phonological and non-verbal working memory, subcomponents of executive function. Three groups of bilinguals, who varied in terms of the timing of second language learning (i.e., simultaneous bilinguals learned their two languages from birth; early and late bilinguals who learned their second language before or after 5 years of age, respectively), performed phonological and non-verbal working memory tasks in the magnetic resonance imaging scanner. Results showed that there were no group differences in performance on either of the tasks, or in the neural correlates of performance of the non-verbal task. However, critically, we showed that despite similar behavioural performance, the groups differed in the patterns of neural recruitment during performance of the phonological working memory task. The pattern of group differences was non-linear, demonstrating similar neural recruitment for simultaneous and late bilinguals that differed from early bilinguals. Findings from the current study suggest a dynamic mapping between the brain and cognition, contributing to our current understanding of the effect of the timing of language learning on cognitive processes and demonstrating a specific effect on language-related executive function.

Spoken Word Segmentation in First and Second Language: When ERP and Behavioral Measures Diverge.

Previous studies of word segmentation in a second language have yielded equivocal results. This is not surprising given the differences in the bilingual experience and proficiency of the participants and the varied experimental designs that have been used. The present study tried to account for a number of relevant variables to determine if bilingual listeners are able to use native-like word segmentation strategies. Here, 61 French-English bilingual adults who varied in L1 (French or English) and language dominance took part in an audiovisual integration task while event-related brain potentials (ERPs) were recorded. Participants listened to sentences built around ambiguous syllable strings (which could be disambiguated based on different word segmentation patterns), during which an illustration was presented on screen. Participants were asked to determine if the illustration was related to the heard utterance or not. Each participant listened to both English and French utterances, providing segmentation patterns that included both their native language (used as reference) and their L2. Interestingly, different patterns of results were observed in the event-related potentials (online) and behavioral (offline) results, suggesting that L2 participants showed signs of being able to adapt their segmentation strategies to the specifics of the L2 (online ERP results), but that the extent of the adaptation varied as a function of listeners' language experience (offline behavioral results).

Visual feedback of the tongue influences speech adaptation to a physical modification of the oral cavity.

Studies examining sensorimotor adaptation of speech to changing sensory conditions have demonstrated a central role for both auditory and somatosensory feedback in speech motor learning. The potential influence of visual feedback of oral articulators, which is not typically available during speech production but may nonetheless enhance oral motor control, remains poorly understood. The present study explores the influence of ultrasound visual feedback of the tongue on adaptation of speech production (focusing on the sound /s/) to a physical perturbation of the oral articulators (prosthesis altering the shape of the hard palate). Two visual feedback groups were tested that differed in the two-dimensional plane being imaged (coronal or sagittal) during practice producing /s/ words, along with a no-visual-feedback control group. Participants in the coronal condition were found to adapt their speech production across a broader range of acoustic spectral moments and syllable contexts than the no-feedback controls. In contrast, the sagittal group showed reduced adaptation compared to no-feedback controls. The results indicate that real-time visual feedback of the tongue is spontaneously integrated during speech motor adaptation, with effects that can enhance or interfere with oral motor learning depending on compatibility of the visual articulatory information with requirements of the speaking task.

Individuals With Mild Cognitive Impairment and Alzheimer's Disease Benefit From Audiovisual Speech Cues and Supportive Sentence Context.

Purpose Speech perception in noise becomes difficult with age but can be facilitated by audiovisual (AV) speech cues and sentence context in healthy older adults. However, individuals with Alzheimer's disease (AD) may present with deficits in AV integration, potentially limiting the extent to which they can benefit from AV cues. This study investigated the benefit of these cues in individuals with mild cognitive impairment (MCI), individuals with AD, and healthy older adult controls. Method This study compared auditory-only and AV speech perception of sentences presented in noise. These sentences had one of two levels of context: high (e.g., "Stir your coffee with a spoon") and low (e.g., "Bob didn't think about the spoon"). Fourteen older controls (M age = 72.71 years, SD = 9.39), 13 individuals with MCI (M age = 79.92 years, SD = 5.52), and nine individuals with probable Alzheimer's-type dementia (M age = 79.38 years, SD = 3.40) completed the speech perception task and were asked to repeat the terminal word of each sentence. Results All three groups benefited (i.e., identified more terminal words) from AV and sentence context. Individuals with MCI showed a smaller AV benefit compared to controls in low-context conditions, suggesting difficulties with AV integration. Individuals with AD showed a smaller benefit in high-context conditions compared to controls, indicating difficulties with AV integration and context use in AD. Conclusions Individuals with MCI and individuals with AD do benefit from AV speech and semantic context during speech perception in noise (albeit to a lower extent than healthy older adults). This suggests that engaging in face-to-face communication and providing ample context will likely foster more effective communication between patients and caregivers, professionals, and loved ones.

Near native-like stress pattern perception in English-French bilinguals as indexed by the mismatch negativity.

We examined lexical stress processing in English-French bilinguals. Auditory mismatch negativity (MMN) responses were recorded in response to English and French pseudowords, whose primary stress occurred either on a language-consistent "usual" or language-inconsistent "unusual" syllable. In most conditions, the pseudowords elicited two consecutive MMNs, and somewhat surprisingly, these MMNs were not systematically modulated by bilingual experience. This suggests that it is possible to achieve native-like pre-attentive processing of lexical stress, even in a language that one has not learned since birth.

Earlier age of second language learning induces more robust speech encoding in the auditory brainstem in adults, independent of amount of language exposure during early childhood.

Learning a second language (L2) at a young age is a driving factor of functional neuroplasticity in the auditory brainstem. To date, it remains unclear whether these effects remain stable until adulthood and to what degree the amount of exposure to the L2 in early childhood might affect their outcome. We compared three groups of adult English-French bilinguals in their ability to categorize English vowels in relation to their frequency following responses (FFR) evoked by the same vowels. At the time of testing, cognitive abilities as well as fluency in both languages were matched between the (1) simultaneous bilinguals (SIM, N = 18); (2) sequential bilinguals with L1-English (N = 14); and (3) sequential bilinguals with L1-French (N = 11). Our results show that the L1-English group show sharper category boundaries in identification of the vowels compared to the L1-French group. Furthermore, the same pattern was reflected in the FFRs (i.e., larger FFR responses in L1-English > SIM > L1-French), while again only the difference between the L1-English and the L1-French group was statistically significant; nonetheless, there was a trend towards larger FFR in SIM compared to L1-French. Our data extends previous literature showing that exposure to a language during the first years of life induces functional neuroplasticity in the auditory brainstem that remains stable until at least young adulthood. Furthermore, the findings suggest that amount of exposure (i.e., 100% vs. 50%) to that language does not differentially shape the robustness of the perceptual abilities or the auditory brainstem encoding of phonetic categories of the language. Statement of significance: Previous studies have indicated that early age of L2 acquisition induces functional neuroplasticity in the auditory brainstem during processing of the L2. This study compared three groups of adult bilinguals who differed in their age of L2 acquisition as well as the amount of exposure to the L2 during early childhood. We demonstrate for the first time that the neuroplastic effect in the brainstem remains stable until young adulthood and that the amount of L2 exposure does not influence behavioral or brainstem plasticity. Our study provides novel insights into low-level auditory plasticity as a function of varying bilingual experience.

Sensorimotor adaptation across the speech production workspace in response to a palatal perturbation.

Talkers have been shown to adapt the production of multiple vowel sounds simultaneously in response to altered auditory feedback. The present study extends this work by exploring the adaptation of speech production to a physical alteration of the vocal tract involving a palatal prosthesis that impacts both somatosensory and auditory feedback during the production of a range of consonants and vowels. Acoustic and kinematic measures of the tongue were used to examine the impact of the physical perturbation across the various speech sounds, and to assess learned changes following 20 min of speech practice involving the production of complex, variable sentences. As in prior studies, acoustic analyses showed perturbation and adaptation effects primarily for sounds directly involving interaction with the palate. Analyses of tongue kinematics, however, revealed systematic, robust effects of the perturbation and subsequent motor learning across the full range of speech sounds. The results indicate that speakers are able to reconfigure oral motor patterns during the production of multiple speech sounds spanning the articulatory workspace following a physical alteration of the vocal tract.

The Relationship Between Speech Perceptual Discrimination and Speech Production in Parkinson's Disease.

Purpose We recently demonstrated that individuals with Parkinson's disease (PD) respond differentially to specific altered auditory feedback parameters during speech production. Participants with PD respond more robustly to pitch and less robustly to formant manipulations compared to control participants. In this study, we investigated whether differences in perceptual processing may in part underlie these compensatory differences in speech production. Methods Pitch and formant feedback manipulations were presented under 2 conditions: production and listening. In the production condition, 15 participants with PD and 15 age- and gender-matched healthy control participants judged whether their own speech output was manipulated in real time. During the listening task, participants judged whether paired tokens of their previously recorded speech samples were the same or different. Results Under listening, 1st formant manipulation discrimination was significantly reduced for the PD group compared to the control group. There was a trend toward better discrimination of pitch in the PD group, but the group difference was not significant. Under the production condition, the ability of participants with PD to identify pitch manipulations was greater than that of the controls. Conclusion The findings suggest perceptual processing differences associated with acoustic parameters of fundamental frequency and 1st formant perturbations in PD. These findings extend our previous results, indicating that different patterns of compensation to pitch and 1st formant shifts may reflect a combination of sensory and motor mechanisms that are differentially influenced by basal ganglia dysfunction.

Language learning experience and mastering the challenges of perceiving speech in noise.

Given the ubiquity of noisy environments and increasing globalization, the necessity to perceive speech in noise in a non-native language is common and necessary for successful communication. In the current investigation, bilingual individuals who learned their non-native language at different ages underwent magnetic resonance imaging while listening to sentences in both of their languages, in quiet and in noise. Sentence context was varied such that the final word could be of high or low predictability. Results show that early non-native language learning is associated with superior ability to benefit from contextual information behaviourally, and a pattern of neural recruitment in the left inferior frontal gyrus that suggests easier processing when perceiving non-native speech in noise. These findings have implications for our understanding of speech processing in non-optimal listening conditions and shed light on how individuals navigate every day complex communicative environments, in a native and non-native language.

Different Responses to Altered Auditory Feedback in Younger and Older Adults Reflect Differences in Lexical Bias.

Purpose Previous work has found that both young and older adults exhibit a lexical bias in categorizing speech stimuli. In young adults, this has been argued to be an automatic influence of the lexicon on perceptual category boundaries. Older adults exhibit more top-down biases than younger adults, including an increased lexical bias. We investigated the nature of the increased lexical bias using a sensorimotor adaptation task designed to evaluate whether automatic processes drive this bias in older adults. Method A group of older adults ( n = 27) and younger adults ( n = 35) participated in an altered auditory feedback production task. Participants produced target words and nonwords under altered feedback that affected the 1st formant of the vowel. There were 2 feedback conditions that affected the lexical status of the target, such that target words were shifted to sound more like nonwords (e.g., less-liss) and target nonwords to sound more like words (e.g., kess-kiss). Results A mixed-effects linear regression was used to investigate the magnitude of compensation to altered auditory feedback between age groups and lexical conditions. Over the course of the experiment, older adults compensated (by shifting their production of 1st formant) more to altered auditory feedback when producing words that were shifted toward nonwords ( less-liss) than when producing nonwords that were shifted toward words ( kess-kiss). This is in contrast to younger adults who compensated more to nonwords that were shifted toward words compared to words that were shifted toward nonwords. Conclusion We found no evidence that the increased lexical bias previously observed in older adults is driven by a greater sensitivity to top-down lexical influence on perceptual category boundaries. We suggest the increased lexical bias in older adults is driven by postperceptual processes that arise as a result of age-related cognitive and sensory changes.

Adaptive and selective production of syllable duration and fundamental frequency as word segmentation cues by French-English bilinguals.

Despite the significant impact of prosody on L2 speakers' intelligibility, few studies have examined the production of prosodic cues associated with word segmentation in non-native or non-dominant languages. Here, 62 French-English bilingual adults, who varied in L1 (French or English) and language dominance, produced sentences built around syllable strings that can be produced either as one bisyllabic word or two monosyllabic words. Each participant produced both English and French utterances, providing both native productions (used as reference) and L2 productions. Acoustic analyses of the mean fundamental frequency (F0) and duration of both syllables of the ambiguous string revealed that speakers' relative language dominance affected the speakers' prosodic cue production over and above L1. Speakers also produced different prosodic patterns in English and French, suggesting that the production of prosodic cues associated with word-segmentation is both adaptive (modified by language experience) and selective (specific to each language).