The effect of native language and bilingualism on multimodal perception in speech: A study of audio-aerotactile integrationa).

Previous studies of speech perception revealed that tactile sensation can be integrated into the perception of stop consonants. It remains uncertain whether such multisensory integration can be shaped by linguistic experience, such as the listener's native language(s). This study investigates audio-aerotactile integration in phoneme perception for English and French monolinguals as well as English-French bilingual listeners. Six step voice onset time continua of alveolar (/da/-/ta/) and labial (/ba/-/pa/) stops constructed from both English and French end points were presented to listeners who performed a forced-choice identification task. Air puffs were synchronized to syllable onset and randomly applied to the back of the hand. Results show that stimuli with an air puff elicited more "voiceless" responses for the /da/-/ta/ continuum by both English and French listeners. This suggests that audio-aerotactile integration can occur even though the French listeners did not have an aspiration/non-aspiration contrast in their native language. Furthermore, bilingual speakers showed larger air puff effects compared to monolinguals in both languages, perhaps due to bilinguals' heightened receptiveness to multimodal information in speech.

Sensitivity and specificity of an acoustic- and perceptual-based tool for assessing motor speech disorders in French: the MonPaGe-screening protocol.

To respond to the need of objective screening tools for motor speech disorders (MSD), we present the screening version of a speech assessment protocol (MonPaGe-2.0.s), which is based on semi-automated acoustic and perceptual measures on several speech dimensions in French. We validate the screening tool by testing its sensitivity and specificity and comparing its outcome with external standard assessment tools. The data from 80 patients diagnosed with different types of mild to moderate MSD and 62 healthy test controls were assessed against the normative data obtained on 404 neurotypical speakers, with Deviance Scores computed on seven speech dimensions (voice, speech rate, articulation, prosody, pneumophonatory control, diadochokinetic rate, intelligibility) based on acoustic and perceptual measures. A cut-off of the MonPaGe total deviance score (TotDevS) >2 allowed MSD to be diagnosed with specificity of 95% and an overall sensitivity of 83.8% on all patients pulled, reaching 91% when very mildly impaired patients were excluded. A strong correlation was found between the MonPaGe TotDevS and an external composite perceptual score of MSD provided by six experts. The MonPaGe screening protocol has proven its sensitivity and specificity for diagnosing presence and severity of MSD. Further implementations are needed to complement the characterization of impaired dimensions in order to distinguish subtypes of MSD.

Sensorimotor adaptation across the speech production workspace in response to a palatal perturbation.

Talkers have been shown to adapt the production of multiple vowel sounds simultaneously in response to altered auditory feedback. The present study extends this work by exploring the adaptation of speech production to a physical alteration of the vocal tract involving a palatal prosthesis that impacts both somatosensory and auditory feedback during the production of a range of consonants and vowels. Acoustic and kinematic measures of the tongue were used to examine the impact of the physical perturbation across the various speech sounds, and to assess learned changes following 20 min of speech practice involving the production of complex, variable sentences. As in prior studies, acoustic analyses showed perturbation and adaptation effects primarily for sounds directly involving interaction with the palate. Analyses of tongue kinematics, however, revealed systematic, robust effects of the perturbation and subsequent motor learning across the full range of speech sounds. The results indicate that speakers are able to reconfigure oral motor patterns during the production of multiple speech sounds spanning the articulatory workspace following a physical alteration of the vocal tract.

Impact of visual and auditory deprivation on speech perception and production in adults.

Speech perception relies on auditory and visual cues and there are strong links between speech perception and production. We aimed to evaluate the role of auditory and visual modalities on speech perception and production in adults with impaired hearing or sight versus those with normal hearing and sight. We examined speech perception and production of three isolated vowels (/i/, /y/, /u/), which were selected based on their different auditory and visual perceptual saliencies, in 12 deaf adults who used one or two cochlear implants (CIs), 14 congenitally blind adults, and 16 adults with normal sight and hearing. The results showed that the deaf adults who used a CI had worse vowel identification and discrimination perception and they also produced vowels that were less typical or precise than other participants. They had different tongue positions in speech production, which possibly partly explains the poorer quality of their spoken vowels. Blind individuals had larger lip openings and smaller lip protrusions for the rounded vowel and unrounded vowels, compared to the other participants, but they still produced vowels that were similar to those produced by the adults with normal sight and hearing. In summary, the deaf adults, even though they used CIs, had greater difficulty in producing accurate vowel targets than the blind adults, whereas the blind adults were still able to produce accurate vowel targets, even though they used different articulatory strategies.

Relevance of Assembly-Activating Protein for Adeno-associated Virus Vector Production and Capsid Protein Stability in Mammalian and Insect Cells.

The discovery that adeno-associated virus 2 (AAV2) encodes an eighth protein, called assembly-activating protein (AAP), transformed our understanding of wild-type AAV biology. Concurrently, it raised questions about the role of AAP during production of recombinant vectors based on natural or molecularly engineered AAV capsids. Here, we show that AAP is indeed essential for generation of functional recombinant AAV2 vectors in both mammalian and insect cell-based vector production systems. Surprisingly, we observed that AAV2 capsid proteins VP1 to -3 are unstable in the absence of AAP2, likely due to rapid proteasomal degradation. Inhibition of the proteasome led to an increase of intracellular VP1 to -3 but neither triggered assembly of functional capsids nor promoted nuclear localization of the capsid proteins. Together, this underscores the crucial and unique role of AAP in the AAV life cycle, where it rapidly chaperones capsid assembly, thus preventing degradation of free capsid proteins. An expanded analysis comprising nine alternative AAV serotypes (1, 3 to 9, and rh10) showed that vector production always depends on the presence of AAP, with the exceptions of AAV4 and AAV5, which exhibited AAP-independent, albeit low-level, particle assembly. Interestingly, AAPs from all 10 serotypes could cross-complement AAP-depleted helper plasmids during vector production, despite there being distinct intracellular AAP localization patterns. These were most pronounced for AAP4 and AAP5, congruent with their inability to rescue an AAV2/AAP2 knockout. We conclude that AAP is key for assembly of genuine capsids from at least 10 different AAV serotypes, which has implications for vectors derived from wild-type or synthetic AAV capsids.IMPORTANCE Assembly of adeno-associated virus 2 (AAV2) is regulated by the assembly-activating protein (AAP), whose open reading frame overlaps with that of the viral capsid proteins. As the majority of evidence was obtained using virus-like particles composed solely of the major capsid protein VP3, AAP's role in and relevance for assembly of genuine AAV capsids have remained largely unclear. Thus, we established a trans-complementation assay permitting assessment of AAP functionality during production of recombinant vectors based on complete AAV capsids and derived from any serotype. We find that AAP is indeed a critical factor not only for AAV2, but also for generation of vectors derived from nine other AAV serotypes. Moreover, we identify a new role of AAP in maintaining capsid protein stability in mammalian and insect cells. Thereby, our study expands our current understanding of AAV/AAP biology, and it concomitantly provides insights into the importance of AAP for AAV vector production.

Hyper-articulation in Lombard speech: An active communicative strategy to enhance visible speech cues?

This study investigates the hypothesis that speakers make active use of the visual modality in production to improve their speech intelligibility in noisy conditions. Six native speakers of Canadian French produced speech in quiet conditions and in 85 dB of babble noise, in three situations: interacting face-to-face with the experimenter (AV), using the auditory modality only (AO), or reading aloud (NI, no interaction). The audio signal was recorded with the three-dimensional movements of their lips and tongue, using electromagnetic articulography. All the speakers reacted similarly to the presence vs absence of communicative interaction, showing significant speech modifications with noise exposure in both interactive and non-interactive conditions, not only for parameters directly related to voice intensity or for lip movements (very visible) but also for tongue movements (less visible); greater adaptation was observed in interactive conditions, though. However, speakers reacted differently to the availability or unavailability of visual information: only four speakers enhanced their visible articulatory movements more in the AV condition. These results support the idea that the Lombard effect is at least partly a listener-oriented adaptation. However, to clarify their speech in noisy conditions, only some speakers appear to make active use of the visual modality.

Directional asymmetries reveal a universal bias in adult vowel perception.

Research on cross-language vowel perception in both infants and adults has shown that for many vowel contrasts, discrimination is easier when the same pair of vowels is presented in one direction compared to the reverse direction. According to one account, these directional asymmetries reflect a universal bias favoring "focal" vowels (i.e., vowels whose adjacent formants are close in frequency, which concentrates acoustic energy into a narrower spectral region). An alternative, but not mutually exclusive, account is that such effects reflect an experience-dependent bias favoring prototypical instances of native-language vowel categories. To disentangle the effects of focalization and prototypicality, the authors first identified a certain location in phonetic space where vowels were consistently categorized as /u/ by both Canadian-English and Canadian-French listeners, but that nevertheless varied in their stimulus goodness (i.e., the best Canadian-French /u/ exemplars were more focal compared to the best Canadian-English /u/ exemplars). In subsequent AX discrimination tests, both Canadian-English and Canadian-French listeners performed better at discriminating changes from less to more focal /u/'s compared to the reverse, regardless of variation in prototypicality. These findings demonstrate a universal bias favoring vowels with greater formant convergence that operates independently of biases related to language-specific prototype categorization.

When infants talk, infants listen: pre-babbling infants prefer listening to speech with infant vocal properties.

To learn to produce speech, infants must effectively monitor and assess their own speech output. Yet very little is known about how infants perceive speech produced by an infant, which has higher voice pitch and formant frequencies compared to adult or child speech. Here, we tested whether pre-babbling infants (at 4-6 months) prefer listening to vowel sounds with infant vocal properties over vowel sounds with adult vocal properties. A listening preference favoring infant vowels may derive from their higher voice pitch, which has been shown to attract infant attention in infant-directed speech (IDS). In addition, infants' nascent articulatory abilities may induce a bias favoring infant speech given that 4- to 6-month-olds are beginning to produce vowel sounds. We created infant and adult /i/ ('ee') vowels using a production-based synthesizer that simulates the act of speaking in talkers at different ages and then tested infants across four experiments using a sequential preferential listening task. The findings provide the first evidence that infants preferentially attend to vowel sounds with infant voice pitch and/or formants over vowel sounds with no infant-like vocal properties, supporting the view that infants' production abilities influence how they process infant speech. The findings with respect to voice pitch also reveal parallels between IDS and infant speech, raising new questions about the role of this speech register in infant development. Research exploring the underpinnings and impact of this perceptual bias can expand our understanding of infant language development.

Compensation for a lip-tube perturbation in 4-year-olds: Articulatory, acoustic, and perceptual data analyzed in comparison with adults.

The nature of the speech goal in children was investigated in a study of compensation strategies for a lip-tube perturbation. Acoustic, articulatory, and perceptual analyses of the vowels /y/ and /u/ produced by ten 4-year-old French speakers and ten adult French speakers were conducted under two conditions: normal and with a large tube inserted between the lips. Ultrasound and acoustic recordings of isolated vowels were made in the normal condition before any perturbation, for each of the trials in the perturbed condition, and in the normal condition after the perturbed trials. Data revealed that adult participants moved their tongues in the perturbed condition more than children did. The perturbation was generally at least partly compensated for during the perturbed trials in adults, but children did not show a typical learning effect. In particular, unsystematic improvements were observed during the sequence of perturbed trials, and after-effects were not clear in the articulatory domain. This suggests that children may establish associative links between multisensory phonemic representations and articulatory maneuvers, but those links may mainly rely on trial-to-trial, error-based feedback correction mechanisms rather than on the internal model of the speech production apparatus, as they are in adults.

Maintaining Distinctiveness at Increased Speaking Rates: A Comparison between Congenitally Blind and Sighted Speakers.

OBJECTIVES: The effects of increased speaking rates on vowels have been well documented in sighted adults. It has been reported that in fast speech, vowels are less widely spaced acoustically than in their citation form. Vowel space compression has also been reported in congenitally blind speakers. The objective of the study was to investigate the interaction of vision and speaking rate in adult speakers. PATIENTS AND METHODS: Contrast distances between vowels were examined in conversational and fast speech produced by 10 congenitally blind and 10 sighted French-Canadian adults. Acoustic analyses were carried out. RESULTS: Compared with the sighted speakers, in the fast speaking condition, the blind speakers produced more vowels with contrast along the height, place of articulation, and rounding features located within the auditory target regions typical of French vowels. CONCLUSION: Blind speakers relied more heavily than sighted speakers on auditory properties of vowels to maintain perceptual distinctiveness.

Effects of blindness on production-perception relationships: Compensation strategies for a lip-tube perturbation of the French [u].

The impact of congenital visual deprivation on speech production in adults was examined in an ultrasound study of compensation strategies for lip-tube perturbation. Acoustic and articulatory analyses of the rounded vowel /u/ produced by 12 congenitally blind adult French speakers and 11 sighted adult French speakers were conducted under two conditions: normal and perturbed (with a 25-mm diameter tube inserted between the lips). Vowels were produced with auditory feedback and without auditory feedback (masked noise) to evaluate the extent to which both groups relied on this type of feedback to control speech movements. The acoustic analyses revealed that all participants mainly altered F2 and F0 and, to a lesser extent, F1 in the perturbed condition - only when auditory feedback was available. There were group differences in the articulatory strategies recruited to compensate; while all speakers moved their tongues more backward in the perturbed condition, blind speakers modified tongue-shape parameters to a greater extent than sighted speakers.

Effects of Congenital Visual Deprivation on the Auditory Perception of Anticipatory Labial Coarticulation.

OBJECTIVE: It has been shown previously that congenitally blind francophone adults had higher auditory discrimination scores than sighted adults. It is unclear, however, if, compared to their sighted peers, blind speakers display an increased ability to detect anticipatory acoustic cues. In this paper, this ability is investigated in both speaker groups. METHODS: Using the gating paradigm, /izi/ and /izy/ sequences were truncated to include a variable duration of the vowel. The sequences were used as stimuli in an auditory identification test. Seventeen congenitally blind adults (9 females and 8 males) and 17 sighted controls were recruited. Their task was to identify the second vowel of the sequence. RESULTS: Results show that all participants could reliably identify the rounded vowel prior to its acoustic onset, but steeper identification slopes were found for sighted listeners than for blind listeners. CONCLUSION: The difference in identification slopes likely suggests that sighted speakers display finer abilities to perceptually follow the decreasing values of the frication noise, compared to blind speakers.

Exploring consequences of short- and long-term deafness on speech production: a lip-tube perturbation study.

Studies have reported strong links between speech production and perception. We aimed to evaluate the role of long- and short-term auditory feedback alteration on speech production. Eleven adults with normal hearing (controls) and 17 cochlear implant (CI) users (7 pre-lingually deaf and 10 post-lingually deaf adults) were recruited. Short-term auditory feedback deprivation was induced by turning off the CI or by providing masking noise. Acoustic and articulatory measures were obtained during the production of /u/, with and without a tube inserted between the lips (perturbation), and with and without auditory feedback. F1 values were significantly different between the implant OFF and ON conditions for the pre-lingually deaf participants. In the absence of auditory feedback, the pre-lingually deaf participants moved the tongue more forward. Thus, a lack of normal auditory experience of speech may affect the internal representation of a vowel.

Who's talking now? Infants' perception of vowels with infant vocal properties.

Little is known about infants' abilities to perceive and categorize their own speech sounds or vocalizations produced by other infants. In the present study, prebabbling infants were habituated to /i/ ("ee") or /a/ ("ah") vowels synthesized to simulate men, women, and children, and then were presented with new instances of the habituation vowel and a contrasting vowel on different trials, with all vowels simulating infant talkers. Infants showed greater recovery of interest to the contrasting vowel than to the habituation vowel, which demonstrates recognition of the habituation-vowel category when it was produced by an infant. A second experiment showed that encoding the vowel category and detecting the novel vowel required additional processing when infant vowels were included in the habituation set. Despite these added cognitive demands, infants demonstrated the ability to track vowel categories in a multitalker array that included infant talkers. These findings raise the possibility that young infants can categorize their own vocalizations, which has important implications for early vocal learning.

Mitigating stuttering self-stigma: How do we start and where do we go? Using a Participative Concept Mapping Approach to develop a local framework of principles.

PURPOSE: This study aims to create a stigma reduction framework for stuttering in the local context of Québec, Canada using the Participative Concept Mapping Approach (PCMA), focusing on both self and societal stigma. METHOD: Employing a mixed-methods approach, this study engaged 17 experts-people who stutter, clinicians and health innovation specialists-in PCMA workshops. Via diverse steps, including generation, sorting and rating of ideas in response to the focus prompt, "To effectively address stuttering (self-)stigma, an intervention should…" these sessions led to a framework depicted in visual maps, then refined into actionable principles through qualitative analysis. Mixed-methods data analysis used the open-source R-CMap software to generate visual maps illustrating the relationships among ideas as well as importance and feasibility ratings. RESULTS: The collaborative workshops identified 95 ideas in response to the focus prompt, reunited in 7 clusters, evolving into 16 principles to mitigate stuttering stigma and self-stigma. At the therapy level, these principles emphasize personalized therapy, thorough assessments, stigma-free therapeutic environment, empowerment, and the importance of group inclusivity and educating the relational circles. Societally, they advocate for initiatives such as improved educational outreach, empathy enhancement, and better representation. This dual approach targets individual experiences and societal views on stuttering, stressing the need for an all-encompassing intervention framework. CONCLUSION: The findings demonstrate PCMA's usefulness in crafting local, culturally sensitive, tailored interventions for stigma reduction. The study emphasizes the necessity of holistic approaches that address individual experiences and societal perceptions, offering a model to conduct similar exercises in diverse local settings.

Exposure to Canadian French Cued Speech Improves Consonant Articulation in Children With Cochlear Implants: Acoustic and Articulatory Data.

PURPOSE: One of the strategies that can be used to support speech communication in deaf children is cued speech, a visual code in which manual gestures are used as additional phonological information to supplement the acoustic and labial speech information. Cued speech has been shown to improve speech perception and phonological skills. This exploratory study aims to assess whether and how cued speech reading proficiency may also have a beneficial effect on the acoustic and articulatory correlates of consonant production in children. METHOD: Eight children with cochlear implants (from 5 to 11 years of age) and with different receptive proficiency in Canadian French Cued Speech (three children with low receptive proficiency vs. five children with high receptive proficiency) are compared to 10 children with typical hearing (from 4 to 11 years of age) on their production of stop and fricative consonants. Articulation was assessed with ultrasound measurements. RESULTS: The preliminary results reveal that cued speech proficiency seems to sustain the development of speech production in children with cochlear implants and to improve their articulatory gestures, particularly for the place contrast in stops as well as fricatives. CONCLUSION: This work highlights the importance of studying objective data and comparing acoustic and articulatory measurements to better characterize speech production in children.

Silent articulation modulates auditory and audiovisual speech perception.

The concept of an internal forward model that internally simulates the sensory consequences of an action is a central idea in speech motor control. Consistent with this hypothesis, silent articulation has been shown to modulate activity of the auditory cortex and to improve the auditory identification of concordant speech sounds, when embedded in white noise. In the present study, we replicated and extended this behavioral finding by showing that silently articulating a syllable in synchrony with the presentation of a concordant auditory and/or visually ambiguous speech stimulus improves its identification. Our results further demonstrate that, even in the case of perfect perceptual identification, concurrent mouthing of a syllable speeds up the perceptual processing of a concordant speech stimulus. These results reflect multisensory-motor interactions during speech perception and provide new behavioral arguments for internally generated sensory predictions during silent speech production.

The development of motor synergies in children: ultrasound and acoustic measurements.

The present study focuses on differences in lingual coarticulation between French children and adults. The specific question pursued is whether 4-5 year old children have already acquired a synergy observed in adults in which the tongue back helps the tip in the formation of alveolar consonants. Locus equations, estimated from acoustic and ultrasound imaging data were used to compare coarticulation degree between adults and children and further investigate differences in motor synergy between the front and back parts of the tongue. Results show similar slope and intercept patterns for adults and children in both the acoustic and articulatory domains, with an effect of place of articulation in both groups between alveolar and non-alveolar consonants. These results suggest that 4-5 year old children (1) have learned the motor synergy investigated and (2) have developed a pattern of coarticulatory resistance depending on a consonant place of articulation. Also, results show that acoustic locus equations can be used to gauge the presence of motor synergies in children.

Anticipatory lip gestures: a validation of the Movement Expansion Model in congenitally blind speakers.

In this paper, anticipatory co-articulation of the lip protrusion and constriction gestures is investigated in speakers with visual deprivation. Audio-visual recordings of 11 congenitally blind French speakers producing [V-roundC-roundV+round] sequences were measured with a lip shape tracking system. Lip protrusion and constriction values and their relative timings were analyzed. Results show that despite the reduced magnitude of lip protrusion and constriction area in blind speakers, the timing of the anticipatory gestures can be appropriately modeled by the Movement Expansion Model [from Abry and Lallouache (1995a). Bul. de la Comm. Parlée 3, 85-99; (1995b). Proceedings of ICPHS, pp. 152-155; Noiray et al. (2011). J. Acoust. Soc. Am. 129, 340-349], which predicts lawful anticipatory behavior expanding linearly as the intervocalic consonant interval increases.

Language dependent vowel representation in speech production.

The representation of speech goals was explored using an auditory feedback paradigm. When talkers produce vowels the formant structure of which is perturbed in real time, they compensate to preserve the intended goal. When vowel formants are shifted up or down in frequency, participants change the formant frequencies in the opposite direction to the feedback perturbation. In this experiment, the specificity of vowel representation was explored by examining the magnitude of vowel compensation when the second formant frequency of a vowel was perturbed for speakers of two different languages (English and French). Even though the target vowel was the same for both language groups, the pattern of compensation differed. French speakers compensated to smaller perturbations and made larger compensations overall. Moreover, French speakers modified the third formant in their vowels to strengthen the compensation even though the third formant was not perturbed. English speakers did not alter their third formant. Changes in the perceptual goodness ratings by the two groups of participants were consistent with the threshold to initiate vowel compensation in production. These results suggest that vowel goals not only specify the quality of the vowel but also the relationship of the vowel to the vowel space of the spoken language.