A Theoretical Framework for Human and Nonhuman Vocal Interaction.

Vocal communication is a critical feature of social interaction across species; however, the relation between such behavior in humans and nonhumans remains unclear. To enable comparative investigation of this topic, we review the literature pertinent to interactive language use and identify the superset of cognitive operations involved in generating communicative action. We posit these functions comprise three intersecting multistep pathways: (a) the Content Pathway, which selects the movements constituting a response; (b) the Timing Pathway, which temporally structures responses; and (c) the Affect Pathway, which modulates response parameters according to internal state. These processing streams form the basis of the Convergent Pathways for Interaction framework, which provides a conceptual model for investigating the cognitive and neural computations underlying vocal communication across species.

Localization of stuttering based on causal brain lesions.

Stuttering affects approximately 1 in 100 adults and can result in significant communication problems and social anxiety. It most often occurs as a developmental disorder but can also be caused by focal brain damage. These latter cases may lend unique insight into the brain regions causing stuttering. Here, we investigated the neuroanatomical substrate of stuttering using three independent datasets: (i) case reports from the published literature of acquired neurogenic stuttering following stroke (n = 20, 14 males/six females, 16-77 years); (ii) a clinical single study cohort with acquired neurogenic stuttering following stroke (n = 20, 13 males/seven females, 45-87 years); and (iii) adults with persistent developmental stuttering (n = 20, 14 males/six females, 18-43 years). We used the first two datasets and lesion network mapping to test whether lesions causing acquired stuttering map to a common brain network. We then used the third dataset to test whether this lesion-based network was relevant to developmental stuttering. In our literature dataset, we found that lesions causing stuttering occurred in multiple heterogeneous brain regions, but these lesion locations were all functionally connected to a common network centred around the left putamen, including the claustrum, amygdalostriatal transition area and other adjacent areas. This finding was shown to be specific for stuttering (PFWE < 0.05) and reproducible in our independent clinical cohort of patients with stroke-induced stuttering (PFWE < 0.05), resulting in a common acquired stuttering network across both stroke datasets. Within the common acquired stuttering network, we found a significant association between grey matter volume and stuttering impact for adults with persistent developmental stuttering in the left posteroventral putamen, extending into the adjacent claustrum and amygdalostriatal transition area (PFWE < 0.05). We conclude that lesions causing acquired neurogenic stuttering map to a common brain network, centred to the left putamen, claustrum and amygdalostriatal transition area. The association of this lesion-based network with symptom severity in developmental stuttering suggests a shared neuroanatomy across aetiologies.

LaDIVA: A neurocomputational model providing laryngeal motor control for speech acquisition and production.

Many voice disorders are the result of intricate neural and/or biomechanical impairments that are poorly understood. The limited knowledge of their etiological and pathophysiological mechanisms hampers effective clinical management. Behavioral studies have been used concurrently with computational models to better understand typical and pathological laryngeal motor control. Thus far, however, a unified computational framework that quantitatively integrates physiologically relevant models of phonation with the neural control of speech has not been developed. Here, we introduce LaDIVA, a novel neurocomputational model with physiologically based laryngeal motor control. We combined the DIVA model (an established neural network model of speech motor control) with the extended body-cover model (a physics-based vocal fold model). The resulting integrated model, LaDIVA, was validated by comparing its model simulations with behavioral responses to perturbations of auditory vocal fundamental frequency (fo) feedback in adults with typical speech. LaDIVA demonstrated capability to simulate different modes of laryngeal motor control, ranging from short-term (i.e., reflexive) and long-term (i.e., adaptive) auditory feedback paradigms, to generating prosodic contours in speech. Simulations showed that LaDIVA's laryngeal motor control displays properties of motor equivalence, i.e., LaDIVA could robustly generate compensatory responses to reflexive vocal fo perturbations with varying initial laryngeal muscle activation levels leading to the same output. The model can also generate prosodic contours for studying laryngeal motor control in running speech. LaDIVA can expand the understanding of the physiology of human phonation to enable, for the first time, the investigation of causal effects of neural motor control in the fine structure of the vocal signal.

Neurocomputational modeling of speech motor development.

This review describes a computational approach for modeling the development of speech motor control in infants. We address the development of two levels of control: articulation of individual speech sounds (defined here as phonemes, syllables, or words for which there is an optimized motor program) and production of sound sequences such as phrases or sentences. We describe the DIVA model of speech motor control and its application to the problem of learning individual sounds in the infant's native language. Then we describe the GODIVA model, an extension of DIVA, and how chunking of frequently produced phoneme sequences is implemented within it.

Disentangling Effects of Memory Storage and Inter-articulator Coordination on Generalization in Speech Motor Sequence Learning.

Generalization in motor control is the extent to which motor learning affects movements in situations different than those in which it originally occurred. Recent data on orofacial speech movements indicates that motor sequence learning generalizes to novel syllable sequences containing phonotactically illegal, but previously practiced, consonant clusters. Practicing an entire syllable, however, results in even larger performance gains compared to practicing just its clusters. These patterns of generalization could reflect language-general changes in phonological memory storage and/or inter-articulator coordination during motor sequence learning. To disentangle these factors, we conducted two experiments in which talkers intensively practiced producing novel syllables containing illegal onset and coda clusters over two consecutive days. During the practice phases of both experiments, we observed that, through repetition, talkers gradually produced the syllables with fewer errors, indicative of learning. After learning, talkers were tested for generalization to single syllables (Experiment 1) or syllable pairs (Experiment 2) that overlapped to varying degrees with the practiced syllables. Across both experiments, we found that performance improvements from practicing syllables with illegal clusters partially generalized to novel syllables that contained those clusters, but performance was more error prone if the clusters occurred in a different syllable position (onset versus coda) as in practice, demonstrating that inter-articulator coordination is contextually sensitive. Furthermore, changing the position of a cluster was found to be more deleterious to motor performance during the production of the second syllables in syllable pairs, which required talkers to store more phonological material in memory prior to articulation, compared to single syllables. This interaction effect reveals a complex interplay between memory storage and inter-articulator coordination on generalization in speech motor sequence learning.

Brain-Computer Interfaces for Treatment of Focal Dystonia.

Task-specificity in isolated focal dystonias is a powerful feature that may successfully be targeted with therapeutic brain-computer interfaces. While performing a symptomatic task, the patient actively modulates momentary brain activity (disorder signature) to match activity during an asymptomatic task (target signature), which is expected to translate into symptom reduction.

Anomalous morphology in left hemisphere motor and premotor cortex of children who stutter.

Stuttering is a neurodevelopmental disorder that affects the smooth flow of speech production. Stuttering onset occurs during a dynamic period of development when children first start learning to formulate sentences. Although most children grow out of stuttering naturally, ∼1% of all children develop persistent stuttering that can lead to significant psychosocial consequences throughout one's life. To date, few studies have examined neural bases of stuttering in children who stutter, and even fewer have examined the basis for natural recovery versus persistence of stuttering. Here we report the first study to conduct surface-based analysis of the brain morphometric measures in children who stutter. We used FreeSurfer to extract cortical size and shape measures from structural MRI scans collected from the initial year of a longitudinal study involving 70 children (36 stuttering, 34 controls) in the 3-10-year range. The stuttering group was further divided into two groups: persistent and recovered, based on their later longitudinal visits that allowed determination of their eventual clinical outcome. A region of interest analysis that focused on the left hemisphere speech network and a whole-brain exploratory analysis were conducted to examine group differences and group × age interaction effects. We found that the persistent group could be differentiated from the control and recovered groups by reduced cortical thickness in left motor and lateral premotor cortical regions. The recovered group showed an age-related decrease in local gyrification in the left medial premotor cortex (supplementary motor area and and pre-supplementary motor area). These results provide strong evidence of a primary deficit in the left hemisphere speech network, specifically involving lateral premotor cortex and primary motor cortex, in persistent developmental stuttering. Results further point to a possible compensatory mechanism involving left medial premotor cortex in those who recover from childhood stuttering.

Auditory-motor adaptation is reduced in adults who stutter but not in children who stutter.

Previous studies have shown that adults who stutter produce smaller corrective motor responses to compensate for unexpected auditory perturbations in comparison to adults who do not stutter, suggesting that stuttering may be associated with deficits in integration of auditory feedback for online speech monitoring. In this study, we examined whether stuttering is also associated with deficiencies in integrating and using discrepancies between expected and received auditory feedback to adaptively update motor programs for accurate speech production. Using a sensorimotor adaptation paradigm, we measured adaptive speech responses to auditory formant frequency perturbations in adults and children who stutter and their matched nonstuttering controls. We found that the magnitude of the speech adaptive response for children who stutter did not differ from that of fluent children. However, the adaptation magnitude of adults who stutter in response to auditory perturbation was significantly smaller than the adaptation magnitude of adults who do not stutter. Together these results indicate that stuttering is associated with deficits in integrating discrepancies between predicted and received auditory feedback to calibrate the speech production system in adults but not children. This auditory-motor integration deficit thus appears to be a compensatory effect that develops over years of stuttering.

Surface electromyographic control of a novel phonemic interface for speech synthesis.

Many individuals with minimal movement capabilities use AAC to communicate. These individuals require both an interface with which to construct a message (e.g., a grid of letters) and an input modality with which to select targets. This study evaluated the interaction of two such systems: (a) an input modality using surface electromyography (sEMG) of spared facial musculature, and (b) an onscreen interface from which users select phonemic targets. These systems were evaluated in two experiments: (a) participants without motor impairments used the systems during a series of eight training sessions, and (b) one individual who uses AAC used the systems for two sessions. Both the phonemic interface and the electromyographic cursor show promise for future AAC applications.

The neural correlates of speech motor sequence learning.

Speech is perhaps the most sophisticated example of a species-wide movement capability in the animal kingdom, requiring split-second sequencing of approximately 100 muscles in the respiratory, laryngeal, and oral movement systems. Despite the unique role speech plays in human interaction and the debilitating impact of its disruption, little is known about the neural mechanisms underlying speech motor learning. Here, we studied the behavioral and neural correlates of learning new speech motor sequences. Participants repeatedly produced novel, meaningless syllables comprising illegal consonant clusters (e.g., GVAZF) over 2 days of practice. Following practice, participants produced the sequences with fewer errors and shorter durations, indicative of motor learning. Using fMRI, we compared brain activity during production of the learned illegal sequences and novel illegal sequences. Greater activity was noted during production of novel sequences in brain regions linked to non-speech motor sequence learning, including the BG and pre-SMA. Activity during novel sequence production was also greater in brain regions associated with learning and maintaining speech motor programs, including lateral premotor cortex, frontal operculum, and posterior superior temporal cortex. Measures of learning success correlated positively with activity in left frontal operculum and white matter integrity under left posterior superior temporal sulcus. These findings indicate speech motor sequence learning relies not only on brain areas involved generally in motor sequencing learning but also those associated with feedback-based speech motor learning. Furthermore, learning success is modulated by the integrity of structural connectivity between these motor and sensory brain regions.

Vowel category boundaries enhance cortical and behavioral responses to speech feedback alterations.

Auditory feedback is instrumental in the online control of speech, allowing speakers to compare their self-produced speech signal with a desired auditory target and correct for errors. However, there is little account of the representation of "target" and "error": does error depend purely on acoustic distance from a target, or is error enhanced by phoneme category changes? Here, we show an effect of vowel boundaries on compensatory responses to a real-time auditory perturbation. While human subjects spoke monosyllabic words, event-triggered functional magnetic resonance imaging was used to characterize neural responses to unexpected changes in auditory feedback. Capitalizing on speakers' natural variability, we contrasted the responses to feedback perturbations applied to two classes of utterances: (1) those that fell nearer to the category boundary, for which perturbations were designed to change the phonemic identity of the heard speech; and (2) those that fell farther from the boundary, for which perturbations resulted in only sub-phonemic auditory differences. Subjects' behavioral compensation was more than three times greater when feedback shifts were applied nearer to a category boundary. Furthermore, a near-boundary shift resulted in stronger cortical responses, most notably in right posterior superior temporal gyrus, than an identical shift that occurred far from the boundary. Across participants, a correlation was found between the amount of compensation to the perturbation and the amount of activity in a network of superior temporal and inferior frontal brain regions. Together, these results demonstrate that auditory feedback control of speech is sensitive to linguistic categories learned through auditory experience.

In vitro resistance mechanisms of Neisseria meningitidis against neutrophil extracellular traps.

Neisseria meningitidis (Nm) is a leading cause of septicemia in childhood. Nm septicemia is unique with respect to very quick disease progression, high in vivo bacterial replication rate and its considerable mortality. Nm circumvents major mechanisms of innate immunity such as complement system and phagocytosis. Neutrophil extracellular traps (NETs) are formed from neutrophils during systemic infection and are suggested to contain invading microorganisms. Here, we investigated the interaction of Nm with NETs. Both, meningococci and spontaneously released outer membrane vesicles (SOMVs) were potent NET inducers. NETs were unable to kill NET bound meningococci, but slowed down their proliferation rate. Using Nm as model organism we identified three novel mechanisms how bacteria can evade NET-mediated killing: (i) modification of lipid A of meningococcal LPS with phosphoethanolamine protected Nm from NET-bound cathepsin G; (ii) expression of the high-affinity zinc uptake receptor ZnuD allowed Nm to escape NET-mediated nutritional immunity; (iii) binding of SOMVs to NETs saved Nm from NET binding and the consequent bacteriostatic effect. Escape from NETs may contribute to the most rapid progression of meningococcal disease. The induction of NET formation by Nm in vivo might aggravate thrombosis in vessels ultimately directing to disseminated intravascular coagulation (DIC).

Non-arbitrary mappings between size and sound of English words: Form typicality effects during lexical access and memory.

A century of research has provided evidence of limited size sound symbolism in English, that is, certain vowels are non-arbitrarily associated with words denoting small versus large referents (e.g., /i/ as in teensy and /ɑ/ as in tall). In the present study, we investigated more extensive statistical regularities between surface form properties of English words and ratings of their semantic size, that is, form typicality, and its impact on language and memory processing. Our findings provide the first evidence of significant word form typicality for semantic size. In five empirical studies using behavioural megastudy data sets of performance on written and auditory lexical decision, reading aloud, semantic decision, and recognition memory tasks, we show that form typicality for size is a stronger and more consistent predictor of lexical access during word comprehension and production than semantic size, in addition to playing a significant role in verbal memory. The empirical results demonstrate that statistical information about non-arbitrary form-size mappings is accessed automatically during language and verbal memory processing, unlike semantic size that is largely dependent on task contexts that explicitly require participants to access size knowledge. We discuss how a priori knowledge about non-arbitrary form-meaning associations in the lexicon might be incorporated in models of language processing that implement Bayesian statistical inference.

Controlling Pitch for Prosody: Sensorimotor Adaptation in Linguistically Meaningful Contexts.

PURPOSE: This study examined how speakers adapt to fundamental frequency (fo) errors that affect the use of prosody to convey linguistic meaning, whether fo adaptation in that context relates to adaptation in linguistically neutral sustained vowels, and whether cue trading is reflected in responses in the prosodic cues of fo and amplitude. METHOD: Twenty-four speakers said vowels and sentences while fo was digitally altered to induce predictable errors. Shifts in fo (±200 cents) were applied to the entire sustained vowel and one word (emphasized or unemphasized) in sentences. Two prosodic cues-fo and amplitude-were extracted. The effects of fo shifts, shift direction, and emphasis on fo response magnitude were evaluated with repeated-measures analyses of variance. Relationships between adaptive fo responses in sentences and vowels and between adaptive fo and amplitude responses were evaluated with Spearman correlations. RESULTS: Speakers adapted to fo errors in both linguistically meaningful sentences and linguistically neutral vowels. Adaptive fo responses of unemphasized words were smaller than those of emphasized words when fo was shifted upward. There was no relationship between adaptive fo responses in vowels and emphasized words, but adaptive fo and amplitude responses were strongly, positively correlated. CONCLUSIONS: Sensorimotor adaptation occurs in response to fo errors regardless of how disruptive the error is to linguistic meaning. Adaptation to fo errors during sustained vowels may not involve the exact same mechanisms as sensorimotor adaptation as it occurs in meaningful speech. The relationship between adaptive responses in fo and amplitude supports an integrated model of prosody. SUPPLEMENTAL MATERIAL: https://doi.org/10.23641/asha.25008908.

A neurocomputational view of the effects of Parkinson's disease on speech production.

The purpose of this article is to review the scientific literature concerning speech in Parkinson's disease (PD) with reference to the DIVA/GODIVA neurocomputational modeling framework. Within this theoretical view, the basal ganglia (BG) contribute to several different aspects of speech motor learning and execution. First, the BG are posited to play a role in the initiation and scaling of speech movements. Within the DIVA/GODIVA framework, initiation and scaling are carried out by initiation map nodes in the supplementary motor area acting in concert with the BG. Reduced support of the initiation map from the BG in PD would result in reduced movement intensity as well as susceptibility to early termination of movement. A second proposed role concerns the learning of common speech sequences, such as phoneme sequences comprising words; this view receives support from the animal literature as well as studies identifying speech sequence learning deficits in PD. Third, the BG may play a role in the temporary buffering and sequencing of longer speech utterances such as phrases during conversational speech. Although the literature does not support a critical role for the BG in representing sequence order (since incorrectly ordered speech is not characteristic of PD), the BG are posited to contribute to the scaling of individual movements in the sequence, including increasing movement intensity for emphatic stress on key words. Therapeutic interventions for PD have inconsistent effects on speech. In contrast to dopaminergic treatments, which typically either leave speech unchanged or lead to minor improvements, deep brain stimulation (DBS) can degrade speech in some cases and improve it in others. However, cases of degradation may be due to unintended stimulation of efferent motor projections to the speech articulators. Findings of spared speech after bilateral pallidotomy appear to indicate that any role played by the BG in adult speech must be supplementary rather than mandatory, with the sequential order of well-learned sequences apparently represented elsewhere (e.g., in cortico-cortical projections).

Statistical relationships between surface form and sensory meanings of English words influence lexical processing.

Across spoken languages, there are some words whose acoustic features resemble the meanings of their referents by evoking perceptual imagery, i.e., they are iconic (e.g., in English, "splash" imitates the sound of an object hitting water). While these sound symbolic form-meaning relationships are well-studied, relatively little work has explored whether the sensory properties of English words also involve systematic (i.e., statistical) form-meaning mappings. We first test the prediction that surface form properties can predict sensory experience ratings for over 5,000 monosyllabic and disyllabic words (Juhasz & Yap, 2013), confirming they explain a significant proportion of variance. Next, we show that iconicity and sensory form typicality, a statistical measure of how well a word's form aligns with its sensory experience rating, are only weakly related to each other, indicating they are likely to be distinct constructs. To determine whether form typicality influences processing of sensory words, we conducted regression analyses using lexical decision, word recognition, naming and semantic decision tasks from behavioral megastudy data sets. Across the data sets, sensory form typicality was able to predict more variance in performance than sensory experience or iconicity ratings. Further, the effects of typicality were consistently inhibitory in comprehension (i.e., more typical forms were responded to more slowly and less accurately), whereas for production the effect was facilitatory. These findings are the first evidence that systematic form-meaning mappings in English sensory words influence their processing. We discuss how language processing models incorporating Bayesian prediction mechanisms might be able to account for form typicality in the lexicon. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Evidence for planning and motor subtypes of stuttering based on resting state functional connectivity.

We tested the hypothesis, generated from the Gradient Order Directions Into Velocities of Articulators (GODIVA) model, that adults who stutter (AWS) may comprise subtypes based on differing connectivity within the cortico-basal ganglia planning or motor loop. Resting state functional connectivity from 91 AWS and 79 controls was measured for all GODIVA model connections. Based on a principal components analysis, two connections accounted for most of the connectivity variability in AWS: left thalamus - left posterior inferior frontal sulcus (planning loop component) and left supplementary motor area - left ventral premotor cortex (motor loop component). A k-means clustering algorithm using the two connections revealed three clusters of AWS. Cluster 1 was significantly different from controls in both connections; Cluster 2 was significantly different in only the planning loop; and Cluster 3 was significantly different in only the motor loop. These findings suggest the presence of planning and motor subtypes of stuttering.

Auditory feedback control in adults who stutter during metronome-paced speech I. Timing Perturbation.

PURPOSE: This study determined whether adults who stutter (AWS) exhibit deficits in responding to an auditory feedback timing perturbation, and whether external timing cues, which increase fluency, attenuate any disruptions due to altered temporal auditory feedback. METHODS: Fifteen AWS and sixteen adults who do not stutter (ANS) read aloud a multisyllabic sentence either with normal pacing or with each syllable paced at the rate of a metronome. On random trials, an auditory feedback timing perturbation was applied, and timing responses were compared between groups and pacing conditions. RESULTS: Both groups responded to the timing perturbation by delaying subsequent syllable boundaries, and there were no significant differences between groups in either pacing condition. Furthermore, no response differences were found between normally paced and metronome-paced conditions. CONCLUSION: These findings are interpreted as showing that 1) AWS respond normally to pure timing perturbations, and 2) metronome-paced speech has no effect on online speech timing control as assessed in the present experiment.

On the roles of form systematicity and sensorimotor effects in language processing.

Grounded or embodied cognition research has employed body-object interaction (BOI; e.g., Pexman et al., 2019) ratings to investigate sensorimotor effects during language processing. We investigated relationships between BOI ratings and nonarbitrary statistical mappings between words' phonological forms and their syntactic category in English; i.e., form systematicity. In Study 1, principal components analysis revealed that BOI and form systematicity measures load on a common component, indicating they convey similar information about the probability of a word belonging to a particular syntactic category. In Studies 2, 3, and 4, form systematicity measures were stronger predictors of English Lexicon Project (ELP; Balota et al., 2007), Auditory English Lexicon Project (AELP; Goh et al., 2020), and English Crowdsourcing Project (ECP; Mandera et al., 2020) performance than BOI. In Study 5, BOI was a stronger predictor of performance from the Calgary Semantic Decision Project (CSDP; Pexman et al., 2017) than form systematicity. In Study 6, only form systematicity significantly predicted performance from the LinguaPix object naming megastudy (Krautz & Keuleers, 2022). Together, these results demonstrate that nonarbitrary statistical relationships in the form of mappings between ortho-phonological information and meaning are accessed automatically during language processing; i.e., even when syntactic category is not relevant to the task, and that sensorimotor simulation mechanisms are only strongly engaged when explicitly demanded by the task. We discuss the implications of these findings for proposals of embodied or grounded cognition and interpretations of neuroimaging data from word recognition tasks. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Emotion from the sound of a word: Statistical relationships between surface form and valence of English words influence lexical access and memory.

It is generally accepted that a word's emotional valence (i.e., whether a word is perceived as positive, negative, or neutral) influences how it is accessed and remembered. There is also evidence that the affective content of some words is represented in nonarbitrary sound-meaning associations (i.e., emotional sound symbolism). We investigated whether more extensive statistical relationships exist between the surface form properties of English words and ratings of their emotional valence, that is, form typicality. We found significant form typicality for both valence and extremity of valence (the absolute distance from the midpoint of the rating scale, regardless of polarity). Next, using behavioral megastudy data sets, we show that measures of emotional form typicality are significant predictors of lexical access during written and auditory lexical decision and reading aloud tasks in addition to recognition memory performance. These findings show nonarbitrary form-valence mappings in English are accessed automatically during language and verbal memory processing. We discuss how these findings might be incorporated into theoretical accounts that implement Bayesian statistical inference. (PsycInfo Database Record (c) 2023 APA, all rights reserved).