Impairment of the internal forward model and feedback mechanisms for vocal sensorimotor control in post-stroke aphasia: evidence from directional responses to altered auditory feedback.

The present study examined opposing and following vocal responses to altered auditory feedback (AAF) to determine how damage to left-hemisphere brain networks impairs the internal forward model and feedback mechanisms in post-stroke aphasia. Forty-nine subjects with aphasia and sixty age-matched controls performed speech vowel production tasks while their auditory feedback was altered using randomized ± 100 cents upward and downward pitch-shift stimuli. Data analysis revealed that when vocal responses were averaged across all trials (i.e., opposing and following), the overall magnitude of vocal compensation was significantly reduced in the aphasia group compared with controls. In addition, when vocal responses were analyzed separately for opposing and following trials, subjects in the aphasia group showed a significantly lower percentage of opposing and higher percentage of following vocal response trials compared with controls, particularly for the upward pitch-shift stimuli. However, there was no significant difference in the magnitude of opposing and following vocal responses between the two groups. These findings further support previous evidence on the impairment of vocal sensorimotor control in aphasia and provide new insights into the distinctive impact of left-hemisphere stroke on the internal forward model and feedback mechanisms. In this context, we propose that the lower percentage of opposing responses in aphasia may be accounted for by deficits in feedback-dependent mechanisms of audio-vocal integration and motor control. In addition, the higher percentage of following responses may reflect aberrantly increased reliance of the speech system on the internal forward model for generating sensory predictions during vocal error detection and motor control.

Neural correlates of impaired vocal feedback control in post-stroke aphasia.

We used left-hemisphere stroke as a model to examine how damage to sensorimotor brain networks impairs vocal auditory feedback processing and control. Individuals with post-stroke aphasia and matched neurotypical control subjects vocalized speech vowel sounds and listened to the playback of their self-produced vocalizations under normal (NAF) and pitch-shifted altered auditory feedback (AAF) while their brain activity was recorded using electroencephalography (EEG) signals. Event-related potentials (ERPs) were utilized as a neural index to probe the effect of vocal production on auditory feedback processing with high temporal resolution, while lesion data in the stroke group was used to determine how brain abnormality accounted for the impairment of such mechanisms. Results revealed that ERP activity was aberrantly modulated during vocalization vs. listening in aphasia, and this effect was accompanied by the reduced magnitude of compensatory vocal responses to pitch-shift alterations in the auditory feedback compared with control subjects. Lesion-mapping revealed that the aberrant pattern of ERP modulation in response to NAF was accounted for by damage to sensorimotor networks within the left-hemisphere inferior frontal, precentral, inferior parietal, and superior temporal cortices. For responses to AAF, neural deficits were predicted by damage to a distinguishable network within the inferior frontal and parietal cortices. These findings define the left-hemisphere sensorimotor networks implicated in auditory feedback processing, error detection, and vocal motor control. Our results provide translational synergy to inform the theoretical models of sensorimotor integration while having clinical applications for diagnosis and treatment of communication disabilities in individuals with stroke and other neurological conditions.

Compensatory mechanisms affect sensorimotor integration during ongoing vocal motor acts in marmoset monkeys.

Any transmission of vocal signals faces the challenge of acoustic interferences such as heavy rain, wind, animal or urban sounds. Consequently, several mechanisms and strategies have evolved to optimize signal-to-noise ratio. Examples to increase detectability are the Lombard effect, an involuntary rise in call amplitude in response to masking ambient noise, which is often associated with other vocal changes such as call frequency and duration, as well as the animals' capability of limiting calling to periods where noise perturbation is absent. Previous studies revealed vocal flexibility and various audio-vocal integration mechanisms in marmoset monkeys. Using acoustic perturbation triggered by vocal behaviour, we investigated whether marmosets are capable of exhibiting changes in call structure when perturbing noise starts after call onset or whether such effects only occur if noise perturbation starts prior to call onset. We show that marmosets are capable of rapidly modulating call amplitude and frequency in response to such noise perturbation. Vocalizations swiftly increased call frequency after noise onset indicating a rapid effect of perturbing noise on vocal motor production. Call amplitudes were also affected. Interestingly, however, the marmosets did not exhibit the Lombard effect as previously reported but decreased call intensity in response to noise. Our findings indicate that marmosets possess a general avoidance strategy to call in the presence of ambient noise and suggest that these animals are capable of counteracting a previously thought involuntary audio-vocal mechanism, the Lombard effect. These findings will pave the way to investigate the underlying audio-vocal integration mechanisms explaining these behaviours.

Timing during transitions in Bengalese finch song: implications for motor sequencing.

To investigate mechanisms of action sequencing, we examined the relationship between timing and sequencing of syllables in Bengalese finch song. An individual's song comprises acoustically distinct syllables organized into probabilistic sequences: a given syllable potentially can transition to several different syllables (divergence points), and several different syllables can transition to a given syllable (convergence points). In agreement with previous studies, we found that more probable transitions at divergence points occur with shorter intersyllable gaps. One intuition for this relationship is that selection between syllables reflects a competitive branching process, in which stronger links to one syllable lead to both higher probabilities and shorter latencies for transitions to that syllable vs. competing alternatives. However, we found that simulations of competitive race models result in overlapping winning-time distributions for competing outcomes and fail to replicate the strong negative correlation between probability and gap duration found in song data. Further investigation of song structure revealed strong positive correlation between gap durations for transitions that share a common convergent point. Such transitions are not related by a common competitive process, but instead reflect a common terminal syllable. In contrast to gap durations, transition probabilities were not correlated at convergence points. Together, our data suggest that syllable selection happens early during the gap, with gap timing determined chiefly by the latency to syllable initiation. This may result from a process in which probabilistic sequencing is first stabilized, followed by a shortening of the latency to syllables that are sung more often.NEW & NOTEWORTHY Bengalese finch songs consist of probabilistic sequences of syllables. Previous studies revealed a strong negative correlation between transition probability and the duration of intersyllable gaps. We show here that the negative correlation is inconsistent with previous suggestions that timing at syllable transitions is governed by a race between competing alternatives. Rather, the data suggest that syllable selection happens early during the gap, with gap timing determined chiefly by the latency to syllable initiation.

Vocal plasticity in a reptile.

Sophisticated vocal communication systems of birds and mammals, including human speech, are characterized by a high degree of plasticity in which signals are individually adjusted in response to changes in the environment. Here, we present, to our knowledge, the first evidence for vocal plasticity in a reptile. Like birds and mammals, tokay geckos (Gekko gecko) increased the duration of brief call notes in the presence of broadcast noise compared to quiet conditions, a behaviour that facilitates signal detection by receivers. By contrast, they did not adjust the amplitudes of their call syllables in noise (the Lombard effect), which is in line with the hypothesis that the Lombard effect has evolved independently in birds and mammals. However, the geckos used a different strategy to increase signal-to-noise ratios: instead of increasing the amplitude of a given call type when exposed to noise, the subjects produced more high-amplitude syllable types from their repertoire. Our findings demonstrate that reptile vocalizations are much more flexible than previously thought, including elaborate vocal plasticity that is also important for the complex signalling systems of birds and mammals. We suggest that signal detection constraints are one of the major forces driving the evolution of animal communication systems across different taxa.

Audio-vocal interaction in single neurons of the monkey ventrolateral prefrontal cortex.

Complex audio-vocal integration systems depend on a strong interconnection between the auditory and the vocal motor system. To gain cognitive control over audio-vocal interaction during vocal motor control, the PFC needs to be involved. Neurons in the ventrolateral PFC (VLPFC) have been shown to separately encode the sensory perceptions and motor production of vocalizations. It is unknown, however, whether single neurons in the PFC reflect audio-vocal interactions. We therefore recorded single-unit activity in the VLPFC of rhesus monkeys (Macaca mulatta) while they produced vocalizations on command or passively listened to monkey calls. We found that 12% of randomly selected neurons in VLPFC modulated their discharge rate in response to acoustic stimulation with species-specific calls. Almost three-fourths of these auditory neurons showed an additional modulation of their discharge rates either before and/or during the monkeys' motor production of vocalization. Based on these audio-vocal interactions, the VLPFC might be well positioned to combine higher order auditory processing with cognitive control of the vocal motor output. Such audio-vocal integration processes in the VLPFC might constitute a precursor for the evolution of complex learned audio-vocal integration systems, ultimately giving rise to human speech.

Left-hemisphere activation is associated with enhanced vocal pitch error detection in musicians with absolute pitch.

The ability to process auditory feedback for vocal pitch control is crucial during speaking and singing. Previous studies have suggested that musicians with absolute pitch (AP) develop specialized left-hemisphere mechanisms for pitch processing. The present study adopted an auditory feedback pitch perturbation paradigm combined with ERP recordings to test the hypothesis whether the neural mechanisms of the left-hemisphere enhance vocal pitch error detection and control in AP musicians compared with relative pitch (RP) musicians and non-musicians (NM). Results showed a stronger N1 response to pitch-shifted voice feedback in the right-hemisphere for both AP and RP musicians compared with the NM group. However, the left-hemisphere P2 component activation was greater in AP and RP musicians compared with NMs and also for the AP compared with RP musicians. The NM group was slower in generating compensatory vocal reactions to feedback pitch perturbation compared with musicians, and they failed to re-adjust their vocal pitch after the feedback perturbation was removed. These findings suggest that in the earlier stages of cortical neural processing, the right hemisphere is more active in musicians for detecting pitch changes in voice feedback. In the later stages, the left-hemisphere is more active during the processing of auditory feedback for vocal motor control and seems to involve specialized mechanisms that facilitate pitch processing in the AP compared with RP musicians. These findings indicate that the left hemisphere mechanisms of AP ability are associated with improved auditory feedback pitch processing during vocal pitch control in tasks such as speaking or singing.

Temporal specificity of abnormal neural oscillations during phonatory events in laryngeal dystonia.

Laryngeal dystonia is a debilitating disorder of voicing in which the laryngeal muscles are intermittently in spasm resulting in involuntary interruptions during speech. The central pathophysiology of laryngeal dystonia, underlying computational impairments in vocal motor control, remains poorly understood. Although prior imaging studies have found aberrant activity in the CNS during phonation in patients with laryngeal dystonia, it is not known at what timepoints during phonation these abnormalities emerge and what function may be impaired. To investigate this question, we recruited 22 adductor laryngeal dystonia patients (15 female, age range = 28.83-72.46 years) and 18 controls (eight female, age range = 27.40-71.34 years). We leveraged the fine temporal resolution of magnetoencephalography to monitor neural activity around glottal movement onset, subsequent voice onset and after the onset of pitch feedback perturbations. We examined event-related beta-band (12-30 Hz) and high-gamma-band (65-150 Hz) neural oscillations. Prior to glottal movement onset, we observed abnormal frontoparietal motor preparatory activity. After glottal movement onset, we observed abnormal activity in the somatosensory cortex persisting through voice onset. Prior to voice onset and continuing after, we also observed abnormal activity in the auditory cortex and the cerebellum. After pitch feedback perturbation onset, we observed no differences between controls and patients in their behavioural responses to the perturbation. But in patients, we did find abnormal activity in brain regions thought to be involved in the auditory feedback control of vocal pitch (premotor, motor, somatosensory and auditory cortices). Our study results confirm the abnormal processing of somatosensory feedback that has been seen in other studies. However, there were several remarkable findings in our study. First, patients have impaired vocal motor activity even before glottal movement onset, suggesting abnormal movement preparation. These results are significant because (i) they occur before movement onset, abnormalities in patients cannot be ascribed to deficits in vocal performance and (ii) they show that neural abnormalities in laryngeal dystonia are more than just abnormal responses to sensory feedback during phonation as has been hypothesized in some previous studies. Second, abnormal auditory cortical activity in patients begins even before voice onset, suggesting abnormalities in setting up auditory predictions before the arrival of auditory feedback at voice onset. Generally, activation abnormalities identified in key brain regions within the speech motor network around various phonation events not only provide temporal specificity to neuroimaging phenotypes in laryngeal dystonia but also may serve as potential therapeutic targets for neuromodulation.

Continuous theta burst stimulation over left supplementary motor area facilitates auditory-vocal integration in individuals with Parkinson's disease.

Accumulating evidence suggests that impairment in auditory-vocal integration characterized by abnormally enhanced vocal compensations for auditory feedback perturbations contributes to hypokinetic dysarthria in Parkinson's disease (PD). However, treatment of this abnormality remains a challenge. The present study examined whether abnormalities in auditory-motor integration for vocal pitch regulation in PD can be modulated by neuronavigated continuous theta burst stimulation (c-TBS) over the left supplementary motor area (SMA). After receiving active or sham c-TBS over left SMA, 16 individuals with PD vocalized vowel sounds while hearing their own voice unexpectedly pitch-shifted two semitones upward or downward. A group of pairwise-matched healthy participants was recruited as controls. Their vocal responses and event-related potentials (ERPs) were measured and compared across the conditions. The results showed that applying c-TBS over left SMA led to smaller vocal responses paralleled by smaller P1 and P2 responses and larger N1 responses in individuals with PD. Major neural generators of reduced P2 responses were located in the right inferior and medial frontal gyrus, pre- and post-central gyrus, and insula. Moreover, suppressed vocal compensations were predicted by reduced P2 amplitudes and enhanced N1 amplitudes. Notably, abnormally enhanced vocal and P2 responses in individuals with PD were normalized by c-TBS over left SMA when compared to healthy controls. Our results provide the first causal evidence that abnormalities in auditory-motor control of vocal pitch production in PD can be modulated by c-TBS over left SMA, suggesting that it may be a promising non-invasive treatment for speech motor disorders in PD.

The Lombard Effect: From Acoustics to Neural Mechanisms.

Understanding the neural underpinnings of vocal-motor control in humans and other animals remains a major challenge in neurobiology. The Lombard effect - a rise in call amplitude in response to background noise - has been demonstrated in a wide range of vertebrates. Here, we review both behavioral and neurophysiological data and propose that the Lombard effect is driven by a subcortical neural network, which can be modulated by cortical processes. The proposed framework offers mechanistic explanations for two fundamental features of the Lombard effect: its widespread taxonomic distribution across the vertebrate phylogenetic tree and the widely observed variations in compensation magnitude. We highlight the Lombard effect as a model behavioral paradigm for unraveling some of the neural underpinnings of audiovocal integration.

Auditory and audio-vocal responses of single neurons in the monkey ventral premotor cortex.

Monkey vocalization is a complex behavioral pattern, which is flexibly used in audio-vocal communication. A recently proposed dual neural network model suggests that cognitive control might be involved in this behavior, originating from a frontal cortical network in the prefrontal cortex and mediated via projections from the rostral portion of the ventral premotor cortex (PMvr) and motor cortex to the primary vocal motor network in the brainstem. For the rapid adjustment of vocal output to external acoustic events, strong interconnections between vocal motor and auditory sites are needed, which are present at cortical and subcortical levels. However, the role of the PMvr in audio-vocal integration processes remains unclear. In the present study, single neurons in the PMvr were recorded in rhesus monkeys (Macaca mulatta) while volitionally producing vocalizations in a visual detection task or passively listening to monkey vocalizations. Ten percent of randomly selected neurons in the PMvr modulated their discharge rate in response to acoustic stimulation with species-specific calls. More than four-fifths of these auditory neurons showed an additional modulation of their discharge rates either before and/or during the monkeys' motor production of the vocalization. Based on these audio-vocal interactions, the PMvr might be well positioned to mediate higher order auditory processing with cognitive control of the vocal motor output to the primary vocal motor network. Such audio-vocal integration processes in the premotor cortex might constitute a precursor for the evolution of complex learned audio-vocal integration systems, ultimately giving rise to human speech.