Unpacking the multilingualism continuum: An investigation of language variety co-activation in simultaneous interpreters.

This study examines the phonological co-activation of a task-irrelevant language variety in mono- and bivarietal speakers of German with and without simultaneous interpreting (SI) experience during German comprehension and production. Assuming that language varieties in bivarietal speakers are co-activated analogously to the co-activation observed in bilinguals, the hypothesis was tested in the Visual World paradigm. Bivarietalism and SI experience were expected to affect co-activation, as bivarietalism requires communication-context based language-variety selection, while SI hinges on concurrent comprehension and production in two languages; task type was not expected to affect co-activation as previous evidence suggests the phenomenon occurs during comprehension and production. Sixty-four native speakers of German participated in an eye-tracking study and completed a comprehension and a production task. Half of the participants were trained interpreters and half of each sub-group were also speakers of Swiss German (i.e., bivarietal speakers). For comprehension, a growth-curve analysis of fixation proportions on phonological competitors revealed cross-variety co-activation, corroborating the hypothesis that co-activation in bivarietals' minds bears similar traits to language co-activation in multilingual minds. Conversely, co-activation differences were not attributable to SI experience, but rather to differences in language-variety use. Contrary to expectations, no evidence for phonological competition was found for either same- nor cross-variety competitors in either production task (interpreting- and word-naming variety). While phonological co-activation during production cannot be excluded based on our data, exploring the effects of additional demands involved in a production task hinging on a language-transfer component (oral translation from English to Standard German) merit further exploration in the light of a more nuanced understanding of the complexity of the SI task.

A literacy-related color-specific deficit in rapid automatized naming: Evidence from neurotypical completely illiterate and literate adults.

There is a robust positive relationship between reading skills and the time to name aloud an array of letters, digits, objects, or colors as quickly as possible. A convincing and complete explanation for the direction and locus of this association remains, however, elusive. In this study, we investigated rapid automatized naming (RAN) of everyday objects and basic color patches in neurotypical illiterate and literate adults. Literacy acquisition and education enhanced RAN performance for both conceptual categories but this advantage was much larger for (abstract) colors than everyday objects. This result suggests that (a) literacy/education may be causal for serial rapid naming ability of non-alphanumeric items and (b) differences in the lexical quality of conceptual representations can underlie the reading-related differential RAN performance. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Individual theta-band cortical entrainment to speech in quiet predicts word-in-noise comprehension.

Speech elicits brain activity time-locked to its amplitude envelope. The resulting speech-brain synchrony (SBS) is thought to be crucial to speech parsing and comprehension. It has been shown that higher speech-brain coherence is associated with increased speech intelligibility. However, studies depending on the experimental manipulation of speech stimuli do not allow conclusion about the causality of the observed tracking. Here, we investigate whether individual differences in the intrinsic propensity to track the speech envelope when listening to speech-in-quiet is predictive of individual differences in speech-recognition-in-noise, in an independent task. We evaluated the cerebral tracking of speech in source-localized magnetoencephalography, at timescales corresponding to the phrases, words, syllables and phonemes. We found that individual differences in syllabic tracking in right superior temporal gyrus and in left middle temporal gyrus (MTG) were positively associated with recognition accuracy in an independent words-in-noise task. Furthermore, directed connectivity analysis showed that this relationship is partially mediated by top-down connectivity from premotor cortex-associated with speech processing and active sensing in the auditory domain-to left MTG. Thus, the extent of SBS-even during clear speech-reflects an active mechanism of the speech processing system that may confer resilience to noise.

How Does Literacy Affect Speech Processing? Not by Enhancing Cortical Responses to Speech, But by Promoting Connectivity of Acoustic-Phonetic and Graphomotor Cortices.

Previous research suggests that literacy, specifically learning alphabetic letter-to-phoneme mappings, modifies online speech processing and enhances brain responses, as indexed by the BOLD, to speech in auditory areas associated with phonological processing (Dehaene et al., 2010). However, alphabets are not the only orthographic systems in use in the world, and hundreds of millions of individuals speak languages that are not written using alphabets. In order to make claims that literacy per se has broad and general consequences for brain responses to speech, one must seek confirmatory evidence from nonalphabetic literacy. To this end, we conducted a longitudinal fMRI study in India probing the effect of literacy in Devanagari, an abubgida, on functional connectivity and cerebral responses to speech in 91 variously literate Hindi-speaking male and female human participants. Twenty-two completely illiterate participants underwent 6 months of reading and writing training. Devanagari literacy increases functional connectivity between acoustic-phonetic and graphomotor brain areas, but we find no evidence that literacy changes brain responses to speech, either in cross-sectional or longitudinal analyses. These findings shows that a dramatic reconfiguration of the neurofunctional substrates of online speech processing may not be a universal result of learning to read, and suggest that the influence of writing on speech processing should also be investigated.SIGNIFICANCE STATEMENT It is widely claimed that a consequence of being able to read is enhanced auditory processing of speech, reflected by increased cortical responses in areas associated with phonological processing. Here we find no relationship between literacy and the magnitude of brain response to speech stimuli in individuals who speak Hindi, which is written using a nonalphabetic script, Devanagari, an abugida. We propose that the exact nature of the script under examination must be considered before making sweeping claims about the consequences of literacy for the brain. Further, we find evidence that literacy enhances functional connectivity between auditory processing areas and graphomotor areas, suggesting a mechanism whereby learning to write might influence speech perception.

Speech sound categorization: The contribution of non-auditory and auditory cortical regions.

Which processes in the human brain lead to the categorical perception of speech sounds? Investigation of this question is hampered by the fact that categorical speech perception is normally confounded by acoustic differences in the stimulus. By using ambiguous sounds, however, it is possible to dissociate acoustic from perceptual stimulus representations. Twenty-seven normally hearing individuals took part in an fMRI study in which they were presented with an ambiguous syllable (intermediate between /da/ and /ga/) in one ear and with disambiguating acoustic feature (third formant, F3) in the other ear. Multi-voxel pattern searchlight analysis was used to identify brain areas that consistently differentiated between response patterns associated with different syllable reports. By comparing responses to different stimuli with identical syllable reports and identical stimuli with different syllable reports, we disambiguated whether these regions primarily differentiated the acoustics of the stimuli or the syllable report. We found that BOLD activity patterns in left perisylvian regions (STG, SMG), left inferior frontal regions (vMC, IFG, AI), left supplementary motor cortex (SMA/pre-SMA), and right motor and somatosensory regions (M1/S1) represent listeners' syllable report irrespective of stimulus acoustics. Most of these regions are outside of what is traditionally regarded as auditory or phonological processing areas. Our results indicate that the process of speech sound categorization implicates decision-making mechanisms and auditory-motor transformations.

The Predictive Value of Individual Electric Field Modeling for Transcranial Alternating Current Stimulation Induced Brain Modulation.

There is considerable individual variability in the reported effectiveness of non-invasive brain stimulation. This variability has often been ascribed to differences in the neuroanatomy and resulting differences in the induced electric field inside the brain. In this study, we addressed the question whether individual differences in the induced electric field can predict the neurophysiological and behavioral consequences of gamma band tACS. In a within-subject experiment, bi-hemispheric gamma band tACS and sham stimulation was applied in alternating blocks to the participants' superior temporal lobe, while task-evoked auditory brain activity was measured with concurrent functional magnetic resonance imaging (fMRI) and a dichotic listening task. Gamma tACS was applied with different interhemispheric phase lags. In a recent study, we could show that anti-phase tACS (180° interhemispheric phase lag), but not in-phase tACS (0° interhemispheric phase lag), selectively modulates interhemispheric brain connectivity. Using a T1 structural image of each participant's brain, an individual simulation of the induced electric field was computed. From these simulations, we derived two predictor variables: maximal strength (average of the 10,000 voxels with largest electric field values) and precision of the electric field (spatial correlation between the electric field and the task evoked brain activity during sham stimulation). We found considerable variability in the individual strength and precision of the electric fields. Importantly, the strength of the electric field over the right hemisphere predicted individual differences of tACS induced brain connectivity changes. Moreover, we found in both hemispheres a statistical trend for the effect of electric field strength on tACS induced BOLD signal changes. In contrast, the precision of the electric field did not predict any neurophysiological measure. Further, neither strength, nor precision predicted interhemispheric integration. In conclusion, we found evidence for the dose-response relationship between individual differences in electric fields and tACS induced activity and connectivity changes in concurrent fMRI. However, the fact that this relationship was stronger in the right hemisphere suggests that the relationship between the electric field parameters, neurophysiology, and behavior may be more complex for bi-hemispheric tACS.

Global and localized network characteristics of the resting brain predict and adapt to foreign language learning in older adults.

Resting brain (rs) activity has been shown to be a reliable predictor of the level of foreign language (L2) proficiency younger adults can achieve in a given time-period. Since rs properties change over the lifespan, we investigated whether L2 attainment in older adults (aged 64-74 years) is also predicted by individual differences in rs activity, and to what extent rs activity itself changes as a function of L2 proficiency. To assess how neuronal assemblies communicate at specific frequencies to facilitate L2 development, we examined localized and global measures (Minimum Spanning Trees) of connectivity. Results showed that central organization within the beta band (~ 13-29.5 Hz) predicted measures of L2 complexity, fluency and accuracy, with the latter additionally predicted by a left-lateralized centro-parietal beta network. In contrast, reduced connectivity in a right-lateralized alpha (~ 7.5-12.5 Hz) network predicted development of L2 complexity. As accuracy improved, so did central organization in beta, whereas fluency improvements were reflected in localized changes within an interhemispheric beta network. Our findings highlight the importance of global and localized network efficiency and the role of beta oscillations for L2 learning and suggest plasticity even in the ageing brain. We interpret the findings against the background of networks identified in socio-cognitive processes.

Speech segmentation: New dogs, old tricks?

A new study using electroencephalography and functional magnetic resonance imaging suggests that dogs and humans may segment speech in similar ways.

Linguistic labels cue biological motion perception and misperception.

Linguistic labels exert a particularly strong top-down influence on perception. The potency of this influence has been ascribed to their ability to evoke category-diagnostic features of concepts. In doing this, they facilitate the formation of a perceptual template concordant with those features, effectively biasing perceptual activation towards the labelled category. In this study, we employ a cueing paradigm with moving, point-light stimuli across three experiments, in order to examine how the number of biological motion features (form and kinematics) encoded in lexical cues modulates the efficacy of lexical top-down influence on perception. We find that the magnitude of lexical influence on biological motion perception rises as a function of the number of biological motion-relevant features carried by both cue and target. When lexical cues encode multiple biological motion features, this influence is robust enough to mislead participants into reporting erroneous percepts, even when a masking level yielding high performance is used.

Selective modulation of interhemispheric connectivity by transcranial alternating current stimulation influences binaural integration.

Brain connectivity plays a major role in the encoding, transfer, and integration of sensory information. Interregional synchronization of neural oscillations in the γ-frequency band has been suggested as a key mechanism underlying perceptual integration. In a recent study, we found evidence for this hypothesis showing that the modulation of interhemispheric oscillatory synchrony by means of bihemispheric high-density transcranial alternating current stimulation (HD-TACS) affects binaural integration of dichotic acoustic features. Here, we aimed to establish a direct link between oscillatory synchrony, effective brain connectivity, and binaural integration. We experimentally manipulated oscillatory synchrony (using bihemispheric γ-TACS with different interhemispheric phase lags) and assessed the effect on effective brain connectivity and binaural integration (as measured with functional MRI and a dichotic listening task, respectively). We found that TACS reduced intrahemispheric connectivity within the auditory cortices and antiphase (interhemispheric phase lag 180°) TACS modulated connectivity between the two auditory cortices. Importantly, the changes in intra- and interhemispheric connectivity induced by TACS were correlated with changes in perceptual integration. Our results indicate that γ-band synchronization between the two auditory cortices plays a functional role in binaural integration, supporting the proposed role of interregional oscillatory synchrony in perceptual integration.

Perceptual Learning of Vocoded Speech With and Without Contralateral Hearing: Implications for Cochlear Implant Rehabilitation.

Purpose An increasing number of individuals with residual or even normal contralateral hearing are being considered for cochlear implantation. It remains unknown whether the presence of contralateral hearing is beneficial or detrimental to their perceptual learning of cochlear implant (CI)-processed speech. The aim of this experiment was to provide a first insight into this question using acoustic simulations of CI processing. Method Sixty normal-hearing listeners took part in an auditory perceptual learning experiment. Each subject was randomly assigned to one of three groups of 20 referred to as NORMAL, LOWPASS, and NOTHING. The experiment consisted of two test phases separated by a training phase. In the test phases, all subjects were tested on recognition of monosyllabic words passed through a six-channel "PSHC" vocoder presented to a single ear. In the training phase, which consisted of listening to a 25-min audio book, all subjects were also presented with the same vocoded speech in one ear but the signal they received in their other ear differed across groups. The NORMAL group was presented with the unprocessed speech signal, the LOWPASS group with a low-pass filtered version of the speech signal, and the NOTHING group with no sound at all. Results The improvement in speech scores following training was significantly smaller for the NORMAL than for the LOWPASS and NOTHING groups. Conclusions This study suggests that the presentation of normal speech in the contralateral ear reduces or slows down perceptual learning of vocoded speech but that an unintelligible low-pass filtered contralateral signal does not have this effect. Potential implications for the rehabilitation of CI patients with partial or full contralateral hearing are discussed.

Resolving the Connectome, Spectrally-Specific Functional Connectivity Networks and Their Distinct Contributions to Behavior.

The resting human brain exhibits spontaneous patterns of activity that reflect features of the underlying neural substrate. Examination of interareal coupling of resting-state oscillatory activity has revealed that the brain's resting activity is composed of functional networks, whose topographies differ depending on oscillatory frequency, suggesting a role for carrier frequency as a means of creating multiplexed, or functionally segregated, communication channels between brain areas. Using canonical correlation analysis (CCA), we examined spectrally resolved resting-state connectivity patterns derived from magnetoencephalography (MEG) recordings to determine the relationship between connectivity intrinsic to different frequency channels and a battery of over a hundred behavioral and demographic indicators, in a group of 89 young healthy participants. We demonstrate that each of the classical frequency bands in the range 1-40 Hz (δ, θ, α, ß, and γ) delineates a subnetwork that is behaviorally relevant, spatially distinct, and whose expression is either negatively or positively predictive of individual traits, with the strongest link in the α-band being negative and networks oscillating at different frequencies, such as θ, ß, and γ carrying positive function.

The noise-resilient brain: Resting-state oscillatory activity predicts words-in-noise recognition.

The role of neuronal oscillations in the processing of speech has recently come to prominence. Since resting-state (RS) brain activity has been shown to predict both task-related brain activation and behavioural performance, we set out to establish whether inter-individual differences in spectrally-resolved RS-MEG power are associated with variations in words-in-noise recognition in a sample of 88 participants made available by the Human Connectome Project. Positive associations with resilience to noise were observed with power in the range 21 and 29 Hz in a number of areas along the left temporal gyrus and temporo-parietal association areas peaking in left posterior superior temporal gyrus (pSTG). Significant associations were also found in the right posterior superior temporal gyrus in the frequency range 30-40 Hz. We propose that individual differences in words-in-noise performance are related to baseline excitability levels of the neural substrates of phonological processing.

Bilateral Gamma/Delta Transcranial Alternating Current Stimulation Affects Interhemispheric Speech Sound Integration.

Perceiving speech requires the integration of different speech cues, that is, formants. When the speech signal is split so that different cues are presented to the right and left ear (dichotic listening), comprehension requires the integration of binaural information. Based on prior electrophysiological evidence, we hypothesized that the integration of dichotically presented speech cues is enabled by interhemispheric phase synchronization between primary and secondary auditory cortex in the gamma frequency band. We tested this hypothesis by applying transcranial alternating current stimulation (TACS) bilaterally above the superior temporal lobe to induce or disrupt interhemispheric gamma-phase coupling. In contrast to initial predictions, we found that gamma TACS applied in-phase above the two hemispheres (interhemispheric lag 0°) perturbs interhemispheric integration of speech cues, possibly because the applied stimulation perturbs an inherent phase lag between the left and right auditory cortex. We also observed this disruptive effect when applying antiphasic delta TACS (interhemispheric lag 180°). We conclude that interhemispheric phase coupling plays a functional role in interhemispheric speech integration. The direction of this effect may depend on the stimulation frequency.

Learning to read recycles visual cortical networks without destruction.

Learning to read is associated with the appearance of an orthographically sensitive brain region known as the visual word form area. It has been claimed that development of this area proceeds by impinging upon territory otherwise available for the processing of culturally relevant stimuli such as faces and houses. In a large-scale functional magnetic resonance imaging study of a group of individuals of varying degrees of literacy (from completely illiterate to highly literate), we examined cortical responses to orthographic and nonorthographic visual stimuli. We found that literacy enhances responses to other visual input in early visual areas and enhances representational similarity between text and faces, without reducing the extent of response to nonorthographic input. Thus, acquisition of literacy in childhood recycles existing object representation mechanisms but without destructive competition.

Publisher Correction: Cortical encoding of speech enhances task-relevant acoustic information.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.The original and corrected figures are shown in the accompanying Publisher Correction.

Cortical encoding of speech enhances task-relevant acoustic information.

Speech is the most important signal in our auditory environment, and the processing of speech is highly dependent on context. However, it is unknown how contextual demands influence the neural encoding of speech. Here, we examine the context dependence of auditory cortical mechanisms for speech encoding at the level of the representation of fundamental acoustic features (spectrotemporal modulations) using model-based functional magnetic resonance imaging. We found that the performance of different tasks on identical speech sounds leads to neural enhancement of the acoustic features in the stimuli that are critically relevant to task performance. These task effects were observed at the earliest stages of auditory cortical processing, in line with interactive accounts of speech processing. Our work provides important insights into the mechanisms that underlie the processing of contextually relevant acoustic information within our rich and dynamic auditory environment.

Affective blindsight relies on low spatial frequencies.

The human brain can process facial expressions of emotions rapidly and without awareness. Several studies in patients with damage to their primary visual cortices have shown that they may be able to guess the emotional expression on a face despite their cortical blindness. This non-conscious processing, called affective blindsight, may arise through an intact subcortical visual route that leads from the superior colliculus to the pulvinar, and thence to the amygdala. This pathway is thought to process the crude visual information conveyed by the low spatial frequencies of the stimuli. In order to investigate whether this is the case, we studied a patient (TN) with bilateral cortical blindness and affective blindsight. An fMRI paradigm was performed in which fearful and neutral expressions were presented using faces that were either unfiltered, or filtered to remove high or low spatial frequencies. Unfiltered fearful faces produced right amygdala activation although the patient was unaware of the presence of the stimuli. More importantly, the low spatial frequency components of fearful faces continued to produce right amygdala activity while the high spatial frequency components did not. Our findings thus confirm that the visual information present in the low spatial frequencies is sufficient to produce affective blindsight, further suggesting that its existence could rely on the subcortical colliculo-pulvino-amygdalar pathway.

Beyond bilingualism: multilingual experience correlates with caudate volume.

The multilingual brain implements mechanisms that serve to select the appropriate language as a function of the communicative environment. Engaging these mechanisms on a regular basis appears to have consequences for brain structure and function. Studies have implicated the caudate nuclei as important nodes in polyglot language control processes, and have also shown structural differences in the caudate nuclei in bilingual compared to monolingual populations. However, the majority of published work has focused on the categorical differences between monolingual and bilingual individuals, and little is known about whether these findings extend to multilingual individuals, who have even greater language control demands. In the present paper, we present an analysis of the volume and morphology of the caudate nuclei, putamen, pallidum and thalami in 75 multilingual individuals who speak three or more languages. Volumetric analyses revealed a significant relationship between multilingual experience and right caudate volume, as well as a marginally significant relationship with left caudate volume. Vertex-wise analyses revealed a significant enlargement of dorsal and anterior portions of the left caudate nucleus, known to have connectivity with executive brain regions, as a function of multilingual expertise. These results suggest that multilingual expertise might exercise a continuous impact on brain structure, and that as additional languages beyond a second are acquired, the additional demands for linguistic and cognitive control result in modifications to brain structures associated with language management processes.