A behavioural exploration of language aptitude and experience, cognition and more using Graph Analysis.

Language aptitude has recently regained interest in cognitive neuroscience. Traditional language aptitude testing included phonemic coding ability, associative memory, grammatical sensitivity and inductive language learning. Moreover, domain-general cognitive abilities are associated with individual differences in language aptitude, together with factors that have yet to be elucidated. Beyond domain-general cognition, it is also likely that aptitude and experience in domain-specific but non-linguistic fields (e.g. music or numerical processing) influence and are influenced by language aptitude. We investigated some of these relationships in a sample of 152 participants, using exploratory graph analysis, across different levels of regularisation, i.e. sensitivity. We carried out a meta cluster analysis in a second step to identify variables that are robustly grouped together. We discuss the data, as well as their meta-network groupings, at a baseline network sensitivity level, and in two analyses, one including and the other excluding dyslexic readers. Our results show a stable association between language and cognition, and the isolation of multilingual language experience, musicality and literacy. We highlight the necessity of a more comprehensive view of language and of cognition as multivariate systems.

Speech prosody enhances the neural processing of syntax.

Human language relies on the correct processing of syntactic information, as it is essential for successful communication between speakers. As an abstract level of language, syntax has often been studied separately from the physical form of the speech signal, thus often masking the interactions that can promote better syntactic processing in the human brain. However, behavioral and neural evidence from adults suggests the idea that prosody and syntax interact, and studies in infants support the notion that prosody assists language learning. Here we analyze a MEG dataset to investigate how acoustic cues, specifically prosody, interact with syntactic representations in the brains of native English speakers. More specifically, to examine whether prosody enhances the cortical encoding of syntactic representations, we decode syntactic phrase boundaries directly from brain activity, and evaluate possible modulations of this decoding by the prosodic boundaries. Our findings demonstrate that the presence of prosodic boundaries improves the neural representation of phrase boundaries, indicating the facilitative role of prosodic cues in processing abstract linguistic features. This work has implications for interactive models of how the brain processes different linguistic features. Future research is needed to establish the neural underpinnings of prosody-syntax interactions in languages with different typological characteristics.

Multivariate Concavity Amplitude Index (MCAI) for characterizing Heschl's gyrus shape.

Heschl's gyrus (HG), which includes primary auditory cortex, is highly variable in its shape (i.e. gyrification patterns), between hemispheres and across individuals. Differences in HG shape have been observed in the context of phonetic learning skill and expertise, and of professional musicianship, among others. Two of the most common configurations of HG include single HG, where a single transverse temporal gyrus is present, and common stem duplications (CSD), where a sulcus intermedius (SI) arises from the lateral aspect of HG. Here we describe a new toolbox, called 'Multivariate Concavity Amplitude Index' (MCAI), which automatically assesses the shape of HG. MCAI works on the output of TASH, our first toolbox which automatically segments HG, and computes continuous indices of concavity, which arise when sulci are present, along the outer perimeter of an inflated representation of HG, in a directional manner. Thus, MCAI provides a multivariate measure of shape, which is reproducible and sensitive to small variations in shape. We applied MCAI to structural magnetic resonance imaging (MRI) data of N=181 participants, including professional and amateur musicians and from non-musicians. Former studies have shown large variations in HG shape in the former groups. We validated MCAI by showing high correlations between the dominant (i.e. highest) lateral concavity values and continuous visual assessments of the degree of lateral gyrification of the first gyrus. As an application of MCAI, we also replicated previous visually obtained findings showing a higher likelihood of bilateral CSDs in musicians. MCAI opens a wide range of applications in evaluating HG shape in the context of individual differences, expertise, disorder and genetics.

Thalamic volume and functional connectivity are associated with nicotine dependence severity and craving.

Tobacco smoking is associated with deleterious health outcomes. Most smokers want to quit smoking, yet relapse rates are high. Understanding neural differences associated with tobacco use may help generate novel treatment options. Several animal studies have recently highlighted the central role of the thalamus in substance use disorders, but this research focus has been understudied in human smokers. Here, we investigated associations between structural and functional magnetic resonance imaging measures of the thalamus and its subnuclei to distinct smoking characteristics. We acquired anatomical scans of 32 smokers as well as functional resting-state scans before and after a cue-reactivity task. Thalamic functional connectivity was associated with craving and dependence severity, whereas the volume of the thalamus was associated with dependence severity only. Craving, which fluctuates rapidly, was best characterized by differences in brain function, whereas the rather persistent syndrome of dependence severity was associated with both brain structural differences and function. Our study supports the notion that functional versus structural measures tend to be associated with behavioural measures that evolve at faster versus slower temporal scales, respectively. It confirms the importance of the thalamus to understand mechanisms of addiction and highlights it as a potential target for brain-based interventions to support smoking cessation, such as brain stimulation and neurofeedback.

A Discriminative Characterization of Heschl's Gyrus Morphology using Spectral Graph Features.

Heschl's Gyrus (HG), which hosts the primary auditory cortex, exhibits large variability not only in size but also in its gyrification patterns, within (i.e., between hemispheres) and between individuals. Conventional structural measures such as volume, surface area and thickness do not capture the full morphological complexity of HG, in particular, with regards to its shape. We present a method for characterizing the morphology of HG in terms of Laplacian eigenmodes of surface-based and volume-based graph representations of its structure, and derive a set of spectral graph features that can be used to discriminate HG subtypes. We applied this method to a dataset of 177 adults previously shown to display considerable variability in the shape of their HG, including data from amateur and professional musicians, as well as non-musicians. Results show the superiority of the proposed spectral graph features over conventional ones in differentiating HG subtypes, in particular, single HG versus Common Stem Duplications (CSDs). We anticipate the proposed shape features to be found beneficial in the domains of language, music and associated pathologies, in which variability of HG morphology has previously been established.

TASH: Toolbox for the Automated Segmentation of Heschl's gyrus.

Auditory cortex volume and shape differences have been observed in the context of phonetic learning, musicianship and dyslexia. Heschl's gyrus, which includes primary auditory cortex, displays large anatomical variability across individuals and hemispheres. Given this variability, manual labelling is the gold standard for segmenting HG, but is time consuming and error prone. Our novel toolbox, called 'Toolbox for the Automated Segmentation of HG' or TASH, automatically segments HG in brain structural MRI data, and extracts measures including its volume, surface area and cortical thickness. TASH builds upon FreeSurfer, which provides an initial segmentation of auditory regions, and implements further steps to perform finer auditory cortex delineation. We validate TASH by showing significant relationships between HG volumes obtained using manual labelling and using TASH, in three independent datasets acquired on different scanners and field strengths, and by showing good qualitative segmentation. We also present two applications of TASH, demonstrating replication and extension of previously published findings of relationships between HG volumes and (a) phonetic learning, and (b) musicianship. In sum, TASH effectively segments HG in a fully automated and reproducible manner, opening up a wide range of applications in the domains of expertise, disease, genetics and brain plasticity.

Publisher Correction: Cortical encoding of speech enhances task-relevant acoustic information.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.The original and corrected figures are shown in the accompanying Publisher Correction.

Cortical encoding of speech enhances task-relevant acoustic information.

Speech is the most important signal in our auditory environment, and the processing of speech is highly dependent on context. However, it is unknown how contextual demands influence the neural encoding of speech. Here, we examine the context dependence of auditory cortical mechanisms for speech encoding at the level of the representation of fundamental acoustic features (spectrotemporal modulations) using model-based functional magnetic resonance imaging. We found that the performance of different tasks on identical speech sounds leads to neural enhancement of the acoustic features in the stimuli that are critically relevant to task performance. These task effects were observed at the earliest stages of auditory cortical processing, in line with interactive accounts of speech processing. Our work provides important insights into the mechanisms that underlie the processing of contextually relevant acoustic information within our rich and dynamic auditory environment.

Morpho-syntactic complexity modulates brain activation in Persian-English bilinguals: An fMRI study.

The Persian language can be considered to have a relatively more complex and combinatorial morpho-syntax than languages like Chinese and English. For example, the Persian verbal system is largely constituted of light verb constructions, in which light verbs are combined with specific items coming from other grammatical classes to generate entirely new verbal entities. This study was designed to examine the mediating effect of language-inherent properties related to morpho-syntax on activation of the left inferior frontal gyrus (LIFG), a brain area involved in morpho-syntactic processing. To this end, 20 late Persian-English bilinguals were required to covertly generate verbs and nouns from object and action pictures, within a cued grammatical context. Consistent with predictions, the results of an ROI analysis revealed an interaction between task and language in BA 44 of the LIFG and its right homologue, with greater activation of this region during the production of Persian compared to English verbs. In contrast, there was greater activation of the BA 44 during the production of English compared to Persian nouns, consistent with the more effortful processing of their less proficient second language (English). The findings suggest that language-specific properties such as morpho-syntactic complexity can modulate the recruitment of Broca's area, over and above the more well-documented effects of language proficiency.

Beyond bilingualism: multilingual experience correlates with caudate volume.

The multilingual brain implements mechanisms that serve to select the appropriate language as a function of the communicative environment. Engaging these mechanisms on a regular basis appears to have consequences for brain structure and function. Studies have implicated the caudate nuclei as important nodes in polyglot language control processes, and have also shown structural differences in the caudate nuclei in bilingual compared to monolingual populations. However, the majority of published work has focused on the categorical differences between monolingual and bilingual individuals, and little is known about whether these findings extend to multilingual individuals, who have even greater language control demands. In the present paper, we present an analysis of the volume and morphology of the caudate nuclei, putamen, pallidum and thalami in 75 multilingual individuals who speak three or more languages. Volumetric analyses revealed a significant relationship between multilingual experience and right caudate volume, as well as a marginally significant relationship with left caudate volume. Vertex-wise analyses revealed a significant enlargement of dorsal and anterior portions of the left caudate nucleus, known to have connectivity with executive brain regions, as a function of multilingual expertise. These results suggest that multilingual expertise might exercise a continuous impact on brain structure, and that as additional languages beyond a second are acquired, the additional demands for linguistic and cognitive control result in modifications to brain structures associated with language management processes.

Cortical thickness increases after simultaneous interpretation training.

Simultaneous interpretation is a complex cognitive task that not only demands multilingual language processing, but also requires application of extreme levels of domain-general cognitive control. We used MRI to longitudinally measure cortical thickness in simultaneous interpretation trainees before and after a Master's program in conference interpreting. We compared them to multilingual control participants scanned at the same interval of time. Increases in cortical thickness were specific to trainee interpreters. Increases were observed in regions involved in lower-level, phonetic processing (left posterior superior temporal gyrus, anterior supramarginal gyrus and planum temporale), in the higher-level formulation of propositional speech (right angular gyrus) and in the conversion of items from working memory into a sequence (right dorsal premotor cortex), and finally, in domain-general executive control and attention (right parietal lobule). Findings are consistent with the linguistic requirements of simultaneous interpretation and also with the more general cognitive demands on attentional control for expert performance in simultaneous interpreting. Our findings may also reflect beneficial, potentially protective effects of simultaneous interpretation training, which has previously been shown to confer enhanced skills in certain executive and attentional domains over and above those conferred by bilingualism.

Plasticity of white matter connectivity in phonetics experts.

Phonetics experts are highly trained to analyze and transcribe speech, both with respect to faster changing, phonetic features, and to more slowly changing, prosodic features. Previously we reported that, compared to non-phoneticians, phoneticians had greater local brain volume in bilateral auditory cortices and the left pars opercularis of Broca's area, with training-related differences in the grey-matter volume of the left pars opercularis in the phoneticians group (Golestani et al. 2011). In the present study, we used diffusion MRI to examine white matter microstructure, indexed by fractional anisotropy, in (1) the long segment of arcuate fasciculus (AF_long), which is a well-known language tract that connects Broca's area, including left pars opercularis, to the temporal cortex, and in (2) the fibers arising from the auditory cortices. Most of these auditory fibers belong to three validated language tracts, namely to the AF_long, the posterior segment of the arcuate fasciculus and the middle longitudinal fasciculus. We found training-related differences in phoneticians in left AF_long, as well as group differences relative to non-experts in the auditory fibers (including the auditory fibers belonging to the left AF_long). Taken together, the results of both studies suggest that grey matter structural plasticity arising from phonetic transcription training in Broca's area is accompanied by changes to the white matter fibers connecting this very region to the temporal cortex. Our findings suggest expertise-related changes in white matter fibers connecting fronto-temporal functional hubs that are important for phonetic processing. Further studies can pursue this hypothesis by examining the dynamics of these expertise related grey and white matter changes as they arise during phonetic training.

The effect of phonetic production training with visual feedback on the perception and production of foreign speech sounds.

Second-language learners often experience major difficulties in producing non-native speech sounds. This paper introduces a training method that uses a real-time analysis of the acoustic properties of vowels produced by non-native speakers to provide them with immediate, trial-by-trial visual feedback about their articulation alongside that of the same vowels produced by native speakers. The Mahalanobis acoustic distance between non-native productions and target native acoustic spaces was used to assess L2 production accuracy. The experiment shows that 1 h of training per vowel improves the production of four non-native Danish vowels: the learners' productions were closer to the corresponding Danish target vowels after training. The production performance of a control group remained unchanged. Comparisons of pre- and post-training vowel discrimination performance in the experimental group showed improvements in perception. Correlational analyses of training-related changes in production and perception revealed no relationship. These results suggest, first, that this training method is effective in improving non-native vowel production. Second, training purely on production improves perception. Finally, it appears that improvements in production and perception do not systematically progress at equal rates within individuals.

Brain functional plasticity associated with the emergence of expertise in extreme language control.

We used functional magnetic resonance imaging (fMRI) to longitudinally examine brain plasticity arising from long-term, intensive simultaneous interpretation training. Simultaneous interpretation is a bilingual task with heavy executive control demands. We compared brain responses observed during simultaneous interpretation with those observed during simultaneous speech repetition (shadowing) in a group of trainee simultaneous interpreters, at the beginning and at the end of their professional training program. Age, sex and language-proficiency matched controls were scanned at similar intervals. Using multivariate pattern classification, we found distributed patterns of changes in functional responses from the first to second scan that distinguished the interpreters from the controls. We also found reduced recruitment of the right caudate nucleus during simultaneous interpretation as a result of training. Such practice-related change is consistent with decreased demands on multilingual language control as the task becomes more automatized with practice. These results demonstrate the impact of simultaneous interpretation training on the brain functional response in a cerebral structure that is not specifically linguistic, but that is known to be involved in learning, in motor control, and in a variety of domain-general executive functions. Along with results of recent studies showing functional and structural adaptations in the caudate nuclei of experts in a broad range of domains, our results underline the importance of this structure as a central node in expertise-related networks.

fMRI of Simultaneous Interpretation Reveals the Neural Basis of Extreme Language Control.

We used functional magnetic resonance imaging (fMRI) to examine the neural basis of extreme multilingual language control in a group of 50 multilingual participants. Comparing brain responses arising during simultaneous interpretation (SI) with those arising during simultaneous repetition revealed activation of regions known to be involved in speech perception and production, alongside a network incorporating the caudate nucleus that is known to be implicated in domain-general cognitive control. The similarity between the networks underlying bilingual language control and general executive control supports the notion that the frequently reported bilingual advantage on executive tasks stems from the day-to-day demands of language control in the multilingual brain. We examined neural correlates of the management of simultaneity by correlating brain activity during interpretation with the duration of simultaneous speaking and hearing. This analysis showed significant modulation of the putamen by the duration of simultaneity. Our findings suggest that, during SI, the caudate nucleus is implicated in the overarching selection and control of the lexico-semantic system, while the putamen is implicated in ongoing control of language output. These findings provide the first clear dissociation of specific dorsal striatum structures in polyglot language control, roles that are consistent with previously described involvement of these regions in nonlinguistic executive control.

Connectivity changes underlying neurofeedback training of visual cortex activity.

Neurofeedback based on real-time functional magnetic resonance imaging (fMRI) is a new approach that allows training of voluntary control over regionally specific brain activity. However, the neural basis of successful neurofeedback learning remains poorly understood. Here, we assessed changes in effective brain connectivity associated with neurofeedback training of visual cortex activity. Using dynamic causal modeling (DCM), we found that training participants to increase visual cortex activity was associated with increased effective connectivity between the visual cortex and the superior parietal lobe. Specifically, participants who learned to control activity in their visual cortex showed increased top-down control of the superior parietal lobe over the visual cortex, and at the same time reduced bottom-up processing. These results are consistent with efficient employment of top-down visual attention and imagery, which were the cognitive strategies used by participants to increase their visual cortex activity.

Bilingual speech-in-noise: neural bases of semantic context use in the native language.

Bilingual listeners comprehend speech-in-noise better in their native than non-native language. This native-language benefit is thought to arise from greater use of top-down linguistic information to assist degraded speech comprehension. Using functional magnetic resonance imaging, we recently showed that left angular gyrus activation is modulated when semantic context is used to assist native language speech-in-noise comprehension (Golestani, Hervais-Adelman, Obleser, & Scott, 2013). Here, we extend the previous work, by reanalyzing the previous data alongside the results obtained in the non-native language of the same late bilingual participants. We found a behavioral benefit of semantic context in processing speech-in-noise in the native language only, and the imaging results also revealed a native language context effect in the left angular gyrus. We also find a complementary role of lower-level auditory regions during stimulus-driven processing. Our findings help to elucidate the neural basis of the established native language behavioral benefit of speech-in-noise processing.

Semantic versus perceptual interactions in neural processing of speech-in-noise.

Native listeners make use of higher-level, context-driven semantic and linguistic information during the perception of speech-in-noise. In a recent behavioral study, using a new paradigm that isolated the semantic level of speech by using words, we showed that this native-language benefit is at least partly driven by semantic context (Golestani et al., 2009). Here, we used the same paradigm in a functional magnetic resonance imaging (fMRI) experiment to study the neural bases of speech intelligibility, as well as to study the neural bases of this semantic context effect in the native language. A forced-choice recognition task on the first of two auditorily presented semantically related or unrelated words was employed, where the first, 'target' word was embedded in different noise levels. Results showed that activation in components of the brain language network, including Broca's area and the left posterior superior temporal sulcus, as well as brain regions known to be functionally related to attention and task difficulty, was modulated by stimulus intelligibility. In line with several previous studies examining the role of linguistic context in the intelligibility of degraded speech at the sentence level, we found that activation in the angular gyrus of the left inferior parietal cortex was modulated by the presence of semantic context, and further, that this modulation depended on the intelligibility of the speech stimuli. Our findings help to further elucidate neural mechanisms underlying the interaction of context-driven and signal-driven factors during the perception of degraded speech, and this specifically at the semantic level.

Executive control of language in the bilingual brain: integrating the evidence from neuroimaging to neuropsychology.

In this review we will focus on delineating the neural substrates of the executive control of language in the bilingual brain, based on the existing neuroimaging, intracranial, transcranial magnetic stimulation, and neuropsychological evidence. We will also offer insights from ongoing brain-imaging studies into the development of expertise in multilingual language control. We will concentrate specifically on evidence regarding how the brain selects and controls languages for comprehension and production. This question has been addressed in a number of ways and using various tasks, including language switching during production or perception, translation, and interpretation. We will attempt to synthesize existing evidence in order to bring to light the neural substrates that are crucial to executive control of language.