Prediction of Second Language Proficiency Based on Electroencephalographic Signals Measured While Listening to Natural Speech.

This study had two goals: to clarify the relationship between electroencephalographic (EEG) features estimated while non-native speakers listened to a second language (L2) and their proficiency in L2 determined by a conventional paper test and to provide a predictive model for L2 proficiency based on EEG features. We measured EEG signals from 205 native Japanese speakers, who varied widely in English proficiency while they listened to natural speech in English. Following the EEG measurement, they completed a conventional English listening test for Japanese speakers. We estimated multivariate temporal response functions separately for word class, speech rate, word position, and parts of speech. We found significant negative correlations between listening score and 17 EEG features, which included peak latency of early components (corresponding to N1 and P2) for both open and closed class words and peak latency and amplitude of a late component (corresponding to N400) for open class words. On the basis of the EEG features, we generated a predictive model for Japanese speakers' English listening proficiency. The correlation coefficient between the true and predicted listening scores was 0.51. Our results suggest that L2 or foreign language ability can be assessed using neural signatures measured while listening to natural speech, without the need of a conventional paper test.

Effects of sex and proficiency in second language processing as revealed by a large-scale fNIRS study of school-aged children.

Previous neuroimaging studies in adults have revealed that first and second languages (L1/L2) share similar neural substrates, and that proficiency is a major determinant of the neural organization of L2 in the lexical-semantic and syntactic domains. However, little is known about neural substrates of children in the phonological domain, or about sex differences. Here, we conducted a large-scale study (n = 484) of school-aged children using functional near-infrared spectroscopy and a word repetition task, which requires a great extent of phonological processing. We investigated cortical activation during word processing, emphasizing sex differences, to clarify similarities and differences between L1 and L2, and proficiency-related differences during early L2 learning. L1 and L2 shared similar neural substrates with decreased activation in L2 compared to L1 in the posterior superior/middle temporal and angular/supramarginal gyri for both sexes. Significant sex differences were found in cortical activation within language areas during high-frequency word but not during low-frequency word processing. During high-frequency word processing, widely distributed areas including the angular/supramarginal gyri were activated in boys, while more restricted areas, excluding the angular/supramarginal gyri were activated in girls. Significant sex differences were also found in L2 proficiency-related activation: activation significantly increased with proficiency in boys, whereas no proficiency-related differences were found in girls. Importantly, cortical sex differences emerged with proficiency. Based on previous research, the present results indicate that sex differences are acquired or enlarged during language development through different cognitive strategies between sexes, possibly reflecting their different memory functions.

The integration hypothesis of human language evolution and the nature of contemporary languages.

How human language arose is a mystery in the evolution of Homo sapiens. Miyagawa et al. (2013) put forward a proposal, which we will call the Integration Hypothesis of human language evolution, that holds that human language is composed of two components, E for expressive, and L for lexical. Each component has an antecedent in nature: E as found, for example, in birdsong, and L in, for example, the alarm calls of monkeys. E and L integrated uniquely in humans to give rise to language. A challenge to the Integration Hypothesis is that while these non-human systems are finite-state in nature, human language is known to require characterization by a non-finite state grammar. Our claim is that E and L, taken separately, are in fact finite-state; when a grammatical process crosses the boundary between E and L, it gives rise to the non-finite state character of human language. We provide empirical evidence for the Integration Hypothesis by showing that certain processes found in contemporary languages that have been characterized as non-finite state in nature can in fact be shown to be finite-state. We also speculate on how human language actually arose in evolution through the lens of the Integration Hypothesis.

An event-related potential investigation of lexical pitch-accent processing in auditory Japanese.

Lexical prosody plays an important role in speech comprehension. However, the electrophysiological nature and time course of processing lexical prosody in mora-timed languages are rarely known in contrast to the wealth of knowledge in stress-timed languages and syllable-timed languages like German and French. In the present study, lexical pitch-accent processing in Japanese is investigated using event-related potentials. Participants listened to sentences with verbs either correct or incorrect with respect to pitch-accent (phonological condition), word meaning (semantic condition) or sentence type (syntactic condition). When the brain potentials of correct and incorrect sentences were compared within conditions, the phonological and semantic conditions showed a negativity and positivity (P600), while the syntactic condition displayed a P600. Furthermore, the negativity in response to pitch-accent violations (pitch-accent negativity) appeared approximately 60ms earlier than the response to semantic violations (N400), while no significant topographical distributions were found between the two components. These results suggest that the pitch-accent negativity reflects initial phonological processing followed by lexical access and word recognition. Moreover, the P600 displayed in all conditions was interpreted as a general integration process that is common across the three domains.

Sound to language: different cortical processing for first and second languages in elementary school children as revealed by a large-scale study using fNIRS.

A large-scale study of 484 elementary school children (6-10 years) performing word repetition tasks in their native language (L1-Japanese) and a second language (L2-English) was conducted using functional near-infrared spectroscopy. Three factors presumably associated with cortical activation, language (L1/L2), word frequency (high/low), and hemisphere (left/right), were investigated. L1 words elicited significantly greater brain activation than L2 words, regardless of semantic knowledge, particularly in the superior/middle temporal and inferior parietal regions (angular/supramarginal gyri). The greater L1-elicited activation in these regions suggests that they are phonological loci, reflecting processes tuned to the phonology of the native language, while phonologically unfamiliar L2 words were processed like nonword auditory stimuli. The activation was bilateral in the auditory and superior/middle temporal regions. Hemispheric asymmetry was observed in the inferior frontal region (right dominant), and in the inferior parietal region with interactions: low-frequency words elicited more right-hemispheric activation (particularly in the supramarginal gyrus), while high-frequency words elicited more left-hemispheric activation (particularly in the angular gyrus). The present results reveal the strong involvement of a bilateral language network in children's brains depending more on right-hemispheric processing while acquiring unfamiliar/low-frequency words. A right-to-left shift in laterality should occur in the inferior parietal region, as lexical knowledge increases irrespective of language.

Age and amount of exposure to a foreign language during childhood: behavioral and ERP data on the semantic comprehension of spoken English by Japanese children.

Children's foreign-language (FL) learning is a matter of much social as well as scientific debate. Previous behavioral research indicates that starting language learning late in life can lead to problems in phonological processing. Inadequate phonological capacity may impede lexical learning and semantic processing (phonological bottleneck hypothesis). Using both behavioral and neuroimaging data, here we examine the effects of age of first exposure (AOFE) and total hours of exposure (HOE) to English, on 350 Japanese primary-school children's semantic processing of spoken English. Children's English proficiency scores and N400 event-related brain potentials (ERPs) were analyzed in multiple regression analyses. The results showed (1) that later, rather than earlier, AOFE led to higher English proficiency and larger N400 amplitudes, when HOE was controlled for; and (2) that longer HOE led to higher English proficiency and larger N400 amplitudes, whether AOFE was controlled for or not. These data highlight the important role of amount of exposure in FL learning, and cast doubt on the view that starting FL learning earlier always produces better results.

The acceleration of spoken-word processing in children's native-language acquisition: an ERP cohort study.

Healthy adults can identify spoken words at a remarkable speed, by incrementally analyzing word-onset information. It is currently unknown how this adult-level speed of spoken-word processing emerges during children's native-language acquisition. In a picture-word mismatch paradigm, we manipulated the semantic congruency between picture contexts and spoken words, and recorded event-related potential (ERP) responses to the words. Previous similar studies focused on the N400 response, but we focused instead on the onsets of semantic congruency effects (N200 or Phonological Mismatch Negativity), which contain critical information for incremental spoken-word processing. We analyzed ERPs obtained longitudinally from two age cohorts of 40 primary-school children (total n=80) in a 3-year period. Children first tested at 7 years of age showed earlier onsets of congruency effects (by approximately 70ms) when tested 2 years later (i.e., at age 9). Children first tested at 9 years of age did not show such shortening of onset latencies 2 years later (i.e., at age 11). Overall, children's onset latencies at age 9 appeared similar to those of adults. These data challenge the previous hypothesis that word processing is well established at age 7. Instead they support the view that the acceleration of spoken-word processing continues beyond age 7.

Neural correlates of foreign-language learning in childhood: a 3-year longitudinal ERP study.

A foreign language (a language not spoken in one's community) is difficult to master completely. Early introduction of foreign-language (FL) education during childhood is becoming a standard in many countries. However, the neural process of child FL learning still remains largely unknown. We longitudinally followed 322 school-age children with diverse FL proficiency for three consecutive years, and acquired children's ERP responses to FL words that were semantically congruous or incongruous with the preceding picture context. As FL proficiency increased, various ERP components previously reported in mother-tongue (L1) acquisition (such as a broad negativity, an N400, and a late positive component) appeared sequentially, critically in an identical order to L1 acquisition. This finding was supported not only by cross-sectional analyses of children at different proficiency levels but also by longitudinal analyses of the same children over time. Our data are consistent with the hypothesis that FL learning in childhood reproduces identical developmental stages in an identical order to L1 acquisition, suggesting that the nature of the child's brain itself may determine the normal course of FL learning. Future research should test the generalizability of the results in other aspects of language such as syntax.

An ERP study of second language learning after childhood: effects of proficiency.

Whether there is an absolute critical period for acquiring language is a matter of continuous debate. One approach to address this issue is to compare the processes of second language (L2) learning after childhood and those of first language (L1) learning during childhood. To study the cortical process of postchildhood L2 learning, we compared event-related brain potentials recorded from two groups of adult Japanese speakers who attained either high or intermediate proficiency in English after childhood (J-High and J-Low), and adult native English speakers (ENG). Semantic anomalies embedded in English sentences evoked a clear N400 component in all three groups, with only the time course of the brain activation varying among the groups. Syntactic violations elicited a left-lateralized negativity similar to the left anterior negativity in ENG and J-High, but not in J-Low. In ENG, a P600 component was additionally found. These results suggest that semantic processing is robust from early on in L2 learning, whereas the development of syntactic processing is more dependent on proficiency as evidenced by the lack of the left-lateralized negativity in J-Low. Because early maturation and stability of semantic processing as opposed to syntactic processing are also a feature of L1 processing, postchildhood L2 learning may be governed by the same brain properties as those which govern childhood L1 learning. We argue that these processes are qualitatively similar in many respects, with only restricted domains of language processing being subject to absolute critical period effects.

Cognitive processes in two-point discrimination: an ERP study.

OBJECTIVE: To elucidate the temporal features of the cognitive process in two-point discrimination (TPD). METHODS: We measured somatosensory event-related potentials (ERPs) in 9 subjects during the TPD task, in which we provided a pair of electrical pulses simultaneously, altering the distance between the electrodes. We analyzed the TPD-related ERPs and investigated the relationship between the potentials and the subjects' judgments. RESULTS: During the TPD task, a negative potential approximately 140 ms after the stimulation (N140) was enhanced as compared to a stimulus counting task. Two late positive components, LPC-1 and LPC-2, whose peak latencies were 300 and 500 ms, respectively, were identified only in the TPD task. The LPC-1 was recorded dominantly in the fronto-central area, while the LPC-2 was detected dominantly in the centro-parietal area. The amplitude of the LPC-2 was significantly modulated by the degree of consistency in the subjects' judgment. On the other hand, these ERP components did not show significant difference between the alternate judgments, i.e. 'one-point' or 'two-point' judgment. CONCLUSIONS: Our results suggest that the N140 is related to the attention toward the stimulation. The LPC-1 and LPC-2 are likely to correspond to the processes represented by P3a and P3b, based on their temporal and spatial behavior.

Pain processing within the primary somatosensory cortex in humans.

To investigate the processing of noxious stimuli within the primary somatosensory cortex (SI), we recorded magnetoencephalography following noxious epidermal electrical stimulation (ES) and innocuous transcutaneous electrical stimulation (TS) applied to the dorsum of the left hand. TS activated two sources sequentially within SI: one in the posterior bank of the central sulcus and another in the crown of the postcentral gyrus, corresponding to Brodmann's areas 3b and 1, respectively. Activities from area 3b consisted of 20- and 30-ms responses. Activities from area 1 consisted of three components peaking at 26, 36 and 49 ms. ES activated one source within SI whose location and orientation were similar to those of the TS-activated area 1 source. Activities from this source consisted of three components peaking at 88, 98 and 109 ms, later by 60 ms than the corresponding TS responses. ES and TS subsequently activated a similar region in the upper bank of the sylvian fissure, corresponding to the secondary somatosensory cortex (SII). The onset latency of the SII activity following ES (109 ms) was later by 29 ms than that of the first SI response (80 ms). Likewise, the onset latency of SII activity following TS (52 ms) was later by 35 ms than that of area 1 of SI (17 ms). Therefore, our results showed that the processing of noxious and innocuous stimuli is similar with respect to the source locations and activation timings within SI and SII except that there were no detectable activations within area 3b following noxious stimulation.