A dataset of behavioral measures on Chinese word production in picture naming.

Most studies of language production have been conducted with speakers of alphabetic languages, but relatively little research has examined languages with non-alphabetic scripts, such as Chinese. Moreover, most work on language word production has investigated phonological output processing (i.e., speaking), whereas comparatively little research has focused on orthographic output, such as writing and typing. Work on non-alphabetic languages and/or written production is particularly promising, given that it speaks to universalities vs. specificity in terms of architectures and mechanisms underlying language processing across all world languages and modalities. The current article reports a dataset of word production in Chinese with spoken and written responses, which includes reaction times of 193,851 trials of naming 403 pictures obtained from 667 participants across 23 Chinese word production experiments. All data were collected in the same experimental environment and from participants with relatively homogenous characteristics, using the same protocols and parameters. The dataset enables researchers to explore how Chinese speakers produce spoken and/or written words, and to identify language-specific features underlying word production.

Verbal working memory capacity modulates semantic and phonological prediction in spoken comprehension.

Mounting evidence suggests that people may use multiple cues to predict different levels of representation (e.g., semantic, syntactic, and phonological) during language comprehension. One question that has been less investigated is the relationship between general cognitive processing and the efficiency of prediction at various linguistic levels, such as semantic and phonological levels. To address this research gap, the present study investigated how working memory capacity (WMC) modulates different kinds of prediction behavior (i.e., semantic prediction and phonological prediction) in the visual world. Chinese speakers listened to the highly predictable sentences that contained a highly predictable target word, and viewed a visual display of objects. The visual display of objects contained a target object corresponding to the predictable word, a semantic or a phonological competitor that was semantically or phonologically related to the predictable word, and an unrelated object. We conducted a Chinese version of the reading span task to measure verbal WMC and grouped participants into high- and low-span groups. Participants showed semantic and phonological prediction with comparable size in both groups during language comprehension, with earlier semantic prediction in the high-span group, and a similar time course of phonological prediction in both groups. These results suggest that verbal working memory modulates predictive processing in language comprehension.

Predicting phonological information in language comprehension: evidence from ERP representational similarity analysis and Chinese idioms.

Do comprehenders predict the meaning and even the phonological form of upcoming words during language comprehension? With a growing body of evidence suggesting that semantic representations may be predicted, the evidence for phonological prediction is less clear and largely derived from studies conducted in languages utilizing an alphabetic script. In this research, we aim to examine the prediction of phonological information in the processing of Chinese idioms through the use of ERP representational similarity analysis (RSA). The study utilizes four-character Chinese idioms, and phonological overlap was manipulated by varying the syllable at the idiom-final part between idiom pairs so that pairs of idioms share a syllable (i.e. within-pairs) or not (between-pairs). We quantified the similarity between patterns of neural activity of idioms for within- and between-pairs. RSA results revealed greater similarity in neural activity patterns for idioms within-pairs, compared with between-pairs, and critically this similarity effect was observed prior to the presentation of the phonological similarity, providing evidence for the pre-activation of upcoming phonological information, under circumstances that encourage predictive processing.

Predicting coarse-grained semantic features in language comprehension: evidence from ERP representational similarity analysis and Chinese classifier.

Existing studies demonstrate that comprehenders can predict semantic information during language comprehension. Most evidence comes from a highly constraining context, in which a specific word is likely to be predicted. One question that has been investigated less is whether prediction can occur when prior context is less constraining for predicting specific words. Here, we aim to address this issue by examining the prediction of animacy features in low-constraining context, using electroencephalography (EEG), in combination with representational similarity analysis (RSA). In Chinese, a classifier follows a numeral and precedes a noun, and classifiers constrain animacy features of upcoming nouns. In the task, native Chinese Mandarin speakers were presented with either animate-constraining or inanimate-constraining classifiers followed by congruent or incongruent nouns. EEG amplitude analysis revealed an N400 effect for incongruent conditions, reflecting the difficulty of semantic integration when an incompatible noun is encountered. Critically, we quantified the similarity between patterns of neural activity following the classifiers. RSA results revealed that the similarity between patterns of neural activity following animate-constraining classifiers was greater than following inanimate-constraining classifiers, before the presentation of the nouns, reflecting pre-activation of animacy features of nouns. These findings provide evidence for the prediction of coarse-grained semantic feature of upcoming words.

Predicting phonology in language comprehension: Evidence from the visual world eye-tracking task in Mandarin Chinese.

Whereas a growing body of research demonstrates that people may predict conceptual representations during language comprehension, evidence for phonological prediction is less straightforward. Moreover, existing findings of phonological prediction come largely from studies conducted with languages with alphabetic scripts, making it difficult to dissociate the effects of phonology from orthography. In two experiments, we used the visual world paradigm to investigate whether comprehenders predict phonological information during comprehension of Chinese sentences, where phonology and orthography are largely dissociable. Participants listened to sentences containing a highly predictable word while viewing a visual display consisting of a critical object and three distractors (target object, a semantic competitor object, a phonological competitor object, or an unrelated object). We manipulated preview time (i.e., 2 s in Experiment 1 and 1 s in Experiment 2) to investigate how preview time influences the phonological prediction effect. In addition, we used different stimuli to test the robustness of the results. Results showed anticipatory eye movements for semantic competitors: participants fixated more on the semantic competitors than unrelated objects before the onset of predictable target words. Critically, in the two experiments, the results showed anticipatory fixations on phonological competitor objects. These findings provide clear evidence for the preactivation of both semantic and phonological information in sentence comprehension. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

A joint investigation of facilitation and interference effects of semantic and phonological similarity in a continuous naming task.

Semantic and phonological similarity effects provide critical constraints on the mechanisms underlying language production. In the present study, we jointly investigated effects of semantic and phonological similarity using the continuous naming task. In the semantic condition, Chinese Mandarin speakers named a list of pictures composed of 12 semantic category sets with 5 items from each semantic category, while in the phonological condition, they named a list of pictures from 12 phonological sets of 5 items sharing a spoken syllable. Related pictures occurred on adjacent trials, or were separated by 2, 4, or 6 unrelated pictures. Similar results were found across the semantic and phonological conditions: naming was facilitated by the directly preceding production of a related picture. For nonconsecutive related responses, naming latency increased linearly as a function of the number of preceding production instances of related pictures. Parallel patterns of facilitation and interference effects arising from semantic and phonological similarity suggest universal principles which govern language production. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Interference effects of phonological similarity in word production arise from competitive incremental learning.

In the blocked cyclic naming task, native Mandarin speakers named pictures with disyllabic names in small sets and blocks, with the critical manipulation whether pictures within a block shared an atonal syllable or not. We found the expected facilitation when the overlapping portion of responses was in word-initial position, but we also replicated a recent observation that with 'inconsistent' overlap (shared syllables could be either in first or second word position), form overlap causes interference. Crucially, interference also occurred when phonologically unrelated filler trials or trials which required a nonlinguistic response were interleaved with the critical pictures. The same pattern was found with written responses and orthographic radical overlap. The results are best explained via "competitive incremental learning" between lexical and phonological representations. A computer simulation confirms that this principle generates interference, and that the result is unaffected by filler trials. We conclude that incremental learning constitutes a universal principle in the mapping from semantics to phonology in language production.

Parallel Processing of Semantics and Phonology in Spoken Production: Evidence from Blocked Cyclic Picture Naming and EEG.

Spoken language production involves lexical-semantic access and phonological encoding. A theoretically important question concerns the relative time course of these two cognitive processes. The predominant view has been that semantic and phonological codes are accessed in successive stages. However, recent evidence seems difficult to reconcile with a sequential view but rather suggests that both types of codes are accessed in parallel. Here, we used ERPs combined with the "blocked cyclic naming paradigm" in which items overlapped either semantically or phonologically. Behaviorally, both semantic and phonological overlap caused interference relative to unrelated baseline conditions. Crucially, ERP data demonstrated that the semantic and phonological effects emerged at a similar latency (∼180 msec after picture onset) and within a similar time window (180-380 msec). These findings suggest that access to phonological information takes place at a relatively early stage during spoken planning, largely in parallel with semantic processing.

Phonological inhibition in written production.

The present study investigated the contribution of phonological relatedness on written production using the blocked cyclic naming paradigm. Participants were instructed to write down picture names in homogeneous and heterogeneous context. In the homogeneous context, items shared a syllable which corresponded to different written forms in various items. The position type of the shared syllable was manipulated so that the shared syllable was initial-only or distributed across various positions of words. Contrary to previous studies which showed facilitative effects of phonological relatedness on written production, interference effects in both reaction times and errors were found for both position types of phonological overlap. The findings indicate that phonological overlap does not always lead to facilitation but inhibition could occur. Implications of the present findings for theoretical models of word production are discussed.

Syllables and phonemes as planning units in Mandarin Chinese spoken word production: Evidence from ERPs.

Speakers of different languages might rely on differential phonological units when planning spoken output. In the present experiment, we investigated the role of phonemes, as well as the relative time course of syllabic vs phonemic encoding, in Mandarin Chinese word production. A form preparation task was combined with encephalography (EEG). In Experiment 1, word-initial phonemic overlap was manipulated; in Experiment 2, overlap was either in terms of phonemes or of syllables. Priming in latencies was found for syllabic but not for phonemic overlap. Phonemic overlap modulated ERPs in a 230-300 ms time window (range across Experiment 1 and 2) whereas syllabic overlap was found in a 200-280 ms time window. These results show that both phonemes and syllables are important planning units for Chinese speakers, and the relatively similar time course of activation provides important constraints on psycholinguistic models of Chinese spoken production. (143 words).

Co-activation of Taxonomic and Thematic Relations in Spoken Word Comprehension: Evidence From Eye Movements.

Evidence from behavior, computational linguistics, and neuroscience studies supported that semantic knowledge is represented in (at least) two semantic systems (i.e., taxonomic and thematic systems). It remains unclear whether, and to what extent taxonomic and thematic relations are co-activated. The present study investigated the co-activation of the two types of semantic representations when both types of semantic relations are simultaneously presented. In a visual-world task, participants listened to a spoken target word and looked at a visual display consisted of a taxonomic competitor, a thematic competitor and two distractors. Growth curve analyses revealed that both taxonomic and thematic competitors attracted visual attention during the processing of the target word but taxonomic competitor received more looks than thematic competitor. Moreover, although fixations on taxonomic competitor rose faster than thematic competitor, these two types of competitors started to attract more fixations than distractor in a similar time window. These findings indicate that taxonomic and thematic relations are co-activated by the spoken word, the activation of taxonomic relation is stronger and rise faster than thematic relation.

The role of orthography in second-language spoken word production: Evidence from Tibetan Chinese bilinguals.

Evidence suggests that spoken language production involves involuntary access to orthographic representations, both in languages with alphabetic and non-alphabetic scripts. An unexplored question is whether the role of orthography varies as a function of the language being native or non-native to the individual. Native (L1) and non-native (L2) languages differ in important aspects, that is, lexical representations in L2 might be less well established, but acquired at least partly via reading, and these unique features of non-native languages may contribute to a fundamental difference in how spelling and sound interact in production. We investigated an orthographic impact on spoken production with Tibetan Chinese bilinguals who named coloured line drawings of objects with Chinese adjective-noun phrases. Colour and object names were orthographically related or unrelated. Even though none of the participants were aware of the orthographic manipulation, orthographic overlap generated a facilitatory effect. In conjunction with earlier findings from native speakers on the identical task, we conclude that orthographic information is activated in spoken word production regardless of whether the response language is native or non-native.

Orthographic effects in Mandarin spoken language production.

For literate individuals, does the spoken production of language involve access to orthographic codes? Previous research has rendered mixed results, with a few positive findings contrasting with a range of null findings. In the current experiments, we chose spoken Mandarin as the target language in order to better dissociate sound from spelling. Mandarin speakers named coloured line drawings of common objects with adjective-noun phrases (e.g., /lan2/ /hua1ping2/, "blue vase"). Adjectives and nouns were semantically and phonologically unrelated on all trials, but on critical trials they shared an orthographic radical. In two experiments, this resulted in a significant facilitatory effect on naming latencies. We interpret these results as strong evidence for the claim that retrieval of phonological codes in spoken production involves the co-activation of orthographic representations.

Visual attention shift to printed words during spoken word recognition in Chinese: The role of phonological information.

The aim of this study was to investigate the extent to which phonological information mediates the visual attention shift to printed Chinese words in spoken word recognition by using an eye-movement technique with a printed-word paradigm. In this paradigm, participants are visually presented with four printed words on a computer screen, which include a target word, a phonological competitor, and two distractors. Participants are then required to select the target word using a computer mouse, and the eye movements are recorded. In Experiment 1, phonological information was manipulated at the full-phonological overlap; in Experiment 2, phonological information at the partial-phonological overlap was manipulated; and in Experiment 3, the phonological competitors were manipulated to share either fulloverlap or partial-overlap with targets directly. Results of the three experiments showed that the phonological competitor effects were observed at both the full-phonological overlap and partial-phonological overlap conditions. That is, phonological competitors attracted more fixations than distractors, which suggested that phonological information mediates the visual attention shift during spoken word recognition. More importantly, we found that the mediating role of phonological information varies as a function of the phonological similarity between target words and phonological competitors.

Orthographic effects in second-language spoken-word recognition.

Evidence from both alphabetic and nonalphabetic languages has suggested the role of orthography in the processing of spoken words in individuals' native language (L1). Less evidence has existed for such effects in nonnative (L2) spoken-word processing. Whereas in L1 orthographic representations are learned only after phonological representations have long been established, in L2 the sound and spelling of words are often learned in conjunction; this might predict stronger orthographic effects in L2 than in L1 spoken processing. On the other hand, lexical codes are typically less integrated and stable in L2 than in L1, which might entail less pronounced orthographic effects. To explore this issue, Tibetan Chinese bilinguals judged whether Chinese spoken words presented in pairs were related in meaning. Some of the unrelated word pairs were orthographically related, and critically, this orthographic overlap induced a significant increase in response latencies. Compared to previous results from L1 listeners with the identical procedure, the orthographic effect for L2 listeners was more pronounced. These findings indicate that orthographic information is involuntarily accessed in native and nonnative spoken-word recognition alike and that it may play a more important role in the latter compared to the former. (PsycINFO Database Record

The time course of morphological processing during spoken word recognition in Chinese.

We investigated the time course of morphological processing during spoken word recognition using the printed-word paradigm. Chinese participants were asked to listen to a spoken disyllabic compound word while simultaneously viewing a printed-word display. Each visual display consisted of three printed words: a semantic associate of the first constituent of the compound word (morphemic competitor), a semantic associate of the whole compound word (whole-word competitor), and an unrelated word (distractor). Participants were directed to detect whether the spoken target word was on the visual display. Results indicated that both the morphemic and whole-word competitors attracted more fixations than the distractor. More importantly, the morphemic competitor began to diverge from the distractor immediately at the acoustic offset of the first constituent, which was earlier than the whole-word competitor. These results suggest that lexical access to the auditory word is incremental and morphological processing (i.e., semantic access to the first constituent) that occurs at an early processing stage before access to the representation of the whole word in Chinese.

Orthographic effects in spoken word recognition: Evidence from Chinese.

Extensive evidence from alphabetic languages demonstrates a role of orthography in the processing of spoken words. Because alphabetic systems explicitly code speech sounds, such effects are perhaps not surprising. However, it is less clear whether orthographic codes are involuntarily accessed from spoken words in languages with non-alphabetic systems, in which the sound-spelling correspondence is largely arbitrary. We investigated the role of orthography via a semantic relatedness judgment task: native Mandarin speakers judged whether or not spoken word pairs were related in meaning. Word pairs were either semantically related, orthographically related, or unrelated. Results showed that relatedness judgments were made faster for word pairs that were semantically related than for unrelated word pairs. Critically, orthographic overlap on semantically unrelated word pairs induced a significant increase in response latencies. These findings indicate that orthographic information is involuntarily accessed in spoken-word recognition, even in a non-alphabetic language such as Chinese.

Tracking the time course of lexical access in orthographic production: An event-related potential study of word frequency effects in written picture naming.

Previous studies of spoken picture naming using event-related potentials (ERPs) have shown that speakers initiate lexical access within 200ms after stimulus onset. In the present study, we investigated the time course of lexical access in written, rather than spoken, word production. Chinese participants wrote target object names which varied in word frequency, and written naming times and ERPs were measured. Writing latencies exhibited a classical frequency effect (faster responses for high- than for low-frequency names). More importantly, ERP results revealed that electrophysiological activity elicited by high- and low frequency target names started to diverge as early as 168ms post picture onset. We conclude that lexical access during written word production is initiated within 200ms after picture onset. This estimate is compatible with previous studies on spoken production which likewise showed a rapid onset of lexical access (i.e., within 200ms after stimuli onset). We suggest that written and spoken word production share the lexicalization stage.

Semantic information mediates visual attention during spoken word recognition in Chinese: Evidence from the printed-word version of the visual-world paradigm.

In the present study, we investigated whether the activation of semantic information during spoken word recognition can mediate visual attention's deployment to printed Chinese words. We used a visual-world paradigm with printed words, in which participants listened to a spoken target word embedded in a neutral spoken sentence while looking at a visual display of printed words. We examined whether a semantic competitor effect could be observed in the printed-word version of the visual-world paradigm. In Experiment 1, the relationship between the spoken target words and the printed words was manipulated so that they were semantically related (a semantic competitor), phonologically related (a phonological competitor), or unrelated (distractors). We found that the probability of fixations on semantic competitors was significantly higher than that of fixations on the distractors. In Experiment 2, the orthographic similarity between the spoken target words and their semantic competitors was manipulated to further examine whether the semantic competitor effect was modulated by orthographic similarity. We found significant semantic competitor effects regardless of orthographic similarity. Our study not only reveals that semantic information can affect visual attention, it also provides important new insights into the methodology employed to investigate the semantic processing of spoken words during spoken word recognition using the printed-word version of the visual-world paradigm.

Cascadedness in Chinese written word production.

In written word production, is activation transmitted from lexical-semantic selection to orthographic encoding in a serial or cascaded fashion? Very few previous studies have addressed this issue, and the existing evidence comes from languages with alphabetic orthographic systems. We report a study in which Chinese participants were presented with colored line drawings of objects and were instructed to write the name of the color while attempting to ignore the object. Significant priming was found when on a trial, the written response shared an orthographic radical with the written name of the object. This finding constitutes clear evidence that task-irrelevant lexical codes activate their corresponding orthographic representation, and hence suggests that activation flows in a cascaded fashion within the written production system. Additionally, the results speak to how the time interval between processing of target and distractor dimensions affects and modulates the emergence of orthographic facilitation effects.