Cantonese AphasiaBank: An annotated database of spoken discourse and co-verbal gestures by healthy and language-impaired native Cantonese speakers.

This article reports the construction of a multimodal annotated database of spoken discourse and co-verbal gestures by native healthy speakers of Cantonese and individuals with language impairment: the Cantonese AphasiaBank. This corpus was established as a foundation for aphasiologists and clinicians to use in designing and conducting research investigations into theoretical and clinical issues related to acquired language disorders in Chinese. Details in terms of the purpose, structure, and levels of annotation of the database (containing part-of-speech-annotated orthographic transcripts with Romanization and the corresponding videos) are described. The discussion presents the challenges of building a spoken database of a language that is not linguistically well-researched and that does not have a standardized written form for many of its lexical items, as well as presenting how these issues were addressed. Most importantly, the article highlights the potential of Cantonese AphasiaBank as a powerful research tool for linguists and psycholinguists.

An analysis of topics and vocabulary in Chinese oral narratives by normal speakers and speakers with fluent aphasia.

This study analysed the topic and vocabulary of Chinese speakers based on language samples of personal recounts in a large spoken Chinese database recently made available in the public domain, i.e. Cantonese AphasiaBank ( http://www.speech.hku.hk/caphbank/search/ ). The goal of the analysis is to offer clinicians a rich source for selecting ecologically valid training materials for rehabilitating Chinese-speaking people with aphasia (PWA) in the design and planning of culturally and linguistically appropriate treatments. Discourse production of 65 Chinese-speaking PWA of fluent types (henceforth, PWFA) and their non-aphasic controls narrating an important event in their life were extracted from Cantonese AphasiaBank. Analyses of topics and vocabularies in terms of part-of-speech, word frequency, lexical semantics, and diversity were conducted. There was significant overlap in topics between the two groups. While the vocabulary was larger for controls than that of PWFA as expected, they were similar in distribution across parts-of-speech, frequency of occurrence, and the ratio of concrete to abstract items in major open word classes. Moreover, proportionately more different verbs than nouns were employed at the individual level for both speaker groups. The findings provide important implications for guiding directions of aphasia rehabilitation not only of fluent but also non-fluent Chinese aphasic speakers.

A Quantitative Study of Right Dislocation in Cantonese Spoken Discourse.

Right Dislocation (RD) has been suggested to be a focus marking device carrying an affective function motivated by limited planning time in conversation. The current study investigated the effects of genre type, planning load and affective function on the use of RD in Cantonese monologues. Discourse data were extracted from a recently developed corpus of oral narratives in Cantonese Chinese containing language samples from 144 native Cantonese speakers evenly distributed in age, education levels and gender. Three genre types representing different structures, styles and degrees of topic familiarity were chosen for an RD analysis: procedural description, story-telling and recount of personal event. The results revealed that genre types and planning load influenced the rate of RD occurrence. (1) Specifically, the lowest proportion of RD occurred in procedural description, assumed to be the most structured genre; whereas the highest rate was found in personal event recount, considered to be the most stylized and less structured genre. (2) The highest proportion of RD appeared near the end of a narrative, where heavier cognitive load is demanded compared with the beginning of a narrative; moreover, RD also tended to co-occur with disfluency. (3) There was a high percentage of RD tokens in the personal event recount for expressing explicit emotions; and (4) a lower rate of occurrence of RD was found in monologues than previous studies based on conversations. The overall findings suggest that the use of RD is sensitive to genre structure and style, as well as planning load effects.

Electrophysiological evidence of sublexical phonological access in character processing by L2 Chinese learners of L1 alphabetic scripts.

While Chinese character reading relies more on addressed phonology relative to alphabetic scripts, skilled Chinese readers also access sublexical phonological units during recognition of phonograms. However, sublexical orthography-to-phonology mapping has not been found among beginning second language (L2) Chinese learners. This study investigated character reading in more advanced Chinese learners whose native writing system is alphabetic. Phonological regularity and consistency were examined in behavioral responses and event-related potentials (ERPs) in lexical decision and delayed naming tasks. Participants were 18 native English speakers who acquired written Chinese after age 5 years and reached grade 4 Chinese reading level. Behaviorally, regular characters were named more accurately than irregular characters, but consistency had no effect. Similar to native Chinese readers, regularity effects emerged early with regular characters eliciting a greater N170 than irregular characters. Regular characters also elicited greater frontal P200 and smaller N400 than irregular characters in phonograms of low consistency. Additionally, regular-consistent characters and irregular-inconsistent characters had more negative amplitudes than irregular-consistent characters in the N400 and LPC time windows. The overall pattern of brain activities revealed distinct regularity and consistency effects in both tasks. Although orthographic neighbors are activated in character processing of L2 Chinese readers, the timing of their impact seems delayed compared with native Chinese readers. The time courses of regularity and consistency effects across ERP components suggest both assimilation and accommodation of the reading network in learning to read a typologically distinct second orthographic system.

Individual differences in processing pitch contour and rise time in adults: A behavioral and electrophysiological study of Cantonese tone merging.

One way to understand the relationship between speech perception and production is to examine cases where the two dissociate. This study investigates the hypothesis that perceptual acuity reflected in event-related potentials (ERPs) to rise time of sound amplitude envelope and pitch contour [reflected in the mismatch negativity (MMN)] may associate with individual differences in production among speakers with otherwise comparable perceptual abilities. To test this hypothesis, advantage was taken of an on-going sound change-tone merging in Cantonese, and compared the ERPs between two groups of typically developed native speakers who could discriminate the high rising and low rising tones with equivalent accuracy but differed in the distinctiveness of their production of these tones. Using a passive oddball paradigm, early positive-going EEG components to rise time and MMN to pitch contour were elicited during perception of the two tones. Significant group differences were found in neural responses to rise time rather than pitch contour. More importantly, individual differences in efficiency of tone discrimination in response latency and magnitude of neural responses to rise time were correlated with acoustic measures of F0 offset and rise time differences in productions of the two rising tones.

Designing, implementing and evaluating an online problem-based learning (PBL) environment--a pilot study.

Problem-based learning (PBL) has been shown to be effective for promoting student competencies in self-directed and collaborative learning, critical thinking, self-reflection and tackling novel situations. However, the need for face-to-face interactions at the same place and time severely limits the potential of traditional PBL. The requirements of space and for meeting at a specific location at the same time create timetabling difficulties. Such limitations need to be tackled before all potentials of PBL learning can be realized. The present study aimed at designing and implementing an online PBL environment for undergraduate speech/language pathology students, and assessing the associated pedagogical effectiveness. A group of eight PBL students were randomly selected to participate in the study. They underwent 4 weeks of online PBL using Adobe Connect. Upon completion of the experiment, they were assessed via a self-reported questionnaire and quantitative comparison with traditional PBL students based on the same written assignment. The questionnaire revealed that all participating students enjoyed online PBL, without any perceived negative effects on learning. Online PBL unanimously saved the students travel time to and from school. Statistical analysis indicated no significant difference in assignment grades between the online and traditional PBL groups, indicating that online PBL learning appears to be similarly effective as traditional face-to-face PBL learning.

Relationship Between Cognitive Functions and Multilevel Language Processing: Data From Chinese Speakers With Aphasia and Implications.

PURPOSE: This study aims to investigate the relationship between nonverbal cognitive functions and language processing of people with aphasia (PWA) by taking a data-driven approach, as well as multiple cognitive components and multilevel linguistic perspectives. It is hypothesized that language performance is differentially associated with cognitive processing of PWA, with executive functions (EFs) playing a stronger role in language tasks with increasing linguistic complexity. METHOD: A language battery assessing word comprehension/production, sentence comprehension, and discourse production, together with a series of nonlinguistic cognitive tasks targeting simple/complex attention, short-term/working memory, or EFs, was administered to 53 Cantonese-speaking PWA. Cognitive factors extracted from principal component analysis applied to the cognitive battery served as predictors in four multiple regression analyses to predict PWA's performance at various linguistic levels. RESULTS: Two cognitive factors, representing (a) simple attention and memory and (b) EF, were extracted. The former predicted performance in word processing tasks, whereas EF significantly predicted performance in all language tasks with increasing contribution as a function of linguistic complexity. CONCLUSION: The results based on Chinese PWA provide comprehensive evidence for the view that language performance is the end product of interaction between linguistic and nonlinguistic functions and have clear implications for clinical management of PWA.

Dissociative neural correlates of semantic processing of nouns and verbs in Chinese--a language with minimal inflectional morphology.

Numerous studies using various techniques and methodologies have demonstrated distinctive responses to nouns and verbs both at the behavioral and neurological levels. However, since the great majority of these studies involved tasks employing pictorial stimuli and languages with rich inflectional morphology, it is not clear whether word class effects resulted from semantic differences between objects and actions or different inflectional operations associated with the two word classes. Such shortcomings were addressed in this study by using a language with impoverished inflectional morphology - Chinese. Both concrete and abstract words were included, while controlling for nuisance variables between the two word classes, including imageability, word frequency, age-of-acquisition, and number of stroke. Participants were asked to judge the semantic relatedness of noun or verb pairs by pressing different buttons. The results revealed specific neural correlates for verb class in left lateral temporal and inferior frontal regions. Furthermore, the patterns of neural distribution of nouns and verbs were consistent with observations from Indo-European languages. Plausible accounts for neural separation of word classes were considered.

N170 reflects orthographic uniqueness point effects in English among native Japanese and Korean readers.

Orthographic uniqueness point (OUP) refers to the letter position of a word at which it is distinguishable from other lexical items in the language. Previous findings of OUP effects have been mixed and mainly demonstrated in native readers of alphabetic languages. The current study investigated whether OUP effects could be shown among non-native readers in a visual repetition detection task. The experiment tested three OUP conditions (early, mid, late) in native English readers and proficient non-native English readers whose native scripts were Japanese or Korean. Results revealed main effects of OUP on N170 amplitude, where early OUP words elicited more negative N170 and late OUP words elicited marginally less negative N170 than mean activation for both native and non-native readers. There was no indication that non-linearity or non-alphabetic nature of one's native script influenced OUP effects. Results were consistent with a parallel letter processing account in single word reading.

Dissociation of tone merger and congenital amusia in Hong Kong Cantonese.

While the issue of individual variation has been widely studied in second language learning or processing, it is less well understood how perceptual and musical aptitude differences can explain individual variation in native speech processing. In the current study, we make use of tone merger in Hong Kong Cantonese, an ongoing sound change that concerns the merging of tones in perception, production or both in a portion of native speakers, to examine the possible relationship between tone merger and musical and pitch abilities. Although a previous study has reported the occurrence of tone merger independently of musical training, it has not been investigated before whether tone-merging individuals, especially those merging tones in perception, would have inferior musical perception and fine-grained pitch sensitivities, given the close relationship of speech and music. To this end, we tested three groups of tone-merging individuals with various tone perception and production profiles on musical perception and pitch threshold tasks, in comparison to a group of Cantonese speakers with congenital amusia, and another group of controls without tone merger or amusia. Additionally, the amusics were compared with tone-merging individuals on the details of their tone discrimination and production profiles. The results showed a clear dissociation of tone merger and amusia, with the tone-merging individuals exhibiting intact musical and pitch abilities; on the other hand, the amusics demonstrated widespread difficulties in tone discrimination yet intact tone production, in contrast to the highly selective confusion of a specific tone pair in production or discrimination in tone-merging individuals. These findings provide the first evidence that tone merger and amusia are distinct from each other, and further suggest that the cause of tone merger may lie elsewhere rather than being driven by musical or pitch deficits. We also discussed issues arising from the current findings regarding the neural mechanisms of tone merger and amusia.

Functional orthographic units in Chinese character reading: Are there abstract radical identities?

Previous research has shown that the components of Chinese characters (e.g., semantic components, phonetic components, and radicals) serve as processing units in reading. One outstanding question concerns the existence of amodal orthographic representations that unify multiple, form-specific character components, similar to the abstract letter identities (ALIs) that unify case-specific letter forms (A/a) in Roman script. Although Chinese does not have case, a subset of semantic radicals have multiple forms (e.g., - are both "water" radicals), allowing for a test of the existence of Abstract Radical Identities (ARIs) that unify the multiple forms. In Experiment 1, a visual same-different judgement task was used to detect the presence of ARI representations. Evidence for ARIs was provided by the finding that radical pairs with different forms but the same radical identity were judged to be visually different more slowly than matched pairs of different forms with different radical identities. In Experiment 2, we evaluated ARI effects in real character reading. A lexical decision priming task compared prime-target character pairs containing radicals with the same identity but different forms (e.g., -) with matched prime-target character pairs with unrelated radicals (e.g., -). Inhibitory priming was observed only in the same-identity radical condition compared with the unrelated condition. These combined results provide, for the first time, evidence of format-free representations of orthographic units in Chinese characters-abstract radical identities (ARIs).

Treatment generalization and executive control processes: preliminary data from Chinese anomic individuals.

BACKGROUND: While various treatment approaches have been shown to be effective in remediating word-finding difficulties in aphasic individuals, interest has recently been directed at the role of executive functions in affecting treatment outcomes. AIMS: To examine the existence of a possible relationship between treatment generalization and executive control abilities. METHODS & PROCEDURES: An identical treatment protocol using the English alphabet as letter cues to facilitate name retrieval was applied to five Cantonese-speaking anomic individuals. A series of language and cognitive tasks were administered to help identify which deficit(s) would affect treatment results. OUTCOMES & RESULTS: All five participants demonstrated improvement in naming treated items. However, only two subjects with better inhibitory control exhibited significant gains in naming phonologically related untrained items. CONCLUSIONS & IMPLICATIONS: The preliminary results not only converge on current findings of the role of executive functions in rehabilitation results, but also identify in particular how inhibitory control may affect the outcomes of anomia therapy.

Top-down and bottom-up mechanisms as reflected by beta and gamma oscillations in speech perception: An individual-difference approach.

Recent neurophysiological studies have proposed distinct roles of ß and γ oscillations in implementing top-down and bottom-up processes. The present study aims to test this hypothesis in the domain of speech perception. We examined ß and γ oscillations elicited to a tone contrast in a passive oddball paradigm, and their relationships with discrimination sensitivity d' and RT from two groups of healthy adults who showed high and low discrimination sensitivity to the contrast. The low-sensitivity group showed a significant reduction in ß, which was further related to d'. Individual differences in RT were related to different frequency bands in the two groups, with a RT-ß correlation in the low-sensitivity group, and a RT-γ relation in the high-sensitivity group. Based on these findings, we suggest that ß, implicated in top-down processing, reflects individual differences in phonological representations, and that γ, involved in bottom-up processing, reflects individual differences in acoustic encoding.

Impact of characteristics of L1 literacy experience on picture processing: ERP data from trilingual non-native Chinese and English readers.

Previous studies involving ex-illiterate and young readers of alphabetic scripts have shown that processing of non-verbal visual stimuli may be affected by literacy, which is attributable to intensive perceptual training during reading acquisition. This study examined whether the characteristics of one's native writing system, with respect to visual complexity and overall shape of orthographic unit, would influence the processing of pictured objects using event-related potential (ERP) with linear mixed-effects modeling. Kanji and Hangul constitute an interesting contrast as they differ in visual complexity but are similar in orthographic shape. Neural responses to pictures were analyzed in N170 and N400 reflecting ease of recognition and access to semantic representation, respectively. Trilingual speakers with Japanese or Korean as L1, who learned to read Chinese and English as non-native languages, as well as native Chinese and native English readers participated in a repetition detection task in which mixed blocks of pictures and words (Chinese or English) were presented. The overall results showed bilaterally distributed N170 and N400, and group differences in the N400 were confined to the anterior region. More importantly, Japanese readers exhibited more negative N170 and less negative N400 than Korean participants regardless of language context. The present findings have provided insights into the possible impact of reading acquisition on non-linguistic visual processing, and suggest that one's early experience of a visually complex orthography has positive transfer to processing of line drawings in terms of more efficient visual recognition and semantic access.

Interactions of age of acquisition and lexical frequency effects with phonological regularity: An ERP study.

Across languages, lexical frequency and age of acquisition (AoA) are important predictors of word reading that are naturally correlated, and both variables have been shown to interact with phonological regularity. Previous behavioral findings in Chinese have shown stronger regularity effects in low frequency relative to high frequency characters. Meanwhile, the arbitrary mapping hypothesis predicts stronger interference effects in late-acquired irregular words. This study examined the neural bases of these phenomena in Chinese using a delayed naming task with 480 single characters. Single-trial ERP analyses were conducted to contrast the interactions of frequency or AoA effects with phonological regularity, while controlling for the other factor. Results showed differential and significant effects of AoA and frequency at the N400 and late positive component (LPC), respectively, indicating their independence. ERP interaction patterns of frequency and regularity in Chinese were observed for the first time in the LPC time window and suggested semantic interference from sublexical units during character reading. Interaction of AoA and regularity at the N400 could be explained by the semantic hypothesis but appeared inconsistent with the arbitrary mapping hypothesis.

Use of co-verbal gestures during word-finding difficulty among Cantonese speakers with fluent aphasia and unimpaired controls.

BACKGROUND: Co-verbal gestures refer to hand or arm movements made during speaking. Spoken language and gestures have been shown to be tightly integrated in human communication. AIMS: The present study investigated whether co-verbal gesture use was associated with lexical retrieval in connected speech in unimpaired speakers and persons with aphasia (PWA). METHODS & PROCEDURES: Narrative samples of 58 fluent PWA and 58 control speakers were extracted from Cantonese AphasiaBank. Based on the indicators of word-finding difficulty (WFD) in connected speech adapted from previous research, and a gesture annotation system with independent coding of gesture forms and functions, all WFD instances were identified. The presence and type of gestures accompanying each incident of WFD were then annotated. Finally, whether the use of gesture was accompanied by resolution of WFD, i.e., the corresponding target word could be retrieved, was examined. OUTCOMES & RESULTS: Employment of co-verbal gesture did not seem to be related to the success of word retrieval. PWA's naming ability at single-word level and their overall language ability (as reflected by the aphasia quotient of the Cantonese version of the Western Aphasia Battery) were found to be the two strongest predictors of success rate of resolving WFD. CONCLUSIONS: The Lexical Retrieval Hypothesis highlighting the facilitative functions of iconic and metaphoric gestures in lexical retrieval was not supported. Challenges in conducting research related to WFD, and the clinical implications in gesture-based language intervention for PWA were discussed.

A case study of the effect of age-of-acquisition on reading aloud in Chinese dyslexia.

This paper reports the influence of age-of-acquisition (AoA) effects on the oral reading accuracy of a Chinese brain-injured individual, FWL, who has anomia and dyslexia resulting from moderate-to-severe semantic deficits. We found an effect of the phonological consistency of a character and tentative evidence for an interaction between AoA and consistency. These observations converge on previous reports of an effect of AoA on reading and spelling of alphabetic scripts and in the reading of Japanese Kanji, a non-alphabetic script. An effect of AoA is also the expected outcome of the arbitrary mapping hypothesis which assumes that the locus of the AoA effect resides in the connection between levels of representations in the lexical processing system. We consider alternative interpretations of the AoA effect being located at the representations themselves, including phonological output and the semantic system. We propose that future studies of dyslexic individuals who rely primarily on the semantic reading route for reading in Chinese may reveal effects of semantic variables, including those associated with the semantic radical in phonetic compound characters.

Induced gamma oscillations index individual differences in speech sound perception and production.

Auditory neuroscience has provided strong evidence that neural oscillations synchronize to the rhythm of speech stimuli, and oscillations at different frequencies have been linked to processing of different language structures. The present study aims to examine how these ubiquitous neurophysiological attributes may inform us about the brain processes that underpin individual differences in speech perception and production, which in turn elucidate the specific functions of neural oscillations in the domain of speech processing. To this end, we recorded electrophysiological responses to a lexical tone contrast in a passive auditory oddball paradigm from two groups of healthy tone-language speakers who were equal in perceptual discriminability but differed in response latency and production distinctiveness of the tone contrast. Time-frequency analysis was applied to the EEG data, and decomposed into theta (4-7 Hz), beta (12-30 Hz), and gamma (30-50 Hz) frequency bands. Results show that listeners with longer discrimination RT and less distinctive production showed significantly higher induced (non-phase-locked) gamma during tone processing. Moreover, among speakers with less distinctive production, individual differences in induced gamma were significantly correlated with discrimination latency and production distinction. Based on the present findings, we propose that differences in gamma oscillations reflect differential sensory/perceptual computations during acoustic encoding, impacting the quality of perceptual representations, which further mediates individual differences in speech perception and production.

Measuring discourse coherence in anomic aphasia using Rhetorical Structure Theory.

PURPOSE: The existing body of work regarding discourse coherence in aphasia has provided mixed results, leaving the question of coherence being impaired or intact as a result of brain injury unanswered. In this study, discourse coherence in non-brain-damaged (NBD) speakers and speakers with anomic aphasia was investigated quantitatively and qualitatively. METHOD: Fifteen native speakers of Cantonese with anomic aphasia and 15 NBD participants produced 60 language samples. Elicitation tasks included story-telling induced by a picture series and a procedural description. The samples were annotated for discourse structure in the framework of Rhetorical Structure Theory (RST) in order to analyse a number of structural parameters. After that 20 naïve listeners rated coherence of each sample. RESULT: Disordered discourse was rated as significantly less coherent. The NBD group demonstrated a higher production fluency than the participants with aphasia and used a richer set of semantic relations to create discourse, particularly in the description of settings, expression of causality, and extent of elaboration. People with aphasia also tended to omit essential information content. CONCLUSION: Reduced essential information content, lower degree of elaboration, and a larger amount of structural disruptions may have contributed to the reduced overall discourse coherence in speakers with anomic aphasia.

Cognitive basis of individual differences in speech perception, production and representations: The role of domain general attentional switching.

This study investigated whether individual differences in cognitive functions, attentional abilities in particular, were associated with individual differences in the quality of phonological representations, resulting in variability in speech perception and production. To do so, we took advantage of a tone merging phenomenon in Cantonese, and identified three groups of typically developed speakers who could differentiate the two rising tones (high and low rising) in both perception and production [+Per+Pro], only in perception [+Per-Pro], or in neither modalities [-Per-Pro]. Perception and production were reflected, respectively, by discrimination sensitivity d' and acoustic measures of pitch offset and rise time differences. Components of event-related potential (ERP)-the mismatch negativity (MMN) and the ERPs to amplitude rise time-were taken to reflect the representations of the acoustic cues of tones. Components of attention and working memory in the auditory and visual modalities were assessed with published test batteries. The results show that individual differences in both perception and production are linked to how listeners encode and represent the acoustic cues (pitch contour and rise time) as reflected by ERPs. The present study has advanced our knowledge from previous work by integrating measures of perception, production, attention, and those reflecting quality of representation, to offer a comprehensive account for the underlying cognitive factors of individual differences in speech processing. Particularly, it is proposed that domain-general attentional switching affects the quality of perceptual representations of the acoustic cues, giving rise to individual differences in perception and production.