Pre- and post-head processing for single- and double-scrambled sentences of a head-final language as measured by the eye tracking method.

Using the eye-tracking method, the present study depicted pre- and post-head processing for simple scrambled sentences of head-final languages. Three versions of simple Japanese active sentences with ditransitive verbs were used: namely, (1) SO1O2V canonical, (2) SO2O1V single-scrambled, and (3) O1O2SV double-scrambled order. First pass reading times indicated that the third noun phrase just before the verb in both single- and double-scrambled sentences required longer reading times compared to canonical sentences. Re-reading times (the sum of all fixations minus the first pass reading) showed that all noun phrases including the crucial phrase before the verb in double-scrambled sentences required longer re-reading times than those required for single-scrambled sentences; single-scrambled sentences had no difference from canonical ones. Therefore, a single filler-gap dependency can be resolved in pre-head anticipatory processing whereas two filler-gap dependencies require much greater cognitive loading than a single case. These two dependencies can be resolved in post-head processing using verb agreement information.

Implicit and explicit second language training recruit common neural mechanisms for syntactic processing.

In contrast to native language acquisition, adult second-language (L2) acquisition occurs under highly variable learning conditions. Although most adults acquire their L2 at least partially through explicit instruction, as in a classroom setting, many others acquire their L2 primarily through implicit exposure, as is typical of an immersion environment. Whether these differences in acquisition environment play a role in determining the neural mechanisms that are ultimately recruited to process L2 grammar has not been well characterized. This study investigated this issue by comparing the ERP response to novel L2 syntactic rules acquired under conditions of implicit exposure and explicit instruction, using a novel laboratory language-learning paradigm. Native speakers tested on these stimuli showed a biphasic response to syntactic violations, consisting of an earlier negativity followed by a later P600 effect. After merely an hour of training, both implicitly and explicitly trained learners who were capable of detecting grammatical violations also elicited P600 effects. In contrast, learners who were unable to discriminate between grammatically correct and incorrect sentences did not show significant P600 effects. The magnitude of the P600 effect was found to correlate with learners' behavioral proficiency. Behavioral measures revealed that successful learners from both the implicit and explicit groups gained explicit, verbalizable knowledge about the L2 grammar rules. Taken together, these results indicate that late, controlled mechanisms indexed by the P600 play a crucial role in processing a late-learned L2 grammar, regardless of training condition. These findings underscore the remarkable plasticity of later, attention-dependent processes and their importance in lifelong learning.

Revisiting effects of contextual strength on the subordinate bias effect: evidence from eye movements.

In this study, we examined two issues regarding the role of context in ambiguity resolution: whether access to the contextually appropriate meaning is exhaustive or selective, and whether the contextually inappropriate meaning is inhibited. Participants read texts in which a biased ambiguous word was encountered twice while their eye movements were measured. The context preceding the first encounter varied in the extent to which the subordinate meaning was supported; the context preceding the second encounter always supported the dominant meaning. The findings suggest that lexical access is exhaustive but can be influenced by context, and that the subsequent accessibility of the contextually inappropriate meaning is unaffected by previous selection processes. The results were interpreted in terms of the assumptions of the reordered-access model and activation mechanisms that operate during reading.

SPaM: a combined self-paced reading and masked-priming paradigm.

In this article, we validate an experimental paradigm, SPaM, that we first described elsewhere (Luke & Christianson, Memory & Cognition 40:628-641, 2012). SPaM is a synthesis of self-paced reading and masked priming. The primary purpose of SPaM is to permit the study of sentence context effects on early word recognition. In the experiment reported here, we show that SPaM successfully reproduces results from both the self-paced reading and masked-priming literatures. We also outline the advantages and potential uses of this paradigm. For users of E-Prime, the experimental program can be downloaded from our lab website, http://epl.beckman.illinois.edu/.

Understanding mechanisms in transitive inferences: an eye-tracking study in Korean reading.

The current experiment examined the mechanism of relational information processing by assessing transitive inferences in different syntactic structures. More specifically, the current experiment focused on whether the demands of conscious inference processing interact with the difficulty of syntactic processing. This research used the eye-tracking method to investigate online processing mechanisms in complex sentences with transitive inference. Overall sentence reading times, accuracy rates of comprehension questions, and the two eye-movement measures of gaze duration and re-reading times were examined in 32 participants. The results showed that inference processing demands affected overall reading times and accuracy rates, while syntactic processing demands did not have an effect on overall reading times or accuracy rates. The results of the eye-tracking measures showed that syntactic processing demands affected gaze duration, while the inference processing demand affected re-reading times. Apparently, the difficulty of inference processing was not affected by the surface form of a sentence. The results of this study suggested that basic processes of sentence interpretation share resources with other cognitive processes such as inference.

Second language listening difficulties perceived by low-level learners.

The purpose was the develop a questionnaire to identify the specific listening difficulties of second language (L2) learners. Based on previous research, a questionnaire containing 31 items was developed and administered to 1,056 college freshmen. The whole sample was split randomly into two subsamples, each containing 528 cases. Exploratory factor analysis was performed to analyse the first subsample, and six factors were extracted, explaining a total of 57.1% of variance. To test the factor model, confirmatory factor analysis was conducted with the second subsample. Various fit indices were examined. The best fitting model for the data was a 23-item, six-factor model representing text, input channel and surroundings, relevance, listener, speaker, and task. Apart from the listener factor, all components are external ones and deemed to be uncontrollable by listeners. L2 learners must take an active role in listening practice to overcome L2 listening difficulties.

Evaluation of an automated procedure for detecting frequency-following responses in American and Chinese neonates.

To date, observations of the scalp-recorded frequency-following response (FFR) to voice pitch have depended on subjective interpretation of the experimenter. The purpose of this study was to develop and evaluate an automated procedure for detecting the presence of a response. Twenty American (9 boys, 1-3 days) and 20 Chinese (10 boys, 1-3 days) neonates were recruited. A Chinese monosyllable that mimicked the English vowel /i/ with a rising pitch (117-166 Hz) was used as the stimulus. Three objective indices (Frequency Error, Tracking Accuracy, and Pitch Strength) were computed from the recorded brain waves and the test results were compared with human judgments to calculate the sensitivity and specificity values. Results demonstrated that the automated procedure produced sensitivity values between 53-90% and specificity values between 80-100%, and could be used to assess the presence of an FFR for neonates who were born in a tonal or non-tonal language environment.

Psychological essentialist reasoning and perspective taking during reading: a donkey is not a zebra, but a plate can be a clock.

In an eyetracking study, we examined whether readers use psychological essentialist reasoning and perspective taking online. Stories were presented in which an animal or an artifact was transformed into another animal (e.g., a donkey into a zebra) or artifact (e.g., a plate into a clock). According to psychological essentialism, the essence of the animal did not change in these stories, while the transformed artifact would be thought to have changed categories. We found evidence that readers use this kind of reasoning online: When reference was made to the transformed animal, the nontransformed term ("donkey") was preferred, but the opposite held for the transformed artifact ("clock" was read faster than "plate"). The immediacy of the effect suggests that this kind of reasoning is employed automatically. Perspective taking was examined within the same stories by the introduction of a novel story character. This character, who was naïve about the transformation, commented on the transformed animal or artifact. If the reader were to take this character's perspective immediately and exclusively for reference solving, then only the transformed term ("zebra" or "clock") would be felicitous. However, the results suggested that while this character's perspective could be taken into account, it seems difficult to completely discard one's own perspective at the same time.

The role of imagery-related properties in picture naming: a newly standardized set of 360 pictures for Japanese.

Picture naming was investigated primarily to determine its dependence on certain imagery-related variables, with a secondary aim of developing a new set of Japanese norms for 360 pictures. Pictures refined from the original Nishimoto, Miyawaki, Ueda, Une, and Takahashi (Behavior Research Methods 37:398-416, 2005) set were used. Naming behaviors were measured using four imagery-related measures (imageability, vividness, image agreement, and image variability) and four conventional measures (naming time, name agreement, familiarity, and age of acquisition), as well as a number of other measures (17 total). A simultaneous multiple regression analysis performed on naming times showed that the most reliable predictor was H, a measure of name diversity; two image-related measures (image agreement and vividness) and age of acquisition also contributed substantially to the prediction of naming times. The accuracy of picture naming (measured as name agreement) was predicted by vividness, age of acquisition, familiarity, and image agreement. This suggests that certain processes involving mental imagery play a role in picture naming. The full set of norms and pictures may be downloaded from http://www.psychonomic.org/archive/ or along with the article from http://www.springerlink.com .

The real-time status of strong and weak islands.

In two eye-tracking reading experiments, we used a variant of the filled gap technique to investigate how strong and weak islands are processed on a moment-to-moment basis during comprehension. Experiment 1 provided a conceptual replication of previous studies showing that real time processing is sensitive to strong islands. In the absence of an island, readers experienced processing difficulty when a pronoun appeared in a position of a predicted gap, but this difficulty was absent when the pronoun appeared inside a strong island. Experiment 2 showed an analogous effect for weak islands: a processing cost was seen for a pronoun in the position of a predicted gap in a that-complement clause, but this cost was absent in a matched whether clause, which constitutes a weak island configuration. Overall, our results are compatible with the claim that active dependency formation is suspended, or reduced, in both weak and strong island structures.

Computerized analysis of speech and language to identify psycholinguistic correlates of frontotemporal lobar degeneration.

OBJECTIVE: To evaluate the use of a semiautomated computerized system for measuring speech and language characteristics in patients with frontotemporal lobar degeneration (FTLD). BACKGROUND: FTLD is a heterogeneous disorder comprising at least 3 variants. Computerized assessment of spontaneous verbal descriptions by patients with FTLD offers a detailed and reproducible view of the underlying cognitive deficits. METHODS: Audiorecorded speech samples of 38 patients from 3 participating medical centers were elicited using the Cookie Theft stimulus. Each patient underwent a battery of neuropsychologic tests. The audio was analyzed by the computerized system to measure 15 speech and language variables. Analysis of variance was used to identify characteristics with significant differences in means between FTLD variants. Factor analysis was used to examine the implicit relations between subsets of the variables. RESULTS: Semiautomated measurements of pause-to-word ratio and pronoun-to-noun ratio were able to discriminate between some of the FTLD variants. Principal component analysis of all 14 variables suggested 4 subjectively defined components (length, hesitancy, empty content, grammaticality) corresponding to the phenomenology of FTLD variants. CONCLUSION: Semiautomated language and speech analysis is a promising novel approach to neuropsychologic assessment that offers a valuable contribution to the toolbox of researchers in dementia and other neurodegenerative disorders.

Improving accuracy in detecting acoustic onsets.

In current cognitive psychology, naming latencies are commonly measured by electronic voice keys that detect when sound exceeds a certain amplitude threshold. However, recent research (e.g., K. Rastle & M. H. Davis, 2002) has shown that these devices are particularly inaccurate in precisely detecting acoustic onsets. In this article, the authors discuss the various problems and solutions that have been put forward with respect to this issue and show that classical voice keys may trigger several tens of milliseconds later than acoustic onset. The authors argue that a solution to this problem may come from voice keys that use a combination of analogue and digital noise (nonspeech sound) detection. It is shown that the acoustic onsets detected by such a device are only a few milliseconds delayed and correlate highly (up to .99) with reaction time values obtained by visual waveform inspection.

Sliding into happiness: A new tool for measuring affective responses to words.

Reliable measurement of affective responses is critical for research into human emotion. Affective evaluation of words is most commonly gauged on multiple dimensions-including valence (positivity) and arousal-using a rating scale. Despite its popularity, this scale is open to criticism: It generates ordinal data that is often misinterpreted as interval, it does not provide the fine resolution that is essential by recent theoretical accounts of emotion, and its extremes may not be properly calibrated. In 5 experiments, the authors introduce a new slider tool for affective evaluation of words on a continuous, well-calibrated and high-resolution scale. In Experiment 1, participants were shown a word and asked to move a manikin representing themselves closer to or farther away from the word. The manikin's distance from the word strongly correlated with the word's valence. In Experiment 2, individual differences in shyness and sociability elicited reliable differences in distance from the words. Experiment 3 validated the results of Experiments 1 and 2 using a demographically more diverse population of responders. Finally, Experiment 4 (along with Experiment 2) suggested that task demand is not a potential cause for scale recalibration. In Experiment 5, men and women placed a manikin closer or farther from words that showed sex differences in valence, highlighting the sensitivity of this measure to group differences. These findings shed a new light on interactions among affect, language, and individual differences, and demonstrate the utility of a new tool for measuring word affect. (PsycINFO Database Record

Embodiment awareness, mathematics discourse, and the blind.

Blindness might be described as a biological condition, and thus remedies could be in the realm of biotechnology. However, the convergence of information technology and cognitive science offers great opportunities for understanding and helping blind children as they learn mathematics, the crosscutting discipline most important for all branches of science and engineering. This article outlines our logic and approach for providing blind students with awareness of the embodiment of their teachers to maintain situated communication. First, we shall show that math discourse is inherently spatiotemporal, and that this information is carried by gesticulation in conjunction with speech. Second, we shall explore the capacity of those who are blind for the imagism necessary for mathematics reasoning. Third, we shall advance a set of augmentative devices suggested by our analysis. Finally, we shall outline our ongoing experiments to validate our rationale.

Bilingual and multilingual language processing.

This chapter addresses the interesting question on the neurolinguistics of bilingualism and the representation of language in the brain in bilingual and multilingual subjects. A fundamental issue is whether the cerebral representation of language in bi- and multilinguals differs from that of monolinguals, and if so, in which specific way. This is an interdisciplinary question which needs to identify and differentiate different levels involved in the neural representation of languages, such as neuroanatomical, neurofunctional, biochemical, psychological and linguistic levels. Furthermore, specific factors such as age, manner of acquisition and environmental factors seem to affect the neural representation. We examined the question whether verbal memory processing in two unrelated languages is mediated by a common neural system or by distinct cortical areas. Subjects were Finnish-English adult multilinguals who had acquired the second language after the age of ten. They were PET-scanned whilst either encoding or retrieving word pairs in their mother tongue (Finnish) or in a foreign language (English). Within each language, subjects had to encode and retrieve four sets of 12 visually presented paired word associates which were not semantically related. Two sets consisted of highly imaginable words and the other two sets of abstract words. Presentation of pseudo-words served as a reference condition. An emission scan was recorded after each intravenous administration of O-15 water. Encoding was associated with prefrontal and hippocampal activation. During memory retrieval, precuneus showed a consistent activation in both languages and for both highly imaginable and abstract words. Differential activations were found in Broca's area and in the cerebellum as well as in the angular/supramarginal gyri according to the language used. The findings advance our understanding of the neural representation that underlies multiple language functions. Further studies are needed to elucidate the neuronal mechanisms of bi/multilingual language processing. A promising perspective for future bi/multilingual research is an integrative approach using brain imaging studies with a high spatial resolution such as fMRI, combined with techniques with a high temporal resolution, such as magnetoencephalography (MEG).

Pointing the way to new constraints on the dynamical claims of computational models.

The reach-to-touch paradigm has become an increasingly popular tool in the study of human cognition. It is widely held that reaching responses are able to reveal the moment-by-moment unfolding of decision processes by virtue of an assumed continuity between reaching trajectories and the underlying "cognitive trajectory." Yet the standard analysis of reaching trajectories aggregates the trajectories across stimulus viewing times, which yields ambiguous results. Here we introduce a new version of the reach-to-touch paradigm that incorporates the response-signal procedure to elicit reaching movements across a wide range of stimulus viewing times. We then analyze the direction of the initial movement by stimulus viewing time, which produces a sigmoidal growth pattern. Of note, we show how this sigmoidal relationship between stimulus viewing time and initial direction can be used to test and constrain the dynamical claims of computational models of basic cognitive processes. We introduce our new version of the reach-to-touch paradigm and analyses in the context of a lexical decision task and we compare our results with the dynamical claims of the dual-route cascaded model of reading.

Capturing additional information about the organization of entries in the lexicon from verbal fluency productions.

Troyer and colleagues [Troyer, A. K., Moscovitch, M., & Winocur, G. (1997). Clustering and switching as two components of verbal fluency: evidence from younger and older healthy adults. Neuropsychology, 11(1), 138-146] developed a seminal method to measure clustering and switching behaviors during verbal fluency (VF) productions. We sought to expand the reach of their system by modifying the scoring rules. Compared to the Troyer system, our modifications yield comparable estimates of interrater reliability and similar patterns of correlation with demographic characteristics for both clustering and switching in healthy adults. However, two objective measures of word relatedness (interword interval timing and latent semantic analysis) confirm that our revisions capture additional information about the organization of entries in the lexical network.

Whole-language and item-specific control in bilingual language production.

The current study investigated the scope of bilingual language control differentiating between whole-language control involving control of an entire lexicon specific to 1 language and lexical-level control involving only a restricted set of recently activated lexical representations. To this end, we tested 60 Dutch-English (Experiment 1) and 64 Chinese-English bilinguals (Experiment 2) on a verbal fluency task in which speakers produced members of letter (or phoneme for Chinese) categories first in 1 language and then members of either (a) the same categories or (b) different categories in their other language. Chinese-English bilinguals also named pictures in both languages. Both bilingual groups showed reduced dominant language fluency after producing exemplars from the same categories in the nondominant language, whereas nondominant language production was not influenced by prior production of words from the same categories in the other language. Chinese-English, but not Dutch-English, bilinguals exhibited similar testing order effects for different letter/phoneme categories. In addition, Chinese-English bilinguals who exhibited significant testing order effects in the repeated categories condition of the fluency task exhibited no such effects when naming repeated pictures after a language switch. These results imply multiple levels of inhibitory control in bilingual language production. Testing order effects in the verbal fluency task pinpoint a lexical locus of bilingual control, and the finding of interference effects for some bilinguals even when different categories are tested across languages further implies a whole-language control process, although the ability to exert such global inhibition may only develop for some types of bilinguals.

The shape of things to come: evaluating word frequency as a continuous variable in recognition memory.

The role of experience in memory, specifically the word frequency (WF) mirror effect showing higher hit rates and lower false alarm rates for low-frequency words, is one of the hallmarks of memory. However, this "regularity of memory" is limited because normative WF has been treated as discrete (low vs. high). We evaluate the extent to which the prototypical WF mirror effect holds when WF is treated as a continuous variable. We find a clear nonmonotonic U-shaped relationship. Hit rates are higher for both low-frequency and high-frequency words. Linear and quadratic regression models were fit to the data at both the item and the participant level, and the quadratic model provided a better fit at both levels. This finding is inconsistent with the empirical and theoretical finding of a mirror effect and requires a novel approach to accounting for the role of experience in episodic memory.

Reconsidering the role of temporal order in spoken word recognition.

Models of spoken word recognition assume that words are represented as sequences of phonemes. We evaluated this assumption by examining phonemic anadromes, words that share the same phonemes but differ in their order (e.g., sub and bus). Using the visual-world paradigm, we found that listeners show more fixations to anadromes (e.g., sub when bus is the target) than to unrelated words (well) and to words that share the same vowel but not the same set of phonemes (sun). This contrasts with the predictions of existing models and suggests that words are not defined as strict sequences of phonemes.