Body-object interaction ratings for 3600 French nouns.

Body-object interaction (BOI) measures the ease with which the human body can interact with the concept represented by a word. This research focuses on two main objectives: first, to establish French norms for the psycholinguistic variable BOI, and second, to investigate the contribution of BOI to language processing in French. We collected BOI ratings for 3600 French nouns from participants through an online platform. The inter- and intrastudy reliability of these new ratings indicate that the ratings are robust. We then aimed to determine the role of BOI in word recognition. A hierarchical regression analysis was conducted using lexical decision reaction times (RTs) as the dependent variable. BOI was found to be a significant predictor of lexical decision latencies, beyond the contribution of word length, frequency, orthographic distinctiveness, and imageability. Contrary to previous findings in English, higher BOI values were associated with longer RTs in French, indicating an inhibitory effect of BOI on French word processing. Methodological differences may account for this divergent result. Taken together, the results of this study show the independent contribution of BOI to word recognition in French. This supports the notion that sensorimotor information is a crucial component of language processing. By providing a reliable and sizable BOI database for French nouns, we offer a valuable resource for psycholinguistic and language processing research. This research underscores the complex relationship between language, cognition, and sensorimotor experiences, advancing our comprehension of language processing mechanisms.

Decoding the essence of two-character Chinese words: Unveiling valence, arousal, concreteness, familiarity, and imageability through word norming.

Investigation of affective and semantic dimensions of words is essential for studying word processing. In this study, we expanded Tse et al.'s (Behav Res Methods 49:1503-1519, 2017; Behav Res Methods 55:4382-4402, 2023) Chinese Lexicon Project by norming five word dimensions (valence, arousal, familiarity, concreteness, and imageability) for over 25,000 two-character Chinese words presented in traditional script. Through regression models that controlled for other variables, we examined the relationships among these dimensions. We included ambiguity, quantified by the standard deviation of the ratings of a given lexical variable across different raters, as separate variables (e.g., valence ambiguity) to explore their connections with other variables. The intensity-ambiguity relationships (i.e., between normed variables and their ambiguities, like valence with valence ambiguity) were also examined. In these analyses with a large pool of words and controlling for other lexical variables, we replicated the asymmetric U-shaped valence-arousal relationship, which was moderated by valence and arousal ambiguities. We also observed a curvilinear relationship between valence and familiarity and between valence and concreteness. Replicating Brainerd et al.'s (J Exp Psychol Gen 150:1476-1499, 2021; J Mem Lang 121:104286, 2021) quadratic intensity-ambiguity relationships, we found that the ambiguity of valence, arousal, concreteness, and imageability decreases as the value of these variables is extremely low or extremely high, although this was not generalized to familiarity. While concreteness and imageability were strongly correlated, they displayed different relationships with arousal, valence, familiarity, and valence ambiguity, suggesting their distinct conceptual nature. These findings further our understanding of the affective and semantic dimensions of two-character Chinese words. The normed values of all these variables can be accessed via https://osf.io/hwkv7 .

How ready is speech-to-text for psychological language research? Evaluating the validity of AI-generated English transcripts for analyzing free-spoken responses in younger and older adults.

For the longest time, the gold standard in preparing spoken language corpora for text analysis in psychology was using human transcription. However, such standard comes at extensive cost, and creates barriers to quantitative spoken language analysis that recent advances in speech-to-text technology could address. The current study quantifies the accuracy of AI-generated transcripts compared to human-corrected transcripts across younger (n = 100) and older (n = 92) adults and two spoken language tasks. Further, it evaluates the validity of Linguistic Inquiry and Word Count (LIWC)-features extracted from these two kinds of transcripts, as well as transcripts specifically prepared for LIWC analyses via tagging. We find that overall, AI-generated transcripts are highly accurate with a word error rate of 2.50% to 3.36%, albeit being slightly less accurate for younger compared to older adults. LIWC features extracted from either transcripts are highly correlated, while the tagging procedure significantly alters filler word categories. Based on these results, automatic speech-to-text appears to be ready for psychological language research when using spoken language tasks in relatively quiet environments, unless filler words are of interest to researchers.

TACO: A Turkish database for abstract concepts.

The organization of abstract concepts reflects different dimensions, grounded in the brain regions coding for the corresponding experience. Normative measures of linguistic stimuli offer noteworthy insights into the organization of conceptual knowledge, but studies differ in the dimensions and classes of concepts considered. Additionally, most of the available information has been collected in English, without considering possible linguistic and cultural differences. Here, we aimed to create a comprehensive Turkish database for abstract concepts (TACO), including rarely investigated classes such as political concepts. We included 503 words-78 concrete (fruits, animals, tools) and 425 abstract (emotions, social, mental states, theoretical, quantity, space, political)-rated by 134 Turkish speakers for familiarity, imageability, age of acquisition, valence, arousal, quantity, space, theoretical, social, mental state, and political dimensions. We calculated dominance and exclusivity, indicating the dimension receiving the highest mean score for each word, and the position of the word along the unidimensional-multidimensional continuum, respectively. A principal component analysis (PCA) was conducted on the semantic dimensions. The results showed that mental state was the dominant dimension for most concepts. Moderate to low levels of exclusivity indicated that the concepts were multidimensional. PCA revealed three components: Component 1 captured the juxtaposition between social/mental state and magnitude polarities, Component 2 highlighted affective components, and Component 3 grouped together political and theoretical dimensions. The introduction of political concepts provided insights into the multidimensional nature of this unexplored class, closely intertwined with the theoretical dimension. TACO constitutes the first comprehensive Turkish database covering several abstract dimensions, paving the way for cross-linguistic and cross-cultural studies of semantic representations.

The English Sublexical Toolkit: Methods for indexing sound-spelling consistency.

This work introduces the English Sublexical Toolkit, a suite of tools that utilizes an experience-dependent learning framework of sublexical knowledge to extract regularities from the English lexicon. The Toolkit quantifies the empirical regularity of sublexical units in both the reading and spelling directions (i.e., grapheme-to-phoneme and phoneme-to-grapheme) and at multiple grain sizes (i.e., phoneme/grapheme and onset/rime unit size). It can extract multiple experience-dependent regularity indices for words or pseudowords, including both frequency indices (e.g., grapheme frequency) and conditional probability indices (e.g., grapheme-to-phoneme probability). These tools provide (1) superior estimates of the regularities that better reflect the complexity of the sublexical system relative to previously published indices and (2) completely novel indices of sublexical units such as phonographeme frequency (i.e., combined units of individual phonemes and graphemes that are independent of processing direction). We demonstrate that measures from the toolkit explain significant amounts of variance in empirical data (naming of real words and lexical decision), and either outperform or are comparable to the best available consistency measures. The flexibility of the toolkit is further demonstrated by its ability to readily index the probability of different pseudowords pronunciations, and we report that the measures account for the majority of variance in these empirically observed probabilities. Overall, this work provides a framework and resources that can be flexibly used to identify optimal corpus-based consistency measures that help explain reading/spelling behaviors for real and pseudowords.

Capturing individual differences in sentence processing: How reliable is the self-paced reading task?

Advances in research on language processing have originally come from group-level comparisons, but there is now a growing interest in individual differences. To investigate individual differences, tasks that have shown robust group-level differences are often used with the implicit assumption that they will also be reliable when used as an individual differences measure. Here, we examined whether one of the primary tasks used in psycholinguistic research on language processing, the self-paced reading task, can reliably measure individual differences in relative clause processing. We replicated the well-established effects of relative clauses at the group level, with object relative clauses being more difficult to process than subject relative clauses. However, when using difference scores, the reliability of the size of the relative clause effect was close to zero because the self-paced reading times for the different relative clause types were highly correlated within individuals. Nonetheless, we found that the self-paced reading task can be used to reliably capture individual differences in overall reading speed as well as key sentence regions when the two types of relative clause sentences are considered separately. Our results indicate that both the reliability and validity of different sentence regions need to be assessed to determine whether and when self-paced reading can be used to examine individual differences in language processing.

Standardizing norms for 1286 colored pictures in Cantonese.

This study established psycholinguistic norms in Cantonese for a set of 1286 colored pictures sourced from several picture databases, including 750 colored line drawings from MultiPic (Duñabeitia et al., 2018) and 536 photographs selected for McRae et al. (2005) concepts. The pictures underwent rigorous normalization processes. We provided picture characteristics including name and concept agreement, familiarity, visual complexity, and frequency of modal responses. Through correlational analyses, we observed strong interrelationships among these variables. We also compared the current Cantonese norming to other languages and demonstrated similarity and variations among different languages. Additionally, we embraced the multilingual diversity within the current sample, and found that higher Cantonese proficiency but lower non-native language proficiency were associated with better spoken picture naming. Last but not least, we validated the predictive power of normed variables calculated from typed responses to spoken picture naming, and the consistency between typed and spoken responses. The present norming provides a timely and valuable alternative for researchers in the field of psycholinguistics, especially those studying Cantonese production and lexical retrieval. All raw data, analysis scripts, and final norming results are available online as psycholinguistic norms for Cantonese in the following link at the Open Science Framework: https://osf.io/dz9j6/?view_only=a452d8a56c92430b9dedf21ac26b1bc1 .

LASTU: A psycholinguistic search tool for Finnish lexical stimuli.

LASTU is a tool for searching for Finnish language stimulus words for psycholinguistic studies. The tool allows the user to query a number of properties, including forms, lemmas, frequencies, and morphological features. It also includes two new measures for quantifying lemma and form ambiguity. The tool is written in Python and is available for Windows and macOS platforms. It is available at https://osf.io/j8v6b/ . Included with the tool is a database based on a massive corpus of dependency-parsed Finnish language data crawled from the Internet (over 5 billion tokens). While LASTU has been developed for researchers working on the Finnish language, the openly available implementation can also be applied to other languages.

NSP-SCD: A corpus construction protocol for child-directed print in understudied languages.

Child-directed print corpora enable systematic psycholinguistic investigations, but this research infrastructure is not available in many understudied languages. Moreover, researchers of understudied languages are dependent on manual tagging because precise automatized parsers are not yet available. One plausible way forward is to limit the intensive work to a small-sized corpus. However, with little systematic enquiry about approaches to corpus construction, it is unclear how robust a small corpus can be made. The current study examines the potential of a non-sequential sampling protocol for small corpus development (NSP-SCD) through a cross-corpora and within-corpus analysis. A corpus comprising 17,584 words was developed by applying the protocol to a larger corpus of 150,595 words from children's books for 3-to-10-year-olds. While the larger corpus will by definition have more instances of unique words and unique orthographic units, still, the selectively sampled small corpus approximated the larger corpus for lexical and orthographic diversity and was equivalent for orthographic representation and word length. Psycholinguistic complexity increased by book level and varied by parts of speech. Finally, in a robustness check of lexical diversity, the non-sequentially sampled small corpus was more efficient compared to a same-sized corpus constructed by simply using all sentences from a few books (402 books vs. seven books). If a small corpus must be used then non-sequential sampling from books stratified by book level makes the corpus statistics better approximate what is found in larger corpora. Overall, the protocol shows promise as a tool to advance the science of child language acquisition in understudied languages.

Can large language models help augment English psycholinguistic datasets?

Research on language and cognition relies extensively on psycholinguistic datasets or "norms". These datasets contain judgments of lexical properties like concreteness and age of acquisition, and can be used to norm experimental stimuli, discover empirical relationships in the lexicon, and stress-test computational models. However, collecting human judgments at scale is both time-consuming and expensive. This issue of scale is compounded for multi-dimensional norms and those incorporating context. The current work asks whether large language models (LLMs) can be leveraged to augment the creation of large, psycholinguistic datasets in English. I use GPT-4 to collect multiple kinds of semantic judgments (e.g., word similarity, contextualized sensorimotor associations, iconicity) for English words and compare these judgments against the human "gold standard". For each dataset, I find that GPT-4's judgments are positively correlated with human judgments, in some cases rivaling or even exceeding the average inter-annotator agreement displayed by humans. I then identify several ways in which LLM-generated norms differ from human-generated norms systematically. I also perform several "substitution analyses", which demonstrate that replacing human-generated norms with LLM-generated norms in a statistical model does not change the sign of parameter estimates (though in select cases, there are significant changes to their magnitude). I conclude by discussing the considerations and limitations associated with LLM-generated norms in general, including concerns of data contamination, the choice of LLM, external validity, construct validity, and data quality. Additionally, all of GPT-4's judgments (over 30,000 in total) are made available online for further analysis.

Semantic feature norms: a cross-method and cross-language comparison.

The ability to assign meaning to perceptual stimuli forms the basis of human behavior and the ability to use language. The meanings of things have primarily been probed using behavioral production norms and corpus-derived statistical methods. However, it is not known to what extent the collection method and the language being probed influence the resulting semantic feature vectors. In this study, we compare behavioral with corpus-based norms, across Finnish and English, using an all-to-all approach. To complete the set of norms required for this study, we present a new set of Finnish behavioral production norms, containing both abstract and concrete concepts. We found that all the norms provide largely similar information about the relationships of concrete objects and allow item-level mapping across norms sets. This validates the use of the corpus-derived norms which are easier to obtain than behavioral norms, which are labor-intensive to collect, for studies that do not depend on subtle differences in meaning between close semantic neighbors.

The Chinese lexicon of deaf readers: A database of character decisions and a comparison between deaf and hearing readers.

We present a psycholinguistic study investigating lexical effects on simplified Chinese character recognition by deaf readers. Prior research suggests that deaf readers exhibit efficient orthographic processing and decreased reliance on speech-based phonology in word recognition compared to hearing readers. In this large-scale character decision study (25 participants, each evaluating 2500 real characters and 2500 pseudo-characters), we analyzed various factors influencing character recognition accuracy and speed in deaf readers. Deaf participants demonstrated greater accuracy and faster recognition when characters were more frequent, were acquired earlier, had more strokes, displayed higher orthographic complexity, were more imageable in reference, or were less concrete in reference. Comparison with a previous study of hearing readers revealed that the facilitative effect of frequency on character decision accuracy was stronger for deaf readers than hearing readers. The effect of orthographic-phonological regularity differed significantly for the two groups, indicating that deaf readers rely more on orthographic structure and less on phonological information during character recognition. Notably, increased stroke counts (i.e., higher orthographic complexity) hindered hearing readers but facilitated recognition processes in deaf readers, suggesting that deaf readers excel at recognizing characters based on orthographic structure. The database generated from this large-scale character decision study offers a valuable resource for further research and practical applications in deaf education and literacy.

Concreteness ratings for 36,000 Estonian words.

We present a collection of concreteness ratings for 35,979 words in Estonian. The data were collected via a web application from 2278 native Estonian speakers. Human ratings of concreteness have not been collected for Estonian beforehand. We compare our results to Aedmaa et al. (2018), who assigned concreteness ratings to 240,000 Estonian words by means of machine learning. We show that while these two datasets show reasonable correlation (R = 0.71), there are considerable differences in the distribution of the ratings, which we discuss in this paper. Furthermore, the results also raise questions about the importance of the type of scale used for collecting ratings. While most other datasets have been compiled based on questionnaires entailing five- or seven-point Likert scales, we used a continuous 0-10 scale. Comparing our rating distribution to those of other studies, we found that it is most similar to the distribution in Lahl et al. (Behavior Research Methods, 41(1), 13-19, 2009), who also used a 0-10 scale. Concreteness ratings for Estonian words are available at OSF .

Phasic pupillary responses reveal differential engagement of attentional control in bilingual spoken language processing.

Language processing is cognitively demanding, requiring attentional resources to efficiently select and extract linguistic information as utterances unfold. Previous research has associated changes in pupil size with increased attentional effort. However, it is unknown whether the behavioral ecology of speakers may differentially affect engagement of attentional resources involved in conversation. For bilinguals, such an act potentially involves competing signals in more than one language and how this competition arises may differ across communicative contexts. We examined changes in pupil size during the comprehension of unilingual and codeswitched speech in a richly-characterized bilingual sample. In a visual-world task, participants saw pairs of objects as they heard instructions to select a target image. Instructions were either unilingual or codeswitched from one language to the other. We found that only bilinguals who use each of their languages in separate communicative contexts and who have high attention ability, show differential attention to unilingual and codeswitched speech. Bilinguals for whom codeswitching is common practice process unilingual and codeswitched speech similarly, regardless of attentional skill. Taken together, these results suggest that bilinguals recruit different language control strategies for distinct communicative purposes. The interactional context of language use critically determines attentional control engagement during language processing.

Bilinguals are better than monolinguals in detecting manipulative discourse.

One of the most contentious topics in cognitive science concerns the impact of bilingualism on cognitive functions and neural resources. Research on executive functions has shown that bilinguals often perform better than monolinguals in tasks that require monitoring and inhibiting automatic responses. The robustness of this effect is a matter of an ongoing debate, with both sides approaching bilingual cognition mainly through measuring abilities that fall outside the core domain of language processing. However, the mental juggling that bilinguals perform daily involves language. This study takes a novel path to bilingual cognition by comparing the performance of monolinguals and bilinguals in a timed task that features a special category of stimulus, which has the peculiar ability to manipulate the cognitive parser into treating it as well-formed while it is not: grammatical illusions. The results reveal that bilinguals outperform monolinguals in detecting illusions, but they are also slower across the board in judging the stimuli, illusory or not. We capture this trade-off by proposing the Plurilingual Adaptive Trade-off Hypothesis (PATH), according to which the adaptation of bilinguals' cognitive abilities may (i) decrease fallibility to illusions by means of recruiting sharpened top-down control processes, but (ii) this is part of a larger bundle of effects, not all of which are necessarily advantageous.

Adaptation of a semantic picture-word interference paradigm for future language mapping with transcranial magnetic stimulation: A behavioural study.

Neuro-navigated transcranial magnetic stimulation (TMS) helps to identify language-related cortical regions prior to brain tumour surgery. We adapted a semantic picture-word interference (PWI) paradigm from psycholinguistics to high-resolution TMS language mapping which prospectively can be used to specifically address the level of semantic processing. In PWI, pictures are presented along with distractor words which facilitate or inhibit the lexical access to the picture name. These modulatory effects of distractors can be annihilated in language-sensitive areas by the inhibitory effects of TMS on language processing. The rationale here is to observe the distractor effect without active stimulation and then to observe presumably its elimination by interference of the TMS stimulation. The special requirements to use PWI in this setting are (1) identifying word material for accelerating reliably naming latencies, choosing (2) the ideal presentation modality, and (3) the appropriate timing of distractor presentation. These are then controlled in real TMS language mapping. To adapt a semantic PWI naming paradigm for TMS application we employed 30 object-pictures in spoken German language. Part-whole associative semantic related or unrelated distractors were presented in two experiments including 15 healthy volunteers each, once auditorily and once visually. Data analysis across the entire stimulus set revealed a trend for facilitation in the visual condition, whereas no effects were observed for auditory distractors. In a sub-set, we found a significant facilitation effect for visual semantic distractors. Thus, with this study we provide a well-controlled item set for future studies implementing effective TMS language mapping applying visual semantic PWI.

Analysis of English free association network reveals mechanisms of efficient solution of Remote Association Tests.

We study correlations between the structure and properties of a free association network of the English language, and solutions of psycholinguistic Remote Association Tests (RATs). We show that average hardness of individual RATs is largely determined by relative positions of test words (stimuli and response) on the free association network. We argue that the solution of RATs can be interpreted as a first passage search problem on a network whose vertices are words and links are associations between words. We propose different heuristic search algorithms and demonstrate that in "easily-solving" RATs (those that are solved in 15 seconds by more than 64% subjects) the solution is governed by "strong" network links (i.e. strong associations) directly connecting stimuli and response, and thus the efficient strategy consist in activating such strong links. In turn, the most efficient mechanism of solving medium and hard RATs consists of preferentially following sequence of "moderately weak" associations.

Modeling the predictive potential of extralinguistic context with script knowledge: The case of fragments.

We describe a novel approach to estimating the predictability of utterances given extralinguistic context in psycholinguistic research. Predictability effects on language production and comprehension are widely attested, but so far predictability has mostly been manipulated through local linguistic context, which is captured with n-gram language models. However, this method does not allow to investigate predictability effects driven by extralinguistic context. Modeling effects of extralinguistic context is particularly relevant to discourse-initial expressions, which can be predictable even if they lack linguistic context at all. We propose to use script knowledge as an approximation to extralinguistic context. Since the application of script knowledge involves the generation of prediction about upcoming events, we expect that scrips can be used to manipulate the likelihood of linguistic expressions referring to these events. Previous research has shown that script-based discourse expectations modulate the likelihood of linguistic expressions, but script knowledge has often been operationalized with stimuli which were based on researchers' intuitions and/or expensive production and norming studies. We propose to quantify the likelihood of an utterance based on the probability of the event to which it refers. This probability is calculated with event language models trained on a script knowledge corpus and modulated with probabilistic event chains extracted from the corpus. We use the DeScript corpus of script knowledge to obtain empirically founded estimates of the likelihood of an event to occur in context without having to resort to expensive pre-tests of the stimuli. We exemplify our method at a case study on the usage of nonsentential expressions (fragments), which shows that utterances that are predictable given script-based extralinguistic context are more likely to be reduced.

Presuppositions of determiners are immediately used to disambiguate utterance meaning: A mouse-tracking study on the German language.

The present study investigated how listeners understand and process the definite and the indefinite determiner. While the definite determiner clearly conveys a uniqueness presupposition, the status of the anti-uniqueness inference associated with the indefinite determiner is less clear. In a forced choice production task, we observed that participants make use of the information about number usually associated with the two determiners to convey a message. In a subsequent mouse-tracking task, participants had to select one of two potential referents presented on screen according to an auditorily presented stimulus sentence. The data revealed that participants use the information about uniqueness or anti-uniqueness encoded in determiners to disambiguate sentence meaning as early as possible, but only when they are exclusively faced with felicitous uses of determiners.

N170 reflects orthographic uniqueness point effects in English among native Japanese and Korean readers.

Orthographic uniqueness point (OUP) refers to the letter position of a word at which it is distinguishable from other lexical items in the language. Previous findings of OUP effects have been mixed and mainly demonstrated in native readers of alphabetic languages. The current study investigated whether OUP effects could be shown among non-native readers in a visual repetition detection task. The experiment tested three OUP conditions (early, mid, late) in native English readers and proficient non-native English readers whose native scripts were Japanese or Korean. Results revealed main effects of OUP on N170 amplitude, where early OUP words elicited more negative N170 and late OUP words elicited marginally less negative N170 than mean activation for both native and non-native readers. There was no indication that non-linearity or non-alphabetic nature of one's native script influenced OUP effects. Results were consistent with a parallel letter processing account in single word reading.