EXPRESS: Sandhi-based predictability of pitch accent facilitates word recognition in Kansai Japanese speakers.

We investigated the predictability effects of pitch accent on word recognition using the sandhi rule in Kansai Japanese (KJ). Native KJ speakers and native Tokyo Japanese (TJ) speakers (control group) saw four objects while hearing modifier + noun phrases in a speeded image-selection task. The register tone of the noun's initial mora was predictable or unpredictable based on the tone of the modifier's final mora in KJ but not in TJ. Experiment 1 found faster reaction times in the predictable vs. unpredictable condition in KJ speakers but only when the modifier had an all-low tone. This suggests that the modifier ending that changes following the sandhi rule functions as a reliable cue to constrain an upcoming tone, whereas the modifier ending that remains the same does not (although the next tone is predictable). Unexpectedly, we found the same but weaker effect in TJ speakers. Experiment 2 replicated this effect and additionally showed that the facilitation effect was not because TJ speakers were exposed to KJ well enough to become familiar with the KJ sandhi rule. We speculate that the effect in TJ speakers is related to a language-universal constraint against a sequence of low tones without a high tone within a phonological word, which may urge listeners to listen for a high tone in the upcoming input.

Analysing data from the psycholinguistic visual-world paradigm: Comparison of different analysis methods.

In this paper, we discuss key characteristics and typical experimental designs of the visual-world paradigm and compare different methods of analysing eye-movement data. We discuss the nature of the eye-movement data from a visual-world study and provide data analysis tutorials on ANOVA, t-tests, linear mixed-effects model, growth curve analysis, cluster-based permutation analysis, bootstrapped differences of timeseries, generalised additive modelling, and divergence point analysis to enable psycholinguists to apply each analytical method to their own data. We discuss advantages and disadvantages of each method and offer recommendations about how to select an appropriate method depending on the research question and the experimental design.

Situating language register across the ages, languages, modalities, and cultural aspects: Evidence from complementary methods.

In the present review paper by members of the collaborative research center "Register: Language Users' Knowledge of Situational-Functional Variation" (CRC 1412), we assess the pervasiveness of register phenomena across different time periods, languages, modalities, and cultures. We define "register" as recurring variation in language use depending on the function of language and on the social situation. Informed by rich data, we aim to better understand and model the knowledge involved in situation- and function-based use of language register. In order to achieve this goal, we are using complementary methods and measures. In the review, we start by clarifying the concept of "register", by reviewing the state of the art, and by setting out our methods and modeling goals. Against this background, we discuss three key challenges, two at the methodological level and one at the theoretical level: (1) To better uncover registers in text and spoken corpora, we propose changes to established analytical approaches. (2) To tease apart between-subject variability from the linguistic variability at issue (intra-individual situation-based register variability), we use within-subject designs and the modeling of individuals' social, language, and educational background. (3) We highlight a gap in cognitive modeling, viz. modeling the mental representations of register (processing), and present our first attempts at filling this gap. We argue that the targeted use of multiple complementary methods and measures supports investigating the pervasiveness of register phenomena and yields comprehensive insights into the cross-methodological robustness of register-related language variability. These comprehensive insights in turn provide a solid foundation for associated cognitive modeling.

Everyday Language Exposure Shapes Prediction of Specific Words in Listening Comprehension: A Visual World Eye-Tracking Study.

We investigated the effects of everyday language exposure on the prediction of orthographic and phonological forms of a highly predictable word during listening comprehension. Native Japanese speakers in Tokyo (Experiment 1) and Berlin (Experiment 2) listened to sentences that contained a predictable word and viewed four objects. The critical object represented the target word (e.g., /sakana/; fish), an orthographic competitor (e.g., /tuno/; horn), a phonological competitor (e.g., /sakura/; cherry blossom), or an unrelated word (e.g., /hon/; book). The three other objects were distractors. The Tokyo group fixated the target and the orthographic competitor over the unrelated objects before the target word was mentioned, suggesting that they pre-activated the orthographic form of the target word. The Berlin group showed a weaker bias toward the target than the Tokyo group, and they showed a tendency to fixate the orthographic competitor only when the orthographic similarity was very high. Thus, prediction effects were weaker in the Berlin group than in the Tokyo group. We found no evidence for the prediction of phonological information. The obtained group differences support probabilistic models of prediction, which regard the built-up language experience as a basis of prediction.

Prediction of phonological and gender information: An event-related potential study in Italian.

Do people predict different aspects of a predictable word to the same extent? We tested prediction of phonological and gender information by creating phonological and gender mismatches between an article and a predictable noun in Italian. Native Italian speakers read predictive sentence contexts followed by the expected noun (e.g., un incidente: 'accident') or another plausible, but unexpected noun, either beginning with a different phonological class (consonant vs. vowel, e.g., uno scontro: 'collision'; phonological mismatch) or belonging to a different gender class (e.g., un'inondazione: 'flooding'; gender mismatch). Phonological mismatch articles elicited greater negativity than expected articles at posterior channels around 450-800 ms post-stimulus. In contrast, gender mismatch articles elicited greater negativity than expected articles at left posterior channels around 250-800 ms. Unexpected nouns showed an N400 effect followed by frontal positivity relative to expected nouns. The earlier effect for the gender mismatch articles suggests that people are quicker or more likely to pre-activate gender information vs. phonological information of a predictable word. We interpret the results with respect to production-based prediction accounts.

Dissociable effects of prediction and integration during language comprehension: evidence from a large-scale study using brain potentials.

Composing sentence meaning is easier for predictable words than for unpredictable words. Are predictable words genuinely predicted, or simply more plausible and therefore easier to integrate with sentence context? We addressed this persistent and fundamental question using data from a recent, large-scale (n = 334) replication study, by investigating the effects of word predictability and sentence plausibility on the N400, the brain's electrophysiological index of semantic processing. A spatio-temporally fine-grained mixed-effect multiple regression analysis revealed overlapping effects of predictability and plausibility on the N400, albeit with distinct spatio-temporal profiles. Our results challenge the view that the predictability-dependent N400 reflects the effects of either prediction or integration, and suggest that semantic facilitation of predictable words arises from a cascade of processes that activate and integrate word meaning with context into a sentence-level meaning. This article is part of the theme issue 'Towards mechanistic models of meaning composition'.

Prediction of orthographic information during listening comprehension: A printed-word visual world study.

Two visual world eye-tracking experiments examined the role of orthographic information in the visual context in pre-activation of orthographic and phonological information using Japanese. Participants heard sentences that contained a predictable target word and viewed a display showing four words in a logogram, kanji (Experiment 1) or in a phonogram, hiragana (Experiment 2). The four words included either the target word (e.g., /sakana/; fish), an orthographic competitor (e.g., /tuno/; horn), a phonological competitor (e.g., /sakura/; cherry blossom), or an unrelated word (e.g., /hon/; book), together with three distractor words. The orthographic competitor was orthographically or phonologically dissimilar to the target in hiragana. In Experiment 1, target and orthographic competitor words attracted more fixations than unrelated words before the target word was mentioned, suggesting that participants pre-activated orthographic form of the target word. In Experiment 2, target and phonological competitor words attracted more predictive fixations than unrelated words, but orthographic competitor words did not, suggesting a critical role of the visual context. This pre-activation pattern does not fit with the pattern of lexical activation in auditory word recognition, where orthography and phonology interact. However, it is compatible with the pattern of lexical activation in spoken word production, where orthographic information is not automatically activated, in line with production-based prediction accounts.

Large-scale replication study reveals a limit on probabilistic prediction in language comprehension.

Do people routinely pre-activate the meaning and even the phonological form of upcoming words? The most acclaimed evidence for phonological prediction comes from a 2005 Nature Neuroscience publication by DeLong, Urbach and Kutas, who observed a graded modulation of electrical brain potentials (N400) to nouns and preceding articles by the probability that people use a word to continue the sentence fragment ('cloze'). In our direct replication study spanning 9 laboratories (N=334), pre-registered replication-analyses and exploratory Bayes factor analyses successfully replicated the noun-results but, crucially, not the article-results. Pre-registered single-trial analyses also yielded a statistically significant effect for the nouns but not the articles. Exploratory Bayesian single-trial analyses showed that the article-effect may be non-zero but is likely far smaller than originally reported and too small to observe without very large sample sizes. Our results do not support the view that readers routinely pre-activate the phonological form of predictable words.

On predicting form and meaning in a second language.

We used event-related potentials (ERP) to investigate whether Spanish-English bilinguals preactivate form and meaning of predictable words. Participants read high-cloze sentence contexts (e.g., "The student is going to the library to borrow a . . ."), followed by the predictable word (book), a word that was form-related (hook) or semantically related (page) to the predictable word, or an unrelated word (sofa). Word stimulus onset synchrony (SOA) was 500 ms (Experiment 1) or 700 ms (Experiment 2). In both experiments, all nonpredictable words elicited classic N400 effects. Form-related and unrelated words elicited similar N400 effects. Semantically related words elicited smaller N400s than unrelated words, which however, did not depend on cloze value of the predictable word. Thus, we found no N400 evidence for preactivation of form or meaning at either SOA, unlike native-speaker results (Ito, Corley et al., 2016). However, non-native speakers did show the post-N400 posterior positivity (LPC effect) for form-related words like native speakers, but only at the slower SOA. This LPC effect increased gradually with cloze value of the predictable word. We do not interpret this effect as necessarily demonstrating prediction, but rather as evincing combined effects of top-down activation (contextual meaning) and bottom-up activation (form similarity) that result in activation of unseen words that fit the context well, thereby leading to an interpretation conflict reflected in the LPC. Although there was no evidence that non-native speakers preactivate form or meaning, non-native speakers nonetheless appear to use bottom-up and top-down information to constrain incremental interpretation much like native speakers do. (PsycINFO Database Record