Sentence-final completion norms for 2925 Mexican Spanish sentence contexts.

Sentence-final completion tasks serve as valuable tools in studying language processing and the associated predictive mechanisms. There are several established sentence-completion norms for languages like English, Portuguese, French, and Spanish, each tailored to the language it was designed for and evaluated in. Yet, cultural variations among native speakers of the same language complicate the claim of a universal application of these norms. In this study, we developed a corpus of 2925 sentence-completion norms specifically for Mexican Spanish. This corpus is distinctive for several reasons: Firstly, it is the most comprehensive set of sentence-completion norms for Mexican Spanish to date. Secondly, it offers a substantial range of experimental stimuli with considerable variability in terms of the predictability of word sentence completion (cloze probability/surprisal) and the level of uncertainty inherent in the sentence context (entropy). Thirdly, the syntactic complexity of the sentences in the corpus is varied, as are the characteristics of the final word nouns (including aspects of concreteness/abstractness, length, and frequency). This paper details the generation of the sentence contexts, explains the methodology employed for data collection from a total of 1470 participants, and outlines the approach to data analysis for the establishment of sentence-completion norms. These norms provide a significant contribution to fields such as linguistics, cognitive science, and machine learning, among others, by enhancing our understanding of language, predictive mechanisms, knowledge representation, and context representation. The collected data is accessible through the Open Science Framework (OSF) at the following link: https://osf.io/js359/?view_only=bb1b328d37d643df903ed69bb2405ac0 .

Cloze probability, predictability ratings, and computational estimates for 205 English sentences, aligned with existing EEG and reading time data.

We release a database of cloze probability values, predictability ratings, and computational estimates for a sample of 205 English sentences (1726 words), aligned with previously released word-by-word reading time data (both self-paced reading and eye-movement records; Frank et al., Behavior Research Methods, 45(4), 1182-1190. 2013) and EEG responses (Frank et al., Brain and Language, 140, 1-11. 2015). Our analyses show that predictability ratings are the best predictors of the EEG signal (N400, P600, LAN) self-paced reading times, and eye movement patterns, when spillover effects are taken into account. The computational estimates are particularly effective at explaining variance in the eye-tracking data without spillover. Cloze probability estimates have decent overall psychometric accuracy and are the best predictors of early fixation patterns (first fixation duration). Our results indicate that the choice of the best measurement of word predictability in context critically depends on the processing index being considered.

Filling the gap: Cloze probability and sentence constraint norms for 807 European Portuguese sentences.

Sentence processing is affected by the sentence context and word expectancy. To investigate sentence comprehension experimentally, it is useful to have sentence completion norms with both context constraint and word expectancy measures. In this study, two experiments were conducted to collect norms for completion of 807 European Portuguese sentences. Context constraint was measured through type-token ratio and proportion idiosyncratic responses, while word expectancy was assessed by cloze probability. Besides establishing norms for a large sample of sentences, the study investigated the impact of the production procedure and method of analysis. In Experiment 1, a single-production procedure was used, i.e., participants completed each sentence fragment with only a single response, whereas in Experiment 2, a multiple-production procedure was used, i.e., participants have to provide up to three completion words for each sentence fragment. In Experiment 2, the analyses were obtained using two distinct methods: first-response analysis and combined-response analysis. The results showed that cloze and context measures are comparable between production paradigms and that the results from both analysis methods were correlated. The advantages of each production procedure and analysis method are discussed.

Completion norms for 3085 English sentence contexts.

In everyday language processing, sentence context affects how readers and listeners process upcoming words. In experimental situations, it can be useful to identify words that are predicted to greater or lesser degrees by the preceding context. Here we report completion norms for 3085 English sentences, collected online using a written cloze procedure in which participants were asked to provide their best guess for the word completing a sentence. Sentences varied between eight and ten words in length. At least 100 unique participants contributed to each sentence. All responses were reviewed by human raters to mitigate the influence of mis-spellings and typographical errors. The responses provide a range of predictability values for 13,438 unique target words, 6790 of which appear in more than one sentence context. We also provide entropy values based on the relative predictability of multiple responses. A searchable set of norms is available at http://sentencenorms.net . Finally, we provide the code used to collate and organize the responses to facilitate additional analyses and future research projects.

Normative Data for Novel Nominal Metaphors, Novel Similes, Literal, and Anomalous Utterances in Polish and English.

The two studies reported in the article provide normative measures for 120 novel nominal metaphors, 120 novel similes, 120 literal sentences, and 120 anomalous utterances in Polish (Study 1) and in English (Study 2). The presented set is ideally suited to addressing methodological requirements in research on metaphor processing. The critical (sentence-final) words of each utterance were controlled for in terms of their frequency per million, number of letters and syllables. For each condition in each language, the following variables are reported: cloze probability, meaningfulness, metaphoricity, and familiarity, whose results confirm that the sentences are well-matched. Consequently, the present paper provides materials that can be employed in order to test the new as well as existing theories of metaphor comprehension. The results obtained from the series of normative tests showed the same pattern in both studies, where the comparison structure present in similes (i.e., A is like B) facilitated novel metaphor comprehension, as compared to categorical statements (i.e., A is B). It therefore indicates that comparison mechanisms might be engaged in novel meaning construction irrespectively of language-specific syntactic rules.

Limits on lexical prediction during reading.

Efficient language processing may involve generating expectations about upcoming input. To investigate the extent to which prediction might facilitate reading, a large-scale survey provided cloze scores for all 2689 words in 55 different text passages. Highly predictable words were quite rare (5% of content words), and most words had a more-expected competitor. An eye-tracking study showed sensitivity to cloze probability but no mis-prediction cost. Instead, the presence of a more-expected competitor was found to be facilitative in several measures. Further, semantic and morphosyntactic information was highly predictable even when word identity was not, and this information facilitated reading above and beyond the predictability of the full word form. The results are consistent with graded prediction but inconsistent with full lexical prediction. Implications for theories of prediction in language comprehension are discussed.

Occipital and orbitofrontal hemodynamics during naturally paced reading: an fNIRS study.

Humans typically read at incredibly fast rates, because they predict likely occurring words from a given context. Here, we used functional near-infrared spectroscopy (fNIRS) to track the ultra-rapid hemodynamic responses of words presented every 280 ms in a naturally paced sentence context. We found a lower occipital deoxygenation to unpredictable than to predictable words. The greater hemodynamic responses to unexpected words suggest that the visual features of expected words have been pre-activated previous to stimulus presentation. Second, we tested opposing theoretical proposals about the role of the medial orbitofrontal cortex (OFC): Either OFC may respond to the breach of expectation; or OFC is activated when the present stimulus matches the prediction. A significant interaction between word frequency and predictability indicated OFC responses to breaches of expectation for low- but not for high-frequency words: OFC is sensitive to both, bottom-up processing as mediated by word frequency, as well as top-down predictions. Particularly, when a rare word is unpredictable, OFC becomes active. Finally, we discuss how a high temporal resolution can help future studies to disentangle the hemodynamic responses of single trials in such an ultra-rapid event succession as naturally paced reading.

Predictive processing of music and language in autism: Evidence from Mandarin and English speakers.

Atypical predictive processing has been associated with autism across multiple domains, based mainly on artificial antecedents and consequents. As structured sequences where expectations derive from implicit learning of combinatorial principles, language and music provide naturalistic stimuli for investigating predictive processing. In this study, we matched melodic and sentence stimuli in cloze probabilities and examined musical and linguistic prediction in Mandarin- (Experiment 1) and English-speaking (Experiment 2) autistic and non-autistic individuals using both production and perception tasks. In the production tasks, participants listened to unfinished melodies/sentences and then produced the final notes/words to complete these items. In the perception tasks, participants provided expectedness ratings of the completed melodies/sentences based on the most frequent notes/words in the norms. While Experiment 1 showed intact musical prediction but atypical linguistic prediction in autism in the Mandarin sample that demonstrated imbalanced musical training experience and receptive vocabulary skills between groups, the group difference disappeared in a more closely matched sample of English speakers in Experiment 2. These findings suggest the importance of taking an individual differences approach when investigating predictive processing in music and language in autism, as the difficulty in prediction in autism may not be due to generalized problems with prediction in any type of complex sequence processing.

Evoking the N400 Event-related Potential (ERP) Component Using a Publicly Available Novel Set of Sentences with Semantically Incongruent or Congruent Eggplants (Endings).

During speech comprehension, the ongoing context of a sentence is used to predict sentence outcome by limiting subsequent word likelihood. Neurophysiologically, violations of context-dependent predictions result in amplitude modulations of the N400 event-related potential (ERP) component. While the N400 is widely used to measure semantic processing and integration, no publicly-available auditory stimulus set is available to standardize approaches across the field. Here, we developed an auditory stimulus set of 442 sentences that utilized the semantic anomaly paradigm, measured cloze probability for all stimuli, and was made for both children and adults. With 20 neurotypical adults, we validated that this set elicits robust N400's, as well as two additional semantically-related ERP components: the recognition potential (∼ 250 ms) and the late positivity component (∼ 600 ms). This stimulus set (https://doi.org/10.5061/dryad.9ghx3ffkg) and the 20 high-density (128-channel) electrophysiological datasets (https://doi.org/10.5061/dryad.6wwpzgmx4) are made publicly available to promote data sharing and reuse. Future studies that use this stimulus set to investigate sentential semantic comprehension in both control and clinical populations may benefit from the increased comparability and reproducibility within this field of research.

Love thy neighbor: Facilitation and inhibition in the competition between parallel predictions.

Ample evidence suggests that during word recognition and production, simultaneously activated lexical and sublexical representations interact, demonstrating varied patterns of facilitation and inhibition in various tasks and measures. A separate line of research has led to a growing consensus that prediction during sentence processing involves activating multiple possible predictions. However, very little is known about the nature of the interactions between parallel predictions. The current study employed a speeded cloze task to probe competition between simultaneously activated predictions. We focused on the modal response (the most probable completion for a sentence) and its strongest competitor (the second most probable completion). Examining production latencies of the modal response, the results showed an interaction between competitor strength and the semantic relatedness between the competitor and the modal: when the two were related, the stronger the competitor was, the more it facilitated production; however, when the two were unrelated, the stronger the competitor was, the more inhibition it caused. These results contrast with the pattern observed for the influences of near and distant semantic neighbors on word recognition and production. However, we show that when the different nature of the tasks is taken into consideration, these patterns of interaction between parallel predictions can be accounted for by the interactive activation and competition (IAC) model used to account for previous neighborhood effects (Chen & Mirman, 2012).

Study of differences between patients with schizophrenia and healthy people in semantic processing.

Semantic processing is important in language comprehension and production, and context can facilitate understanding and accelerate processing speed by pre-activating semantically related words. There are many studies suggesting that patients with schizophrenia have inferior language ability. This study was aimed to examine the differences between patients with schizophrenia and healthy people in semantic processing with Chinese classifier-noun pairs rating tasks. Participants were required to finish rating tasks to judge acceptability of classifier-noun pairs. Also, the Positive and Negative Syndrome Scale (PANSS) was conducted in the schizophrenia group. According to results of variance analysis, schizophrenic patients' accuracy of judgment on the acceptability of classifier-noun pairs differed from the control group (F = 4.13, p < .05), and the contextual effect of classifier constraint could be observed in healthy people (F(1, 31) = 5.38, p < .05) but not in patients with schizophrenia (F(1, 25) = 3.55, p = .07), indicating that they failed to use the contextual information to facilitate language comprehension as healthy people. Stepwise linear regression analysis found that hostility, poor impulse control and suspiciousness/persecution and preoccupation in the PANSS may have contributed to the reduced sensitivity in the rating in patients (t = -2.38-3.80, p < .05).

Are Linguistic Prediction Deficits Characteristic of Adults with Dyslexia?

Individuals with dyslexia show deficits in phonological abilities, rapid automatized naming, short-term/working memory, processing speed, and some aspects of sensory and visual processing. There is currently one report in the literature that individuals with dyslexia also show impairments in linguistic prediction. The current study sought to investigate prediction in language processing in dyslexia. Forty-one adults with dyslexia and 43 typically-developing controls participated. In the experiment, participants made speeded-acceptability judgements in sentences with word final cloze manipulations. The final word was a high-cloze probability word, a low-cloze probability word, or a semantically anomalous word. Reaction time from the onset of the final word to participants' response was recorded. Results indicated that individuals with dyslexia showed longer reaction times, and crucially, they showed clear differences from controls in low predictability sentences, which is consistent with deficits in linguistic prediction. Conclusions focus on the mechanism supporting prediction in language comprehension and possible reasons why individuals with dyslexia show less prediction.

Semantic Prediction in Brain and Mind.

We highlight a novel brain correlate of prediction, the prediction potential (or PP), a slow negative-going potential shift preceding visual, acoustic, and spoken or written verbal stimuli that can be predicted from their context. The cortical sources underlying the prediction potential reflect perceptual and semantic features of anticipated stimuli before these appear.

Studying Musical and Linguistic Prediction in Comparable Ways: The Melodic Cloze Probability Method.

Prediction or expectancy is thought to play an important role in both music and language processing. However, prediction is currently studied independently in the two domains, limiting research on relations between predictive mechanisms in music and language. One limitation is a difference in how expectancy is quantified. In language, expectancy is typically measured using the cloze probability task, in which listeners are asked to complete a sentence fragment with the first word that comes to mind. In contrast, previous production-based studies of melodic expectancy have asked participants to sing continuations following only one to two notes. We have developed a melodic cloze probability task in which listeners are presented with the beginning of a novel tonal melody (5-9 notes) and are asked to sing the note they expect to come next. Half of the melodies had an underlying harmonic structure designed to constrain expectations for the next note, based on an implied authentic cadence (AC) within the melody. Each such 'authentic cadence' melody was matched to a 'non-cadential' (NC) melody matched in terms of length, rhythm and melodic contour, but differing in implied harmonic structure. Participants showed much greater consistency in the notes sung following AC vs. NC melodies on average. However, significant variation in degree of consistency was observed within both AC and NC melodies. Analysis of individual melodies suggests that pitch prediction in tonal melodies depends on the interplay of local factors just prior to the target note (e.g., local pitch interval patterns) and larger-scale structural relationships (e.g., melodic patterns and implied harmonic structure). We illustrate how the melodic cloze method can be used to test a computational model of melodic expectation. Future uses for the method include exploring the interplay of different factors shaping melodic expectation, and designing experiments that compare the cognitive mechanisms of prediction in music and language.