Cloze enough? Hemodynamic effects of predictive processing during natural reading.

Evidence accrues that readers form multiple hypotheses about upcoming words. The present study investigated the hemodynamic effects of predictive processing during natural reading by means of combining fMRI and eye movement recordings. In particular, we investigated the neural and behavioral correlates of precision-weighted prediction errors, which are thought to be indicative of subsequent belief updating. Participants silently read sentences in which we manipulated the cloze probability and the semantic congruency of the final word that served as an index for precision and prediction error respectively. With respect to the neural correlates, our findings indicate an enhanced activation within the left inferior frontal and middle temporal gyrus suggesting an effect of precision on prediction update in higher (lexico-)semantic levels. Despite being evident at the neural level, we did not observe any evidence that this mechanism resulted in disproportionate reading times on participants' eye movements. The results speak against discrete predictions, but favor the notion that multiple words are activated in parallel during reading.

Visual field improvement in neglect after virtual reality intervention: a single-case study.

A patient suffering from visuo-spatial neglect was investigated as a special interest case during a study on the effectiveness of "restorative approaches" after visual field loss. This patient trained with our newly developed Virtual Reality (VR) system "Salzburg Visual Field Trainer" for 254 days. Perimetric results show a visual field expansion of 48.8% (left eye) and 36.8% (right eye) translating to an improvement of approximately 5.5° to 10.5° of visual angle. Further, subjective self-report shows improvements of up to 317% in visual field functionality. Our results indicate that patients suffering from visuo-spatial neglect could benefit from a VR-based restorative intervention.

Children struggle beyond preschool-age in a continuous version of the ambiguous figures task.

Children until the age of five are only able to reverse an ambiguous figure when they are informed about the second interpretation. In two experiments, we examined whether children's difficulties would extend to a continuous version of the ambiguous figures task. Children (Experiment 1: 66 3- to 5-year olds; Experiment 2: 54 4- to 9-year olds) and adult controls saw line drawings of animals gradually morph-through well-known ambiguous figures-into other animals. Results show a relatively late developing ability to recognize the target animal, with difficulties extending beyond preschool-age. This delay can neither be explained with improvements in theory of mind, inhibitory control, nor individual differences in eye movements. Even the best achieving children only started to approach adult level performance at the age of 9, suggesting a fundamentally different processing style in children and adults.

Processing of parafoveally presented words. An fMRI study.

The present fMRI study investigated neural correlates of parafoveal preprocessing during reading and the type of information that is accessible from the upcoming - not yet fixated - word. Participants performed a lexical decision flanker task while the constraints imposed by the first three letters (the initial trigram) of parafoveally presented words were controlled. Behavioral results evidenced that the amount of information extracted from parafoveal stimuli, was affected by the difficulty of the foveal stimulus. Easy to process foveal stimuli (i.e., high frequency nouns) allowed parafoveal information to be extracted up to the lexical level. Conversely, when foveal stimuli were difficult to process (orthographically legal nonwords) only constraining trigrams modulated the task performance. Neuroimaging findings showed no effects of lexicality (i.e., difference between words and pseudowords) in the parafovea independently from the difficulty of the foveal stimulus. The constraints imposed by the initial trigrams, however, modulated the hemodynamic response in the left supramarginal gyrus. We interpreted the supramarginal activation as reflecting sublexical (phonological) processes. The missing parafoveal lexicality effect was discussed in relation to findings of experiments which observed effects of parafoveal semantic congruency on electrophysiological correlates.

Sex hormones and number processing. Progesterone and testosterone relate to hemispheric asymmetries during number comparison.

Like many visual stimuli, multi-digit numbers are of a hierarchical nature, with whole number magnitudes depending on individual digit magnitudes. Accordingly, multi-digit numbers can be processed in a holistic (whole number magnitudes) or decomposed manner (digit magnitudes). The compatibility effect during number comparison serves as an indicator of decomposed processing. It is characterized by impaired performance for items where the larger number contains the smaller unit-digit. We were recently able to demonstrate, that the compatibility effect indeed depends on an individual's tendency to process visual hierarchical stimuli on a global or local level. Accordingly, factors affecting global-local processing, should also affect number magnitude processing, i.e. the compatibility effect. Among these factors are hemispheric asymmetries, sex differences and sex hormones (estradiol, progesterone, testosterone). In the present study 39 men and 37 naturally cycling women in their luteal cycle phase completed a number comparison task with stimuli randomly presented to the left and right hemifield. As in previous studies, we observed a larger compatibility effect in the right hemifield (left hemisphere) than in the left hemifield (right hemisphere) and in men than in women. However, this is the first study to evaluate the effects of sex hormones on hemispheric asymmetries during number comparison. We found progesterone to relate to increased hemispheric asymmetries in men, but decreased hemispheric asymmetries in women. Additionally, testosterone was negatively related to hemispheric asymmetries in women's compatibility effect in reaction times. These results add to the growing evidence that sex hormones relate to hemispheric asymmetries in cognitive functions.

Words in Context: The Effects of Length, Frequency, and Predictability on Brain Responses During Natural Reading.

Word length, frequency, and predictability count among the most influential variables during reading. Their effects are well-documented in eye movement studies, but pertinent evidence from neuroimaging primarily stem from single-word presentations. We investigated the effects of these variables during reading of whole sentences with simultaneous eye-tracking and functional magnetic resonance imaging (fixation-related fMRI). Increasing word length was associated with increasing activation in occipital areas linked to visual analysis. Additionally, length elicited a U-shaped modulation (i.e., least activation for medium-length words) within a brain stem region presumably linked to eye movement control. These effects, however, were diminished when accounting for multiple fixation cases. Increasing frequency was associated with decreasing activation within left inferior frontal, superior parietal, and occipito-temporal regions. The function of the latter region-hosting the putative visual word form area-was originally considered as limited to sublexical processing. An exploratory analysis revealed that increasing predictability was associated with decreasing activation within middle temporal and inferior frontal regions previously implicated in memory access and unification. The findings are discussed with regard to their correspondence with findings from single-word presentations and with regard to neurocognitive models of visual word recognition, semantic processing, and eye movement control during reading.

Fixation-related FMRI analysis in the domain of reading research: using self-paced eye movements as markers for hemodynamic brain responses during visual letter string processing.

The present study investigated the feasibility of using self-paced eye movements during reading (measured by an eye tracker) as markers for calculating hemodynamic brain responses measured by functional magnetic resonance imaging (fMRI). Specifically, we were interested in whether the fixation-related fMRI analysis approach was sensitive enough to detect activation differences between reading material (words and pseudowords) and nonreading material (line and unfamiliar Hebrew strings). Reliable reading-related activation was identified in left hemisphere superior temporal, middle temporal, and occipito-temporal regions including the visual word form area (VWFA). The results of the present study are encouraging insofar as fixation-related analysis could be used in future fMRI studies to clarify some of the inconsistent findings in the literature regarding the VWFA. Our study is the first step in investigating specific visual word recognition processes during self-paced natural sentence reading via simultaneous eye tracking and fMRI, thus aiming at an ecologically valid measurement of reading processes. We provided the proof of concept and methodological framework for the analysis of fixation-related fMRI activation in the domain of reading research.

Stronger functional connectivity during reading contextually predictable words in slow readers.

The effect of word predictability is well-documented in terms of local brain activation, but less is known about the functional connectivity among those regions associated with processing predictable words. Evidence from eye movement studies showed that the effect is much more pronounced in slow than in fast readers, suggesting that speed-impaired readers rely more on sentence context to compensate for their difficulties with visual word recognition. The present study aimed to investigate differences in functional connectivity of fast and slow readers within core regions associated with processing predictable words. We hypothesize a stronger synchronization between higher-order language areas, such as the left middle temporal (MTG) and inferior frontal gyrus (IFG), and the left occipito-temporal cortex (OTC) in slow readers. Our results show that slow readers exhibit more functional correlations among these connections; especially between the left IFG and OTC. We interpret our results in terms of the lexical quality hypothesis which postulates a stronger involvement of semantics on orthographic processing in (speed-)impaired readers.

Placebo effect after visual restitution training: no eye-tracking controlled perimetric improvement after visual border stimulation in late subacute and chronic visual field defects after stroke.

Introduction: A significant number of Restitution Training (RT) paradigms claim to ameliorate visual field loss after stroke by re-activating neuronal connections in the residual visual cortex due to repeated bright light-stimulation at the border of the blind and intact fields. However, the effectiveness of RT has been considered controversial both in science and clinical practice for years. The main points of the controversy are (1) the reliability of perimetric results which may be affected by compensatory eye movements and (2) heterogeneous samples consisting of patients with visual field defects and/or visuospatial neglect. Methods: By means of our newly developed and validated Virtual Reality goggles Salzburg Visual Field Trainer (SVFT) 16 stroke patients performed RT on a regular basis for 5 months. By means of our newly developed and validated Eye Tracking Based Visual Field Analysis (EFA), we conducted a first-time full eye-movement-controlled perimetric pre-post intervention study. Additionally, patients subjectively rated the size of their intact visual field. Results: Analysis showed that patients' mean self-assessment of their subjective visual field size indicated statistically significant improvement while, in contrast, objective eye tracking controlled perimetric results revealed no statistically significant effect. Discussion: Bright-light detection RT at the blind-field border solely induced a placebo effect and did not lead to training-induced neuroplasticity in the visual cortex of the type needed to ameliorate the visual field size of stroke patients.

The effect of masks on the recognition of facial expressions: A true-to-life study on the perception of basic emotions.

Mouth-to-nose face masks became ubiquitous due to the COVID-19 pandemic. This ignited studies on the perception of emotions in masked faces. Most of these studies presented still images of an emotional face with a face mask digitally superimposed upon the nose-mouth region. A common finding of these studies is that smiles become less perceivable. The present study investigated the recognition of basic emotions in video sequences of faces. We replicated much of the evidence gathered from presenting still images with digitally superimposed masks. We also unearthed fundamental differences in comparison to existing studies with regard to the perception of smile which is less impeded than previous studies implied.

Eye movements during text reading align with the rate of speech production.

Across languages, the speech signal is characterized by a predominant modulation of the amplitude spectrum between about 4.3 and 5.5 Hz, reflecting the production and processing of linguistic information chunks (syllables and words) every ~200 ms. Interestingly, ~200 ms is also the typical duration of eye fixations during reading. Prompted by this observation, we demonstrate that German readers sample written text at ~5 Hz. A subsequent meta-analysis of 142 studies from 14 languages replicates this result and shows that sampling frequencies vary across languages between 3.9 Hz and 5.2 Hz. This variation systematically depends on the complexity of the writing systems (character-based versus alphabetic systems and orthographic transparency). Finally, we empirically demonstrate a positive correlation between speech spectrum and eye movement sampling in low-skilled non-native readers, with tentative evidence from post hoc analysis suggesting the same relationship in low-skilled native readers. On the basis of this convergent evidence, we propose that during reading, our brain's linguistic processing systems imprint a preferred processing rate-that is, the rate of spoken language production and perception-onto the oculomotor system.

Systematic influence of gaze position on pupil size measurement: analysis and correction.

Cognitive effort is reflected in pupil dilation, but the assessment of pupil size is potentially susceptible to changes in gaze position. This study exemplarily used sentence reading as a stand-in for paradigms that assess pupil size in tasks during which changes in gaze position are unavoidable. The influence of gaze position on pupil size was first investigated by an artificial eye model with a fixed pupil size. Despite its fixed pupil size, the systematic measurements of the artificial eye model revealed substantial gaze-position-dependent changes in the measured pupil size. We evaluated two functions and showed that they can accurately capture and correct the gaze-dependent measurement error of pupil size recorded during a sentence-reading and an effortless z-string-scanning task. Implications for previous studies are discussed, and recommendations for future studies are provided.

Salzburg Visual Field Trainer (SVFT): A virtual reality device for (the evaluation of) neuropsychological rehabilitation.

OBJECTIVE: "Visual Restitution Therapies" (VRT) claim to ameliorate visual field defects of neurological patients by repeated visual light stimulation, leading to training-related neuroplasticity and resulting in reconnection of lesioned neurons in early cortical areas. Because existing systems are stationary, uncomfortable, and unreliable, we developed a training instrument based on virtual reality goggles. The goal of the "Salzburg Visual Field Trainer" (SVFT) is twofold: (1) The device facilitates the clinical evaluation of established neuropsychological rehabilitation approaches, such as VRT. (2) The device enables patients to independently perform VRT based (or other) neuropsychological training methodologies flexibly and comfortably. METHODS AND ANALYSIS: The SVFT was developed on the principles of VRT. Individual configuration of the SVFT is based on perimetric data of the respective patient's visual field. To validate the utmost important aspect of neuropsychological rehabilitation methodologies-that is displaying stimuli precisely in desired locations in the user's visual field-two steps were conducted in this proof-of-concept study: First, we assessed the individual "blind spots" location and extent of 40 healthy, normal sighted participants. This was done with the help of our recently developed perimetric methodology "Eye Tracking Based Visual Field Analysis" (EFA). Second, depending on the individual characteristics of every participant's blind spots, we displayed-by means of the SVFT-15 stimuli in the respective locations of every participants' blind spots and 85 stimuli in the surrounding, intact visual area. The ratio between visible and non-visible stimuli, which is reflected in the behavioral responses (clicks on a remote control) of the 40 participants, provides insight into the accuracy of the SVFT to display training stimuli in areas desired by the investigator. As the blind spot is a naturally occurring, absolute scotoma, we utilized this blind area as an objective criterion and a "simulated" visual field defect to evaluate the theoretical applicability of the SVFT. RESULTS: Outcomes indicate that the SVFT is highly accurate in displaying training stimuli in the desired areas of the user's visual field with an accuracy of 99.0%. Data analysis further showed a sensitivity of .98, specificity of .99, a positive predictive value of .96, a negative predictive value of .996, a hit rate of .99, a random hit rate of .74 and a RATZ-Index of .98. This translates to 14.7% correct non-reactions, 0.7% false non-reactions, 0.3% false reactions and 84.3% correct reactions to displayed test stimuli during the evaluation study. Reports from participants further indicate that the SVFT is comfortable to wear and intuitive to use. CONCLUSIONS: The SVFT can help to investigate the true effects of VRT based methodologies (or other neuropsychological approaches) and the underlying mechanisms of training-related neuroplasticity in the visual cortex in neurological patients suffering from visual field defects.

Anticipating trajectories of exponential growth.

Humans grossly underestimate exponential growth, but are at the same time overconfident in their (poor) judgement. The so-called 'exponential growth bias' is of new relevance in the context of COVID-19, because it explains why humans have fundamental difficulties to grasp the magnitude of a spreading epidemic. Here, we addressed the question, whether logarithmic scaling and contextual framing of epidemiological data affect the anticipation of exponential growth. Our findings show that underestimations were most pronounced when growth curves were linearly scaled and framed in the context of a more advanced epidemic progression. For logarithmic scaling, estimates were much more accurate, on target for growth rates around 31%, and not affected by contextual framing. We conclude that the logarithmic depiction is conducive for detecting exponential growth during an early phase as well as resurgences of exponential growth.

Eye-tracking-based visual field analysis (EFA): a reliable and precise perimetric methodology for the assessment of visual field defects.

OBJECTIVE: Several studies report evidence for training-related neuroplasticity in the visual cortex, while other studies suggest that improvements simply reflect inadequate eye fixation control during perimetric prediagnostics and postdiagnostics. METHODS AND ANALYSIS: To improve diagnostics, a new eye-tracking-based methodology for visual field analysis (eye-tracking-based visual field analysis (EFA)) was developed. The EFA is based on static automated perimetry and additionally takes individual eye movements in real time into account and compensates for them. In the present study, an evaluation of the EFA with the help of blind spots of 58 healthy participants and the individual visual field defects of 23 clinical patients is provided. With the help of the EFA, optical coherence tomography, Goldmann perimetry and a Humphrey field analyser, these natural and acquired scotomas were diagnosed and the results were compared accordingly. RESULTS: The EFA provides a SE of measurement of 0.38° for the right eye (OD) and 0.50° for the left eye (OS), leading to 0.44° of visual angle for both eyes (OU). Based on participants' individual results, the EFA provides disattenuated correlation (validity) of 1.00 for both OD and OS. Results from patients suffering from cortical lesions and glaucoma further indicate that the EFA is capable of diagnosing acquired scotoma validly and is applicable for clinical use. CONCLUSION: Outcomes indicate that the EFA is highly reliable and precise in diagnosing individual shape and location of scotoma and capable of recording changes of visual field defects (after intervention) with unprecedented precision. Test duration is comparable to established instruments and due to the high customisability of the EFA, assessment duration can be shortened by adapting the diagnostic procedure to the patients' individual visual field characteristics. Therefore, the saccade-compensating methodology enables researchers and healthcare professionals to rule out eye movements as a source of inaccuracies in pre-, post-, and follow-up assessments.

Eye-movements during number comparison: Associations to sex and sex hormones.

Multi-digit numbers are of a hierarchical nature with whole number magnitudes depending on digit magnitudes. Processing of multi-digit numbers can occur in a holistic or decomposed fashion. The unit-decade compatibility effect during number comparison is often used as a measure of decomposed processing. It refers to the fact that performance is reduced when the larger number contains the smaller unit digit (e.g. 73 vs. 26). It has been demonstrated that women show a larger compatibility effect than men, which is in accordance with their general tendency towards focusing on stimulus details during processing of visual hierarchical stimuli (local processing style). Such a local processing style has been related to higher progesterone and lower testosterone levels. One method to study individual processing styles is eye-tracking. The aim of the present study was to examine whether sex and sex hormones (estradiol, progesterone, testosterone) relate to eye movement behavior in the number comparison task. Unlike previous studies we found no evidence for sex differences in the behavioral compatibility effect. Nevertheless, women look more often and longer at individual digits and show a stronger compatibility effect in fixation durations compared to men, while men show more saccades between numbers than women. Estradiol and progesterone were related to fewer fixations and shorter fixation durations and more saccades between numbers in men, but not in women. Furthermore, the compatibility effect in the number of fixations and fixation durations was negatively related to testosterone in women. In summary, this is the first study to demonstrate sex differences and sex hormone influences on eye gaze behavior during number comparison.

Co-registration of eye movements and neuroimaging for studying contextual predictions in natural reading.

Sixteen years ago, Sereno and Rayner (2003. Measuring word recognition in reading: eye movements and event-related potentials. Trends in Cognitive Sciences, 7(11), 489-493) illustrated how "by means of review and comparison" eye movement (EM) and event-related potential (ERP) studies may advance our understanding of visual word recognition. Attempts to simultaneously record EMs and ERPs soon followed. Recently, this co-registration approach has also been transferred to fMRI and oscillatory EEG. With experimental settings close to natural reading, co-registration enables us to directly integrate insights from EM and neuroimaging studies. This should extend current experimental paradigms by moving the field towards studying sentence-level processing including effects of context and parafoveal preview. This article will introduce the basic principles and applications of co-registration and selectively review how this approach may shed light on one of the most controversially discussed issues in reading research, contextual predictions in online language processing.

Spill the load: Mixed evidence for a foveal load effect, reliable evidence for a spillover effect in eye-movement control during reading.

It has been hypothesized that the processing difficulty of the fixated word (i.e., "foveal load") modulates the amount of parafoveal preprocessing of the next word. Evidence for the hypothesis has been provided by the application of parafoveal masks within the boundary paradigm. Other studies that applied alternative means of manipulating the parafoveal preview (i.e., visual degradation) could not replicate the effect of foveal load. The present study examined the effect of foveal load by directly comparing the application of parafoveal masks (Exp. 1) with the alternative manipulation of visually degrading the parafoveal preview (Exp. 2) in adult readers. Contrary to expectation, we did not find the foveal-load interaction in the first experiment with traditional letter masks. We did, however, find the expected interaction in the second experiment with visually degraded previews. Both experiments revealed a spillover effect indicating that the processing of a word is not (always) fully completed when the reader already fixates the next word (i.e., processing "spills over" to the next word). The implications for models of eye-movement control in reading are discussed.

No Effect of cathodal tDCS of the posterior parietal cortex on parafoveal preprocessing of words.

The present study investigated the functional role of the posterior parietal cortex during the processing of parafoveally presented letter strings. To this end, we simultaneously presented two letter strings (word or pseudoword) - one foveally and one parafoveally - and asked the participants to indicate the presence of a word (i.e., lexical decision flanker task). We applied cathodal transcranial direct current stimulation (tDCS) over the posterior parietal cortex in order to establish causal links between brain activity and lexical decision performance (accuracy and latency). The results indicated that foveal stimulus difficulty affected the amount of parafoveally processed information. Bayes factor analysis showed no effects of brain stimulation suggesting that posterior parietal cathodal tDCS does not modulate attention-related processes during parafoveal preprocessing. This result is discussed in the context of recent tDCS studies on attention and performance.

An investigation of parafoveal masks with the incremental boundary paradigm.

Most of what we know about parafoveal preprocessing during reading is based on the boundary paradigm in combination with parafoveal masks as a presumably neutral baseline condition. Recent evidence questions the neutrality of the baseline condition by showing that parafoveal masks inflict preview costs. Using a novel, incremental boundary paradigm we studied the effect of parafoveal masks. Manipulating the salience of parafoveal previews, we found that increasing salience of the masks resulted in increasingly longer fixation times on target words, but also on pretarget words-suggesting preview costs. We conclude that the hidden preview costs of parafoveal masks in the classical boundary paradigm inflate the processing times for the baseline condition and hence lead to an overestimation of the preview benefit. Thus, the present study questions the validity of some of the conclusions drawn on the basis of the classical boundary paradigm.