The link between visual exploration and neuronal activity: a multi-modal study combining eye tracking, functional magnetic resonance imaging and transcranial magnetic stimulation.

In the present multi-modal study we aimed to investigate the role of visual exploration in relation to the neuronal activity and performance during visuospatial processing. To this end, event related functional magnetic resonance imaging er-fMRI was combined with simultaneous eye tracking recording and transcranial magnetic stimulation (TMS). Two groups of twenty healthy subjects each performed an angle discrimination task with different levels of difficulty during er-fMRI. The number of fixations as a measure of visual exploration effort was chosen to predict blood oxygen level-dependent (BOLD) signal changes using the general linear model (GLM). Without TMS, a positive linear relationship between the visual exploration effort and the BOLD signal was found in a bilateral fronto-parietal cortical network, indicating that these regions reflect the increased number of fixations and the higher brain activity due to higher task demands. Furthermore, the relationship found between the number of fixations and the performance demonstrates the relevance of visual exploration for visuospatial task solving. In the TMS group, offline theta bursts TMS (TBS) was applied over the right posterior parietal cortex (PPC) before the fMRI experiment started. Compared to controls, TBS led to a reduced correlation between visual exploration and BOLD signal change in regions of the fronto-parietal network of the right hemisphere, indicating a disruption of the network. In contrast, an increased correlation was found in regions of the left hemisphere, suggesting an intent to compensate functionality of the disturbed areas. TBS led to fewer fixations and faster response time while keeping accuracy at the same level, indicating that subjects explored more than actually needed.

Reading on LCD vs e-Ink displays: effects on fatigue and visual strain.

PURPOSE: Most recently light and mobile reading devices with high display resolutions have become popular and they may open new possibilities for reading applications in education, business and the private sector. The ability to adapt font size may also open new reading opportunities for people with impaired or low vision. Based on their display technology two major groups of reading devices can be distinguished. One type, predominantly found in dedicated e-book readers, uses electronic paper also known as e-Ink. Other devices, mostly multifunction tablet-PCs, are equipped with backlit LCD displays. While it has long been accepted that reading on electronic displays is slow and associated with visual fatigue, this new generation is explicitly promoted for reading. Since research has shown that, compared to reading on electronic displays, reading on paper is faster and requires fewer fixations per line, one would expect differential effects when comparing reading behaviour on e-Ink and LCD. In the present study we therefore compared experimentally how these two display types are suited for reading over an extended period of time. METHODS: Participants read for several hours on either e-Ink or LCD, and different measures of reading behaviour and visual strain were regularly recorded. These dependent measures included subjective (visual) fatigue, a letter search task, reading speed, oculomotor behaviour and the pupillary light reflex. RESULTS: Results suggested that reading on the two display types is very similar in terms of both subjective and objective measures. CONCLUSIONS: It is not the technology itself, but rather the image quality that seems crucial for reading. Compared to the visual display units used in the previous few decades, these more recent electronic displays allow for good and comfortable reading, even for extended periods of time.

About the role of visual field defects in pure alexia.

Pure alexia is an acquired reading disorder characterized by a disproportionate prolongation of reading time as a function of word length. Although the vast majority of cases reported in the literature show a right-sided visual defect, little is known about the contribution of this low-level visual impairment to their reading difficulties. The present study was aimed at investigating this issue by comparing eye movement patterns during text reading in six patients with pure alexia with those of six patients with hemianopic dyslexia showing similar right-sided visual field defects. We found that the role of the field defect in the reading difficulties of pure alexics was highly deficit-specific. While the amplitude of rightward saccades during text reading seems largely determined by the restricted visual field, other visuo-motor impairments-particularly the pronounced increases in fixation frequency and viewing time as a function of word length-may have little to do with their visual field defect. In addition, subtracting the lesions of the hemianopic dyslexics from those found in pure alexics revealed the largest group differences in posterior parts of the left fusiform gyrus, occipito-temporal sulcus and inferior temporal gyrus. These regions included the coordinate assigned to the centre of the visual word form area in healthy adults, which provides further evidence for a relation between pure alexia and a damaged visual word form area. Finally, we propose a list of three criteria that may improve the differential diagnosis of pure alexia and allow appropriate therapy recommendations.

Interhemispheric balance of overt attention: a theta burst stimulation study.

Interhemispheric imbalance is discussed as a pathophysiological mechanism in visuospatial neglect. It is suggested that after a lesion of the right hemisphere the mutual transcallosal inhibition is impaired, resulting in an increased activity of the left hemisphere. We investigated the interhemispheric balance of attention in healthy subjects by using a free visual exploration task and by interfering with the neural activity of the posterior parietal cortex (PPC) of either hemisphere using an inhibitory transcranial magnetic stimulation routine with theta burst stimulation (TBS). Subjects explored colour photographs of real-life scenes presented on a computer screen under four conditions: (i) without TBS; (ii) after TBS over the right PPC; (iii) after TBS over the left PPC; and (iv) after TBS over the right PPC and, after the first half of the task, over the left PPC. Eye movements were measured, and distribution of mean cumulative fixation duration over screen halves was analyzed. TBS over the right PPC resulted in a significant rightward shift of mean cumulative fixation duration of approximately 30 min. The shift could be reversed when a subsequent train of TBS was applied over the left PPC. However, left PPC stimulation alone had no significant effect on visual exploration behaviour. The present study shows that the effect of TBS on the PPC depends on which hemisphere is stimulated and on the state of the contralateral homologue area. These findings are in accordance with the predictions of the interhemispheric rivalry model in neglect.

Sight-reading of violinists: eye movements anticipate the musical flow.

When sight-reading a piece of music the eyes constantly scan the score slightly ahead of music execution. This separation between reading and acting is commonly termed eye-hand span and can be expressed in two ways: as anticipation in notes or in time. Previous research, predominantly in piano players, found skill-dependent differences of eye-hand span. To date no study has explored visual anticipation in violinists. The present study investigated how structural properties of a piece of music affect the eye-hand span in a group of violinists. To this end eye movements and bow reversals were recorded synchronously while musicians sight-read a piece of music. The results suggest that structural differences of the score are reflected in the eye-hand span in a way similar to skill level. Specifically, the piece with higher complexity was associated with lower anticipation in notes, longer fixation duration and a tendency for more regressive fixations. Anticipation in time, however, remained the same (approximately 1 s) independently of the score played but was correlated with playing tempo. We conclude that the eye-hand span is not only influenced by the experience of the musician, but also by the structure of the score to be played.

Neglect-like visual exploration behaviour after theta burst transcranial magnetic stimulation of the right posterior parietal cortex.

The right posterior parietal cortex (PPC) is critically involved in visual exploration behaviour, and damage to this area may lead to neglect of the left hemispace. We investigated whether neglect-like visual exploration behaviour could be induced in healthy subjects using theta burst repetitive transcranial magnetic stimulation (rTMS). To this end, one continuous train of theta burst rTMS was applied over the right PPC in 12 healthy subjects prior to a visual exploration task where colour photographs of real-life scenes were presented on a computer screen. In a control experiment, stimulation was also applied over the vertex. Eye movements were measured, and the distribution of visual fixations in the left and right halves of the screen was analysed. In comparison to the performance of 28 control subjects without stimulation, theta burst rTMS over the right PPC, but not the vertex, significantly decreased cumulative fixation duration in the left screen-half and significantly increased cumulative fixation duration in the right screen-half for a time period of 30 min. These results suggest that theta burst rTMS is a reliable method of inducing transient neglect-like visual exploration behaviour.

The feeling of fluent perception: a single experience from multiple asynchronous sources.

Zeki and co-workers recently proposed that perception can best be described as locally distributed, asynchronous processes that each create a kind of microconsciousness, which condense into an experienced percept. The present article is aimed at extending this theory to metacognitive feelings. We present evidence that perceptual fluency-the subjective feeling of ease during perceptual processing-is based on speed of processing at different stages of the perceptual process. Specifically, detection of briefly presented stimuli was influenced by figure-ground contrast, but not by symmetry (Experiment 1) or the font (Experiment 2) of the stimuli. Conversely, discrimination of these stimuli was influenced by whether they were symmetric (Experiment 1) and by the font they were presented in (Experiment 2), but not by figure-ground contrast. Both tasks however were related with the subjective experience of fluency (Experiments 1 and 2). We conclude that subjective fluency is the conscious phenomenal correlate of different processing stages in visual perception.

When left becomes right and vice versa: mirrored vision after cerebral hypoxia.

The combination of acquired mirror writing and reading is an extremely rare neurological disorder. It is encountered when brain damaged patients prefer horizontally mirrored over normal script in writing and reading. Previous theories have related this pathology to a disinhibition of mirrored engrams in the non-dominant hemisphere, possibly accompanied by a reversal of the preferred scanning direction. Here, we report the experimental investigation of PR, a patient who developed pronounced mirror writing and reading following septic shock that caused hypoxic brain damage. A series of five oculomotor experiments revealed that the patient's preferred scanning direction was indeed reversed. However, PR showed striking scanpath abnormalities and mirror reversals that cannot be explained by previous theories. Considered together with mirror phenomena she displayed in neuropsychological tasks and everyday activities, our findings suggest a horizontal reversal of visual information on a perceptual level. In addition, a systematic manipulation of visual variables within two further experiments had dramatic effects on her mirror phenomena. When confronted with moving, flickering or briefly presented stimuli, PR showed hardly any left-right reversals. Not only do these findings underline the perceptual nature of her disorder, but also allow interpretation of the pathology in terms of a dissociation between visual subsystems. We speculate that early visual cortices are crucially involved in this dissociation. More generally, her mirrored vision may represent an extreme clinical manifestation of the relative instability of the horizontal axis in spatial vision.

To look or not to look at threat? Scanpath differences within a group of spider phobics.

Predicting the behavior of phobic patients in a confrontational situation is challenging. While avoidance as a major clinical component of phobias suggests that patients orient away from threat, findings based on cognitive paradigms indicate an attentional bias towards threat. Here we present eye movement data from 21 spider phobics and 21 control subjects, based on 3 basic oculomotor tasks and a visual exploration task that included close-up views of spiders. Relative to the control group, patients showed accelerated reflexive saccades in one of the basic oculomotor tasks, while the fear-relevant exploration task evoked a general slowing in their scanning behavior and pronounced oculomotor avoidance. However, this avoidance strongly varied within the patient group and was not associated with the scores from spider avoidance-sensitive questionnaire scales. We suggest that variation of oculomotor avoidance between phobics reflects different strategies of how they cope with threat in confrontational situations.

One-Hertz transcranial magnetic stimulation over the frontal eye field induces lasting inhibition of saccade triggering.

The aim of the study was to examine the effect of low-frequency repetitive transcranial magnetic stimulation on saccade triggering. In five participants, a train of 600 pulses with a frequency of 1 Hz was applied over the right frontal eye field and--as control condition--over the vertex. After repetitive transcranial magnetic stimulation application, oculomotor performance was evaluated with an overlap paradigm. The results show that the repetitive transcranial magnetic stimulation effect was specific for frontal eye field stimulation. Saccade latencies were found to be increased bilaterally for several minutes after the stimulation, and the time course of recovery was different for the ipsilateral and contralateral sides. The results are discussed in the light of possible local and remote repetitive transcranial magnetic stimulation effects on the oculomotor network.

Repetitive TMS over the human oculomotor cortex: comparison of 1-Hz and theta burst stimulation.

The aim of the study was to compare the effect duration of two different protocols of repetitive transcranial magnetic stimulation (rTMS) on saccade triggering. In four experiments, two regions (right frontal eye field (FEF) and vertex) were stimulated using a 1-Hz and a theta burst protocol (three 30Hz pulses repeated at intervals of 100ms). The same number of TMS pulses (600 pulses) was applied with stimulation strength of 80% of the resting motor threshold for hand muscles. Following stimulation the subjects repeatedly performed an oculomotor task using a modified overlap paradigm, and saccade latencies were measured over a period of 60min. The results show that both 1-Hz and theta burst stimulation had inhibitory effects on saccade triggering when applied over the FEF, but not over the vertex. One-hertz rTMS significantly increased saccade latencies over a period of about 8min. After theta burst rTMS, this effect lasted up to 30min. Furthermore, the decay of rTMS effects was protocol-specific: After 1-Hz stimulation, saccade latencies returned to a baseline level much faster than after theta burst stimulation. We speculate that these time course differences represent distinct physiological mechanisms of how TMS interacts with brain function.

The influence of colour on oculomotor behaviour during image perception.

The aim of this study was to investigate how oculomotor behaviour depends on the availability of colour information in pictorial stimuli. Forty study participants viewed complex images in colour or grey-scale, while their eye movements were recorded. We found two major effects of colour. First, although colour increases the complexity of an image, fixations on colour images were shorter than on their grey-scale versions. This suggests that colour enhances discriminability and thus affects low-level perceptual processing. Second, colour decreases the similarity of spatial fixation patterns between participants. The role of colour on visual attention seems to be more important than previously assumed, in theoretical as well as methodological terms.

The role of the right frontal eye field in overt visual attention deployment as assessed by free visual exploration.

The frontal eye field (FEF) is known to be involved in saccade generation and visual attention control. Studies applying covert attentional orienting paradigms have shown that the right FEF is involved in attentional shifts to both the left and the right hemifield. In the current study, we aimed at examining the effects of inhibitory continuous theta burst (cTBS) transcranial magnetic stimulation over the right FEF on overt attentional orienting, as measured by a free visual exploration paradigm. In forty-two healthy subjects, free visual exploration of naturalistic pictures was tested in three conditions: (1) after cTBS over the right FEF; (2) after cTBS over a control site (vertex); and, (3) without any stimulation. The results showed that cTBS over the right FEF-but not cTBS over the vertex-triggered significant changes in the spatial distribution of the cumulative fixation duration. Compared to the group without stimulation and the group with cTBS over the vertex, cTBS over the right FEF decreased cumulative fixation duration in the left and in the right peripheral regions, and increased cumulative fixation duration in the central region. The present study supports the view that the right FEF is involved in the bilateral control of not only covert, but also of overt, peripheral visual attention.

Personal neglect-a disorder of body representation?

The cognitive mechanisms underlying personal neglect are not well known. One theory postulates that personal neglect is due to a disorder of contralesional body representation. In the present study, we have investigated whether personal neglect is best explained by impairments in the representation of the contralesional side of the body, in particular, or a dysfunction of the mental representation of the contralesional space in general. For this, 22 patients with right hemisphere cerebral lesions (7 with personal neglect, 15 without personal neglect) and 13 healthy controls have been studied using two experimental tasks measuring representation of the body and extrapersonal space. In the tasks, photographs of left and right hands as well as left and right rear-view mirrors presented from the front and the back had to be judged as left or right. Our results show that patients with personal neglect made more errors when asked to judge stimuli of left hands and left rear-view mirrors than either patients without personal neglect or healthy controls. Furthermore, regression analyses indicated that errors in interpreting left hands were the best predictor of personal neglect, while other variables such as extrapersonal neglect, somatosensory or motor impairments, or deficits in left extrapersonal space representation had no predictive value of personal neglect. These findings suggest that deficient body representation is the major mechanism underlying personal neglect.

Interference with gesture production by theta burst stimulation over left inferior frontal cortex.

OBJECTIVE: The traditional view of a predominant inferior parietal representation of gestures has been recently challenged by neuroimaging studies demonstrating that gesture production and discrimination may critically depend on inferior frontal lobe function. The aim of the present work was therefore to investigate the effect of transient disruption of these brain sites by continuous theta burst stimulation (cTBS) on gesture production and recognition. METHODS: Fourteen healthy subjects participated in the study. A repeated measures design was employed with three experimental sessions: baseline (BSL), left inferior parietal (IPL) and inferior frontal (IFG) TBS. Gesture production and recognition was assessed in an off-line approach using a new test of upper limb apraxia (TULIA) and a modified version of postural knowledge test (PKT). RESULTS: TBS of the left IFG significantly lowered total TULIA scores. The effect was even more prominent when contrasted with IPL than with BSL. However, TBS over either stimulation site did not significantly influence PKT measures. CONCLUSIONS: The interference of the left inferior frontal cTBS with gesture production emphasizes the role this brain region has in the control of gestures. SIGNIFICANCE: The study demonstrated that gesture performance is amenable to modulation with TBS.

Spontaneous recovery of visually-triggered saccades after focal lesions of the frontal and parietal eye fields: a combined longitudinal oculomotor and fMRI study.

OBJECTIVE: To analyze oculomotor recovery in a patient with ischemic lesions restricted to the left frontal eye field (FEF) and the left parietal eye field (PEF). METHODS: Two, three, and four weeks after the stroke, saccades were measured and mean gain and latency were calculated. At the same time intervals and 2 months after stroke, the same oculomotor paradigm was performed during fMRI. Bilateral FEF and PEF were identified and defined as volumes of interest (VOI). Both cluster size and mean percentage blood oxygenation level-dependent (BOLD) signal changes were computed for each VOI. RESULTS: Initially, rightward saccades were hypometric and showed bilaterally increased latencies that recovered within 4 weeks (Talairach and Tournoux, 1988). FMRI revealed important changes in cluster size and percentage BOLD signal change in the contralesional and ipsilesional hemisphere. A persisting high activation was found in the contralesional intact FEF and PEF, whereas in the lesioned FEF and PEF, the initially absent or reduced activity increased. Two months after stroke symmetric activations in both FEF and PEF were found. CONCLUSIONS: Saccade deficits completely and rapidly recovered due to functional rearrangements within the ipsi- and contralesional hemispheric oculomotor network. SIGNIFICANCE: This study shows the importance of the contralesional and ipsilesional hemispheres in oculomotor recovery.

Polarity correspondence in comparative number magnitude judgments.

When asked which of two digits is greater, participants respond more quickly if physical size corresponds to number magnitude, such as in 3 7, than when the two attributes contradict each other, such as in 3 7. This size congruence effect in comparative number judgments is a well-documented phenomenon. We extended existing findings by showing that this effect does not depend on physical size of the number alone but can be observed with number symmetry. In addition, we observed that symmetric numbers are judged as being smaller than asymmetric numbers, which renders an interpretation of the number symmetry congruence effect in terms of physical size implausible. We refer to the polarity correspondence principle (Proctor & Cho, 2006) to explain the present findings.

Linking physiology with behaviour: Functional specialisation of the visual field is reflected in gaze patterns during visual search.

Based on neurophysiological findings and a grid to score binocular visual field function, two hypotheses concerning the spatial distribution of fixations during visual search were tested and confirmed in healthy participants and patients with homonymous visual field defects. Both groups showed significant biases of fixations and viewing time towards the centre of the screen and the upper screen half. Patients displayed a third bias towards the side of their field defect, which represents oculomotor compensation. Moreover, significant correlations between the extent of these three biases and search performance were found. Our findings suggest a new, more dynamic view of how functional specialisation of the visual field influences behaviour.

Size matters: saccades during scene perception.

We investigated the effect of image size on saccade amplitudes. First, in a meta-analysis, relevant results from previous scene perception studies are summarised, suggesting the possibility of a linear relationship between mean saccade amplitude and image size. Forty-eight observers viewed 96 colour scene images scaled to four different sizes, while their eye movements were recorded. Mean and median saccade amplitudes were found to be directly proportional to image size, while the mode of the distribution lay in the range of very short saccades. However, saccade amplitudes expressed as percentages of image size were not constant over the different image sizes; on smaller stimulus images, the relative saccades were found to be larger, and vice versa. In sum, and as far as mean and median saccade amplitudes are concerned, the size of stimulus images is the dominant factor. Other factors, such as image properties, viewing task, or measurement equipment, are only of subordinate importance. Thus, the role of stimulus size has to be reconsidered, in theoretical as well as methodological terms.

Extending lifetime of plastic changes in the human brain.

The ability of the brain to adjust to changing environments and to recover from damage rests on its remarkable capacity to adapt through plastic changes of underlying neural networks. We show here with an eye movement paradigm that a lifetime of plastic changes can be extended to several hours by repeated applications of theta burst transcranial magnetic stimulation to the frontal eye field of the human cortex. The results suggest that repeated application of the same stimulation protocol consolidates short-lived plasticity into long-lasting changes.