Consequences of eye movements for spatial selectivity.

What determines spatial tuning in the visual system? Standard views rely on the assumption that spatial information is directly inherited from the relative position of photoreceptors and shaped by neuronal connectivity.1,2 However, human eyes are always in motion during fixation,3,4,5,6 so retinal neurons receive temporal modulations that depend on the interaction of the spatial structure of the stimulus with eye movements. It has long been hypothesized that these modulations might contribute to spatial encoding,7,8,9,10,11,12 a proposal supported by several recent observations.13,14,15,16 A fundamental, yet untested, consequence of this encoding strategy is that spatial tuning is not hard-wired in the visual system but critically depends on how the fixational motion of the eye shapes the temporal structure of the signals impinging onto the retina. Here we used high-resolution techniques for eye-tracking17 and gaze-contingent display control18 to quantitatively test this distinctive prediction. We examined how contrast sensitivity, a hallmark of spatial vision, is influenced by fixational motion, both during normal active fixation and when the spatiotemporal stimulus on the retina is altered to mimic changes in fixational control. We showed that visual sensitivity closely follows the strength of the luminance modulations delivered within a narrow temporal bandwidth, so changes in fixational motion have opposite visual effects at low and high spatial frequencies. By identifying a key role for oculomotor activity in spatial selectivity, these findings have important implications for the perceptual consequences of abnormal eye movements, the sources of perceptual variability, and the function of oculomotor control.

High refresh rate display for natural monocular viewing in AOSLO psychophysics experiments.

By combining an external display operating at 360 frames per second with an Adaptive Optics Scanning Laser Ophthalmoscope (AOSLO) for human foveal imaging, we demonstrate color stimulus delivery at high spatial and temporal resolution in AOSLO psychophysics experiments. A custom pupil relay enables viewing of the stimulus through a 3-mm effective pupil diameter and provides refractive error correction from -8 to +4 diopters. Performance of the assembled and aligned pupil relay was validated by measuring the wavefront error across the field of view and correction range, and the as-built Strehl ratio was 0.64 or better. High-acuity stimuli were rendered on the external display and imaged through the pupil relay to demonstrate that spatial frequencies up to 54 cycles per degree, corresponding to 20/11 visual acuity, are resolved. The completed external display was then used to render fixation markers across the field of view of the monitor, and a continuous retinal montage spanning 9.4 by 5.4 degrees of visual angle was acquired with the AOSLO. We conducted eye-tracking experiments during free-viewing and high-acuity tasks with polychromatic images presented on the external display. Sub-arcminute eye position uncertainty was achieved, enabling precise localization of the line of sight on the monitor while simultaneously imaging the fine structure of the human central fovea. This high refresh rate display overcomes the temporal, spectral, and field of view limitations of AOSLO-based stimulus presentation, enabling natural monocular viewing of stimuli in psychophysics experiments conducted with AOSLO.

Eye blinks as a visual processing stage.

Humans blink their eyes frequently during normal viewing, more often than it seems necessary for keeping the cornea well lubricated. Since the closure of the eyelid disrupts the image on the retina, eye blinks are commonly assumed to be detrimental to visual processing. However, blinks also provide luminance transients rich in spatial information to neural pathways highly sensitive to temporal changes. Here, we report that the luminance modulations from blinks enhance visual sensitivity. By coupling high-resolution eye tracking in human observers with modeling of blink transients and spectral analysis of visual input signals, we show that blinking increases the power of retinal stimulation and that this effect significantly enhances visibility despite the time lost in exposure to the external scene. We further show that, as predicted from the spectral content of input signals, this enhancement is selective for stimuli at low spatial frequencies and occurs irrespective of whether the luminance transients are actively generated or passively experienced. These findings indicate that, like eye movements, blinking acts as a computational component of a visual processing strategy that uses motor behavior to reformat spatial information into the temporal domain.

Alignment, calibration, and validation of an adaptive optics scanning laser ophthalmoscope for high-resolution human foveal imaging.

In prior art, advances in adaptive optics scanning laser ophthalmoscope (AOSLO) technology have enabled cones in the human fovea to be resolved in healthy eyes with normal vision and low to moderate refractive errors, providing new insight into human foveal anatomy, visual perception, and retinal degenerative diseases. These high-resolution ophthalmoscopes require careful alignment of each optical subsystem to ensure diffraction-limited imaging performance, which is necessary for resolving the smallest foveal cones. This paper presents a systematic and rigorous methodology for building, aligning, calibrating, and testing an AOSLO designed for imaging the cone mosaic of the central fovea in humans with cellular resolution. This methodology uses a two-stage alignment procedure and thorough system testing to achieve diffraction-limited performance. Results from retinal imaging of healthy human subjects under 30 years of age with refractive errors of less than 3.5 diopters using either 680 nm or 840 nm light show that the system can resolve cones at the very center of the fovea, the region where the cones are smallest and most densely packed.

Poster Session: Spatial-frequency-selective enhancement of visual sensitivity from saccade dynamics.

Eye movements transform a spatial scene into luminance modulations on the retina. Recent work has shown that this transformation is highly structured: within human temporal sensitivity, saccades deliver power that increases in proportion to spatial frequency (SF) up to a critical frequency and remains constant beyond that. Importantly, the critical SF increases with decreasing amplitude. Therefore, at sufficiently low SFs, larger saccades effectively deliver stronger input signals to the retina. Here we tested whether this input reformatting has the predicted perceptual consequences, by examining how large and small saccades (6o & 1o) affect contrast sensitivity. We measured relative sensitivity at two SFs: a reference (0.5 cpd), equal to the critical SF for the small saccade, and a probe at either a lower or higher SF (0.1/2.5 cpd). We predicted that large saccades enhance visibility only when the probe has a lower SF than the reference. Subjects (N=7) made instructed saccades while presented with a plaid of overlapping orthogonal gratings at the two SFs and reported which grating was more visible. Results closely follow theoretical predictions: psychometric functions following small and large saccades only differed with the lower SF probe, in which case the larger saccade significantly enhanced visibility. In sum, saccades enable selectivity not only in the spatial domain, but also in the spatial-frequency domain.

Poster Session: Oculomotor influences on retinal input signals in myopia.

Studies of emmetropization have traditionally focused on the spatial characteristics of visual input signals. Yet the input to the retina is not a two-dimensional pattern but a temporally-varying luminance flow. The temporal structure of this flow is predominately determined by eye movements, as the human eyes move incessantly. Even when fixating on a single point, a persistent motion known as ocular drift reformats the luminance flow in a way that counterbalances the spectra of natural scenes. It is established that emmetropes are highly sensitive to these luminance modulations. However, their visual consequences in myopia and hyperopia are unknown. Here, we first review how the temporal-frequency distribution of retinal input signals varies with the amount of ocular drift. We then use a detailed optical/geometrical model of the eye to study how the eye movements jointly shape retinal input as a function of refraction. We show that, within the temporal range of sensitivity of the retina, the spatial frequency distribution of the input signals conveys signed information about defocus. Specifically, for a given degree of defocus, myopic retinas experience more power from low spatial frequency stimuli than hyperopic retinas. These redistribution of input power may have a consequence during eye growth supporting the proposal that eye movements should be taken into consideration in the process of emmetropization.

Poster Session: Fixational Eye Movements in Myopia.

During fixation, an incessant drift of the eye keeps the image impinging on the retina always in motion. Previous work indicated that luminance modulations from ocular drift serve important visual functions in emmetropes (Intoy & Rucci, 2020; Clark et al 2022). However, it remains unknown how ocular drift varies under myopia, a visual impairment commonly caused by eye elongation. We measured eye movements in 19 individuals with varying degrees of myopia (-0.25D to -6.5D) using a digital Dual-Purkinje Image eye-tracker, a recently developed system with sub-arcminute resolution. Subjects observed stimuli monocularly with vision corrected via a Badal optometer. They engaged in two high-acuity tasks: (a) resolution of a 20/20 line of an eye chart (5 evenly spaced tumbling E optotypes); and (b) a more natural task where subjects were presented with images of distant faces (1°) and asked to report the image's gaze direction. We show ocular drift characteristics differ in myopes relative to emmetropes. Drift was faster and less curved in myopic observers. On the retina, these changes result in luminance modulations that amplify low spatial frequencies at the expense of high spatial frequencies, so that high-frequency signals are effectively weaker in myopes These results are consistent with the proposal that fine spatial vision strongly relies on oculomotor-induced luminance modulations and emphasize the importance of considering fine eye movements in myopia.

Fine-scale measurement of the blind spot borders.

The blind spot is both a necessity and a nuisance for seeing. It is the portion of the visual field projecting to where the optic nerve crosses the retina, a region devoid of photoreceptors and hence visual input. The precise way in which vision transitions into blindness at the blind spot border is to date unknown. A chief challenge to map this transition is the incessant movement of the eye, which unavoidably smears measurements across space. In this study, we used high-resolution eye-tracking and state-of-the-art retinal stabilization to finely map the blind spot borders. Participants reported the onset of tiny high-contrast probes that were briefly flashed at precise positions around the blind spot. This method has sufficient resolution to enable mapping of blood vessels from psychophysical measurements. Our data show that, even after accounting for eye movements, the transition zones at the edges of the blind spot are considerable. On the horizontal meridian, the regions with detection rates between 80% and 20% span approximately 25% of the overall width of the blind spot. These borders also vary considerably in size across different axes. These data show that the transition from full visibility to blindness at the blind spot border is not abrupt but occurs over a broad area.

Detailed characterization of neural selectivity in free viewing primates.

Fixation constraints in visual tasks are ubiquitous in visual and cognitive neuroscience. Despite its widespread use, fixation requires trained subjects, is limited by the accuracy of fixational eye movements, and ignores the role of eye movements in shaping visual input. To overcome these limitations, we developed a suite of hardware and software tools to study vision during natural behavior in untrained subjects. We measured visual receptive fields and tuning properties from multiple cortical areas of marmoset monkeys who freely viewed full-field noise stimuli. The resulting receptive fields and tuning curves from primary visual cortex (V1) and area MT match reported selectivity from the literature which was measured using conventional approaches. We then combined free viewing with high-resolution eye tracking to make the first detailed 2D spatiotemporal measurements of foveal receptive fields in V1. These findings demonstrate the power of free viewing to characterize neural responses in untrained animals while simultaneously studying the dynamics of natural behavior.

High-resolution eye-tracking via digital imaging of Purkinje reflections.

Reliably measuring eye movements and determining where the observer looks are fundamental needs in vision science. A classical approach to achieve high-resolution oculomotor measurements is the so-called dual Purkinje image (DPI) method, a technique that relies on the relative motion of the reflections generated by two distinct surfaces in the eye, the cornea and the back of the lens. This technique has been traditionally implemented in fragile and difficult to operate analog devices, which have remained exclusive use of specialized oculomotor laboratories. Here we describe progress on the development of a digital DPI, a system that builds on recent advances in digital imaging to enable fast, highly precise eye-tracking without the complications of previous analog devices. This system integrates an optical setup with no moving components with a digital imaging module and dedicated software on a fast processing unit. Data from both artificial and human eyes demonstrate subarcminute resolution at 1 kHz. Furthermore, when coupled with previously developed gaze-contingent calibration methods, this system enables localization of the line of sight within a few arcminutes.

Cognitive influences on fixational eye movements.

We perceive the world based on visual information acquired via oculomotor control,1 an activity intertwined with ongoing cognitive processes.2,3,4 Cognitive influences have been primarily studied in the context of macroscopic movements, like saccades and smooth pursuits. However, our eyes are never still, even during periods of fixation. One of the fixational eye movements, ocular drifts, shifts the stimulus over hundreds of receptors on the retina, a motion that has been argued to enhance the processing of spatial detail by translating spatial into temporal information.5 Despite their apparent randomness, ocular drifts are under neural control.6,7,8 However little is known about the control of drift beyond the brainstem circuitry of the vestibulo-ocular reflex.9,10 Here, we investigated the cognitive control of ocular drifts with a letter discrimination task. The experiment was designed to reveal open-loop effects, i.e., cognitive oculomotor control driven by specific prior knowledge of the task, independent of incoming sensory information. Open-loop influences were isolated by randomly presenting pure noise fields (no letters) while subjects engaged in discriminating specific letter pairs. Our results show open-loop control of drift direction in human observers.

Inferring visual space from ultra-fine extra-retinal knowledge of gaze position.

It has long been debated how humans resolve fine details and perceive a stable visual world despite the incessant fixational motion of their eyes. Current theories assume these processes to rely solely on the visual input to the retina, without contributions from motor and/or proprioceptive sources. Here we show that contrary to this widespread assumption, the visual system has access to high-resolution extra-retinal knowledge of fixational eye motion and uses it to deduce spatial relations. Building on recent advances in gaze-contingent display control, we created a spatial discrimination task in which the stimulus configuration was entirely determined by oculomotor activity. Our results show that humans correctly infer geometrical relations in the absence of spatial information on the retina and accurately combine high-resolution extraretinal monitoring of gaze displacement with retinal signals. These findings reveal a sensory-motor strategy for encoding space, in which fine oculomotor knowledge is used to interpret the fixational input to the retina.

Eye drift during fixation predicts visual acuity.

Visual acuity is commonly assumed to be determined by the eye optics and spatial sampling in the retina. Unlike a camera, however, the eyes are never stationary during the acquisition of visual information; a jittery motion known as ocular drift incessantly displaces stimuli over many photoreceptors. Previous studies have shown that acuity is impaired in the absence of retinal image motion caused by eye drift. However, the relation between individual drift characteristics and acuity remains unknown. Here, we show that a) healthy emmetropes exhibit a large variability in their amount of drift and that b) these differences profoundly affect the structure of spatiotemporal signals to the retina. We further show that c) the spectral distribution of the resulting luminance modulations strongly correlates with individual visual acuity and that d) natural intertrial fluctuations in the amount of drift modulate acuity. As a consequence, in healthy emmetropes, acuity can be predicted from the motor behavior elicited by a simple fixation task, without directly measuring it. These results shed new light on how oculomotor behavior contributes to fine spatial vision.

Fast and nonuniform dynamics of perisaccadic vision in the central fovea.

Humans use rapid eye movements (saccades) to inspect stimuli with the foveola, the region of the retina where receptors are most densely packed. It is well established that visual sensitivity is generally attenuated during these movements, a phenomenon known as saccadic suppression. This effect is commonly studied with large, often peripheral, stimuli presented during instructed saccades. However, little is known about how saccades modulate the foveola and how the resulting dynamics unfold during natural visual exploration. Here we measured the foveal dynamics of saccadic suppression in a naturalistic high-acuity task, a task designed after primates' social grooming, which-like most explorations of fine patterns-primarily elicits minute saccades (microsaccades). Leveraging on recent advances in gaze-contingent display control, we were able to systematically map the perisaccadic time course of sensitivity across the foveola. We show that contrast sensitivity is not uniform across this region and that both the extent and dynamics of saccadic suppression vary within the foveola. Suppression is stronger and faster in the most central portion, where sensitivity is generally higher and selectively rebounds at the onset of a new fixation. These results shed light on the modulations experienced by foveal vision during the saccade-fixation cycle and explain some of the benefits of microsaccades.

Accuracy and precision of small saccades.

Despite recent advances on the mechanisms and purposes of fine oculomotor behavior, a rigorous assessment of the precision and accuracy of the smallest saccades is still lacking. Yet knowledge of how effectively these movements shift gaze is necessary for understanding their functions and is helpful in further elucidating their motor underpinnings. Using a combination of high-resolution eye-tracking and gaze-contingent control, here we examined the accuracy and precision of saccades aimed toward targets ranging from [Formula: see text] to [Formula: see text] eccentricity. We show that even small saccades of just 14-[Formula: see text] are very effective in centering the stimulus on the retina. Furthermore, we show that for a target at any given eccentricity, the probability of eliciting a saccade depends on its efficacy in reducing the foveal offset. The pattern of results reported here is consistent with current knowledge on the motor mechanisms of microsaccade production.

Spatiotemporal Content of Saccade Transients.

Humans use rapid gaze shifts, known as saccades, to explore visual scenes. These movements yield abrupt luminance changes on the retina, which elicit robust neural discharges at fixation onsets. Yet little is known about the spatial content of saccade transients. Here, we show that saccades redistribute spatial information within the temporal range of retinal sensitivity following two distinct regimes: saccade modulations counterbalance (whiten) the spectral density of natural scenes at low spatial frequencies and follow the external power distribution at higher frequencies. This redistribution is a consequence of saccade dynamics, particularly the speed/amplitude/duration relation known as the main sequence. It resembles the redistribution resulting from inter-saccadic eye drifts, revealing a continuum in the modulations given by different eye movements, with oculomotor transitions primarily acting by regulating the bandwidth of whitening. Our findings suggest important computational roles for saccade transients in the establishment of spatial representations and lead to testable predictions about their consequences for visual functions and encoding mechanisms.

Finely tuned eye movements enhance visual acuity.

High visual acuity is essential for many tasks, from recognizing distant friends to driving a car. While much is known about how the eye's optics and anatomy contribute to spatial resolution, possible influences from eye movements are rarely considered. Yet humans incessantly move their eyes, and it has long been suggested that oculomotor activity enhances fine pattern vision. Here we examine the role of eye movements in the most common assessment of visual acuity, the Snellen eye chart. By precisely localizing gaze and actively controlling retinal stimulation, we show that fixational behavior improves acuity by more than 0.15 logMAR, at least 2 lines of the Snellen chart. This improvement is achieved by adapting both microsaccades and ocular drifts to precisely position the image on the retina and adjust its motion. These findings show that humans finely tune their fixational eye movements so that they greatly contribute to normal visual acuity.

Contrast sensitivity reveals an oculomotor strategy for temporally encoding space.

The contrast sensitivity function (CSF), how sensitivity varies with the frequency of the stimulus, is a fundamental assessment of visual performance. The CSF is generally assumed to be determined by low-level sensory processes. However, the spatial sensitivities of neurons in the early visual pathways, as measured in experiments with immobilized eyes, diverge from psychophysical CSF measurements in primates. Under natural viewing conditions, as in typical psychophysical measurements, humans continually move their eyes even when looking at a fixed point. Here, we show that the resulting transformation of the spatial scene into temporal modulations on the retina constitutes a processing stage that reconciles human CSF and the response characteristics of retinal ganglion cells under a broad range of conditions. Our findings suggest a fundamental integration between perception and action: eye movements work synergistically with the spatio-temporal sensitivities of retinal neurons to encode spatial information.

Temporal Coding of Visual Space.

Establishing a representation of space is a major goal of sensory systems. Spatial information, however, is not always explicit in the incoming sensory signals. In most modalities it needs to be actively extracted from cues embedded in the temporal flow of receptor activation. Vision, on the other hand, starts with a sophisticated optical imaging system that explicitly preserves spatial information on the retina. This may lead to the assumption that vision is predominantly a spatial process: all that is needed is to transmit the retinal image to the cortex, like uploading a digital photograph, to establish a spatial map of the world. However, this deceptively simple analogy is inconsistent with theoretical models and experiments that study visual processing in the context of normal motor behavior. We argue here that, as with other senses, vision relies heavily on temporal strategies and temporal neural codes to extract and represent spatial information.

Perspective: Can eye movements contribute to emmetropization?

During development, the eye tunes its size to its optics so that distant objects are in focus, a state known as emmetropia. Although multiple factors contribute to this process, a strong influence appears to be exerted by the visual input signals entering the eye. Much research has been dedicated to the possible roles of specific features of the retinal image, such as the magnitude of blur. However, in humans and other species, the input to the retina is not an image, but a spatiotemporal flow of luminance. Small eye movements occur incessantly during natural fixation, continually transforming the spatial scene into temporal modulations on the retina. An emerging body of evidence suggests that this space-time reformatting is crucial to many aspects of visual processing, including sensitivity to fine spatial detail. The resulting temporal modulations depend not only on ocular dynamics, but also on the optics and shape of the eye, and the spatial statistics of the visual scene. Here we examine the characteristics of these signals and suggest that they may play a role in emmetropization. A direct consequence of this viewpoint is that abnormal oculomotor behavior may contribute to the development of myopia and hyperopia.