Use of eye-gaze technology feedback by assistive technology professionals: findings from a thematic analysis.

Purpose: Eye-gaze technology offers professionals a range of feedback tools, but it is not well understood how these are used to support decision-making or how professionals understand their purpose and function. This paper explores how professionals use a variety of feedback tools and provides commentary on their current use and ideas for future tool development.Methods and Materials: The study adopted a focus group methodology with two groups of professional participants: those involved in the assessment and provision of eye-gaze technology (n = 6) and those who interact with individuals using eye-gaze technology on an ongoing basis (n = 5). Template analysis was used to provide qualitative insight into the research questions.Results: Professionals highlighted several issues with existing tools and gave suggestions on how these could be made better. It is generally felt that existing tools highlight the existence of problems but offer little in the way of solutions or suggestions. Some differences of opinion related to professional perspective were highlighted. Questions about automating certain processes were raised by both groups.Conclusions: Discussion highlighted the need for different levels of feedback for users and professionals. Professionals agreed that current tools are useful to identify problems but do not offer insight into potential solutions. Some tools are being used to draw inferences about vision and cognition which are not supported by existing literature. New tools may be needed to better meet the needs of professionals and an increased understanding of how existing tools function may support such development.

Professionals sometimes make use of feedback tools to infer the cognitive and/or visual abilities of users, although the tools are not designed or validated for these purposes, and the existing literature does not support this.Some eye-gaze feedback tools are perceived as a "black box", leaving professionals uncertain as to how to usefully interpret and apply the outputs.There is an opportunity to improve tools that provide feedback on how well an eye-gaze system is working or how effectively a user can interact with this technology.Professionals identified that tools could be better at offering potential solutions, rather than simply identifying the existence of problems.

Tuning in to a hip-hop beat: Pursuit eye movements reveal processing of biological motion.

Smooth pursuit eye movements are mainly driven by motion signals to achieve their goal of reducing retinal motion blur. However, they can also show anticipation of predictable movement patterns. Oculomotor predictions may rely on an internal model of the target kinematics. Most investigations on the nature of those predictions have concentrated on simple stimuli, such as a decontextualized dot. However, biological motion is one of the most important visual stimuli in regulating human interaction and its perception involves integration of form and motion across time and space. Therefore, we asked whether there is a specific contribution of an internal model of biological motion in driving pursuit eye movements. Unlike previous contributions, we exploited the cyclical nature of walking to measure eye movement's ability to track the velocity oscillations of the hip of point-light walkers. We quantified the quality of tracking by cross-correlating pursuit and hip velocity oscillations. We found a robust correlation between signals, even along the horizontal dimension, where changes in velocity during the stepping cycle are very subtle. The inversion of the walker and the presentation of the hip-dot without context incurred the same additional phase lag along the horizontal dimension. These findings support the view that information beyond the hip-dot contributes to the prediction of hip kinematics that controls pursuit. We also found a smaller phase lag in inverted walkers for pursuit along the vertical dimension compared to upright walkers, indicating that inversion does not simply reduce prediction. We suggest that pursuit eye movements reflect the visual processing of biological motion and as such could provide an implicit measure of higher-level visual function.

A metacognitive approach to the study of motion-induced duration biases reveals inter-individual differences in forming confidence judgments.

Our ability to estimate the duration of subsecond visual events is prone to distortions, which depend on both sensory and decisional factors. To disambiguate between these two influences, we can look at the alignment between discrimination estimates of duration at the point of subjective equality and confidence estimates when the confidence about decisions is minimal, because observers should be maximally uncertain when two stimuli are perceptually the same. Here, we used this approach to investigate the relationship between the speed of a visual stimulus and its perceived duration. Participants were required to compare two intervals, report which had the longer duration, and then rate their confidence in that judgment. One of the intervals contained a stimulus drifting at a constant speed, whereas the stimulus embedded in the other interval could be stationary, linearly accelerating or decelerating, or drifting at the same speed. Discrimination estimates revealed duration compression for the stationary stimuli and, to a lesser degree, for the accelerating and decelerating stimuli. Confidence showed a similar pattern, but, overall, the confidence estimates were shifted more toward higher durations, pointing to a small contribution of decisional processes. A simple observer model, which assumes that both judgments are based on the same sensory information, captured well inter-individual differences in the criterion used to form a confidence judgment.

An Exploratory Investigation of Pupillometry As a Measure of Tinnitus Intrusiveness on a Test of Auditory Short-Term Memory.

OBJECTIVES: The purpose of the current study was to investigate the potential of pupillometry to provide an objective measure of competition between tinnitus and external sounds during a test of auditory short-term memory. DESIGN: Twelve participants with chronic tinnitus and twelve control participants without tinnitus took part in the study. Pretest sessions used an adaptive method to estimate listeners' frequency discrimination threshold on a test of delayed pitch discrimination for pure tones. Target and probe tones were presented at 72 dB SPL and centered on 750 Hz±2 semitones with an additional jitter of 5 to 20 Hz. Test sessions recorded baseline pupil diameter and task-related pupillary responses (TEPRs) during three blocks of delayed pitch discrimination trials. The difference between target and probe tones was set to the individual's frequency detection threshold for 80% response-accuracy. Listeners with tinnitus also completed the Tinnitus Handicap Inventory (THI). Linear mixed effects procedures were applied to examine changes in baseline pupil diameter and TEPRs associated with group (tinnitus versus control), block (1 to 3) and their interaction. The association between THI scores and maximum TEPRs was assessed using simple linear regression. RESULTS: Patterns of baseline pupil dilation across trials diverged in listeners with tinnitus and controls. For controls, baseline pupil dilation remained constant across blocks. For listeners with tinnitus, baseline pupil dilation increased on blocks 2 and 3 compared with block 1. TEPR amplitudes were also larger in listeners with tinnitus than controls. Linear mixed effects models yielded a significant group by block interaction for baseline pupil diameter and a significant main effect of group on maximum TEPR amplitudes. Regression analyses yielded a significant association between THI scores and TEPR amplitude in listeners with tinnitus. CONCLUSIONS: Our data indicate measures of baseline pupil diameter, and TEPRs are sensitive to competition between tinnitus and external sounds during a test of auditory short-term memory. This result suggests pupillometry can provide an objective measure of intrusion in tinnitus. Future research will be required to establish whether our findings generalize to listeners across a full range of tinnitus severity.

Programme of the 21st European Conference on Eye Movements.

About ECEM ECEM was initiated by Rudolf Groner (Bern), Dieter Heller (Bayreuth at the time) and Henk Breimer (Tilburg) in the 198 to provide a forum for an interdisciplinary group of scientists interested in eye movements. Since the inaugural meeting in Bern, the conference has been held every two years in different venues across Europe until 2021, when it was planned to take place in Leicester but was cancelled due to the COVID pandemic. It was decided to hold the meeting in Leicester in August 2022 instead, and as an in person meeting rather than an online or hybrid event. Incidentally, the present meeting is the third time the conference has come to the English East Midlands, now in Leicester following previous meetings in the neighbouring cities of Derby and Nottingham. The sites of previous ECEMs and webpages can be found here..

Book of Abstracts of the 21th European Conference on Eye Movements in Leicester 2022.

Contents Keynotes: Iain Gilchrist: Integrative Active Vision p 5 Ziad Hafed: A Vision for orienting in Primate Oculomotor Control Circuitry p 6 Fatema Ghasia: Miniscule Eye Movements Play a Major Role in Binocular Vision Disorders p.7 Miriam Spering: Eye Movements as a Window into Human Decision-Making p.8 Monica S. Castelhano: Explorations of how Scene Context and Previous Experience Dynamically Influence Attention and Eye Movement Guidance p.9   Symposia: Eye Tracking and the Visual Arts p.19 Eye Movements during Text Processing and Multiline Reading p.23 Unstable Fixation and Nystagmus with a Focus on the Next Generation of Researchers p.84 Eye Movements as a measure of Higher-Level Text Processing p.97 Eye Movements in Memory Processes Between Working Memory and Long-Term Memory p.178 Symposium to Honour Alexander Pollatsek's Legacy to Eye Movement Research p.204   Talks: Reading p.30 Parafoveal Processing p.36 Cinical and Applied p.39 Visual Search p.92 Eye Movement Control in Reading I & II p.104 & 116 & 225 Reading Development p.110 Decision-Making p.122 Eye-tracking Methods p.128 Real World and Virtual Reality p.134 Chinese Reading p.185 Special Populations p.191 Visuo-motor p.195 Bilingual Reading p.201 & 217 Reading Comprehension p.219 Pupillometry p.235   Poster sessions: Attention p.44 & 139 Cognition p. 49 Visuo-Motor p.62 Memory p.145 Methods p.150 Reading p. 57 & 155 Real World p.169 Social Cognition p.173.

The role of eye movements in perceiving vehicle speed and time-to-arrival at the roadside.

To avoid collisions, pedestrians depend on their ability to perceive and interpret the visual motion of other road users. Eye movements influence motion perception, yet pedestrians' gaze behavior has been little investigated. In the present study, we ask whether observers sample visual information differently when making two types of judgements based on the same virtual road-crossing scenario and to which extent spontaneous gaze behavior affects those judgements. Participants performed in succession a speed and a time-to-arrival two-interval discrimination task on the same simple traffic scenario-a car approaching at a constant speed (varying from 10 to 90 km/h) on a single-lane road. On average, observers were able to discriminate vehicle speeds of around 18 km/h and times-to-arrival of 0.7 s. In both tasks, observers placed their gaze closely towards the center of the vehicle's front plane while pursuing the vehicle. Other areas of the visual scene were sampled infrequently. No differences were found in the average gaze behavior between the two tasks and a pattern classifier (Support Vector Machine), trained on trial-level gaze patterns, failed to reliably classify the task from the spontaneous eye movements it elicited. Saccadic gaze behavior could predict time-to-arrival discrimination performance, demonstrating the relevance of gaze behavior for perceptual sensitivity in road-crossing.

Achieving visual stability during smooth pursuit eye movements: Directional and confidence judgements favor a recalibration model.

During smooth pursuit eye movements, the visual system is faced with the task of telling apart reafferent retinal motion from motion in the world. While an efference copy signal can be used to predict the amount of reafference to subtract from the image, an image-based adaptive mechanism can ensure the continued accuracy of this computation. Indeed, repeatedly exposing observers to background motion with a fixed direction relative to that of the target that is pursued leads to a shift in their point of subjective stationarity (PSS). We asked whether the effect of exposure reflects adaptation to motion contingent on pursuit direction, recalibration of a reference signal or both. A recalibration account predicts a shift in reference signal (i.e. predicted reafference), resulting in a shift of PSS, but no change in sensitivity. Results show that both directional judgements and confidence judgements about them favor a recalibration account, whereby there is an adaptive shift in the reference signal caused by the prevailing retinal motion during pursuit. We also found that the recalibration effect is specific to the exposed visual hemifield.

Visual selective attention and the control of tracking eye movements: a critical review.

People's eyes are directed at objects of interest with the aim of acquiring visual information. However, processing this information is constrained in capacity, requiring task-driven and salience-driven attentional mechanisms to select few among the many available objects. A wealth of behavioral and neurophysiological evidence has demonstrated that visual selection and the motor selection of saccade targets rely on shared mechanisms. This coupling supports the premotor theory of visual attention put forth more than 30 years ago, postulating visual selection as a necessary stage in motor selection. In this review, we examine to which extent the coupling of visual and motor selection observed with saccades is replicated during ocular tracking. Ocular tracking combines catch-up saccades and smooth pursuit to foveate a moving object. We find evidence that ocular tracking requires visual selection of the speed and direction of the moving target, but the position of the motion signal may not coincide with the position of the pursuit target. Further, visual and motor selection can be spatially decoupled when pursuit is initiated (open-loop pursuit). We propose that a main function of coupled visual and motor selection is to serve the coordination of catch-up saccades and pursuit eye movements. A simple race-to-threshold model is proposed to explain the variable coupling of visual selection during pursuit, catch-up and regular saccades, while generating testable predictions. We discuss pending issues, such as disentangling visual selection from preattentive visual processing and response selection, and the pinpointing of visual selection mechanisms, which have begun to be addressed in the neurophysiological literature.

Ambiguity in high definition: Gaze determines physical interpretation of ambiguous rotation even in the absence of a visual context.

Physical interactions between objects, or between an object and the ground, are amongst the most biologically relevant for live beings. Prior knowledge of Newtonian physics may play a role in disambiguating an object's movement as well as foveation by increasing the spatial resolution of the visual input. Observers were shown a virtual 3D scene, representing an ambiguously rotating ball translating on the ground. The ball was perceived as rotating congruently with friction, but only when gaze was located at the point of contact. Inverting or even removing the visual context had little influence on congruent judgements compared with the effect of gaze. Counterintuitively, gaze at the point of contact determines the solution of perceptual ambiguity, but independently of visual context. We suggest this constitutes a frugal strategy, by which the brain infers dynamics locally when faced with a foveated input that is ambiguous.

Motion integration is anisotropic during smooth pursuit eye movements.

Smooth pursuit eye movements (pursuit) are used to minimize the retinal motion of moving objects. During pursuit, the pattern of motion on the retina carries not only information about the object movement but also reafferent information about the eye movement itself. The latter arises from the retinal flow of the stationary world in the direction opposite to the eye movement. To extract the global direction of motion of the tracked object and stationary world, the visual system needs to integrate ambiguous local motion measurements (i.e., the aperture problem). Unlike the tracked object, the stationary world's global motion is entirely determined by the eye movement and thus can be approximately derived from motor commands sent to the eye (i.e., from an efference copy). Because retinal motion opposite to the eye movement is dominant during pursuit, different motion integration mechanisms might be used for retinal motion in the same direction and opposite to pursuit. To investigate motion integration during pursuit, we tested direction discrimination of a brief change in global object motion. The global motion stimulus was a circular array of small static apertures within which one-dimensional gratings moved. We found increased coherence thresholds and a qualitatively different reflexive ocular tracking for global motion opposite to pursuit. Both effects suggest reduced sampling of motion opposite to pursuit, which results in an impaired ability to extract coherence in motion signals in the reafferent direction. We suggest that anisotropic motion integration is an adaptation to asymmetric retinal motion patterns experienced during pursuit eye movements. NEW & NOTEWORTHY This study provides a new understanding of how the visual system achieves coherent perception of an object's motion while the eyes themselves are moving. The visual system integrates local motion measurements to create a coherent percept of object motion. An analysis of perceptual judgments and reflexive eye movements to a brief change in an object's global motion confirms that the visual and oculomotor systems pick fewer samples to extract global motion opposite to the eye movement.

The contribution of forward masking to saccadic inhibition of return.

Inhibition of return is the name typically given to the prolonged latency of motor responses directed to a previously cued target location. There is intense debate about the origins of this effect and its function, but most take for granted (despite lack of evidence) that it depends little on forward masking. Therefore, we re-examined the role of forward masking in inhibition of return. Forward masking was indexed by slower saccadic reaction times (SRTs) when the target orientation repeated the cue orientation at the same location. We confirmed effects of orientation repetition in the absence of an attentional bias when cues were presented on both sides of fixation (bilateral presentation). The effect of orientation repetition was reduced with high target contrast, consistent with a low-level origin such as contrast gain control in early visual areas. When presenting cues on only one side of fixation (unilateral presentation), we obtained inhibition of return with longer cue-target intervals and facilitation with targets presented shortly after the cue. The effect of orientation repetition was reduced when facilitation was observed, but was as strong as with bilateral cues when inhibition of return was observed. Therefore, forward masking may contribute to the inhibition of return effect by delaying reaction times to repeated features at the same location, but is not a principal cause of inhibition of return; in agreement with previous views. SIGNIFICANCE STATEMENT: The saccadic inhibition of return effect is a reaction-time cost when responding to a pre-cued location. Additional object updating costs are typically invoked to explain reaction-time costs observed when cue and target have the same shape. Yet, lower-level, forward masking of the target by the cue can not be ruled out. Importantly, we show an effect of orientation repetition that is consistent with low-level forward masking rather than object updating costs and that does not interact with inhibition of return.

Saccade Adaptation and Visual Uncertainty.

Visual uncertainty may affect saccade adaptation in two complementary ways. First, an ideal adaptor should take into account the reliability of visual information for determining the amount of correction, predicting that increasing visual uncertainty should decrease adaptation rates. We tested this by comparing observers' direction discrimination and adaptation rates in an intra-saccadic-step paradigm. Second, clearly visible target steps may generate a slower adaptation rate since the error can be attributed to an external cause, instead of an internal change in the visuo-motor mapping that needs to be compensated. We tested this prediction by measuring saccade adaptation to different step sizes. Most remarkably, we found little correlation between estimates of visual uncertainty and adaptation rates and no slower adaptation rates with more visible step sizes. Additionally, we show that for low contrast targets backward steps are perceived as stationary after the saccade, but that adaptation rates are independent of contrast. We suggest that the saccadic system uses different position signals for adapting dysmetric saccades and for generating a trans-saccadic stable visual percept, explaining that saccade adaptation is found to be independent of visual uncertainty.

Perceptual task induces saccadic adaptation by target selection.

Adaptation of saccades can be induced by different error signals, such as retinal position errors, prediction errors, or reinforcement learning. Recently, we showed that a shift in the spatial goal of a perceptual task can induce saccadic adaptation, in the absence of a bottom-up position error. Here, we investigated whether this top-down effect is mediated by the visibility of the task-relevant object, by reinforcement due to the feedback about the perceptual judgment or by a target selection mechanism. Participants were asked to discriminate visual stimuli arranged in a vertical compound. To induce adaptation, the discrimination target was presented at eccentric locations in the compound. In the first experiment, we compared adaptation with an easy and difficult discrimination. In the second experiment, we compared adaptation when feedback about the perceptual task was valid and when feedback was provided but was unrelated to performance. In the third experiment, we compared adaptation with instructions to fixate one of the elements in the compound-target selection-to the perceptual task condition-target selection and discrimination. To control for a bottom-up stimulus effect, we ran a fourth experiment in which the only instruction was to look at the compound. The saccade amplitude data were fitted by a two-state model distinguishing between an immediate and a gradual error correction process. We replicated our finding that a perceptual task can drive adaptation of saccades. Adaptation showed no effect of feedback reliability, nor an effect of the perceptual task beyond target selection. Adaptation was induced by a top-down signal since it was absent when there was no target selection instruction and no perceptual task. The immediate error correction was larger for the difficult than for the easy condition, suggesting that task difficulty affects mainly voluntary saccade targeting. In addition, the repetition of experiments one week later increased the magnitude of the gradual error correction. The results dissociate two distinct components of adaptation: an immediate and a gradual error correction. We conclude that perceptual-task induced adaptation is most likely due to top-down target selection within a larger object.

Novel integrated and portable endotoxin detection system based on an electrochemical biosensor.

This paper describes the design, implementation and validation of a sensitive and integral technology solution for endotoxin detection. The unified and portable platform is based on the electrochemical detection of endotoxins using a synthetic peptide immobilized on a thin-film biosensor. The work covers the fabrication of an optimized sensor, the biofunctionalization protocol and the design and implementation of the measuring and signalling elements (a microfluidic chamber and a portable potentiostat-galvanostat), framed ad hoc for this specific application. The use of thin-film technologies to fabricate the biosensing device and the application of simple immobilization and detection methods enable a rapid, easy and sensitive technique for in situ and real time LPS detection.

Ocular tracking responses to background motion gated by feature-based attention.

Involuntary ocular tracking responses to background motion offer a window on the dynamics of motion computations. In contrast to spatial attention, we know little about the role of feature-based attention in determining this ocular response. To probe feature-based effects of background motion on involuntary eye movements, we presented human observers with a balanced background perturbation. Two clouds of dots moved in opposite vertical directions while observers tracked a target moving in horizontal direction. Additionally, they had to discriminate a change in the direction of motion (±10° from vertical) of one of the clouds. A vertical ocular following response occurred in response to the motion of the attended cloud. When motion selection was based on motion direction and color of the dots, the peak velocity of the tracking response was 30% of the tracking response elicited in a single task with only one direction of background motion. In two other experiments, we tested the effect of the perturbation when motion selection was based on color, by having motion direction vary unpredictably, or on motion direction alone. Although the gain of pursuit in the horizontal direction was significantly reduced in all experiments, indicating a trade-off between perceptual and oculomotor tasks, ocular responses to perturbations were only observed when selection was based on both motion direction and color. It appears that selection by motion direction can only be effective for driving ocular tracking when the relevant elements can be segregated before motion onset.

Saccadic adaptation induced by a perceptual task.

The human motor system and muscles are subject to fluctuations in the short and long term. Motor adaptation is classically thought of as a low-level process that compensates for the error between predicted and executed movements in order to maintain movement accuracy. Contrary to a low-level account, accurate movements might be only a means to support high-level behavioral and perceptual goals. To isolate the influence of high-level goals in adaptation of saccadic eye movements, we manipulated perceptual task requirements in the absence of low-level errors. Observers had to discriminate one character within a peripheral array of characters. Between trials, the location of this character within the array was changed. This manipulation led to an immediate strategic change and a slower, gradual adaptation of saccade amplitude and direction. These changes had a similar magnitude to classical saccade adaptation and transferred at least partially to reactive saccades without a perceptual task. These results suggest that a perceptual task can modify oculomotor commands by generating a top-down error signal in saccade maps just like a bottom-up visual position error. Hence saccade adaptation not only maintains saccadic targeting accuracy, but also optimizes gaze behavior for the behavioral goal, showing that perception shapes even low-level oculomotor mechanisms.

Like a rolling stone: naturalistic visual kinematics facilitate tracking eye movements.

Newtonian physics constrains object kinematics in the real world. We asked whether eye movements towards tracked objects depend on their compliance with those constraints. In particular, the force of gravity constrains round objects to roll on the ground with a particular rotational and translational motion. We measured tracking eye movements towards rolling objects. We found that objects with rotational and translational motion that was congruent with an object rolling on the ground elicited faster tracking eye movements during pursuit initiation than incongruent stimuli. Relative to a condition without rotational component, we compared objects with this motion with a condition in which there was no rotational component, we essentially obtained benefits of congruence, and, to a lesser extent, costs from incongruence. Anticipatory pursuit responses showed no congruence effect, suggesting that the effect is based on visually-driven predictions, not on velocity storage. We suggest that the eye movement system incorporates information about object kinematics acquired by a lifetime of experience with visual stimuli obeying the laws of Newtonian physics.

Masking and color inheritance along the apparent motion path.

Long-range apparent motion is the illusory motion that can be perceived when two static and distant stimuli are presented in succession. Within some spatiotemporal range not only is motion sensed, but it appears as if one stimulus is displaced from one place to another (termed beta or optimal motion). Several groups have found that this illusory percept can interact with perception of a physically present stimulus, but some disagree on the origin of these interactions. We know little about how suppressive effects depend on feature-similarity between a target and the stimuli in apparent motion (inducers)-which would indicate an early perceptual locus-or even about the minimal conditions under which to obtain this effect. Unlike early studies that used a two-stroke apparent motion paradigm, we were able to demonstrate that motion can mask stimuli presented at interpolated locations along the apparent motion path, as shown by the elevation of contrast thresholds compared to a control condition. Apparent motion masking depended on color similarity between target and inducers. Further, we found evidence that the color of inducers alters the apparent color of intervening gray probes, indicating some inheritance or chromatic averaging across distant locations, but no clear evidence of predictive updating. Finally, the analysis of the presentation times delivering maximal masking effects suggests a predictive interpolation process is responsible for interference by apparent motion filling-in. We discuss alternative mechanisms, in particular the possible role of apparent-motion-induced metacontrast masking in generating this pattern of results.

Saliency changes appearance.

Numerous studies have suggested that the deployment of attention is linked to saliency. In contrast, very little is known about how salient objects are perceived. To probe the perception of salient elements, observers compared two horizontally aligned stimuli in an array of eight elements. One of them was salient because of its orientation or direction of motion. We observed that the perceived luminance contrast or color saturation of the salient element increased: the salient stimulus looked even more salient. We explored the possibility that changes in appearance were caused by attention. We chose an event-related potential indexing attentional selection, the N2pc, to answer this question. The absence of an N2pc to the salient object provides preliminary evidence against involuntary attentional capture by the salient element. We suggest that signals from a master saliency map flow back into individual feature maps. These signals boost the perceived feature contrast of salient objects, even on perceptual dimensions different from the one that initially defined saliency.