Minimal reporting guideline for research involving eye tracking (2023 edition).

A guideline is proposed that comprises the minimum items to be reported in research studies involving an eye tracker and human or non-human primate participant(s). This guideline was developed over a 3-year period using a consensus-based process via an open invitation to the international eye tracking community. This guideline will be reviewed at maximum intervals of 4 years.

Tonic and phasic effects of reward on the pupil: implications for locus coeruleus function.

The locus coeruleus (LC), a nucleus in the pons of the brainstem, plays a significant role in attention and cognitive control. Here, we use an adapted auditory oddball paradigm and measured the pupil dilation response, to provide a marker of LC activity in humans. In Experiment 1, we show event-related pupil responses to rare auditory events which were further elevated by task relevant. In Experiment 2, by asking participants to silently count the number of oddballs, we demonstrated that the task-relevance elevation was not a result of the generation or execution of the manual response. In Experiment 3, we observed two separate effects of reward on the pupil response. First, we found an overall increase in pupil area in the high compared to the low-reward blocks: a sustained effect reminiscent of the tonic changes that occur in LC. Second, we found elevated event-related pupil responses to behaviourally relevant stimuli in the high-reward condition compared with the low-reward condition, consistent with phasic changes in LC in response to a stimulus. These results highlight the complexity of the relationship between the pupil response and reward, and the inferred role of LC in both top-down and bottom-up cognitive control.

Dissecting the links between reward and loss, decision-making, and self-reported affect using a computational approach.

Links between affective states and risk-taking are often characterised using summary statistics from serial decision-making tasks. However, our understanding of these links, and the utility of decision-making as a marker of affect, needs to accommodate the fact that ongoing (e.g., within-task) experience of rewarding and punishing decision outcomes may alter future decisions and affective states. To date, the interplay between affect, ongoing reward and punisher experience, and decision-making has received little detailed investigation. Here, we examined the relationships between reward and loss experience, affect, and decision-making in humans using a novel judgement bias task analysed with a novel computational model. We demonstrated the influence of within-task favourability on decision-making, with more risk-averse/'pessimistic' decisions following more positive previous outcomes and a greater current average earning rate. Additionally, individuals reporting more negative affect tended to exhibit greater risk-seeking decision-making, and, based on our model, estimated time more poorly. We also found that individuals reported more positive affective valence during periods of the task when prediction errors and offered decision outcomes were more positive. Our results thus provide new evidence that (short-term) within-task rewarding and punishing experiences determine both future decision-making and subjectively experienced affective states.

Using Primary Reinforcement to Enhance Translatability of a Human Affect and Decision-Making Judgment Bias Task.

Good translatability of behavioral measures of affect (emotion) between human and nonhuman animals is core to comparative studies. The judgment bias (JB) task, which measures "optimistic" and "pessimistic" decision-making under ambiguity as indicators of positive and negative affective valence, has been used in both human and nonhuman animals. However, one key disparity between human and nonhuman studies is that the former typically use secondary reinforcers (e.g., money) whereas the latter typically use primary reinforcers (e.g., food). To address this deficiency and shed further light on JB as a measure of affect, we developed a novel version of a JB task for humans using primary reinforcers. Data on decision-making and reported affective state during the JB task were analyzed using computational modeling. Overall, participants grasped the task well, and as anticipated, their reported affective valence correlated with trial-by-trial variation in offered volume of juice. In addition, previous findings from monetary versions of the task were replicated: More positive prediction errors were associated with more positive affective valence, a higher lapse rate was associated with lower affective arousal, and affective arousal decreased as a function of number of trials completed. There was no evidence that more positive valence was associated with greater "optimism," but instead, there was evidence that affective valence influenced the participants' decision stochasticity, whereas affective arousal tended to influence their propensity for errors. This novel version of the JB task provides a useful tool for investigation of the links between primary reward and punisher experience, affect, and decision-making, especially from a comparative perspective.

Look-ahead fixations during visuomotor behavior: Evidence from assembling a camping tent.

Eye movements can support ongoing manipulative actions, but a class of so-called look ahead fixations (LAFs) are related to future tasks. We examined LAFs in a complex natural task-assembling a camping tent. Tent assembly is a relatively uncommon task and requires the completion of multiple subtasks in sequence over a 5- to 20-minute duration. Participants wore a head-mounted camera and eye tracker. Subtasks and LAFs were annotated. We document four novel aspects of LAFs. First, LAFs were not random and their frequency was biased to certain objects and subtasks. Second, latencies are larger than previously noted, with 35% of LAFs occurring within 10 seconds before motor manipulation and 75% within 100 seconds. Third, LAF behavior extends far into future subtasks, because only 47% of LAFs are made to objects relevant to the current subtask. Seventy-five percent of LAFs are to objects used within five upcoming steps. Last, LAFs are often directed repeatedly to the target before manipulation, suggesting memory volatility. LAFs with short fixation-action latencies have been hypothesized to benefit future visual search and/or motor manipulation. However, the diversity of LAFs suggest they may also reflect scene exploration and task relevance, as well as longer term problem solving and task planning.

Cognitive Control of Saccadic Selection and Inhibition from within the Core Cortical Saccadic Network.

The ability to select the task-relevant stimulus for a saccadic eye movement, while inhibiting saccades to task-irrelevant stimuli, is crucial for active vision. Here, we present a novel saccade-contingent behavioral paradigm and investigate the neural basis of the central cognitive functions underpinning such behavior, saccade selection, saccade inhibition, and saccadic choice, in female and male human participants. The paradigm allows for exceptionally well-matched contrasts, with task demands formalized with stochastic accumulation-to-threshold models. Using fMRI, we replicated the core cortical eye-movement network for saccade generation (frontal eye fields, posterior parietal cortex, and higher-level visual areas). However, in contrast to previously published tasks, saccadic selection and inhibition recruited only this core network. Brain-behavior analyses further showed that inhibition efficiency may be underpinned by white-matter integrity of tracts between key saccade-generating regions, and that inhibition efficiency is associated with right inferior frontal gyrus engagement, potentially implementing general-purpose inhibition. The core network, however, was insufficient for saccadic choice, which recruited anterior regions commonly attributed to saccadic action selection, including dorsolateral prefrontal cortex and anterior cingulate cortex. Jointly, the results indicate that extra-saccadic activity observed for free choice, and in previously published tasks probing saccadic control, is likely due to increased load on higher-level cognitive processes, and not saccadic selection per se, which is achieved within the canonical cortical eye movement network.SIGNIFICANCE STATEMENT The ability to selectively attend to, and to not attend to, parts of the world is crucial for successful action. Mapping the neural substrate of the key cognitive functions underlying such behavior, saccade selection and inhibition, is a challenge. Canonical tasks, often preceding the cognitive neuroscience revolution by decennia, were not designed to isolate single cognitive functions, and result in extremely widespread brain activity. We developed a novel behavioral paradigm, which demonstrates the following: (1) the cognitive control of saccades is achieved within key cortical saccadic brain regions; (2) individual variability in control efficiency is related to white-matter connectivity between the same regions; and (3) widespread activity in canonical tasks is likely related to higher-level cognitive demands and not saccadic control.

The parallel programming of landing position in saccadic eye movement sequences.

Saccadic eye movements occur in sequences, gathering new information about the visual environment to support successful task completion. Here, we examine the control of these saccadic sequences and specifically the extent to which the spatial aspects of the saccadic responses are programmed in parallel. We asked participants to saccade to a series of visual targets and, while they shifted their gaze around the display, we displaced select targets. We found that saccade landing position was deviated toward the previous location of the target suggesting that partial parallel programming of target location information was occurring. The saccade landing position was also affected by the new target location, which demonstrates that the saccade landing position was also partially updated following the shift. This pattern was present even for targets that were the subject of the next fixation. Having a greater preview about the sequence path influenced saccade accuracy with saccades being less affected by relocations when there is less preview information. The results demonstrate that landing positions from a saccade sequence are programmed in parallel and combined with more immediate visual signals.

The programming of sequences of saccades.

Saccadic eye movements move the high-resolution fovea to point at regions of interest. Saccades can only be generated serially (i.e., one at a time). However, what remains unclear is the extent to which saccades are programmed in parallel (i.e., a series of such moments can be planned together) and how far ahead such planning occurs. In the current experiment, we investigate this issue with a saccade contingent preview paradigm. Participants were asked to execute saccadic eye movements in response to seven small circles presented on a screen. The extent to which participants were given prior information about target locations was varied on a trial-by-trial basis: participants were aware of the location of the next target only, the next three, five, or all seven targets. The addition of new targets to the display was made during the saccade to the next target in the sequence. The overall time taken to complete the sequence was decreased as more targets were available up to all seven targets. This was a result of a reduction in the number of saccades being executed and a reduction in their saccade latencies. Surprisingly, these results suggest that, when faced with a demand to saccade to a large number of target locations, saccade preparation about all target locations is carried out in parallel.

The role of fixation disengagement in the parallel programming of sequences of saccades.

One of the core mechanisms involved in the control of saccade responses to selected target stimuli is the disengagement from the current fixation location, so that the next saccade can be executed. To carry out everyday visual tasks, we make multiple eye movements that can be programmed in parallel. However, the role of disengagement in the parallel programming of saccades has not been examined. It is well established that the need for disengagement slows down saccadic response time. This may be important in allowing the system to program accurate eye movements and have a role to play in the control of multiple eye movements but as yet this remains untested. Here, we report two experiments that seek to examine whether fixation disengagement reduces saccade latencies when the task completion demands multiple saccade responses. A saccade contingent paradigm was employed and participants were asked to execute saccadic eye movements to a series of seven targets while manipulating when these targets were shown. This both promotes fixation disengagement and controls the extent that parallel programming can occur. We found that trial duration decreased as more targets were made available prior to fixation: this was a result both of a reduction in the number of saccades being executed and in their saccade latencies. This supports the view that even when fixation disengagement is not required, parallel programming of multiple sequential saccadic eye movements is still present. By comparison with previous published data, we demonstrate a substantial speeded of response times in these condition ("a gap effect") and that parallel programming is attenuated in these conditions.

Quantifying peripheral and foveal perceived differences in natural image patches to predict visual search performance.

Duncan and Humphreys (1989) identified two key factors that affected performance in a visual search task for a target among distractors. The first was the similarity of the target to distractors (TD), and the second was the similarity of distractors to each other (DD). Here we investigate if it is the perceived similarity in foveal or peripheral vision that determines performance. We studied search using stimuli made from patches cut from colored images of natural objects; differences between targets and their modified distractors were estimated using a ratings task peripherally and foveally. We used search conditions in which the targets and distractors were easy to distinguish both foveally and peripherally ("high" stimuli), in which they were difficult to distinguish both foveally and peripherally ("low"), and in which they were easy to distinguish foveally but difficult to distinguish peripherally ("metamers"). In the critical metameric condition, search slopes (change of search time with number of distractors) were similar to the "low" condition, indicating a key role for peripheral information in visual search as both conditions have low perceived similarity peripherally. Furthermore, in all conditions, search slope was well described quantitatively from peripheral TD and DD but not foveal. However, some features of search, such as error rates, do indicate roles for foveal vision too.

The contribution of pre-stimulus neural oscillatory activity to spontaneous response time variability.

Large variability between individual response times, even in identical conditions, is a ubiquitous property of animal behavior. However, the origins of this stochasticity and its relation to action decisions remain unclear. Here we focus on the state of the perception-action network in the pre-stimulus period and its influence on subsequent saccadic response time and choice in humans. We employ magnetoencephalography (MEG) and a correlational source reconstruction approach to identify the brain areas where pre-stimulus oscillatory activity predicted saccadic response time to visual targets. We find a relationship between future response time and pre-stimulus power, but not phase, in occipital (including V1), parietal, posterior cingulate and superior frontal cortices, consistently across alpha, beta and low gamma frequencies, each accounting for between 1 and 4% of the RT variance. Importantly, these correlations were not explained by deterministic sources of variance, such as experimental factors and trial history. Our results further suggest that occipital areas mainly reflect short-term (trial to trial) stochastic fluctuations, while the frontal contribution largely reflects longer-term effects such as fatigue or practice. Parietal areas reflect fluctuations at both time scales. We found no evidence of lateralization: these effects were indistinguishable in both hemispheres and for both saccade directions, and non-predictive of choice - a finding with fundamental consequences for models of action decision, where independent, not coupled, noise is normally assumed.

Guidance toward and away from distractors in repeated visual search.

When searching for two targets consecutively in the same display, participants use memory of recently fixated distractors that become the target in the second search to find that target more quickly. Here we ask whether participants are also using memory for fixated distractors that do not become the target. In Experiment 1 we show that search is faster overall in the second search regardless of whether or not the second search target was fixated in the first search. We replicate this effect in Experiment 2 for different display sizes and further show that the effect is a result of the prioritization of locations that are more likely to contain the target. This suggests that representations of the fixated distractor items are retained across the two searches and that these representations can be used flexibly to optimize search performance. Furthermore, this suggests that the short-term memory processes that support search across consecutive searches not only facilitate guidance toward the target but also allow distractors to be excluded from the search process.

Perception of differences in naturalistic dynamic scenes, and a V1-based model.

We investigate whether a computational model of V1 can predict how observers rate perceptual differences between paired movie clips of natural scenes. Observers viewed 198 pairs of movies clips, rating how different the two clips appeared to them on a magnitude scale. Sixty-six of the movie pairs were naturalistic and those remaining were low-pass or high-pass spatially filtered versions of those originals. We examined three ways of comparing a movie pair. The Spatial Model compared corresponding frames between each movie pairwise, combining those differences using Minkowski summation. The Temporal Model compared successive frames within each movie, summed those differences for each movie, and then compared the overall differences between the paired movies. The Ordered-Temporal Model combined elements from both models, and yielded the single strongest predictions of observers' ratings. We modeled naturalistic sustained and transient impulse functions and compared frames directly with no temporal filtering. Overall, modeling naturalistic temporal filtering improved the models' performance; in particular, the predictions of the ratings for low-pass spatially filtered movies were much improved by employing a transient impulse function. The correlations between model predictions and observers' ratings rose from 0.507 without temporal filtering to 0.759 (p = 0.01%) when realistic impulses were included. The sustained impulse function and the Spatial Model carried more weight in ratings for normal and high-pass movies, whereas the transient impulse function with the Ordered-Temporal Model was most important for spatially low-pass movies. This is consistent with models in which high spatial frequency channels with sustained responses primarily code for spatial details in movies, while low spatial frequency channels with transient responses code for dynamic events.

Children with autism are neither systematic nor optimal foragers.

It is well established that children with autism often show outstanding visual search skills. To date, however, no study has tested whether these skills, usually assessed on a table-top or computer, translate to more true-to-life settings. One prominent account of autism, Baron-Cohen's "systemizing" theory, gives us good reason to suspect that they should. In this study, we tested whether autistic children's exceptional skills at small-scale search extend to a large-scale environment and, in so doing, tested key claims of the systemizing account. Twenty school-age children with autism and 20 age- and ability-matched typical children took part in a large-scale search task in the "foraging room": a purpose-built laboratory, with numerous possible search locations embedded into the floor. Children were instructed to search an array of 16 (green) locations to find the hidden (red) target as quickly as possible. The distribution of target locations was manipulated so that they appeared on one side of the midline for 80% of trials. Contrary to predictions of the systemizing account, autistic children's search behavior was much less efficient than that of typical children: they showed reduced sensitivity to the statistical properties of the search array, and furthermore, their search patterns were strikingly less optimal and less systematic. The nature of large-scale search behavior in autism cannot therefore be explained by a facility for systemizing. Rather, children with autism showed difficulties exploring and exploiting the large-scale space, which might instead be attributed to constraints (rather than benefits) in their cognitive repertoire.

Interruption in visual search: a systematic review.

Visual search, the process of trying to find a target presented among distractors, is a much-studied cognitive task. Less well-studied is the condition in which the search task is interrupted before the target is found. The consequences of such interruptions in visual search have been investigated across various disciplines, which has resulted in diverse and at times contradictory findings. The aim of this systematic review is to provide a more cohesive understanding of the effects of interruptions in visual search. For this purpose, we identified 28 studies that met our inclusion criteria. To facilitate a more organized and comprehensive analysis, we grouped the studies based on three dimensions: the search environment, the interruption aftermath, and the type of the interrupting event. While interruptions in visual search are variable and manifest differently across studies, our review provides a foundational scheme for a more cohesive understanding of the subject. This categorization serves as a starting point for exploring potential future directions, which we delineate in our conclusions.

Influence of environmental statistics on inhibition of saccadic return.

Initiating an eye movement is slowed if the saccade is directed to a location that has been fixated in the recent past. We show that this inhibitory effect is modulated by the temporal statistics of the environment: If a return location is likely to become behaviorally relevant, inhibition of return is absent. By fitting an accumulator model of saccadic decision-making, we show that the inhibitory effect and the sensitivity to local statistics can be dissociated in their effects on the rate of accumulation of evidence, and the threshold controlling the amount of evidence needed to generate a saccade.

Regional effects of clutter on human target detection performance.

Clutter is something that is encountered in everyday life, from a messy desk to a crowded street. Such clutter may interfere with our ability to search for objects in such environments, like our car keys or the person we are trying to meet. A number of computational models of clutter have been proposed and shown to work well for artificial and other simplified scene search tasks. In this paper, we correlate the performance of different models of visual clutter to human performance in a visual search task using natural scenes. The models we evaluate are Feature Congestion (Rosenholtz, Li, & Nakano, 2007), Sub-band Entropy (Rosenholtz et al., 2007), Segmentation (Bravo & Farid, 2008), and Edge Density (Mack & Oliva, 2004) measures. The correlations were performed across a range of target-centered subregions to produce a correlation profile, indicating the scale at which clutter was affecting search performance. Overall clutter was rather weakly correlated with performance (r ≈ 0.2). However, different measures of clutter appear to reflect different aspects of the search task: correlations with Feature Congestion are greatest for the actual target patch, whereas the Sub-band Entropy is most highly correlated in a region 12° × 12° centered on the target.

Development of human spatial cognition in a three-dimensional world.

Jeffery et al. accurately identify the importance of developing an understanding of spatial reference frames in a three-dimensional world. We examine human spatial cognition via a unique paradigm that investigates the role of saliency and adjusting reference frames. This includes work with adults, typically developing children, and children who develop non-typically (e.g., those with autism).

Measuring real-time cognitive engagement in remote audiences.

Responses to arts and entertainment media offer a valuable window into human behaviour. Many individuals worldwide spend the vast majority of their leisure time engaging with video content at home. However, there are few ways to study engagement and attention in this natural home viewing context. We used motion-tracking of the head via a web-camera to measure real-time cognitive engagement in 132 individuals while they watched 30 min of streamed theatre content at home. Head movement was negatively associated with engagement across a constellation of measures. Individuals who moved less reported feeling more engaged and immersed, evaluated the performance as more engaging, and were more likely to express interest in watching further. Our results demonstrate the value of in-home remote motion tracking as a low-cost, scalable metric of cognitive engagement, which can be used to collect audience behaviour data in a natural setting.