Interruption in visual search: a systematic review.

Visual search, the process of trying to find a target presented among distractors, is a much-studied cognitive task. Less well-studied is the condition in which the search task is interrupted before the target is found. The consequences of such interruptions in visual search have been investigated across various disciplines, which has resulted in diverse and at times contradictory findings. The aim of this systematic review is to provide a more cohesive understanding of the effects of interruptions in visual search. For this purpose, we identified 28 studies that met our inclusion criteria. To facilitate a more organized and comprehensive analysis, we grouped the studies based on three dimensions: the search environment, the interruption aftermath, and the type of the interrupting event. While interruptions in visual search are variable and manifest differently across studies, our review provides a foundational scheme for a more cohesive understanding of the subject. This categorization serves as a starting point for exploring potential future directions, which we delineate in our conclusions.

Slower rates of prism adaptation but intact aftereffects in patients with early to mid-stage Parkinson's disease.

There is currently mixed evidence on the effect of Parkinson's disease on motor adaptation. Some studies report that patients display adaptation comparable to age-matched controls, while others report a complete inability to adapt to novel sensory perturbations. Here, early to mid-stage Parkinson's patients were recruited to perform a prism adaptation task. When compared to controls, patients showed slower rates of initial adaptation but intact aftereffects. These results support the suggestion that patients with early to mid-stage Parkinson's disease display intact adaptation driven by sensory prediction errors, as shown by the intact aftereffect. But impaired facilitation of performance through cognitive strategies informed by task error, as shown by the impaired initial adaptation. These results support recent studies that suggest that patients with Parkinson's disease retain the ability to perform visuomotor adaptation, but display altered use of cognitive strategies to aid performance and generalises these previous findings to the classical prism adaptation task.

Minimal reporting guideline for research involving eye tracking (2023 edition).

A guideline is proposed that comprises the minimum items to be reported in research studies involving an eye tracker and human or non-human primate participant(s). This guideline was developed over a 3-year period using a consensus-based process via an open invitation to the international eye tracking community. This guideline will be reviewed at maximum intervals of 4 years.

Measuring real-time cognitive engagement in remote audiences.

Responses to arts and entertainment media offer a valuable window into human behaviour. Many individuals worldwide spend the vast majority of their leisure time engaging with video content at home. However, there are few ways to study engagement and attention in this natural home viewing context. We used motion-tracking of the head via a web-camera to measure real-time cognitive engagement in 132 individuals while they watched 30 min of streamed theatre content at home. Head movement was negatively associated with engagement across a constellation of measures. Individuals who moved less reported feeling more engaged and immersed, evaluated the performance as more engaging, and were more likely to express interest in watching further. Our results demonstrate the value of in-home remote motion tracking as a low-cost, scalable metric of cognitive engagement, which can be used to collect audience behaviour data in a natural setting.

Audience immersion: validating attentional and physiological measures against self-report.

When an audience member becomes immersed, their attention shifts towards the media and story, and they allocate cognitive resources to represent events and characters. Here, we investigate whether it is possible to measure immersion using continuous behavioural and physiological measures. Using television and film clips, we validated dual-task reaction times, heart rate, and skin conductance against self-reported narrative engagement. We find that reaction times to a secondary task were strongly positively correlated with self-reported immersion: slower reaction times were indicative of greater immersion, particularly emotional engagement. Synchrony in heart rate across participants was associated with self-reported attentional and emotional engagement with the story, although we found no such relationship with skin conductance. These results establish both dual-task reaction times and heart rate as candidate measures for the real-time, continuous, assessment of audience immersion.

Tonic and phasic effects of reward on the pupil: implications for locus coeruleus function.

The locus coeruleus (LC), a nucleus in the pons of the brainstem, plays a significant role in attention and cognitive control. Here, we use an adapted auditory oddball paradigm and measured the pupil dilation response, to provide a marker of LC activity in humans. In Experiment 1, we show event-related pupil responses to rare auditory events which were further elevated by task relevant. In Experiment 2, by asking participants to silently count the number of oddballs, we demonstrated that the task-relevance elevation was not a result of the generation or execution of the manual response. In Experiment 3, we observed two separate effects of reward on the pupil response. First, we found an overall increase in pupil area in the high compared to the low-reward blocks: a sustained effect reminiscent of the tonic changes that occur in LC. Second, we found elevated event-related pupil responses to behaviourally relevant stimuli in the high-reward condition compared with the low-reward condition, consistent with phasic changes in LC in response to a stimulus. These results highlight the complexity of the relationship between the pupil response and reward, and the inferred role of LC in both top-down and bottom-up cognitive control.

Proactive and reactive control mechanisms in navigational search.

Reactive and proactive cognitive control are fundamental for guiding complex human behaviour. In two experiments, we evaluated the role of both types of cognitive control in navigational search. Participants searched for a single hidden target in a floor array where the salience at the search locations varied (flashing or static lights). An a-priori rule of the probable location of the target (either under a static or a flashing light) was provided at the start of each experiment. Both experiments demonstrated a bias towards rule-adherent locations. Search errors, measured as revisits, were more likely to occur under the flashing rule for searching flashing locations, regardless of the salience of target location in Experiment 1 and at rule-congruent (flashing) locations in Experiment 2. Consistent with dual mechanisms of control, rule-adherent search was explained by engaging proactive control to guide goal-maintained search behaviour and by engaging reactive control to avoid revisits to salient (flashing) locations. Experiment 2 provided direct evidence for dual mechanisms of control using a Dot Pattern Expectancy task to distinguish the dominant control mode for a participant. Participants with a reactive control mode generated more revisits to salient (flashing) locations. These data point to complementary roles for proactive and reactive control in guiding navigational search and propose a novel framework for interpreting navigational search.

Saccadic and manual response time data on inhibition of return during and after a visual search.

In the present paper we present a dataset that provides data of two experiments in which we investigated the presence of Inhibition of Return (IOR) during and after a visual search. Participants either had to saccade (Experiment 1 and 2) or make a manual response (Experiment 2) to a probe during a visual search task (searching for a target letter among a set of distractors) or immediately after its completion. The data consist of the unprocessed raw data and one csv-file of the processed eye tracking data on eight (Experiment 1) and 18 (Experiment 2) participants, respectively. In total, we obtained 5,116 trials in Experiment 1 and 18,424 in Experiment 2. The data set is stored at the repository DOOR hosted by the University of Krems (https://door.donau-uni.ac.at/view/o:1014). Detailed information about the experiments and the interpretation of the data can be found in the paper "Post-search IOR: Searching for inhibition of return after search" (Höfler et al., 2019) [1].

Using Primary Reinforcement to Enhance Translatability of a Human Affect and Decision-Making Judgment Bias Task.

Good translatability of behavioral measures of affect (emotion) between human and nonhuman animals is core to comparative studies. The judgment bias (JB) task, which measures "optimistic" and "pessimistic" decision-making under ambiguity as indicators of positive and negative affective valence, has been used in both human and nonhuman animals. However, one key disparity between human and nonhuman studies is that the former typically use secondary reinforcers (e.g., money) whereas the latter typically use primary reinforcers (e.g., food). To address this deficiency and shed further light on JB as a measure of affect, we developed a novel version of a JB task for humans using primary reinforcers. Data on decision-making and reported affective state during the JB task were analyzed using computational modeling. Overall, participants grasped the task well, and as anticipated, their reported affective valence correlated with trial-by-trial variation in offered volume of juice. In addition, previous findings from monetary versions of the task were replicated: More positive prediction errors were associated with more positive affective valence, a higher lapse rate was associated with lower affective arousal, and affective arousal decreased as a function of number of trials completed. There was no evidence that more positive valence was associated with greater "optimism," but instead, there was evidence that affective valence influenced the participants' decision stochasticity, whereas affective arousal tended to influence their propensity for errors. This novel version of the JB task provides a useful tool for investigation of the links between primary reward and punisher experience, affect, and decision-making, especially from a comparative perspective.

Motion disrupts dynamic visual search for an orientation change.

Visual search in dynamic environments, for example lifeguarding or CCTV monitoring, has several fundamentally different properties to standard visual search tasks. The visual environment is constantly moving, a range of items could become targets and the task is to search for a certain event. We developed a novel task in which participants were required to search static and moving displays for an orientation change thus capturing components of visual search, multiple object tracking and change detection paradigms. In Experiment 1, we found that the addition of moving distractors slowed participants' response time to detect an orientation changes in a moving target, showing that the motion of distractors disrupts the rapid detection of orientation changes in a moving target. In Experiment 2 we found that, in displays of both moving and static objects, response time was slower if a moving object underwent a change than if a static object did, thus demonstrating that motion of the target itself also disrupts the detection of an orientation change. Our results could have implications for training in real-world occupations where the task is to search a dynamic environment for a critical event. Moreover, we add to the literature highlighting the need to develop lab-based tasks with high experimental control from any real-world tasks researchers may wish to investigate rather than extrapolating from static visual search tasks to more dynamic environments.

Look-ahead fixations during visuomotor behavior: Evidence from assembling a camping tent.

Eye movements can support ongoing manipulative actions, but a class of so-called look ahead fixations (LAFs) are related to future tasks. We examined LAFs in a complex natural task-assembling a camping tent. Tent assembly is a relatively uncommon task and requires the completion of multiple subtasks in sequence over a 5- to 20-minute duration. Participants wore a head-mounted camera and eye tracker. Subtasks and LAFs were annotated. We document four novel aspects of LAFs. First, LAFs were not random and their frequency was biased to certain objects and subtasks. Second, latencies are larger than previously noted, with 35% of LAFs occurring within 10 seconds before motor manipulation and 75% within 100 seconds. Third, LAF behavior extends far into future subtasks, because only 47% of LAFs are made to objects relevant to the current subtask. Seventy-five percent of LAFs are to objects used within five upcoming steps. Last, LAFs are often directed repeatedly to the target before manipulation, suggesting memory volatility. LAFs with short fixation-action latencies have been hypothesized to benefit future visual search and/or motor manipulation. However, the diversity of LAFs suggest they may also reflect scene exploration and task relevance, as well as longer term problem solving and task planning.

Target processing in overt serial visual search involves the dorsal attention network: A fixation-based event-related fMRI study.

In serial visual search we shift attention successively from location to location in search for the target. Although such search has been investigated using fMRI, overt attention (i.e., eye movements) was usually neglected or discouraged. As a result, it is unclear what happens in the instant when our gaze falls upon a target as compared to a distractor. In the present experiment, we used a multiple target search task that required eye movements and employed an analysis based on fixations as events of interest to investigate differences between target and distractor processing. Twenty young healthy adults indicated the number of targets (0-3) among distractors in a 20-item display. Compared to distractor fixations, we found that target fixations gave rise to wide-spread activation in the dorsal attention system, as well as in the visual cortex. Targets that were found later during the search activated the left inferior frontal gyrus and the left supramarginal gyrus more strongly than those that were found earlier. Finally, areas associated with visual and verbal working memory showed increased activation with a larger number of targets in the display.

Dissecting the links between reward and loss, decision-making, and self-reported affect using a computational approach.

Links between affective states and risk-taking are often characterised using summary statistics from serial decision-making tasks. However, our understanding of these links, and the utility of decision-making as a marker of affect, needs to accommodate the fact that ongoing (e.g., within-task) experience of rewarding and punishing decision outcomes may alter future decisions and affective states. To date, the interplay between affect, ongoing reward and punisher experience, and decision-making has received little detailed investigation. Here, we examined the relationships between reward and loss experience, affect, and decision-making in humans using a novel judgement bias task analysed with a novel computational model. We demonstrated the influence of within-task favourability on decision-making, with more risk-averse/'pessimistic' decisions following more positive previous outcomes and a greater current average earning rate. Additionally, individuals reporting more negative affect tended to exhibit greater risk-seeking decision-making, and, based on our model, estimated time more poorly. We also found that individuals reported more positive affective valence during periods of the task when prediction errors and offered decision outcomes were more positive. Our results thus provide new evidence that (short-term) within-task rewarding and punishing experiences determine both future decision-making and subjectively experienced affective states.

Pre-movement changes in sensorimotor beta oscillations predict motor adaptation drive.

Beta frequency oscillations in scalp electroencephalography (EEG) recordings over the primary motor cortex have been associated with the preparation and execution of voluntary movements. Here, we test whether changes in beta frequency are related to the preparation of adapted movements in human, and whether such effects generalise to other species (cat). Eleven healthy adult humans performed a joystick visuomotor adaptation task. Beta (15-25 Hz) scalp EEG signals recorded over the motor cortex during a pre-movement preparatory phase were, on average, significantly reduced in amplitude during early adaptation trials compared to baseline, late adaptation, or aftereffect trials. The changes in beta were not related to measurements of reaction time or reach duration. We also recorded local field potential (LFP) activity within the primary motor cortex of three cats during a prism visuomotor adaptation task. Analysis of these signals revealed similar reductions in motor cortical LFP beta frequencies during early adaptation. This effect was present when controlling for any influence of the reaction time and reach duration. Overall, the results are consistent with a reduction in pre-movement beta oscillations predicting an increase in adaptive drive in upcoming task performance when motor errors are largest in magnitude and the rate of adaptation is greatest.

Reward and punisher experience alter rodent decision-making in a judgement bias task.

The influence of affective states on decision-making is likely to be complex. Negative states resulting from experience of punishing events have been hypothesised to generate enhanced expectations of future punishment and 'pessimistic'/risk-averse decisions. However, they may also influence how decision-outcomes are valued. Such influences may further depend on whether decisions at hand are germane to the rewards or punishers that induced the affective state in the first place. Here we attempt to dissect these influences by presenting either many or few rewards or punishers of different types (sucrose vs air-puff; 50 kHz vs 22 kHz ultrasonic vocalisations) to rats, and investigating their subsequent decisions in a judgement bias task that employed sucrose and air-puff as decision outcomes. Rats that received many sucrose pellets prior to testing were more risk-averse than those receiving many air-puffs. Ultrasonic vocalisations did not alter decision-making. Computational analysis revealed a higher weighting of punishers relative to rewards (in agreement with findings from a separate behavioural task) and a bias towards the risk-averse response following pre-test sucrose compared to pre-test air-puff. Thus, in this study reward and punisher manipulation of affective state appeared to alter decision-making by influencing both expectation and valuation of decision-outcomes in a domain-specific way.

The parallel programming of landing position in saccadic eye movement sequences.

Saccadic eye movements occur in sequences, gathering new information about the visual environment to support successful task completion. Here, we examine the control of these saccadic sequences and specifically the extent to which the spatial aspects of the saccadic responses are programmed in parallel. We asked participants to saccade to a series of visual targets and, while they shifted their gaze around the display, we displaced select targets. We found that saccade landing position was deviated toward the previous location of the target suggesting that partial parallel programming of target location information was occurring. The saccade landing position was also affected by the new target location, which demonstrates that the saccade landing position was also partially updated following the shift. This pattern was present even for targets that were the subject of the next fixation. Having a greater preview about the sequence path influenced saccade accuracy with saccades being less affected by relocations when there is less preview information. The results demonstrate that landing positions from a saccade sequence are programmed in parallel and combined with more immediate visual signals.

Lateralized memory circuit dropout in Alzheimer's disease patients.

Altered connectivity within neuronal networks is often observed in Alzheimer's disease. However, delineating pro-cognitive compensatory changes from pathological network decline relies on characterizing network and task effects together. In this study, we interrogated the dynamics of occipito-temporo-frontal brain networks responsible for implicit and explicit memory processes using high-density EEG and dynamic causal modelling. We examined source-localized network activity from patients with Alzheimer's disease (n = 21) and healthy controls (n = 21), while they performed both visual recognition (explicit memory) and implicit priming tasks. Parametric empirical Bayes analyses identified significant reductions in temporo-frontal connectivity and in subcortical visual input in patients, specifically in the left hemisphere during the recognition task. There was also slowing in frontal left hemisphere signal transmission during the implicit priming task, with significantly more distinct dropout in connectivity during the recognition task, suggesting that these network drop-out effects are affected by task difficulty. Furthermore, during the implicit memory task, increased right frontal activity was correlated with improved task performance in patients only, suggesting that right-hemisphere compensatory mechanisms may be employed to mitigate left-lateralized network dropout in Alzheimer's disease. Taken together, these findings suggest that Alzheimer's disease is associated with lateralized memory circuit dropout and potential compensation from the right hemisphere, at least for simpler memory tasks.

The role of fixation disengagement in the parallel programming of sequences of saccades.

One of the core mechanisms involved in the control of saccade responses to selected target stimuli is the disengagement from the current fixation location, so that the next saccade can be executed. To carry out everyday visual tasks, we make multiple eye movements that can be programmed in parallel. However, the role of disengagement in the parallel programming of saccades has not been examined. It is well established that the need for disengagement slows down saccadic response time. This may be important in allowing the system to program accurate eye movements and have a role to play in the control of multiple eye movements but as yet this remains untested. Here, we report two experiments that seek to examine whether fixation disengagement reduces saccade latencies when the task completion demands multiple saccade responses. A saccade contingent paradigm was employed and participants were asked to execute saccadic eye movements to a series of seven targets while manipulating when these targets were shown. This both promotes fixation disengagement and controls the extent that parallel programming can occur. We found that trial duration decreased as more targets were made available prior to fixation: this was a result both of a reduction in the number of saccades being executed and in their saccade latencies. This supports the view that even when fixation disengagement is not required, parallel programming of multiple sequential saccadic eye movements is still present. By comparison with previous published data, we demonstrate a substantial speeded of response times in these condition ("a gap effect") and that parallel programming is attenuated in these conditions.