Visual scanning of social stimuli in preterm and autism spectrum disorder children.

OBJECTIVE: To evaluate the pattern of eye-gaze of preterm (PT), autism spectrum disorder (ASD) and neurotypical (Ty) children. METHODS: A cross-sectional study with eight preterm (born with ≤2000 g weight), nine ASD and five Ty male children, between six and nine years old, was performed. The eye gaze was evaluated presenting a board with a couple in social interaction, and a video with four children playing with blocks, projected in a screen computer, successively, evaluating the time that the children looked at each stimulus. RESULTS: Although all the groups focus on the central social figure with no significant differences, ASD presented significant differences in time fixation of the objects (p=0.021), while premature children fixated more time in the central social interaction than in the whole scene than typical children. CONCLUSIONS: Although this study found noteworthy differences in the eye-gaze patterns among the three groups, additional research with a more extensive participant pool is necessary to validate these preliminary results.

MYFix: Automated Fixation Annotation of Eye-Tracking Videos.

In mobile eye-tracking research, the automatic annotation of fixation points is an important yet difficult task, especially in varied and dynamic environments such as outdoor urban landscapes. This complexity is increased by the constant movement and dynamic nature of both the observer and their environment in urban spaces. This paper presents a novel approach that integrates the capabilities of two foundation models, YOLOv8 and Mask2Former, as a pipeline to automatically annotate fixation points without requiring additional training or fine-tuning. Our pipeline leverages YOLO's extensive training on the MS COCO dataset for object detection and Mask2Former's training on the Cityscapes dataset for semantic segmentation. This integration not only streamlines the annotation process but also improves accuracy and consistency, ensuring reliable annotations, even in complex scenes with multiple objects side by side or at different depths. Validation through two experiments showcases its efficiency, achieving 89.05% accuracy in a controlled data collection and 81.50% accuracy in a real-world outdoor wayfinding scenario. With an average runtime per frame of 1.61 ± 0.35 s, our approach stands as a robust solution for automatic fixation annotation.

Oculomotor routines for perceptual judgments.

In everyday life we frequently make simple visual judgments about object properties, for example, how big or wide is a certain object? Our goal is to test whether there are also task-specific oculomotor routines that support perceptual judgments, similar to the well-established exploratory routines for haptic perception. In a first study, observers saw different scenes with two objects presented in a photorealistic virtual reality environment. Observers were asked to judge which of two objects was taller or wider while gaze was tracked. All tasks were performed with the same set of virtual objects in the same scenes, so that we can compare spatial characteristics of exploratory gaze behavior to quantify oculomotor routines for each task. Width judgments showed fixations around the center of the objects with larger horizontal spread. In contrast, for height judgments, gaze was shifted toward the top of the objects with larger vertical spread. These results suggest specific strategies in gaze behavior that presumably are used for perceptual judgments. To test the causal link between oculomotor behavior and perception, in a second study, observers could freely gaze at the object or we introduced a gaze-contingent setup forcing observers to fixate specific positions on the object. Discrimination performance was similar between free-gaze and the gaze-contingent conditions for width and height judgments. These results suggest that although gaze is adapted for different tasks, performance seems to be based on a perceptual strategy, independent of potential cues that can be provided by the oculomotor system.

Study on the relationship between fixation characteristics and hit rate in psychological procedure training of free throw.

BACKGROUND: Free throw is an important means of scoring in basketball games. With the improvement of basketball competition level and the enhancement of confrontation degree, the number of free throws in the game gradually increases, so the score of free throw will have an important impact on the result of the game. The purpose of this study is to explore the relationship between visual attention characteristics and hit rate of basketball players in free throw psychological procedure training, so as to provide scientific basis for basketball teaching and training. METHODS: Forty players with similar free throw abilities were randomly assigned to the experimental group (10 males, 10 females) and control group (10 males, 10 females). The experimental group was free throw psychological procedure training, while the control group was trained with routine training, Eye movement indices (number of fixations, fixation duration, and pupil dilation) and the free throw hit rate and analyzed before and after the experiment. Group differences were examined using t-tests, while paired sample t-tests were conducted to compare pre- and post-test results within each group. The training time and training times of the two groups were the same. RESULTS: There were significant differences in fixation duration, number of fixations, pupil diameter and free throw hit rate between pre-test and post-test in the experimental group (P < 0.05). Post-test, there were significant differences in number of fixations, fixation duration, pupil diameter and free throw hit rate between the two groups (P < 0.05). There was a significant positive correlation between number of fixations and free throw hit rate in top (P < 0.01), and there was a significant positive correlation between fixation duration and hit rate in front (P < 0.01). CONCLUSIONS: The psychological procedure training can improve the visual information search strategy and information processing ability of free throw, and significantly improve the free throw hit rate. There was a positive correlation between the front fixation time and the free throw hit rate, and there was a positive correlation between the top number of fixations and the free throw hit rate.

Spiral scanning improves subject fixation in widefield retinal imaging.

Point scanning retinal imaging modalities, including confocal scanning light ophthalmoscopy (cSLO) and optical coherence tomography, suffer from fixational motion artifacts. Fixation targets, though effective at reducing eye motion, are infeasible in some applications (e.g., handheld devices) due to their bulk and complexity. Here, we report on a cSLO device that scans the retina in a spiral pattern under pseudo-visible illumination, thus collecting image data while simultaneously projecting, into the subject's vision, the image of a bullseye, which acts as a virtual fixation target. An imaging study of 14 young adult volunteers was conducted to compare the fixational performance of this technique to that of raster scanning, with and without a discrete inline fixation target. Image registration was used to quantify subject eye motion; a strip-wise registration method was used for raster scans, and a novel, to the best of our knowledge, ring-based method was used for spiral scans. Results indicate a statistically significant reduction in eye motion by the use of spiral scanning as compared to raster scanning without a fixation target.

Eye tracking evidence for the reinstatement of emotionally negative and neutral memories.

Recent eye tracking studies have linked gaze reinstatement-when eye movements from encoding are reinstated during retrieval-with memory performance. In this study, we investigated whether gaze reinstatement is influenced by the affective salience of information stored in memory, using an adaptation of the emotion-induced memory trade-off paradigm. Participants learned word-scene pairs, where scenes were composed of negative or neutral objects located on the left or right side of neutral backgrounds. This allowed us to measure gaze reinstatement during scene memory tests based on whether people looked at the side of the screen where the object had been located. Across two experiments, we behaviorally replicated the emotion-induced memory trade-off effect, in that negative object memory was better than neutral object memory at the expense of background memory. Furthermore, we found evidence that gaze reinstatement was related to recognition memory for the object and background scene components. This effect was generally comparable for negative and neutral memories, although the effects of valence varied somewhat between the two experiments. Together, these findings suggest that gaze reinstatement occurs independently of the processes contributing to the emotion-induced memory trade-off effect.

Quantifying task-related gaze.

Competing theories attempt to explain what guides eye movements when exploring natural scenes: bottom-up image salience and top-down semantic salience. In one study, we apply language-based analyses to quantify the well-known observation that task influences gaze in natural scenes. Subjects viewed ten scenes as if they were performing one of two tasks. We found that the semantic similarity between the task and the labels of objects in the scenes captured the task-dependence of gaze (t(39) = 13.083; p < 0.001). In another study, we examined whether image salience or semantic salience better predicts gaze during a search task, and if viewing strategies are affected by searching for targets of high or low semantic relevance to the scene. Subjects searched 100 scenes for a high- or low-relevance object. We found that image salience becomes a worse predictor of gaze across successive fixations, while semantic salience remains a consistent predictor (X2(1, N=40) = 75.148, p < .001). Furthermore, we found that semantic salience decreased as object relevance decreased (t(39) = 2.304; p = .027). These results suggest that semantic salience is a useful predictor of gaze during task-related scene viewing, and that even in target-absent trials, gaze is modulated by the relevance of a search target to the scene in which it might be located.

Is P3 amplitude associated with greater gaze distraction effect in schizotypy?

A recently proposed "Hyperfocusing hypothesis" suggests that schizotypy is associated with a more narrow but more intense way of allocating attention. The current study aims to test a vital prediction of this hypothesis in a social context, that schizotypy may be related to greater difficulty overcoming the distracting effects of gaze. This could cause a longer time to respond to targets that are invalidly cued by gaze. The current study tested this prediction in a modified Posner cueing paradigm by using P3 as an indicator for attentional resources. Seventy-four young healthy individuals with different levels of schizotypy were included, they were asked to detect the location of a target that was cued validly or invalidly by the gaze and head orientation. The results revealed that (a) schizotypy is associated with hyperfocusing on gaze direction, leading to greater difficulty overcoming the distracting effect of gaze. The higher the trait-schizotypy score, the more time needed to respond to targets that were invalidly cued by gaze (b) schizotypy is associated with reduced P3 which is directed by social communicative stimuli. The higher the trait-schizotypy score, the smaller the amplitude of P3 (c) the relationship between schizotypal traits and response times of the gaze-invalid condition is fully intermediated by P3. The findings of the current study suggest the P3 component may be a crucial neural mechanism underlying joint attention deficits in schizophrenia.

Common structure of saccades and microsaccades in visual perception.

We obtain large amounts of external information through our eyes, a process often considered analogous to picture mapping onto a camera lens. However, our eyes are never as still as a camera lens, with saccades occurring between fixations and microsaccades occurring within a fixation. Although saccades are agreed to be functional for information sampling in visual perception, it remains unknown if microsaccades have a similar function when eye movement is restricted. Here, we demonstrated that saccades and microsaccades share common spatiotemporal structures in viewing visual objects. Twenty-seven adults viewed faces and houses in free-viewing and fixation-controlled conditions. Both saccades and microsaccades showed distinctive spatiotemporal patterns between face and house viewing that could be discriminated by pattern classifications. The classifications based on saccades and microsaccades could also be mutually generalized. Importantly, individuals who showed more distinctive saccadic patterns between faces and houses also showed more distinctive microsaccadic patterns. Moreover, saccades and microsaccades showed a higher structure similarity for face viewing than house viewing and a common orienting preference for the eye region over the mouth region. These findings suggested a common oculomotor program that is used to optimize information sampling during visual object perception.

Gaze patterns reflect the retrieval and selection of memories in a context-dependent object location retrieval task.

Selective retrieval of context-relevant memories is critical for animal survival. A behavioral index that captures its dynamic nature in real time is necessary to investigate this retrieval process. Here, we found a bias in eye gaze towards the locations previously associated with individual objects during retrieval. Participants learned two locations associated with each visual object and recalled one of them indicated by a contextual cue in the following days. Before the contextual cue presentation, participants often gazed at both locations associated with the given object on the background screen (look-at-both), and the frequency of look-at-both gaze pattern increased as learning progressed. Following the cue presentation, their gaze shifted toward the context-appropriate location. Interestingly, participants showed a higher accuracy of memory retrieval in trials where they gazed at both object-associated locations, implying functional advantage of the look-at-both gaze patterns. Our findings indicate that naturalistic eye movements reflect the dynamic process of memory retrieval and selection, highlighting the potential of eye gaze as an indicator for studying these cognitive processes.

Mri findings, looking behaviour and affect recognition in very preterm children: A pilot study.

Children born very preterm often exhibit atypical gaze behaviors, affect recognition difficulties and are at risk for cerebral white matter damage. This study explored links between these sequalae. In 24 12-year-old children born very preterm, ventricle size using Evans and posterior ventricle indices, and corpus callosum area were used to measure white matter thickness. The findings revealed a correlation between less attention towards the eyes and larger ventricle size. Ventricle and posterior corpus callosum sizes were correlated to affect-recognition proficiency. Findings suggest a link between white matter damage, gaze behavior, and affect recognition accuracy, emphasizing a relation with social perception.

Toward a theory of perspective perception in pictures.

This paper reviews projection models and their perception in realistic pictures, and proposes hypotheses for three-dimensional (3D) shape and space perception in pictures. In these hypotheses, eye fixations, and foveal vision play a central role. Many past theories and experimental studies focus solely on linear perspective. Yet, these theories fail to explain many important perceptual phenomena, including the effectiveness of nonlinear projections. Indeed, few classical paintings strictly obey linear perspective, nor do the best distortion-avoidance techniques for wide-angle computational photography. The hypotheses here employ a two-stage model for 3D human vision. When viewing a picture, the first stage perceives 3D shape for the current gaze. Each fixation has its own perspective projection, but, owing to the nature of foveal and peripheral vision, shape information is obtained primarily for a small region of the picture around the fixation. As a viewer moves their eyes, the second stage continually integrates some of the per-gaze information into an overall interpretation of a picture. The interpretation need not be geometrically stable or consistent over time. It is argued that this framework could explain many disparate pictorial phenomena, including different projection styles throughout art history and computational photography, while being consistent with the constraints of human 3D vision. The paper reviews open questions and suggests new studies to explore these hypotheses.

Sustaining attention in visuomotor timing is associated with location-based binding.

Maintaining focus of attention over prolonged periods can be challenging, especially when the target stimulus is absent from the temporal sequence. Prior research has shown that a temporal attentional cue filling in the temporal blank can improve sustained attention: in a sustained visual attention task requiring synchronizing finger tapping with a temporally regular sequence composed of brief flash disks interleaved with blank periods, task performance was improved when a continuous fixation point that served as a temporal attentional cue was presented superimposed on the disk stimulus. To test the hypothesis that binding the temporal attentional cue with the target temporal sequence by spatial overlapping is crucial for enhancing sustained attention, the present study conducted a series of three experiments that deconstructed the bound connection between the cue and the sequence stimulus. In Experiment 1, the cue was placed above or below a flash disk. In Experiment 2, the cue was between two vertically arranged flash disks. In Experiment 3, the cue was in a flash ring. No significant effect of sustained attention improvement was found in any of the three experiments. Experiment 4 further replicated these null results and the previously observed effect of sustained attention improvement when the temporal cue was superimposed on the sequence stimulus. Our finding demonstrates that binding by spatial overlapping during the temporal blank when the sequence stimulus is absent is critical for enhancing sustained attention, which should be beneficial for improving performance across a broader range of tasks that require prolonged maintenance of attention.

Gaze and behavioural metrics in the refractive correction of presbyopia.

PURPOSE: To investigate gaze and behavioural metrics at different viewing distances with multifocal contact lenses (MFCLs), single vision contact lenses (SVCLs) and progressive addition lenses (PALs). METHODS: Fifteen presbyopic contact lens wearers participated over five separate study visits. At each visit, participants were randomly assigned to wear one of five refractive corrections: habitual PAL spectacles, delefilcon A (Alcon Inc.) MFCLs and three separate pairs of delefilcon A single vision lenses worn as distance, intermediate and near corrections. Participants wore a Pupil Core headset to record eye and head movements while performing three visual tasks: reading, visual search and scene observation. Data were investigated using linear regression and post-hoc testing. Parameters of interest included gaze (fixation duration, head movement) and behavioural (reading speed, reading accuracy, visual search time) metrics. RESULTS: Reading speed in SVCLs was significantly faster than in MFCLs and PAL spectacles (F = 16.3, p < 0.0001). Refractive correction worn did not influence visual search times (F = 0.16, p = 0.85). Fixation duration was significantly affected by the type of visual task (F = 60.2, p < 0.001), and an interaction effect was observed between viewing distance and refractive correction (F = 4.3, p = 0.002). There was significantly more horizontal and vertical head movement (F = 3.2, p = 0.01 and F = 3.3, p = 0.01, respectively) during visual search tasks when wearing PAL spectacles compared to SVCLs or MFCLs. CONCLUSION: This work showed that the type of refractive correction affects behavioural metrics such as reading speed and gaze behaviour by affecting horizontal and vertical head movements. The findings of this study suggest that under certain conditions, wearers of MFCLs make fewer head movements compared to PAL spectacles. Gaze behaviour metrics offer a new approach to compare and understand contact lens and spectacle performance, with potential applications including peripheral optical designs for myopia management.

The Functional Vision for Communication Questionnaire (FVC-Q): Exploring Parental Report of Non-Speaking Children's Fixation Skills Using a Structured History-Taking Approach.

This paper explores whether a structured history-taking tool yields useful descriptions of children's looking skills. Parents of 32 children referred to a specialist communication clinic reported their child's looking skills using the Functional Vision for Communication Questionnaire (FVC-Q), providing descriptions of single object fixation, fixation shifts between objects and fixation shifts from object to person. Descriptions were compared with clinical assessment. 24/32 children were reported to have some limitation in fixation. Limitation was subsequently seen in 30/32 children. Parental report and assessment agreed fully in 23/32 (72%). The largest area of discrepancy was object-person fixation shifts, with five children not observed to show this behavior despite its being reported. Findings indicate a structured questionnaire yields description of fixations, which correspond well with clinical assessment. Descriptions supported discussion between parents and clinicians. It is proposed that the FVC-Q is a valuable tool in supporting clinicians in eliciting information about fixation skills.

Pupil Response in Visual Tracking Tasks: The Impacts of Task Load, Familiarity, and Gaze Position.

Pupil size is a significant biosignal for human behavior monitoring and can reveal much underlying information. This study explored the effects of task load, task familiarity, and gaze position on pupil response during learning a visual tracking task. We hypothesized that pupil size would increase with task load, up to a certain level before decreasing, decrease with task familiarity, and increase more when focusing on areas preceding the target than other areas. Fifteen participants were recruited for an arrow tracking learning task with incremental task load. Pupil size data were collected using a Tobii Pro Nano eye tracker. A 2 × 3 × 5 three-way factorial repeated measures ANOVA was conducted using R (version 4.2.1) to evaluate the main and interactive effects of key variables on adjusted pupil size. The association between individuals' cognitive load, assessed by NASA-TLX, and pupil size was further analyzed using a linear mixed-effect model. We found that task repetition resulted in a reduction in pupil size; however, this effect was found to diminish as the task load increased. The main effect of task load approached statistical significance, but different trends were observed in trial 1 and trial 2. No significant difference in pupil size was detected among the three gaze positions. The relationship between pupil size and cognitive load overall followed an inverted U curve. Our study showed how pupil size changes as a function of task load, task familiarity, and gaze scanning. This finding provides sensory evidence that could improve educational outcomes.

The center of a face catches the eye in face perception.

Using the "Don't look" (DL) paradigm, wherein participants are asked not to look at a specific feature (i.e., eye, nose, and mouth), we previously documented that Easterners struggled to completely avoid fixating on the eyes and nose. Their underlying mechanisms for attractiveness may differ because the fixations on the eyes were triggered only reflexively, whereas fixations on the nose were consistently elicited. In this study, we predominantly focused on the nose, where the center-of-gravity (CoG) effect, which refers to a person's tendency to look near an object's CoG, could be confounded. Full-frontal and mid-profile faces were used because the latter's CoG did not correspond to the nose location. Although we hypothesized that these two effects are independent, the results indicated that, in addition to the successful tracing of previous studies, the CoG effect explains the nose-attracting effect. This study not only reveals this explanation but also raises a question regarding the CoG effect on Eastern participants.

Age-Differential Role of Gaze Reinstatement in Recognition Memory for Negative Visual Stimuli.

OBJECTIVES: Although research has shown that the replay of encoding-specific gaze patterns during retrieval, known as gaze reinstatement, facilitates memory retrieval, little is known about whether it differentially associates with the negativity preference in memory (defined as enhanced memory for negative stimuli relative to neutral stimuli in this study) among younger and older adults. The present study aims to address this research gap. METHODS: A total of 33 older adults (16 women; aged 58-69 years, M = 63.48, SD = 2.98) and 36 younger adults (10 women; aged 18-26 years, M = 20.39, SD = 1.57) completed a remember/know recognition memory task involving negative and neutral pictures. Their eye movements were tracked during both the memory encoding and retrieval phases. RESULTS: Younger and older adults had better memory for negative than neutral pictures. Older adults exhibited significantly stronger gaze reinstatement for negative than neutral stimuli, while this difference was nonsignificant in younger adults. Moreover, gaze reinstatement is positively linked to memory performance in both age groups. DISCUSSION: The results suggest that gaze reinstatement may play age-differential roles in the negativity preference of memory. Negative valence may enhance gaze reinstatement, which improves subsequent recognition memory, particularly among older adults. The finding contributes to a better understanding of the mechanisms underlying the negative preference for memory in different age groups.

Pathways for Naturalistic Looking Behavior in Primate II. Superior Colliculus Integrates Parallel Top-down and Bottom-up Inputs.

Volitional signals for gaze control are provided by multiple parallel pathways converging on the midbrain superior colliculus (SC), whose deeper layers output to the brainstem gaze circuits. In the first of two papers (Takahashi and Veale, 2023), we described the properties of gaze behavior of several species under both laboratory and natural conditions, as well as the current understanding of the brainstem and spinal cord circuits implementing gaze control in primate. In this paper, we review the parallel pathways by which sensory and task information reaches SC and how these sensory and task signals interact within SC's multilayered structure. This includes both bottom-up (world statistics) signals mediated by sensory cortex, association cortex, and subcortical structures, as well as top-down (goal and task) influences which arrive via either direct excitatory pathways from cerebral cortex, or via indirect basal ganglia relays resulting in inhibition or dis-inhibition as appropriate for alternative behaviors. Models of attention such as saliency maps serve as convenient frameworks to organize our understanding of both the separate computations of each neural pathway, as well as the interaction between the multiple parallel pathways influencing gaze. While the spatial interactions between gaze's neural pathways are relatively well understood, the temporal interactions between and within pathways will be an important area of future study, requiring both improved technical methods for measurement and improvement of our understanding of how temporal dynamics results in the observed spatiotemporal allocation of gaze.

The effect of self-focused attention during mirror gazing on body image evaluations, appearance-related imagery, and urges to mirror gaze.

BACKGROUND AND OBJECTIVES: Mirror gazing has been linked to poor body image. Cognitive-behavioral models propose that mirror gazing induces self-focused attention. This activates appearance-related imagery, increases body dissatisfaction, and promotes further mirror gazing. However, evidence for these relationships remains scarce. Our study experimentally investigated how self-focused attention impacts overall and facial appearance satisfaction, perceived attractiveness, distress about appearance and disliked features, vividness and emotional quality of appearance-related imagery, and urges to mirror gaze. Baseline body dysmorphic concerns were studied as a moderator. METHODS: Singaporean undergraduates (Mage = 21.22, SDage = 1.62; 35 females, 28 males) were randomly assigned to high or low self-focused attention during a mirror gazing task. Dependent variables were measured with visual analogue scales, and body dysmorphic concerns with the Body Image Disturbance Questionnaire (BIDQ). Analysis of variance and moderation analyses were conducted. RESULTS: Self-focused attention lowered overall and facial appearance satisfaction. Perceived attractiveness decreased only in individuals with high baseline body dysmorphic concerns. Contrary to predictions, distress, appearance-related imagery, and urges to mirror gaze were unaffected. LIMITATIONS: This study used a non-clinical sample. The BIDQ has not been psychometrically validated in Singaporean samples. CONCLUSIONS: Self-focused attention during mirror gazing lowers positive body image evaluations. Individuals with higher body dysmorphic concerns are particularly vulnerable to low perceived attractiveness.