Individual differences in human gaze behavior generalize from faces to objects.

Individuals differ in where they fixate on a face, with some looking closer to the eyes while others prefer the mouth region. These individual biases are highly robust, generalize from the lab to the outside world, and have been associated with social cognition and associated disorders. However, it is unclear, whether these biases are specific to faces or influenced by domain-general mechanisms of vision. Here, we juxtaposed these hypotheses by testing whether individual face fixation biases generalize to inanimate objects. We analyzed >1.8 million fixations toward faces and objects in complex natural scenes from 405 participants tested in multiple labs. Consistent interindividual differences in fixation positions were highly inter-correlated across faces and objects in all samples. Observers who fixated closer to the eye region also fixated higher on inanimate objects and vice versa. Furthermore, the inter-individual spread of fixation positions scaled with target size in precisely the same, non-linear manner for faces and objects. These findings contradict a purely domain-specific account of individual face gaze. Instead, they suggest significant domain-general contributions to the individual way we look at faces, a finding with potential relevance for basic vision, face perception, social cognition, and associated clinical conditions.

The Timing of Gaze Direction Perception: ERP Decoding and Task Modulation.

Distinguishing the direction of another person's eye gaze is extremely important in everyday social interaction, as it provides critical information about people's attention and, therefore, intentions. The temporal dynamics of gaze processing have been investigated using event-related potentials (ERPs) recorded with electroencephalography (EEG). However, the moment at which our brain distinguishes the gaze direction (GD), irrespectively of other facial cues, remains unclear. To solve this question, the present study aimed to investigate the time course of gaze direction processing, using an ERP decoding approach, based on the combination of a support vector machine and error-correcting output codes. We recorded EEG in young healthy subjects, 32 of them performing GD detection and 34 conducting face orientation tasks. Both tasks presented 3D realistic faces with five different head and gaze orientations each: 30°, 15° to the left or right, and 0°. While the classical ERP analyses did not show clear GD effects, ERP decoding analyses revealed that discrimination of GD, irrespective of head orientation, started at 140 ms in the GD task and at 120 ms in the face orientation task. GD decoding accuracy was higher in the GD task than in the face orientation task and was the highest for the direct gaze in both tasks. These findings suggest that the decoding of brain patterns is modified by task relevance, which changes the latency and the accuracy of GD decoding.

Influence of gaze, vision, and memory on hand kinematics in a placement task.

People usually reach for objects to place them in some position and orientation, but the placement component of this sequence is often ignored. For example, reaches are influenced by gaze position, visual feedback, and memory delays, but their influence on object placement is unclear. Here, we tested these factors in a task where participants placed and oriented a trapezoidal block against two-dimensional (2-D) visual templates displayed on a frontally located computer screen. In experiment 1, participants matched the block to three possible orientations: 0° (horizontal), +45° and -45°, with gaze fixated 10° to the left/right. The hand and template either remained illuminated (closed-loop), or visual feedback was removed (open-loop). Here, hand location consistently overshot the template relative to gaze, especially in the open-loop task; likewise, orientation was influenced by gaze position (depending on template orientation and visual feedback). In experiment 2, a memory delay was added, and participants sometimes performed saccades (toward, away from, or across the template). In this task, the influence of gaze on orientation vanished, but location errors were influenced by both template orientation and final gaze position. Contrary to our expectations, the previous saccade metrics also impacted placement overshoot. Overall, hand orientation was influenced by template orientation in a nonlinear fashion. These results demonstrate interactions between gaze and orientation signals in the planning and execution of hand placement and suggest different neural mechanisms for closed-loop, open-loop, and memory delay placement.NEW & NOTEWORTHY Eye-hand coordination studies usually focus on object acquisition, but placement is equally important. We investigated how gaze position influences object placement toward a 2-D template with different levels of visual feedback. Like reach, placement overestimated goal location relative to gaze and was influenced by previous saccade metrics. Gaze also modulated hand orientation, depending on template orientation and level of visual feedback. Gaze influence was feedback-dependent, with location errors having no significant effect after a memory delay.

A computational account of conflict processing during mental imagery.

Previous studies examining conflict processing within the context of a color-word Stroop task have focused on both stimulus and response conflicts. However, it has been unclear whether conflict can emerge independently of stimulus conflict. In this study, a novel arrow-gaze mental-rotation Stroop task was introduced to explore the interplay between conflict processing and mental rotation. A modelling approach was utilized to provide a process-level account of the findings. The results of our Stroop task indicate that conflict can emerge from mental rotation in the absence of stimulus conflict. The strength of this imagery conflict effect decreases and even reverses as mental rotation angles increase. Additionally, it was observed that participants responded more quickly and with greater accuracy to small rather than large face orientations. A comparison of three conflict diffusion models-the diffusion model for conflict tasks (DMC), the dual-stage two-phase model (DSTP), and the shrinking spotlight model (SSP)-yielded consistent support for the DSTP over the DMC and SSP in the majority of instances. The DSTP account of the experimental results revealed an increased nondecision time with increasing mental rotation, a reduction in interference from incompatible stimuli, and an improved drift rate in response selection phase, which suggests enhanced cognitive control. The findings from the model-based analysis provide evidence for a novel interaction between cognitive control and mental rotation.

Can I see it in the eyes? An investigation of freezing-like motion patterns in response to avoidable threat.

Freezing is one of the most extensively studied defensive behaviors in rodents. Both reduced body and gaze movements during anticipation of threat also occur in humans and have been discussed as translational indicators of freezing but their relationship remains unclear. We thus set out to elucidate body and eye movements and concomitant autonomic dynamics in anticipation of avoidable threat. Specifically, 50 participants viewed naturalistic pictures that were preceded by a colored fixation cross, signaling them whether to expect an inevitable (shock), no (safety), or a potential shock (flight) that could be avoided by a quick button press. Body sway, eye movements, the heart rate and skin conductance were recorded. We replicated previously described reductions in body sway, gaze dispersion, and the heart rate, and a skin conductance increase in flight trials. Stronger reductions in gaze but not in body sway predicted faster motor reactions on a trial-wise basis, highlighting their functional role in action preparation. We failed to find a trait-like relationship between body and gaze movements across participants, but their temporal profiles were positively related within individuals, suggesting that both metrics partly reflect the same construct. However, future research is desirable to assess these response patterns in naturalistic environments. A more ethological examination of different movement dynamics upon threat would not only warrant better comparability between rodent and human research but also help determine whether and how eye-tracking could be implemented as a proxy for fear-related movements in restricted brain imaging environments.

Temporal dynamics of ocular torsion and vertical vergence during visual, vestibular, and visuovestibular rotations.

Ocular torsion and vertical divergence reflect the brain's sensorimotor integration of motion through the vestibulo-ocular reflex (VOR) and the optokinetic reflex (OKR) to roll rotations. Torsion and vergence however express different response patterns depending on several motion variables, but research on their temporal dynamics remains limited. This study investigated the onset times of ocular torsion (OT) and vertical vergence (VV) during visual, vestibular, and visuovestibular motion, as well as their relative decay rates following prolonged optokinetic stimulations. Temporal characteristics were retrieved from three separate investigations where the level of visual clutter and acceleration were controlled. Video eye-tracking was used to retrieve the eye-movement parameters from a total of 41 healthy participants across all trials. Ocular torsion consistently initiated earlier than vertical vergence, particularly evident under intensified visual information density, and higher clutter levels were associated with more balanced decay rates. Additionally, stimulation modality and accelerations affected the onsets of both eye movements, with visuovestibular motion triggering earlier responses compared to vestibular motion, and increased accelerations leading to earlier onsets for both movements. The present study showed that joint visuovestibular responses produced more rapid onsets, indicating a synergetic sensorimotor process. It also showed that visual content acted as a fusional force during the decay period, and imposed greater influence over the torsional onset compared to vergence. Acceleration, by contrast, did not affect the temporal relationship between the two eye movements. Altogether, these findings provide insights into the sensorimotor integration of the vestibulo-ocular and optokinetic reflex arcs.

The center of a face catches the eye in face perception.

Using the "Don't look" (DL) paradigm, wherein participants are asked not to look at a specific feature (i.e., eye, nose, and mouth), we previously documented that Easterners struggled to completely avoid fixating on the eyes and nose. Their underlying mechanisms for attractiveness may differ because the fixations on the eyes were triggered only reflexively, whereas fixations on the nose were consistently elicited. In this study, we predominantly focused on the nose, where the center-of-gravity (CoG) effect, which refers to a person's tendency to look near an object's CoG, could be confounded. Full-frontal and mid-profile faces were used because the latter's CoG did not correspond to the nose location. Although we hypothesized that these two effects are independent, the results indicated that, in addition to the successful tracing of previous studies, the CoG effect explains the nose-attracting effect. This study not only reveals this explanation but also raises a question regarding the CoG effect on Eastern participants.

Variation in gaze following across the life span: A process-level perspective.

Following eye gaze is fundamental for many social-cognitive abilities, for example, when judging what another agent can or cannot know. While the emergence of gaze following has been thoroughly studied on a group level, we know little about (a) the developmental trajectory beyond infancy and (b) the sources of individual differences. In Study 1, we examined gaze following across the lifespan (N = 478 3- to 19-year-olds from Leipzig, Germany; and N = 240 20- to 80-year-old international, remotely tested adults). We found a steep performance improvement during preschool years, in which children became more precise in locating the attentional focus of an agent. Precision levels then stayed comparably stable throughout adulthood with a minor decline toward old age. In Study 2, we formalized the process of gaze following in a computational cognitive model that allowed us to conceptualize individual differences in a psychologically meaningful way (N = 60 3- to 5-year-olds, 50 adults). According to our model, participants estimate pupil angles with varying levels of precision based on observing the pupil location within the agent's eyes. In Study 3, we empirically tested how gaze following relates to vector following in non-social settings and perspective-taking abilities (N = 102 4- to 5-year-olds). We found that gaze following is associated with both of these abilities but less so with other Theory of Mind tasks. This work illustrates how the combination of reliable measurement instruments and formal theoretical models allows us to explore the in(ter)dependence of core social-cognitive processes in greater detail. RESEARCH HIGHLIGHTS: Gaze following develops beyond infancy. The highest precision levels in localizing attentional foci are reached in young adulthood with a slight decrease towards old age. We present a computational model that describes gaze following as a process of estimating pupil angles and the corresponding gaze vectors. The model explains individual differences and recovers signature patterns in the data. To estimate the relation between gaze- and vector following, we designed a non-social vector following task. We found substantial correlations between gaze following and vector following, as well as Level 2 perspective-taking. Other Theory of Mind tasks did not correlate.

Effects of Inversion and Fixation Location on the Processing of Face and House Stimuli - A Mass Univariate Analysis.

Most Event Related Potential studies investigating the time course of visual processing have focused mainly on the N170 component. Stimulus orientation affects the N170 amplitude for faces but not for objects, a finding interpreted as reflecting holistic/configural processing for faces and featural processing for objects. Furthermore, while recent studies suggest where on the face people fixate impacts the N170, fixation location effects have not been investigated in objects. A data-driven mass univariate analysis (all time points and electrodes) was used to investigate the time course of inversion and fixation location effects on the neural processing of faces and houses. Strong and widespread orientation effects were found for both faces and houses, from 100-350ms post-stimulus onset, including P1 and N170 components, and later, a finding arguing against a lack of holistic processing for houses. While no clear fixation effect was found for houses, fixation location strongly impacted face processing early, reflecting retinotopic mapping around the C2 and P1 components, and during the N170-P2 interval. Face inversion effects were also largest for nasion fixation around 120ms. The results support the view that facial feature integration (1) depends on which feature is being fixated and where the other features are situated in the visual field, (2) occurs maximally during the P1-N170 interval when fixation is on the nasion and (3) continues past 200ms, suggesting the N170 peak, where weak effects were found, might be an inflexion point between processes rather than the end of a feature integration into a whole process.

Novelty preference assessed by eye tracking: A sensitive measure of impaired recognition memory in epilepsy.

OBJECTIVE: Epilepsy patients often report memory deficits despite normal objective testing, suggesting that available measures are insensitive or that non-mnemonic factors are involved. The Visual Paired Comparison Task (VPCT) assesses novelty preference, the tendency to fixate on novel images rather than previously viewed items, requiring recognition memory for the "old" images. As novelty preference is a sensitive measure of hippocampal-dependent memory function, we predicted impaired VPCT performance in epilepsy patients compared to healthy controls. METHODS: We assessed 26 healthy adult controls and 31 epilepsy patients (16 focal-onset, 13 generalized-onset, 2 unknown-onset) with the VPCT using delays of 2 or 30 s between encoding and recognition. Fifteen healthy controls and 17 epilepsy patients (10 focal-onset, 5 generalized-onset, 2 unknown-onset) completed the task at 2-, 5-, and 30-minute delays. Subjects also performed standard memory measures, including the Medical College of Georgia (MCG) Paragraph Test, California Verbal Learning Test-Second Edition (CVLT-II), and Brief Visual Memory Test-Revised (BVMT-R). RESULTS: The epilepsy group was high functioning, with greater estimated IQ (p = 0.041), greater years of education (p = 0.034), and higher BVMT-R scores (p = 0.024) compared to controls. Both the control group and epilepsy cohort, as well as focal- and generalized-onset subgroups, had intact novelty preference at the 2- and 30-second delays (p-values ≤ 0.001) and declined at 30 min (p-values > 0.05). Only the epilepsy patients had early declines at 2- and 5-minute delays (controls with intact novelty preference at p = 0.003 and p ≤ 0.001, respectively; epilepsy groups' p-values > 0.05). CONCLUSIONS: Memory for the "old" items decayed more rapidly in overall, focal-onset, and generalized-onset epilepsy groups. The VPCT detected deficits while standard memory measures were largely intact, suggesting that the VPCT may be a more sensitive measure of temporal lobe memory function than standard neuropsychological batteries.

Interacting with autistic virtual characters: intrapersonal synchrony of nonverbal behavior affects participants' perception.

Temporal coordination of communicative behavior is not only located between but also within interaction partners (e.g., gaze and gestures). This intrapersonal synchrony (IaPS) is assumed to constitute interpersonal alignment. Studies show systematic variations in IaPS in individuals with autism, which may affect the degree of interpersonal temporal coordination. In the current study, we reversed the approach and mapped the measured nonverbal behavior of interactants with and without ASD from a previous study onto virtual characters to study the effects of the differential IaPS on observers (N = 68), both with and without ASD (crossed design). During a communication task with both characters, who indicated targets with gaze and delayed pointing gestures, we measured response times, gaze behavior, and post hoc impression formation. Results show that character behavior indicative of ASD resulted in overall enlarged decoding times in observers and this effect was even pronounced in observers with ASD. A classification of observer's gaze types indicated differentiated decoding strategies. Whereas non-autistic observers presented with a rather consistent eyes-focused strategy associated with efficient and fast responses, observers with ASD presented with highly variable decoding strategies. In contrast to communication efficiency, impression formation was not influenced by IaPS. The results underline the importance of timing differences in both production and perception processes during multimodal nonverbal communication in interactants with and without ASD. In essence, the current findings locate the manifestation of reduced reciprocity in autism not merely in the person, but in the interactional dynamics of dyads.

Evidence That Pervasive Body Gaze Behavior in Heterosexual Men Is a Social Marker for Implicit, Physiological, and Explicit Sexual Assault Propensities.

Deliberate and effortful attempts to gaze at the bodies of women is emerging as a valuable marker of sexual objectification in men. Some preliminary evidence suggests that pervasive body gaze behavior may also accompany insidious attitudes which can facilitate sexual assault. The present study aimed to further explore this potential by examining pervasive body gaze associations with explicit, implicit, and physiological sexual assault propensity measures. We presented 110 heterosexual male participants with images of fully and partially dressed women with and without injuries while measuring their skin conductance responses. We also captured implicit and explicit sexual assault measures in addition to self-reported pervasive body gaze behavior. Pervasive body gaze behavior was significantly correlated with rape myth acceptance attitudes, prior perpetration of sexual assault, a stronger implicit association between erotica and aggression, and lower physiological reactivity during exposure to partially dressed injured women. These findings suggest that body gaze towards women could be a behavioral marker for inclinations to victim blame, preferences for rough sexual conduct, and a physiological desensitization towards female victims. This study further validates a five item self-reported body gaze measure as a valuable tool for detecting deviant sexual objectification attitudes and affective states. As such, measurement and observation of body gaze behavior could be useful for developing risk assessments, estimating intervention efficacy, and enhancing public awareness.

Depressive symptoms and visual attention to others' eyes in healthy individuals.

BACKGROUND: Eye contact is a fundamental part of social interaction. In clinical studies, it has been observed that patients suffering from depression make less eye contact during interviews than healthy individuals, which could be a factor contributing to their social functioning impairments. Similarly, results from mood induction studies with healthy persons indicate that attention to the eyes diminishes as a function of sad mood. The present screen-based eye-tracking study examined whether depressive symptoms in healthy individuals are associated with reduced visual attention to other persons' direct gaze during free viewing. METHODS: Gaze behavior of 44 individuals with depressive symptoms and 49 individuals with no depressive symptoms was analyzed in a free viewing task. Grouping was based on the Beck Depression Inventory using the cut-off proposed by Hautzinger et al. (2006). Participants saw pairs of faces with direct gaze showing emotional or neutral expressions. One-half of the face pairs was shown without face masks, whereas the other half was presented with face masks. Participants' dwell times and first fixation durations were analyzed. RESULTS: In case of unmasked facial expressions, participants with depressive symptoms looked shorter at the eyes compared to individuals without symptoms across all expression conditions. No group difference in first fixation duration on the eyes of masked and unmasked faces was observed. Individuals with depressive symptoms dwelled longer on the mouth region of unmasked faces. For masked faces, no significant group differences in dwell time on the eyes were found. Moreover, when specifically examining dwell time on the eyes of faces with an emotional expression there were also no significant differences between groups. Overall, participants gazed significantly longer at the eyes in masked compared to unmasked faces. CONCLUSIONS: For faces without mask, our results suggest that depressiveness in healthy individuals goes along with less visual attention to other persons' eyes but not with less visual attention to others' faces. When factors come into play that generally amplify the attention directed to the eyes such as face masks or emotions then no relationship between depressiveness and visual attention to the eyes can be established.

In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimation and Beyond.

Predicting human's gaze from egocentric videos serves as a critical role for human intention understanding in daily activities. In this paper, we present the first transformer-based model to address the challenging problem of egocentric gaze estimation. We observe that the connection between the global scene context and local visual information is vital for localizing the gaze fixation from egocentric video frames. To this end, we design the transformer encoder to embed the global context as one additional visual token and further propose a novel global-local correlation module to explicitly model the correlation of the global token and each local token. We validate our model on two egocentric video datasets - EGTEA Gaze + and Ego4D. Our detailed ablation studies demonstrate the benefits of our method. In addition, our approach exceeds the previous state-of-the-art model by a large margin. We also apply our model to a novel gaze saccade/fixation prediction task and the traditional action recognition problem. The consistent gains suggest the strong generalization capability of our model. We also provide additional visualizations to support our claim that global-local correlation serves a key representation for predicting gaze fixation from egocentric videos. More details can be found in our website (https://bolinlai.github.io/GLC-EgoGazeEst).

The effects of gaze-display feedback on medical students' self-monitoring and learning in radiology.

Self-monitoring is essential for effectively regulating learning, but difficult in visual diagnostic tasks such as radiograph interpretation. Eye-tracking technology can visualize viewing behavior in gaze displays, thereby providing information about visual search and decision-making. We hypothesized that individually adaptive gaze-display feedback improves posttest performance and self-monitoring of medical students who learn to detect nodules in radiographs. We investigated the effects of: (1) Search displays, showing which part of the image was searched by the participant; and (2) Decision displays, showing which parts of the image received prolonged attention in 78 medical students. After a pretest and instruction, participants practiced identifying nodules in 16 cases under search-display, decision-display, or no feedback conditions (n = 26 per condition). A 10-case posttest, without feedback, was administered to assess learning outcomes. After each case, participants provided self-monitoring and confidence judgments. Afterward, participants reported on self-efficacy, perceived competence, feedback use, and perceived usefulness of the feedback. Bayesian analyses showed no benefits of gaze displays for post-test performance, monitoring accuracy (absolute difference between participants' estimated and their actual test performance), completeness of viewing behavior, self-efficacy, and perceived competence. Participants receiving search-displays reported greater feedback utilization than participants receiving decision-displays, and also found the feedback more useful when the gaze data displayed was precise and accurate. As the completeness of search was not related to posttest performance, search displays might not have been sufficiently informative to improve self-monitoring. Information from decision displays was rarely used to inform self-monitoring. Further research should address if and when gaze displays can support learning.

Teaching through their eyes: effects on optometry teachers' adaptivity and students' learning when teachers see students' gaze.

Adaptive teacher support fosters effective learning in one-to-one teaching sessions, which are a common way of learning complex visual tasks in the health sciences. Adaptive support is tailored to student needs, and this is difficult in complex visual tasks as visual problem-solving processes are covert and thus cannot be directly observed by the teacher. Eye-tracking apparatus can measure covert processes and make them visible in gaze displays: visualizations of where a student looks while executing a task. We investigate whether live dynamic gaze displays help teachers in being more adaptive to students' needs when teaching optical coherence tomography interpretation in one-to-one teaching sessions and whether this fosters learning. Forty-nine students and 10 teachers participated in a one-to-one teaching session in clinical optometry. In the control condition, teachers saw the learning task of the student and could discuss it with them, whereas in the gaze-display condition, teachers could additionally see where the student looked. After the 15-minute teaching session, a test was administered to examine achievement. Furthermore, students filled in the 'questionnaire on teacher support adaptivity', and teachers rated how adaptive their support was. Bayesian analyses provide some initial evidence that students did not experience support to be more adaptive in the gaze-display condition versus the control condition, nor were their post-test scores higher. Teachers rated their provided support as being more adaptive in the gaze-display versus the control condition. Further research could investigate if live dynamic gaze displays impact adaptive teaching when used over longer periods or with more teacher training.

Individual differences in sociocognitive traits in semi-free-ranging rhesus monkeys (Macaca mulatta).

Characterizing individual differences in cognition is crucial for understanding the evolution of cognition as well as to test the biological consequences of different cognitive traits. Here, we harnessed the strengths of a uniquely large, naturally-living primate population at the Cayo Santiago Biological Field Station to characterized individual differences in rhesus monkey performance across two social cognitive tasks. A total of n = 204 semi-free-ranging adult rhesus monkeys participated in a data collection procedure, where we aimed to test individuals on both tasks at two time-points that were one year apart. In the socioemotional responses task, we assessed monkeys' attention to conspecific photographs with neutral versus negative emotional expressions. We found that monkeys showed overall declines in interest in conspecific photographs with age, but relative increases in attention to threat stimuli specifically, and further that these responses exhibited long-term stability across repeated testing. In the gaze following task we assessed monkeys' propensity to co-orient with an experimenter. Here, we found no evidence for age-related change in responses, and responses showed only limited repeatability over time. Finally, we found some evidence for common individual variation for performance across the tasks: monkeys that showed greater interest in conspecific photographs were more likely to follow a human's gaze. These results show how studies of comparative cognitive development and aging can provide insights into the evolution of cognition, and identify core primate social cognitive traits that may be related across and within individuals.

Use of eye tracking in medical education.

Eye tracking has become increasingly applied in medical education research for studying the cognitive processes that occur during the performance of a task, such as image interpretation and surgical skills development. However, analysis and interpretation of the large amount of data obtained by eye tracking can be confusing. In this article, our intention is to clarify the analysis and interpretation of the data obtained from eye tracking. Understanding the relationship between eye tracking metrics (such as gaze, pupil and blink rate) and cognitive processes (such as visual attention, perception, memory and cognitive workload) is essential. The importance of calibration and how the limitations of eye tracking can be overcome is also highlighted.

Exploring the challenges of avoiding collisions with virtual pedestrians using a dual-task paradigm in individuals with chronic moderate to severe traumatic brain injury.

BACKGROUND: Individuals with a moderate-to-severe traumatic brain injury (m/sTBI), despite experiencing good locomotor recovery six months post-injury, face challenges in adapting their locomotion to the environment. They also present with altered cognitive functions, which may impact dual-task walking abilities. Whether they present collision avoidance strategies with moving pedestrians that are altered under dual-task conditions, however, remains unclear. This study aimed to compare between individuals with m/sTBI and age-matched control individuals: (1), the locomotor and cognitive costs associated with the concurrent performance of circumventing approaching virtual pedestrians (VRPs) while attending to an auditory-based cognitive task and; (2) gaze behaviour associated with the VRP circumvention task in single and dual-task conditions. METHODOLOGY: Twelve individuals with m/sTBI (age = 43.3 ± 9.5 yrs; >6 mo. post injury) and 12 healthy controls (CTLs) (age = 41.8 ± 8.3 yrs) were assessed while walking in a virtual subway station viewed in a head-mounted display. They performed a collision avoidance task with VRPs, as well as auditory-based cognitive tasks (pitch discrimination and auditory Stroop), both under single and dual-task conditions. Dual-task cost (DTC) for onset distance of trajectory deviation, minimum distance from the VRP, maximum lateral deviation, walking speed, gaze fixations and cognitive task accuracy were contrasted between groups using generalized estimating equations. RESULTS: In contrast to CTLs who showed locomotor DTCs only, individuals with m/sTBI displayed both locomotor and cognitive DTCs. While both groups walked slower under dual-task conditions, only individuals with m/sTBI failed to modify their onset distance of trajectory deviation and maintained smaller minimum distances and smaller maximum lateral deviation compared to single-task walking. Both groups showed shorter gaze fixations on the approaching VRP under dual-task conditions, but this reduction was less pronounced in the individuals with m/sTBI. A reduction in cognitive task accuracy under dual-task conditions was found in the m/sTBI group only. CONCLUSION: Individuals with m/sTBI present altered locomotor and gaze behaviours, as well as altered cognitive performances, when executing a collision avoidance task involving moving pedestrians in dual-task conditions. Potential mechanisms explaining those alterations are discussed. Present findings highlight the compromised complex walking abilities in individuals with m/sTBI who otherwise present a good locomotor recovery.

The emotion of sound target modulates the auditory gaze cueing effect.

The auditory gaze cueing effect (auditory-GCE) is a faster response to auditory targets at an eye-gaze cue location than at a non-cue location. Previous research has found that auditory-GCE can be influenced by the integration of both gaze direction and emotion conveyed through facial expressions. However, it is unclear whether the emotional information of auditory targets can be cross-modally integrated with gaze direction to affect auditory-GCE. Here, we set neutral faces with different gaze directions as cues and three emotional sounds (fearful, happy, and neutral) as targets to investigate how the emotion of sound target modulates the auditory-GCE. Moreover, we conducted a controlled experiment using arrow cues. The results show that the emotional content of sound targets influences the auditory-GCE but only for those induced by facial cues. Specifically, fearful sounds elicit a significantly larger auditory-GCE compared to happy and neutral sounds, indicating that the emotional content of auditory targets plays a modulating role in the auditory-GCE. Furthermore, this modulation appears to occur only at a higher level of social meaning, involving the integration of emotional information from a sound with social gaze direction, rather than at a lower level, which involves the integration of direction and auditory emotion.