Differences in the perception of direct gaze between the externally and internally rotated eye.

The perception of direct gaze provides multiple benefits for the observer. Previous studies have investigated how the information from both eyes is used to estimate gaze direction, showing that the perception of gaze direction differs when only the externally rotated eye versus only the internally rotated eye is visible. We examined the width and center of the area of direct gaze by presenting the observers with either the externally or internally rotated eye, or both eyes with the task to judge whether a computer avatar is looking at them. Two experiments yield evidence for a wider area of direct gaze for the externally rotated eye (around 6°) than for the internally rotated eye (around 4°). The area of direct gaze for both eyes was found to be the same as for the internally rotated eye, but smaller than for the externally rotated eye. When both eyes were present, our results indicate that the perception of direct gaze is more likely to follow the internally rotated eye. The discussion substantiates a new generalization that observers base their judgments on the more rotated eye, which can differ due to angle kappa and vergence, in our study it is the internally rotated eye.

The effect of gaze information associated with the search items on contextual cueing effect.

Previous research on the mechanisms of contextual cueing effect has been inconsistent, with some researchers showing that the contextual benefit was derived from the attentional guidance whereas others argued that the former theory was not the source of contextual cueing effect. We brought the "stare-in-the-crowd" effect that used pictures of gaze with different orientations as stimuli into a traditional contextual cueing effect paradigm to investigate whether attentional guidance plays a part in this effect. We embedded the letters used in a traditional contextual cueing effect paradigm into the gaze pictures with direct and averted orientation. In Experiment 1, we found that there was a weak interaction between the contextual cueing effect and the "stare-in-the-crowd" effect. In Experiments 2 and 3, we found that the contextual cueing effect was influenced differently when the direct gaze was combined with the target or distractors. These results suggested that attentional guidance played an important role in the generation of a contextual cueing effect and the direct gaze had a special impact on visual search. To summarize the three findings, the direct gaze on target location facilitates the contextual cueing effect, and such an effect is even greater when we compared condition with the direct gaze on target location with condition with the direct gaze on distractor location (Experiments 2 and 3). Such an effect of gaze on a contextual cueing effect is manifested even when the effect of gaze ("stare-in-the-crowd" effect) was absent in the New configurations (search trials without learning).

Looking into troubled waters: Childhood emotional maltreatment modulates neural responses to prolonged gazing into one's own, but not others', eyes.

One of the most prevalent nonverbal, social phenomena known to automatically elicit self- and other-referential processes is eye contact. By its negative effects on the perception of social safety and views about the self and others, childhood emotional maltreatment (CEM) may fundamentally affect these processes. To investigate whether the socioaffective consequences of CEM may become visible in response to (prolonged) eye gaze, 79 adult participants (mean [M]age = 49.87, standard deviation [SD]age = 4.62) viewed videos with direct and averted gaze of an unfamiliar other and themselves while we recorded self-reported mood, eye movements using eye-tracking, and markers of neural activity using fMRI. Participants who reported higher levels of CEM exhibited increased activity in ventromedial prefrontal cortex to one's own, but not to others', direct gaze. Furthermore, in contrast to those who reported fewer of such experiences, they did not report a better mood in response to a direct gaze of self and others, despite equivalent amounts of time spent looking into their own and other peoples' eyes. The fact that CEM is associated with enhanced neural activation in a brain area that is crucially involved in self-referential processing (i.e., vmPFC) in response to one's own direct gaze is in line with the chronic negative impact of CEM on a person's self-views. Interventions that directly focus on targeting maladaptive self-views elicited during eye gaze to self may be clinically useful.

Infant responses to direct gaze and associations to autism: A live eye-tracking study.

LAY ABSTRACT: When other people look directly towards us, we often respond by looking back at them, and such direct-gaze responses are important for establishing eye contact. Atypical eye contact is common in autism, but how and when this aspect of autism develops is not well understood. Here, we studied whether how much and how quickly infants respond to others' direct gaze is associated with autism in toddlerhood. We did this by measuring direct-gaze responses in a playful social interaction using live eye tracking. The study included 169 infants, of whom 129 had an elevated likelihood of developing autism due to having a first-degree family member with the condition, and 40 with typical likelihood of autism. In the elevated likelihood group, 35 were diagnosed with autism spectrum disorder at 3 years of age, and 94 were not. The results showed that infants in all three groups tended to increase their looking towards the adult's face after the adult looked directly at them. However, neither how much nor how quickly the infants responded to direct gaze by looking back at the adult reliably differentiated the infants with or without subsequent autism. While infants in the elevated likelihood of autism and subsequent diagnosis group tended to look away quicker from faces with direct gaze than infants in the typical likelihood group, this measure did not differentiate between the two elevated likelihood groups. We interpret the results as supporting the view that atypical direct-gaze responses are not early markers of autism.

'I am afraid you will see the stain on my soul': Direct gaze neural processing in individuals with PTSD after moral injury recall.

Direct eye contact is essential to understanding others' thoughts and feelings in social interactions. However, those with post-traumatic stress disorder (PTSD) and exposure to moral injury (MI) may exhibit altered theory-of-mind (ToM)/mentalizing processes and experience shame which precludes one's capacity for direct eye contact. We investigated blood oxygenation level-dependent (BOLD) responses associated with direct vs averted gaze using a virtual reality paradigm in individuals with PTSD (n = 28) relative to healthy controls (n = 18) following recall of a MI vs a neutral memory. Associations between BOLD responses and clinical symptomatology were also assessed. After MI recall, individuals with PTSD showed greater activation in the right temporoparietal junction as compared to controls (T = 4.83; pFDR < 0.001; k = 237) during direct gaze. No significant activation occurred during direct gaze after neutral memory recall. Further, a significant positive correlation was found between feelings of distress and right medial superior frontal gyrus activation in individuals with PTSD (T = 5.03; pFDR = 0.049; k = 123). These findings suggest that direct gaze after MI recall prompts compensatory ToM/mentalizing processing. Implications for future interventions aimed at mitigating the effects of PTSD on social functioning are discussed.

Are the directions of both eyes integrated before or after the perception of direct gaze? Evidence from simulated mild strabismus.

The cone of gaze is a looker's range of gaze directions that is accepted as direct by an observer. The present research asks how the condition of mild strabismus, that is, when the two eyes point in slightly different directions, influences the cone of gaze. Normally, both eyes are rotated in a coordinated manner such that both eyes are directed to the same fixation point. With strabismus, there are two fixation points, and, therefore, two directions into which the two eyes point. This raises the question of the direction and the shape (i.e., width) of the gaze cone. Two experiments are conducted with simulated mild strabismus. Three conditions are tested, the two strabismic conditions of esotropia, and exotropia and one orthotropic (nonstrabismic) condition. Results show that the direction of the gaze cone is roughly the average of the directions of the two eyes. Furthermore, the width of the gaze cone is not affected by simulated strabismus and is thus the same for the strabismic and the orthotropic conditions. The results imply a model where at first the direction of gaze based on both eyes is perceived, and where the gaze cone is implied on the basis of the combined gaze direction.

The effects of the presence of a face and direct eye gaze on voice identity learning.

We rarely become familiar with the voice of another person in isolation but usually also have access to visual identity information, thus learning to recognize their voice and face in parallel. There are conflicting findings as to whether learning to recognize voices in audiovisual vs audio-only settings is advantageous or detrimental to learning. One prominent finding shows that the presence of a face overshadows the voice, hindering voice identity learning by capturing listeners' attention (Face Overshadowing Effect; FOE). In the current study, we tested the proposal that the effect of audiovisual training on voice identity learning is driven by attentional processes. Participants learned to recognize voices through either audio-only training (Audio-Only) or through three versions of audiovisual training, where a face was presented alongside the voices. During audiovisual training, the faces were either looking at the camera (Direct Gaze), were looking to the side (Averted Gaze) or had closed eyes (No Gaze). We found a graded effect of gaze on voice identity learning: Voice identity recognition was most accurate after audio-only training and least accurate after audiovisual training including direct gaze, constituting a FOE. While effect sizes were overall small, the magnitude of FOE was halved for the Averted and No Gaze conditions. With direct gaze being associated with increased attention capture compared to averted or no gaze, the current findings suggest that incidental attention capture at least partially underpins the FOE. We discuss these findings in light of visual dominance effects and the relative informativeness of faces vs voices for identity perception.

Masked face is looking at me: Face mask increases the feeling of being looked at during the COVID-19 pandemic.

Background: As the COVID-19 global pandemic unfolded, governments recommended wearing face masks as a protective measure. Recent studies have found that a face mask influences perception; but how it affects social perception, especially the judgment of being looked at, is still unknown. This study investigated how wearing a mask influences the judgment of gaze direction by conducting a cone of direct gaze (CoDG) task. Methods: In Experiment 1, three types of masked faces were considered to investigate whether the effect of masks on CoDG is modulated by mask types. Experiment 2 was to further validate the results of Experiment 1 by adding a learning phase to help participants better distinguish N95 and surgical masks. Furthermore, to investigate whether the effect of masks derives from its social significance, a face with only the eye-region (a mouth-cut face) was used as the stimuli in Experiment 3. Results: The results of Experiment 1 found that wearing masks widens the CoDG, irrespective of the mask type. Experiment 2 replicated the results of Experiment 1. Experiment 3 found that the CoDG of N95-masked faces was wider than the mouth-cut and non-masked faces, while no significant difference existed between the CoDG of mouth-cut and non-masked faces, illustrating that the influence of wearing masks on CoDG was due to high-level social significance rather than low-level facial feature information. Conclusion: The results show that face mask increases the feeling of being looked at during the COVID-19 Pandemic. The present findings are of significance for understanding the impact of wearing masks on human social cognition in the context of COVID-19.

Face masks have a limited effect on the feeling of being looked at.

Introduction: Wearing face masks has been promoted as an effective measure to reduce the spread of COVID-19. Because face masks cover a major part of the face, they have detrimental effects on various aspects of social cognition. Yet, a highly important feature of the face is not occluded by face masks: the eyes. The eyes play an important role in social interactions: knowing where another person is looking is of central importance when interacting with others. Recent research has reported an attentional shift toward the eye region as a consequence of the widespread exposure to face masks. However, no study has yet investigated the influence of face masks on the perception of eye gaze direction. Here we investigated whether face masks have an effect on the feeling of being looked at. Assuming an attentional shift toward the eyes, we might expect more accurate gaze perception in faces wearing face masks. Methods: Sixty-five participants decided for a series of realistic avatar faces whether each face was making eye contact or not. Half of the faces wore face masks, the other half did not. For each participant and separately for each condition (mask vs. no mask), we calculated the cone of direct gaze (CoDG), a commonly used measure to quantify the range of gaze angles within which an observer assumes mutual gaze. Results: Contrary to our expectations, results show that mutual gaze is not recognized more accurately in masked faces. Rather, the CoDG was, on average, slightly wider for faces wearing masks compared to faces without masks. Discussion: Notwithstanding the relatively small effect of face mask, these findings potentially have implications on our social interactions. If we inadvertently feel looked at by an onlooker, we may react inappropriately by reciprocating the alleged approach orientation.

Effect of perceived eye gaze on the N170 component - A systematic review.

Direction of another person's eye gaze provides crucial information about their attention and intentions, which is essential for an effective social interaction. Event-related potential (ERP) measures offer precise temporal tracking of neural processes related to gaze perception. While the sensitivity of the ERP component N170 to face processing is principally agreed, the research on gaze direction effect on this component is thus far inconsistent. Here, we systematically reviewed literature on the sensitivity of N170 to gaze direction. We analysed if four factors, known to affect the face N170 (i.e., emotion, face orientation, task demand, and stimuli motion), were modulated by gaze direction. N170 sensitivity to gaze was reported the most in the studies that involved deviated faces, dynamic stimuli, and that used explicit tasks directly related to gaze or face processing. The present review provides a much-needed summary of the literature to date, highlighting the complexity of the effect of gaze direction on the N170 component, and the need of systematic studies investigating the combination of these factors.

How vergence influences the perception of being looked at.

Perceiving other people's direct gaze is important for many areas of everyday activity. For horizontal and vertical eye movements, the area of being looked at, known as the cone of gaze, has been well explored. Previous research has shown a range of eye rotations (up to eccentricities of 4°-9°) that people accept as direct gaze. Vergence is an important cue for perceiving the depth of fixation. This study examines the range of vergence angles that support the perception of being looked at. In two experiments, observers adjusted the degree of vergence of the lookers' eyes until they felt just (not) looked at. The first experiment also asked to adjust the point of being exactly looked at, which was 0° (parallel eyes). The thresholds of being just (not) looked at were around 4.5° of convergence and 2.5° divergence, which results in a depth of 7° of vergence. This depth was replicated in Experiment 2, while the thresholds of convergence (3.5°) and divergence (3.5°) slightly differ from Experiment 1. The results indicate a consistent area of vergences being accepted as direct gaze, yielding first-time evidence for a third dimension-the depth dimension-of direct gaze.

Direct eye gaze enhances the ventriloquism effect.

The "ventriloquism effect" describes an illusory phenomenon where the perceived location of an auditory stimulus is pulled toward the location of a visual stimulus. Ventriloquists use this phenomenon to create an illusion where an inanimate puppet is perceived to speak. Ventriloquists use the expression and suppression of their own and the puppet's mouth movements as well the direction of their respective eye gaze to maximize the illusion. While the puppet's often exaggerated mouth movements have been demonstrated to enhance the ventriloquism effect, the contribution of direct eye gaze remains unknown. In Experiment 1, participants viewed an image of a person's face while hearing a temporally synchronous recording of a voice originating from different locations on the azimuthal plane. The eyes of the facial stimuli were either looking directly at participants or were closed. Participants were more likely to misperceive the location of a range of voice locations as coming from a central position when the eye gaze of the facial stimuli were directed toward them. Thus, direct gaze enhances the ventriloquist effect by attracting participants' perception of the voice locations toward the location of the face. In an exploratory analysis, we furthermore found no evidence for an other-race effect between White vs Asian listeners. In Experiment 2, we replicated the effect of direct eye gaze on the ventriloquism effect, also showing that faces per se attract perceived sound locations compared with audio-only sound localization. Showing a modulation of the ventriloquism effect by socially-salient eye gaze information thus adds to previous findings reporting top-down influences on this effect.

Pupil dilation predicts modulation of direct gaze on action value calculations.

Perceiving direct gaze facilitates social cognition and behaviour. We hypothesized that direct gaze modulates decision-making, particularly calculations of action values. To test our hypothesis, we used the reinforcement learning paradigm in situations with or without direct gaze. Forty adults were recruited and participated in pupil size measurements and a two-armed bandit task. The task was conducted with 70% and 30% reward probabilities for each option. During the task, a female showing the Direct Gaze (DG) or Closed Eyes (CE) condition was presented from the start of each trial. The results showed that behavioural bias to choices with 70% reward probability increased more in the DG condition than in the CE condition and the expected reward value. This bias to choices with 70% reward in the DG condition was predicted by pupil dilation to DG. These results suggest that participants over-evaluated the expected reward value in the DG condition, and this DG effect may be related to subjective expectations of rewarding events indexed by pupil dilations. It is considered that perceiving direct gaze is a driver of reward expectations that modulate action value calculations and then cognitive processing and behaviours are facilitated.

From eye to arrow: Attention capture by direct gaze requires more than just the eyes.

Human attention is strongly attracted by direct gaze and sudden onset motion. The sudden direct-gaze effect refers to the processing advantage for targets appearing on peripheral faces that suddenly establish eye contact. Here, we investigate the necessity of social information for attention capture by (sudden onset) ostensive cues. Six experiments involving 204 participants applied (1) naturalistic faces, (2) arrows, (3) schematic eyes, (4) naturalistic eyes, or schematic facial configurations (5) without or (6) with head turn to an attention-capture paradigm. Trials started with two stimuli oriented towards the observer and two stimuli pointing into the periphery. Simultaneous to target presentation, one direct stimulus changed to averted and one averted stimulus changed to direct, yielding a 2 × 2 factorial design with direction and motion cues being absent or present. We replicated the (sudden) direct-gaze effect for photographic faces, but found no corresponding effects in Experiments 2-6. Hence, a holistic and socially meaningful facial context seems vital for attention capture by direct gaze. STATEMENT OF SIGNIFICANCE: The present study highlights the significance of context information for social attention. Our findings demonstrate that the direct-gaze effect, that is, the prioritization of direct gaze over averted gaze, critically relies on the presentation of a meaningful holistic and naturalistic facial context. This pattern of results is evidence in favor of early effects of surrounding social information on attention capture by direct gaze.

Eccentric Gaze as a Possible Cause of "Zoom Fatigue".

BACKGROUND: The Covid-19 pandemic has led to a marked increase in the use of videoconferencing for social interaction. Many people report discomfort and disaffection with this modality, which has been labeled "Zoom Fatigue." Common videoconferencing hardware setups necessitate that if a user looks at the image of the person with whom they are in videoconference, they will not be looking directly at the camera and will appear to not be making direct eye contact. This study determined the minimum threshold of eccentric gaze in a videoconferencing setup above which subjects are perceived as not making direct eye contact by the majority of untrained observers. METHODS: Image captures were made of four subjects successively fixating at small increments eccentric to a video camera, both vertically and horizontally ranging from 0.9 degrees to 19 degrees of eccentricity. The images were embedded in separate Powerpoint files for each subject. Each file was assessed by seven graders who indicated whether or not they felt the subject was looking directly at them in each slide. RESULTS: The threshold for which 75% of the graders could detect that the subject was not looking at them ranged from only 2.7 degrees for horizontal eccentricity to 5.4 degrees for vertical eccentricity. CONCLUSION: The hardware setups commonly used for videoconferencing result in persistent eccentric gaze of the participating individuals if they look at the image of the other participants. In theory, this could be a contributing cause of Zoom Fatigue.

The Cone of Direct Gaze: A Stable Trait.

Direct eye gaze is a potent stimulus in social interactions and is often associated with interest and approach orientation. Yet, there is remarkable variability in the range of gaze lines that people accept as being direct. A measure that is frequently used to quantify the range of gaze angles within which an observer assumes mutual gaze is the cone of direct gaze (CoDG). While individual differences in CoDG have often been examined, studies that systematically investigate the stability of an observers' CoDG over time are scarce. In two experiments, we measured the CoDG using an established paradigm and repeated the measurement after 5 min and/or after 1 week. We found high inter-individual variation, but high agreement within participants (ICCs between 0.649 and 0.855). We conclude that the CoDG can be seen as a rather stable measure, much like a personality trait.

How ubiquitous is the direct-gaze advantage? Evidence for an averted-gaze advantage in a gaze-discrimination task.

Human eye gaze conveys an enormous amount of socially relevant information, and the rapid assessment of gaze direction is of particular relevance in order to adapt behavior accordingly. Specifically, previous research demonstrated evidence for an advantage of processing direct (vs. averted) gaze. The present study examined discrimination performance for gaze direction (direct vs. averted) under controlled presentation conditions: Using a backward-masking gaze-discrimination task, photographs of faces with direct and averted gaze were briefly presented, followed by a mask stimulus. Additionally, effects of facial context on gaze discrimination were assessed by either presenting gaze direction in isolation (i.e., by only showing the eye region) or in the context of an upright or inverted face. Across three experiments, we consistently observed a facial context effect with highest discrimination performance for faces presented in upright position, lower performance for inverted faces, and lowest performance for eyes presented in isolation. Additionally, averted gaze was generally responded to faster and with higher accuracy than direct gaze, indicating an averted-gaze advantage. Overall, the results suggest that direct gaze is not generally associated with processing advantages, thereby highlighting the important role of presentation conditions and task demands in gaze perception.

Attention neglects a stare-in-the-crowd: Unanticipated consequences of prediction-error coding.

Direct gaze - someone looking at you - is an important and subjectively-salient stimulus. Its processing is thought to be enhanced by the brain's internalised predictions - priors - that effectively specify it as the most likely gaze direction. Current consensus holds that, befitting its presumed importance, direct gaze attracts attention more powerfully than other gazes. Conversely, some Predictive Coding (PC) models, in which exogenous attention is drawn to stimuli that violate predictions, may be construed as making the opposite claim - i.e., exogenous attention should be biased away from direct gaze (which conforms to internal predictions), toward averted gaze (which does not). Here, searching displays with salient, 'odd-one-out' gazes, we observed attentional bias (in rapid, initial saccades) toward averted gaze, as would be expected by PC models. However, this pattern obtained only when conditions highlighted gaze-uniqueness. We speculate that, in our experiments, task requirements determined how prediction influenced perception.

Gazing Without Eyes: A "Stare-in-the-Crowd" Effect Induced by Simple Geometric Shapes.

Of the many effects that eye contact has, perhaps the most powerful is the stare-in-the-crowd effect, wherein faces are detected more readily when they look directly toward you. This is commonly attributed to others' eyes being especially salient visual stimuli, but here we ask whether stares-in-the-crowd might arise instead from a deeper property that the eyes (but not only the eyes) signify: the direction of others' attention and intentions. In fact, even simple geometric shapes can be seen as intentional, as when numerous randomly scattered cones are all consistently pointing at you. Accordingly, we show here that cones directed at the observer are detected faster (in fields of averted cones) than are cones averted away from the observer (in fields of directed cones). These results suggest that perceived intentionality itself captures attention-and that even in the absence of eyes, others' directed attention stands out in a crowd.

Psychophysiological responses to eye contact in a live interaction and in video call.

Another person's gaze directed to oneself elicits autonomic arousal and facial reactions indicating positive affect in its observer. These effects have only been found to occur with mutual, live eye contact and not in response to direct gaze pictures or when the observer believes that the live person cannot see them. The question remains whether the physical presence of the other person is necessary for these effects. We measured psychophysiological responses to another person's direct versus averted gaze in three conditions: live interaction, bidirectional video call, and watching a mere video. Autonomic arousal was measured with skin conductance responses and facial reactions with facial electromyography. In the live and video call conditions, but not in the mere video condition, direct gaze increased autonomic arousal in comparison to averted gaze. In all three conditions, however, direct gaze elicited positive affective facial reactions. Therefore, an experience of being seen is essential for the autonomic reactions but not for the facial responses that are elicited by another person's direct gaze. Most importantly, the results suggest that the physical presence or proximity of the other person is not necessary for these psychophysiological responses to eye contact.