The role of visual and auditory information in social event segmentation.

Humans organise their social worlds into social and nonsocial events. Social event segmentation refers to the ability to parse the environmental content into social and nonsocial events or units. Here, we investigated the role that perceptual information from visual and auditory modalities, in isolation and in conjunction, played in social event segmentation. Participants viewed a video clip depicting an interaction between two actors and marked the boundaries of social and nonsocial events. Depending on the condition, the clip at first contained only auditory or only visual information. Then, the clip was shown containing both auditory and visual information. Higher overall group consensus and response consistency in parsing the clip was found for social segmentation and when both auditory and visual information was available. Presenting the clip in the visual domain only benefitted group agreement in social segmentation while the inclusion of auditory information (under the audiovisual condition) also improved response consistency in nonsocial segmentation. Thus, social segmentation utilises information from the visual modality, with the auditory cues contributing under ambiguous or uncertain conditions and during segmentation of nonsocial content.

A dual mobile eye tracking study on natural eye contact during live interactions.

Human eyes convey a wealth of social information, with mutual looks representing one of the hallmark gaze communication behaviors. However, it remains relatively unknown if such reciprocal communication requires eye-to-eye contact or if general face-to-face looking is sufficient. To address this question, while recording looking behavior in live interacting dyads using dual mobile eye trackers, we analyzed how often participants engaged in mutual looks as a function of looking towards the top (i.e., the Eye region) and bottom half of the face (i.e., the Mouth region). We further examined how these different types of mutual looks during an interaction connected with later gaze-following behavior elicited in an individual experimental task. The results indicated that dyads engaged in mutual looks in various looking combinations (Eye-to-eye, Eye-to-mouth, and Mouth-to-Mouth) but proportionately spent little time in direct eye-to-eye gaze contact. However, the time spent in eye-to-eye contact significantly predicted the magnitude of later gaze following response elicited by the partner's gaze direction. Thus, humans engage in looking patterns toward different face parts during interactions, with direct eye-to-eye looks occurring relatively infrequently; however, social messages relayed during eye-to-eye contact appear to carry key information that propagates to affect subsequent individual social behavior.

Intrapersonal Behavioral Coordination and Expressive Accuracy During First Impressions.

What factors influence how accurately we express our personalities? Here, we investigated the role of targets' nonverbal expressivity or the intrapersonal coordination between head and body movements. To do so, using a novel movement quantification method, we examined whether variability in a person's behavioral coordination was related to how accurately their personality was perceived by naive observers. Targets who exhibited greater variability in intrapersonal behavior coordination, indicating more expressive behavior, were perceived more accurately on high observability personality items, such as how energetic and helpful they are. Moreover, these associations held controlling for other indicators of overall movement, self- and perceiver-rated extroversion, as well as how engaging and likable targets were perceived to be. This provides preliminary evidence that variability in intrapersonal behavioral coordination may be a unique behavioral indicator of expressive accuracy, although further research that replicates these findings and examines the causal associations is needed.

Physical Disability Affects Women's but Not Men's Perception of Opposite-Sex Attractiveness.

Physical appearance influences our perceptions, judgments, and decision making about others. While the current literature with regard to the perceptions and judgments of nondisabled people's attractiveness is robust, the research investigating the perceived physical attractiveness and judgments of physically disabled individuals is scarce. Therefore, in the current study, we investigated whether people with physical disabilities are perceived by the opposite sex as more or less attractive relative to nondisabled individuals. Our results, based on over 675 participants, showed a positive effect for women's attractiveness ratings of men with physical disabilities, but not men's attractiveness ratings of physically disabled women. Moreover, social desirability bias was positively associated with attractiveness ratings of physically disabled individuals, meaning those with higher tendency to be viewed favorably by others rated physically disabled individuals more attractive. Finally, our results revealed that attractiveness ratings of individuals with physical disabilities are positively associated with extroversion and empathy in both men and women, and positively with agreeableness and negatively with neuroticism in women. In conclusion, our study showed women rate men with physical disabilities as higher on attractiveness than nondisabled men, which is also influenced by their social desirability bias.

Higher levels of IgA and IgG at sepsis onset are associated with higher mortality: results from the Albumin Italian Outcome Sepsis (ALBIOS) trial.

BACKGROUND: The role of intravenous immunoglobulins (IVIG) during sepsis is controversial, as different trials on IVIG have observed inconsistent survival benefits. We aimed to elucidate the possible association and clinical significance between circulating levels of immunoglobulins. METHODS: In a subset of 956 patients with severe sepsis and septic shock of the multicentre, open-label RCT ALBIOS, venous blood samples were serially collected 1, 2, and 7 days after enrolment (or at ICU discharge, whichever came first). IgA, IgG and IgM concentrations were assayed in all patients on day 1 and in a subgroup of 150 patients on days 2 and 7. Ig concentrations were measured employing a turbidimetric assay, OSR61171 system. RESULTS: IgA on day 1 had a significant predictive value for both 28-day and 90-day mortality (28-day mortality, HR: 1.50 (95% CI 1.18-1.92); 90-day mortality, HR: 1.54 (95% CI 1.25-1.91)). IgG, but not IgM, on day 1 showed similar results for 28-day (HR 1.83 (95% CI 1.33-2.51) and 90-day mortality HR: 1.66 (95% CI 1.23-2.25)). In addition, lower levels of IgG but not of IgA and IgM, at day 1 were associated with significantly higher risk of secondary infections (533 [406-772] vs 600 [452-842] mg/dL, median [Q1-Q3], p = 0.007). CONCLUSIONS: In the largest cohort study of patients with severe sepsis or septic shock, we found that high levels of IgA and IgG on the first day of diagnosis were associated with a decreased 90-day survival. No association was found between IgM levels and survival. As such, the assessment of endogenous immunoglobulins could be a useful tool to identify septic patients at high risk of mortality. Trial registration #NCT00707122, Clinicaltrial.gov, registered 30 June 2008.

Standing out from the crowd: Both cue numerosity and social information affect attention in multi-agent contexts.

Groups of people offer abundant opportunities for social interactions. We used a two-phase task to investigate how social cue numerosity and social information about an individual affected attentional allocation in such multi-agent settings. The learning phase was a standard gaze-cuing procedure in which a stimulus face could be either uninformative or informative about the upcoming target. The test phase was a group-cuing procedure in which the stimulus faces from the learning phase were presented in groups of three. The target could either be cued by the group minority (i.e., one face) or majority (i.e., two faces) or by uninformative or informative stimulus faces. Results showed an effect of cue numerosity, whereby responses were faster to targets cued by the group majority than the group minority. However, responses to targets cued by informative identities included in the group minority were as fast as responses to targets cued by the group majority. Thus, previously learned social information about an individual was able to offset the general enhancement of cue numerosity, revealing a complex interplay between cue numerosity and social information in guiding attention in multi-agent settings.

Prior attentional bias is modulated by social gaze.

Focusing attention is a key cognitive skill, but how the gaze of others affects engaged attention remains relatively unknown. We investigated if participants' attentional bias toward a location is modulated by the number of people gazing toward or away from it. We presented participants with a nonpredictive directional cue that biased attention towards a specific location. Then, any number of four stimulus faces turned their gaze toward or away from the attended location. When all the faces looked at the attended location participants increased their commitment to it, and response time to targets at that location were speeded. When most or all of the faces looked away from the attended location, attention was withdrawn, and response times were slowed. This study reveals that the gaze of others can penetrate one's ability to focus attention, which in turn can be both beneficial and costly to one's responses to events in the environment.

Attention promotes accurate impression formation.

OBJECTIVE: An ability to form accurate impressions of others is vital for adaptive social behavior in humans. Here, we examined if attending to persons more is associated with greater accuracy in personality impressions. METHOD: We asked 42 observers (36 females; mean age = 21 years, age range = 18-28; expected power = 0.96) to form personality impressions of unacquainted individuals (i.e., targets) from video interviews while their attentional behavior was assessed using eye tracking. We examined whether (a) attending more to targets benefited accuracy, (b) attending to specific body parts (e.g., face vs. body) drove this association, and (c) targets' ease of personality readability modulated these effects. RESULTS: Paying more attention to a target was associated with forming more accurate personality impressions. Attention to the whole person contributed to this effect, with this association occurring independently of targets' ease of readability. CONCLUSIONS: These findings show that attending more to a person is associated with increased accuracy and thus suggest that attention promotes social adaption by supporting accurate social perception.

Tracking the Leader: Gaze Behavior in Group Interactions.

Can social gaze behavior reveal the leader during real-world group interactions? To answer this question, we developed a novel tripartite approach combining (1) computer vision methods for remote gaze estimation, (2) a detailed taxonomy to encode the implicit semantics of multi-party gaze features, and (3) machine learning methods to establish dependencies between leadership and visual behaviors. We found that social gaze behavior distinctively identified group leaders. Crucially, the relationship between leadership and gaze behavior generalized across democratic and autocratic leadership styles under conditions of low and high time-pressure, suggesting that gaze can serve as a general marker of leadership. These findings provide the first direct evidence that group visual patterns can reveal leadership across different social behaviors and validate a new promising method for monitoring natural group interactions.

Taking it out of context: The role of contextual coherence during social event segmentation.

Social event segmentation, or parsing of the ongoing dynamic content into discrete social events, is thought to represent a mechanism that supports the expert human ability to navigate complex social environments. Here, we examined whether this ability is influenced by the temporal coherence of the context and by different sources of perceptual information. To do so, we created two video clips, one in which several situations unfolded in a contextually consistent manner, and the other in which the order of these situations was scrambled using a random sequence. Participants viewed each clip and were asked to mark social and nonsocial events in counterbalanced blocks of trials. We analyzed key-press behaviour as well as visual and auditory signals within the clips. Results showed that participants agreed on similar social and nonsocial events regardless of context availability, with greater agreement for social relative to nonsocial events. Context, however, modulated the reliance on sources of perceptual information, such that visual and auditory information was used differently when context was unavailable. Together, these data show that contextual coherence does not determine social event segmentation but serves a modulatory role in perceivers' reliance on perceptual sources of information when identifying events in complex social environments.

Suppressing movements with phantom limbs and existing limbs evokes comparable electrophysiological inhibitory responses.

Phantom limb is a common sensation in amputees, who often report vivid experiences of voluntarily moving their phantom. Previous studies showed that phantom movement can be functionally disentangled from imagined movement comparable to the actual movement of an intact limb. How and to what extent phantom movement and real movement share similar physiological mechanisms? Here, we focused on a specific aspect of motor control, the motor inhibition, and we asked whether inhibitory physiological responses are implemented when a phantom movement has to be suppressed. Sixteen two-handed controls and two left upper-limb amputees (with and without phantom movement) underwent a Go/Nogo paradigm, while event-related potentials (ERPs) were recorded. The task was performed with both the right (intact) and the left (phantom) hand, either in real or imagery conditions. Opposite results between the moving-phantom case and the static-phantom case were found. In the real condition, moving-phantom case showed the classical motor-inhibition related ERP pattern, with large P300 inhibitory wave when the movements of both (right) intact and (left) phantom limbs have to be suppressed. This inhibitory response was not different from that found in controls (who performed the task with an existing hand; real condition), but, crucially, it was significantly different from the imagery condition of controls. Contrariwise, in the static-phantom case, the ERP responses to Nogo trials during the real condition were different from the real condition in controls, but were not different from their imagery condition. Importantly, in the real condition, Nogo-ERP responses were significantly different between the two phantom cases. Taken together, these findings provide compelling evidence that phantom movements share the same neurophysiological correlates of real movements, not only when an action has to be executed, but also when it should be inhibited.

Gaze following in multiagent contexts: Evidence for a quorum-like principle.

Research shows that humans spontaneously follow another individual's gaze. However, little remains known on how they respond when multiple gaze cues diverge across members of a social group. To address this question, we presented participants with displays depicting three (Experiment 1) or five (Experiment 2) agents showing diverging social cues. In a three-person group, one individual looking at the target (33% of the group) was sufficient to elicit gaze-facilitated target responses. With a five-person group, however, three individuals looking at the target (60% of the group) were necessary to produce the same effect. Gaze following in small groups therefore appears to be based on a quorum-like principle, whereby the critical level of social information needed for gaze following is determined by a proportion of consistent social cues scaled as a function of group size. As group size grows, greater agreement is needed to evoke joint attention.

How attention gates social interactions.

Social interactions are at the core of social life. However, humans selectively choose their exchange partners and do not engage in all available opportunities for social encounters. In this review, we argue that attentional systems play an important role in guiding the selection of social interactions. Supported by both classic and emerging literature, we identify and characterize the three core processes-perception, interpretation, and evaluation-that interact with attentional systems to modulate selective responses to social environments. Perceptual processes facilitate attentional prioritization of social cues. Interpretative processes link attention with understanding of cues' social meanings and agents' mental states. Evaluative processes determine the perceived value of the source of social information. The interplay between attention and these three routes of processing places attention in a powerful role to manage the selection of the vast amount of social information that individuals encounter on a daily basis and, in turn, gate the selection of social interactions.

Staring reality in the face: A comparison of social attention across laboratory and real world measures suggests little common ground.

The ability to attend to someone else's gaze is thought to represent one of the essential building blocks of the human sociocognitive system. This behavior, termed social attention, has traditionally been assessed using laboratory procedures in which participants' response time and/or accuracy performance indexes attentional function. Recently, a parallel body of emerging research has started to examine social attention during real life social interactions using naturalistic and observational methodologies. The main goal of the present work was to begin connecting these two lines of inquiry. To do so, here we operationalized, indexed, and measured the engagement and shifting components of social attention using covert and overt measures. These measures were obtained during an unconstrained real-world social interaction and during a typical laboratory social cuing task. Our results indicated reliable and overall similar indices of social attention engagement and shifting within each task. However, these measures did not relate across the two tasks. We discuss these results as potentially reflecting the differences in social attention mechanisms, the specificity of the cuing task's measurement, as well as possible general dissimilarities with respect to context, task goals, and/or social presence. (PsycINFO Database Record

Where Is Your Attention? Assessing Individual Instances of Covert Attentional Orienting in Response to Gaze and Arrow Cues.

Humans spontaneously follow where others are looking. However, recent investigations suggest such gaze-following behavior during natural interactions occurs relatively infrequently, only in about a third of available instances. Here we investigated if a similar frequency of orienting is also found in laboratory tasks that measure covert attentional orienting using manual responses. To do so, in two experiments, we analyzed responses from a classic gaze cuing task, with arrow cues serving as control stimuli. We reasoned that the proportions of attentional benefits and costs, defined as responses falling outside of 1 standard deviation of the average performance for the neutral condition, would provide a good approximation of individual instances of attentional shifts. We found that although benefits and costs occurred in less than half of trials, benefits emerged on a greater proportion of validly cued relative to invalidly cued trials. This pattern of data held across two different measures of neutral performance, as assessed by Experiments 1 and 2, as well as across the two cue types. These results suggest that similarly to gaze-following in naturalistic settings, covert orienting within the cuing task also appears to occur relatively infrequently.

When Far Becomes Near.

On many occasions, people spontaneously or deliberately take the perspective of a person facing them rather than their own perspective. How is this done? Using a spatial perspective task in which participants were asked to identify objects at specific locations, we found that self-perspective judgments were faster for objects presented to the right, rather than the left, and for objects presented closer to the participants' own bodies. Strikingly, taking the opposing perspective of another person led to a reversal (i.e., remapping) of these effects, with reference to the other person's position (Experiment 1). A remapping of spatial relations was also observed when an empty chair replaced the other person (Experiment 2), but not when access to the other viewpoint was blocked (Experiment 3). Thus, when the spatial scene allows a physically feasible but opposing point of view, people respond as if their own bodies were in that place. Imagination can thus overcome perception.

Decoding intentions from movement kinematics.

How do we understand the intentions of other people? There has been a longstanding controversy over whether it is possible to understand others' intentions by simply observing their movements. Here, we show that indeed movement kinematics can form the basis for intention detection. By combining kinematics and psychophysical methods with classification and regression tree (CART) modeling, we found that observers utilized a subset of discriminant kinematic features over the total kinematic pattern in order to detect intention from observation of simple motor acts. Intention discriminability covaried with movement kinematics on a trial-by-trial basis, and was directly related to the expression of discriminative features in the observed movements. These findings demonstrate a definable and measurable relationship between the specific features of observed movements and the ability to discriminate intention, providing quantitative evidence of the significance of movement kinematics for anticipating others' intentional actions.

Followers are not followed: Observed group interactions modulate subsequent social attention.

We asked whether previous observations of group interactions modulate subsequent social attention episodes. Participants first completed a learning phase with 2 conditions. In the "leader" condition 1 of 3 identities turned her gaze first, followed by the 2 other faces. In the "follower" condition, 1 of the identities turned her gaze after the 2 other faces had first shifted their gaze. Thus, participants observed that some individuals were consistently leaders and others followers of others' attention. In the test phase, the faces of leaders and followers were presented in a gaze cueing paradigm. Remarkably, the followers did not elicit gaze cueing. Our data demonstrate that individuals who do not guide group attention in exploring the environment are ineffective social attention directors in later encounters. Thus, the role played in previous group social attention interactions modulates the relative weight assigned to others' gaze: we ignore the gaze of group followers.

Temporal perception in joint action: This is MY action.

Here we investigated the temporal perception of self- and other-generated actions during sequential joint actions. Participants judged the perceived time of two events, the first triggered by the participant and the second by another agent, during a cooperative or competitive interaction, or by an unspecified mechanical cause. Results showed that participants perceived self-generated events as shifted earlier in time (anticipation temporal judgment bias) and non-self-generated events as shifted later in time (repulsion temporal judgment bias). This latter effect was observed independently from the kind of cause (i.e., agentive or mechanical) or interaction (i.e., cooperative or competitive). We suggest that this might represent a mental process which allows discriminating events that cannot plausibly be linked to one's own action. When an event immediately follows a self-generated one, temporal judgment biases operate as self-serving biases in order to separate self-generated events from events of another physical causality.