Autistic young people adaptively use gaze to facilitate joint attention during multi-gestural dyadic interactions.

LAY ABSTRACT: Autistic people have been said to have 'problems' with joint attention, that is, looking where someone else is looking. Past studies of joint attention have used tasks that require autistic people to continuously look at and respond to eye-gaze cues. But joint attention can also be done using other social cues, like pointing. This study looked at whether autistic and non-autistic young people use another person's eye gaze during joint attention in a task that did not require them to look at their partner's face. In the task, each participant worked together with their partner to find a computer-generated object in virtual reality. Sometimes the participant had to help guide their partner to the object, and other times, they followed their partner's lead. Participants were told to point to guide one another but were not told to use eye gaze. Both autistic and non-autistic participants often looked at their partner's face during joint attention interactions and were faster to respond to their partner's hand-pointing when the partner also looked at the object before pointing. This shows that autistic people can and do use information from another person's eyes, even when they don't have to. It is possible that, by not forcing autistic young people to look at their partner's face and eyes, they were better able to gather information from their partner's face when needed, without being overwhelmed. This shows how important it is to design tasks that provide autistic people with opportunities to show what they can do.

Dynamical biomarkers in teams and other multiagent systems.

Effective team behavior in high-performance environments such as in sport and the military requires individual team members to efficiently perceive the unfolding task events, predict the actions and action intents of the other team members, and plan and execute their own actions to simultaneously accomplish individual and collective goals. To enhance team performance through effective cooperation, it is crucial to measure the situation awareness and dynamics of each team member and how they collectively impact the team's functioning. Further, to be practically useful for real-life settings, such measures must be easily obtainable from existing sensors. This paper presents several methodologies that can be used on positional and movement acceleration data of team members to quantify and/or predict team performance, assess situation awareness, and to help identify task-relevant information to support individual decision-making. Given the limited reporting of these methods within military cohorts, these methodologies are described using examples from team sports and teams training in virtual environments, with discussion as to how they can be applied to real-world military teams.

Conversation dynamics in a multiplayer video game with knowledge asymmetry.

Despite the challenges associated with virtually mediated communication, remote collaboration is a defining characteristic of online multiplayer gaming communities. Inspired by the teamwork exhibited by players in first-person shooter games, this study investigated the verbal and behavioral coordination of four-player teams playing a cooperative online video game. The game, Desert Herding, involved teams consisting of three ground players and one drone operator tasked to locate, corral, and contain evasive robot agents scattered across a large desert environment. Ground players could move throughout the environment, while the drone operator's role was akin to that of a "spectator" with a bird's-eye view, with access to veridical information of the locations of teammates and the to-be-corralled agents. Categorical recurrence quantification analysis (catRQA) was used to measure the communication dynamics of teams as they completed the task. Demands on coordination were manipulated by varying the ground players' ability to observe the environment with the use of game "fog." Results show that catRQA was sensitive to changes to task visibility, with reductions in task visibility reorganizing how participants conversed during the game to maintain team situation awareness. The results are discussed in the context of future work that can address how team coordination can be augmented with the inclusion of artificial agents, as synthetic teammates.

Assessing Team Effectiveness by How Players Structure Their Search in a First-Person Multiplayer Video Game.

People working as a team can achieve more than when working alone due to a team's ability to parallelize the completion of tasks. In collaborative search tasks, this necessitates the formation of effective division of labor strategies to minimize redundancies in search. For such strategies to be developed, team members need to perceive the task's relevant components and how they evolve over time, as well as an understanding of what others will do so that they can structure their own behavior to contribute to the team's goal. This study explored whether the capacity for team members to coordinate effectively can be related to how participants structure their search behaviors in an online multiplayer collaborative search task. Our results demonstrated that the structure of search behavior, quantified using detrended fluctuation analysis, was sensitive to contextual factors that limit a participant's ability to gather information. Further, increases in the persistence of movement fluctuations during search behavior were found as teams developed more effective coordinative strategies and were associated with better task performance.

Spatial and time domain analysis of eye-tracking data during screening of brain magnetic resonance images.

INTRODUCTION: Eye-tracking research has been widely used in radiology applications. Prior studies exclusively analysed either temporal or spatial eye-tracking features, both of which alone do not completely characterise the spatiotemporal dynamics of radiologists' gaze features. PURPOSE: Our research aims to quantify human visual search dynamics in both domains during brain stimuli screening to explore the relationship between reader characteristics and stimuli complexity. The methodology can be used to discover strategies to aid trainee radiologists in identifying pathology, and to select regions of interest for machine vision applications. METHOD: The study was performed using eye-tracking data 5 seconds in duration from 57 readers (15 Brain-experts, 11 Other-experts, 5 Registrars and 26 Naïves) for 40 neuroradiological images as stimuli (i.e., 20 normal and 20 pathological brain MRIs). The visual scanning patterns were analysed by calculating the fractal dimension (FD) and Hurst exponent (HE) using re-scaled range (R/S) and detrended fluctuation analysis (DFA) methods. The FD was used to measure the spatial geometrical complexity of the gaze patterns, and the HE analysis was used to measure participants' focusing skill. The focusing skill is referred to persistence/anti-persistence of the participants' gaze on the stimulus over time. Pathological and normal stimuli were analysed separately both at the "First Second" and full "Five Seconds" viewing duration. RESULTS: All experts were more focused and a had higher visual search complexity compared to Registrars and Naïves. This was seen in both the pathological and normal stimuli in the first and five second analyses. The Brain-experts subgroup was shown to achieve better focusing skill than Other-experts due to their domain specific expertise. Indeed, the FDs found when viewing pathological stimuli were higher than those in normal ones. Viewing normal stimuli resulted in an increase of FD found in five second data, unlike pathological stimuli, which did not change. In contrast to the FDs, the scanpath HEs of pathological and normal stimuli were similar. However, participants' gaze was more focused for "Five Seconds" than "First Second" data. CONCLUSIONS: The HE analysis of the scanpaths belonging to all experts showed that they have greater focus than Registrars and Naïves. This may be related to their higher visual search complexity than non-experts due to their training and expertise.

Task dynamics define the contextual emergence of human corralling behaviors.

Social animals have the remarkable ability to organize into collectives to achieve goals unobtainable to individual members. Equally striking is the observation that despite differences in perceptual-motor capabilities, different animals often exhibit qualitatively similar collective states of organization and coordination. Such qualitative similarities can be seen in corralling behaviors involving the encirclement of prey that are observed, for example, during collaborative hunting amongst several apex predator species living in disparate environments. Similar encirclement behaviors are also displayed by human participants in a collaborative problem-solving task involving the herding and containment of evasive artificial agents. Inspired by the functional similarities in this behavior across humans and non-human systems, this paper investigated whether the containment strategies displayed by humans emerge as a function of the task's underlying dynamics, which shape patterns of goal-directed corralling more generally. This hypothesis was tested by comparing the strategies naïve human dyads adopt during the containment of a set of evasive artificial agents across two disparate task contexts. Despite the different movement types (manual manipulation or locomotion) required in the different task contexts, the behaviors that humans display can be predicted as emergent properties of the same underlying task-dynamic model.

Gaze facilitates responsivity during hand coordinated joint attention.

The coordination of attention between individuals is a fundamental part of everyday human social interaction. Previous work has focused on the role of gaze information for guiding responses during joint attention episodes. However, in many contexts, hand gestures such as pointing provide another valuable source of information about the locus of attention. The current study developed a novel virtual reality paradigm to investigate the extent to which initiator gaze information is used by responders to guide joint attention responses in the presence of more visually salient and spatially precise pointing gestures. Dyads were instructed to use pointing gestures to complete a cooperative joint attention task in a virtual environment. Eye and hand tracking enabled real-time interaction and provided objective measures of gaze and pointing behaviours. Initiators displayed gaze behaviours that were spatially congruent with the subsequent pointing gestures. Responders overtly attended to the initiator's gaze during the joint attention episode. However, both these initiator and responder behaviours were highly variable across individuals. Critically, when responders did overtly attend to their partner's face, their saccadic reaction times were faster when the initiator's gaze was also congruent with the pointing gesture, and thus predictive of the joint attention location. These results indicate that humans attend to and process gaze information to facilitate joint attention responsivity, even in contexts where gaze information is implicit to the task and joint attention is explicitly cued by more spatially precise and visually salient pointing gestures.

Hopf Bifurcations in Complex Multiagent Activity: The Signature of Discrete to Rhythmic Behavioral Transitions.

Most human actions are composed of two fundamental movement types, discrete and rhythmic movements. These movement types, or primitives, are analogous to the two elemental behaviors of nonlinear dynamical systems, namely, fixed-point and limit cycle behavior, respectively. Furthermore, there is now a growing body of research demonstrating how various human actions and behaviors can be effectively modeled and understood using a small set of low-dimensional, fixed-point and limit cycle dynamical systems (differential equations). Here, we provide an overview of these dynamical motorprimitives and detail recent research demonstrating how these dynamical primitives can be used to model the task dynamics of complex multiagent behavior. More specifically, we review how a task-dynamic model of multiagent shepherding behavior, composed of rudimentary fixed-point and limit cycle dynamical primitives, can not only effectively model the behavior of cooperating human co-actors, but also reveals how the discovery and intentional use of optimal behavioral coordination during task learning is marked by a spontaneous, self-organized transition between fixed-point and limit cycle dynamics (i.e., via a Hopf bifurcation).

Driving after pediatric traumatic brain injury: Impact of distraction and executive functioning.

OBJECTIVE: The objective of the current study was to examine the driving performance of young drivers with a history of moderate to severe traumatic brain injury (TBI) compared with an uninjured control group. The impact of cell phone related distraction (conversation and texting) and executive functioning (EF) were also explored. METHOD: Individuals aged 16-25 years with (n = 19) and without (n = 19) a history of TBI engaged in a simulated drive under 3 distraction conditions (no distraction, cell phone conversation, and texting). Mean speed, maximum speed, standard deviation of speed, standard deviation of lane position, and crash rates were used as outcomes. The Global Executive Composite (GEC) from the Behavior Rating Inventory of Executive Functioning (BRIEF) was used to measure EF. RESULTS: Significant Injury × Distraction × GEC interaction effects were noted on max speed and speed variability, with a trending Distraction × GEC interaction noted for lane position variability. The effect of distraction was most notable among individuals with greater GEC scores, across both injury groups. CONCLUSIONS: A history of pediatric TBI did not specifically impact driving performance independent of EF, with EF playing a central role in functioning across domains of driving performance. Consistent effect of EF suggests that deficits in driving performance may be associated with EF specifically, with individuals with EF difficulties following TBI at greater risk for poor driving performance. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Human social motor solutions for human-machine interaction in dynamical task contexts.

Multiagent activity is commonplace in everyday life and can improve the behavioral efficiency of task performance and learning. Thus, augmenting social contexts with the use of interactive virtual and robotic agents is of great interest across health, sport, and industry domains. However, the effectiveness of human-machine interaction (HMI) to effectively train humans for future social encounters depends on the ability of artificial agents to respond to human coactors in a natural, human-like manner. One way to achieve effective HMI is by developing dynamical models utilizing dynamical motor primitives (DMPs) of human multiagent coordination that not only capture the behavioral dynamics of successful human performance but also, provide a tractable control architecture for computerized agents. Previous research has demonstrated how DMPs can successfully capture human-like dynamics of simple nonsocial, single-actor movements. However, it is unclear whether DMPs can be used to model more complex multiagent task scenarios. This study tested this human-centered approach to HMI using a complex dyadic shepherding task, in which pairs of coacting agents had to work together to corral and contain small herds of virtual sheep. Human-human and human-artificial agent dyads were tested across two different task contexts. The results revealed (i) that the performance of human-human dyads was equivalent to those composed of a human and the artificial agent and (ii) that, using a "Turing-like" methodology, most participants in the HMI condition were unaware that they were working alongside an artificial agent, further validating the isomorphism of human and artificial agent behavior.

Variable and intermittent grip force control in response to differing load force dynamics.

A recent study (Grover et al. Exp Brain Res 236(10):2531-2544, 2018) found that the grip force applied to maintain grasp of a hand-held object exhibited intermittent coupling to the changing load forces exerted by the object as it was oscillated. In particular, the strength and consistency of grip force response to load force oscillations was tied to overall load force levels and the prominence of load force oscillations. This contrasts with previous reports of grip force-load force coupling as generally continuous and stable and, therefore, has implications for theoretical accounts of grip force control that are predicated on these prior understandings of the coupling. The finding of intermittency additionally raises questions about the consistency of the temporal relation (i.e., lead/lag) between grip force and load force over time. The objective of the current study was, therefore, to investigate how the time-varying pattern (i.e., the regularity vs. complexity) of load force variations contribute to shifts between more intermittent and more continuous grip force control, and to determine the temporal consistency of the coupling. It was found that grip force became more tightly and continuously responsive to load force as load force changes became less predictable. Additionally, we report strong evidence that the temporal (i.e., lead/lag) relation between grip force and load force and the strength of their coupling vary substantially over time.

Perceiver as polar planimeter: Direct perception of jumping, reaching, and jump-reaching affordances for the self and others.

Runeson (Scandanavian Journal of Psychology 18:172-179, 1977) suggested that the polar planimeter might serve as an informative model system of perceptual mechanism. The key aspect of the polar planimeter is that it registers a higher order property of the environment without computational mediation on the basis of lower order properties, detecting task-specific information only. This aspect was posited as a hypothesis for the perception of jumping and reaching affordances for the self and another person. The findings supported this hypothesis. The perception of reaching while jumping significantly differed from an additive combination of jump-without-reaching and reach-without-jumping perception. The results are consistent with Gibson's (The senses considered as perceptual systems, Houghton Mifflin, Boston, MA; Gibson, The senses considered as perceptual systems, Houghton Mifflin, Boston, MA, 1966; The ecological approach to visual perception, Houghton Mifflin, Boston, MA; Gibson, The ecological approach to visual perception, Houghton Mifflin, Boston, MA, 1979) theory of information-that aspects of the environment are specified by patterns in energetic media.

Less efficient oculomotor performance is associated with increased incidence of head impacts in high school ice hockey.

OBJECTIVES: To evaluate associations between pre-season oculomotor performance on visual tracking tasks and in-season head impact incidence during high school boys ice hockey. DESIGN: Prospective observational study design. METHODS: Fifteen healthy high school aged male hockey athletes (M=16.50±1.17years) performed two 30s blocks each of a prosaccade and self-paced saccade task, and two trials each of a slow, medium, and fast smooth pursuit task (90°s-1; 180°s-1; 360°s-1) during the pre-season. Regular season in-game collision data were collected via helmet-mounted accelerometers. Simple linear regressions were used to examine relations between oculomotor performance measures and collision incidence at various impact thresholds. RESULTS: The variability of prosaccade latency was positively related to total collisions for the 20g force cutoff (p=0.046, adjusted R2=0.28). The average self-paced saccade velocity (p=0.020, adjusted R2=0.37) and variability of smooth pursuit gaze velocity (p=0.012, adjusted R2=0.47) were also positively associated with total collisions for the 50g force cutoff. CONCLUSIONS: These results provide preliminary evidence that less efficient oculomotor performance on three different oculomotor tasks is associated with increased incidence of head impacts during a competitive ice hockey season. The variability of prosaccade latency, the average self-paced saccade velocity and the variability of gaze velocity during predictable smooth pursuit all related to increased head impacts. Future work is needed to further understand player initiated collisions, but this is an important first step toward understanding strategies to reduce incidence of injury risk in ice hockey, and potentially contact sports more generally.

Herd Those Sheep: Emergent Multiagent Coordination and Behavioral-Mode Switching.

Effectively coordinating one's behaviors with those of others is essential for successful multiagent activity. In recent years, increased attention has been given to understanding the dynamical principles that underlie such coordination because of a growing interest in behavioral synchrony and complex-systems phenomena. Here, we examined the behavioral dynamics of a novel, multiagent shepherding task, in which pairs of individuals had to corral small herds of virtual sheep in the center of a virtual game field. Initially, all pairs adopted a complementary, search-and-recover mode of behavioral coordination, in which both members corralled sheep predominantly on their own sides of the field. Over the course of game play, however, a significant number of pairs spontaneously discovered a more effective mode of behavior: coupled oscillatory containment, in which both members synchronously oscillated around the sheep. Analysis and modeling revealed that both modes were defined by the task's underlying dynamics and, moreover, reflected context-specific realizations of the lawful dynamics that define functional shepherding behavior more generally.

Quantification and analysis of saccadic and smooth pursuit eye movements and fixations to detect oculomotor deficits.

Assessment of deficits in oculomotor function may be useful to detect visuomotor impairments due to a closed head injury. Systematic analysis schemes are needed to reliably quantify oculomotor deficits associated with oculomotor impairment via brain trauma. We propose a systematic, automated analysis scheme using various eye-tracking tasks to assess oculomotor function in a cohort of adolescents with acute concussion symptoms and aged-matched healthy controls. From these data we have evidence that these methods reliably detect oculomotor deficits in the concussed group, including reduced spatial accuracy and diminished tracking performance during visually guided prosaccade and self-paced saccade tasks. The accuracy and tracking deficits are consistent with prior studies on oculomotor function, while introducing novel discriminatory measures relative to fixation assessments - methodologically, a less complicated measure of performance - and thus represent a reliable and simple scheme of detection and analysis of oculomotor deficits associated with brain injury.