Intersecting kinematic encoding and readout of intention in autism.

Observers with autism spectrum disorders (ASDs) find it difficult to read intentions from movements. However, the computational bases of these difficulties are unknown. Do these difficulties reflect an intention readout deficit, or are they more likely rooted in kinematic (dis-)similarities between typical and ASD kinematics? We combined motion tracking, psychophysics, and computational analyses to uncover single-trial intention readout computations in typically developing (TD) children (n = 35) and children with ASD (n = 35) who observed actions performed by TD children and children with ASD. Average intention discrimination performance was above chance for TD observers but not for ASD observers. However, single-trial analysis showed that both TD and ASD observers read single-trial variations in movement kinematics. TD readers were better able to identify intention-informative kinematic features during observation of TD actions; conversely, ASD readers were better able to identify intention-informative features during observation of ASD actions. Crucially, while TD observers were generally able to extract the intention information encoded in movement kinematics, those with autism were unable to do so. These results extend existing conceptions of mind reading in ASD by suggesting that intention reading difficulties reflect both an interaction failure, rooted in kinematic dissimilarity between TD and ASD kinematics (at the level of feature identification), and an individual readout deficit (at the level of information extraction), accompanied by an overall reduced sensitivity of intention readout to single-trial variations in movement kinematics.

Identifying the signature of prospective motor control in children with autism.

Failure to develop prospective motor control has been proposed to be a core phenotypic marker of autism spectrum disorders (ASD). However, whether genuine differences in prospective motor control permit discriminating between ASD and non-ASD profiles over and above individual differences in motor output remains unclear. Here, we combined high precision measures of hand movement kinematics and rigorous machine learning analyses to determine the true power of prospective movement data to differentiate children with autism and typically developing children. Our results show that while movement is unique to each individual, variations in the kinematic patterning of sequential grasping movements genuinely differentiate children with autism from typically developing children. These findings provide quantitative evidence for a prospective motor control impairment in autism and indicate the potential to draw inferences about autism on the basis of movement kinematics.

A kind of magic: Enhanced detection of pantomimed grasps in professional magicians.

Professional magicians regularly use pantomimed grasps (i.e., movements towards imagined objects) to deceive audiences. To do so, they learn to shape their hands similarly for real and pantomimed grasps. Here we tested whether this form of motor expertise provides them a significant benefit when processing pantomimed grasps. To this aim, in a one-interval discrimination design, we asked 17 professional magicians and 17 naïve controls to watch video clips of reach-to-grasp movements recorded from naïve participants and judge whether the observed movement was real or pantomimed. All video clips were edited to spatially occlude the grasped object (either present or imagined). Data were analysed within a drift diffusion model approach. Fitting different models showed that, whereas magicians and naïve performed similarly when observing real grasps, magicians had a specific advantage compared with naïve at discriminating pantomimed grasps. These findings suggest that motor expertise may be crucial for detecting relevant cues from hand movement during the discrimination of pantomimed grasps. Results are discussed in terms of motor recalibration.

Prospective motor control obeys to idiosyncratic strategies in autism.

Disturbance of primary prospective motor control has been proposed to contribute to faults in higher mind functions of individuals with autism spectrum disorder, but little research has been conducted to characterize prospective control strategies in autism. In the current study, we applied pattern-classification analyses to kinematic features to verify whether children with autism spectrum disorder (ASD) and typically developing (TD) children altered their initial grasp in anticipation of self- and other-actions. Results indicate that children with autism adjusted their behavior to accommodate onward actions. The way they did so, however, varied idiosyncratically from one individual to another, which suggests that previous characterizations of general lack of prospective control strategies may be overly simplistic. These findings link abnormalities in anticipatory control with increased variability and offer insights into the difficulties that individuals with ASD may experience in social interaction.

One hand, two hands, two people: Prospective sensorimotor control in children with autism.

Where grasps are made reveals how grasps are planned. The grasp height effect predicts that, when people take hold of an object to move it to a new position, the grasp height on the object is inversely related to the height of the target position. In the present study, we used this effect as a window into the prospective sensorimotor control of children with autism spectrum disorders without accompanying intellectual impairment. Participants were instructed to grasp a vertical cylinder and move it from a table (home position) to a shelf of varying height (target position). Depending on the conditions, they performed the task using only one hand (unimanual), two hands (bimanual), or with the help of a co-actor (joint). Comparison between the performance of typically developing children and children with autism revealed no group difference across tasks. We found, however, a significant influence of IQ on grasp height modulation in both groups. These results provide clear evidence against a general prospective sensorimotor planning deficit and suggest that at least some form of higher order planning is present in autism without accompanying intellectual impairment.

Seeing mental states: An experimental strategy for measuring the observability of other minds.

Is it possible to perceive others' mental states? Are mental states visible in others' behavior? In contrast to the traditional view that mental states are hidden and not directly accessible to perception, in recent years a phenomenologically-motivated account of social cognition has emerged: direct social perception. However, despite numerous published articles that both defend and critique direct perception, researchers have made little progress in articulating the conditions under which direct perception of others' mental states is possible. This paper proposes an empirically anchored approach to the observability of others' mentality - not just in the weak sense of discussing relevant empirical evidence for and against the phenomenon of interest, but also, and more specifically, in the stronger sense of identifying an experimental strategy for measuring the observability of mental states and articulating the conditions under which mental states are observable. We conclude this article by reframing the problem of direct perception in terms of establishing a definable and measurable relationship between movement features and perceived mental states.

The heaviness of invisible objects: Predictive weight judgments from observed real and pantomimed grasps.

Observation of others' actions has been proposed to provide a shared experience of the properties of objects acted upon. We report results that suggest a similar form of shared experience may be gleaned from the observation of pantomimed grasps, i.e., grasps aimed at pretended objects. In a weight judgment task, participants were asked to observe a hand reaching towards and grasping either a real or imagined glass, and to predictively judge its weight. Results indicate that participants were able to discriminate whether the to-be-grasped glass was empty, and thus light, or full, and thus heavy. Worthy of further investigation, this finding suggests that by observing others' movements we can make predictions, and form expectations about the characteristics of objects that exist only in others' minds.

Anticipatory action planning in blind and sighted individuals.

Several studies on visually guided reach-to-grasp movements have documented that how objects are grasped differs depending on the actions one intends to perform subsequently. However, no previous study has examined whether this differential grasping may also occur without visual input. In this study, we used motion capture technology to investigate the influence of visual feedback and prior visual experience on the modulation of kinematics by intention in sighted (in both full-vision and no-vision conditions), early-blind and late-blind participants. Results provide evidence of modulation of kinematics by intention to a similar degree under both full-vision and no-vision conditions. Moreover, they demonstrate that prior visual experience has little impact on the tailoring of grasping movements to intention. This suggests that sequential action planning does not depend on visual input, and may instead be ascribed to the function of multisensory-motor cortical network that operates and develops not only in light, but also in darkness.

When Far Becomes Near.

On many occasions, people spontaneously or deliberately take the perspective of a person facing them rather than their own perspective. How is this done? Using a spatial perspective task in which participants were asked to identify objects at specific locations, we found that self-perspective judgments were faster for objects presented to the right, rather than the left, and for objects presented closer to the participants' own bodies. Strikingly, taking the opposing perspective of another person led to a reversal (i.e., remapping) of these effects, with reference to the other person's position (Experiment 1). A remapping of spatial relations was also observed when an empty chair replaced the other person (Experiment 2), but not when access to the other viewpoint was blocked (Experiment 3). Thus, when the spatial scene allows a physically feasible but opposing point of view, people respond as if their own bodies were in that place. Imagination can thus overcome perception.

Decoding intentions from movement kinematics.

How do we understand the intentions of other people? There has been a longstanding controversy over whether it is possible to understand others' intentions by simply observing their movements. Here, we show that indeed movement kinematics can form the basis for intention detection. By combining kinematics and psychophysical methods with classification and regression tree (CART) modeling, we found that observers utilized a subset of discriminant kinematic features over the total kinematic pattern in order to detect intention from observation of simple motor acts. Intention discriminability covaried with movement kinematics on a trial-by-trial basis, and was directly related to the expression of discriminative features in the observed movements. These findings demonstrate a definable and measurable relationship between the specific features of observed movements and the ability to discriminate intention, providing quantitative evidence of the significance of movement kinematics for anticipating others' intentional actions.

Doing It Your Way: How Individual Movement Styles Affect Action Prediction.

Individuals show significant variations in performing a motor act. Previous studies in the action observation literature have largely ignored this ubiquitous, if often unwanted, characteristic of motor performance, assuming movement patterns to be highly similar across repetitions and individuals. In the present study, we examined the possibility that individual variations in motor style directly influence the ability to understand and predict others' actions. To this end, we first recorded grasping movements performed with different intents and used a two-step cluster analysis to identify quantitatively 'clusters' of movements performed with similar movement styles (Experiment 1). Next, using videos of the same movements, we proceeded to examine the influence of these styles on the ability to judge intention from action observation (Experiments 2 and 3). We found that motor styles directly influenced observers' ability to 'read' others' intention, with some styles always being less 'readable' than others. These results provide experimental support for the significance of motor variability for action prediction, suggesting that the ability to predict what another person is likely to do next directly depends on her individual movement style.

Are We Real When We Fake? Attunement to Object Weight in Natural and Pantomimed Grasping Movements.

Behavioral and neuropsychological studies suggest that real actions and pantomimed actions tap, at least in part, different neural systems. Inspired by studies showing weight-attunement in real grasps, here we asked whether (and to what extent) kinematics of pantomimed reach-to-grasp movement can reveal the weight of the pretended target. To address this question, we instructed participants (n = 15) either to grasp or pretend to grasp toward two differently weighted objects, i.e., a light object and heavy object. Using linear discriminant analysis, we then proceeded to classify the weight of the target - either real or pretended - on the basis of the recorded movement patterns. Classification analysis revealed that pantomimed reach-to-grasp movements retained information about object weight, although to a lesser extent than real grasp movements. These results are discussed in relation to the mechanisms underlying the control of real and pantomimed grasping movements.

Grasping others' movements: Rapid discrimination of object size from observed hand movements.

During reach-to-grasp movements, the hand is gradually molded to conform to the size and shape of the object to be grasped. Yet the ability to glean information about object properties by observing grasping movements is poorly understood. In this study, we capitalized on the effect of object size to investigate the ability to discriminate the size of an invisible object from movement kinematics. The study consisted of 2 phases. In the first action execution phase, to assess grip scaling, we recorded and analyzed reach-to-grasp movements performed toward differently sized objects. In the second action observation phase, video clips of the corresponding movements were presented to participants in a two-alternative forced-choice task. To probe discrimination performance over time, videos were edited to provide selective vision of different periods from 2 viewpoints. Separate analyses were conducted to determine how the participants' ability to discriminate between stimulus alternatives (Type I sensitivity) and their metacognitive ability to discriminate between correct and incorrect responses (Type II sensitivity) varied over time and viewpoint. We found that as early as 80 ms after movement onset, participants were able to discriminate object size from the observation of grasping movements delivered from the lateral viewpoint. For both viewpoints, information pickup closely matched the evolution of the hand's kinematics, reaching an almost perfect performance well before the fingers made contact with the object (60% of movement duration). These findings suggest that observers are able to decode object size from kinematic sources specified early on in the movement. (PsycINFO Database Record

The Role of Perspective in Mental Time Travel.

Recent years have seen accumulating evidence for the proposition that people process time by mapping it onto a linear spatial representation and automatically "project" themselves on an imagined mental time line. Here, we ask whether people can adopt the temporal perspective of another person when travelling through time. To elucidate similarities and differences between time travelling from one's own perspective or from the perspective of another person, we asked participants to mentally project themselves or someone else (i.e., a coexperimenter) to different time points. Three basic properties of mental time travel were manipulated: temporal location (i.e., where in time the travel originates: past, present, and future), motion direction (either backwards or forwards), and temporal duration (i.e., the distance to travel: one, three, or five years). We found that time travels originating in the present lasted longer in the self- than in the other-perspective. Moreover, for self-perspective, but not for other-perspective, time was differently scaled depending on where in time the travel originated. In contrast, when considering the direction and the duration of time travelling, no dissimilarities between the self- and the other-perspective emerged. These results suggest that self- and other-projection, despite some differences, share important similarities in structure.

Investigating the ability to read others' intentions using humanoid robots.

The ability to interact with other people hinges crucially on the possibility to anticipate how their actions would unfold. Recent evidence suggests that a similar skill may be grounded on the fact that we perform an action differently if different intentions lead it. Human observers can detect these differences and use them to predict the purpose leading the action. Although intention reading from movement observation is receiving a growing interest in research, the currently applied experimental paradigms have important limitations. Here, we describe a new approach to study intention understanding that takes advantage of robots, and especially of humanoid robots. We posit that this choice may overcome the drawbacks of previous methods, by guaranteeing the ideal trade-off between controllability and naturalness of the interactive scenario. Robots indeed can establish an interaction in a controlled manner, while sharing the same action space and exhibiting contingent behaviors. To conclude, we discuss the advantages of this research strategy and the aspects to be taken in consideration when attempting to define which human (and robot) motion features allow for intention reading during social interactive tasks.

When gaze opens the channel for communication: Integrative role of IFG and MPFC.

Recent advances in the field of cognitive neuroscience have revealed that direct gaze modulates activity in cortical and subcortical key regions of the 'social brain network', including the inferior frontal gyrus (IFG) and the anterior rostral medial prefrontal cortex (arMPFC). However, very little is known about how direct gaze is processed during live interaction with a real partner. Here, for the first time we used an experimental setup allowing the participant inside an MRI scanner to interact face-to-face with a partner located in the scanner room. Depending on condition, the participant and the partner were instructed either to look at each other in the eyes or to direct their gaze away from the other. As control conditions, participants gazed at their own eyes, reflected in a mirror, or gazed at a picture of the partner's eyes. Results revealed that direct gaze by the partner was associated with activity in areas involved in production and comprehension of language and action, including the IFG, the premotor cortex (PM), and the supplementary motor area (SMA). Activations in these areas were observed regardless of the participant's gaze behavior. In contrast, increased activity in arMPFC, an area involved in inference of other mental states during social interaction and communication, was only observed when the participant reciprocated the partner's direct gaze so as to establish mutual gaze. Psychophysiological interaction (PPI) analysis revealed effective connectivity between the IFG and the arMPFC during mutual gaze. This suggests that, within a larger network concerned with the processing of social gaze, mutual gaze with a real partner is established by an increased coupling between areas involved in the detection of communicative intentions, language, and social interaction.

Predicting object size from hand kinematics: a temporal perspective.

Research on reach-to-grasp movements generally concentrates on kinematics values that are expression of maxima, in particular the maximum aperture of the hand and the peak of wrist velocity. These parameters provide a snapshot description of movement kinematics at a specific time point during reach, i.e., the maximum within a set of value, but do not allow to investigate how hand kinematics gradually conform to target properties. The present study was designed to extend the characterization of object size effects to the temporal domain. Thus, we computed the wrist velocity and the grip aperture throughout reach-to-grasp movements aimed at large versus small objects. To provide a deeper understanding of how joint movements varied over time, we also considered the time course of finger motion relative to hand motion. Results revealed that movement parameters evolved in parallel but at different rates in relation to object size. Furthermore, a classification analysis performed using a Support Vector Machine (SVM) approach showed that kinematic features taken as a group predicted the correct target size well before contact with the object. Interestingly, some kinematics features exhibited a higher ability to discriminate the target size than others did. These findings reinforce our knowledge about the relationship between kinematics and object properties and shed new light on the quantity and quality of information available in the kinematics of a reach-to-grasp movement over time. This might have important implications for our understanding of the action-perception coupling mechanism.

Intentions in the brain: the unveiling of Mister Hyde.

Is it possible to understand the intentions of others by merely observing their movements? Current debate has been mainly focused on the role that mirror neurons and motor simulation may play in this process, with surprisingly little attention being devoted to how intentions are actually translated into movements. Here, we delineate an alternative approach to the problem of intention-from-movement understanding, which takes "action execution" rather than "action observation" as a starting point. We first consider whether and to what extent, during action execution, intentions shape movement kinematics. We then examine whether observers are sensitive to intention information conveyed by visual kinematics and can use this information to discriminate between different intentions. Finally, we consider the neural mechanisms that may contribute to intention-from-movement understanding. We argue that by reframing the relationship between intention and movement, this evidence opens new perspectives into the neurobiology of how we know other minds and predict others' behavior.