Intersecting kinematic encoding and readout of intention in autism.

Observers with autism spectrum disorders (ASDs) find it difficult to read intentions from movements. However, the computational bases of these difficulties are unknown. Do these difficulties reflect an intention readout deficit, or are they more likely rooted in kinematic (dis-)similarities between typical and ASD kinematics? We combined motion tracking, psychophysics, and computational analyses to uncover single-trial intention readout computations in typically developing (TD) children (n = 35) and children with ASD (n = 35) who observed actions performed by TD children and children with ASD. Average intention discrimination performance was above chance for TD observers but not for ASD observers. However, single-trial analysis showed that both TD and ASD observers read single-trial variations in movement kinematics. TD readers were better able to identify intention-informative kinematic features during observation of TD actions; conversely, ASD readers were better able to identify intention-informative features during observation of ASD actions. Crucially, while TD observers were generally able to extract the intention information encoded in movement kinematics, those with autism were unable to do so. These results extend existing conceptions of mind reading in ASD by suggesting that intention reading difficulties reflect both an interaction failure, rooted in kinematic dissimilarity between TD and ASD kinematics (at the level of feature identification), and an individual readout deficit (at the level of information extraction), accompanied by an overall reduced sensitivity of intention readout to single-trial variations in movement kinematics.

When Far Becomes Near.

On many occasions, people spontaneously or deliberately take the perspective of a person facing them rather than their own perspective. How is this done? Using a spatial perspective task in which participants were asked to identify objects at specific locations, we found that self-perspective judgments were faster for objects presented to the right, rather than the left, and for objects presented closer to the participants' own bodies. Strikingly, taking the opposing perspective of another person led to a reversal (i.e., remapping) of these effects, with reference to the other person's position (Experiment 1). A remapping of spatial relations was also observed when an empty chair replaced the other person (Experiment 2), but not when access to the other viewpoint was blocked (Experiment 3). Thus, when the spatial scene allows a physically feasible but opposing point of view, people respond as if their own bodies were in that place. Imagination can thus overcome perception.

The Role of Perspective in Mental Time Travel.

Recent years have seen accumulating evidence for the proposition that people process time by mapping it onto a linear spatial representation and automatically "project" themselves on an imagined mental time line. Here, we ask whether people can adopt the temporal perspective of another person when travelling through time. To elucidate similarities and differences between time travelling from one's own perspective or from the perspective of another person, we asked participants to mentally project themselves or someone else (i.e., a coexperimenter) to different time points. Three basic properties of mental time travel were manipulated: temporal location (i.e., where in time the travel originates: past, present, and future), motion direction (either backwards or forwards), and temporal duration (i.e., the distance to travel: one, three, or five years). We found that time travels originating in the present lasted longer in the self- than in the other-perspective. Moreover, for self-perspective, but not for other-perspective, time was differently scaled depending on where in time the travel originated. In contrast, when considering the direction and the duration of time travelling, no dissimilarities between the self- and the other-perspective emerged. These results suggest that self- and other-projection, despite some differences, share important similarities in structure.

When gaze opens the channel for communication: Integrative role of IFG and MPFC.

Recent advances in the field of cognitive neuroscience have revealed that direct gaze modulates activity in cortical and subcortical key regions of the 'social brain network', including the inferior frontal gyrus (IFG) and the anterior rostral medial prefrontal cortex (arMPFC). However, very little is known about how direct gaze is processed during live interaction with a real partner. Here, for the first time we used an experimental setup allowing the participant inside an MRI scanner to interact face-to-face with a partner located in the scanner room. Depending on condition, the participant and the partner were instructed either to look at each other in the eyes or to direct their gaze away from the other. As control conditions, participants gazed at their own eyes, reflected in a mirror, or gazed at a picture of the partner's eyes. Results revealed that direct gaze by the partner was associated with activity in areas involved in production and comprehension of language and action, including the IFG, the premotor cortex (PM), and the supplementary motor area (SMA). Activations in these areas were observed regardless of the participant's gaze behavior. In contrast, increased activity in arMPFC, an area involved in inference of other mental states during social interaction and communication, was only observed when the participant reciprocated the partner's direct gaze so as to establish mutual gaze. Psychophysiological interaction (PPI) analysis revealed effective connectivity between the IFG and the arMPFC during mutual gaze. This suggests that, within a larger network concerned with the processing of social gaze, mutual gaze with a real partner is established by an increased coupling between areas involved in the detection of communicative intentions, language, and social interaction.

The effects of task and content on digit placement on a bottle.

In addition to hand shaping, previous studies have shown that subjects adapt placement of individual digits to object properties such as its weight and center of mass. However, the extent to which digit placement varies based on task context is unknown. In the present study, we investigated where subjects place their digits on a bottle when the upcoming task (lift versus pour) and object content (i.e., amount of liquid: empty, half, and full) were manipulated. Our results showed that subjects anticipated both the upcoming task and content by varying digit placement when grasping the bottle prior to the onset of manipulation. Specifically, subjects increased the vertical distance between the thumb and index finger for pouring but not for lifting. This larger moment arm might have been established to decrease the amount of force required to tilt the bottle. Content also affected digit placement: the digits were placed higher and were wrapped more around the bottle with increasing content. This strategy may maximize grip surface contact, and hence grasp stability. These findings extend previous research showing that grasp planning not only takes place at a macroscopic level (whole-hand position relative to an object), but also at the level of individual digit placement. This finer level of control appears to be sensitive to the expected mechanical properties of the object and how these may affect grasp stability throughout the upcoming manipulation.

Identifying the signature of prospective motor control in children with autism.

Failure to develop prospective motor control has been proposed to be a core phenotypic marker of autism spectrum disorders (ASD). However, whether genuine differences in prospective motor control permit discriminating between ASD and non-ASD profiles over and above individual differences in motor output remains unclear. Here, we combined high precision measures of hand movement kinematics and rigorous machine learning analyses to determine the true power of prospective movement data to differentiate children with autism and typically developing children. Our results show that while movement is unique to each individual, variations in the kinematic patterning of sequential grasping movements genuinely differentiate children with autism from typically developing children. These findings provide quantitative evidence for a prospective motor control impairment in autism and indicate the potential to draw inferences about autism on the basis of movement kinematics.

Testing the effects of end-goal during reach-to-grasp movements in Parkinson's disease.

Previous evidence suggests that hand shaping during reaching is modulated by the presence and the nature of the end-goal following object's grasp. Here we test whether such modulation is maintained in Parkinson's disease (PD). Six participants with PD and six healthy participants took part in the study. Participants were requested to reach towards a bottle filled with water, and then: (1) grasp it without performing any subsequent action; (2) grasp it and place it accurately on a target area; (3) grasp it and pour its contents within a container. The results showed that participants shaped their hand differently depending on the presence or absence of an action following object's grasp. However, the request to perform an action after grasp determined a modulation of hand kinematics which was delayed for PD than for control participants. Further, whereas for control participants the nature of the end-goal determined a modulation of hand shaping, for PD patients such modulation was not evident. Data are discussed in terms of the role played by basal ganglia in implementing anticipatory mechanisms for the control of manipulative activities. We contend that in PD patients these mechanisms are not totally compromised, but their implementation depends on the action information that has to be anticipated.

A kind of magic: Enhanced detection of pantomimed grasps in professional magicians.

Professional magicians regularly use pantomimed grasps (i.e., movements towards imagined objects) to deceive audiences. To do so, they learn to shape their hands similarly for real and pantomimed grasps. Here we tested whether this form of motor expertise provides them a significant benefit when processing pantomimed grasps. To this aim, in a one-interval discrimination design, we asked 17 professional magicians and 17 naïve controls to watch video clips of reach-to-grasp movements recorded from naïve participants and judge whether the observed movement was real or pantomimed. All video clips were edited to spatially occlude the grasped object (either present or imagined). Data were analysed within a drift diffusion model approach. Fitting different models showed that, whereas magicians and naïve performed similarly when observing real grasps, magicians had a specific advantage compared with naïve at discriminating pantomimed grasps. These findings suggest that motor expertise may be crucial for detecting relevant cues from hand movement during the discrimination of pantomimed grasps. Results are discussed in terms of motor recalibration.

Anticipatory control of grasping: independence of sensorimotor memories for kinematics and kinetics.

We have recently provided evidence for anticipatory grasp control mechanisms in the kinematic domain by showing that subjects modulate digit placement on an object based on its center of mass (CM) when it can be anticipated (Lukos et al., 2007). This behavior relied on sensorimotor memories about digit contact points and forces required for optimal manipulation. We found that accurate sensorimotor memories depended on the acquisition of implicit knowledge about object properties associated with repeated manipulations of the same object. Whereas implicit knowledge of object properties is essential for anticipatory grasp control, the extent to which subjects can use explicit knowledge to accurately scale digit forces in an anticipatory manner is controversial. Additionally, it is not known whether subjects are able to use explicit knowledge of object properties for anticipatory control of contact points. We addressed this question by asking subjects to grasp and lift an object while providing explicit knowledge of object CM location as visual or verbal cues. Contact point modulation and object roll, a measure of anticipatory force control, were assessed using blocked and random CM presentations. We found that explicit knowledge of object CM enabled subjects to modulate contact points. In contrast, subjects could not minimize object roll in the random condition to the same extent as in the blocked when provided with a verbal or visual cue. These findings point to a dissociation in the effect of explicit knowledge of object properties on grasp kinematics versus kinetics, thus suggesting independent anticipatory processes for grasping.

Visuomotor priming effects in Parkinson's disease patients depend on the match between the observed and the executed action.

Evidence exists that action observation activates the same cortical motor areas that are involved in the performance of the observed actions. An untested idea is whether subcortical structures such as the basal ganglia play a role in the coding of other people's actions. This study used kinematics to examine how Parkinson's disease patients react to the observation of an action which they were subsequently requested to perform. In each trial a model and an observer, which could be either a Parkinsonian patient or a neurologically healthy participant, were seated facing each other. The model was requested to grasp a stimulus (action condition), to perform a kicking action towards the stimulus (control-action condition), and to not perform any action (control condition). The task for the observer was always to grasp the stimulus after having watched the model performing her task. Results show that Parkinson's disease patients did show facilitation effects only when the model was a Parkinsonian patient. Whereas, neurologically healthy participants' movements were facilitated following the observation of either the Parkinsonian and the healthy model grasping the object. No facilitation effects were found for both the control and the control-action conditions. The fact that normal visuomotor priming takes place in PD patients when the observed action matches with what they can perform suggests that basal ganglia might not be necessary for it. However, damage to the basal ganglia might become relevant when such a match does not occur. In such circumstances, a damage to these structures might prevent the deployment of additional activity which might be necessary to influence cortical functions related to the representations of observed actions.

Breaking the flow of an action.

The present study was aimed at investigating whether the execution of a sequential action changes when the temporal contiguity between the motor steps composing it is altered. Participants were requested to reach and grasp an object and pour its contents into a container under two conditions: a 'fluent pouring' condition in which participants were instructed to execute the action fluently and an 'interrupted pouring' condition in which participants were instructed to reach and grasp the object, wait for an acoustic signal and then complete the pouring action. A 'control' condition in which participants were requested to reach and grasp the object without performing any subsequent action was also administered. Results indicate that movement duration and hand kinematics varied depending on the temporal relationship between the reach-to-grasp and the lift-to-pour phases. When a delay at object contact was introduced, reach duration was longer and the thumb/index abduction angle was greater than when such a delay was not introduced. These results are interpreted in light of 'internal model' theories suggesting that a strict temporal contiguity between the motor steps composing an action is a prerequisite for a skilful movement to be planned and executed.

Choice of contact points during multidigit grasping: effect of predictability of object center of mass location.

It has been shown that when subjects can predict object properties [e.g., weight or center of mass (CM)], fingertip forces are appropriately scaled before the object is lifted, i.e., before somatosensory feedback can be processed. However, it is not known whether subjects, in addition to these anticipatory force mechanisms, exploit the ability to choose where digits can be placed to facilitate object manipulation. We addressed this question by asking subjects to reach and grasp an object whose CM was changed to the left, center, or right of the object in either a predictable or unpredictable manner. The only task requirement was to minimize object roll during lift. We hypothesized that subjects would modulate contact points but only when object CM location could be predicted. As expected, object roll was significantly smaller in the predictable condition. This experimental condition was also associated with statistically distinct spatial distributions of contact points as a function of object CM location but primarily when large torques had to be counteracted, i.e., for right and left CM locations. In contrast, when subjects could not anticipate CM location, a "default" distribution of contact points was used, this being statistically indistinguishable from that adopted for the center CM location in the predictable condition. We conclude that choice of contact points is integrated with anticipatory force control mechanisms to facilitate object manipulation. These results demonstrate that planning of digit placement is an important component of grasp control.

Effects of olfactory stimuli on arm-reaching duration.

The aim of the present study was to investigate the effects of olfactory stimuli on visually guided reaching. In Experiment 1, participants reached toward and grasped either a small (almond/strawberry) or a large (apple/orange) visual target. Any 1 of 4 odors corresponding to the visual stimuli or odorless air was administered before movement initiation. Within the same block of trials, participants smelled 1) an odor associated with an object of a different size than the target, 2) an odor associated with an object of a size equal to that of the target, or 3) odorless air. Results indicated that reaching duration was longer for trials in which the odor "size" and the visual target did not match than when they matched. In Experiment 2, the same procedures were applied but the "no-odor" trials were administered in a separate block to the "odor" trials. Similar results as for Experiment 1 were found. However, in contrast to Experiment 1, the presence of an odor increased the level of alertness resulting in a shortening of reaching duration. We contend that olfactory stimuli have the capacity to elicit motor plans interfering with those programmed for a movement toward a visual stimulus.

An object for an action, the same object for other actions: effects on hand shaping.

Objects can be grasped in several ways due to their physical properties, the context surrounding the object, and the goal of the grasping agent. The aim of the present study was to investigate whether the prior-to-contact grasping kinematics of the same object vary as a result of different goals of the person grasping it. Subjects were requested to reach toward and grasp a bottle filled with water, and then complete one of the following tasks: (1) Grasp it without performing any subsequent action; (2) Lift and throw it; (3) Pour the water into a container; (4) Place it accurately on a target area; (5) Pass it to another person. We measured the angular excursions at both metacarpal-phalangeal (mcp) and proximal interphalangeal (pip) joints of all digits, and abduction angles of adjacent digit pairs by means of resistive sensors embedded in a glove. The results showed that the presence and the nature of the task to be performed following grasping affect the positioning of the fingers during the reaching phase. We contend that a one-to-one association between a sensory stimulus and a motor response does not capture all the aspects involved in grasping. The theoretical approach within which we frame our discussion considers internal models of anticipatory control which may provide a suitable explanation of our results.

One hand, two hands, two people: Prospective sensorimotor control in children with autism.

Where grasps are made reveals how grasps are planned. The grasp height effect predicts that, when people take hold of an object to move it to a new position, the grasp height on the object is inversely related to the height of the target position. In the present study, we used this effect as a window into the prospective sensorimotor control of children with autism spectrum disorders without accompanying intellectual impairment. Participants were instructed to grasp a vertical cylinder and move it from a table (home position) to a shelf of varying height (target position). Depending on the conditions, they performed the task using only one hand (unimanual), two hands (bimanual), or with the help of a co-actor (joint). Comparison between the performance of typically developing children and children with autism revealed no group difference across tasks. We found, however, a significant influence of IQ on grasp height modulation in both groups. These results provide clear evidence against a general prospective sensorimotor planning deficit and suggest that at least some form of higher order planning is present in autism without accompanying intellectual impairment.

Seeing mental states: An experimental strategy for measuring the observability of other minds.

Is it possible to perceive others' mental states? Are mental states visible in others' behavior? In contrast to the traditional view that mental states are hidden and not directly accessible to perception, in recent years a phenomenologically-motivated account of social cognition has emerged: direct social perception. However, despite numerous published articles that both defend and critique direct perception, researchers have made little progress in articulating the conditions under which direct perception of others' mental states is possible. This paper proposes an empirically anchored approach to the observability of others' mentality - not just in the weak sense of discussing relevant empirical evidence for and against the phenomenon of interest, but also, and more specifically, in the stronger sense of identifying an experimental strategy for measuring the observability of mental states and articulating the conditions under which mental states are observable. We conclude this article by reframing the problem of direct perception in terms of establishing a definable and measurable relationship between movement features and perceived mental states.

Prospective motor control obeys to idiosyncratic strategies in autism.

Disturbance of primary prospective motor control has been proposed to contribute to faults in higher mind functions of individuals with autism spectrum disorder, but little research has been conducted to characterize prospective control strategies in autism. In the current study, we applied pattern-classification analyses to kinematic features to verify whether children with autism spectrum disorder (ASD) and typically developing (TD) children altered their initial grasp in anticipation of self- and other-actions. Results indicate that children with autism adjusted their behavior to accommodate onward actions. The way they did so, however, varied idiosyncratically from one individual to another, which suggests that previous characterizations of general lack of prospective control strategies may be overly simplistic. These findings link abnormalities in anticipatory control with increased variability and offer insights into the difficulties that individuals with ASD may experience in social interaction.

The heaviness of invisible objects: Predictive weight judgments from observed real and pantomimed grasps.

Observation of others' actions has been proposed to provide a shared experience of the properties of objects acted upon. We report results that suggest a similar form of shared experience may be gleaned from the observation of pantomimed grasps, i.e., grasps aimed at pretended objects. In a weight judgment task, participants were asked to observe a hand reaching towards and grasping either a real or imagined glass, and to predictively judge its weight. Results indicate that participants were able to discriminate whether the to-be-grasped glass was empty, and thus light, or full, and thus heavy. Worthy of further investigation, this finding suggests that by observing others' movements we can make predictions, and form expectations about the characteristics of objects that exist only in others' minds.

Anticipatory action planning in blind and sighted individuals.

Several studies on visually guided reach-to-grasp movements have documented that how objects are grasped differs depending on the actions one intends to perform subsequently. However, no previous study has examined whether this differential grasping may also occur without visual input. In this study, we used motion capture technology to investigate the influence of visual feedback and prior visual experience on the modulation of kinematics by intention in sighted (in both full-vision and no-vision conditions), early-blind and late-blind participants. Results provide evidence of modulation of kinematics by intention to a similar degree under both full-vision and no-vision conditions. Moreover, they demonstrate that prior visual experience has little impact on the tailoring of grasping movements to intention. This suggests that sequential action planning does not depend on visual input, and may instead be ascribed to the function of multisensory-motor cortical network that operates and develops not only in light, but also in darkness.

Virtual reality applications for the remapping of space in neglect patients.

PURPOSE: The aims of the present article were the following: (i) to provide some evidence of the potential of virtual reality (VR) for the assessment, training and recovery of hemispatial neglect; (ii) to present data from our laboratory which seem to confirm that the clinical manifestation of neglect can be improved by using VR techniques; and (iii) to ascertain the neural bases of this improvement. METHODS: We used a VR device (DataGlove) interfaced with a specially designed computer program which allowed neglect patients to reach and grasp a real object while simultaneously observing the grasping of a virtual object located within a virtual environment by a virtual hand. The virtual hand was commanded in real time by their real hand. RESULTS: After a period of training, hemispatial neglect patients coded the visual stimuli within the neglected space in an identical fashion as those presented within the preserved portions of space. However it was also found that only patients with lesions that spared the inferior parietal/superior temporal regions were able to benefit from the virtual reality training. CONCLUSIONS: It was concluded that using VR it is possible to re-create links between the affected and the nonaffected space in neglect patients. Furthermore, that specific regions may play a crucial role in the recovery of space that underlies the improvement of neglect patients when trained with virtual reality. The implications of these results for determining the neural bases of a higher order attentional and/or spatial representation, and for the treatment of patients with unilateral neglect are discussed.