Anticipation (second-order motor planning) is stored in memory - processing of grasp postures in a priming paradigm.

The end-state comfort effect (ESC) describes the tendency to grasp an object with an initial uncomfortable grasp posture in order to achieve a comfortable end posture. The ESC is an example for anticipative processes in manual action. ESC planning is investigated in many studies where this effect is measured in the context of motor observation and motion capture. However, there is little evidence if the anticipative link between different action states, especially between initial grasp postures and comfortable end postures, is represented in memory. The aim of the present study was to investigate whether the perception of a grasp posture holding a bar leads to the activation of action-related representations of grasping actions. For this purpose, a priming paradigm was used in which prime images were shown depicting either a comfortable (overhand grip) or uncomfortable (underhand grip) grasp posture holding a two-colored bar. The subsequently shown target images represented either a comfortable (thumb-up) or uncomfortable (thumb-down) final grasp posture of this grasping action. Due to the different grasp postures in the prime and target, prime-target pairs represented different types of action sequences. Furthermore, physically possible, and physically impossible actions were presented. Participants were asked to react to the top color of the bar shown in the target-picture, whereby the shown grasp posture was irrelevant for this decision. Results showed that reaction times did not differ after presentation of an overhand grip to target pictures showing comfortable or uncomfortable final grasp postures. In contrast, after presentation of an underhand grip in the prime, reactions to target pictures with final comfortable grasp postures were faster compared to target pictures with uncomfortable grasp postures. The effect was only found for the physically possible action. The findings suggest that the perception of the underhand grip leads to cognitive pre-activation of a final action state. The present study suggests that the association between an initial uncomfortable underhand grip and its action effect, in form of a final action state that is consistent with the ESC, is represented in memory. Such motor representation might be important for the anticipation and control of goal-directed grasping.

Sensitivity and specificity of the action observation network to kinematics, target object, and gesture meaning.

Hierarchical models have been proposed to explain how the brain encodes actions, whereby different areas represent different features, such as gesture kinematics, target object, action goal, and meaning. The visual processing of action-related information is distributed over a well-known network of brain regions spanning separate anatomical areas, attuned to specific stimulus properties, and referred to as action observation network (AON). To determine the brain organization of these features, we measured representational geometries during the observation of a large set of transitive and intransitive gestures in two independent functional magnetic resonance imaging experiments. We provided evidence for a partial dissociation between kinematics, object characteristics, and action meaning in the occipito-parietal, ventro-temporal, and lateral occipito-temporal cortex, respectively. Importantly, most of the AON showed low specificity to all the explored features, and representational spaces sharing similar information content were spread across the cortex without being anatomically adjacent. Overall, our results support the notion that the AON relies on overlapping and distributed coding and may act as a unique representational space instead of mapping features in a modular and segregated manner.

Choice effects on temporal binding of action and outcomes: Examining the role of outcome focus and measures of time interval estimation.

The ability to make one's own choices is vital to the experience of intentional behavior. Such agency experiences are reflected in the perceptual compression of time between actions and resulting outcomes. Whereas some studies show that choice limitations weaken temporal binding, other studies do not find such an effect. Reviewing the literature, we noted two potential factors that may moderate choice limitation effects on temporal binding: (a) the extent to which individuals represent their actions in terms of the consequences they produce; and (b) the response mode of the time interval estimation measurement where participants report numbers or use a slider to indicate time intervals. Testing these conceptual and methodological factors in two separate experiments yielded clear effects of choice limitation on temporal binding but no clear moderator role of the two factors. Interestingly, overall analyses showed that the choice limitation effect gradually vanishes over time.

Effect of Object on Kinesthetic Motor Imagery in Autism Spectrum Disorder: A Pilot Study Based on Eye-Tracking Methodology.

Introduction: Social disturbance is a significant autism spectrum disorder (ASD) symptom. Action representation, which is a fundamental component of social interaction, can be investigated through kinesthetic motor imagery (KMI). KMI has been commonly studied with the well-developed laterality judgment paradigm, wherein participants are required to discriminate the laterality of a hand rotated by different angles along one or more axes. Here, we investigated the KMI processing in individuals with ASD by hand laterality judgment paradigm with eye-tracking methodology. Methods: The current study included 22 participants with ASD and 22 typical developing (TD) peers matched for age, gender, and intelligence. Participants were asked to judge the laterality of hand-with-tooth brush images. Results: Compared to the TD controls, individuals with ASD performed KMI with lower accuracy and longer response time in both correct and incorrect action conditions. The incorrect action representation had greater effect on KMI for individuals with ASD. Differences in eye-movement patterns were also observed, characterized by individuals with ASD were more focused on the object area while TD peers were more focused on the hand area. Conclusion: Results suggest that while altered KMI performance was observed, the incorrect action representation elicited more engagement of KMI in both groups. The object-centered eye-movement pattern may contribute to the refine of motor simulation intervention for individuals with ASD.

Motor deficits in autism differ from that of developmental coordination disorder.

LAY ABSTRACT: A vast majority of individuals with autism spectrum disorder experience impairments in motor skills. Those are often labelled as additional developmental coordination disorder despite the lack of studies comparing both disorders. Consequently, motor skills rehabilitation programmes in autism are often not specific but rather consist in standard programmes for developmental coordination disorder. Here, we compared motor performance in three groups of children: a control group, an autism spectrum disorder group and a developmental coordination disorder group. Despite similar level of motor skills evaluated by the standard movement assessment battery for children, in a Reach-to-Displace Task, children with autism spectrum disorder and developmental coordination disorder showed specific motor control deficits. Children with autism spectrum disorder failed to anticipate the object properties, but could correct their movement as well as typically developing children. In contrast, children with developmental coordination disorder were atypically slow, but showed a spared anticipation. Our study has important clinical implications as motor skills rehabilitations are crucial to both populations. Specifically, our findings suggest that individuals with autism spectrum disorder would benefit from therapies aiming at improving their anticipation, maybe through the support of their preserved representations and use of sensory information. Conversely, individuals with developmental coordination disorder would benefit from a focus on the use of sensory information in a timely fashion.

An active inference model of hierarchical action understanding, learning and imitation.

We advance a novel active inference model of the cognitive processing that underlies the acquisition of a hierarchical action repertoire and its use for observation, understanding and imitation. We illustrate the model in four simulations of a tennis learner who observes a teacher performing tennis shots, forms hierarchical representations of the observed actions, and imitates them. Our simulations show that the agent's oculomotor activity implements an active information sampling strategy that permits inferring the kinematic aspects of the observed movement, which lie at the lowest level of the action hierarchy. In turn, this low-level kinematic inference supports higher-level inferences about deeper aspects of the observed actions: proximal goals and intentions. Finally, the inferred action representations can steer imitative responses, but interfere with the execution of different actions. Our simulations show that hierarchical active inference provides a unified account of action observation, understanding, learning and imitation and helps explain the neurobiological underpinnings of visuomotor cognition, including the multiple routes for action understanding in the dorsal and ventral streams and mirror mechanisms.

No need to integrate action information during coarse semantic processing of man-made tools.

Action representation of man-made tools consists of two subtypes: structural action representation concerning how to grasp an object, and functional action representation concerning the skilled use of an object. Compared to structural action representation, functional action representation plays the dominant role in fine-grained (i.e., basic level) object recognition. However, it remains unclear whether the two types of action representation are involved differently in the coarse semantic processing in which the object is recognized at a superordinate level (i.e., living/non-living). Here we conducted three experiments using the priming paradigm, in which video clips displaying structural and functional action hand gestures were used as prime stimuli and grayscale photos of man-made tools were used as target stimuli. Participants recognized the target objects at the basic level in Experiment 1 (i.e., naming task) and at the superordinate level in Experiments 2 and 3 (i.e., categorization task). We observed a significant priming effect for functional action prime-target pairs only in the naming task. In contrast, no priming effect was found in either the naming or the categorization task for the structural action prime-target pairs (Experiment 2), even when the categorization task was preceded by a preliminary action imitation of the prime gestures (Experiment 3). Our results suggest that only functional action information is retrieved during fine-grained object processing. In contrast, coarse semantic processing does not require the integration of either structural or functional action information.

Action representations in prevention behavior: Evidence from motor execution.

Human actions sometimes aim at preventing an event from occurring. How these to-be-prevented events are represented, however, is poorly understood. Recent proposals in the literature point to a possible divide between effect-producing, operant actions, and effect-precluding, prevention actions, suggesting that the control of operant actions relies on codes of environment-related effects whereas prevention actions do not. Here we report two experiments on this issue, showing that spatial features (Experiment 1) as well as temporal features (Experiment 2) of to-be-prevented events influence actions in the same way as corresponding features of to-be-produced effects. This implies that selecting and executing prevention actions relies on anticipated environmental changes, comparable to operant actions.

Self-Supervised Action Representation Learning Based on Asymmetric Skeleton Data Augmentation.

Contrastive learning has received increasing attention in the field of skeleton-based action representations in recent years. Most contrastive learning methods use simple augmentation strategies to construct pairs of positive samples. When using such pairs of positive samples to learn action representations, deeper feature information cannot be learned, thus affecting the performance of downstream tasks. To solve the problem of insufficient learning ability, we propose an asymmetric data augmentation strategy and attempt to apply it to the training of 3D skeleton-based action representations. First, we carefully study the different characteristics presented by different skeleton views and choose a specific augmentation method for a certain view. Second, specific augmentation methods are incorporated into the left and right branches of the asymmetric data augmentation pipeline to increase the convergence difficulty of the contrastive learning task, thereby significantly improving the quality of the learned action representations. Finally, since many methods directly act on the joint view, the augmented samples are quite different from the original samples. We use random probability activation to transform the joint view to avoid extreme augmentation of the joint view. Extensive experiments on NTU RGB + D datasets show that our method is effective.

Dissociation between dreams and wakefulness: Insights from body and action representations of rare individuals with massive somatosensory deafferentation.

The realism of body and actions in dreams is thought to be induced by simulations based on internal representations used during wakefulness. As somatosensory signals contribute to the updating of body and action representations, these are impaired when somatosensory signals are lacking. Here, we tested the hypothesis that individuals with somatosensory deafferentation have impaired body and actions in their dreams, as in wakefulness. We questioned three individuals with a severe, acquired sensory neuropathy on their dreams. While deafferented participants were impaired in daily life, they could dream of themselves as able-bodied, with some sensations (touch, proprioception) and actions (such as running or jumping) which had not been experienced in physical life since deafferentation. We speculate that simulation in dreams could be based on former, "healthy" body and action representations. Our findings are consistent with the idea that distinct body and action representations may be used during dreams and wakefulness.

Representational Processes of Actions Toward and Away from the Body.

The aim of the present study was to investigate the role of mental representation processes during the planning, reaching, and use phases of actions with tools commonly used toward the body (TB, e.g., toothbrush) or away from the body (AB, e.g., pencil). In the first session, healthy participants were asked to perform TB (i.e., making circular movements with the toothbrush near the mouth) and AB (i.e., making circular movements with the pencil near the desk) actions both with (i.e., actual use) and without the tool in hand (i.e., the pantomime of tool use). In the second session, the same participants performed a series of mental rotation tasks involving body- (i.e., face and hands) and object-related (i.e., abstract lines) stimuli. The temporal and kinematic analysis of the motor actions showed that the time required to start the pantomimes (i.e., the planning phase) was shorter for the AB action than for the TB action. In contrast, the reaching phase lasted longer for the AB action than for the TB action. Furthermore, the TB pantomime was associated with the performance in the mental rotation of body-related stimuli, especially during the planning and reaching phases, whereas the AB pantomime was more related to the performance in the mental rotation of object-related stimuli, especially during the tool use phase. Thus, the results revealed that the direction of a goal-directed motor action influences the dynamics of the different phases of the motor action and can determine the type of mental images involved in the planning and execution of the action.

Social Action Effects: Representing Predicted Partner Responses in Social Interactions.

The sociomotor framework outlines a possible role of social action effects on human action control, suggesting that anticipated partner reactions are a major cue to represent, select, and initiate own body movements. Here, we review studies that elucidate the actual content of social action representations and that explore factors that can distinguish action control processes involving social and inanimate action effects. Specifically, we address two hypotheses on how the social context can influence effect-based action control: first, by providing unique social features such as body-related, anatomical codes, and second, by orienting attention towards any relevant feature dimensions of the action effects. The reviewed empirical work presents a surprisingly mixed picture: while there is indirect evidence for both accounts, previous studies that directly addressed the anatomical account showed no signs of the involvement of genuinely social features in sociomotor action control. Furthermore, several studies show evidence against the differentiation of social and non-social action effect processing, portraying sociomotor action representations as remarkably non-social. A focus on enhancing the social experience in future studies should, therefore, complement the current database to establish whether such settings give rise to the hypothesized influence of social context.

Effective connectivity within the neural system for object-directed action representation during aware and unaware tool processing.

Previous brain functional specialization evidence has shown that both aware and unaware visual processing of manipulable objects activate left premotor, parietal, and posterior temporal cortices, which are thought to constitute object-directed action and object-function processing streams. An open question is whether, both under supraliminal and subliminal processing conditions, there is directional spread of activation along these functional streams, leading to causal inter-regional connectivity effects. In this study, we used Dynamic Causal Modelling to estimate the effective connectivity influences within the premotor-parieto-temporal network, as a function of factorial contrasts for Manipulability (manipulable vs non-manipulable objects) and Perceptual Awareness (above vs below perceptual threshold). We modeled forward and backward connections originating from visual area V4, as a region underlying object texture segregation, and spreading through the left premotor-parieto-temporal network. Both above and below perceptual threshold, the visual processing of manipulable objects was associated with a specific increase of reciprocal effective connectivity coupling among left premotor-parieto-temporal regions. Aware and unaware manipulable object processing differed from each other for their distinct patterns of top-down activation enhancement exerted, in the former case, by left premotor-parieto-temporal regions on area V4 and, in the latter case, by left premotor on temporal regions. Although it is only under aware processing conditions that effective connectivity in the action representation system may promote object visual contour segregation in area V4, our results suggest that the encoding of object-action and object-function information can occur through left-hemispheric premotor, parietal, and temporal causal interdependencies, even when the object is not consciously perceived.

How vertical elevation affects self-other integration as measured by the joint Simon effect.

Earlier findings suggest that positions of power decrease self-other integration and increase psychological distance to others. Until now, however, evidence for this relation rests exclusively on subjective measures. The current research instead employed a vertical joint Simon task to measure self-other integration. This task assesses the extent to which people represent their own actions in reference to their co-actor's, also referred to as the joint Simon effect. Building on cultural associations between power and vertical elevation, we manipulated whether participants were in an elevated (high-power) or lower (low-power) seating position. Experiments 1a and 1b reanalyzed existing datasets and found that elevated (vs. lower) seating position decreased the joint Simon effect, consistent with predictions. Experiment 2 provides a high-powered replication of this finding. Yet, further analyses revealed that feelings of power - measured as a manipulation check and indeed demonstrating that the manipulation was successful - did not mediate or moderate the effect of seating position on the joint Simon effect. Therefore, it is possible that the effect of seating elevation was driven through other aspects of that manipulation than feelings of power. We discuss these and suggest ways to test these alternative explanations.

Inferior parietal lobule involved in representation of "what" in a delayed-action Libet task.

Intentional motor action is typically characterized by the decision about the timing, and the selection of the action variant, known as the "what" component. We compared free action selection with instructed action, where the movement type was externally cued, in order to investigate the action selection and action representation in a Libet's task. Temporal and spatial locus of these processes was examined using the combination of high-density electroencephalography, topographic analysis of variance, and source reconstruction. Instructed action, engaging representation of the response movement, was associated with distinct negativity at the parietal and centro-parietal channels starting around 750 ms before the movement, which has a source particularly in the bilateral inferior parietal lobule. This suggests that in delayed-action tasks, the process of action representation in the inferior parietal lobule may play an important part in the larger parieto-frontal activity responsible for movement selection.

Structuralist mental representation of dual-action demands: Evidence for compositional coding from dual tasks with low cross-task dimensional overlap.

The present study asks how behavioral (dual-action) demands in dual tasks are mentally represented and whether changes in representation might govern practice-related dual-task performance improvements. Three different representation accounts were empirically tested based on the idea that dual-action demands required in a dual-task trial might be represented in different ways. According to a compositional (Structuralist) account, component tasks remain structurally intact when combined with another task. In contrast, a holistic (Gestalt) account posits that dual-action requirements in dual tasks are represented holistically and entirely distinct from its component action requirements. Finally, a contextual change account assumes that a change in context (e.g., from single- to dual-action requirement) generally impedes response retrieval, similar to repeating a response while the task context switches. To address this issue, we analyzed trial-by-trial effects in a single/dual switch paradigm (SDS paradigm, involving a randomized mix of single- and dual-task trials within blocks). Specifically, we analyzed performance in an extensive dual-task training setting (involving training sessions across several days) combining an auditory-vocal task and a visual-manual task. The results indicated that, throughout practice, nearly all relevant comparisons of performance between complete switch trials (e.g., between the two single tasks) and partial repetition trials (e.g., from dual to single task) revealed partial repetition benefits, that is, for both the auditory-vocal and the visual-manual task, and for both single- and dual-task performance analyses. Therefore, dual-action requirements in the present dual-task setting are mentally represented in a compositional, Structuralist fashion, probably due to low between-task dimensional overlap.

Bodily Illusions and Motor Imagery in Fibromyalgia.

Fibromyalgia (FM) is characterised by chronic, continuous, widespread pain, often associated with a sense of fatigue, non-restorative sleep and physical exhaustion. Due to the nature of this condition and the absence of other neurological issues potentially able to induce disorders in body representations per se, it represents a perfect model since it provides an opportunity to study the relationship between pain and the bodily self. Corporeal illusions were investigated in 60 participants with or without a diagnosis of FM by means of an ad hoc devised interview. In addition, motor imagery was investigated and illusions relating to body part movements and changes in body size, feelings of alienness, and sensations of body parts not belonging to one's own body (disownership and somatoparaphrenic-like sensations) were found. Crucially, these symptoms do not correlate with any of the clinical measures of pain or functional deficits. The results showed that motor imagery was also impaired, and the severity of the deficits found correlated with the functional impairment of the participant. This indicates that disorders in body representations and motor imagery are part of the clinical expression of FM. However, while motor imagery seems to be linked to reduced autonomy and functional deficits, bodily illusions are independent and potentially represent a concurrent symptom.

To prevent means to know: Explicit but no implicit agency for prevention behavior.

Human agents draw on a variety of explicit and implicit cues to construct a sense of agency for their actions and the effects of these actions on the outside world. Associative mechanisms binding actions to their immediate effects support the evolution of agency for operant actions. However, human agents often also act to prevent a certain event from occurring. Such prevention behavior poses a critical challenge for the sense of agency, as successful prevention inherently revolves around the absence of a perceivable effect. By assessing the psychological microstructure of singular operant and prevention actions we show that this comes with profound consequences: agency for prevention actions is only evident in explicit measures but not in corresponding implicit proxies. These findings attest to an altered action representation in prevention behavior and they support recent proposals to model related processes such as avoidance learning in terms of propositional rather than associative terms.

Dance and Parkinson's: A review and exploration of the role of cognitive representations of action.

Parkinson's disease (PD) is a neurodegenerative condition that causes both sensorimotor and non-motor impairments, and there is a clear need for non-medical approaches to improve quality of life. Dance is an increasingly popular activity among people with PD, which demonstrates potential therapeutic benefits. However, findings to date have been inconsistent, and little is known about the mechanisms underlying benefits of dance in PD. In this review, we provide an overview of research into dance for people with PD. The majority of quantitative evidence is in the sensorimotor domain, but cognitive, psychological and social effects have also been reported. We consider the role of cognitive representations of action within dance through observation, imitation and imagery, which may contribute to both sensorimotor and non-motor outcomes for people with PD. Moreover, we discuss how these processes may be enhanced through dance to provide further benefits in everyday life. Finally, we propose avenues for future research to increase understanding of action representation in dance for PD, which has the potential to inform practice and maximize benefits.