Representation of the observer's predicted outcome value in mirror and nonmirror neurons of macaque F5 ventral premotor cortex.

In the search for the function of mirror neurons, a previous study reported that F5 mirror neuron responses are modulated by the value that the observing monkey associates with the grasped object. Yet we do not know whether mirror neurons are modulated by the expected reward value for the observer or also by other variables, which are causally dependent on value (e.g., motivation, attention directed at the observed action, arousal). To clarify this, we trained two rhesus macaques to observe a grasping action on an object kept constant, followed by four fully predictable outcomes of different values (2 outcomes with positive and 2 with negative emotional valence). We found a consistent order in population activity of both mirror and nonmirror neurons that matches the order of the value of this predicted outcome but that does not match the order of the above-mentioned value-dependent variables. These variables were inferred from the probability not to abort a trial, saccade latency, modulation of eye position during action observation, heart rate, and pupil size. Moreover, we found subpopulations of neurons tuned to each of the four predicted outcome values. Multidimensional scaling revealed equal normalized distances of 0.25 between the two positive and between the two negative outcomes suggesting the representation of a relative value, scaled to the task setting. We conclude that F5 mirror neurons and nonmirror neurons represent the observer's predicted outcome value, which in the case of mirror neurons may be transferred to the observed object or action.NEW & NOTEWORTHY Both the populations of F5 mirror neurons and nonmirror neurons represent the predicted value of an outcome resulting from the observation of a grasping action. Value-dependent motivation, arousal, and attention directed at the observed action do not provide a better explanation for this representation. The population activity's metric suggests an optimal scaling of value representation to task setting.

A prosocial function of head-gaze aversion and head-cocking in common marmosets.

Gaze aversion is a behavior adopted by several mammalian and non-mammalian species in response to eye contact, and is usually interpreted as a reaction to a perceived threat. Unlike many other primate species, common marmosets (Callithrix jacchus) are thought to have a high tolerance for direct gaze, barely exhibiting gaze avoidance towards conspecifics and humans. Here we show that this does not hold for marmosets interacting with a familiar experimenter who suddenly establishes eye contact in a playful interaction (peekaboo). Video footage synchronously recorded from the perspective of the marmoset and the experimenter showed that the monkeys consistently alternated between eye contact and head-gaze aversion, and that these responses were often preceded by head-cocking. We hypothesize that this behavioral strategy helps marmosets to temporarily disengage from emotionally overwhelming social stimulation due to sight of another individual's face, in order to prepare for a new round of affiliative face-to-face interactions.

Shape-invariant encoding of dynamic primate facial expressions in human perception.

Dynamic facial expressions are crucial for communication in primates. Due to the difficulty to control shape and dynamics of facial expressions across species, it is unknown how species-specific facial expressions are perceptually encoded and interact with the representation of facial shape. While popular neural network models predict a joint encoding of facial shape and dynamics, the neuromuscular control of faces evolved more slowly than facial shape, suggesting a separate encoding. To investigate these alternative hypotheses, we developed photo-realistic human and monkey heads that were animated with motion capture data from monkeys and humans. Exact control of expression dynamics was accomplished by a Bayesian machine-learning technique. Consistent with our hypothesis, we found that human observers learned cross-species expressions very quickly, where face dynamics was represented largely independently of facial shape. This result supports the co-evolution of the visual processing and motor control of facial expressions, while it challenges appearance-based neural network theories of dynamic expression recognition.

A Naturalistic Dynamic Monkey Head Avatar Elicits Species-Typical Reactions and Overcomes the Uncanny Valley.

Research on social perception in monkeys may benefit from standardized, controllable, and ethologically valid renditions of conspecifics offered by monkey avatars. However, previous work has cautioned that monkeys, like humans, show an adverse reaction toward realistic synthetic stimuli, known as the "uncanny valley" effect. We developed an improved naturalistic rhesus monkey face avatar capable of producing facial expressions (fear grin, lip smack and threat), animated by motion capture data of real monkeys. For validation, we additionally created decreasingly naturalistic avatar variants. Eight rhesus macaques were tested on the various videos and avoided looking at less naturalistic avatar variants, but not at the most naturalistic or the most unnaturalistic avatar, indicating an uncanny valley effect for the less naturalistic avatar versions. The avoidance was deepened by motion and accompanied by physiological arousal. Only the most naturalistic avatar evoked facial expressions comparable to those toward the real monkey videos. Hence, our findings demonstrate that the uncanny valley reaction in monkeys can be overcome by a highly naturalistic avatar.

Reflexive gaze following in common marmoset monkeys.

The ability to extract the direction of the other's gaze allows us to shift our attention to an object of interest to the other and to establish joint attention. By mapping one's own intentions on the object of joint attention, humans develop a Theory of (the other's) Mind (TOM), a functional sequence possibly disrupted in autism. Gaze following of both humans and old world monkeys is orchestrated by very similar cortical architectures, strongly suggesting homology. Also new world monkeys, a primate suborder that split from the old world monkey line about 35 million years ago, have complex social structures and one member of this group, the common marmosets (Callithrix jacchus) are known to follow human head-gaze. However, the question is if they use gaze following to establish joint attention with conspecifics. Here we show that this is indeed the case. In a free choice task, head-restrained marmosets prefer objects gazed at by a conspecific and, moreover, they exhibit considerably shorter choice reaction times for the same objects. These findings support the assumption of an evolutionarily old domain specific faculty shared within the primate order and they underline the potential value of marmosets in studies of normal and disturbed joint attention.

Modulation of arm reaching movements during processing of arm/hand-related action verbs with and without emotional connotation.

The theory of embodied language states that language comprehension relies on an internal reenactment of the sensorimotor experience associated with the processed word or sentence. Most evidence in support of this hypothesis had been collected using linguistic material without any emotional connotation. For instance, it had been shown that processing of arm-related verbs, but not of those leg-related verbs, affects the planning and execution of reaching movements; however, at present it is unknown whether this effect is further modulated by verbs evoking an emotional experience. Showing such a modulation might shed light on a very debated issue, i.e. the way in which the emotional meaning of a word is processed. To this end, we assessed whether processing arm/hand-related verbs describing actions with negative connotations (e.g. to stab) affects reaching movements differently from arm/hand-related verbs describing actions with neutral connotation (e.g. to comb). We exploited a go/no-go paradigm in which healthy participants were required to perform arm-reaching movements toward a target when verbs expressing emotional hand actions, neutral hand actions or foot actions were shown, and to refrain from moving when no-effector-related verbs were presented. Reaction times and percentages of errors increased when the verb involved the same effector as used to give the response. However, we also found that the size of this interference decreased when the arm/hand-related verbs had a negative emotional connotation. Crucially, we show that such modulation only occurred when the verb semantics had to be retrieved. These results suggest that the comprehension of negatively valenced verbs might require the simultaneous reenactment of the neural circuitry associated with the processing of the emotion evoked by their meaning and of the neural circuitry associated with their motor features.

Processing of hand-related verbs specifically affects the planning and execution of arm reaching movements.

Even though a growing body of research has shown that the processing of action language affects the planning and execution of motor acts, several aspects of this interaction are still hotly debated. The directionality (i.e. does understanding action-related language induce a facilitation or an interference with the corresponding action?), the time course, and the nature of the interaction (i.e. under what conditions does the phenomenon occur?) are largely unclear. To further explore this topic we exploited a go/no-go paradigm in which healthy participants were required to perform arm reaching movements toward a target when verbs expressing either hand or foot actions were shown, and to refrain from moving when abstract verbs were presented. We found that reaction times (RT) and percentages of errors increased when the verb involved the same effector used to give the response. This interference occurred very early, when the interval between verb presentation and the delivery of the go signal was 50 ms, and could be elicited until this delay was about 600 ms. In addition, RTs were faster when subjects used the right arm than when they used the left arm, suggesting that action-verb understanding is left-lateralized. Furthermore, when the color of the printed verb and not its meaning was the cue for movement execution the differences between RTs and error percentages between verb categories disappeared, unequivocally indicating that the phenomenon occurs only when the semantic content of a verb has to be retrieved. These results are compatible with the theory of embodied language, which hypothesizes that comprehending verbal descriptions of actions relies on an internal simulation of the sensory-motor experience of the action, and provide a new and detailed view of the interplay between action language and motor acts.