Mixed selectivity in monkey anterior intraparietal area during visual and motor processes.

Classical studies suggest that the anterior intraparietal area (AIP) contributes to the encoding of specific information such as objects and actions of self and others, through a variety of neuronal classes, such as canonical, motor and mirror neurons. However, these studies typically focused on a single variable, leaving it unclear whether distinct sets of AIP neurons encode a single or multiple sources of information and how multimodal coding emerges. Here, we chronically recorded monkey AIP neurons in a variety of tasks and conditions classically employed in separate experiments. Most cells exhibited mixed selectivity for observed objects, executed actions, and observed actions, enhanced when this information came from the monkey's peripersonal working space. In contrast with the classical view, our findings indicate that multimodal coding emerges in AIP from partially-mixed selectivity of individual neurons for a variety of information relevant for planning actions directed to both physical objects and other subjects.

Largely shared neural codes for biological and nonbiological observed movements but not for executed actions in monkey premotor areas.

The neural processing of others' observed actions recruits a large network of brain regions (the action observation network; AON) in which frontal motor areas are thought to play a crucial role. As the discovery of mirror neurons (MNs) in the ventral premotor cortex, it has been assumed that their activation was conditional upon the presentation of biological rather than nonbiological motion stimuli, supporting a form of direct visuomotor matching. Nonetheless, nonbiological observed movements have rarely been used as control stimuli to evaluate visual specificity, thereby leaving the issue of similarity among neural codes for executed actions and biological or nonbiological observed movements unresolved. Here, we addressed this issue by recording from two nodes of the AON that are attracting increasing interest, namely, the ventrorostral part of the dorsal premotor area F2 and the mesial presupplementary motor area F6 of macaques while they 1) executed a reaching-grasping task, 2) observed an experimenter performing the task, and 3) observed a nonbiological effector moving in the same context. Our findings revealed stronger neuronal responses to the observation of biological than nonbiological movement, but biological and nonbiological visual stimuli produced highly similar neural dynamics and relied on largely shared neural codes, which in turn remarkably differed from those associated with executed actions. These results indicate that, in highly familiar contexts, visuomotor remapping processes in premotor areas hosting MNs are more complex and flexible than predicted by a direct visuomotor matching hypothesis.NEW & NOTEWORTHY Pioneering studies on mirror neurons (MNs) in premotor areas emphasized the absence of response to the sight of nonbiological moving objects, suggesting a match between execution and observation activities. This study shows that although premotor neurons can discriminate between biological and nonbiological observed movements, these visual stimuli rely on largely shared neural codes, which differ strongly from those associated with executed actions.

Local and system mechanisms for action execution and observation in parietal and premotor cortices.

The action observation network (AON) includes a system of brain areas largely shared with action execution in both human and nonhuman primates. Yet temporal and tuning specificities of distinct areas and of physiologically identified neuronal classes in the encoding of self and others' action remain unknown. We recorded the activity of 355 single units from three crucial nodes of the AON, the anterior intraparietal area (AIP), and premotor areas F5 and F6, while monkeys performed a Go/No-Go grasping task and observed an experimenter performing it. At the system level, during task execution, F6 displays a prevalence of suppressed neurons and signals whether an action has to be performed, whereas AIP and F5 share a prevalence of facilitated neurons and remarkable target selectivity; during task observation, F5 stands out for its unique prevalence of facilitated neurons and its stronger and earlier modulation than AIP and F6. By applying unsupervised clustering of spike waveforms, we found distinct cell classes unevenly distributed across areas, with different firing properties and carrying specific visuomotor signals. Broadly spiking neurons exhibited a balanced amount of facilitated and suppressed activity during action execution and observation, whereas narrower spiking neurons showed more mutually facilitated responses during the execution of one's own and others' action, particularly in areas AIP and F5. Our findings elucidate the time course of activity and firing properties of neurons in the AON during one's own and others' action, from the system level of anatomically distinct areas to the local level of physiologically distinct cell classes.

Stable readout of observed actions from format-dependent activity of monkey's anterior intraparietal neurons.

Humans accurately identify observed actions despite large dynamic changes in their retinal images and a variety of visual presentation formats. A large network of brain regions in primates participates in the processing of others' actions, with the anterior intraparietal area (AIP) playing a major role in routing information about observed manipulative actions (OMAs) to the other nodes of the network. This study investigated whether the AIP also contributes to invariant coding of OMAs across different visual formats. We recorded AIP neuronal activity from two macaques while they observed videos portraying seven manipulative actions (drag, drop, grasp, push, roll, rotate, squeeze) in four visual formats. Each format resulted from the combination of two actor's body postures (standing, sitting) and two viewpoints (lateral, frontal). Out of 297 recorded units, 38% were OMA-selective in at least one format. Robust population code for viewpoint and actor's body posture emerged shortly after stimulus presentation, followed by OMA selectivity. Although we found no fully invariant OMA-selective neuron, we discovered a population code that allowed us to classify action exemplars irrespective of the visual format. This code depends on a multiplicative mixing of signals about OMA identity and visual format, particularly evidenced by a set of units maintaining a relatively stable OMA selectivity across formats despite considerable rescaling of their firing rate depending on the visual specificities of each format. These findings suggest that the AIP integrates format-dependent information and the visual features of others' actions, leading to a stable readout of observed manipulative action identity.

Author Correction: Differential neural dynamics underlying pragmatic and semantic affordance processing in macaque ventral premotor cortex.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

Connectional gradients underlie functional transitions in monkey pre-supplementary motor area.

The pre-supplementary motor area F6 is involved in a variety of functions in multiple domains, from planning/withholding goal-directed actions in space to rule-based cognitive processes and social interactions. Yet, the neural machinery underlying this functional heterogeneity remains unclear. Here, we measured local population dynamics in different rostro-caudal sites of cytoarchitectonically verified area F6 in two monkeys during spatial, contextual and motor processes, both in individual and social conditions. Then, we correlated multimodal population tuning with local anatomical connectivity revealed by neural tracer injections into the functionally characterized sites. We found stronger tuning for object position relative to the monkey in the rostral portion of area F6 than in its caudal part, which in turn exhibits stronger tuning to self and other's (observed) action. Functional specificities were associated with a rostro-caudal transition in connectivity strength from lateral prefrontal cortex, pregenual anterior cingulate cortex and associative striatum (rostrally), to dorso-ventral premotor areas and the motor putamen (caudally). These findings suggest that the functional heterogeneity of the pre-supplementary area F6 is accounted for by gradual transitions in functional properties grounded on local cortico-cortical and cortico-striatal connectional specificities.

Differential neural dynamics underling pragmatic and semantic affordance processing in macaque ventral premotor cortex.

Premotor neurons play a fundamental role in transforming physical properties of observed objects, such as size and shape, into motor plans for grasping them, hence contributing to "pragmatic" affordance processing. Premotor neurons can also contribute to "semantic" affordance processing, as they can discharge differently even to pragmatically identical objects depending on their behavioural relevance for the observer (i.e. edible or inedible objects). Here, we compared the response of monkey ventral premotor area F5 neurons tested during pragmatic (PT) or semantic (ST) visuomotor tasks. Object presentation responses in ST showed shorter latency and lower object selectivity than in PT. Furthermore, we found a difference between a transient representation of semantic affordances and a sustained representation of pragmatic affordances at both the single neuron and population level. Indeed, responses in ST returned to baseline within 0.5 s whereas in PT they showed the typical sustained visual-to-motor activity during Go trials. In contrast, during No-go trials, the time course of pragmatic and semantic information processing was similar. These findings suggest that premotor cortex generates different dynamics depending on pragmatic and semantic information provided by the context in which the to-be-grasped object is presented.

Anterior Intraparietal Area: A Hub in the Observed Manipulative Action Network.

Current knowledge regarding the processing of observed manipulative actions (OMAs) (e.g., grasping, dragging, or dropping) is limited to grasping and underlying neural circuitry remains controversial. Here, we addressed these issues by combining chronic neuronal recordings along the anteroposterior extent of monkeys' anterior intraparietal (AIP) area with tracer injections into the recorded sites. We found robust neural selectivity for 7 distinct OMAs, particularly in the posterior part of AIP (pAIP), where it was associated with motor coding of grip type and own-hand visual feedback. This cluster of functional properties appears to be specifically grounded in stronger direct connections of pAIP with the temporal regions of the ventral visual stream and the prefrontal cortex, as connections with skeletomotor related areas and regions of the dorsal visual stream exhibited opposite or no rostrocaudal gradients. Temporal and prefrontal areas may provide visual and contextual information relevant for manipulative action processing. These results revise existing models of the action observation network, suggesting that pAIP constitutes a parietal hub for routing information about OMA identity to the other nodes of the network.

Agent-based representations of objects and actions in the monkey pre-supplementary motor area.

Information about objects around us is essential for planning actions and for predicting those of others. Here, we studied pre-supplementary motor area F6 neurons with a task in which monkeys viewed and grasped (or refrained from grasping) objects, and then observed a human doing the same task. We found "action-related neurons" encoding selectively monkey's own action [self-type (ST)], another agent's action [other-type (OT)], or both [self- and other-type (SOT)]. Interestingly, we found "object-related neurons" exhibiting the same type of selectivity before action onset: Indeed, distinct sets of neurons discharged when visually presented objects were targeted by the monkey's own action (ST), another agent's action (OT), or both (SOT). Notably, object-related neurons appear to signal self and other's intention to grasp and the most likely grip type that will be performed, whereas action-related neurons encode a general goal attainment signal devoid of any specificity for the observed grip type. Time-resolved cross-modal population decoding revealed that F6 neurons first integrate information about object and context to generate an agent-shared signal specifying whether and how the object will be grasped, which progressively turns into a broader agent-based goal attainment signal during action unfolding. Importantly, shared representation of objects critically depends upon their location in the observer's peripersonal space, suggesting an "object-mirroring" mechanism through which observers could accurately predict others' impending action by recruiting the same motor representation they would activate if they were to act upon the same object in the same context.

Cortical and subcortical connections of parietal and premotor nodes of the monkey hand mirror neuron network.

Mirror neurons (MNs) are a class of cells originally discovered in the monkey ventral premotor cortex (PMv) and inferior parietal lobule (IPL). They discharge during both action execution and action observation and appear to play a crucial role in understanding others' actions. It has been proposed that the mirror mechanism is based on a match between the visual description of actions, encoded in temporal cortical regions, and their motor representation, provided by PMv and IPL. However, neurons responding to action observation have been recently found in other cortical regions, suggesting that the mirror mechanism relies on a wider network. Here we provide the first description of this network by injecting neural tracers into physiologically identified IPL and PMv sectors containing hand MNs. Our results show that these sectors are reciprocally connected, in line with the current view, but IPL MN sectors showed virtually no direct connection with temporal visual areas. In addition, we found that PMv and IPL MN sectors share connections with several cortical regions, including the dorsal and mesial premotor cortex, the primary motor cortex, the secondary somatosensory cortex, the mid-dorsal insula and the ventrolateral prefrontal cortex, as well as subcortical structures, such as motor and polysensory thalamic nuclei and the mid-dorsal claustrum. We propose that each of these regions constitutes a node of an "extended network", through which information relative to ongoing movements, social context, environmental contingencies, abstract rules, and internal states can influence MN activity and contribute to several socio-cognitive functions.

Comparative Performance of Linear Multielectrode Probes and Single-Tip Electrodes for Intracortical Microstimulation and Single-Neuron Recording in Macaque Monkey.

Intracortical microstimulation (ICMS) is one of the most widely employed techniques for providing causal evidence of the relationship between neuronal activity and specific motor, perceptual, or even cognitive functions. In recent years, several new types of linear multielectrode silicon probes have been developed, allowing researchers to sample neuronal activity at different depths along the same cortical site simultaneously and with high spatial precision. Nevertheless, silicon multielectrode probes have been rarely employed for ICMS studies and, more importantly, it is unknown whether and to what extent they can be used for combined recording and stimulation experiments. Here, we addressed these issues during both acute and chronic conditions. First, we compared the behavioral outcomes of ICMS delivered to the hand region of a monkey's motor cortex with multielectrode silicon probes, commercially available multisite stainless-steel probes and single-tip glass-coated tungsten microelectrodes. The results for all three of the probes were reliable and similar. Furthermore, we tested the impact of long-train ICMS delivered through chronically implanted silicon probes at different time intervals, from 1 to 198 days after ICMS sessions, showing that although the number of recorded neurons decreased over time, in line with previous studies, ICMS did not alter silicon probes' recording capabilities. These findings indicate that in ICMS experiments, the performance of linear multielectrode silicon probes is comparable to that of both single-tip and multielectrode stainless-steel probes, suggesting that the silicon probes can be successfully used for combined recording and stimulation studies in chronic conditions.

Spatial and viewpoint selectivity for others' observed actions in monkey ventral premotor mirror neurons.

The spatial location and viewpoint of observed actions are closely linked in natural social settings. For example, actions observed from a subjective viewpoint necessarily occur within the observer's peripersonal space. Neurophysiological studies have shown that mirror neurons (MNs) of the monkey ventral premotor area F5 can code the spatial location of live observed actions. Furthermore, F5 MN discharge can also be modulated by the viewpoint from which filmed actions are seen. Nonetheless, whether and to what extent MNs can integrate viewpoint and spatial location of live observed actions remains unknown. We addressed this issue by comparing the activity of 148 F5 MNs while macaque monkeys observed an experimenter grasping in three different combinations of viewpoint and spatial location, namely, lateral view in the (1) extrapersonal and (2) peripersonal space and (3) subjective view in the peripersonal space. We found that the majority of MNs were space-selective (60.8%): those selective for the peripersonal space exhibited a preference for the subjective viewpoint both at the single-neuron and population level, whereas space-unselective neurons were view invariant. These findings reveal the existence of a previously neglected link between spatial and viewpoint selectivity in MN activity during live-action observation.

Extending the Cortical Grasping Network: Pre-supplementary Motor Neuron Activity During Vision and Grasping of Objects.

Grasping relies on a network of parieto-frontal areas lying on the dorsolateral and dorsomedial parts of the hemispheres. However, the initiation and sequencing of voluntary actions also requires the contribution of mesial premotor regions, particularly the pre-supplementary motor area F6. We recorded 233 F6 neurons from 2 monkeys with chronic linear multishank neural probes during reaching-grasping visuomotor tasks. We showed that F6 neurons play a role in the control of forelimb movements and some of them (26%) exhibit visual and/or motor specificity for the target object. Interestingly, area F6 neurons form 2 functionally distinct populations, showing either visually-triggered or movement-related bursts of activity, in contrast to the sustained visual-to-motor activity displayed by ventral premotor area F5 neurons recorded in the same animals and with the same task during previous studies. These findings suggest that F6 plays a role in object grasping and extend existing models of the cortical grasping network.

Processing of Own Hand Visual Feedback during Object Grasping in Ventral Premotor Mirror Neurons.

Mirror neurons (MNs) discharge during action execution as well as during observation of others' actions. Our own actions are those that we have the opportunity to observe more frequently, but no study thus far to our knowledge has addressed the issue of whether, and to what extent, MNs can code own hand visual feedback (HVF) during object grasping. Here, we show that MNs of the ventral premotor area F5 of macaque monkeys are particularly sensitive to HVF relative to non-MNs simultaneously recorded in the same penetrations. Importantly, the HVF effect is more evident on MN activity during hand-object interaction than during the hand-shaping phase. Furthermore, the increase of MN activity induced by HVF and others' actions observed from a subjective perspective were positively correlated. These findings indicate that at least part of ventral premotor MNs can process the visual information coming from own hand interacting with objects, likely playing a role in self-action monitoring. SIGNIFICANCE STATEMENT: We show that mirror neurons (MNs) of area F5 of the macaque, in addition to encoding others' observed actions, are particularly sensitive, relative to simultaneously recorded non-MNs, to the sight of the monkey's own hand during object grasping, likely playing a role in self-action monitoring.

Mirror neuron activation prior to action observation in a predictable context.

A fundamental capacity of social animals consists in the predictive representation of upcoming events in the outside world, such as the actions of others. Here, we tested the activity of ventral premotor area F5 mirror neurons (MNs) while monkeys observed an experimenter performing (Action condition) or withholding (Inaction condition) a grasping action, which could be predicted on the basis of previously presented auditory instructions. Many of the recorded MNs discharged only during action observation (Action MNs), but one-third also encoded the experimenter's withheld action (Inaction MNs). Interestingly, while most of Action MNs exhibited reactive discharge during action observation, becoming active after the go signal, the majority of Inaction MNs showed predictive discharge. MN population activity as a whole displayed an overall predictive activation pattern, becoming active, on average, 340 ms before the go signal. Furthermore, MNs became active earlier when the observed action was performed in the monkeys' extrapersonal rather than peripersonal space, suggesting that context-based neural prediction of others' actions plays different roles depending on the monkeys' ability to interact with the observed agent.

Ventral premotor neurons encoding representations of action during self and others' inaction.

Our environment offers us a number of opportunities for action. However, sometimes we also have to refrain from acting, for example, when facing a "do not touch" sign placed over a desirable object on the shelf of a shop. Previous findings emphasized the role of mesial frontal and prefrontal regions in the inhibition of stimulus-driven motor responses [1-3], leading to the prediction that motor areas should not become active when one inhibits a motor response. Nevertheless, refraining from performing a specific action might require one to internally represent what one is not doing. Is the motor system simply inhibited in this condition, or does it play an active role in the representation of the withheld action? Here, we show that while the majority of macaque ventral premotor neurons remain silent when the monkey refrains from grasping an object, others, recorded simultaneously with the former, discharge both when the monkey grasps an object ("action") and when it refrains from doing so ("inaction"). The same effect has been shown to be present for mirror neurons [4]. Some of them, besides discharging during action observation, also fire when the observed agent refrains from acting. Notably, neurons discharging during inaction specifically encode either the monkey's own or other's inaction, not both. Our findings indicate that ventral premotor cortex encodes representations of our own or others' action not only when we perform or observe that action but also when its negation is represented.

Cortical processing of object affordances for self and others' action.

The perception of objects does not rely only on visual brain areas, but also involves cortical motor regions. In particular, different parietal and premotor areas host neurons discharging during both object observation and grasping. Most of these cells often show similar visual and motor selectivity for a specific object (or set of objects), suggesting that they might play a crucial role in representing the "potential motor act" afforded by the object. The existence of such a mechanism for the visuomotor transformation of object physical properties in the most appropriate motor plan for interacting with them has been convincingly demonstrated in humans as well. Interestingly, human studies have shown that visually presented objects can automatically trigger the representation of an action provided that they are located within the observer's reaching space (peripersonal space). The "affordance effect" also occurs when the presented object is outside the observer's peripersonal space, but inside the peripersonal space of an observed agent. These findings recently received direct support by single neuron studies in monkey, indicating that space-constrained processing of objects in the ventral premotor cortex might be relevant to represent objects as potential targets for one's own or others' action.

Space-dependent representation of objects and other's action in monkey ventral premotor grasping neurons.

The macaque ventral premotor area F5 hosts two types of visuomotor grasping neurons: "canonical" neurons, which respond to visually presented objects and underlie visuomotor transformation for grasping, and "mirror" neurons, which respond during the observation of others' action, likely playing a role in action understanding. Some previous evidence suggested that canonical and mirror neurons could be anatomically segregated in different sectors of area F5. Here we investigated the functional properties of single neurons in the hand field of area F5 using various tasks similar to those originally designed to investigate visual responses to objects and actions. By using linear multielectrode probes, we were able to simultaneously record different types of neurons and to precisely localize their cortical depth. We recorded 464 neurons, of which 243 showed visuomotor properties. Canonical and mirror neurons were often present in the same cortical sites; and, most interestingly, a set of neurons showed both canonical and mirror properties, discharging to object presentation as well as during the observation of experimenter's goal-directed acts (canonical-mirror neurons). Typically, visual responses to objects were constrained to the monkey peripersonal space, whereas action observation responses were less space-selective. Control experiments showed that space-constrained coding of objects mostly relies on an operational (action possibility) rather than metric (absolute distance) reference frame. Interestingly, canonical-mirror neurons appear to code object as target for both one's own and other's action, suggesting that they could play a role in predictive representation of others' impending actions.