Stable readout of observed actions from format-dependent activity of monkey's anterior intraparietal neurons.

Humans accurately identify observed actions despite large dynamic changes in their retinal images and a variety of visual presentation formats. A large network of brain regions in primates participates in the processing of others' actions, with the anterior intraparietal area (AIP) playing a major role in routing information about observed manipulative actions (OMAs) to the other nodes of the network. This study investigated whether the AIP also contributes to invariant coding of OMAs across different visual formats. We recorded AIP neuronal activity from two macaques while they observed videos portraying seven manipulative actions (drag, drop, grasp, push, roll, rotate, squeeze) in four visual formats. Each format resulted from the combination of two actor's body postures (standing, sitting) and two viewpoints (lateral, frontal). Out of 297 recorded units, 38% were OMA-selective in at least one format. Robust population code for viewpoint and actor's body posture emerged shortly after stimulus presentation, followed by OMA selectivity. Although we found no fully invariant OMA-selective neuron, we discovered a population code that allowed us to classify action exemplars irrespective of the visual format. This code depends on a multiplicative mixing of signals about OMA identity and visual format, particularly evidenced by a set of units maintaining a relatively stable OMA selectivity across formats despite considerable rescaling of their firing rate depending on the visual specificities of each format. These findings suggest that the AIP integrates format-dependent information and the visual features of others' actions, leading to a stable readout of observed manipulative action identity.

Agent-based representations of objects and actions in the monkey pre-supplementary motor area.

Information about objects around us is essential for planning actions and for predicting those of others. Here, we studied pre-supplementary motor area F6 neurons with a task in which monkeys viewed and grasped (or refrained from grasping) objects, and then observed a human doing the same task. We found "action-related neurons" encoding selectively monkey's own action [self-type (ST)], another agent's action [other-type (OT)], or both [self- and other-type (SOT)]. Interestingly, we found "object-related neurons" exhibiting the same type of selectivity before action onset: Indeed, distinct sets of neurons discharged when visually presented objects were targeted by the monkey's own action (ST), another agent's action (OT), or both (SOT). Notably, object-related neurons appear to signal self and other's intention to grasp and the most likely grip type that will be performed, whereas action-related neurons encode a general goal attainment signal devoid of any specificity for the observed grip type. Time-resolved cross-modal population decoding revealed that F6 neurons first integrate information about object and context to generate an agent-shared signal specifying whether and how the object will be grasped, which progressively turns into a broader agent-based goal attainment signal during action unfolding. Importantly, shared representation of objects critically depends upon their location in the observer's peripersonal space, suggesting an "object-mirroring" mechanism through which observers could accurately predict others' impending action by recruiting the same motor representation they would activate if they were to act upon the same object in the same context.

Anterior Intraparietal Area: A Hub in the Observed Manipulative Action Network.

Current knowledge regarding the processing of observed manipulative actions (OMAs) (e.g., grasping, dragging, or dropping) is limited to grasping and underlying neural circuitry remains controversial. Here, we addressed these issues by combining chronic neuronal recordings along the anteroposterior extent of monkeys' anterior intraparietal (AIP) area with tracer injections into the recorded sites. We found robust neural selectivity for 7 distinct OMAs, particularly in the posterior part of AIP (pAIP), where it was associated with motor coding of grip type and own-hand visual feedback. This cluster of functional properties appears to be specifically grounded in stronger direct connections of pAIP with the temporal regions of the ventral visual stream and the prefrontal cortex, as connections with skeletomotor related areas and regions of the dorsal visual stream exhibited opposite or no rostrocaudal gradients. Temporal and prefrontal areas may provide visual and contextual information relevant for manipulative action processing. These results revise existing models of the action observation network, suggesting that pAIP constitutes a parietal hub for routing information about OMA identity to the other nodes of the network.

Extending the Cortical Grasping Network: Pre-supplementary Motor Neuron Activity During Vision and Grasping of Objects.

Grasping relies on a network of parieto-frontal areas lying on the dorsolateral and dorsomedial parts of the hemispheres. However, the initiation and sequencing of voluntary actions also requires the contribution of mesial premotor regions, particularly the pre-supplementary motor area F6. We recorded 233 F6 neurons from 2 monkeys with chronic linear multishank neural probes during reaching-grasping visuomotor tasks. We showed that F6 neurons play a role in the control of forelimb movements and some of them (26%) exhibit visual and/or motor specificity for the target object. Interestingly, area F6 neurons form 2 functionally distinct populations, showing either visually-triggered or movement-related bursts of activity, in contrast to the sustained visual-to-motor activity displayed by ventral premotor area F5 neurons recorded in the same animals and with the same task during previous studies. These findings suggest that F6 plays a role in object grasping and extend existing models of the cortical grasping network.

Processing of Own Hand Visual Feedback during Object Grasping in Ventral Premotor Mirror Neurons.

Mirror neurons (MNs) discharge during action execution as well as during observation of others' actions. Our own actions are those that we have the opportunity to observe more frequently, but no study thus far to our knowledge has addressed the issue of whether, and to what extent, MNs can code own hand visual feedback (HVF) during object grasping. Here, we show that MNs of the ventral premotor area F5 of macaque monkeys are particularly sensitive to HVF relative to non-MNs simultaneously recorded in the same penetrations. Importantly, the HVF effect is more evident on MN activity during hand-object interaction than during the hand-shaping phase. Furthermore, the increase of MN activity induced by HVF and others' actions observed from a subjective perspective were positively correlated. These findings indicate that at least part of ventral premotor MNs can process the visual information coming from own hand interacting with objects, likely playing a role in self-action monitoring. SIGNIFICANCE STATEMENT: We show that mirror neurons (MNs) of area F5 of the macaque, in addition to encoding others' observed actions, are particularly sensitive, relative to simultaneously recorded non-MNs, to the sight of the monkey's own hand during object grasping, likely playing a role in self-action monitoring.

Mirror neuron activation prior to action observation in a predictable context.

A fundamental capacity of social animals consists in the predictive representation of upcoming events in the outside world, such as the actions of others. Here, we tested the activity of ventral premotor area F5 mirror neurons (MNs) while monkeys observed an experimenter performing (Action condition) or withholding (Inaction condition) a grasping action, which could be predicted on the basis of previously presented auditory instructions. Many of the recorded MNs discharged only during action observation (Action MNs), but one-third also encoded the experimenter's withheld action (Inaction MNs). Interestingly, while most of Action MNs exhibited reactive discharge during action observation, becoming active after the go signal, the majority of Inaction MNs showed predictive discharge. MN population activity as a whole displayed an overall predictive activation pattern, becoming active, on average, 340 ms before the go signal. Furthermore, MNs became active earlier when the observed action was performed in the monkeys' extrapersonal rather than peripersonal space, suggesting that context-based neural prediction of others' actions plays different roles depending on the monkeys' ability to interact with the observed agent.

Space-dependent representation of objects and other's action in monkey ventral premotor grasping neurons.

The macaque ventral premotor area F5 hosts two types of visuomotor grasping neurons: "canonical" neurons, which respond to visually presented objects and underlie visuomotor transformation for grasping, and "mirror" neurons, which respond during the observation of others' action, likely playing a role in action understanding. Some previous evidence suggested that canonical and mirror neurons could be anatomically segregated in different sectors of area F5. Here we investigated the functional properties of single neurons in the hand field of area F5 using various tasks similar to those originally designed to investigate visual responses to objects and actions. By using linear multielectrode probes, we were able to simultaneously record different types of neurons and to precisely localize their cortical depth. We recorded 464 neurons, of which 243 showed visuomotor properties. Canonical and mirror neurons were often present in the same cortical sites; and, most interestingly, a set of neurons showed both canonical and mirror properties, discharging to object presentation as well as during the observation of experimenter's goal-directed acts (canonical-mirror neurons). Typically, visual responses to objects were constrained to the monkey peripersonal space, whereas action observation responses were less space-selective. Control experiments showed that space-constrained coding of objects mostly relies on an operational (action possibility) rather than metric (absolute distance) reference frame. Interestingly, canonical-mirror neurons appear to code object as target for both one's own and other's action, suggesting that they could play a role in predictive representation of others' impending actions.

The Representation of Decision Variables in Orbitofrontal Cortex is Longitudinally Stable.

The computation and comparison of subjective values underlying economic choices rely on the orbitofrontal cortex (OFC). In this area, distinct groups of neurons encode the value of individual options, the binary choice outcome, and the chosen value. These variables capture both the input and the output of the choice process, suggesting that the cell groups found in OFC constitute the building blocks of a decision circuit. Here we show that this neural circuit is longitudinally stable. Using two-photon calcium imaging, we recorded from mice choosing between different juice flavors. Recordings of individual cells continued for up to 20 weeks. For each cell and each pair of sessions, we compared the activity profiles using cosine similarity, and we assessed whether the cell encoded the same variable in both sessions. These analyses revealed a high degree of stability and a modest representational drift. A quantitative estimate indicated this drift would not randomize the circuit within the animal's lifetime.

Local and system mechanisms for action execution and observation in parietal and premotor cortices.

The action observation network (AON) includes a system of brain areas largely shared with action execution in both human and nonhuman primates. Yet temporal and tuning specificities of distinct areas and of physiologically identified neuronal classes in the encoding of self and others' action remain unknown. We recorded the activity of 355 single units from three crucial nodes of the AON, the anterior intraparietal area (AIP), and premotor areas F5 and F6, while monkeys performed a Go/No-Go grasping task and observed an experimenter performing it. At the system level, during task execution, F6 displays a prevalence of suppressed neurons and signals whether an action has to be performed, whereas AIP and F5 share a prevalence of facilitated neurons and remarkable target selectivity; during task observation, F5 stands out for its unique prevalence of facilitated neurons and its stronger and earlier modulation than AIP and F6. By applying unsupervised clustering of spike waveforms, we found distinct cell classes unevenly distributed across areas, with different firing properties and carrying specific visuomotor signals. Broadly spiking neurons exhibited a balanced amount of facilitated and suppressed activity during action execution and observation, whereas narrower spiking neurons showed more mutually facilitated responses during the execution of one's own and others' action, particularly in areas AIP and F5. Our findings elucidate the time course of activity and firing properties of neurons in the AON during one's own and others' action, from the system level of anatomically distinct areas to the local level of physiologically distinct cell classes.

Author Correction: Differential neural dynamics underlying pragmatic and semantic affordance processing in macaque ventral premotor cortex.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

Connectional gradients underlie functional transitions in monkey pre-supplementary motor area.

The pre-supplementary motor area F6 is involved in a variety of functions in multiple domains, from planning/withholding goal-directed actions in space to rule-based cognitive processes and social interactions. Yet, the neural machinery underlying this functional heterogeneity remains unclear. Here, we measured local population dynamics in different rostro-caudal sites of cytoarchitectonically verified area F6 in two monkeys during spatial, contextual and motor processes, both in individual and social conditions. Then, we correlated multimodal population tuning with local anatomical connectivity revealed by neural tracer injections into the functionally characterized sites. We found stronger tuning for object position relative to the monkey in the rostral portion of area F6 than in its caudal part, which in turn exhibits stronger tuning to self and other's (observed) action. Functional specificities were associated with a rostro-caudal transition in connectivity strength from lateral prefrontal cortex, pregenual anterior cingulate cortex and associative striatum (rostrally), to dorso-ventral premotor areas and the motor putamen (caudally). These findings suggest that the functional heterogeneity of the pre-supplementary area F6 is accounted for by gradual transitions in functional properties grounded on local cortico-cortical and cortico-striatal connectional specificities.

Differential neural dynamics underling pragmatic and semantic affordance processing in macaque ventral premotor cortex.

Premotor neurons play a fundamental role in transforming physical properties of observed objects, such as size and shape, into motor plans for grasping them, hence contributing to "pragmatic" affordance processing. Premotor neurons can also contribute to "semantic" affordance processing, as they can discharge differently even to pragmatically identical objects depending on their behavioural relevance for the observer (i.e. edible or inedible objects). Here, we compared the response of monkey ventral premotor area F5 neurons tested during pragmatic (PT) or semantic (ST) visuomotor tasks. Object presentation responses in ST showed shorter latency and lower object selectivity than in PT. Furthermore, we found a difference between a transient representation of semantic affordances and a sustained representation of pragmatic affordances at both the single neuron and population level. Indeed, responses in ST returned to baseline within 0.5 s whereas in PT they showed the typical sustained visual-to-motor activity during Go trials. In contrast, during No-go trials, the time course of pragmatic and semantic information processing was similar. These findings suggest that premotor cortex generates different dynamics depending on pragmatic and semantic information provided by the context in which the to-be-grasped object is presented.

Spatial and viewpoint selectivity for others' observed actions in monkey ventral premotor mirror neurons.

The spatial location and viewpoint of observed actions are closely linked in natural social settings. For example, actions observed from a subjective viewpoint necessarily occur within the observer's peripersonal space. Neurophysiological studies have shown that mirror neurons (MNs) of the monkey ventral premotor area F5 can code the spatial location of live observed actions. Furthermore, F5 MN discharge can also be modulated by the viewpoint from which filmed actions are seen. Nonetheless, whether and to what extent MNs can integrate viewpoint and spatial location of live observed actions remains unknown. We addressed this issue by comparing the activity of 148 F5 MNs while macaque monkeys observed an experimenter grasping in three different combinations of viewpoint and spatial location, namely, lateral view in the (1) extrapersonal and (2) peripersonal space and (3) subjective view in the peripersonal space. We found that the majority of MNs were space-selective (60.8%): those selective for the peripersonal space exhibited a preference for the subjective viewpoint both at the single-neuron and population level, whereas space-unselective neurons were view invariant. These findings reveal the existence of a previously neglected link between spatial and viewpoint selectivity in MN activity during live-action observation.

Comparative Performance of Linear Multielectrode Probes and Single-Tip Electrodes for Intracortical Microstimulation and Single-Neuron Recording in Macaque Monkey.

Intracortical microstimulation (ICMS) is one of the most widely employed techniques for providing causal evidence of the relationship between neuronal activity and specific motor, perceptual, or even cognitive functions. In recent years, several new types of linear multielectrode silicon probes have been developed, allowing researchers to sample neuronal activity at different depths along the same cortical site simultaneously and with high spatial precision. Nevertheless, silicon multielectrode probes have been rarely employed for ICMS studies and, more importantly, it is unknown whether and to what extent they can be used for combined recording and stimulation experiments. Here, we addressed these issues during both acute and chronic conditions. First, we compared the behavioral outcomes of ICMS delivered to the hand region of a monkey's motor cortex with multielectrode silicon probes, commercially available multisite stainless-steel probes and single-tip glass-coated tungsten microelectrodes. The results for all three of the probes were reliable and similar. Furthermore, we tested the impact of long-train ICMS delivered through chronically implanted silicon probes at different time intervals, from 1 to 198 days after ICMS sessions, showing that although the number of recorded neurons decreased over time, in line with previous studies, ICMS did not alter silicon probes' recording capabilities. These findings indicate that in ICMS experiments, the performance of linear multielectrode silicon probes is comparable to that of both single-tip and multielectrode stainless-steel probes, suggesting that the silicon probes can be successfully used for combined recording and stimulation studies in chronic conditions.

Ventral premotor neurons encoding representations of action during self and others' inaction.

Our environment offers us a number of opportunities for action. However, sometimes we also have to refrain from acting, for example, when facing a "do not touch" sign placed over a desirable object on the shelf of a shop. Previous findings emphasized the role of mesial frontal and prefrontal regions in the inhibition of stimulus-driven motor responses [1-3], leading to the prediction that motor areas should not become active when one inhibits a motor response. Nevertheless, refraining from performing a specific action might require one to internally represent what one is not doing. Is the motor system simply inhibited in this condition, or does it play an active role in the representation of the withheld action? Here, we show that while the majority of macaque ventral premotor neurons remain silent when the monkey refrains from grasping an object, others, recorded simultaneously with the former, discharge both when the monkey grasps an object ("action") and when it refrains from doing so ("inaction"). The same effect has been shown to be present for mirror neurons [4]. Some of them, besides discharging during action observation, also fire when the observed agent refrains from acting. Notably, neurons discharging during inaction specifically encode either the monkey's own or other's inaction, not both. Our findings indicate that ventral premotor cortex encodes representations of our own or others' action not only when we perform or observe that action but also when its negation is represented.

Application of floating silicon-based linear multielectrode arrays for acute recording of single neuron activity in awake behaving monkeys.

One of the fundamental challenges in behavioral neurophysiology in awake animals is the steady recording of action potentials of many single neurons for as long as possible. Here, we present single neuron data obtained during acute recordings mainly from premotor cortices of three macaque monkeys using a silicon-based linear multielectrode array. The most important aspect of these probes, compared with similar models commercially available, is that, once inserted into the brain using a dedicated insertion device providing an intermediate probe fixation by means of vacuum, they can be released and left floating in the brain. On the basis of our data, these features appear to provide (i) optimal physiological conditions for extracellular recordings, (ii) good or even excellent signal-to-noise ratio depending on the recorded brain area and cortical layer, and (iii) extreme stability of the signal over relatively long periods. The quality of the recorded signal did not change significantly after several penetrations into the same restricted cortical sector, suggesting limited tissue damage due to probe insertion. These results indicate that these probes offer several advantages for acute neurophysiological experiments in awake monkeys, and suggest the possibility to employ them for semichronic or even chronic studies.