Propagating spatiotemporal activity patterns across macaque motor cortex carry kinematic information.

Propagating spatiotemporal neural patterns are widely evident across sensory, motor, and association cortical areas. However, it remains unclear whether any characteristics of neural propagation carry information about specific behavioral details. Here, we provide the first evidence for a link between the direction of cortical propagation and specific behavioral features of an upcoming movement on a trial-by-trial basis. We recorded local field potentials (LFPs) from multielectrode arrays implanted in the primary motor cortex of two rhesus macaque monkeys while they performed a 2D reach task. Propagating patterns were extracted from the information-rich high-gamma band (200 to 400 Hz) envelopes in the LFP amplitude. We found that the exact direction of propagating patterns varied systematically according to initial movement direction, enabling kinematic predictions. Furthermore, characteristics of these propagation patterns provided additional predictive capability beyond the LFP amplitude themselves, which suggests the value of including mesoscopic spatiotemporal characteristics in refining brain-machine interfaces.

Biomechanical and Cortical Control of Tongue Movements During Chewing and Swallowing.

Tongue function is vital for chewing and swallowing and lingual dysfunction is often associated with dysphagia. Better treatment of dysphagia depends on a better understanding of hyolingual morphology, biomechanics, and neural control in humans and animal models. Recent research has revealed significant variation among animal models in morphology of the hyoid chain and suprahyoid muscles which may be associated with variation in swallowing mechanisms. The recent deployment of XROMM (X-ray Reconstruction of Moving Morphology) to quantify 3D hyolingual kinematics has revealed new details on flexion and roll of the tongue during chewing in animal models, movements similar to those used by humans. XROMM-based studies of swallowing in macaques have falsified traditional hypotheses of mechanisms of tongue base retraction during swallowing, and literature review suggests that other animal models may employ a diversity of mechanisms of tongue base retraction. There is variation among animal models in distribution of hyolingual proprioceptors but how that might be related to lingual mechanics is unknown. In macaque monkeys, tongue kinematics-shape and movement-are strongly encoded in neural activity in orofacial primary motor cortex, giving optimism for development of brain-machine interfaces for assisting recovery of lingual function after stroke. However, more research on hyolingual biomechanics and control is needed for technologies interfacing the nervous system with the hyolingual apparatus to become a reality.

Validating markerless pose estimation with 3D X-ray radiography.

To reveal the neurophysiological underpinnings of natural movement, neural recordings must be paired with accurate tracking of limbs and postures. Here, we evaluated the accuracy of DeepLabCut (DLC), a deep learning markerless motion capture approach, by comparing it with a 3D X-ray video radiography system that tracks markers placed under the skin (XROMM). We recorded behavioral data simultaneously with XROMM and RGB video as marmosets foraged and reconstructed 3D kinematics in a common coordinate system. We used the toolkit Anipose to filter and triangulate DLC trajectories of 11 markers on the forelimb and torso and found a low median error (0.228 cm) between the two modalities corresponding to 2.0% of the range of motion. For studies allowing this relatively small error, DLC and similar markerless pose estimation tools enable the study of increasingly naturalistic behaviors in many fields including non-human primate motor control.

Loss of oral sensation impairs feeding performance and consistency of tongue-jaw coordination.

BACKGROUND: Individuals with impaired oral sensation report difficulty chewing, but little is known about the underlying changes to tongue and jaw kinematics. Methodological challenges impede the measurement of 3D tongue movement and its relationship to the gape cycle. OBJECTIVE: The aim of this study was to quantify the impact of loss of oral somatosensation on feeding performance, 3D tongue kinematics and tongue-jaw coordination. METHODOLOGY: XROMM (X-ray Reconstruction of Moving Morphology) was used to quantify 3D tongue and jaw kinematics during feeding in three rhesus macaques (Macaca mulatta) before and after an oral tactile nerve block. Feeding performance was measured using feeding sequence duration, number of manipulation cycles and swallow frequency. Coordination was measured using event- and correlation-based metrics of jaw pitch, anterior tongue length, width and roll. RESULTS: In the absence of tactile sensation to the tongue and other oral structures, feeding performance decreased, and the fast open phase of the gape cycle became significantly longer, relative to the other phases (p < .05). The tongue made similar shapes in both the control and nerve block conditions, but the pattern of tongue-jaw coordination became significantly more variable after the block (p < .05). CONCLUSION: Disruption of oral somatosensation impacts feeding performance by introducing variability into the typically tight pattern of tongue-jaw coordination.

Nonmonotonic spatial structure of interneuronal correlations in prefrontal microcircuits.

Correlated fluctuations of single neuron discharges, on a mesoscopic scale, decrease as a function of lateral distance in early sensory cortices, reflecting a rapid spatial decay of lateral connection probability and excitation. However, spatial periodicities in horizontal connectivity and associational input as well as an enhanced probability of lateral excitatory connections in the association cortex could theoretically result in nonmonotonic correlation structures. Here, we show such a spatially nonmonotonic correlation structure, characterized by significantly positive long-range correlations, in the inferior convexity of the macaque prefrontal cortex. This functional connectivity kernel was more pronounced during wakefulness than anesthesia and could be largely attributed to the spatial pattern of correlated variability between functionally similar neurons during structured visual stimulation. These results suggest that the spatial decay of lateral functional connectivity is not a common organizational principle of neocortical microcircuits. A nonmonotonic correlation structure could reflect a critical topological feature of prefrontal microcircuits, facilitating their role in integrative processes.

A platform for semiautomated voluntary training of common marmosets for behavioral neuroscience.

Generally behavioral neuroscience studies of the common marmoset employ adaptations of well-established training methods used with macaque monkeys. However, in many cases these approaches do not readily generalize to marmosets indicating a need for alternatives. Here we present the development of one such alternate: a platform for semiautomated, voluntary in-home cage behavioral training that allows for the study of naturalistic behaviors. We describe the design and production of a modular behavioral training apparatus using CAD software and digital fabrication. We demonstrate that this apparatus permits voluntary behavioral training and data collection throughout the marmoset's waking hours with little experimenter intervention. Furthermore, we demonstrate the use of this apparatus to reconstruct the kinematics of the marmoset's upper limb movement during natural foraging behavior.NEW & NOTEWORTHY The study of marmosets in neuroscience has grown rapidly and presents unique challenges. We address those challenges with an innovative platform for semiautomated, voluntary training that allows marmosets to train throughout their waking hours with minimal experimenter intervention. We describe the use of this platform to capture upper limb kinematics during foraging and to expand the opportunities for behavioral training beyond the limits of traditional training sessions. This flexible platform can easily incorporate other tasks.

Integrating XMALab and DeepLabCut for high-throughput XROMM.

Marker tracking is a major bottleneck in studies involving X-ray reconstruction of moving morphology (XROMM). Here, we tested whether DeepLabCut, a new deep learning package built for markerless tracking, could be applied to videoradiographic data to improve data processing throughput. Our novel workflow integrates XMALab, the existing XROMM marker tracking software, and DeepLabCut while retaining each program's utility. XMALab is used for generating training datasets, error correction and 3D reconstruction, whereas the majority of marker tracking is transferred to DeepLabCut for automatic batch processing. In the two case studies that involved an in vivo behavior, our workflow achieved a 6 to 13-fold increase in data throughput. In the third case study, which involved an acyclic, post-mortem manipulation, DeepLabCut struggled to generalize to the range of novel poses and did not surpass the throughput of XMALab alone. Deployed in the proper context, this new workflow facilitates large scale XROMM studies that were previously precluded by software constraints.

Movement Decomposition in the Primary Motor Cortex.

A complex action can be described as the composition of a set of elementary movements. While both kinematic and dynamic elements have been proposed to compose complex actions, the structure of movement decomposition and its neural representation remain unknown. Here, we examined movement decomposition by modeling the temporal dynamics of neural populations in the primary motor cortex of macaque monkeys performing forelimb reaching movements. Using a hidden Markov model, we found that global transitions in the neural population activity are associated with a consistent segmentation of the behavioral output into acceleration and deceleration epochs with directional selectivity. Single cells exhibited modulation of firing rates between the kinematic epochs, with abrupt changes in spiking activity timed with the identified transitions. These results reveal distinct encoding of acceleration and deceleration phases at the level of M1, and point to a specific pattern of movement decomposition that arises from the underlying neural activity. A similar approach can be used to probe the structure of movement decomposition in different brain regions, possibly controlling different temporal scales, to reveal the hierarchical structure of movement composition.

Primary motor and sensory cortical areas communicate via spatiotemporally coordinated networks at multiple frequencies.

Skilled movements rely on sensory information to shape optimal motor responses, for which the sensory and motor cortical areas are critical. How these areas interact to mediate sensorimotor integration is largely unknown. Here, we measure intercortical coherence between the orofacial motor (MIo) and somatosensory (SIo) areas of cortex as monkeys learn to generate tongue-protrusive force. We report that coherence between MIo and SIo is reciprocal and that neuroplastic changes in coherence gradually emerge over a few days. These functional networks of coherent spiking and local field potentials exhibit frequency-specific spatiotemporal properties. During force generation, theta coherence (2-6 Hz) is prominent and exhibited by numerous paired signals; before or after force generation, coherence is evident in alpha (6-13 Hz), beta (15-30 Hz), and gamma (30-50 Hz) bands, but the functional networks are smaller and weaker. Unlike coherence in the higher frequency bands, the distribution of the phase at peak theta coherence is bimodal with peaks near 0° and ±180°, suggesting that communication between somatosensory and motor areas is coordinated temporally by the phase of theta coherence. Time-sensitive sensorimotor integration and plasticity may rely on coherence of local and large-scale functional networks for cortical processes to operate at multiple temporal and spatial scales.

High-frequency oscillations in human and monkey neocortex during the wake-sleep cycle.

Beta (ß)- and gamma (γ)-oscillations are present in different cortical areas and are thought to be inhibition-driven, but it is not known if these properties also apply to γ-oscillations in humans. Here, we analyze such oscillations in high-density microelectrode array recordings in human and monkey during the wake-sleep cycle. In these recordings, units were classified as excitatory and inhibitory cells. We find that γ-oscillations in human and ß-oscillations in monkey are characterized by a strong implication of inhibitory neurons, both in terms of their firing rate and their phasic firing with the oscillation cycle. The ß- and γ-waves systematically propagate across the array, with similar velocities, during both wake and sleep. However, only in slow-wave sleep (SWS) ß- and γ-oscillations are associated with highly coherent and functional interactions across several millimeters of the neocortex. This interaction is specifically pronounced between inhibitory cells. These results suggest that inhibitory cells are dominantly involved in the genesis of ß- and γ-oscillations, as well as in the organization of their large-scale coherence in the awake and sleeping brain. The highest oscillation coherence found during SWS suggests that fast oscillations implement a highly coherent reactivation of wake patterns that may support memory consolidation during SWS.

Encoding of Both Reaching and Grasping Kinematics in Dorsal and Ventral Premotor Cortices.

Classically, it has been hypothesized that reach-to-grasp movements arise from two discrete parietofrontal cortical networks. As part of these networks, the dorsal premotor cortex (PMd) has been implicated in the control of reaching movements of the arm, whereas the ventral premotor cortex (PMv) has been associated with the control of grasping movements of the hand. Recent studies have shown that such a strict delineation of function along anatomical boundaries is unlikely, partly because reaching to different locations can alter distal hand kinematics and grasping different objects can affect kinematics of the proximal arm. Here, we used chronically implanted multielectrode arrays to record unit-spiking activity in both PMd and PMv simultaneously while rhesus macaques engaged in a reach-to-grasp task. Generalized linear models were used to predict the spiking activity of cells in both areas as a function of different kinematic parameters, as well as spike history. To account for the influence of reaching on hand kinematics and vice versa, we applied demixed principal components analysis to define kinematics synergies that maximized variance across either different object locations or grip types. We found that single cells in both PMd and PMv encode the kinematics of both reaching and grasping synergies, suggesting that this classical division of reach and grasp in PMd and PMv, respectively, does not accurately reflect the encoding preferences of cells in those areas.SIGNIFICANCE STATEMENT For reach-to-grasp movements, the dorsal premotor cortex (PMd) has been implicated in the control of reaching movements of the arm, whereas the ventral premotor cortex (PMv) has been associated with the control of grasping movements of the hand. We recorded unit-spiking activity in PMd and PMv simultaneously while macaques performed a reach-to-grasp task. We modeled the spiking activity of neurons as a function of kinematic parameters and spike history. We applied demixed principal components analysis to define kinematics synergies. We found that single units in both PMd and PMv encode the kinematics of both reaching and grasping synergies, suggesting that the division of reach and grasp in PMd and PMv, respectively, cannot be made based on their encoding properties.

Emergent coordination underlying learning to reach to grasp with a brain-machine interface.

The development of coordinated reach-to-grasp movement has been well studied in infants and children. However, the role of motor cortex during this development is unclear because it is difficult to study in humans. We took the approach of using a brain-machine interface (BMI) paradigm in rhesus macaques with prior therapeutic amputations to examine the emergence of novel, coordinated reach to grasp. Previous research has shown that after amputation, the cortical area previously involved in the control of the lost limb undergoes reorganization, but prior BMI work has largely relied on finding neurons that already encode specific movement-related information. In this study, we taught macaques to cortically control a robotic arm and hand through operant conditioning, using neurons that were not explicitly reach or grasp related. Over the course of training, stereotypical patterns emerged and stabilized in the cross-covariance between the reaching and grasping velocity profiles, between pairs of neurons involved in controlling reach and grasp, and to a comparable, but lesser, extent between other stable neurons in the network. In fact, we found evidence of this structured coordination between pairs composed of all combinations of neurons decoding reach or grasp and other stable neurons in the network. The degree of and participation in coordination was highly correlated across all pair types. Our approach provides a unique model for studying the development of novel, coordinated reach-to-grasp movement at the behavioral and cortical levels. NEW & NOTEWORTHY Given that motor cortex undergoes reorganization after amputation, our work focuses on training nonhuman primates with chronic amputations to use neurons that are not reach or grasp related to control a robotic arm to reach to grasp through the use of operant conditioning, mimicking early development. We studied the development of a novel, coordinated behavior at the behavioral and cortical level, and the neural plasticity in M1 associated with learning to use a brain-machine interface.

Spatio-Temporal Patterning in Primary Motor Cortex at Movement Onset.

Voluntary movement initiation involves the engagement of large populations of motor cortical neurons around movement onset. Despite knowledge of the temporal dynamics that lead to movement, the spatial structure of these dynamics across the cortical surface remains unknown. In data from 4 rhesus macaques, we show that the timing of attenuation of beta frequency local field potential oscillations, a correlate of locally activated cortex, forms a spatial gradient across primary motor cortex (MI). We show that these spatio-temporal dynamics are recapitulated in the engagement order of ensembles of MI neurons. We demonstrate that these patterns are unique to movement onset and suggest that movement initiation requires a precise spatio-temporal sequential activation of neurons in MI.

Similarity in Neuronal Firing Regimes across Mammalian Species.

UNLABELLED: The architectonic subdivisions of the brain are believed to be functional modules, each processing parts of global functions. Previously, we showed that neurons in different regions operate in different firing regimes in monkeys. It is possible that firing regimes reflect differences in underlying information processing, and consequently the firing regimes in homologous regions across animal species might be similar. We analyzed neuronal spike trains recorded from behaving mice, rats, cats, and monkeys. The firing regularity differed systematically, with differences across regions in one species being greater than the differences in similar areas across species. Neuronal firing was consistently most regular in motor areas, nearly random in visual and prefrontal/medial prefrontal cortical areas, and bursting in the hippocampus in all animals examined. This suggests that firing regularity (or irregularity) plays a key role in neural computation in each functional subdivision, depending on the types of information being carried. SIGNIFICANCE STATEMENT: By analyzing neuronal spike trains recorded from mice, rats, cats, and monkeys, we found that different brain regions have intrinsically different firing regimes that are more similar in homologous areas across species than across areas in one species. Because different regions in the brain are specialized for different functions, the present finding suggests that the different activity regimes of neurons are important for supporting different functions, so that appropriate neuronal codes can be used for different modalities.

Perspectives on classical controversies about the motor cortex.

Primary motor cortex has been studied for more than a century, yet a consensus on its functional contribution to movement control is still out of reach. In particular, there remains controversy as to the level of control produced by motor cortex ("low-level" movement dynamics vs. "high-level" movement kinematics) and the role of sensory feedback. In this review, we present different perspectives on the two following questions: What does activity in motor cortex reflect? and How do planned motor commands interact with incoming sensory feedback during movement? The four authors each present their independent views on how they think the primary motor cortex (M1) controls movement. At the end, we present a dialogue in which the authors synthesize their views and suggest possibilities for moving the field forward. While there is not yet a consensus on the role of M1 or sensory feedback in the control of upper limb movements, such dialogues are essential to take us closer to one.

The science of neural interface systems.

The ultimate goal of neural interface research is to create links between the nervous system and the outside world either by stimulating or by recording from neural tissue to treat or assist people with sensory, motor, or other disabilities of neural function. Although electrical stimulation systems have already reached widespread clinical application, neural interfaces that record neural signals to decipher movement intentions are only now beginning to develop into clinically viable systems to help paralyzed people. We begin by reviewing state-of-the-art research and early-stage clinical recording systems and focus on systems that record single-unit action potentials. We then address the potential for neural interface research to enhance basic scientific understanding of brain function by offering unique insights in neural coding and representation, plasticity, brain-behavior relations, and the neurobiology of disease. Finally, we discuss technical and scientific challenges faced by these systems before they are widely adopted by severely motor-disabled patients.

Sagittal Plane Kinematics of the Jaw and Hyolingual Apparatus During Swallowing in Macaca mulatta.

Studies of mechanisms of feeding behavior are important in a society where aging- and disease-related feeding disorders are increasingly prevalent. It is important to evaluate the clinical relevance of animal models of the disease and the control. Our present study quantifies macaque hyolingual and jaw kinematics around swallowing cycles to determine the extent to which macaque swallowing resembles that of humans. One female and one male adult Macaca mulatta were trained to feed in a primate chair. Videofluoroscopy was used to record kinematics in a sagittal view during natural feeding on solid food, and the kinematics of the hyoid bone, thyroid cartilage, mandibular jaw, and anterior-, middle-, and posterior-tongue. Jaw gape cycles were defined by consecutive maximum gapes, and the kinematics of the swallow cycles were compared with those of the two consecutive non-swallow cycles preceding and succeeding the swallow cycles. Although there are size differences between macaques and humans, and macaques have shorter durations of jaw gape cycles and hyoid and thyroid upward movements, there are several important similarities between our macaque data and human data reported in the literature: (1) The durations of jaw gape cycles during swallow cycles are longer than those of non-swallow cycles as a result of an increased duration of the jaw-opening phase; (2) Hyoid and thyroid upward movement is linked with a posterior tongue movement and is faster during swallow than non-swallow cycles; (3) Tongue elevation propagates from anterior to posterior during swallow and non-swallow cycles. These findings suggest that macaques can be a useful experimental model for human swallowing studies.

Modulation dynamics in the orofacial sensorimotor cortex during motor skill acquisition.

The orofacial sensorimotor cortex is known to play a role in motor learning. However, how motor learning changes the dynamics of neuronal activity and whether these changes differ between orofacial primary motor (MIo) and somatosensory (SIo) cortices remain unknown. To address these questions, we used chronically implanted microelectrode arrays to track learning-induced changes in the activity of simultaneously recorded neurons in MIo and SIo as two naive monkeys (Macaca mulatta) were trained in a novel tongue-protrusion task. Over a period of 8-12 d, the monkeys showed behavioral improvements in task performance that were accompanied by rapid and long-lasting changes in neuronal responses in MIo and SIo occurring in parallel: (1) increases in the proportion of task-modulated neurons, (2) increases in the mutual information between tongue-protrusive force and spiking activity, (3) reductions in the across-trial firing rate variability, and (4) transient increases in coherent firing of neuronal pairs. More importantly, the time-resolved mutual information in MIo and SIo exhibited temporal alignment. While showing parallel changes, MIo neurons exhibited a bimodal distribution of peak correlation lag times between spiking activity and force, whereas SIo neurons showed a unimodal distribution. Moreover, coherent activity between pairs of MIo neurons was higher and centered around force onset compared with pairwise coherence of SIo neurons. Overall, the results suggest that the neuroplasticity in MIo and SIo occurring in parallel serves as a substrate for linking sensation and movement during sensorimotor learning, whereas the differing dynamic organizations reflect specific ways to control movement parameters as learning progresses.

Neural coordination during reach-to-grasp.

When reaching to grasp, we coordinate how we preshape the hand with how we move it. To ask how motor cortical neurons participate in this coordination, we examined the interactions between reach- and grasp-related neuronal ensembles while monkeys reached to grasp a variety of different objects in different locations. By describing the dynamics of these two ensembles as trajectories in a low-dimensional state space, we examined their coupling in time. We found evidence for temporal compensation across many different reach-to-grasp conditions such that if one neural trajectory led in time the other tended to catch up, reducing the asynchrony between the trajectories. Granger causality revealed bidirectional interactions between reach and grasp neural trajectories beyond that which could be attributed to the joint kinematics that were consistently stronger in the grasp-to-reach direction. Characterizing cortical coordination dynamics provides a new framework for understanding the functional interactions between neural populations.