Learning leaves a memory trace in motor cortex.

How are we able to learn new behaviors without disrupting previously learned ones? To understand how the brain achieves this, we used a brain-computer interface (BCI) learning paradigm, which enables us to detect the presence of a memory of one behavior while performing another. We found that learning to use a new BCI map altered the neural activity that monkeys produced when they returned to using a familiar BCI map in a way that was specific to the learning experience. That is, learning left a "memory trace" in the primary motor cortex. This memory trace coexisted with proficient performance under the familiar map, primarily by altering neural activity in dimensions that did not impact behavior. Forming memory traces might be how the brain is able to provide for the joint learning of multiple behaviors without interference.

Dynamical constraints on neural population activity.

The manner in which neural activity unfolds over time is thought to be central to sensory, motor, and cognitive functions in the brain. Network models have long posited that the brain's computations involve time courses of activity that are shaped by the underlying network. A prediction from this view is that the activity time courses should be difficult to violate. We leveraged a brain-computer interface (BCI) to challenge monkeys to violate the naturally-occurring time courses of neural population activity that we observed in motor cortex. This included challenging animals to traverse the natural time course of neural activity in a time-reversed manner. Animals were unable to violate the natural time courses of neural activity when directly challenged to do so. These results provide empirical support for the view that activity time courses observed in the brain indeed reflect the underlying network-level computational mechanisms that they are believed to implement.

A neural basis of choking under pressure.

Incentives tend to drive improvements in performance. But when incentives get too high, we can "choke under pressure" and underperform when it matters most. What neural processes might lead to choking under pressure? We studied Rhesus monkeys performing a challenging reaching task in which they underperform when an unusually large "jackpot" reward is at stake. We observed a collapse in neural information about upcoming movements for jackpot rewards: in the motor cortex, neural planning signals became less distinguishable for different reach directions when a jackpot reward was made available. We conclude that neural signals of reward and motor planning interact in the motor cortex in a manner that can explain why we choke under pressure. One-Sentence Summary: In response to exceptionally large reward cues, animals can "choke under pressure", and this corresponds to a collapse in the neural information about upcoming movements.

How learning unfolds in the brain: toward an optimization view.

How do changes in the brain lead to learning? To answer this question, consider an artificial neural network (ANN), where learning proceeds by optimizing a given objective or cost function. This "optimization framework" may provide new insights into how the brain learns, as many idiosyncratic features of neural activity can be recapitulated by an ANN trained to perform the same task. Nevertheless, there are key features of how neural population activity changes throughout learning that cannot be readily explained in terms of optimization and are not typically features of ANNs. Here we detail three of these features: (1) the inflexibility of neural variability throughout learning, (2) the use of multiple learning processes even during simple tasks, and (3) the presence of large task-nonspecific activity changes. We propose that understanding the role of these features in the brain will be key to describing biological learning using an optimization framework.

Learning is shaped by abrupt changes in neural engagement.

Internal states such as arousal, attention and motivation modulate brain-wide neural activity, but how these processes interact with learning is not well understood. During learning, the brain modifies its neural activity to improve behavior. How do internal states affect this process? Using a brain-computer interface learning paradigm in monkeys, we identified large, abrupt fluctuations in neural population activity in motor cortex indicative of arousal-like internal state changes, which we term 'neural engagement.' In a brain-computer interface, the causal relationship between neural activity and behavior is known, allowing us to understand how neural engagement impacted behavioral performance for different task goals. We observed stereotyped changes in neural engagement that occurred regardless of how they impacted performance. This allowed us to predict how quickly different task goals were learned. These results suggest that changes in internal states, even those seemingly unrelated to goal-seeking behavior, can systematically influence how behavior improves with learning.

Stabilization of a brain-computer interface via the alignment of low-dimensional spaces of neural activity.

The instability of neural recordings can render clinical brain-computer interfaces (BCIs) uncontrollable. Here, we show that the alignment of low-dimensional neural manifolds (low-dimensional spaces that describe specific correlation patterns between neurons) can be used to stabilize neural activity, thereby maintaining BCI performance in the presence of recording instabilities. We evaluated the stabilizer with non-human primates during online cursor control via intracortical BCIs in the presence of severe and abrupt recording instabilities. The stabilized BCIs recovered proficient control under different instability conditions and across multiple days. The stabilizer does not require knowledge of user intent and can outperform supervised recalibration. It stabilized BCIs even when neural activity contained little information about the direction of cursor movement. The stabilizer may be applicable to other neural interfaces and may improve the clinical viability of BCIs.

New neural activity patterns emerge with long-term learning.

Learning has been associated with changes in the brain at every level of organization. However, it remains difficult to establish a causal link between specific changes in the brain and new behavioral abilities. We establish that new neural activity patterns emerge with learning. We demonstrate that these new neural activity patterns cause the new behavior. Thus, the formation of new patterns of neural population activity can underlie the learning of new skills.

Constraints on neural redundancy.

Millions of neurons drive the activity of hundreds of muscles, meaning many different neural population activity patterns could generate the same movement. Studies have suggested that these redundant (i.e. behaviorally equivalent) activity patterns may be beneficial for neural computation. However, it is unknown what constraints may limit the selection of different redundant activity patterns. We leveraged a brain-computer interface, allowing us to define precisely which neural activity patterns were redundant. Rhesus monkeys made cursor movements by modulating neural activity in primary motor cortex. We attempted to predict the observed distribution of redundant neural activity. Principles inspired by work on muscular redundancy did not accurately predict these distributions. Surprisingly, the distributions of redundant neural activity and task-relevant activity were coupled, which enabled accurate predictions of the distributions of redundant activity. This suggests limits on the extent to which redundancy may be exploited by the brain for computation.

Publisher Correction: Learning by neural reassociation.

In the version of this article initially published, equation (10) contained cos Θ instead of sin Θ as the bottom element of the right-hand vector. The error has been corrected in the HTML and PDF versions of the article.

Learning by neural reassociation.

Behavior is driven by coordinated activity across a population of neurons. Learning requires the brain to change the neural population activity produced to achieve a given behavioral goal. How does population activity reorganize during learning? We studied intracortical population activity in the primary motor cortex of rhesus macaques during short-term learning in a brain-computer interface (BCI) task. In a BCI, the mapping between neural activity and behavior is exactly known, enabling us to rigorously define hypotheses about neural reorganization during learning. We found that changes in population activity followed a suboptimal neural strategy of reassociation: animals relied on a fixed repertoire of activity patterns and associated those patterns with different movements after learning. These results indicate that the activity patterns that a neural population can generate are even more constrained than previously thought and might explain why it is often difficult to quickly learn to a high level of proficiency.

A Path to Understanding How Motor Cortex Influences Muscle Activity.

The influence of motor cortex on muscles during different behaviors is incompletely understood. In this issue of Neuron, Miri et al. (2017) show that the population activity patterns produced by motor cortex during different behaviors determine the selective routing of signals along different pathways between motor cortex and muscles.

Extracellular voltage threshold settings can be tuned for optimal encoding of movement and stimulus parameters.

OBJECTIVE: A traditional goal of neural recording with extracellular electrodes is to isolate action potential waveforms of an individual neuron. Recently, in brain-computer interfaces (BCIs), it has been recognized that threshold crossing events of the voltage waveform also convey rich information. To date, the threshold for detecting threshold crossings has been selected to preserve single-neuron isolation. However, the optimal threshold for single-neuron identification is not necessarily the optimal threshold for information extraction. Here we introduce a procedure to determine the best threshold for extracting information from extracellular recordings. We apply this procedure in two distinct contexts: the encoding of kinematic parameters from neural activity in primary motor cortex (M1), and visual stimulus parameters from neural activity in primary visual cortex (V1). APPROACH: We record extracellularly from multi-electrode arrays implanted in M1 or V1 in monkeys. Then, we systematically sweep the voltage detection threshold and quantify the information conveyed by the corresponding threshold crossings. MAIN RESULTS: The optimal threshold depends on the desired information. In M1, velocity is optimally encoded at higher thresholds than speed; in both cases the optimal thresholds are lower than are typically used in BCI applications. In V1, information about the orientation of a visual stimulus is optimally encoded at higher thresholds than is visual contrast. A conceptual model explains these results as a consequence of cortical topography. SIGNIFICANCE: How neural signals are processed impacts the information that can be extracted from them. Both the type and quality of information contained in threshold crossings depend on the threshold setting. There is more information available in these signals than is typically extracted. Adjusting the detection threshold to the parameter of interest in a BCI context should improve our ability to decode motor intent, and thus enhance BCI control. Further, by sweeping the detection threshold, one can gain insights into the topographic organization of the nearby neural tissue.

Single-unit activity, threshold crossings, and local field potentials in motor cortex differentially encode reach kinematics.

A diversity of signals can be recorded with extracellular electrodes. It remains unclear whether different signal types convey similar or different information and whether they capture the same or different underlying neural phenomena. Some researchers focus on spiking activity, while others examine local field potentials, and still others posit that these are fundamentally the same signals. We examined the similarities and differences in the information contained in four signal types recorded simultaneously from multielectrode arrays implanted in primary motor cortex: well-isolated action potentials from putative single units, multiunit threshold crossings, and local field potentials (LFPs) at two distinct frequency bands. We quantified the tuning of these signal types to kinematic parameters of reaching movements. We found 1) threshold crossing activity is not a proxy for single-unit activity; 2) when examined on individual electrodes, threshold crossing activity more closely resembles LFP activity at frequencies between 100 and 300 Hz than it does single-unit activity; 3) when examined across multiple electrodes, threshold crossing activity and LFP integrate neural activity at different spatial scales; and 4) LFP power in the "beta band" (between 10 and 40 Hz) is a reliable indicator of movement onset but does not encode kinematic features on an instant-by-instant basis. These results show that the diverse signals recorded from extracellular electrodes provide somewhat distinct and complementary information. It may be that these signal types arise from biological phenomena that are partially distinct. These results also have practical implications for harnessing richer signals to improve brain-machine interface control.

Intrafascicular stimulation of monkey arm nerves evokes coordinated grasp and sensory responses.

High-count microelectrode arrays implanted in peripheral nerves could restore motor function after spinal cord injury or sensory function after limb loss. In this study, we implanted Utah Slanted Electrode Arrays (USEAs) intrafascicularly at the elbow or shoulder in arm nerves of rhesus monkeys (n = 4) under isoflurane anesthesia. Input-output curves indicated that pulse-width-modulated single-electrode stimulation in each arm nerve could recruit single muscles with little or no recruitment of other muscles. Stimulus trains evoked specific, natural, hand movements, which could be combined via multielectrode stimulation to elicit coordinated power or pinch grasp. Stimulation also elicited short-latency evoked potentials (EPs) in primary somatosensory cortex, which might be used to provide sensory feedback from a prosthetic limb. These results demonstrate a high-resolution, high-channel-count interface to the peripheral nervous system for restoring hand function after neural injury or disruption or for examining nerve structure.

Movement representation in the primary motor cortex and its contribution to generalizable EMG predictions.

It is well known that discharge of neurons in the primary motor cortex (M1) depends on end-point force and limb posture. However, the details of these relations remain unresolved. With the development of brain-machine interfaces (BMIs), these issues have taken on practical as well as theoretical importance. We examined how the M1 encodes movement by comparing single-neuron and electromyographic (EMG) preferred directions (PDs) and by predicting force and EMGs from multiple neurons recorded during an isometric wrist task. Monkeys moved a cursor from a central target to one of eight peripheral targets by exerting force about the wrist while the forearm was held in one of two postures. We fit tuning curves to both EMG and M1 activity measured during the hold period, from which we computed both PDs and the change in PD between forearm postures (ΔPD). We found a unimodal distribution of these ΔPDs, the majority of which were intermediate between the typical muscle response and an unchanging, extrinsic coordinate system. We also discovered that while most neuron-to-EMG predictions generalized well across forearm postures, end-point force measured in extrinsic coordinates did not. The lack of force generalization was due to musculoskeletal changes with posture. Our results show that the dynamics of most of the recorded M1 signals are similar to those of muscle activity and imply that a BMI designed to drive an actuator with dynamics like those of muscles might be more robust and easier to learn than a BMI that commands forces or movements in external coordinates.

Functional connectivity and tuning curves in populations of simultaneously recorded neurons.

How interactions between neurons relate to tuned neural responses is a longstanding question in systems neuroscience. Here we use statistical modeling and simultaneous multi-electrode recordings to explore the relationship between these interactions and tuning curves in six different brain areas. We find that, in most cases, functional interactions between neurons provide an explanation of spiking that complements and, in some cases, surpasses the influence of canonical tuning curves. Modeling functional interactions improves both encoding and decoding accuracy by accounting for noise correlations and features of the external world that tuning curves fail to capture. In cortex, modeling coupling alone allows spikes to be predicted more accurately than tuning curve models based on external variables. These results suggest that statistical models of functional interactions between even relatively small numbers of neurons may provide a useful framework for examining neural coding.

Local field potentials allow accurate decoding of muscle activity.

Local field potentials (LFPs) in primary motor cortex include significant information about reach target location and upper limb movement kinematics. Some evidence suggests that they may be a more robust, longer-lasting signal than action potentials (spikes). Here we assess whether LFPs can also be used to decode upper limb muscle activity, a complex movement-related signal. We record electromyograms from both proximal and distal upper limb muscles from monkeys performing a variety of reach-to-grasp and isometric wrist force tasks. We show that LFPs can be used to decode activity from both proximal and distal muscles with performance rivaling that of spikes. Thus, motor cortical LFPs include information about more aspects of movement than has been previously demonstrated. This provides further evidence suggesting that LFPs could provide a highly informative, long-lasting signal source for neural prostheses.

Electrical conduction block in large nerves: high-frequency current delivery in the nonhuman primate.

Recent studies have made significant progress toward the clinical implementation of high-frequency conduction block (HFB) of peripheral nerves. However, these studies were performed in small nerves, and questions remain regarding the nature of HFB in large-diameter nerves. This study in nonhuman primates shows reliable conduction block in large-diameter nerves (up to 4.1 mm) with relatively low-threshold current amplitude and only moderate nerve discharge prior to the onset of block.

Toward the restoration of hand use to a paralyzed monkey: brain-controlled functional electrical stimulation of forearm muscles.

Loss of hand use is considered by many spinal cord injury survivors to be the most devastating consequence of their injury. Functional electrical stimulation (FES) of forearm and hand muscles has been used to provide basic, voluntary hand grasp to hundreds of human patients. Current approaches typically grade pre-programmed patterns of muscle activation using simple control signals, such as those derived from residual movement or muscle activity. However, the use of such fixed stimulation patterns limits hand function to the few tasks programmed into the controller. In contrast, we are developing a system that uses neural signals recorded from a multi-electrode array implanted in the motor cortex; this system has the potential to provide independent control of multiple muscles over a broad range of functional tasks. Two monkeys were able to use this cortically controlled FES system to control the contraction of four forearm muscles despite temporary limb paralysis. The amount of wrist force the monkeys were able to produce in a one-dimensional force tracking task was significantly increased. Furthermore, the monkeys were able to control the magnitude and time course of the force with sufficient accuracy to track visually displayed force targets at speeds reduced by only one-third to one-half of normal. Although these results were achieved by controlling only four muscles, there is no fundamental reason why the same methods could not be scaled up to control a larger number of muscles. We believe these results provide an important proof of concept that brain-controlled FES prostheses could ultimately be of great benefit to paralyzed patients with injuries in the mid-cervical spinal cord.