Integrating across behaviors and timescales to understand the neural control of movement.

The nervous system evolved to enable navigation throughout the environment in the pursuit of resources. Evolutionarily newer structures allowed increasingly complex adaptations but necessarily added redundancy. A dominant view of movement neuroscientists is that there is a one-to-one mapping between brain region and function. However, recent experimental data is hard to reconcile with the most conservative interpretation of this framework, suggesting a degree of functional redundancy during the performance of well-learned, constrained behaviors. This apparent redundancy likely stems from the bidirectional interactions between the various cortical and subcortical structures involved in motor control. We posit that these bidirectional connections enable flexible interactions across structures that change depending upon behavioral demands, such as during acquisition, execution or adaptation of a skill. Observing the system across both multiple actions and behavioral timescales can help isolate the functional contributions of individual structures, leading to an integrated understanding of the neural control of movement.

Preserved neural dynamics across animals performing similar behaviour.

Animals of the same species exhibit similar behaviours that are advantageously adapted to their body and environment. These behaviours are shaped at the species level by selection pressures over evolutionary timescales. Yet, it remains unclear how these common behavioural adaptations emerge from the idiosyncratic neural circuitry of each individual. The overall organization of neural circuits is preserved across individuals1 because of their common evolutionarily specified developmental programme2-4. Such organization at the circuit level may constrain neural activity5-8, leading to low-dimensional latent dynamics across the neural population9-11. Accordingly, here we suggested that the shared circuit-level constraints within a species would lead to suitably preserved latent dynamics across individuals. We analysed recordings of neural populations from monkey and mouse motor cortex to demonstrate that neural dynamics in individuals from the same species are surprisingly preserved when they perform similar behaviour. Neural population dynamics were also preserved when animals consciously planned future movements without overt behaviour12 and enabled the decoding of planned and ongoing movement across different individuals. Furthermore, we found that preserved neural dynamics extend beyond cortical regions to the dorsal striatum, an evolutionarily older structure13,14. Finally, we used neural network models to demonstrate that behavioural similarity is necessary but not sufficient for this preservation. We posit that these emergent dynamics result from evolutionary constraints on brain development and thus reflect fundamental properties of the neural basis of behaviour.

Nonlinear manifolds underlie neural population activity during behaviour.

There is rich variety in the activity of single neurons recorded during behaviour. Yet, these diverse single neuron responses can be well described by relatively few patterns of neural co-modulation. The study of such low-dimensional structure of neural population activity has provided important insights into how the brain generates behaviour. Virtually all of these studies have used linear dimensionality reduction techniques to estimate these population-wide co-modulation patterns, constraining them to a flat "neural manifold". Here, we hypothesised that since neurons have nonlinear responses and make thousands of distributed and recurrent connections that likely amplify such nonlinearities, neural manifolds should be intrinsically nonlinear. Combining neural population recordings from monkey motor cortex, mouse motor cortex, mouse striatum, and human motor cortex, we show that: 1) neural manifolds are intrinsically nonlinear; 2) the degree of their nonlinearity varies across architecturally distinct brain regions; and 3) manifold nonlinearity becomes more evident during complex tasks that require more varied activity patterns. Simulations using recurrent neural network models confirmed the proposed relationship between circuit connectivity and manifold nonlinearity, including the differences across architecturally distinct regions. Thus, neural manifolds underlying the generation of behaviour are inherently nonlinear, and properly accounting for such nonlinearities will be critical as neuroscientists move towards studying numerous brain regions involved in increasingly complex and naturalistic behaviours.

Mesolimbic dopamine adapts the rate of learning from action.

Recent success in training artificial agents and robots derives from a combination of direct learning of behavioural policies and indirect learning through value functions1-3. Policy learning and value learning use distinct algorithms that optimize behavioural performance and reward prediction, respectively. In animals, behavioural learning and the role of mesolimbic dopamine signalling have been extensively evaluated with respect to reward prediction4; however, so far there has been little consideration of how direct policy learning might inform our understanding5. Here we used a comprehensive dataset of orofacial and body movements to understand how behavioural policies evolved as naive, head-restrained mice learned a trace conditioning paradigm. Individual differences in initial dopaminergic reward responses correlated with the emergence of learned behavioural policy, but not the emergence of putative value encoding for a predictive cue. Likewise, physiologically calibrated manipulations of mesolimbic dopamine produced several effects inconsistent with value learning but predicted by a neural-network-based model that used dopamine signals to set an adaptive rate, not an error signal, for behavioural policy learning. This work provides strong evidence that phasic dopamine activity can regulate direct learning of behavioural policies, expanding the explanatory power of reinforcement learning models for animal learning6.

Hippocampal representations of foraging trajectories depend upon spatial context.

Animals learn trajectories to rewards in both spatial, navigational contexts and relational, non-navigational contexts. Synchronous reactivation of hippocampal activity is thought to be critical for recall and evaluation of trajectories for learning. Do hippocampal representations differentially contribute to experience-dependent learning of trajectories across spatial and relational contexts? In this study, we trained mice to navigate to a hidden target in a physical arena or manipulate a joystick to a virtual target to collect delayed rewards. In a navigational context, calcium imaging in freely moving mice revealed that synchronous CA1 reactivation was retrospective and important for evaluation of prior navigational trajectories. In a non-navigational context, reactivation was prospective and important for initiation of joystick trajectories, even in the same animals trained in both contexts. Adaptation of trajectories to a new target was well-explained by a common learning algorithm in which hippocampal activity makes dissociable contributions to reinforcement learning computations depending upon spatial context.

Motor cortical output for skilled forelimb movement is selectively distributed across projection neuron classes.

The interaction of descending neocortical outputs and subcortical premotor circuits is critical for shaping skilled movements. Two broad classes of motor cortical output projection neurons provide input to many subcortical motor areas: pyramidal tract (PT) neurons, which project throughout the neuraxis, and intratelencephalic (IT) neurons, which project within the cortex and subcortical striatum. It is unclear whether these classes are functionally in series or whether each class carries distinct components of descending motor control signals. Here, we combine large-scale neural recordings across all layers of motor cortex with cell type-specific perturbations to study cortically dependent mouse motor behaviors: kinematically variable manipulation of a joystick and a kinematically precise reach-to-grasp. We find that striatum-projecting IT neuron activity preferentially represents amplitude, whereas pons-projecting PT neurons preferentially represent the variable direction of forelimb movements. Thus, separable components of descending motor cortical commands are distributed across motor cortical projection cell classes.

Dissociable contributions of phasic dopamine activity to reward and prediction.

Sensory cues that precede reward acquire predictive (expected value) and incentive (drive reward-seeking action) properties. Mesolimbic dopamine neurons' responses to sensory cues correlate with both expected value and reward-seeking action. This has led to the proposal that phasic dopamine responses may be sufficient to inform value-based decisions, elicit actions, and/or induce motivational states; however, causal tests are incomplete. Here, we show that direct dopamine neuron stimulation, both calibrated to physiological and greater intensities, at the time of reward can be sufficient to induce and maintain reward seeking (reinforcing) although replacement of a cue with stimulation is insufficient to induce reward seeking or act as an informative cue. Stimulation of descending cortical inputs, one synapse upstream, are sufficient for reinforcement and cues to future reward. Thus, physiological activation of mesolimbic dopamine neurons can be sufficient for reinforcing properties of reward without being sufficient for the predictive and incentive properties of cues.

Neuropixels 2.0: A miniaturized high-density probe for stable, long-term brain recordings.

Measuring the dynamics of neural processing across time scales requires following the spiking of thousands of individual neurons over milliseconds and months. To address this need, we introduce the Neuropixels 2.0 probe together with newly designed analysis algorithms. The probe has more than 5000 sites and is miniaturized to facilitate chronic implants in small mammals and recording during unrestrained behavior. High-quality recordings over long time scales were reliably obtained in mice and rats in six laboratories. Improved site density and arrangement combined with newly created data processing methods enable automatic post hoc correction for brain movements, allowing recording from the same neurons for more than 2 months. These probes and algorithms enable stable recordings from thousands of sites during free behavior, even in small animals such as mice.

In Vivo Optogenetics with Stimulus Calibration.

Optogenetic reagents allow for depolarization and hyperpolarization of cells with light. This provides unprecedented spatial and temporal resolution to the control of neuronal activity both in vitro and in vivo. In the intact animal this requires strategies to deliver light deep into the highly scattering tissue of the brain. A general approach that we describe here is to implant optical fibers just above brain regions targeted for light delivery. In part due to the fact that expression of optogenetic proteins is accomplished by techniques with inherent variability (e.g., viral expression levels), it also requires strategies to measure and calibrate the effect of stimulation. Here we describe general procedures that allow one to simultaneously stimulate neurons and use photometry with genetically encoded activity indicators to precisely calibrate stimulation.

Basal Ganglia Circuits for Action Specification.

Behavior is readily classified into patterns of movements with inferred common goals-actions. Goals may be discrete; movements are continuous. Through the careful study of isolated movements in laboratory settings, or via introspection, it has become clear that animals can exhibit exquisite graded specification to their movements. Moreover, graded control can be as fundamental to success as the selection of which action to perform under many naturalistic scenarios: a predator adjusting its speed to intercept moving prey, or a tool-user exerting the perfect amount of force to complete a delicate task. The basal ganglia are a collection of nuclei in vertebrates that extend from the forebrain (telencephalon) to the midbrain (mesencephalon), constituting a major descending extrapyramidal pathway for control over midbrain and brainstem premotor structures. Here we discuss how this pathway contributes to the continuous specification of movements that endows our voluntary actions with vigor and grace.

Publisher Correction: A repeated molecular architecture across thalamic pathways.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity.

Animals infer when and where a reward is available from experience with informative sensory stimuli and their own actions. In vertebrates, this is thought to depend upon the release of dopamine from midbrain dopaminergic neurons. Studies of the role of dopamine have focused almost exclusively on their encoding of informative sensory stimuli; however, many dopaminergic neurons are active just prior to movement initiation, even in the absence of sensory stimuli. How should current frameworks for understanding the role of dopamine incorporate these observations? To address this question, we review recent anatomical and functional evidence for action-related dopamine signaling. We conclude by proposing a framework in which dopaminergic neurons encode subjective signals of action initiation to solve an internal credit assignment problem.

A repeated molecular architecture across thalamic pathways.

The thalamus is the central communication hub of the forebrain and provides the cerebral cortex with inputs from sensory organs, subcortical systems and the cortex itself. Multiple thalamic regions send convergent information to each cortical region, but the organizational logic of thalamic projections has remained elusive. Through comprehensive transcriptional analyses of retrogradely labeled thalamic neurons in adult mice, we identify three major profiles of thalamic pathways. These profiles exist along a continuum that is repeated across all major projection systems, such as those for vision, motor control and cognition. The largest component of gene expression variation in the mouse thalamus is topographically organized, with features conserved in humans. Transcriptional differences between these thalamic neuronal identities are tied to cellular features that are critical for function, such as axonal morphology and membrane properties. Molecular profiling therefore reveals covariation in the properties of thalamic pathways serving all major input modalities and output targets, thus establishing a molecular framework for understanding the thalamus.

Reconstruction of 1,000 Projection Neurons Reveals New Cell Types and Organization of Long-Range Connectivity in the Mouse Brain.

Neuronal cell types are the nodes of neural circuits that determine the flow of information within the brain. Neuronal morphology, especially the shape of the axonal arbor, provides an essential descriptor of cell type and reveals how individual neurons route their output across the brain. Despite the importance of morphology, few projection neurons in the mouse brain have been reconstructed in their entirety. Here we present a robust and efficient platform for imaging and reconstructing complete neuronal morphologies, including axonal arbors that span substantial portions of the brain. We used this platform to reconstruct more than 1,000 projection neurons in the motor cortex, thalamus, subiculum, and hypothalamus. Together, the reconstructed neurons constitute more than 85 meters of axonal length and are available in a searchable online database. Axonal shapes revealed previously unknown subtypes of projection neurons and suggest organizational principles of long-range connectivity.

The timing of action determines reward prediction signals in identified midbrain dopamine neurons.

Animals adapt their behavior in response to informative sensory cues using multiple brain circuits. The activity of midbrain dopaminergic neurons is thought to convey a critical teaching signal: reward-prediction error. Although reward-prediction error signals are thought to be essential to learning, little is known about the dynamic changes in the activity of midbrain dopaminergic neurons as animals learn about novel sensory cues and appetitive rewards. Here we describe a large dataset of cell-attached recordings of identified dopaminergic neurons as naive mice learned a novel cue-reward association. During learning midbrain dopaminergic neuron activity results from the summation of sensory cue-related and movement initiation-related response components. These components are both a function of reward expectation yet they are dissociable. Learning produces an increasingly precise coordination of action initiation following sensory cues that results in apparent reward-prediction error correlates. Our data thus provide new insights into the circuit mechanisms that underlie a critical computation in a highly conserved learning circuit.

Expanding the Optogenetics Toolkit by Topological Inversion of Rhodopsins.

Targeted manipulation of activity in specific populations of neurons is important for investigating the neural circuit basis of behavior. Optogenetic approaches using light-sensitive microbial rhodopsins have permitted manipulations to reach a level of temporal precision that is enabling functional circuit dissection. As demand for more precise perturbations to serve specific experimental goals increases, a palette of opsins with diverse selectivity, kinetics, and spectral properties will be needed. Here, we introduce a novel approach of "topological engineering"-inversion of opsins in the plasma membrane-and demonstrate that it can produce variants with unique functional properties of interest for circuit neuroscience. In one striking example, inversion of a Channelrhodopsin variant converted it from a potent activator into a fast-acting inhibitor that operates as a cation pump. Our findings argue that membrane topology provides a useful orthogonal dimension of protein engineering that immediately permits as much as a doubling of the available toolkit.

Desensitized D2 autoreceptors are resistant to trafficking.

Dendritic release of dopamine activates dopamine D2 autoreceptors, which are inhibitory G protein-coupled receptors (GPCRs), to decrease the excitability of dopamine neurons. This study used tagged D2 receptors to identify the localization and distribution of these receptors in living midbrain dopamine neurons. GFP-tagged D2 receptors were found to be unevenly clustered on the soma and dendrites of dopamine neurons within the substantia nigra pars compacta (SNc). Physiological signaling and desensitization of the tagged receptors were not different from wild type receptors. Unexpectedly, upon desensitization the tagged D2 receptors were not internalized. When tagged D2 receptors were expressed in locus coeruleus neurons, a desensitizing protocol induced significant internalization. Likewise, when tagged µ-opioid receptors were expressed in dopamine neurons they too were internalized. The distribution and lack of agonist-induced internalization of D2 receptors on dopamine neurons indicate a purposefully regulated localization of these receptors.

Deconstructing behavioral neuropharmacology with cellular specificity.

Behavior has molecular, cellular, and circuit determinants. However, because many proteins are broadly expressed, their acute manipulation within defined cells has been difficult. Here, we combined the speed and molecular specificity of pharmacology with the cell type specificity of genetic tools. DART (drugs acutely restricted by tethering) is a technique that rapidly localizes drugs to the surface of defined cells, without prior modification of the native target. We first developed an AMPAR antagonist DART, with validation in cultured neuronal assays, in slices of mouse dorsal striatum, and in behaving mice. In parkinsonian animals, motor deficits were causally attributed to AMPARs in indirect spiny projection neurons (iSPNs) and to excess phasic firing of tonically active interneurons (TANs). Together, iSPNs and TANs (i.e., D2 cells) drove akinesia, whereas movement execution deficits reflected the ratio of AMPARs in D2 versus D1 cells. Finally, we designed a muscarinic antagonist DART in one iteration, demonstrating applicability of the method to diverse targets.

A Designer AAV Variant Permits Efficient Retrograde Access to Projection Neurons.

Efficient retrograde access to projection neurons for the delivery of sensors and effectors constitutes an important and enabling capability for neural circuit dissection. Such an approach would also be useful for gene therapy, including the treatment of neurodegenerative disorders characterized by pathological spread through functionally connected and highly distributed networks. Viral vectors, in particular, are powerful gene delivery vehicles for the nervous system, but all available tools suffer from inefficient retrograde transport or limited clinical potential. To address this need, we applied in vivo directed evolution to engineer potent retrograde functionality into the capsid of adeno-associated virus (AAV), a vector that has shown promise in neuroscience research and the clinic. A newly evolved variant, rAAV2-retro, permits robust retrograde access to projection neurons with efficiency comparable to classical synthetic retrograde tracers and enables sufficient sensor/effector expression for functional circuit interrogation and in vivo genome editing in targeted neuronal populations. VIDEO ABSTRACT.

Opponent and bidirectional control of movement velocity in the basal ganglia.

For goal-directed behaviour it is critical that we can both select the appropriate action and learn to modify the underlying movements (for example, the pitch of a note or velocity of a reach) to improve outcomes. The basal ganglia are a critical nexus where circuits necessary for the production of behaviour, such as the neocortex and thalamus, are integrated with reward signalling to reinforce successful, purposive actions. The dorsal striatum, a major input structure of basal ganglia, is composed of two opponent pathways, direct and indirect, thought to select actions that elicit positive outcomes and suppress actions that do not, respectively. Activity-dependent plasticity modulated by reward is thought to be sufficient for selecting actions in the striatum. Although perturbations of basal ganglia function produce profound changes in movement, it remains unknown whether activity-dependent plasticity is sufficient to produce learned changes in movement kinematics, such as velocity. Here we use cell-type-specific stimulation in mice delivered in closed loop during movement to demonstrate that activity in either the direct or indirect pathway is sufficient to produce specific and sustained increases or decreases in velocity, without affecting action selection or motivation. These behavioural changes were a form of learning that accumulated over trials, persisted after the cessation of stimulation, and were abolished in the presence of dopamine antagonists. Our results reveal that the direct and indirect pathways can each bidirectionally control movement velocity, demonstrating unprecedented specificity and flexibility in the control of volition by the basal ganglia.