A recurrent neural circuit in Drosophila deblurs visual inputs.

A critical goal of vision is to detect changes in light intensity, even when these changes are blurred by the spatial resolution of the eye and the motion of the animal. Here we describe a recurrent neural circuit in Drosophila that compensates for blur and thereby selectively enhances the perceived contrast of moving edges. Using in vivo, two-photon voltage imaging, we measured the temporal response properties of L1 and L2, two cell types that receive direct synaptic input from photoreceptors. These neurons have biphasic responses to brief flashes of light, a hallmark of cells that encode changes in stimulus intensity. However, the second phase was often much larger than the first, creating an unusual temporal filter. Genetic dissection revealed that recurrent neural circuitry strongly shapes the second phase of the response, informing the structure of a dynamical model. By applying this model to moving natural images, we demonstrate that rather than veridically representing stimulus changes, this temporal processing strategy systematically enhances them, amplifying and sharpening responses. Comparing the measured responses of L2 to model predictions across both artificial and natural stimuli revealed that L2 tunes its properties as the model predicts in order to deblur images. Since this strategy is tunable to behavioral context, generalizable to any time-varying sensory input, and implementable with a common circuit motif, we propose that it could be broadly used to selectively enhance sharp and salient changes.

Transforming a head direction signal into a goal-oriented steering command.

To navigate, we must continuously estimate the direction we are headed in, and we must correct deviations from our goal1. Direction estimation is accomplished by ring attractor networks in the head direction system2,3. However, we do not fully understand how the sense of direction is used to guide action. Drosophila connectome analyses4,5 reveal three cell populations (PFL3R, PFL3L and PFL2) that connect the head direction system to the locomotor system. Here we use imaging, electrophysiology and chemogenetic stimulation during navigation to show how these populations function. Each population receives a shifted copy of the head direction vector, such that their three reference frames are shifted approximately 120° relative to each other. Each cell type then compares its own head direction vector with a common goal vector; specifically, it evaluates the congruence of these vectors via a nonlinear transformation. The output of all three cell populations is then combined to generate locomotor commands. PFL3R cells are recruited when the fly is oriented to the left of its goal, and their activity drives rightward turning; the reverse is true for PFL3L. Meanwhile, PFL2 cells increase steering speed, and are recruited when the fly is oriented far from its goal. PFL2 cells adaptively increase the strength of steering as directional error increases, effectively managing the tradeoff between speed and accuracy. Together, our results show how a map of space in the brain can be combined with an internal goal to generate action commands, via a transformation from world-centric coordinates to body-centric coordinates.

Brain-wide neural activity underlying memory-guided movement.

Behavior relies on activity in structured neural circuits that are distributed across the brain, but most experiments probe neurons in a single area at a time. Using multiple Neuropixels probes, we recorded from multi-regional loops connected to the anterior lateral motor cortex (ALM), a circuit node mediating memory-guided directional licking. Neurons encoding sensory stimuli, choices, and actions were distributed across the brain. However, choice coding was concentrated in the ALM and subcortical areas receiving input from the ALM in an ALM-dependent manner. Diverse orofacial movements were encoded in the hindbrain; midbrain; and, to a lesser extent, forebrain. Choice signals were first detected in the ALM and the midbrain, followed by the thalamus and other brain areas. At movement initiation, choice-selective activity collapsed across the brain, followed by new activity patterns driving specific actions. Our experiments provide the foundation for neural circuit models of decision-making and movement initiation.

Mapping the neural dynamics of locomotion across the Drosophila brain.

Locomotion engages widely distributed networks of neurons. However, our understanding of the spatial architecture and temporal dynamics of the networks that underpin walking remains incomplete. We use volumetric two-photon imaging to map neural activity associated with walking across the entire brain of Drosophila. We define spatially clustered neural signals selectively associated with changes in either forward or angular velocity, demonstrating that neurons with similar behavioral selectivity are clustered. These signals reveal distinct topographic maps in diverse brain regions involved in navigation, memory, sensory processing, and motor control, as well as regions not previously linked to locomotion. We identify temporal trajectories of neural activity that sweep across these maps, including signals that anticipate future movement, representing the sequential engagement of clusters with different behavioral specificities. Finally, we register these maps to a connectome and identify neural networks that we propose underlie the observed signals, setting a foundation for subsequent circuit dissection. Overall, our work suggests a spatiotemporal framework for the emergence and execution of complex walking maneuvers and links this brain-wide neural activity to single neurons and local circuits.

Temporal scaling of motor cortical dynamics reveals hierarchical control of vocal production.

Neocortical activity is thought to mediate voluntary control over vocal production, but the underlying neural mechanisms remain unclear. In a highly vocal rodent, the male Alston's singing mouse, we investigate neural dynamics in the orofacial motor cortex (OMC), a structure critical for vocal behavior. We first describe neural activity that is modulated by component notes (~100 ms), probably representing sensory feedback. At longer timescales, however, OMC neurons exhibit diverse and often persistent premotor firing patterns that stretch or compress with song duration (~10 s). Using computational modeling, we demonstrate that such temporal scaling, acting through downstream motor production circuits, can enable vocal flexibility. These results provide a framework for studying hierarchical control circuits, a common design principle across many natural and artificial systems.

An efficient behavioral screening platform classifies natural products and other chemical cues according to their chemosensory valence in C. elegans.

Throughout history, humans have relied on plants as a source of medication, flavoring, and food. Plants synthesize large chemical libraries and release many of these compounds into the rhizosphere and atmosphere where they affect animal and microbe behavior. To survive, nematodes must have evolved the sensory capacity to distinguish plant-made small molecules (SMs) that are harmful and must be avoided from those that are beneficial and should be sought. This ability to classify chemical cues as a function of their value is fundamental to olfaction, and represents a capacity shared by many animals, including humans. Here, we present an efficient platform based on multi-well plates, liquid handling instrumentation, inexpensive optical scanners, and bespoke software that can efficiently determine the valence (attraction or repulsion) of single SMs in the model nematode, Caenorhabditis elegans. Using this integrated hardware-wetware-software platform, we screened 90 plant SMs and identified 37 that attracted or repelled wild-type animals, but had no effect on mutants defective in chemosensory transduction. Genetic dissection indicates that for at least 10 of these SMs, response valence emerges from the integration of opposing signals, arguing that olfactory valence is often determined by integrating chemosensory signals over multiple lines of information. This study establishes that C. elegans is an effective discovery engine for determining chemotaxis valence and for identifying natural products detected by the chemosensory nervous system.

A high-performance speech neuroprosthesis.

Speech brain-computer interfaces (BCIs) have the potential to restore rapid communication to people with paralysis by decoding neural activity evoked by attempted speech into text1,2 or sound3,4. Early demonstrations, although promising, have not yet achieved accuracies sufficiently high for communication of unconstrained sentences from a large vocabulary1-7. Here we demonstrate a speech-to-text BCI that records spiking activity from intracortical microelectrode arrays. Enabled by these high-resolution recordings, our study participant-who can no longer speak intelligibly owing to amyotrophic lateral sclerosis-achieved a 9.1% word error rate on a 50-word vocabulary (2.7 times fewer errors than the previous state-of-the-art speech BCI2) and a 23.8% word error rate on a 125,000-word vocabulary (the first successful demonstration, to our knowledge, of large-vocabulary decoding). Our participant's attempted speech was decoded  at 62 words per minute, which is 3.4 times as fast as the previous record8 and begins to approach the speed of natural conversation (160 words per minute9). Finally, we highlight two aspects of the neural code for speech that are encouraging for speech BCIs: spatially intermixed tuning to speech articulators that makes accurate decoding possible from only a small region of cortex, and a detailed articulatory representation of phonemes that persists years after paralysis. These results show a feasible path forward for restoring rapid communication to people with paralysis who can no longer speak.

Feedforward amplification in recurrent networks underlies paradoxical neural coding.

The activity of single neurons encodes behavioral variables, such as sensory stimuli (Hubel & Wiesel 1959) and behavioral choice (Britten et al. 1992; Guo et al. 2014), but their influence on behavior is often mysterious. We estimated the influence of a unit of neural activity on behavioral choice from recordings in anterior lateral motor cortex (ALM) in mice performing a memory-guided movement task (H. K. Inagaki et al. 2018). Choice selectivity grew as it flowed through a sequence of directions in activity space. Early directions carried little selectivity but were predicted to have a large behavioral influence, while late directions carried large selectivity and little behavioral influence. Consequently, estimated behavioral influence was only weakly correlated with choice selectivity; a large proportion of neurons selective for one choice were predicted to influence choice in the opposite direction. These results were consistent with models in which recurrent circuits produce feedforward amplification (Goldman 2009; Ganguli et al. 2008; Murphy & Miller 2009) so that small amplitude signals along early directions are amplified to produce low-dimensional choice selectivity along the late directions, and behavior. Targeted photostimulation experiments (Daie et al. 2021b) revealed that activity along the early directions triggered sequential activity along the later directions and caused predictable behavioral biases. These results demonstrate the existence of an amplifying feedforward dynamical motif in the motor cortex, explain paradoxical responses to perturbation experiments (Chettih & Harvey 2019; Daie et al. 2021b; Russell et al. 2019), and reveal behavioral relevance of small amplitude neural dynamics.

Not everything, not everywhere, not all at once: a study of brain-wide encoding of movement.

Activity related to movement is found throughout sensory and motor regions of the brain. However, it remains unclear how movement-related activity is distributed across the brain and whether systematic differences exist between brain areas. Here, we analyzed movement related activity in brain-wide recordings containing more than 50,000 neurons in mice performing a decision-making task. Using multiple techniques, from markers to deep neural networks, we find that movement-related signals were pervasive across the brain, but systematically differed across areas. Movement-related activity was stronger in areas closer to the motor or sensory periphery. Delineating activity in terms of sensory- and motor-related components revealed finer scale structures of their encodings within brain areas. We further identified activity modulation that correlates with decision-making and uninstructed movement. Our work charts out a largescale map of movement encoding and provides a roadmap for dissecting different forms of movement and decision-making related encoding across multi-regional neural circuits.

Neural dynamics in the rodent motor cortex enables flexible control of vocal timing.

Neocortical activity is thought to mediate voluntary control over vocal production, but the underlying neural mechanisms remain unclear. In a highly vocal rodent, the Alston's singing mouse, we investigate neural dynamics in the orofacial motor cortex (OMC), a structure critical for vocal behavior. We first describe neural activity that is modulated by component notes (approx. 100 ms), likely representing sensory feedback. At longer timescales, however, OMC neurons exhibit diverse and often persistent premotor firing patterns that stretch or compress with song duration (approx. 10 s). Using computational modeling, we demonstrate that such temporal scaling, acting via downstream motor production circuits, can enable vocal flexibility. These results provide a framework for studying hierarchical control circuits, a common design principle across many natural and artificial systems.

Long-term unsupervised recalibration of cursor BCIs.

Intracortical brain-computer interfaces (iBCIs) require frequent recalibration to maintain robust performance due to changes in neural activity that accumulate over time. Compensating for this nonstationarity would enable consistently high performance without the need for supervised recalibration periods, where users cannot engage in free use of their device. Here we introduce a hidden Markov model (HMM) to infer what targets users are moving toward during iBCI use. We then retrain the system using these inferred targets, enabling unsupervised adaptation to changing neural activity. Our approach outperforms the state of the art in large-scale, closed-loop simulations over two months and in closed-loop with a human iBCI user over one month. Leveraging an offline dataset spanning five years of iBCI recordings, we further show how recently proposed data distribution-matching approaches to recalibration fail over long time scales; only target-inference methods appear capable of enabling long-term unsupervised recalibration. Our results demonstrate how task structure can be used to bootstrap a noisy decoder into a highly-performant one, thereby overcoming one of the major barriers to clinically translating BCIs.

Hypothalamic neurons that mirror aggression.

Social interactions require awareness and understanding of the behavior of others. Mirror neurons, cells representing an action by self and others, have been proposed to be integral to the cognitive substrates that enable such awareness and understanding. Mirror neurons of the primate neocortex represent skilled motor tasks, but it is unclear if they are critical for the actions they embody, enable social behaviors, or exist in non-cortical regions. We demonstrate that the activity of individual VMHvlPR neurons in the mouse hypothalamus represents aggression performed by self and others. We used a genetically encoded mirror-TRAP strategy to functionally interrogate these aggression-mirroring neurons. We find that their activity is essential for fighting and that forced activation of these cells triggers aggressive displays by mice, even toward their mirror image. Together, we have discovered a mirroring center in an evolutionarily ancient region that provides a subcortical cognitive substrate essential for a social behavior.

A high-performance speech neuroprosthesis.

Speech brain-computer interfaces (BCIs) have the potential to restore rapid communication to people with paralysis by decoding neural activity evoked by attempted speaking movements into text or sound. Early demonstrations, while promising, have not yet achieved accuracies high enough for communication of unconstrainted sentences from a large vocabulary. Here, we demonstrate the first speech-to-text BCI that records spiking activity from intracortical microelectrode arrays. Enabled by these high-resolution recordings, our study participant, who can no longer speak intelligibly due amyotrophic lateral sclerosis (ALS), achieved a 9.1% word error rate on a 50 word vocabulary (2.7 times fewer errors than the prior state of the art speech BCI2) and a 23.8% word error rate on a 125,000 word vocabulary (the first successful demonstration of large-vocabulary decoding). Our BCI decoded speech at 62 words per minute, which is 3.4 times faster than the prior record for any kind of BCI and begins to approach the speed of natural conversation (160 words per minute). Finally, we highlight two aspects of the neural code for speech that are encouraging for speech BCIs: spatially intermixed tuning to speech articulators that makes accurate decoding possible from only a small region of cortex, and a detailed articulatory representation of phonemes that persists years after paralysis. These results show a feasible path forward for using intracortical speech BCIs to restore rapid communication to people with paralysis who can no longer speak.

Unraveling the Entangled Brain: How Do We Go About It?

An impactful understanding of the brain will require entirely new approaches and unprecedented collaborative efforts. The next steps will require brain researchers to develop theoretical frameworks that allow them to tease apart dependencies and causality in complex dynamical systems, as well as the ability to maintain awe while not getting lost in the effort. The outstanding question is: How do we go about it?

Regional cytoarchitecture of the adult and developing mouse enteric nervous system.

The organization and cellular composition of tissues are key determinants of their biological function. In the mammalian gastrointestinal (GI) tract, the enteric nervous system (ENS) intercalates between muscular and epithelial layers of the gut wall and can control GI function independent of central nervous system (CNS) input.1 As in the CNS, distinct regions of the GI tract are highly specialized and support diverse functions, yet the regional and spatial organization of the ENS remains poorly characterized.2 Cellular arrangements,3,4 circuit connectivity patterns,5,6 and diverse cell types7-9 are known to underpin ENS functional complexity and GI function, but enteric neurons are most typically described only as a uniform meshwork of interconnected ganglia. Here, we present a bird's eye view of the mouse ENS, describing its previously underappreciated cytoarchitecture and regional variation. We visually and computationally demonstrate that enteric neurons are organized in circumferential neuronal stripes. This organization emerges gradually during the perinatal period, with neuronal stripe formation in the small intestine (SI) preceding that in the colon. The width of neuronal stripes varies throughout the length of the GI tract, and distinct neuronal subtypes differentially populate specific regions of the GI tract, with stark contrasts between SI and colon as well as within subregions of each. This characterization provides a blueprint for future understanding of region-specific GI function and identifying ENS structural correlates of diverse GI disorders.

Towards a more general understanding of the algorithmic utility of recurrent connections.

Lateral and recurrent connections are ubiquitous in biological neural circuits. Yet while the strong computational abilities of feedforward networks have been extensively studied, our understanding of the role and advantages of recurrent computations that might explain their prevalence remains an important open challenge. Foundational studies by Minsky and Roelfsema argued that computations that require propagation of global information for local computation to take place would particularly benefit from the sequential, parallel nature of processing in recurrent networks. Such "tag propagation" algorithms perform repeated, local propagation of information and were originally introduced in the context of detecting connectedness, a task that is challenging for feedforward networks. Here, we advance the understanding of the utility of lateral and recurrent computation by first performing a large-scale empirical study of neural architectures for the computation of connectedness to explore feedforward solutions more fully and establish robustly the importance of recurrent architectures. In addition, we highlight a tradeoff between computation time and performance and construct hybrid feedforward/recurrent models that perform well even in the presence of varying computational time limitations. We then generalize tag propagation architectures to propagating multiple interacting tags and demonstrate that these are efficient computational substrates for more general computations of connectedness by introducing and solving an abstracted biologically inspired decision-making task. Our work thus clarifies and expands the set of computational tasks that can be solved efficiently by recurrent computation, yielding hypotheses for structure in population activity that may be present in such tasks.

Transforming representations of movement from body- to world-centric space.

When an animal moves through the world, its brain receives a stream of information about the body's translational velocity from motor commands and sensory feedback signals. These incoming signals are referenced to the body, but ultimately, they must be transformed into world-centric coordinates for navigation1,2. Here we show that this computation occurs in the fan-shaped body in the brain of Drosophila melanogaster. We identify two cell types, PFNd and PFNv3-5, that conjunctively encode translational velocity and heading as a fly walks. In these cells, velocity signals are acquired from locomotor brain regions6 and are multiplied with heading signals from the compass system. PFNd neurons prefer forward-ipsilateral movement, whereas PFNv neurons prefer backward-contralateral movement, and perturbing PFNd neurons disrupts idiothetic path integration in walking flies7. Downstream, PFNd and PFNv neurons converge onto hΔB neurons, with a connectivity pattern that pools together heading and translation direction combinations corresponding to the same movement in world-centric space. This network motif effectively performs a rotation of the brain's representation of body-centric translational velocity according to the current heading direction. Consistent with our predictions, we observe that hΔB neurons form a representation of translational velocity in world-centric coordinates. By integrating this representation over time, it should be possible for the brain to form a working memory of the path travelled through the environment8-10.

Modularity and robustness of frontal cortical networks.

Neural activity underlying short-term memory is maintained by interconnected networks of brain regions. It remains unknown how brain regions interact to maintain persistent activity while exhibiting robustness to corrupt information in parts of the network. We simultaneously measured activity in large neuronal populations across mouse frontal hemispheres to probe interactions between brain regions. Activity across hemispheres was coordinated to maintain coherent short-term memory. Across mice, we uncovered individual variability in the organization of frontal cortical networks. A modular organization was required for the robustness of persistent activity to perturbations: each hemisphere retained persistent activity during perturbations of the other hemisphere, thus preventing local perturbations from spreading. A dynamic gating mechanism allowed hemispheres to coordinate coherent information while gating out corrupt information. Our results show that robust short-term memory is mediated by redundant modular representations across brain regions. Redundant modular representations naturally emerge in neural network models that learned robust dynamics.

Targeted photostimulation uncovers circuit motifs supporting short-term memory.

Short-term memory is associated with persistent neural activity that is maintained by positive feedback between neurons. To explore the neural circuit motifs that produce memory-related persistent activity, we measured coupling between functionally characterized motor cortex neurons in mice performing a memory-guided response task. Targeted two-photon photostimulation of small (<10) groups of neurons produced sparse calcium responses in coupled neurons over approximately 100 µm. Neurons with similar task-related selectivity were preferentially coupled. Photostimulation of different groups of neurons modulated activity in different subpopulations of coupled neurons. Responses of stimulated and coupled neurons persisted for seconds, far outlasting the duration of the photostimuli. Photostimuli produced behavioral biases that were predictable based on the selectivity of the perturbed neuronal population, even though photostimulation preceded the behavioral response by seconds. Our results suggest that memory-related neural circuits contain intercalated, recurrently connected modules, which can independently maintain selective persistent activity.