A neural circuit architecture for rapid learning in goal-directed navigation.

Anchoring goals to spatial representations enables flexible navigation but is challenging in novel environments when both representations must be acquired simultaneously. We propose a framework for how Drosophila uses internal representations of head direction (HD) to build goal representations upon selective thermal reinforcement. We show that flies use stochastically generated fixations and directed saccades to express heading preferences in an operant visual learning paradigm and that HD neurons are required to modify these preferences based on reinforcement. We used a symmetric visual setting to expose how flies' HD and goal representations co-evolve and how the reliability of these interacting representations impacts behavior. Finally, we describe how rapid learning of new goal headings may rest on a behavioral policy whose parameters are flexible but whose form is genetically encoded in circuit architecture. Such evolutionarily structured architectures, which enable rapidly adaptive behavior driven by internal representations, may be relevant across species.

A connectome of the Drosophila central complex reveals network motifs suitable for flexible navigation and context-dependent action selection.

Flexible behaviors over long timescales are thought to engage recurrent neural networks in deep brain regions, which are experimentally challenging to study. In insects, recurrent circuit dynamics in a brain region called the central complex (CX) enable directed locomotion, sleep, and context- and experience-dependent spatial navigation. We describe the first complete electron microscopy-based connectome of the Drosophila CX, including all its neurons and circuits at synaptic resolution. We identified new CX neuron types, novel sensory and motor pathways, and network motifs that likely enable the CX to extract the fly's head direction, maintain it with attractor dynamics, and combine it with other sensorimotor information to perform vector-based navigational computations. We also identified numerous pathways that may facilitate the selection of CX-driven behavioral patterns by context and internal state. The CX connectome provides a comprehensive blueprint necessary for a detailed understanding of network dynamics underlying sleep, flexible navigation, and state-dependent action selection.

The Neuroanatomical Ultrastructure and Function of a Biological Ring Attractor.

Neural representations of head direction (HD) have been discovered in many species. Theoretical work has proposed that the dynamics associated with these representations are generated, maintained, and updated by recurrent network structures called ring attractors. We evaluated this theorized structure-function relationship by performing electron-microscopy-based circuit reconstruction and RNA profiling of identified cell types in the HD system of Drosophila melanogaster. We identified motifs that have been hypothesized to maintain the HD representation in darkness, update it when the animal turns, and tether it to visual cues. Functional studies provided support for the proposed roles of individual excitatory or inhibitory circuit elements in shaping activity. We also discovered recurrent connections between neuronal arbors with mixed pre- and postsynaptic specializations. Our results confirm that the Drosophila HD network contains the core components of a ring attractor while also revealing unpredicted structural features that might enhance the network's computational power.

Mechanisms Underlying the Neural Computation of Head Direction.

Many animals use an internal sense of direction to guide their movements through the world. Neurons selective to head direction are thought to support this directional sense and have been found in a diverse range of species, from insects to primates, highlighting their evolutionary importance. Across species, most head-direction networks share four key properties: a unique representation of direction at all times, persistent activity in the absence of movement, integration of angular velocity to update the representation, and the use of directional cues to correct drift. The dynamics of theorized network structures called ring attractors elegantly account for these properties, but their relationship to brain circuits is unclear. Here, we review experiments in rodents and flies that offer insights into potential neural implementations of ring attractor networks. We suggest that a theory-guided search across model systems for biological mechanisms that enable such dynamics would uncover general principles underlying head-direction circuit function.

Generation of stable heading representations in diverse visual scenes.

Many animals rely on an internal heading representation when navigating in varied environments1-10. How this representation is linked to the sensory cues that define different surroundings is unclear. In the fly brain, heading is represented by 'compass' neurons that innervate a ring-shaped structure known as the ellipsoid body3,11,12. Each compass neuron receives inputs from 'ring' neurons that are selective for particular visual features13-16; this combination provides an ideal substrate for the extraction of directional information from a visual scene. Here we combine two-photon calcium imaging and optogenetics in tethered flying flies with circuit modelling, and show how the correlated activity of compass and visual neurons drives plasticity17-22, which flexibly transforms two-dimensional visual cues into a stable heading representation. We also describe how this plasticity enables the fly to convert a partial heading representation, established from orienting within part of a novel setting, into a complete heading representation. Our results provide mechanistic insight into the memory-related computations that are essential for flexible navigation in varied surroundings.

High-performance calcium sensors for imaging activity in neuronal populations and microcompartments.

Calcium imaging with genetically encoded calcium indicators (GECIs) is routinely used to measure neural activity in intact nervous systems. GECIs are frequently used in one of two different modes: to track activity in large populations of neuronal cell bodies, or to follow dynamics in subcellular compartments such as axons, dendrites and individual synaptic compartments. Despite major advances, calcium imaging is still limited by the biophysical properties of existing GECIs, including affinity, signal-to-noise ratio, rise and decay kinetics and dynamic range. Using structure-guided mutagenesis and neuron-based screening, we optimized the green fluorescent protein-based GECI GCaMP6 for different modes of in vivo imaging. The resulting jGCaMP7 sensors provide improved detection of individual spikes (jGCaMP7s,f), imaging in neurites and neuropil (jGCaMP7b), and may allow tracking larger populations of neurons using two-photon (jGCaMP7s,f) or wide-field (jGCaMP7c) imaging.

Busted! A Dope Ring with Activity Clocked at Dawn and Dusk.

Clock neurons generate circadian rhythms in behavioral activity, but the relevant pathways remain poorly understood. In this issue of Neuron, Liang et al. (2019) show that distinct clock neurons independently drive movement-promoting "ring neurons" in Drosophila through dopaminergic relays to support morning and evening locomotor activity.

Visually Guided Behavior and Optogenetically Induced Learning in Head-Fixed Flies Exploring a Virtual Landscape.

Studying the intertwined roles of sensation, experience, and directed action in navigation has been facilitated by the development of virtual reality (VR) environments for head-fixed animals, allowing for quantitative measurements of behavior in well-controlled conditions. VR has long featured in studies of Drosophila melanogaster, but these experiments have typically allowed the fly to change only its heading in a visual scene and not its position. Here we explore how flies move in two dimensions (2D) using a visual VR environment that more closely captures an animal's experience during free behavior. We show that flies' 2D interaction with landmarks cannot be automatically derived from their orienting behavior under simpler one-dimensional (1D) conditions. Using novel paradigms, we then demonstrate that flies in 2D VR adapt their behavior in response to optogenetically delivered appetitive and aversive stimuli. Much like free-walking flies after encounters with food, head-fixed flies exploring a 2D VR respond to optogenetic activation of sugar-sensing neurons by initiating a local search, which appears not to rely on visual landmarks. Visual landmarks can, however, help flies to avoid areas in VR where they experience an aversive, optogenetically generated heat stimulus. By coupling aversive virtual heat to the flies' presence near visual landmarks of specific shapes, we elicit selective learned avoidance of those landmarks. Thus, we demonstrate that head-fixed flies adaptively navigate in 2D virtual environments, but their reliance on visual landmarks is context dependent. These behavioral paradigms set the stage for interrogation of the fly brain circuitry underlying flexible navigation in complex multisensory environments.

Building a functional connectome of the Drosophila central complex.

The central complex is a highly conserved insect brain region composed of morphologically stereotyped neurons that arborize in distinctively shaped substructures. The region is implicated in a wide range of behaviors and several modeling studies have explored its circuit computations. Most studies have relied on assumptions about connectivity between neurons based on their overlap in light microscopy images. Here, we present an extensive functional connectome of Drosophila melanogaster's central complex at cell-type resolution. Using simultaneous optogenetic stimulation, calcium imaging and pharmacology, we tested the connectivity between 70 presynaptic-to-postsynaptic cell-type pairs. We identified numerous inputs to the central complex, but only a small number of output channels. Additionally, the connectivity of this highly recurrent circuit appears to be sparser than anticipated from light microscopy images. Finally, the connectivity matrix highlights the potentially critical role of a class of bottleneck interneurons. All data are provided for interactive exploration on a website.

Neural signatures of dynamic stimulus selection in Drosophila.

Many animals orient using visual cues, but how a single cue is selected from among many is poorly understood. Here we show that Drosophila ring neurons-central brain neurons implicated in navigation-display visual stimulus selection. Using in vivo two-color two-photon imaging with genetically encoded calcium indicators, we demonstrate that individual ring neurons inherit simple-cell-like receptive fields from their upstream partners. Stimuli in the contralateral visual field suppressed responses to ipsilateral stimuli in both populations. Suppression strength depended on when and where the contralateral stimulus was presented, an effect stronger in ring neurons than in their upstream inputs. This history-dependent effect on the temporal structure of visual responses, which was well modeled by a simple biphasic filter, may determine how visual references are selected for the fly's internal compass. Our approach highlights how two-color calcium imaging can help identify and localize the origins of sensory transformations across synaptically connected neural populations.

Angular velocity integration in a fly heading circuit.

Many animals maintain an internal representation of their heading as they move through their surroundings. Such a compass representation was recently discovered in a neural population in the Drosophila melanogaster central complex, a brain region implicated in spatial navigation. Here, we use two-photon calcium imaging and electrophysiology in head-fixed walking flies to identify a different neural population that conjunctively encodes heading and angular velocity, and is excited selectively by turns in either the clockwise or counterclockwise direction. We show how these mirror-symmetric turn responses combine with the neurons' connectivity to the compass neurons to create an elegant mechanism for updating the fly's heading representation when the animal turns in darkness. This mechanism, which employs recurrent loops with an angular shift, bears a resemblance to those proposed in theoretical models for rodent head direction cells. Our results provide a striking example of structure matching function for a broadly relevant computation.

Ring attractor dynamics in the Drosophila central brain.

Ring attractors are a class of recurrent networks hypothesized to underlie the representation of heading direction. Such network structures, schematized as a ring of neurons whose connectivity depends on their heading preferences, can sustain a bump-like activity pattern whose location can be updated by continuous shifts along either turn direction. We recently reported that a population of fly neurons represents the animal's heading via bump-like activity dynamics. We combined two-photon calcium imaging in head-fixed flying flies with optogenetics to overwrite the existing population representation with an artificial one, which was then maintained by the circuit with naturalistic dynamics. A network with local excitation and global inhibition enforces this unique and persistent heading representation. Ring attractor networks have long been invoked in theoretical work; our study provides physiological evidence of their existence and functional architecture.

The insect central complex.

Hordes of tourists flock to Washington, D.C. every spring to see the cherry trees blossom. Once in the city, they must find their way to the Tidal Basin where the Japanese trees grow. Fortunately, a number of visual landmarks can help them to navigate. In 1910, the United States Congress passed The Height of Buildings Act, limiting the elevation of commercial and residential structures in D.C. to 130 feet. Thus, the 555-foot-tall Washington Monument often looms large against the horizon, serving as an anchor point to help set the tourists' sense of direction. Once their heading is set, they can lose sight of the monument behind buildings or groups of tall Scandinavian visitors and still use their internal compass to navigate to the Basin. This compass keeps track of their paces and turns and updates their sense of where they are and where they need to go. Yet while their heading informs their actions, it does not dictate them. Tourists who have been to D.C. in the past can, for example, use remembered views to alter their routes to avoid crowds. On an even finer scale, their leg movements also depend on their current state - they might increase the frequency and length of their strides if hunger pangs compete with their desire to see cherry blossoms, for example. The way in which these disparate cues and motivations influence exploration is a neuroscience mystery across creatures large and small.

Sensitive red protein calcium indicators for imaging neural activity.

Genetically encoded calcium indicators (GECIs) allow measurement of activity in large populations of neurons and in small neuronal compartments, over times of milliseconds to months. Although GFP-based GECIs are widely used for in vivo neurophysiology, GECIs with red-shifted excitation and emission spectra have advantages for in vivo imaging because of reduced scattering and absorption in tissue, and a consequent reduction in phototoxicity. However, current red GECIs are inferior to the state-of-the-art GFP-based GCaMP6 indicators for detecting and quantifying neural activity. Here we present improved red GECIs based on mRuby (jRCaMP1a, b) and mApple (jRGECO1a), with sensitivity comparable to GCaMP6. We characterized the performance of the new red GECIs in cultured neurons and in mouse, Drosophila, zebrafish and C. elegans in vivo. Red GECIs facilitate deep-tissue imaging, dual-color imaging together with GFP-based reporters, and the use of optogenetics in combination with calcium imaging.

Studying small brains to understand the building blocks of cognition.

Cognition encompasses a range of higher-order mental processes, such as attention, working memory, and model-based decision-making. These processes are thought to involve the dynamic interaction of multiple central brain regions. A mechanistic understanding of such computations requires not only monitoring and manipulating specific neural populations during behavior, but also knowing the connectivity of the underlying circuitry. These goals are experimentally challenging in mammals, but are feasible in numerically simpler insect brains. In Drosophila melanogaster in particular, genetic tools enable precisely targeted physiology and optogenetics in actively behaving animals. In this article we discuss how these advantages are increasingly being leveraged to study abstract neural representations and sensorimotor computations that may be relevant for cognition in both insects and mammals.

Central neural circuitry mediating courtship song perception in male Drosophila.

Animals use acoustic signals across a variety of social behaviors, particularly courtship. In Drosophila, song is detected by antennal mechanosensory neurons and further processed by second-order aPN1/aLN(al) neurons. However, little is known about the central pathways mediating courtship hearing. In this study, we identified a male-specific pathway for courtship hearing via third-order ventrolateral protocerebrum Projection Neuron 1 (vPN1) neurons and fourth-order pC1 neurons. Genetic inactivation of vPN1 or pC1 disrupts song-induced male-chaining behavior. Calcium imaging reveals that vPN1 responds preferentially to pulse song with long inter-pulse intervals (IPIs), while pC1 responses to pulse song closely match the behavioral chaining responses at different IPIs. Moreover, genetic activation of either vPN1 or pC1 induced courtship chaining, mimicking the behavioral response to song. These results outline the aPN1-vPN1-pC1 pathway as a labeled line for the processing and transformation of courtship song in males.

Dynamical feature extraction at the sensory periphery guides chemotaxis.

Behavioral strategies employed for chemotaxis have been described across phyla, but the sensorimotor basis of this phenomenon has seldom been studied in naturalistic contexts. Here, we examine how signals experienced during free olfactory behaviors are processed by first-order olfactory sensory neurons (OSNs) of the Drosophila larva. We find that OSNs can act as differentiators that transiently normalize stimulus intensity-a property potentially derived from a combination of integral feedback and feed-forward regulation of olfactory transduction. In olfactory virtual reality experiments, we report that high activity levels of the OSN suppress turning, whereas low activity levels facilitate turning. Using a generalized linear model, we explain how peripheral encoding of olfactory stimuli modulates the probability of switching from a run to a turn. Our work clarifies the link between computations carried out at the sensory periphery and action selection underlying navigation in odor gradients.

Neural dynamics for landmark orientation and angular path integration.

Many animals navigate using a combination of visual landmarks and path integration. In mammalian brains, head direction cells integrate these two streams of information by representing an animal's heading relative to landmarks, yet maintaining their directional tuning in darkness based on self-motion cues. Here we use two-photon calcium imaging in head-fixed Drosophila melanogaster walking on a ball in a virtual reality arena to demonstrate that landmark-based orientation and angular path integration are combined in the population responses of neurons whose dendrites tile the ellipsoid body, a toroidal structure in the centre of the fly brain. The neural population encodes the fly's azimuth relative to its environment, tracking visual landmarks when available and relying on self-motion cues in darkness. When both visual and self-motion cues are absent, a representation of the animal's orientation is maintained in this network through persistent activity, a potential substrate for short-term memory. Several features of the population dynamics of these neurons and their circular anatomical arrangement are suggestive of ring attractors, network structures that have been proposed to support the function of navigational brain circuits.

Neural circuits. Labeling of active neural circuits in vivo with designed calcium integrators.

The identification of active neurons and circuits in vivo is a fundamental challenge in understanding the neural basis of behavior. Genetically encoded calcium (Ca(2+)) indicators (GECIs) enable quantitative monitoring of cellular-resolution activity during behavior. However, such indicators require online monitoring within a limited field of view. Alternatively, post hoc staining of immediate early genes (IEGs) indicates highly active cells within the entire brain, albeit with poor temporal resolution. We designed a fluorescent sensor, CaMPARI, that combines the genetic targetability and quantitative link to neural activity of GECIs with the permanent, large-scale labeling of IEGs, allowing a temporally precise "activity snapshot" of a large tissue volume. CaMPARI undergoes efficient and irreversible green-to-red conversion only when elevated intracellular Ca(2+) and experimenter-controlled illumination coincide. We demonstrate the utility of CaMPARI in freely moving larvae of zebrafish and flies, and in head-fixed mice and adult flies.