Internal models direct dragonfly interception steering.

Sensorimotor control in vertebrates relies on internal models. When extending an arm to reach for an object, the brain uses predictive models of both limb dynamics and target properties. Whether invertebrates use such models remains unclear. Here we examine to what extent prey interception by dragonflies (Plathemis lydia), a behaviour analogous to targeted reaching, requires internal models. By simultaneously tracking the position and orientation of a dragonfly's head and body during flight, we provide evidence that interception steering is driven by forward and inverse models of dragonfly body dynamics and by models of prey motion. Predictive rotations of the dragonfly's head continuously track the prey's angular position. The head-body angles established by prey tracking appear to guide systematic rotations of the dragonfly's body to align it with the prey's flight path. Model-driven control thus underlies the bulk of interception steering manoeuvres, while vision is used for reactions to unexpected prey movements. These findings illuminate the computational sophistication with which insects construct behaviour.

The Role of Motion Extrapolation in Amphibian Prey Capture.

Sensorimotor delays decouple behaviors from the events that drive them. The brain compensates for these delays with predictive mechanisms, but the efficacy and timescale over which these mechanisms operate remain poorly understood. Here, we assess how prediction is used to compensate for prey movement that occurs during visuomotor processing. We obtained high-speed video records of freely moving, tongue-projecting salamanders catching walking prey, emulating natural foraging conditions. We found that tongue projections were preceded by a rapid head turn lasting ∼ 130 ms. This motor lag, combined with the ∼ 100 ms phototransduction delay at photopic light levels, gave a ∼ 230 ms visuomotor response delay during which prey typically moved approximately one body length. Tongue projections, however, did not significantly lag prey position but were highly accurate instead. Angular errors in tongue projection accuracy were consistent with a linear extrapolation model that predicted prey position at the time of tongue contact using the average prey motion during a ∼ 175 ms period one visual latency before the head movement. The model explained successful strikes where the tongue hit the fly, and unsuccessful strikes where the fly turned and the tongue hit a phantom location consistent with the fly's earlier trajectory. The model parameters, obtained from the data, agree with the temporal integration and latency of retinal responses proposed to contribute to motion extrapolation. These results show that the salamander predicts future prey position and that prediction significantly improves prey capture success over a broad range of prey speeds and light levels. SIGNIFICANCE STATEMENT: Neural processing delays cause actions to lag behind the events that elicit them. To cope with these delays, the brain predicts what will happen in the future. While neural circuits in the retina and beyond have been suggested to participate in such predictions, few behaviors have been explored sufficiently to constrain circuit function. Here we show that salamanders aim their tongues by using extrapolation to estimate future prey position, thereby compensating for internal delays from both visual and motor processing. Predictions made just before a prey turn resulted in the tongue being projected to a position consistent with the prey's pre-turn trajectory. These results define the computations and operating regimen for neural circuits that predict target motion.

Nonlinear dynamics support a linear population code in a retinal target-tracking circuit.

A basic task faced by the visual system of many organisms is to accurately track the position of moving prey. The retina is the first stage in the processing of such stimuli; the nature of the transformation here, from photons to spike trains, constrains not only the ultimate fidelity of the tracking signal but also the ease with which it can be extracted by other brain regions. Here we demonstrate that a population of fast-OFF ganglion cells in the salamander retina, whose dynamics are governed by a nonlinear circuit, serve to compute the future position of the target over hundreds of milliseconds. The extrapolated position of the target is not found by stimulus reconstruction but is instead computed by a weighted sum of ganglion cell outputs, the population vector average (PVA). The magnitude of PVA extrapolation varies systematically with target size, speed, and acceleration, such that large targets are tracked most accurately at high speeds, and small targets at low speeds, just as is seen in the motion of real prey. Tracking precision reaches the resolution of single photoreceptors, and the PVA algorithm performs more robustly than several alternative algorithms. If the salamander brain uses the fast-OFF cell circuit for target extrapolation as we suggest, the circuit dynamics should leave a microstructure on the behavior that may be measured in future experiments. Our analysis highlights the utility of simple computations that, while not globally optimal, are efficiently implemented and have close to optimal performance over a limited but ethologically relevant range of stimuli.

Large-scale, high-density (up to 512 channels) recording of local circuits in behaving animals.

Monitoring representative fractions of neurons from multiple brain circuits in behaving animals is necessary for understanding neuronal computation. Here, we describe a system that allows high-channel-count recordings from a small volume of neuronal tissue using a lightweight signal multiplexing headstage that permits free behavior of small rodents. The system integrates multishank, high-density recording silicon probes, ultraflexible interconnects, and a miniaturized microdrive. These improvements allowed for simultaneous recordings of local field potentials and unit activity from hundreds of sites without confining free movements of the animal. The advantages of large-scale recordings are illustrated by determining the electroanatomic boundaries of layers and regions in the hippocampus and neocortex and constructing a circuit diagram of functional connections among neurons in real anatomic space. These methods will allow the investigation of circuit operations and behavior-dependent interregional interactions for testing hypotheses of neural networks and brain function.

Recovery mechanisms in the dragonfly righting reflex.

Insects have evolved sophisticated reflexes to right themselves in mid-air. Their recovery mechanisms involve complex interactions among the physical senses, muscles, body, and wings, and they must obey the laws of flight. We sought to understand the key mechanisms involved in dragonfly righting reflexes and to develop physics-based models for understanding the control strategies of flight maneuvers. Using kinematic analyses, physical modeling, and three-dimensional flight simulations, we found that a dragonfly uses left-right wing pitch asymmetry to roll its body 180 degrees to recover from falling upside down in ~200 milliseconds. Experiments of dragonflies with blocked vision further revealed that this rolling maneuver is initiated by their ocelli and compound eyes. These results suggest a pathway from the dragonfly's visual system to the muscles regulating wing pitch that underly the recovery. The methods developed here offer quantitative tools for inferring insects' internal actions from their acrobatics, and are applicable to a broad class of natural and robotic flying systems.

Heuristic Rules Underlying Dragonfly Prey Selection and Interception.

Animals use rules to initiate behaviors. Such rules are often described as triggers that determine when behavior begins. However, although less explored, these selection rules are also an opportunity to establish sensorimotor constraints that influence how the behavior ends. These constraints may be particularly significant in influencing success in prey capture. Here we explore this in dragonfly prey interception. We found that in the moments leading up to takeoff, perched dragonflies employ a series of sensorimotor rules that determine the time of takeoff and increase the probability of successful capture. First, the dragonfly makes a head saccade followed by smooth pursuit movements to orient its direction-of-gaze at potential prey. Second, the dragonfly assesses whether the prey's angular size and speed co-vary within a privileged range. Finally, the dragonfly times the moment of its takeoff to a prediction of when the prey will cross the zenith. Each of these processes serves a purpose. The angular size-speed criteria biases interception flights to catchable prey, while the head movements and the predictive takeoff ensure flights begin with the prey visually fixated and directly overhead-the key parameters that underlie interception steering. Prey that do not elicit takeoff generally fail at least one of the criterion, and the loss of prey fixation or overhead positioning during flight is strongly correlated with terminated flights. Thus from an abundance of potential targets, the dragonfly selects a stereotyped set of takeoff conditions based on the prey and body states most likely to end in successful capture.

Ensemble coding of vocal control in birdsong.

Zebra finch song is represented in the high-level motor control nucleus high vocal center (HVC) (Reiner et al., 2004) as a sparse sequence of spike bursts. In contrast, the vocal organ is driven continuously by smoothly varying muscle control signals. To investigate how the sparse HVC code is transformed into continuous vocal patterns, we recorded in the singing zebra finch from populations of neurons in the robust nucleus of arcopallium (RA), a premotor area intermediate between HVC and the motor neurons. We found that highly similar song elements are typically produced by different RA ensembles. Furthermore, although the song is modulated on a wide range of time scales (10-100 ms), patterns of neural activity in RA change only on a short time scale (5-10 ms). We suggest that song is driven by a dynamic circuit that operates on a single underlying clock, and that the large convergence of RA neurons to vocal control muscles results in a many-to-one mapping of RA activity to song structure. This permits rapidly changing RA ensembles to drive both fast and slow acoustic modulations, thereby transforming the sparse HVC code into a continuous vocal pattern.

Theta sequences are essential for internally generated hippocampal firing fields.

Sensory cue inputs and memory-related internal brain activities govern the firing of hippocampal neurons, but which specific firing patterns are induced by either of the two processes remains unclear. We found that sensory cues guided the firing of neurons in rats on a timescale of seconds and supported the formation of spatial firing fields. Independently of the sensory inputs, the memory-related network activity coordinated the firing of neurons not only on a second-long timescale, but also on a millisecond-long timescale, and was dependent on medial septum inputs. We propose a network mechanism that might coordinate this internally generated firing. Overall, we suggest that two independent mechanisms support the formation of spatial firing fields in hippocampus, but only the internally organized system supports short-timescale sequential firing and episodic memory.

A spike-timing mechanism for action selection.

We discovered a bimodal behavior in the genetically tractable organism Drosophila melanogaster that allowed us to directly probe the neural mechanisms of an action selection process. When confronted by a predator-mimicking looming stimulus, a fly responds with either a long-duration escape behavior sequence that initiates stable flight or a distinct, short-duration sequence that sacrifices flight stability for speed. Intracellular recording of the descending giant fiber (GF) interneuron during head-fixed escape revealed that GF spike timing relative to parallel circuits for escape actions determined which of the two behavioral responses was elicited. The process was well described by a simple model in which the GF circuit has a higher activation threshold than the parallel circuits, but can override ongoing behavior to force a short takeoff. Our findings suggest a neural mechanism for action selection in which relative activation timing of parallel circuits creates the appropriate motor output.

A battery-free multichannel digital neural/EMG telemetry system for flying insects.

This paper presents a digital neural/EMG telemetry system small enough and lightweight enough to permit recording from insects in flight. It has a measured flight package mass of only 38 mg. This system includes a single-chip telemetry integrated circuit (IC) employing RF power harvesting for battery-free operation, with communication via modulated backscatter in the UHF (902-928 MHz) band. An on-chip 11-bit ADC digitizes 10 neural channels with a sampling rate of 26.1 kSps and 4 EMG channels at 1.63 kSps, and telemeters this data wirelessly to a base station. The companion base station transceiver includes an RF transmitter of +36 dBm (4 W) output power to wirelessly power the telemetry IC, and a digital receiver with a sensitivity of -70 dBm for 10⁻5 BER at 5.0 Mbps to receive the data stream from the telemetry IC. The telemetry chip was fabricated in a commercial 0.35 µ m 4M1P (4 metal, 1 poly) CMOS process. The die measures 2.36 × 1.88 mm, is 250 µm thick, and is wire bonded into a flex circuit assembly measuring 4.6 × 6.8 mm.

Degenerate coding in neural systems.

When the dimensionality of a neural circuit is substantially larger than the dimensionality of the variable it encodes, many different degenerate network states can produce the same output. In this review I will discuss three different neural systems that are linked by this theme. The pyloric network of the lobster, the song control system of the zebra finch, and the odor encoding system of the locust, while different in design, all contain degeneracies between their internal parameters and the outputs they encode. Indeed, although the dynamics of song generation and odor identification are quite different, computationally, odor recognition can be thought of as running the song generation circuitry backwards. In both of these systems, degeneracy plays a vital role in mapping a sparse neural representation devoid of correlations onto external stimuli (odors or song structure) that are strongly correlated. I argue that degeneracy between input and output states is an inherent feature of many neural systems, which can be exploited as a fault-tolerant method of reliably learning, generating, and discriminating closely related patterns.

Experimental test of the birdsong error-correction model.

Adult zebra finches require auditory feedback to maintain their songs. It has been proposed that the lateral magnocellular nucleus of the anterior nidopallium (LMAN) mediates song plasticity based on auditory feedback. In this model, neurons in LMAN, tuned to the spectral and temporal properties of the bird's own song (BOS), are thought to compute the difference between the auditory feedback from the bird's vocalizations and an internal song template. This error-correction signal is then used to initiate changes in the motor system that make future vocalizations a better match to the song template. This model was tested by recording from single LMAN neurons while manipulating the auditory feedback heard by singing birds. In contrast to the model predictions, LMAN spike patterns are insensitive to manipulations of auditory feedback. These results suggest that BOS tuning in LMAN is not used for error detection and constrain the nature of any error signal from LMAN to the motor system. Finally, LMAN neurons produce spikes locked precisely to the bird's song, independent of the auditory feedback heard by the bird. This finding suggests that a large portion of the input to this nucleus is from the motor control signals that generate the song rather than from auditory feedback.