Wiring up for controlled flight.

A map showing how neurons that process motion are wired together in the visual system of fruit flies provides new insights into how animals navigate and remain stable when flying.

Enhancing LGMD-based model for collision prediction via binocular structure.

Introduction: Lobular giant motion detector (LGMD) neurons, renowned for their distinctive response to looming stimuli, inspire the development of visual neural network models for collision prediction. However, the existing LGMD-based models could not yet incorporate the invaluable feature of depth distance and still suffer from the following two primary drawbacks. Firstly, they struggle to effectively distinguish the three fundamental motion patterns of approaching, receding, and translating, in contrast to the natural abilities of LGMD neurons. Secondly, due to their reliance on a general determination process employing an activation function and fixed threshold for output, these models exhibit dramatic fluctuations in prediction effectiveness across different scenarios. Methods: To address these issues, we propose a novel LGMD-based model with a binocular structure (Bi-LGMD). The depth distance of the moving object is extracted by calculating the binocular disparity facilitating a clear differentiation of the motion patterns, after obtaining the moving object's contour through the basic components of the LGMD network. In addition, we introduce a self-adaptive warning depth-distance, enhancing the model's robustness in various motion scenarios. Results: The effectiveness of the proposed model is verified using computer-simulated and real-world videos. Discussion: Furthermore, the experimental results demonstrate that the proposed model is robust to contrast and noise.

An insect-inspired model facilitating autonomous navigation by incorporating goal approaching and collision avoidance.

Being one of the most fundamental and crucial capacity of robots and animals, autonomous navigation that consists of goal approaching and collision avoidance enables completion of various tasks while traversing different environments. In light of the impressive navigational abilities of insects despite their tiny brains compared to mammals, the idea of seeking solutions from insects for the two key problems of navigation, i.e., goal approaching and collision avoidance, has fascinated researchers and engineers for many years. However, previous bio-inspired studies have focused on merely one of these two problems at one time. Insect-inspired navigation algorithms that synthetically incorporate both goal approaching and collision avoidance, and studies that investigate the interactions of these two mechanisms in the context of sensory-motor closed-loop autonomous navigation are lacking. To fill this gap, we propose an insect-inspired autonomous navigation algorithm to integrate the goal approaching mechanism as the global working memory inspired by the sweat bee's path integration (PI) mechanism, and the collision avoidance model as the local immediate cue built upon the locust's lobula giant movement detector (LGMD) model. The presented algorithm is utilized to drive agents to complete navigation task in a sensory-motor closed-loop manner within a bounded static or dynamic environment. Simulation results demonstrate that the synthetic algorithm is capable of guiding the agent to complete challenging navigation tasks in a robust and efficient way. This study takes the first tentative step to integrate the insect-like navigation mechanisms with different functionalities (i.e., global goal and local interrupt) into a coordinated control system that future research avenues could build upon.

Matched function of the neuropil processing optic flow in flies and crabs: the lobula plate mediates optomotor responses in Neohelice granulata.

When an animal rotates (whether it is an arthropod, a fish, a bird or a human) a drift of the visual panorama occurs over its retina, termed optic flow. The image is stabilized by compensatory behaviours (driven by the movement of the eyes, head or the whole body depending on the animal) collectively termed optomotor responses. The dipteran lobula plate has been consistently linked with optic flow processing and the control of optomotor responses. Crabs have a neuropil similarly located and interconnected in the optic lobes, therefore referred to as a lobula plate too. Here we show that the crabs' lobula plate is required for normal optomotor responses since the response was lost or severely impaired in animals whose lobula plate had been lesioned. The effect was behaviour-specific, since avoidance responses to approaching visual stimuli were not affected. Crabs require simpler optic flow processing than flies (because they move slower and in two-dimensional instead of three-dimensional space), consequently their lobula plates are relatively smaller. Nonetheless, they perform the same essential role in the visual control of behaviour. Our findings add a fundamental piece to the current debate on the evolutionary relationship between the lobula plates of insects and crustaceans.

Immunohistochemical Distribution of Serotonin Transporter (SERT) in the Optic Lobe of the Honeybee, Apis mellifera.

Visual information is processed in the optic lobes, which consist of three retinotopic neuropils. These are the lamina, the medulla and the lobula. Biogenic amines play a crucial role in the control of insect responsiveness, and serotonin is clearly related to aggressiveness in invertebrates. Previous studies suggest that serotonin modulates aggression-related behaviours, possibly via alterations in optic lobe activity. The aim of this investigation was to immunohistochemically localize the distribution of serotonin transporter (SERT) in the optic lobe of moderate, docile and aggressive worker honeybees. SERT-immunoreactive fibres showed a wide distribution in the lamina, medulla and lobula; interestingly, the highest percentage of SERT immunoreactivity was observed across all the visual neuropils of the docile group. Although future research is needed to determine the relationship between the distribution of serotonin fibres in the honeybee brain and aggressive behaviours, our immunohistochemical study provides an anatomical basis supporting the role of serotonin in aggressive behaviour in the honeybee.

Neuronal circuits integrating visual motion information in Drosophila melanogaster.

The detection of visual motion enables sophisticated animal navigation, and studies on flies have provided profound insights into the cellular and circuit bases of this neural computation. The fly's directionally selective T4 and T5 neurons encode ON and OFF motion, respectively. Their axons terminate in one of the four retinotopic layers in the lobula plate, where each layer encodes one of the four directions of motion. Although the input circuitry of the directionally selective neurons has been studied in detail, the synaptic connectivity of circuits integrating T4/T5 motion signals is largely unknown. Here, we report a 3D electron microscopy reconstruction, wherein we comprehensively identified T4/T5's synaptic partners in the lobula plate, revealing a diverse set of new cell types and attributing new connectivity patterns to the known cell types. Our reconstruction explains how the ON- and OFF-motion pathways converge. T4 and T5 cells that project to the same layer connect to common synaptic partners and comprise a core motif together with bilayer interneurons, detailing the circuit basis for computing motion opponency. We discovered pathways that likely encode new directions of motion by integrating vertical and horizontal motion signals from upstream T4/T5 neurons. Finally, we identify substantial projections into the lobula, extending the known motion pathways and suggesting that directionally selective signals shape feature detection there. The circuits we describe enrich the anatomical basis for experimental and computations analyses of motion vision and bring us closer to understanding complete sensory-motor pathways.

Anatomical distribution and functional roles of electrical synapses in Drosophila.

Electrical synapses are present in almost all organisms that have a nervous system. However, their brain-wide expression patterns and the full range of contributions to neural function are unknown in most species. Here, we first provide a light-microscopic, immunohistochemistry-based anatomical map of all innexin gap junction proteins-the building blocks of electrical synapses-in the central nervous system of Drosophila melanogaster. Of those innexin types that are expressed in the nervous system, some localize to glial cells, whereas others are predominantly expressed in neurons, with shakB being the most widely expressed neuronal innexin. We then focus on the function of shakB in VS/HS cells-a class of visual projection neurons-thereby uncovering an unexpected role for electrical synapses. Removing shakB from these neurons leads to spontaneous, cell-autonomous voltage and calcium oscillations, demonstrating that electrical synapses are required for these cells' intrinsic stability. Furthermore, we investigate the role of shakB-type electrical synapses in early visual processing. We find that the loss of shakB from the visual circuits upstream of VS/HS cells differentially impairs ON and OFF visual motion processing pathways but is not required for the computation of direction selectivity per se. Taken together, our study demonstrates that electrical synapses are widespread across the Drosophila nervous system and that they play essential roles in neuronal function and visual information processing.

Identifying Inputs to Visual Projection Neurons in Drosophila Lobula by Analyzing Connectomic Data.

Electron microscopy (EM)-based connectomes provide important insights into how visual circuitry of fruit fly Drosophila computes various visual features, guiding and complementing behavioral and physiological studies. However, connectomic analyses of the lobula, a neuropil putatively dedicated to detecting object-like features, remains underdeveloped, largely because of incomplete data on the inputs to the brain region. Here, we attempted to map the columnar inputs into the Drosophila lobula neuropil by performing connectivity-based and morphology-based clustering on a densely reconstructed connectome dataset. While the dataset mostly lacked visual neuropils other than lobula, which would normally help identify inputs to lobula, our clustering analysis successfully extracted clusters of cells with homogeneous connectivity and morphology, likely representing genuine cell types. We were able to draw a correspondence between the resulting clusters and previously identified cell types, revealing previously undocumented connectivity between lobula input and output neurons. While future, more complete connectomic reconstructions are necessary to verify the results presented here, they can serve as a useful basis for formulating hypotheses on mechanisms of visual feature detection in lobula.

A functionally ordered visual feature map in the Drosophila brain.

Topographic maps, the systematic spatial ordering of neurons by response tuning, are common across species. In Drosophila, the lobula columnar (LC) neuron types project from the optic lobe to the central brain, where each forms a glomerulus in a distinct position. However, the advantages of this glomerular arrangement are unclear. Here, we examine the functional and spatial relationships of 10 glomeruli using single-neuron calcium imaging. We discover novel detectors for objects smaller than the lens resolution (LC18) and for complex line motion (LC25). We find that glomeruli are spatially clustered by selectivity for looming versus drifting object motion and ordered by size tuning to form a topographic visual feature map. Furthermore, connectome analysis shows that downstream neurons integrate from sparse subsets of possible glomeruli combinations, which are biased for glomeruli encoding similar features. LC neurons are thus an explicit example of distinct feature detectors topographically organized to facilitate downstream circuit integration.

Neural organization of the third optic neuropil, the lobula, in the highly visual semiterrestrial crab Neohelice granulata.

The visual neuropils (lamina, medulla, and lobula complex) of malacostracan crustaceans and hexapods have many organizational principles, cell types, and functional properties in common. Information about the cellular elements that compose the crustacean lobula is scarce especially when focusing on small columnar cells. Semiterrestrial crabs possess a highly developed visual system and display conspicuous visually guided behaviors. In particular, Neohelice granulata has been previously used to describe the cellular components of the first two optic neuropils using Golgi impregnation technique. Here, we present a comprehensive description of individual elements composing the third optic neuropil, the lobula, of that same species. We characterized a wide variety of elements (140 types) including input terminals and lobula columnar, centrifugal, and input columnar elements. Results reveal a very dense and complex neuropil. We found a frequently impregnated input element (suggesting a supernumerary cartridge representation) that arborizes in the third layer of the lobula and that presents four variants each with ramifications organized following one of the four cardinal axes suggesting a role in directional processing. We also describe input elements with two neurites branching in the third layer, probably connecting with the medulla and lobula plate. These facts suggest that this layer is involved in the directional motion detection pathway in crabs. We analyze and discuss our findings considering the similarities and differences found between the layered organization and components of this crustacean lobula and the lobula of insects.

The impulse response of optic flow-sensitive descending neurons to roll m-sequences.

When animals move through the world, their own movements generate widefield optic flow across their eyes. In insects, such widefield motion is encoded by optic lobe neurons. These lobula plate tangential cells (LPTCs) synapse with optic flow-sensitive descending neurons, which in turn project to areas that control neck, wing and leg movements. As the descending neurons play a role in sensorimotor transformation, it is important to understand their spatio-temporal response properties. Recent work shows that a relatively fast and efficient way to quantify such response properties is to use m-sequences or other white noise techniques. Therefore, here we used m-sequences to quantify the impulse responses of optic flow-sensitive descending neurons in male Eristalis tenax hoverflies. We focused on roll impulse responses as hoverflies perform exquisite head roll stabilizing reflexes, and the descending neurons respond particularly well to roll. We found that the roll impulse responses were fast, peaking after 16.5-18.0 ms. This is similar to the impulse response time to peak (18.3 ms) to widefield horizontal motion recorded in hoverfly LPTCs. We found that the roll impulse response amplitude scaled with the size of the stimulus impulse, and that its shape could be affected by the addition of constant velocity roll or lift. For example, the roll impulse response became faster and stronger with the addition of excitatory stimuli, and vice versa. We also found that the roll impulse response had a long return to baseline, which was significantly and substantially reduced by the addition of either roll or lift.

Modeling Nonlinear Dendritic Processing of Facilitation in a Dragonfly Target-Tracking Neuron.

Dragonflies are highly skilled and successful aerial predators that are even capable of selectively attending to one target within a swarm. Detection and tracking of prey is likely to be driven by small target motion detector (STMD) neurons identified from several insect groups. Prior work has shown that dragonfly STMD responses are facilitated by targets moving on a continuous path, enhancing the response gain at the present and predicted future location of targets. In this study, we combined detailed morphological data with computational modeling to test whether a combination of dendritic morphology and nonlinear properties of NMDA receptors could explain these observations. We developed a hybrid computational model of neurons within the dragonfly optic lobe, which integrates numerical and morphological components. The model was able to generate potent facilitation for targets moving on continuous trajectories, including a localized spotlight of maximal sensitivity close to the last seen target location, as also measured during in vivo recordings. The model did not, however, include a mechanism capable of producing a traveling or spreading wave of facilitation. Our data support a strong role for the high dendritic density seen in the dragonfly neuron in enhancing non-linear facilitation. An alternative model based on the morphology of an unrelated type of motion processing neuron from a dipteran fly required more than three times higher synaptic gain in order to elicit similar levels of facilitation, despite having only 20% fewer synapses. Our data support a potential role for NMDA receptors in target tracking and also demonstrate the feasibility of combining biologically plausible dendritic computations with more abstract computational models for basic processing as used in earlier studies.

Acute Application of Imidacloprid Alters the Sensitivity of Direction Selective Motion Detecting Neurons in an Insect Pollinator.

Cholinergic pesticides, such as the neonicotinoid imidacloprid, are the most important insecticides used for plant protection worldwide. In recent decades, concerns have been raised about side effects on non-target insect species, including altered foraging behavior and navigation. Although pollinators rely on visual cues to forage and navigate their environment, the effects of neonicotinoids on visual processing have been largely overlooked. To test the effect of acute treatment with imidacloprid at known concentrations in the brain, we developed a modified electrophysiological setup that allows recordings of visually evoked responses while perfusing the brain in vivo. We obtained long-lasting recordings from direction selective wide-field, motion sensitive neurons of the hoverfly pollinator, Eristalis tenax. Neurons were treated with imidacloprid (3.9 µM, 0.39 µM or a sham control treatment using the solvent (dimethylsulfoxide) only. Exposure to a high, yet sub-lethal concentration of imidacloprid significantly alters their physiological response to motion stimuli. We observed a general effect of imidacloprid (3.9 µM) increasing spontaneous activity, reducing contrast sensitivity and giving weaker directional tuning to wide-field moving stimuli, with likely implications for errors in flight control, hovering and routing. Our electrophysiological approach reveals the robustness of the fly visual pathway against cholinergic perturbance (i.e., at 0.39 µM) but also potential threatening effects of cholinergic pesticides (i.e., evident at 3.9 µM) for the visual motion detecting system of an important pollinator.

The lobula plate is exclusive to insects.

Just one superorder of insects is known to possess a neuronal network that mediates extremely rapid reactions in flight in response to changes in optic flow. Research on the identity and functional organization of this network has over the course of almost half a century focused exclusively on the order Diptera, a member of the approximately 300-million-year-old clade Holometabola defined by its mode of development. However, it has been broadly claimed that the pivotal neuropil containing the network, the lobula plate, originated in the Cambrian before the divergence of Hexapoda and Crustacea from a mandibulate ancestor. This essay defines the traits that designate the lobula plate and argues against a homologue in Crustacea. It proposes that the origin of the lobula plate is relatively recent and may relate to the origin of flight.

Spatial readout of visual looming in the central brain of Drosophila.

Visual systems can exploit spatial correlations in the visual scene by using retinotopy, the organizing principle by which neighboring cells encode neighboring spatial locations. However, retinotopy is often lost, such as when visual pathways are integrated with other sensory modalities. How is spatial information processed outside of strictly visual brain areas? Here, we focused on visual looming responsive LC6 cells in Drosophila, a population whose dendrites collectively cover the visual field, but whose axons form a single glomerulus-a structure without obvious retinotopic organization-in the central brain. We identified multiple cell types downstream of LC6 in the glomerulus and found that they more strongly respond to looming in different portions of the visual field, unexpectedly preserving spatial information. Through EM reconstruction of all LC6 synaptic inputs to the glomerulus, we found that LC6 and downstream cell types form circuits within the glomerulus that enable spatial readout of visual features and contralateral suppression-mechanisms that transform visual information for behavioral control.

Direction Selective Neurons Responsive to Horizontal Motion in a Crab Reflect an Adaptation to Prevailing Movements in Flat Environments.

All animals need information about the direction of motion to be able to track the trajectory of a target (prey, predator, cospecific) or to control the course of navigation. This information is provided by direction selective (DS) neurons, which respond to images moving in a unique direction. DS neurons have been described in numerous species including many arthropods. In these animals, the majority of the studies have focused on DS neurons dedicated to processing the optic flow generated during navigation. In contrast, only a few studies were performed on DS neurons related to object motion processing. The crab Neohelice is an established experimental model for the study of neurons involved in visually-guided behaviors. Here, we describe in male crabs of this species a new group of DS neurons that are highly directionally selective to moving objects. The neurons were physiologically and morphologically characterized by intracellular recording and staining in the optic lobe of intact animals. Because of their arborization in the lobula complex, we called these cells lobula complex directional cells (LCDCs). LCDCs also arborize in a previously undescribed small neuropil of the lateral protocerebrum. LCDCs are responsive only to horizontal motion. This nicely fits in the behavioral adaptations of a crab inhabiting a flat, densely crowded environment, where most object motions are generated by neighboring crabs moving along the horizontal plane.SIGNIFICANCE STATEMENT Direction selective (DS) neurons are key to a variety of visual behaviors including, target tracking (preys, predators, cospecifics) and course control. Here, we describe the physiology and morphology of a new group of remarkably directional neurons exclusively responsive to horizontal motion in crabs. These neurons arborize in the lobula complex and in a previously undescribed small neuropil of the lateral protocerebrum. The strong sensitivity of these cells for horizontal motion represents a clear example of functional neuronal adaptation to the lifestyle of an animal inhabiting a flat environment.

Non-canonical Receptive Field Properties and Neuromodulation of Feature-Detecting Neurons in Flies.

Several fundamental aspects of motion vision circuitry are prevalent across flies and mice. Both taxa segregate ON and OFF signals. For any given spatial pattern, motion detectors in both taxa are tuned to speed, selective for one of four cardinal directions, and modulated by catecholamine neurotransmitters. These similarities represent conserved, canonical properties of the functional circuits and computational algorithms for motion vision. Less is known about feature detectors, including how receptive field properties differ from the motion pathway or whether they are under neuromodulatory control to impart functional plasticity for the detection of salient objects from a moving background. Here, we investigated 19 types of putative feature selective lobula columnar (LC) neurons in the optic lobe of the fruit fly Drosophila melanogaster to characterize divergent properties of feature selection. We identified LC12 and LC15 as feature detectors. LC15 encodes moving bars, whereas LC12 is selective for the motion of discrete objects, mostly independent of size. Neither is selective for contrast polarity, speed, or direction, highlighting key differences in the underlying algorithms for feature detection and motion vision. We show that the onset of background motion suppresses object responses by LC12 and LC15. Surprisingly, the application of octopamine, which is released during flight, reverses the suppressive influence of background motion, rendering both LCs able to track moving objects superimposed against background motion. Our results provide a comparative framework for the function and modulation of feature detectors and new insights into the underlying neuronal mechanisms involved in visual feature detection.

The diversity of lobula plate tangential cells (LPTCs) in the Drosophila motion vision system.

To navigate through the environment, animals rely on visual feedback to control their movements relative to their surroundings. In dipteran flies, visual feedback is provided by the wide-field motion-sensitive neurons in the visual system called lobula plate tangential cells (LPTCs). Understanding the role of LPTCs in fly behaviors can address many fundamental questions on how sensory circuits guide behaviors. The blowfly was estimated to have ~ 60 LPTCs, but only a few have been identified in Drosophila. We conducted a Gal4 driver screen and identified five LPTC subtypes in Drosophila, based on their morphological characteristics: LPTCs have large arborizations in the lobula plate and project to the central brain. We compared their morphologies to the blowfly LPTCs and named them after the most similar blowfly cells: CH, H1, H2, FD1 and FD3, and V1. We further characterized their pre- and post-synaptic organizations, as well as their neurotransmitter profiles. These anatomical features largely agree with the anatomy and function of their likely blowfly counterparts. Nevertheless, several anatomical details indicate the Drosophila LPTCs may have more complex functions. Our characterization of these five LPTCs in Drosophila will facilitate further functional studies to understand their roles in the visual circuits that instruct fly behaviors.

The Organization of the Second Optic Chiasm of the Drosophila Optic Lobe.

Visual pathways from the compound eye of an insect relay to four neuropils, successively the lamina, medulla, lobula, and lobula plate in the underlying optic lobe. Among these neuropils, the medulla, lobula, and lobula plate are interconnected by the complex second optic chiasm, through which the anteroposterior axis undergoes an inversion between the medulla and lobula. Given their complex structure, the projection patterns through the second optic chiasm have so far lacked critical analysis. By densely reconstructing axon trajectories using a volumetric scanning electron microscopy (SEM) technique, we reveal the three-dimensional structure of the second optic chiasm of Drosophila melanogaster, which comprises interleaving bundles and sheets of axons insulated from each other by glial sheaths. These axon bundles invert their horizontal sequence in passing between the medulla and lobula. Axons connecting the medulla and lobula plate are also bundled together with them but do not decussate the sequence of their horizontal positions. They interleave with sheets of projection neuron axons between the lobula and lobula plate, which also lack decussations. We estimate that approximately 19,500 cells per hemisphere, about two thirds of the optic lobe neurons, contribute to the second chiasm, most being Tm cells, with an estimated additional 2,780 T4 and T5 cells each. The chiasm mostly comprises axons and cell body fibers, but also a few synaptic elements. Based on our anatomical findings, we propose that a chiasmal structure between the neuropils is potentially advantageous for processing complex visual information in parallel. The EM reconstruction shows not only the structure of the chiasm in the adult brain, the previously unreported main topic of our study, but also suggest that the projection patterns of the neurons comprising the chiasm may be determined by the proliferation centers from which the neurons develop. Such a complex wiring pattern could, we suggest, only have arisen in several evolutionary steps.

Differential Tuning to Visual Motion Allows Robust Encoding of Optic Flow in the Dragonfly.

Visual cues provide an important means for aerial creatures to ascertain their self-motion through the environment. In many insects, including flies, moths, and bees, wide-field motion-sensitive neurons in the third optic ganglion are thought to underlie such motion encoding; however, these neurons can only respond robustly over limited speed ranges. The task is more complicated for some species of dragonflies that switch between extended periods of hovering flight and fast-moving pursuit of prey and conspecifics, requiring motion detection over a broad range of velocities. Since little is known about motion processing in these insects, we performed intracellular recordings from hawking, emerald dragonflies (Hemicordulia spp.) and identified a diverse group of motion-sensitive neurons that we named lobula tangential cells (LTCs). Following prolonged visual stimulation with drifting gratings, we observed significant differences in both temporal and spatial tuning of LTCs. Cluster analysis of these changes confirmed several groups of LTCs with distinctive spatiotemporal tuning. These differences were associated with variation in velocity tuning in response to translated, natural scenes. LTCs with differences in velocity tuning ranges and optima may underlie how a broad range of motion velocities are encoded. In the hawking dragonfly, changes in LTC tuning over time are therefore likely to support their extensive range of behaviors, from hovering to fast-speed pursuits.SIGNIFICANCE STATEMENT Understanding how animals navigate the world is an inherently difficult and interesting problem. Insects are useful models for understanding neuronal mechanisms underlying these activities, with neurons that encode wide-field motion previously identified in insects, such as flies, hawkmoths, and butterflies. Like some Dipteran flies, dragonflies exhibit complex aerobatic behaviors, such as hovering, patrolling, and aerial combat. However, dragonflies lack halteres that support such diverse behavior in flies. To understand how dragonflies might address this problem using only visual cues, we recorded from their wide-field motion-sensitive neurons. We found these differ strongly in the ways they respond to sustained motion, allowing them collectively to encode the very broad range of velocities experienced during diverse behavior.