Recurrent pattern completion drives the neocortical representation of sensory inference.

When sensory information is incomplete or ambiguous, the brain relies on prior expectations to infer perceptual objects. Despite the centrality of this process to perception, the neural mechanism of sensory inference is not known. Illusory contours (ICs) are key tools to study sensory inference because they contain edges or objects that are implied only by their spatial context. Using cellular resolution, mesoscale two-photon calcium imaging and multi-Neuropixels recordings in the mouse visual cortex, we identified a sparse subset of neurons in the primary visual cortex (V1) and higher visual areas that respond emergently to ICs. We found that these highly selective 'IC-encoders' mediate the neural representation of IC inference. Strikingly, selective activation of these neurons using two-photon holographic optogenetics was sufficient to recreate IC representation in the rest of the V1 network, in the absence of any visual stimulus. This outlines a model in which primary sensory cortex facilitates sensory inference by selectively strengthening input patterns that match prior expectations through local, recurrent circuitry. Our data thus suggest a clear computational purpose for recurrence in the generation of holistic percepts under sensory ambiguity. More generally, selective reinforcement of top-down predictions by pattern-completing recurrent circuits in lower sensory cortices may constitute a key step in sensory inference.

Impact of walking speed and motion adaptation on optokinetic nystagmus-like head movements in the blowfly Calliphora.

The optokinetic nystagmus is a gaze-stabilizing mechanism reducing motion blur by rapid eye rotations against the direction of visual motion, followed by slower syndirectional eye movements minimizing retinal slip speed. Flies control their gaze through head turns controlled by neck motor neurons receiving input directly, or via descending neurons, from well-characterized directional-selective interneurons sensitive to visual wide-field motion. Locomotion increases the gain and speed sensitivity of these interneurons, while visual motion adaptation in walking animals has the opposite effects. To find out whether flies perform an optokinetic nystagmus, and how it may be affected by locomotion and visual motion adaptation, we recorded head movements of blowflies on a trackball stimulated by progressive and rotational visual motion. Flies flexibly responded to rotational stimuli with optokinetic nystagmus-like head movements, independent of their locomotor state. The temporal frequency tuning of these movements, though matching that of the upstream directional-selective interneurons, was only mildly modulated by walking speed or visual motion adaptation. Our results suggest flies flexibly control their gaze to compensate for rotational wide-field motion by a mechanism similar to an optokinetic nystagmus. Surprisingly, the mechanism is less state-dependent than the response properties of directional-selective interneurons providing input to the neck motor system.

A visual pathway for skylight polarization processing in Drosophila.

Many insects use patterns of polarized light in the sky to orient and navigate. Here, we functionally characterize neural circuitry in the fruit fly, Drosophila melanogaster, that conveys polarized light signals from the eye to the central complex, a brain region essential for the fly's sense of direction. Neurons tuned to the angle of polarization of ultraviolet light are found throughout the anterior visual pathway, connecting the optic lobes with the central complex via the anterior optic tubercle and bulb, in a homologous organization to the 'sky compass' pathways described in other insects. We detail how a consistent, map-like organization of neural tunings in the peripheral visual system is transformed into a reduced representation suited to flexible processing in the central brain. This study identifies computational motifs of the transformation, enabling mechanistic comparisons of multisensory integration and central processing for navigation in the brains of insects.

Serotonergic modulation of visual neurons in Drosophila melanogaster.

Sensory systems rely on neuromodulators, such as serotonin, to provide flexibility for information processing as stimuli vary, such as light intensity throughout the day. Serotonergic neurons broadly innervate the optic ganglia of Drosophila melanogaster, a widely used model for studying vision. It remains unclear whether serotonin modulates the physiology of interneurons in the optic ganglia. To address this question, we first mapped the expression patterns of serotonin receptors in the visual system, focusing on a subset of cells with processes in the first optic ganglion, the lamina. Serotonin receptor expression was found in several types of columnar cells in the lamina including 5-HT2B in lamina monopolar cell L2, required for spatiotemporal luminance contrast, and both 5-HT1A and 5-HT1B in T1 cells, whose function is unknown. Subcellular mapping with GFP-tagged 5-HT2B and 5-HT1A constructs indicated that these receptors localize to layer M2 of the medulla, proximal to serotonergic boutons, suggesting that the medulla neuropil is the primary site of serotonergic regulation for these neurons. Exogenous serotonin increased basal intracellular calcium in L2 terminals in layer M2 and modestly decreased the duration of visually induced calcium transients in L2 neurons following repeated dark flashes, but otherwise did not alter the calcium transients. Flies without functional 5-HT2B failed to show an increase in basal calcium in response to serotonin. 5-HT2B mutants also failed to show a change in amplitude in their response to repeated light flashes but other calcium transient parameters were relatively unaffected. While we did not detect serotonin receptor expression in L1 neurons, they, like L2, underwent serotonin-induced changes in basal calcium, presumably via interactions with other cells. These data demonstrate that serotonin modulates the physiology of interneurons involved in early visual processing in Drosophila.

Inhibitory Interactions and Columnar Inputs to an Object Motion Detector in Drosophila.

The direction-selective T4/T5 cells innervate optic-flow processing projection neurons in the lobula plate of the fly that mediate the visual control of locomotion. In the lobula, visual projection neurons coordinate complex behavioral responses to visual features, however, the input circuitry and computations that bestow their feature-detecting properties are less clear. Here, we study a highly specialized small object motion detector, LC11, and demonstrate that its responses are suppressed by local background motion. We show that LC11 expresses GABA-A receptors that serve to sculpt responses to small objects but are not responsible for the rejection of background motion. Instead, LC11 is innervated by columnar T2 and T3 neurons that are themselves highly sensitive to small static or moving objects, insensitive to wide-field motion and, unlike T4/T5, respond to both ON and OFF luminance steps.

Spike Burst Coding of Translatory Optic Flow and Depth from Motion in the Fly Visual System.

Many animals use the visual motion generated by traveling straight-the translatory optic flow-to successfully navigate obstacles: near objects appear larger and to move more quickly than distant objects. Flies are expert at navigating cluttered environments, and while their visual processing of rotatory optic flow is understood in exquisite detail, how they process translatory optic flow remains a mystery. We present novel cell types that have local motion receptive fields matched to translation self-motion, the vertical translation (VT) cells. One of these, the VT1 cell, encodes self-motion in the forward-sideslip direction and fires action potentials in spike bursts as well as single spikes. We show that the spike burst coding is size and speed-tuned and is selectively modulated by motion parallax-the relative motion experienced during translation. These properties are spatially organized, so that the cell is most excited by clutter rather than isolated objects. When the fly is presented with a simulation of flying past an elevated object, the spike burst activity is modulated by the height of the object, and the rate of single spikes is unaffected. When the moving object alone is experienced, the cell is weakly driven. Meanwhile, the VT2-3 cells have motion receptive fields matched to the lift axis. In conjunction with previously described horizontal cells, the VT cells have properties well suited to the visual navigation of clutter and to encode the fly's movements along near cardinal axes of thrust, lift, and forward sideslip.

Evolution of Biological Image Stabilization.

The use of vision to coordinate behavior requires an efficient control design that stabilizes the world on the retina or directs the gaze towards salient features in the surroundings. With a level gaze, visual processing tasks are simplified and behaviorally relevant features from the visual environment can be extracted. No matter how simple or sophisticated the eye design, mechanisms have evolved across phyla to stabilize gaze. In this review, we describe functional similarities in eyes and gaze stabilization reflexes, emphasizing their fundamental role in transforming sensory information into motor commands that support postural and locomotor control. We then focus on gaze stabilization design in flying insects and detail some of the underlying principles. Systems analysis reveals that gaze stabilization often involves several sensory modalities, including vision itself, and makes use of feedback as well as feedforward signals. Independent of phylogenetic distance, the physical interaction between an animal and its natural environment - its available senses and how it moves - appears to shape the adaptation of all aspects of gaze stabilization.