Active filtering of sequences of neural activity by recurrent circuits of sensory cortex.

In daily life, organisms interact with a sensory world that dynamically changes from moment to moment. Recurrent neural networks can generate dynamics, but in sensory cortex any dynamic role for the dense recurrent excitatory-excitatory network has been unclear. Here we show a new role for recurrent connections in mouse visual cortex: they support powerful dynamical computations, but via filtering sequences of input instead of generating sequences. Using two-photon optogenetics, we measure responses to natural images and play them back, showing amplification when played back during the correct movie dynamic context and suppression in the incorrect context. The sequence selectivity depends on a network mechanism: inputs to groups of cells produce responses in different local neurons, which interact with later inputs to change responses. We confirm this mechanism by designing sequences of inputs that are amplified or suppressed by the network. Together, these data suggest a novel function, sequence filtering, for recurrent connections in cerebral cortex.

Mechanisms underlying reshuffling of visual responses by optogenetic stimulation in mice and monkeys.

The ability to optogenetically perturb neural circuits opens an unprecedented window into mechanisms governing circuit function. We analyzed and theoretically modeled neuronal responses to visual and optogenetic inputs in mouse and monkey V1. In both species, optogenetic stimulation of excitatory neurons strongly modulated the activity of single neurons yet had weak or no effects on the distribution of firing rates across the population. Thus, the optogenetic inputs reshuffled firing rates across the network. Key statistics of mouse and monkey responses lay on a continuum, with mice/monkeys occupying the low-/high-rate regions, respectively. We show that neuronal reshuffling emerges generically in randomly connected excitatory/inhibitory networks, provided the coupling strength (combination of recurrent coupling and external input) is sufficient that powerful inhibitory feedback cancels the mean optogenetic input. A more realistic model, distinguishing tuned visual vs. untuned optogenetic input in a structured network, reduces the coupling strength needed to explain reshuffling.

Excitation creates a distributed pattern of cortical suppression due to varied recurrent input.

Dense local, recurrent connections are a major feature of cortical circuits, yet how they affect neurons' responses has been unclear, with some studies reporting weak recurrent effects, some reporting amplification, and others indicating local suppression. Here, we show that optogenetic input to mouse V1 excitatory neurons generates salt-and-pepper patterns of both excitation and suppression. Responses in individual neurons are not strongly predicted by that neuron's direct input. A balanced-state network model reconciles a set of diverse observations: the observed dynamics, suppressed responses, decoupling of input and output, and long tail of excited responses. The model shows recurrent excitatory-excitatory connections are strong and also variable across neurons. Together, these results demonstrate that excitatory recurrent connections can have major effects on cortical computations by shaping and changing neurons' responses to input.

Single cell optogenetics reveals attenuation-by-suppression in visual cortical neurons.

The relationship between neurons' input and spiking output is central to brain computation. Studies in vitro and in anesthetized animals suggest nonlinearities emerge in cells' input-output (activation) functions as network activity increases, yet how neurons transform inputs in vivo has been unclear. Here, we characterize cortical principal neurons' activation functions in awake mice using two-photon optogenetics and imaging. We find responses to fixed optogenetic input are nearly unchanged as neurons are excited, reflecting a linear response regime above neurons' resting point. In contrast, responses are dramatically attenuated by suppression. This attenuation is a powerful means to filter inputs arriving to suppressed cells, privileging other inputs arriving to excited neurons. These data have two major implications: first, neural activation functions in vivo accord with the activation functions used in recent machine learning systems, and second, neurons' IO functions can enhance sensory processing by attenuating some inputs while leaving others unchanged.

Amplified cortical neural responses as animals learn to use novel activity patterns.

Cerebral cortex supports representations of the world in patterns of neural activity, used by the brain to make decisions and guide behavior. Past work has found diverse, or limited, changes in the primary sensory cortex in response to learning, suggesting that the key computations might occur in downstream regions. Alternatively, sensory cortical changes may be central to learning. We studied cortical learning by using controlled inputs we insert: we trained mice to recognize entirely novel, non-sensory patterns of cortical activity in the primary visual cortex (V1) created by optogenetic stimulation. As animals learned to use these novel patterns, we found that their detection abilities improved by an order of magnitude or more. The behavioral change was accompanied by large increases in V1 neural responses to fixed optogenetic input. Neural response amplification to novel optogenetic inputs had little effect on existing visual sensory responses. A recurrent cortical model shows that this amplification can be achieved by a small mean shift in recurrent network synaptic strength. Amplification would seem to be desirable to improve decision-making in a detection task; therefore, these results suggest that adult recurrent cortical plasticity plays a significant role in improving behavioral performance during learning.

Bicistronic Expression of a High-Performance Calcium Indicator and Opsin for All-Optical Stimulation and Imaging at Cellular Resolution.

State-of-the-art all-optical systems promise unprecedented access to neural activity in vivo, using multiphoton optogenetics to allow simultaneous imaging and control of activity in selected neurons at cellular resolution. However, to achieve wide use of all-optical stimulation and imaging, simple strategies are needed to robustly and stably express opsins and indicators in the same cells. Here, we describe a bicistronic adeno-associated virus (AAV) that expresses both the fast and bright calcium indicator jGCaMP8s, and a soma-targeted (st) and two-photon-activatable opsin, ChrimsonR. With this method, stChrimsonR stimulation with two-photon holography in the visual cortex of mice drives robust spiking in targeted cells, and neural responses to visual sensory stimuli and spontaneous activity are strong and stable. Cells expressing this bicistronic construct show responses to both photostimulation and visual stimulation that are similar to responses measured from cells expressing the same opsin and indicator via separate viruses. This approach is a simple and robust way to prepare neurons in vivo for two-photon holography and imaging.

Performance in even a simple perceptual task depends on mouse secondary visual areas.

Primary visual cortex (V1) in the mouse projects to numerous brain areas, including several secondary visual areas, frontal cortex, and basal ganglia. While it has been demonstrated that optogenetic silencing of V1 strongly impairs visually guided behavior, it is not known which downstream areas are required for visual behaviors. Here we trained mice to perform a contrast-increment change detection task, for which substantial stimulus information is present in V1. Optogenetic silencing of visual responses in secondary visual areas revealed that their activity is required for even this simple visual task. In vivo electrophysiology showed that, although inhibiting secondary visual areas could produce some feedback effects in V1, the principal effect was profound suppression at the location of the optogenetic light. The results show that pathways through secondary visual areas are necessary for even simple visual behaviors.

Response nonlinearities in networks of spiking neurons.

Combining information from multiple sources is a fundamental operation performed by networks of neurons in the brain, whose general principles are still largely unknown. Experimental evidence suggests that combination of inputs in cortex relies on nonlinear summation. Such nonlinearities are thought to be fundamental to perform complex computations. However, these non-linearities are inconsistent with the balanced-state model, one of the most popular models of cortical dynamics, which predicts networks have a linear response. This linearity is obtained in the limit of very large recurrent coupling strength. We investigate the stationary response of networks of spiking neurons as a function of coupling strength. We show that, while a linear transfer function emerges at strong coupling, nonlinearities are prominent at finite coupling, both at response onset and close to saturation. We derive a general framework to classify nonlinear responses in these networks and discuss which of them can be captured by rate models. This framework could help to understand the diversity of non-linearities observed in cortical networks.

Inhibition stabilization is a widespread property of cortical networks.

Many cortical network models use recurrent coupling strong enough to require inhibition for stabilization. Yet it has been experimentally unclear whether inhibition-stabilized network (ISN) models describe cortical function well across areas and states. Here, we test several ISN predictions, including the counterintuitive (paradoxical) suppression of inhibitory firing in response to optogenetic inhibitory stimulation. We find clear evidence for ISN operation in mouse visual, somatosensory, and motor cortex. Simple two-population ISN models describe the data well and let us quantify coupling strength. Although some models predict a non-ISN to ISN transition with increasingly strong sensory stimuli, we find ISN effects without sensory stimulation and even during light anesthesia. Additionally, average paradoxical effects result only with transgenic, not viral, opsin expression in parvalbumin (PV)-positive neurons; theory and expression data show this is consistent with ISN operation. Taken together, these results show strong coupling and inhibition stabilization are common features of the cortex.

Finding patterns in cortical responses.

Simulations predict a paradoxical effect that should be revealed by patterned stimulation of the cortex.

Different Inhibitory Interneuron Cell Classes Make Distinct Contributions to Visual Contrast Perception.

While recent work has revealed how different inhibitory interneurons influence responses of cortical neurons to sensory stimuli, little is known about their distinct contributions to sensory perception. Here, we optogenetically activated different genetically defined interneurons [parvalbumin (PV), somatostatin (SST), vasoactive intestinal peptide (VIP)] in visual cortex (V1) of mice working at threshold in a contrast increment detection task. The visual stimulus was paired with optogenetic stimulation to assess how enhancing V1 inhibitory neuron activity during visual processing altered task performance. PV or SST activation impaired, while VIP stimulation improved, contrast increment detection. The impairment produced by PV or SST activation persisted over several weeks of testing. In contrast, mice learned to reliably detect VIP activation in the absence of any natural visual stimulus. Thus, different inhibitory signals make distinct contributions to visual contrast perception.

Feedforward Inhibition Allows Input Summation to Vary in Recurrent Cortical Networks.

Brain computations depend on how neurons transform inputs to spike outputs. Here, to understand input-output transformations in cortical networks, we recorded spiking responses from visual cortex (V1) of awake mice of either sex while pairing sensory stimuli with optogenetic perturbation of excitatory and parvalbumin-positive inhibitory neurons. We found that V1 neurons' average responses were primarily additive (linear). We used a recurrent cortical network model to determine whether these data, as well as past observations of nonlinearity, could be described by a common circuit architecture. Simulations showed that cortical input-output transformations can be changed from linear to sublinear with moderate (∼20%) strengthening of connections between inhibitory neurons, but this change away from linear scaling depends on the presence of feedforward inhibition. Simulating a variety of recurrent connection strengths showed that, compared with when input arrives only to excitatory neurons, networks produce a wider range of output spiking responses in the presence of feedforward inhibition.

Cortical neural populations can guide behavior by integrating inputs linearly, independent of synchrony.

Neurons are sensitive to the relative timing of inputs, both because several inputs must coincide to reach spike threshold and because active dendritic mechanisms can amplify synchronous inputs. To determine if input synchrony can influence behavior, we trained mice to report activation of excitatory neurons in visual cortex using channelrhodopsin-2. We used light pulses that varied in duration from a few milliseconds to 100 ms and measured neuronal responses and animals' detection ability. We found detection performance was well predicted by the total amount of light delivered. Short pulses provided no behavioral advantage, even when they concentrated evoked spikes into an interval a few milliseconds long. Arranging pulses into trains of varying frequency from beta to gamma also produced no behavioral advantage. Light intensities required to drive behavior were low (at low intensities, channelrhodopsin-2 conductance varies linearly with intensity), and the accompanying changes in firing rate were small (over 100 ms, average change: 1.1 spikes per s). Firing rate changes varied linearly with pulse intensity and duration, and behavior was predicted by total spike count independent of temporal arrangement. Thus, animals' detection performance reflected the linear integration of total input over 100 ms. This behavioral linearity despite neurons' nonlinearities can be explained by a population code using noisy neurons. Ongoing background activity creates probabilistic spiking, allowing weak inputs to change spike probability linearly, with little amplification of coincident input. Summing across a population then yields a total spike count that weights inputs equally, regardless of their arrival time.

Mouse primary visual cortex is used to detect both orientation and contrast changes.

In mammals, the lateral geniculate nucleus (LGN) and the superior colliculus (SC) are the major targets of visual inputs from the retina. The LGN projects mainly to primary visual cortex (V1) while the SC targets the thalamus and brainstem, providing two potential pathways for processing visual inputs. Indeed, cortical lesion experiments in rodents have yielded mixed results, leading to the hypothesis that performance of simple visual behaviors may involve computations performed entirely by this subcortical pathway through the SC. However, these previous experiments have been limited by both their assays of behavioral performance and their use of lesions to change cortical activity. To determine the contribution of V1 to these tasks, we trained mice to perform threshold detection tasks in which they reported changes in either the contrast or orientation of visual stimuli. We then reversibly inhibited V1 by optogenetically activating parvalbumin-expressing inhibitory neurons with channelrhodopsin-2. We found that suppressing activity in V1 substantially impaired performance in visual detection tasks. The behavioral deficit depended on the retinotopic position of the visual stimulus, confirming that the effect was due to the specific suppression of the visually driven V1 neurons. Behavioral effects were seen with only moderate changes in neuronal activity, as inactivation that raised neuronal contrast thresholds by a median of only 14% was associated with a doubling of behavioral contrast detection threshold. Thus, detection of changes in either orientation or contrast is dependent on, and highly sensitive to, the activity of neurons in V1.

Insights into cortical mechanisms of behavior from microstimulation experiments.

Even the simplest behaviors depend on a large number of neurons that are distributed across many brain regions. Because electrical microstimulation can change the activity of localized subsets of neurons, it has provided valuable evidence that specific neurons contribute to particular behaviors. Here we review what has been learned about cortical function from behavioral studies using microstimulation in animals and humans. Experiments that examine how microstimulation affects the perception of stimuli have shown that the effects of microstimulation are usually highly specific and can be related to the stimuli preferred by neurons at the stimulated site. Experiments that ask subjects to detect cortical microstimulation in the absence of other stimuli have provided further insights. Although subjects typically can detect microstimulation of primary sensory or motor cortex, they are generally unable to detect stimulation of most of cortex without extensive practice. With practice, however, stimulation of any part of cortex can become detected. These training effects suggest that some patterns of cortical activity cannot be readily accessed to guide behavior, but that the adult brain retains enough plasticity to learn to process novel patterns of neuronal activity arising anywhere in cortex.

A neural model of sequential movement planning and control of eye movements: Item-Order-Rank working memory and saccade selection by the supplementary eye fields.

How does working memory store multiple spatial positions to control sequences of eye movements, particularly when the same items repeat at multiple list positions, or ranks, during the sequence? An Item-Order-Rank model of working memory shows how rank-selective representations enable storage and recall of items that repeat at arbitrary list positions. Rank-related activity has been observed in many areas including the posterior parietal cortices (PPC), prefrontal cortices (PFC) and supplementary eye fields (SEF). The model shows how rank information, originating in PPC, may support rank-sensitive PFC working memory representations and how SEF may select saccades stored in working memory. It also proposes how SEF may interact with downstream regions such as the frontal eye fields (FEF) during memory-guided sequential saccade tasks, and how the basal ganglia (BG) may control the flow of information. Model simulations reproduce behavioral, anatomical and electrophysiological data under multiple experimental paradigms, including visually- and memory-guided single and sequential saccade tasks. Simulations reproduce behavioral data during two SEF microstimulation paradigms, showing that their seemingly inconsistent findings about saccade latency can be reconciled.

Psychophysical measurement of contrast sensitivity in the behaving mouse.

To understand how activity in mammalian neural circuits controls behavior, the mouse is a promising model system due to the convergence of genetic, optical, and physiological methods. The ability to control and quantify behavior precisely is also essential for these studies. We developed an operant visual detection paradigm to make visual psychophysical measurements: head-fixed mice make responses by pressing a lever. We designed this task to permit neurophysiological studies of behavior in cerebral cortex, where activity is variable from trial to trial and neurons encode many types of information simultaneously. To study neural responses in the face of this complexity, we trained mice to do a task where they perform hundreds of trials daily and perceptual thresholds can be measured. We used this task to measure both visual acuity and the minimum detectable contrast in behaving mice. We found that the mouse contrast response function is similar in shape to other species. They can detect low-contrast stimuli, with a peak contrast threshold of 2%, equivalent to ∼15° eccentric in human vision. Mouse acuity is modest, with an upper limit near 0.5 cycles/°, consistent with prior data.

Local diversity and fine-scale organization of receptive fields in mouse visual cortex.

Many thousands of cortical neurons are activated by any single sensory stimulus, but the organization of these populations is poorly understood. For example, are neurons in mouse visual cortex--whose preferred orientations are arranged randomly--organized with respect to other response properties? Using high-speed in vivo two-photon calcium imaging, we characterized the receptive fields of up to 100 excitatory and inhibitory neurons in a 200 µm imaged plane. Inhibitory neurons had nonlinearly summating, complex-like receptive fields and were weakly tuned for orientation. Excitatory neurons had linear, simple receptive fields that can be studied with noise stimuli and system identification methods. We developed a wavelet stimulus that evoked rich population responses and yielded the detailed spatial receptive fields of most excitatory neurons in a plane. Receptive fields and visual responses were locally highly diverse, with nearby neurons having largely dissimilar receptive fields and response time courses. Receptive-field diversity was consistent with a nearly random sampling of orientation, spatial phase, and retinotopic position. Retinotopic positions varied locally on average by approximately half the receptive-field size. Nonetheless, the retinotopic progression across the cortex could be demonstrated at the scale of 100 µm, with a magnification of ≈ 10 µm/°. Receptive-field and response similarity were in register, decreasing by 50% over a distance of 200 µm. Together, the results indicate considerable randomness in local populations of mouse visual cortical neurons, with retinotopy as the principal source of organization at the scale of hundreds of micrometers.