Cortical feedback loops bind distributed representations of working memory.

Working memory-the brain's ability to internalize information and use it flexibly to guide behaviour-is an essential component of cognition. Although activity related to working memory has been observed in several brain regions1-3, how neural populations actually represent working memory4-7 and the mechanisms by which this activity is maintained8-12 remain unclear13-15. Here we describe the neural implementation of visual working memory in mice alternating between a delayed non-match-to-sample task and a simple discrimination task that does not require working memory but has identical stimulus, movement and reward statistics. Transient optogenetic inactivations revealed that distributed areas of the neocortex were required selectively for the maintenance of working memory. Population activity in visual area AM and premotor area M2 during the delay period was dominated by orderly low-dimensional dynamics16,17 that were, however, independent of working memory. Instead, working memory representations were embedded in high-dimensional population activity, present in both cortical areas, persisted throughout the inter-stimulus delay period, and predicted behavioural responses during the working memory task. To test whether the distributed nature of working memory was dependent on reciprocal interactions between cortical regions18-20, we silenced one cortical area (AM or M2) while recording the feedback it received from the other. Transient inactivation of either area led to the selective disruption of inter-areal communication of working memory. Therefore, reciprocally interconnected cortical areas maintain bound high-dimensional representations of working memory.

Antibody stabilization for thermally accelerated deep immunostaining.

Antibodies have diverse applications due to their high reaction specificities but are sensitive to denaturation when a higher working temperature is required. We have developed a simple, highly scalable and generalizable chemical approach for stabilizing off-the-shelf antibodies against thermal and chemical denaturation. We demonstrate that the stabilized antibodies (termed SPEARs) can withstand up to 4 weeks of continuous heating at 55 °C and harsh denaturants, and apply our method to 33 tested antibodies. SPEARs enable flexible applications of thermocycling and denaturants to dynamically modulate their binding kinetics, reaction equilibrium, macromolecular diffusivity and aggregation propensity. In particular, we show that SPEARs permit the use of a thermally facilitated three-dimensional immunolabeling strategy (termed ThICK staining), achieving whole mouse brain immunolabeling within 72 h, as well as nearly fourfold deeper penetration with threefold less antibodies in human brain tissue. With faster deep-tissue immunolabeling and broad compatibility with tissue processing and clearing methods without the need for any specialized equipment, we anticipate the wide applicability of ThICK staining with SPEARs for deep immunostaining.

The logic of single-cell projections from visual cortex.

Neocortical areas communicate through extensive axonal projections, but the logic of information transfer remains poorly understood, because the projections of individual neurons have not been systematically characterized. It is not known whether individual neurons send projections only to single cortical areas or distribute signals across multiple targets. Here we determine the projection patterns of 591 individual neurons in the mouse primary visual cortex using whole-brain fluorescence-based axonal tracing and high-throughput DNA sequencing of genetically barcoded neurons (MAPseq). Projections were highly diverse and divergent, collectively targeting at least 18 cortical and subcortical areas. Most neurons targeted multiple cortical areas, often in non-random combinations, suggesting that sub-classes of intracortical projection neurons exist. Our results indicate that the dominant mode of intracortical information transfer is not based on 'one neuron-one target area' mapping. Instead, signals carried by individual cortical neurons are shared across subsets of target areas, and thus concurrently contribute to multiple functional pathways.

Functional organization of excitatory synaptic strength in primary visual cortex.

The strength of synaptic connections fundamentally determines how neurons influence each other's firing. Excitatory connection amplitudes between pairs of cortical neurons vary over two orders of magnitude, comprising only very few strong connections among many weaker ones. Although this highly skewed distribution of connection strengths is observed in diverse cortical areas, its functional significance remains unknown: it is not clear how connection strength relates to neuronal response properties, nor how strong and weak inputs contribute to information processing in local microcircuits. Here we reveal that the strength of connections between layer 2/3 (L2/3) pyramidal neurons in mouse primary visual cortex (V1) obeys a simple rule--the few strong connections occur between neurons with most correlated responses, while only weak connections link neurons with uncorrelated responses. Moreover, we show that strong and reciprocal connections occur between cells with similar spatial receptive field structure. Although weak connections far outnumber strong connections, each neuron receives the majority of its local excitation from a small number of strong inputs provided by the few neurons with similar responses to visual features. By dominating recurrent excitation, these infrequent yet powerful inputs disproportionately contribute to feature preference and selectivity. Therefore, our results show that the apparently complex organization of excitatory connection strength reflects the similarity of neuronal responses, and suggest that rare, strong connections mediate stimulus-specific response amplification in cortical microcircuits.

Diverse coupling of neurons to populations in sensory cortex.

A large population of neurons can, in principle, produce an astronomical number of distinct firing patterns. In cortex, however, these patterns lie in a space of lower dimension, as if individual neurons were "obedient members of a huge orchestra". Here we use recordings from the visual cortex of mouse (Mus musculus) and monkey (Macaca mulatta) to investigate the relationship between individual neurons and the population, and to establish the underlying circuit mechanisms. We show that neighbouring neurons can differ in their coupling to the overall firing of the population, ranging from strongly coupled 'choristers' to weakly coupled 'soloists'. Population coupling is largely independent of sensory preferences, and it is a fixed cellular attribute, invariant to stimulus conditions. Neurons with high population coupling are more strongly affected by non-sensory behavioural variables such as motor intention. Population coupling reflects a causal relationship, predicting the response of a neuron to optogenetically driven increases in local activity. Moreover, population coupling indicates synaptic connectivity; the population coupling of a neuron, measured in vivo, predicted subsequent in vitro estimates of the number of synapses received from its neighbours. Finally, population coupling provides a compact summary of population activity; knowledge of the population couplings of n neurons predicts a substantial portion of their n(2) pairwise correlations. Population coupling therefore represents a novel, simple measure that characterizes the relationship of each neuron to a larger population, explaining seemingly complex network firing patterns in terms of basic circuit variables.

Cortical connectivity and sensory coding.

The sensory cortex contains a wide array of neuronal types, which are connected together into complex but partially stereotyped circuits. Sensory stimuli trigger cascades of electrical activity through these circuits, causing specific features of sensory scenes to be encoded in the firing patterns of cortical populations. Recent research is beginning to reveal how the connectivity of individual neurons relates to the sensory features they encode, how differences in the connectivity patterns of different cortical cell classes enable them to encode information using different strategies, and how feedback connections from higher-order cortex allow sensory information to be integrated with behavioural context.

The emergence of functional microcircuits in visual cortex.

Sensory processing occurs in neocortical microcircuits in which synaptic connectivity is highly structured and excitatory neurons form subnetworks that process related sensory information. However, the developmental mechanisms underlying the formation of functionally organized connectivity in cortical microcircuits remain unknown. Here we directly relate patterns of excitatory synaptic connectivity to visual response properties of neighbouring layer 2/3 pyramidal neurons in mouse visual cortex at different postnatal ages, using two-photon calcium imaging in vivo and multiple whole-cell recordings in vitro. Although neural responses were already highly selective for visual stimuli at eye opening, neurons responding to similar visual features were not yet preferentially connected, indicating that the emergence of feature selectivity does not depend on the precise arrangement of local synaptic connections. After eye opening, local connectivity reorganized extensively: more connections formed selectively between neurons with similar visual responses and connections were eliminated between visually unresponsive neurons, but the overall connectivity rate did not change. We propose a sequential model of cortical microcircuit development based on activity-dependent mechanisms of plasticity whereby neurons first acquire feature preference by selecting feedforward inputs before the onset of sensory experience--a process that may be facilitated by early electrical coupling between neuronal subsets--and then patterned input drives the formation of functional subnetworks through a redistribution of recurrent synaptic connections.

Assessing the Role of Inhibition in Stabilizing Neocortical Networks Requires Large-Scale Perturbation of the Inhibitory Population.

Neurons within cortical microcircuits are interconnected with recurrent excitatory synaptic connections that are thought to amplify signals (Douglas and Martin, 2007), form selective subnetworks (Ko et al., 2011), and aid feature discrimination. Strong inhibition (Haider et al., 2013) counterbalances excitation, enabling sensory features to be sharpened and represented by sparse codes (Willmore et al., 2011). This balance between excitation and inhibition makes it difficult to assess the strength, or gain, of recurrent excitatory connections within cortical networks, which is key to understanding their operational regime and the computations that they perform. Networks that combine an unstable high-gain excitatory population with stabilizing inhibitory feedback are known as inhibition-stabilized networks (ISNs) (Tsodyks et al., 1997). Theoretical studies using reduced network models predict that ISNs produce paradoxical responses to perturbation, but experimental perturbations failed to find evidence for ISNs in cortex (Atallah et al., 2012). Here, we reexamined this question by investigating how cortical network models consisting of many neurons behave after perturbations and found that results obtained from reduced network models fail to predict responses to perturbations in more realistic networks. Our models predict that a large proportion of the inhibitory network must be perturbed to reliably detect an ISN regime robustly in cortex. We propose that wide-field optogenetic suppression of inhibition under promoters targeting a large fraction of inhibitory neurons may provide a perturbation of sufficient strength to reveal the operating regime of cortex. Our results suggest that detailed computational models of optogenetic perturbations are necessary to interpret the results of experimental paradigms.SIGNIFICANCE STATEMENT Many useful computational mechanisms proposed for cortex require local excitatory recurrence to be very strong, such that local inhibitory feedback is necessary to avoid epileptiform runaway activity (an "inhibition-stabilized network" or "ISN" regime). However, recent experimental results suggest that this regime may not exist in cortex. We simulated activity perturbations in cortical networks of increasing realism and found that, to detect ISN-like properties in cortex, large proportions of the inhibitory population must be perturbed. Current experimental methods for inhibitory perturbation are unlikely to satisfy this requirement, implying that existing experimental observations are inconclusive about the computational regime of cortex. Our results suggest that new experimental designs targeting a majority of inhibitory neurons may be able to resolve this question.

Model Constrained by Visual Hierarchy Improves Prediction of Neural Responses to Natural Scenes.

Accurate estimation of neuronal receptive fields is essential for understanding sensory processing in the early visual system. Yet a full characterization of receptive fields is still incomplete, especially with regard to natural visual stimuli and in complete populations of cortical neurons. While previous work has incorporated known structural properties of the early visual system, such as lateral connectivity, or imposing simple-cell-like receptive field structure, no study has exploited the fact that nearby V1 neurons share common feed-forward input from thalamus and other upstream cortical neurons. We introduce a new method for estimating receptive fields simultaneously for a population of V1 neurons, using a model-based analysis incorporating knowledge of the feed-forward visual hierarchy. We assume that a population of V1 neurons shares a common pool of thalamic inputs, and consists of two layers of simple and complex-like V1 neurons. When fit to recordings of a local population of mouse layer 2/3 V1 neurons, our model offers an accurate description of their response to natural images and significant improvement of prediction power over the current state-of-the-art methods. We show that the responses of a large local population of V1 neurons with locally diverse receptive fields can be described with surprisingly limited number of thalamic inputs, consistent with recent experimental findings. Our structural model not only offers an improved functional characterization of V1 neurons, but also provides a framework for studying the relationship between connectivity and function in visual cortical areas.

Functional specificity of local synaptic connections in neocortical networks.

Neuronal connectivity is fundamental to information processing in the brain. Therefore, understanding the mechanisms of sensory processing requires uncovering how connection patterns between neurons relate to their function. On a coarse scale, long-range projections can preferentially link cortical regions with similar responses to sensory stimuli. But on the local scale, where dendrites and axons overlap substantially, the functional specificity of connections remains unknown. Here we determine synaptic connectivity between nearby layer 2/3 pyramidal neurons in vitro, the response properties of which were first characterized in mouse visual cortex in vivo. We found that connection probability was related to the similarity of visually driven neuronal activity. Neurons with the same preference for oriented stimuli connected at twice the rate of neurons with orthogonal orientation preferences. Neurons responding similarly to naturalistic stimuli formed connections at much higher rates than those with uncorrelated responses. Bidirectional synaptic connections were found more frequently between neuronal pairs with strongly correlated visual responses. Our results reveal the degree of functional specificity of local synaptic connections in the visual cortex, and point to the existence of fine-scale subnetworks dedicated to processing related sensory information.

Emergence of feature-specific connectivity in cortical microcircuits in the absence of visual experience.

In primary visual cortex (V1), connectivity between layer 2/3 (L2/3) excitatory neurons undergoes extensive reorganization after the onset of visual experience whereby neurons with similar feature selectivity form functional microcircuits (Ko et al., 2011, 2013). It remains unknown whether visual experience is required for the developmental refinement of intracortical circuitry or whether this maturation is guided intrinsically. Here, we correlated the connectivity between V1 L2/3 neurons assayed by simultaneous whole-cell recordings in vitro to their response properties measured by two-photon calcium imaging in vivo in dark-reared mice. We found that neurons with similar responses to oriented gratings or natural movies became preferentially connected in the absence of visual experience. However, the relationship between connectivity and similarity of visual responses to natural movies was not as strong in dark-reared as in normally reared mice. Moreover, dark rearing prevented the normally occurring loss of connections between visually nonresponsive neurons after eye opening (Ko et al., 2013). Therefore, our data suggest that the absence of visual input does not prevent the emergence of functionally specific recurrent connectivity in cortical circuits; however, visual experience is required for complete microcircuit maturation.

Experience leaves a lasting structural trace in cortical circuits.

Sensory experiences exert a powerful influence on the function and future performance of neuronal circuits in the mammalian neocortex. Restructuring of synaptic connections is believed to be one mechanism by which cortical circuits store information about the sensory world. Excitatory synaptic structures, such as dendritic spines, are dynamic entities that remain sensitive to alteration of sensory input throughout life. It remains unclear, however, whether structural changes at the level of dendritic spines can outlast the original experience and thereby provide a morphological basis for long-term information storage. Here we follow spine dynamics on apical dendrites of pyramidal neurons in functionally defined regions of adult mouse visual cortex during plasticity of eye-specific responses induced by repeated closure of one eye (monocular deprivation). The first monocular deprivation episode doubled the rate of spine formation, thereby increasing spine density. This effect was specific to layer-5 cells located in binocular cortex, where most neurons increase their responsiveness to the non-deprived eye. Restoring binocular vision returned spine dynamics to baseline levels, but absolute spine density remained elevated and many monocular deprivation-induced spines persisted during this period of functional recovery. However, spine addition did not increase again when the same eye was closed for a second time. This absence of structural plasticity stands out against the robust changes of eye-specific responses that occur even faster after repeated deprivation. Thus, spines added during the first monocular deprivation experience may provide a structural basis for subsequent functional shifts. These results provide a strong link between functional plasticity and specific synaptic rearrangements, revealing a mechanism of how prior experiences could be stored in cortical circuits.

Functional specificity of recurrent inhibition in visual cortex.

In the neocortex, neural activity is shaped by the interaction of excitatory and inhibitory neurons, defined by the organization of their synaptic connections. Although connections among excitatory pyramidal neurons are sparse and functionally tuned, inhibitory connectivity is thought to be dense and largely unstructured. By measuring in vivo visual responses and synaptic connectivity of parvalbumin-expressing (PV+) inhibitory cells in mouse primary visual cortex, we show that the synaptic weights of their connections to nearby pyramidal neurons are specifically tuned according to the similarity of the cells' responses. Individual PV+ cells strongly inhibit those pyramidal cells that provide them with strong excitation and share their visual selectivity. This structured organization of inhibitory synaptic weights provides a circuit mechanism for tuned inhibition onto pyramidal cells despite dense connectivity, stabilizing activity within feature-specific excitatory ensembles while supporting competition between them.

Learning shapes cortical dynamics to enhance integration of relevant sensory input.

Adaptive sensory behavior is thought to depend on processing in recurrent cortical circuits, but how dynamics in these circuits shapes the integration and transmission of sensory information is not well understood. Here, we study neural coding in recurrently connected networks of neurons driven by sensory input. We show analytically how information available in the network output varies with the alignment between feedforward input and the integrating modes of the circuit dynamics. In light of this theory, we analyzed neural population activity in the visual cortex of mice that learned to discriminate visual features. We found that over learning, slow patterns of network dynamics realigned to better integrate input relevant to the discrimination task. This realignment of network dynamics could be explained by changes in excitatory-inhibitory connectivity among neurons tuned to relevant features. These results suggest that learning tunes the temporal dynamics of cortical circuits to optimally integrate relevant sensory input.

Independent response modulation of visual cortical neurons by attentional and behavioral states.

Sensory processing is influenced by cognitive and behavioral states, but how these states interact to modulate responses of individual neurons is unknown. We trained mice in a visual discrimination task wherein they attended to different locations within a hemifield while running or sitting still, enabling us to examine how visual responses are modulated by spatial attention and running behavior. We found that spatial attention improved discrimination performance and strengthened visual responses of excitatory neurons in the primary visual cortex whose receptive fields overlapped with the attended location. Although individual neurons were modulated by both spatial attention and running, the magnitudes of these influences were not correlated. While running-dependent modulation was stable across days, attentional modulation was dynamic, influencing individual neurons to different degrees after repeated changes in attentional states. Thus, despite similar effects on neural responses, spatial attention and running act independently with different dynamics, implying separable mechanisms for their implementation.

Learning and attention increase visual response selectivity through distinct mechanisms.

Selectivity of cortical neurons for sensory stimuli can increase across days as animals learn their behavioral relevance and across seconds when animals switch attention. While both phenomena occur in the same circuit, it is unknown whether they rely on similar mechanisms. We imaged primary visual cortex as mice learned a visual discrimination task and subsequently performed an attention switching task. Selectivity changes due to learning and attention were uncorrelated in individual neurons. Selectivity increases after learning mainly arose from selective suppression of responses to one of the stimuli but from selective enhancement and suppression during attention. Learning and attention differentially affected interactions between excitatory and PV, SOM, and VIP inhibitory cells. Circuit modeling revealed that cell class-specific top-down inputs best explained attentional modulation, while reorganization of local functional connectivity accounted for learning-related changes. Thus, distinct mechanisms underlie increased discriminability of relevant sensory stimuli across longer and shorter timescales.

Homeostatic regulation of eye-specific responses in visual cortex during ocular dominance plasticity.

Experience-dependent plasticity is crucial for the precise formation of neuronal connections during development. It is generally thought to depend on Hebbian forms of synaptic plasticity. In addition, neurons possess other, homeostatic means of compensating for changes in sensory input, but their role in cortical plasticity is unclear. We used two-photon calcium imaging to investigate whether homeostatic response regulation contributes to changes of eye-specific responsiveness after monocular deprivation (MD) in mouse visual cortex. Short MD durations decreased deprived-eye responses in neurons with binocular input. Longer MD periods strengthened open-eye responses, and surprisingly, also increased deprived-eye responses in neurons devoid of open-eye input. These bidirectional response adjustments effectively preserved the net visual drive for each neuron. Our finding that deprived-eye responses were either weaker or stronger after MD, depending on the amount of open-eye input a cell received, argues for both Hebbian and homeostatic mechanisms regulating neuronal responsiveness during experience-dependent plasticity.

The sensory representation of causally controlled objects.

Intentional control over external objects is informed by our sensory experience of them. To study how causal relationships are learned and effected, we devised a brain machine interface (BMI) task using wide-field calcium signals. Mice learned to entrain activity patterns in arbitrary pairs of cortical regions to guide a visual cursor to a target location for reward. Brain areas that were normally correlated could be rapidly reconfigured to exert control over the cursor in a sensory-feedback-dependent manner. Higher visual cortex was more engaged when expert but not naive animals controlled the cursor. Individual neurons in higher visual cortex responded more strongly to the cursor when mice controlled it than when they passively viewed it, with the greatest response boosting as the cursor approached the target location. Thus, representations of causally controlled objects are sensitive to intention and proximity to the subject's goal, potentially strengthening sensory feedback to allow more fluent control.

Mesoscale cortical dynamics reflect the interaction of sensory evidence and temporal expectation during perceptual decision-making.

How sensory evidence is transformed across multiple brain regions to influence behavior remains poorly understood. We trained mice in a visual change detection task designed to separate the covert antecedents of choices from activity associated with their execution. Wide-field calcium imaging across the dorsal cortex revealed fundamentally different dynamics of activity underlying these processes. Although signals related to execution of choice were widespread, fluctuations in sensory evidence in the absence of overt motor responses triggered a confined activity cascade, beginning with transient modulation of visual cortex and followed by sustained recruitment of the secondary and primary motor cortex. Activation of the motor cortex by sensory evidence was modulated by animals' expectation of when the stimulus was likely to change. These results reveal distinct activation timescales of specific cortical areas by sensory evidence during decision-making and show that recruitment of the motor cortex depends on the interaction of sensory evidence and temporal expectation.