Sustained deep-tissue voltage recording using a fast indicator evolved for two-photon microscopy.

Genetically encoded voltage indicators are emerging tools for monitoring voltage dynamics with cell-type specificity. However, current indicators enable a narrow range of applications due to poor performance under two-photon microscopy, a method of choice for deep-tissue recording. To improve indicators, we developed a multiparameter high-throughput platform to optimize voltage indicators for two-photon microscopy. Using this system, we identified JEDI-2P, an indicator that is faster, brighter, and more sensitive and photostable than its predecessors. We demonstrate that JEDI-2P can report light-evoked responses in axonal termini of Drosophila interneurons and the dendrites and somata of amacrine cells of isolated mouse retina. JEDI-2P can also optically record the voltage dynamics of individual cortical neurons in awake behaving mice for more than 30 min using both resonant-scanning and ULoVE random-access microscopy. Finally, ULoVE recording of JEDI-2P can robustly detect spikes at depths exceeding 400 µm and report voltage correlations in pairs of neurons.

Reconstruction of neocortex: Organelles, compartments, cells, circuits, and activity.

We assembled a semi-automated reconstruction of L2/3 mouse primary visual cortex from ∼250 × 140 × 90 µm3 of electron microscopic images, including pyramidal and non-pyramidal neurons, astrocytes, microglia, oligodendrocytes and precursors, pericytes, vasculature, nuclei, mitochondria, and synapses. Visual responses of a subset of pyramidal cells are included. The data are publicly available, along with tools for programmatic and three-dimensional interactive access. Brief vignettes illustrate the breadth of potential applications relating structure to function in cortical circuits and neuronal cell biology. Mitochondria and synapse organization are characterized as a function of path length from the soma. Pyramidal connectivity motif frequencies are predicted accurately using a configuration model of random graphs. Pyramidal cells receiving more connections from nearby cells exhibit stronger and more reliable visual responses. Sample code shows data access and analysis.

State-dependent pupil dilation rapidly shifts visual feature selectivity.

To increase computational flexibility, the processing of sensory inputs changes with behavioural context. In the visual system, active behavioural states characterized by motor activity and pupil dilation1,2 enhance sensory responses, but typically leave the preferred stimuli of neurons unchanged2-9. Here we find that behavioural state also modulates stimulus selectivity in the mouse visual cortex in the context of coloured natural scenes. Using population imaging in behaving mice, pharmacology and deep neural network modelling, we identified a rapid shift in colour selectivity towards ultraviolet stimuli during an active behavioural state. This was exclusively caused by state-dependent pupil dilation, which resulted in a dynamic switch from rod to cone photoreceptors, thereby extending their role beyond night and day vision. The change in tuning facilitated the decoding of ethological stimuli, such as aerial predators against the twilight sky10. For decades, studies in neuroscience and cognitive science have used pupil dilation as an indirect measure of brain state. Our data suggest that, in addition, state-dependent pupil dilation itself tunes visual representations to behavioural demands by differentially recruiting rods and cones on fast timescales.

Phenotypic variation of transcriptomic cell types in mouse motor cortex.

Cortical neurons exhibit extreme diversity in gene expression as well as in morphological and electrophysiological properties1,2. Most existing neural taxonomies are based on either transcriptomic3,4 or morpho-electric5,6 criteria, as it has been technically challenging to study both aspects of neuronal diversity in the same set of cells7. Here we used Patch-seq8 to combine patch-clamp recording, biocytin staining, and single-cell RNA sequencing of more than 1,300 neurons in adult mouse primary motor cortex, providing a morpho-electric annotation of almost all transcriptomically defined neural cell types. We found that, although broad families of transcriptomic types (those expressing Vip, Pvalb, Sst and so on) had distinct and essentially non-overlapping morpho-electric phenotypes, individual transcriptomic types within the same family were not well separated in the morpho-electric space. Instead, there was a continuum of variability in morphology and electrophysiology, with neighbouring transcriptomic cell types showing similar morpho-electric features, often without clear boundaries between them. Our results suggest that neuronal types in the neocortex do not always form discrete entities. Instead, neurons form a hierarchy that consists of distinct non-overlapping branches at the level of families, but can form continuous and correlated transcriptomic and morpho-electrical landscapes within families.

Diverse task-driven modeling of macaque V4 reveals functional specialization towards semantic tasks.

Responses to natural stimuli in area V4-a mid-level area of the visual ventral stream-are well predicted by features from convolutional neural networks (CNNs) trained on image classification. This result has been taken as evidence for the functional role of V4 in object classification. However, we currently do not know if and to what extent V4 plays a role in solving other computational objectives. Here, we investigated normative accounts of V4 (and V1 for comparison) by predicting macaque single-neuron responses to natural images from the representations extracted by 23 CNNs trained on different computer vision tasks including semantic, geometric, 2D, and 3D types of tasks. We found that V4 was best predicted by semantic classification features and exhibited high task selectivity, while the choice of task was less consequential to V1 performance. Consistent with traditional characterizations of V4 function that show its high-dimensional tuning to various 2D and 3D stimulus directions, we found that diverse non-semantic tasks explained aspects of V4 function that are not captured by individual semantic tasks. Nevertheless, jointly considering the features of a pair of semantic classification tasks was sufficient to yield one of our top V4 models, solidifying V4's main functional role in semantic processing and suggesting that V4's selectivity to 2D or 3D stimulus properties found by electrophysiologists can result from semantic functional goals.

Robust deep learning object recognition models rely on low frequency information in natural images.

Machine learning models have difficulty generalizing to data outside of the distribution they were trained on. In particular, vision models are usually vulnerable to adversarial attacks or common corruptions, to which the human visual system is robust. Recent studies have found that regularizing machine learning models to favor brain-like representations can improve model robustness, but it is unclear why. We hypothesize that the increased model robustness is partly due to the low spatial frequency preference inherited from the neural representation. We tested this simple hypothesis with several frequency-oriented analyses, including the design and use of hybrid images to probe model frequency sensitivity directly. We also examined many other publicly available robust models that were trained on adversarial images or with data augmentation, and found that all these robust models showed a greater preference to low spatial frequency information. We show that preprocessing by blurring can serve as a defense mechanism against both adversarial attacks and common corruptions, further confirming our hypothesis and demonstrating the utility of low spatial frequency information in robust object recognition.

Increased Reliability of Visually-Evoked Activity in Area V1 of the MECP2-Duplication Mouse Model of Autism.

Atypical sensory processing is now thought to be a core feature of the autism spectrum. Influential theories have proposed that both increased and decreased neural response reliability within sensory systems could underlie altered sensory processing in autism. Here, we report evidence for abnormally increased reliability of visual-evoked responses in layer 2/3 neurons of adult male and female primary visual cortex in the MECP2-duplication syndrome animal model of autism. Increased response reliability was due in part to decreased response amplitude, decreased fluctuations in endogenous activity, and an abnormal decoupling of visual-evoked activity from endogenous activity. Similar to what was observed neuronally, the optokinetic reflex occurred more reliably at low contrasts in mutant mice compared with controls. Retinal responses did not explain our observations. These data suggest that the circuit mechanisms for combining sensory-evoked and endogenous signal and noise processes may be altered in this form of syndromic autism.SIGNIFICANCE STATEMENT Atypical sensory processing is now thought to be a core feature of the autism spectrum. Influential theories have proposed that both increased and decreased neural response reliability within sensory systems could underlie altered sensory processing in autism. Here, we report evidence for abnormally increased reliability of visual-evoked responses in primary visual cortex of the animal model for MECP2-duplication syndrome, a high-penetrance single-gene cause of autism. Visual-evoked activity was abnormally decoupled from endogenous activity in mutant mice, suggesting in line with the influential "hypo-priors" theory of autism that sensory priors embedded in endogenous activity may have less influence on perception in autism.

A CRISPR toolbox for generating intersectional genetic mouse models for functional, molecular, and anatomical circuit mapping.

BACKGROUND: The functional understanding of genetic interaction networks and cellular mechanisms governing health and disease requires the dissection, and multifaceted study, of discrete cell subtypes in developing and adult animal models. Recombinase-driven expression of transgenic effector alleles represents a significant and powerful approach to delineate cell populations for functional, molecular, and anatomical studies. In addition to single recombinase systems, the expression of two recombinases in distinct, but partially overlapping, populations allows for more defined target expression. Although the application of this method is becoming increasingly popular, its experimental implementation has been broadly restricted to manipulations of a limited set of common alleles that are often commercially produced at great expense, with costs and technical challenges associated with production of intersectional mouse lines hindering customized approaches to many researchers. Here, we present a simplified CRISPR toolkit for rapid, inexpensive, and facile intersectional allele production. RESULTS: Briefly, we produced 7 intersectional mouse lines using a dual recombinase system, one mouse line with a single recombinase system, and three embryonic stem (ES) cell lines that are designed to study the way functional, molecular, and anatomical features relate to each other in building circuits that underlie physiology and behavior. As a proof-of-principle, we applied three of these lines to different neuronal populations for anatomical mapping and functional in vivo investigation of respiratory control. We also generated a mouse line with a single recombinase-responsive allele that controls the expression of the calcium sensor Twitch-2B. This mouse line was applied globally to study the effects of follicle-stimulating hormone (FSH) and luteinizing hormone (LH) on calcium release in the ovarian follicle. CONCLUSIONS: The lines presented here are representative examples of outcomes possible with the successful application of our genetic toolkit for the facile development of diverse, modifiable animal models. This toolkit will allow labs to create single or dual recombinase effector lines easily for any cell population or subpopulation of interest when paired with the appropriate Cre and FLP recombinase mouse lines or viral vectors. We have made our tools and derivative intersectional mouse and ES cell lines openly available for non-commercial use through publicly curated repositories for plasmid DNA, ES cells, and transgenic mouse lines.

Learning divisive normalization in primary visual cortex.

Divisive normalization (DN) is a prominent computational building block in the brain that has been proposed as a canonical cortical operation. Numerous experimental studies have verified its importance for capturing nonlinear neural response properties to simple, artificial stimuli, and computational studies suggest that DN is also an important component for processing natural stimuli. However, we lack quantitative models of DN that are directly informed by measurements of spiking responses in the brain and applicable to arbitrary stimuli. Here, we propose a DN model that is applicable to arbitrary input images. We test its ability to predict how neurons in macaque primary visual cortex (V1) respond to natural images, with a focus on nonlinear response properties within the classical receptive field. Our model consists of one layer of subunits followed by learned orientation-specific DN. It outperforms linear-nonlinear and wavelet-based feature representations and makes a significant step towards the performance of state-of-the-art convolutional neural network (CNN) models. Unlike deep CNNs, our compact DN model offers a direct interpretation of the nature of normalization. By inspecting the learned normalization pool of our model, we gained insights into a long-standing question about the tuning properties of DN that update the current textbook description: we found that within the receptive field oriented features were normalized preferentially by features with similar orientation rather than non-specifically as currently assumed.

In vivo three-photon imaging of activity of GCaMP6-labeled neurons deep in intact mouse brain.

High-resolution optical imaging is critical to understanding brain function. We demonstrate that three-photon microscopy at 1,300-nm excitation enables functional imaging of GCaMP6s-labeled neurons beyond the depth limit of two-photon microscopy. We record spontaneous activity from up to 150 neurons in the hippocampal stratum pyramidale at ∼1-mm depth within an intact mouse brain. Our method creates opportunities for noninvasive recording of neuronal activity with high spatial and temporal resolution deep within scattering brain tissues.

Inference of synaptic connectivity and external variability in neural microcircuits.

A major goal in neuroscience is to estimate neural connectivity from large scale extracellular recordings of neural activity in vivo. This is challenging in part because any such activity is modulated by the unmeasured external synaptic input to the network, known as the common input problem. Many different measures of functional connectivity have been proposed in the literature, but their direct relationship to synaptic connectivity is often assumed or ignored. For in vivo data, measurements of this relationship would require a knowledge of ground truth connectivity, which is nearly always unavailable. Instead, many studies use in silico simulations as benchmarks for investigation, but such approaches necessarily rely upon a variety of simplifying assumptions about the simulated network and can depend on numerous simulation parameters. We combine neuronal network simulations, mathematical analysis, and calcium imaging data to address the question of when and how functional connectivity, synaptic connectivity, and latent external input variability can be untangled. We show numerically and analytically that, even though the precision matrix of recorded spiking activity does not uniquely determine synaptic connectivity, it is in practice often closely related to synaptic connectivity. This relation becomes more pronounced when the spatial structure of neuronal variability is jointly considered.

Deep convolutional models improve predictions of macaque V1 responses to natural images.

Despite great efforts over several decades, our best models of primary visual cortex (V1) still predict spiking activity quite poorly when probed with natural stimuli, highlighting our limited understanding of the nonlinear computations in V1. Recently, two approaches based on deep learning have emerged for modeling these nonlinear computations: transfer learning from artificial neural networks trained on object recognition and data-driven convolutional neural network models trained end-to-end on large populations of neurons. Here, we test the ability of both approaches to predict spiking activity in response to natural images in V1 of awake monkeys. We found that the transfer learning approach performed similarly well to the data-driven approach and both outperformed classical linear-nonlinear and wavelet-based feature representations that build on existing theories of V1. Notably, transfer learning using a pre-trained feature space required substantially less experimental time to achieve the same performance. In conclusion, multi-layer convolutional neural networks (CNNs) set the new state of the art for predicting neural responses to natural images in primate V1 and deep features learned for object recognition are better explanations for V1 computation than all previous filter bank theories. This finding strengthens the necessity of V1 models that are multiple nonlinearities away from the image domain and it supports the idea of explaining early visual cortex based on high-level functional goals.

Follicle-stimulating hormone and luteinizing hormone increase Ca2+ in the granulosa cells of mouse ovarian follicles†.

In mammalian ovarian follicles, follicle stimulating hormone (FSH) and luteinizing hormone (LH) signal primarily through the G-protein Gs to elevate cAMP, but both of these hormones can also elevate Ca2+ under some conditions. Here, we investigate FSH- and LH-induced Ca2+ signaling in intact follicles of mice expressing genetically encoded Ca2+ sensors, Twitch-2B and GCaMP6s. At a physiological concentration (1 nM), FSH elevates Ca2+ within the granulosa cells of preantral and antral follicles. The Ca2+ rise begins several minutes after FSH application, peaks at ∼10 min, remains above baseline for another ∼10 min, and depends on extracellular Ca2+. However, suppression of the FSH-induced Ca2+ increase by reducing extracellular Ca2+ does not inhibit FSH-induced phosphorylation of MAP kinase, estradiol production, or the acquisition of LH responsiveness. Like FSH, LH also increases Ca2+, when applied to preovulatory follicles. At a physiological concentration (10 nM), LH elicits Ca2+ oscillations in a subset of cells in the outer mural granulosa layer. These oscillations continue for at least 6 h and depend on the activity of Gq family G-proteins. Suppression of the oscillations by Gq inhibition does not inhibit meiotic resumption, but does delay the time to 50% ovulation by about 3 h. In summary, both FSH and LH increase Ca2+ in the granulosa cells of intact follicles, but the functions of these Ca2+ rises are only starting to be identified.

Community-based benchmarking improves spike rate inference from two-photon calcium imaging data.

In recent years, two-photon calcium imaging has become a standard tool to probe the function of neural circuits and to study computations in neuronal populations. However, the acquired signal is only an indirect measurement of neural activity due to the comparatively slow dynamics of fluorescent calcium indicators. Different algorithms for estimating spike rates from noisy calcium measurements have been proposed in the past, but it is an open question how far performance can be improved. Here, we report the results of the spikefinder challenge, launched to catalyze the development of new spike rate inference algorithms through crowd-sourcing. We present ten of the submitted algorithms which show improved performance compared to previously evaluated methods. Interestingly, the top-performing algorithms are based on a wide range of principles from deep neural networks to generative models, yet provide highly correlated estimates of the neural activity. The competition shows that benchmark challenges can drive algorithmic developments in neuroscience.

Faster processing of moving compared with flashed bars in awake macaque V1 provides a neural correlate of the flash lag illusion.

When the brain has determined the position of a moving object, because of anatomical and processing delays the object will have already moved to a new location. Given the statistical regularities present in natural motion, the brain may have acquired compensatory mechanisms to minimize the mismatch between the perceived and real positions of moving objects. A well-known visual illusion-the flash lag effect-points toward such a possibility. Although many psychophysical models have been suggested to explain this illusion, their predictions have not been tested at the neural level, particularly in a species of animal known to perceive the illusion. To this end, we recorded neural responses to flashed and moving bars from primary visual cortex (V1) of awake, fixating macaque monkeys. We found that the response latency to moving bars of varying speed, motion direction, and luminance was shorter than that to flashes, in a manner that is consistent with psychophysical results. At the level of V1, our results support the differential latency model positing that flashed and moving bars have different latencies. As we found a neural correlate of the illusion in passively fixating monkeys, our results also suggest that judging the instantaneous position of the moving bar at the time of flash-as required by the postdiction/motion-biasing model-may not be necessary for observing a neural correlate of the illusion. Our results also suggest that the brain may have evolved mechanisms to process moving stimuli faster and closer to real time compared with briefly appearing stationary stimuli. NEW & NOTEWORTHY We report several observations in awake macaque V1 that provide support for the differential latency model of the flash lag illusion. We find that the equal latency of flash and moving stimuli as assumed by motion integration/postdiction models does not hold in V1. We show that in macaque V1, motion processing latency depends on stimulus luminance, speed and motion direction in a manner consistent with several psychophysical properties of the flash lag illusion.

Q&A: using Patch-seq to profile single cells.

Individual neurons vary widely in terms of their gene expression, morphology, and electrophysiological properties. While many techniques exist to study single-cell variability along one or two of these dimensions, very few techniques can assess all three features for a single cell. We recently developed Patch-seq, which combines whole-cell patch clamp recording with single-cell RNA-sequencing and immunohistochemistry to comprehensively profile the transcriptomic, morphologic, and physiologic features of individual neurons. Patch-seq can be broadly applied to characterize cell types in complex tissues such as the nervous system, and to study the transcriptional signatures underlying the multidimensional phenotypes of single cells.

On the Structure of Neuronal Population Activity under Fluctuations in Attentional State.

Attention is commonly thought to improve behavioral performance by increasing response gain and suppressing shared variability in neuronal populations. However, both the focus and the strength of attention are likely to vary from one experimental trial to the next, thereby inducing response variability unknown to the experimenter. Here we study analytically how fluctuations in attentional state affect the structure of population responses in a simple model of spatial and feature attention. In our model, attention acts on the neural response exclusively by modulating each neuron's gain. Neurons are conditionally independent given the stimulus and the attentional gain, and correlated activity arises only from trial-to-trial fluctuations of the attentional state, which are unknown to the experimenter. We find that this simple model can readily explain many aspects of neural response modulation under attention, such as increased response gain, reduced individual and shared variability, increased correlations with firing rates, limited range correlations, and differential correlations. We therefore suggest that attention may act primarily by increasing response gain of individual neurons without affecting their correlation structure. The experimentally observed reduction in correlations may instead result from reduced variability of the attentional gain when a stimulus is attended. Moreover, we show that attentional gain fluctuations, even if unknown to a downstream readout, do not impair the readout accuracy despite inducing limited-range correlations, whereas fluctuations of the attended feature can in principle limit behavioral performance. SIGNIFICANCE STATEMENT: Covert attention is one of the most widely studied examples of top-down modulation of neural activity in the visual system. Recent studies argue that attention improves behavioral performance by shaping of the noise distribution to suppress shared variability rather than by increasing response gain. Our work shows, however, that latent, trial-to-trial fluctuations of the focus and strength of attention lead to shared variability that is highly consistent with known experimental observations. Interestingly, fluctuations in the strength of attention do not affect coding performance. As a consequence, the experimentally observed changes in response variability may not be a mechanism of attention, but rather a side effect of attentional allocation strategies in different behavioral contexts.

Improved estimation and interpretation of correlations in neural circuits.

Ambitious projects aim to record the activity of ever larger and denser neuronal populations in vivo. Correlations in neural activity measured in such recordings can reveal important aspects of neural circuit organization. However, estimating and interpreting large correlation matrices is statistically challenging. Estimation can be improved by regularization, i.e. by imposing a structure on the estimate. The amount of improvement depends on how closely the assumed structure represents dependencies in the data. Therefore, the selection of the most efficient correlation matrix estimator for a given neural circuit must be determined empirically. Importantly, the identity and structure of the most efficient estimator informs about the types of dominant dependencies governing the system. We sought statistically efficient estimators of neural correlation matrices in recordings from large, dense groups of cortical neurons. Using fast 3D random-access laser scanning microscopy of calcium signals, we recorded the activity of nearly every neuron in volumes 200 µm wide and 100 µm deep (150-350 cells) in mouse visual cortex. We hypothesized that in these densely sampled recordings, the correlation matrix should be best modeled as the combination of a sparse graph of pairwise partial correlations representing local interactions and a low-rank component representing common fluctuations and external inputs. Indeed, in cross-validation tests, the covariance matrix estimator with this structure consistently outperformed other regularized estimators. The sparse component of the estimate defined a graph of interactions. These interactions reflected the physical distances and orientation tuning properties of cells: The density of positive 'excitatory' interactions decreased rapidly with geometric distances and with differences in orientation preference whereas negative 'inhibitory' interactions were less selective. Because of its superior performance, this 'sparse+latent' estimator likely provides a more physiologically relevant representation of the functional connectivity in densely sampled recordings than the sample correlation matrix.

Trial-to-trial, uncertainty-based adjustment of decision boundaries in visual categorization.

Categorization is a cornerstone of perception and cognition. Computationally, categorization amounts to applying decision boundaries in the space of stimulus features. We designed a visual categorization task in which optimal performance requires observers to incorporate trial-to-trial knowledge of the level of sensory uncertainty when setting their decision boundaries. We found that humans and monkeys did adjust their decision boundaries from trial to trial as the level of sensory noise varied, with some subjects performing near optimally. We constructed a neural network that implements uncertainty-based, near-optimal adjustment of decision boundaries. Divisive normalization emerges automatically as a key neural operation in this network. Our results offer an integrated computational and mechanistic framework for categorization under uncertainty.

Random-Access Multiphoton Microscopy for Fast Three-Dimensional Imaging.

Studies in several important areas of neuroscience, including analysis of single neurons as well as neural networks, continue to be limited by currently available experimental tools. By combining molecular probes of cellular function, such as voltage-sensitive or calcium-sensitive dyes, with advanced microscopy techniques such as multiphoton microscopy, experimental neurophysiologists have been able to partially reduce this limitation. These approaches usually provide the needed spatial resolution along with convenient optical sectioning capabilities for isolating regions of interest. However, they often fall short in providing the necessary temporal resolution, primarily due to their restrained laser scanning mechanisms. In this regard, we review a method of laser scanning for multiphoton microscopy that overcomes the temporal limitations of pervious approaches and allows for what is known as 3D Random Access Multiphoton (3D RAMP) microscopy, an imaging technique that supports full three dimensional recording of many sites of interest on physiologically relevant time scales.