Community-based benchmarking improves spike rate inference from two-photon calcium imaging data.

In recent years, two-photon calcium imaging has become a standard tool to probe the function of neural circuits and to study computations in neuronal populations. However, the acquired signal is only an indirect measurement of neural activity due to the comparatively slow dynamics of fluorescent calcium indicators. Different algorithms for estimating spike rates from noisy calcium measurements have been proposed in the past, but it is an open question how far performance can be improved. Here, we report the results of the spikefinder challenge, launched to catalyze the development of new spike rate inference algorithms through crowd-sourcing. We present ten of the submitted algorithms which show improved performance compared to previously evaluated methods. Interestingly, the top-performing algorithms are based on a wide range of principles from deep neural networks to generative models, yet provide highly correlated estimates of the neural activity. The competition shows that benchmark challenges can drive algorithmic developments in neuroscience.

Interhemispheric Synchrony of Spontaneous Cortical States at the Cortical Column Level.

In cat early visual cortex, neural activity patterns resembling evoked orientation maps emerge spontaneously under anesthesia. To test if such patterns are synchronized between hemispheres, we performed bilateral imaging in anesthetized cats using a new improved voltage-sensitive dye. We observed map-like activity patterns spanning early visual cortex in both hemispheres simultaneously. Patterns virtually identical to maps associated with the cardinal and oblique orientations emerged as leading principal components of the spontaneous fluctuations, and the strength of transient orientation states was correlated with their duration, providing evidence that these maps are transiently attracting states. A neural mass model we developed reproduced the dynamics of both smooth and abrupt orientation state transitions observed experimentally. The model suggests that map-like activity arises from slow modulations in spontaneous firing in conjunction with interplay between excitation and inhibition. Our results highlight the efficiency and functional precision of interhemispheric connectivity.

Milliseconds of Sensory Input Abruptly Modulate the Dynamics of Cortical States for Seconds.

Spontaneous internal activity plays a major role in higher brain functions. The question of how it modulates sensory evoked activity and behavior has been explored in anesthetized rodents, cats, monkeys and in behaving human subjects. However, the complementary question of how a brief sensory input modulates the internally generated activity in vivo remains unresolved, and high-resolution mapping of these bidirectional interactions was never performed. Integrating complementary methodologies, at population and single cells levels, we explored this question. Voltage-sensitive dye imaging of population activity in anesthetized rats' somatosensory cortex revealed that spontaneous up-states were largely diminished for ~2 s, even after a single weak whisker deflection. This effect was maximal at the stimulated barrel but spread across several cortical areas. A higher velocity whisker deflection evoked activity at ~15Hz. Two-photon calcium imaging activity and cell-attached recordings confirmed the VSD results and revealed that for several seconds most single cells decreased their firing, but a small number increased firing. Comparing single deflection with long train stimulation, we found a dominant effect of the first population spike. We suggest that, at the onset of a sensory input, some internal messages are silenced to prevent overloading of the processing of relevant incoming sensory information.

A processing work-flow for measuring erythrocytes velocity in extended vascular networks from wide field high-resolution optical imaging data.

Comprehensive information on the spatio-temporal dynamics of the vascular response is needed to underpin the signals used in hemodynamics-based functional imaging. It has recently been shown that red blood cells (RBCs) velocity and its changes can be extracted from wide-field optical imaging recordings of intrinsic absorption changes in cortex. Here, we describe a complete processing work-flow for reliable RBC velocity estimation in cortical networks. Several pre-processing steps are implemented: image co-registration, necessary to correct for small movements of the vasculature, semi-automatic image segmentation for fast and reproducible vessel selection, reconstruction of RBC trajectories patterns for each micro-vessel, and spatio-temporal filtering to enhance the desired data characteristics. The main analysis step is composed of two robust algorithms for estimating the RBCs' velocity field. Vessel diameter and its changes are also estimated, as well as local changes in backscattered light intensity. This full processing chain is implemented with a software suite that is freely distributed. The software uses efficient data management for handling the very large data sets obtained with in vivo optical imaging. It offers a complete and user-friendly graphical user interface with visualization tools for displaying and exploring data and results. A full data simulation framework is also provided in order to optimize the performances of the algorithm with respect to several characteristics of the data. We illustrate the performance of our method in three different cases of in vivo data. We first document the massive RBC speed response evoked by a spreading depression in anesthetized rat somato-sensory cortex. Second, we show the velocity response elicited by a visual stimulation in anesthetized cat visual cortex. Finally, we report, for the first time, visually-evoked RBC speed responses in an extended vascular network in awake monkey extrastriate cortex.

Differential roles of auditory and visual cortex for sensory detection in mice.

Sensory cortex encompasses the regions of the cerebral cortex that receive primary sensory inputs and is crucial for conscious sensory perception in humans. Yet, some forms of perception are possible without sensory cortex. For example in animal models, the association of a sound detection to a simple behavior resists to the inactivation of auditory cortex. In contrast, post-training inactivation experiments conducted in visual or somatosensory cortex led to much stronger effects. Here we show that muscimol inactivation of visual or auditory cortex in the same detection protocol transiently abolishes visual but not auditory detection. We also observe that cortex-dependency correlates with longer reaction times. This suggests that auditory cortex is more easily bypassed by other circuits for stimulus detection than other primary sensory areas, which may be due to timing differences between auditory and visual associations.

Le cortex sensoriel englobe les régions du cortex cérébral qui reçoivent les entrées sensorielles primaires et il est crucial pour la perception sensorielle consciente chez les humains. Pourtant, certaines formes de perception sont possibles sans cortex sensoriel. Par exemple, chez des modèles animaux, l'association d'une détection sonore à un comportement simple résiste à l'inactivation du cortex auditif. En revanche, des expériences d'inactivation post-entraînement menées dans le cortex visuel ou somatosensoriel ont conduit à des effets beaucoup plus forts. Nous montrons ici que l'inactivation par le muscimol du cortex visuel ou auditif dans le même protocole de détection abolit transitoirement la détection visuelle mais pas la détection auditive. Nous observons également que la dépendance au cortex est corrélée à des temps de réaction plus longs. Cela suggère que le cortex auditif est plus facilement contourné par d'autres circuits pour la détection des stimuli que d'autres zones sensorielles primaires, ce qui peut être dû à des différences de timing entre les associations auditives et visuelles.

Network dynamics underlying OFF responses in the auditory cortex.

Across sensory systems, complex spatio-temporal patterns of neural activity arise following the onset (ON) and offset (OFF) of stimuli. While ON responses have been widely studied, the mechanisms generating OFF responses in cortical areas have so far not been fully elucidated. We examine here the hypothesis that OFF responses are single-cell signatures of recurrent interactions at the network level. To test this hypothesis, we performed population analyses of two-photon calcium recordings in the auditory cortex of awake mice listening to auditory stimuli, and compared them to linear single-cell and network models. While the single-cell model explained some prominent features of the data, it could not capture the structure across stimuli and trials. In contrast, the network model accounted for the low-dimensional organization of population responses and their global structure across stimuli, where distinct stimuli activated mostly orthogonal dimensions in the neural state-space.

EEG-fMRI fusion of paradigm-free activity using Kalman filtering.

We address here the use of EEG and fMRI, and their combination, in order to estimate the full spatiotemporal patterns of activity on the cortical surface in the absence of any particular assumptions on this activity such as stimulation times. For handling such a high-dimension inverse problem, we propose the use of (1) a global forward model of how these measures are functions of the "neural activity" of a large number of sources distributed on the cortical surface, formalized as a dynamical system, and (2) adaptive filters, as a natural solution to solve this inverse problem iteratively along the temporal dimension. This estimation framework relies on realistic physiological models, uses EEG and fMRI in a symmetric manner, and takes into account both their temporal and spatial information. We use the Kalman filter and smoother to perform such an estimation on realistic artificial data and demonstrate that the algorithm can handle the high dimensionality of these data and that it succeeds in solving this inverse problem, combining efficiently the information provided by the two modalities (this information being naturally predominantly temporal for EEG and spatial for fMRI). It performs particularly well in reconstructing a random temporally and spatially smooth activity spread over the cortex. The Kalman filter and smoother show some limitations, however, which call for the development of more specific adaptive filters. First, they do not cope well with the strong nonlinearity in the model that is necessary for an adequate description of the relation between cortical electric activities and the metabolic demand responsible for fMRI signals. Second, they fail to estimate a sparse activity (i.e., presenting sharp peaks at specific locations and times). Finally their computational cost remains high. We use schematic examples to explain these limitations and propose further developments of our method to overcome them.

Context-dependent signaling of coincident auditory and visual events in primary visual cortex.

Detecting rapid, coincident changes across sensory modalities is essential for recognition of sudden threats or events. Using two-photon calcium imaging in identified cell types in awake, head-fixed mice, we show that, among the basic features of a sound envelope, loud sound onsets are a dominant feature coded by the auditory cortex neurons projecting to primary visual cortex (V1). In V1, a small number of layer 1 interneurons gates this cross-modal information flow in a context-dependent manner. In dark conditions, auditory cortex inputs lead to suppression of the V1 population. However, when sound input coincides with a visual stimulus, visual responses are boosted in V1, most strongly after loud sound onsets. Thus, a dynamic, asymmetric circuit connecting AC and V1 contributes to the encoding of visual events that are coincident with sounds.

Cortical recruitment determines learning dynamics and strategy.

Salience is a broad and widely used concept in neuroscience whose neuronal correlates, however, remain elusive. In behavioral conditioning, salience is used to explain various effects, such as stimulus overshadowing, and refers to how fast and strongly a stimulus can be associated with a conditioned event. Here, we identify sounds of equal intensity and perceptual detectability, which due to their spectro-temporal content recruit different levels of population activity in mouse auditory cortex. When using these sounds as cues in a Go/NoGo discrimination task, the degree of cortical recruitment matches the salience parameter of a reinforcement learning model used to analyze learning speed. We test an essential prediction of this model by training mice to discriminate light-sculpted optogenetic activity patterns in auditory cortex, and verify that cortical recruitment causally determines association or overshadowing of the stimulus components. This demonstrates that cortical recruitment underlies major aspects of stimulus salience during reinforcement learning.

Review: How do spontaneous and sensory-evoked activities interact?

Twenty years ago, the seminal work of Grinvald et al. revolutionized the view cast on spontaneous cortical activity by showing how, instead of being a mere measure of noise, it profoundly impacts cortical responses to a sensory input and therefore could play a role in sensory processing. This paved the way for a number of studies on the interactions between spontaneous and sensory-evoked activities. Spontaneous activity has subsequently been found to be highly structured and to participate in high cognitive functions, such as influencing conscious perception in humans. However, its functional role remains poorly understood, and only a few speculations exist, from the maintenance of the cortical network to the internal representation of an a priori knowledge of the environment. Furthermore, elucidation of this functional role could stem from studying the opposite relationship between spontaneous and sensory-evoked activities, namely, how a sensory input influences subsequent internal activities. Indeed, this question has remained largely unexplored, but a recent study by the Grinvald laboratory shows that a brief sensory input largely dampens spontaneous rhythms, suggesting a more sophisticated view where some spontaneous rhythms might relate to sensory processing and some others not.

Odor identity coding by distributed ensembles of neurons in the mouse olfactory cortex.

Olfactory perception and behaviors critically depend on the ability to identify an odor across a wide range of concentrations. Here, we use calcium imaging to determine how odor identity is encoded in olfactory cortex. We find that, despite considerable trial-to-trial variability, odor identity can accurately be decoded from ensembles of co-active neurons that are distributed across piriform cortex without any apparent spatial organization. However, piriform response patterns change substantially over a 100-fold change in odor concentration, apparently degrading the population representation of odor identity. We show that this problem can be resolved by decoding odor identity from a subpopulation of concentration-invariant piriform neurons. These concentration-invariant neurons are overrepresented in piriform cortex but not in olfactory bulb mitral and tufted cells. We therefore propose that distinct perceptual features of odors are encoded in independent subnetworks of neurons in the olfactory cortex.

Visual stimulation quenches global alpha range activity in awake primate V4: a case study.

Increasing evidence suggests that sensory stimulation not only changes the level of cortical activity with respect to baseline but also its structure. Despite having been reported in a multitude of conditions and preparations (for instance, as a quenching of intertrial variability, Churchland et al., 2010), such changes remain relatively poorly characterized. Here, we used optical imaging of voltage-sensitive dyes to explore, in V4 of an awake macaque, the spatiotemporal characteristics of both visually evoked and spontaneously ongoing neuronal activity and their difference. With respect to the spontaneous case, we detected a reduction in large-scale activity ([Formula: see text]) in the alpha range (5 to 12.5 Hz) during sensory inflow accompanied by a decrease in pairwise correlations. Moreover, the spatial patterns of correlation obtained during the different visual stimuli were on the average more similar one to another than they were to that obtained in the absence of stimulation. Finally, these observed changes in activity dynamics approached saturation already at very low stimulus contrasts, unlike the progressive, near-linear increase of the mean raw evoked responses over a wide range of contrast values, which could indicate a specific switching in the presence of a sensory inflow.

Temporal asymmetries in auditory coding and perception reflect multi-layered nonlinearities.

Sound recognition relies not only on spectral cues, but also on temporal cues, as demonstrated by the profound impact of time reversals on perception of common sounds. To address the coding principles underlying such auditory asymmetries, we recorded a large sample of auditory cortex neurons using two-photon calcium imaging in awake mice, while playing sounds ramping up or down in intensity. We observed clear asymmetries in cortical population responses, including stronger cortical activity for up-ramping sounds, which matches perceptual saliency assessments in mice and previous measures in humans. Analysis of cortical activity patterns revealed that auditory cortex implements a map of spatially clustered neuronal ensembles, detecting specific combinations of spectral and intensity modulation features. Comparing different models, we show that cortical responses result from multi-layered nonlinearities, which, contrary to standard receptive field models of auditory cortex function, build divergent representations of sounds with similar spectral content, but different temporal structure.

Accurate spike estimation from noisy calcium signals for ultrafast three-dimensional imaging of large neuronal populations in vivo.

Extracting neuronal spiking activity from large-scale two-photon recordings remains challenging, especially in mammals in vivo, where large noises often contaminate the signals. We propose a method, MLspike, which returns the most likely spike train underlying the measured calcium fluorescence. It relies on a physiological model including baseline fluctuations and distinct nonlinearities for synthetic and genetically encoded indicators. Model parameters can be either provided by the user or estimated from the data themselves. MLspike is computationally efficient thanks to its original discretization of probability representations; moreover, it can also return spike probabilities or samples. Benchmarked on extensive simulations and real data from seven different preparations, it outperformed state-of-the-art algorithms. Combined with the finding obtained from systematic data investigation (noise level, spiking rate and so on) that photonic noise is not necessarily the main limiting factor, our method allows spike extraction from large-scale recordings, as demonstrated on acousto-optical three-dimensional recordings of over 1,000 neurons in vivo.

A new variational method for erythrocyte velocity estimation in wide-field imaging in vivo.

Measuring erythrocyte velocity in individual microvessels has important applications for biomedical and functional imaging. Recent multiphoton fluorescence microscopy approaches require injecting fluorescent tracers; moreover, only one or few vessels can be imaged at a time. To overcome these shortcomings, we used CCD-based optical imaging of intrinsic absorption changes in macroscopic vascular networks to record erythrocytes' trajectories over several mm (2) of cortical surface. We then demonstrate the feasibility of erythrocyte velocity estimation from such wide-field data, using two robust, independent, algorithms. The first one is a recently published Radon transform-based algorithm that estimates erythrocyte velocity locally. We adapt it to data obtained in wide-field imaging and show, for the first time, its performance on such datasets. The second ("fasttrack") algorithm is novel. It is based on global energy minimization techniques to estimate the full spatiotemporal erythrocytes' trajectories inside vessels. We test the two algorithms on both simulated and biological data, obtained in rat cerebral cortex in a spreading depression experiment. On vessels with medium-slow erythrocyte velocities both algorithms performed well, allowing their usage as benchmark one for another. However, our novel fasttrack algorithm outperformed the other one for higher velocities, as encountered in the arterial network.

Using nonlinear models in fMRI data analysis: model selection and activation detection.

There is an increasing interest in using physiologically plausible models in fMRI analysis. These models do raise new mathematical problems in terms of parameter estimation and interpretation of the measured data. In this paper, we show how to use physiological models to map and analyze brain activity from fMRI data. We describe a maximum likelihood parameter estimation algorithm and a statistical test that allow the following two actions: selecting the most statistically significant hemodynamic model for the measured data and deriving activation maps based on such model. Furthermore, as parameter estimation may leave much incertitude on the exact values of parameters, model identifiability characterization is a particular focus of our work. We applied these methods to different variations of the Balloon Model (Buxton, R.B., Wang, E.C., and Frank, L.R. 1998. Dynamics of blood flow and oxygenation changes during brain activation: the balloon model. Magn. Reson. Med. 39: 855-864; Buxton, R.B., Uludag, K., Dubowitz, D.J., and Liu, T.T. 2004. Modelling the hemodynamic response to brain activation. NeuroImage 23: 220-233; Friston, K. J., Mechelli, A., Turner, R., and Price, C. J. 2000. Nonlinear responses in fMRI: the balloon model, volterra kernels, and other hemodynamics. NeuroImage 12: 466-477) in a visual perception checkerboard experiment. Our model selection proved that hemodynamic models better explain the BOLD response than linear convolution, in particular because they are able to capture some features like poststimulus undershoot or nonlinear effects. On the other hand, nonlinear and linear models are comparable when signals get noisier, which explains that activation maps obtained in both frameworks are comparable. The tools we have developed prove that statistical inference methods used in the framework of the General Linear Model might be generalized to nonlinear models.

Variational, geometric, and statistical methods for modeling brain anatomy and function.

We survey the recent activities of the Odyssée Laboratory in the area of the application of mathematics to the design of models for studying brain anatomy and function. We start with the problem of reconstructing sources in MEG and EEG, and discuss the variational approach we have developed for solving these inverse problems. This motivates the need for geometric models of the head. We present a method for automatically and accurately extracting surface meshes of several tissues of the head from anatomical magnetic resonance (MR) images. Anatomical connectivity can be extracted from diffusion tensor magnetic resonance images but, in the current state of the technology, it must be preceded by a robust estimation and regularization stage. We discuss our work based on variational principles and show how the results can be used to track fibers in the white matter (WM) as geodesics in some Riemannian space. We then go to the statistical modeling of functional magnetic resonance imaging (fMRI) signals from the viewpoint of their decomposition in a pseudo-deterministic and stochastic part that we then use to perform clustering of voxels in a way that is inspired by the theory of support vector machines and in a way that is grounded in information theory. Multimodal image matching is discussed next in the framework of image statistics and partial differential equations (PDEs) with an eye on registering fMRI to the anatomy. The paper ends with a discussion of a new theory of random shapes that may prove useful in building anatomical and functional atlases.