Latent Dynamical Variables Produce Signatures of Spatiotemporal Criticality in Large Biological Systems.

Understanding the activity of large populations of neurons is difficult due to the combinatorial complexity of possible cell-cell interactions. To reduce the complexity, coarse graining had been previously applied to experimental neural recordings, which showed over two decades of apparent scaling in free energy, activity variance, eigenvalue spectra, and correlation time, hinting that the mouse hippocampus operates in a critical regime. We model such data by simulating conditionally independent binary neurons coupled to a small number of long-timescale stochastic fields and then replicating the coarse-graining procedure and analysis. This reproduces the experimentally observed scalings, suggesting that they do not require fine-tuning of internal parameters, but will arise in any system, biological or not, where activity variables are coupled to latent dynamic stimuli. Parameter sweeps for our model suggest that emergence of scaling requires most of the cells in a population to couple to the latent stimuli, predicting that even the celebrated place cells must also respond to nonplace stimuli.

Randomly connected networks generate emergent selectivity and predict decoding properties of large populations of neurons.

Modern recording methods enable sampling of thousands of neurons during the performance of behavioral tasks, raising the question of how recorded activity relates to theoretical models. In the context of decision making, functional connectivity between choice-selective cortical neurons was recently reported. The straightforward interpretation of these data suggests the existence of selective pools of inhibitory and excitatory neurons. Computationally investigating an alternative mechanism for these experimental observations, we find that a randomly connected network of excitatory and inhibitory neurons generates single-cell selectivity, patterns of pairwise correlations, and the same ability of excitatory and inhibitory populations to predict choice, as in experimental observations. Further, we predict that, for this task, there are no anatomically defined subpopulations of neurons representing choice, and that choice preference of a particular neuron changes with the details of the task. We suggest that distributed stimulus selectivity and functional organization in population codes could be emergent properties of randomly connected networks.

Learning to make external sensory stimulus predictions using internal correlations in populations of neurons.

To compensate for sensory processing delays, the visual system must make predictions to ensure timely and appropriate behaviors. Recent work has found predictive information about the stimulus in neural populations early in vision processing, starting in the retina. However, to utilize this information, cells downstream must be able to read out the predictive information from the spiking activity of retinal ganglion cells. Here we investigate whether a downstream cell could learn efficient encoding of predictive information in its inputs from the correlations in the inputs themselves, in the absence of other instructive signals. We simulate learning driven by spiking activity recorded in salamander retina. We model a downstream cell as a binary neuron receiving a small group of weighted inputs and quantify the predictive information between activity in the binary neuron and future input. Input weights change according to spike timing-dependent learning rules during a training period. We characterize the readouts learned under spike timing-dependent synaptic update rules, finding that although the fixed points of learning dynamics are not associated with absolute optimal readouts they convey nearly all of the information conveyed by the optimal readout. Moreover, we find that learned perceptrons transmit position and velocity information of a moving-bar stimulus nearly as efficiently as optimal perceptrons. We conclude that predictive information is, in principle, readable from the perspective of downstream neurons in the absence of other inputs. This suggests an important role for feedforward prediction in sensory encoding.

State-aware detection of sensory stimuli in the cortex of the awake mouse.

Cortical responses to sensory inputs vary across repeated presentations of identical stimuli, but how this trial-to-trial variability impacts detection of sensory inputs is not fully understood. Using multi-channel local field potential (LFP) recordings in primary somatosensory cortex (S1) of the awake mouse, we optimized a data-driven cortical state classifier to predict single-trial sensory-evoked responses, based on features of the spontaneous, ongoing LFP recorded across cortical layers. Our findings show that, by utilizing an ongoing prediction of the sensory response generated by this state classifier, an ideal observer improves overall detection accuracy and generates robust detection of sensory inputs across various states of ongoing cortical activity in the awake brain, which could have implications for variability in the performance of detection tasks across brain states.

Primary Tactile Thalamus Spiking Reflects Cognitive Signals.

Little is known about whether information transfer at primary sensory thalamic nuclei is modified by behavioral context. Here we studied the influence of previous decisions/rewards on current choices and preceding spike responses of ventroposterior medial thalamus (VPm; the primary sensory thalamus in the rat whisker-related tactile system). We trained head-fixed rats to detect a ramp-like deflection of one whisker interspersed within ongoing white noise stimulation. Using generative modeling of behavior, we identify two task-related variables that are predictive of actual decisions. The first reflects task engagement on a local scale ("trial history": defined as the decisions and outcomes of a small number of past trials), whereas the other captures behavioral dynamics on a global scale ("satiation": slow dynamics of the response pattern along an entire session). Although satiation brought about a slow drift from Go to NoGo decisions during the session, trial history was related to local (trial-by-trial) patterning of Go and NoGo decisions. A second model that related the same predictors first to VPm spike responses, and from there to decisions, indicated that spiking, in contrast to behavior, is sensitive to trial history but relatively insensitive to satiation. Trial history influences VPm spike rates and regularity such that a history of Go decisions would predict fewer noise-driven spikes (but more regular ones), and more ramp-driven spikes. Neuronal activity in VPm, thus, is sensitive to local behavioral history, and may play an important role in higher-order cognitive signaling.SIGNIFICANCE STATEMENT It is an important question for perceptual and brain functions to find out whether cognitive signals modulate the sensory signal stream and if so, where in the brain this happens. This study provides evidence that decision and reward history can already be reflected in the ascending sensory pathway, on the level of first-order sensory thalamus. Cognitive signals are relayed very selectively such that only local trial history (spanning a few trials) but not global history (spanning an entire session) are reflected.

Decoding thalamic afferent input using microcircuit spiking activity.

A behavioral response appropriate to a sensory stimulus depends on the collective activity of thousands of interconnected neurons. The majority of cortical connections arise from neighboring neurons, and thus understanding the cortical code requires characterizing information representation at the scale of the cortical microcircuit. Using two-photon calcium imaging, we densely sampled the thalamically evoked response of hundreds of neurons spanning multiple layers and columns in thalamocortical slices of mouse somatosensory cortex. We then used a biologically plausible decoder to characterize the representation of two distinct thalamic inputs, at the level of the microcircuit, to reveal those aspects of the activity pattern that are likely relevant to downstream neurons. Our data suggest a sparse code, distributed across lamina, in which a small population of cells carries stimulus-relevant information. Furthermore, we find that, within this subset of neurons, decoder performance improves when noise correlations are taken into account.

Inhibition facilitates direction selectivity in a noisy cortical environment.

In a broad class of models, direction selectivity in primary visual cortical neurons arises from the linear summation of spatially offset and temporally lagged inputs combined with a spike threshold. Here, we characterize the robustness of this class of models to input noise and background activity that is uncorrelated with the visual stimulus. When only excitatory inputs were considered, moderate levels of noise substantially degraded direction selectivity. By contrast, the inclusion of inhibition produced a direction-selective neuron even at high noise levels. Moreover, if inhibitory inputs were tuned, mirroring excitatory inputs but lagging by a fixed delay, they promoted a highly direction-selective response by suppressing all excitatory inputs in the null direction while minimally affecting excitatory inputs in the preferred direction. Additionally, tuned inhibition strongly reduced trial-by-trial variability, such that the neuron produced a consistent direction-selective response to multiple presentation of the same stimulus. This work illustrates how inhibition could be used by cortical circuits to reliably extract information on a single-trial basis from feed-forward inputs in a noisy, high-background context.

Neural criticality from effective latent variables.

Observations of power laws in neural activity data have raised the intriguing notion that brains may operate in a critical state. One example of this critical state is 'avalanche criticality', which has been observed in various systems, including cultured neurons, zebrafish, rodent cortex, and human EEG. More recently, power laws were also observed in neural populations in the mouse under an activity coarse-graining procedure, and they were explained as a consequence of the neural activity being coupled to multiple latent dynamical variables. An intriguing possibility is that avalanche criticality emerges due to a similar mechanism. Here, we determine the conditions under which latent dynamical variables give rise to avalanche criticality. We find that populations coupled to multiple latent variables produce critical behavior across a broader parameter range than those coupled to a single, quasi-static latent variable, but in both cases, avalanche criticality is observed without fine-tuning of model parameters. We identify two regimes of avalanches, both critical but differing in the amount of information carried about the latent variable. Our results suggest that avalanche criticality arises in neural systems in which activity is effectively modeled as a population driven by a few dynamical variables and these variables can be inferred from the population activity.

Stereotyped spatiotemporal dynamics of spontaneous activity in visual cortex prior to eye-opening.

Over the course of development, functional sensory representations emerge in the visual cortex. Prior to eye-opening, modular patterns of spontaneous activity form long-range networks that may serve as a precursor for mature network organization. Although the spatial structure of these networks has been well studied, their temporal features, which may contribute to their continued plasticity and development, remain largely uncharacterized. To address this, we imaged hours of spontaneous network activity in the visual cortex of developing ferrets of both sexes utilizing a fast calcium indicator (GCaMP8m) and widefield imaging at high temporal resolution (50Hz), then segmented out spatiotemporal events. The spatial structure of this activity was highly modular, exhibiting spatially segregated active domains consistent with prior work. We found that the vast majority of events showed a clear dynamic component in which modules activated sequentially across the field of view, but only a minority of events were well-fit with a linear traveling wave. We found that spatiotemporal events occur in repeated and stereotyped motifs, reoccurring across hours of imaging. Finally, we found that the most frequently occurring single-frame spatial activity patterns were predictive of future activity patterns over hundreds of milliseconds. Together, our results demonstrate that spontaneous activity in the early developing cortex exhibits a rich spatiotemporal structure, suggesting a potential role in the maturation and refinement of future functional representations.

A machine learning approach for real-time cortical state estimation.

Objective.Cortical function is under constant modulation by internally-driven, latent variables that regulate excitability, collectively known as 'cortical state'. Despite a vast literature in this area, the estimation of cortical state remains relatively ad hoc, and not amenable to real-time implementation. Here, we implement robust, data-driven, and fast algorithms that address several technical challenges for online cortical state estimation.Approach. We use unsupervised Gaussian mixture models to identify discrete, emergent clusters in spontaneous local field potential signals in cortex. We then extend our approach to a temporally-informed hidden semi-Markov model (HSMM) with Gaussian observations to better model and infer cortical state transitions. Finally, we implement our HSMM cortical state inference algorithms in a real-time system, evaluating their performance in emulation experiments.Main results. Unsupervised clustering approaches reveal emergent state-like structure in spontaneous electrophysiological data that recapitulate arousal-related cortical states as indexed by behavioral indicators. HSMMs enable cortical state inferences in a real-time context by modeling the temporal dynamics of cortical state switching. Using HSMMs provides robustness to state estimates arising from noisy, sequential electrophysiological data.Significance. To our knowledge, this work represents the first implementation of a real-time software tool for continuously decoding cortical states with high temporal resolution (40 ms). The software tools that we provide can facilitate our understanding of how cortical states dynamically modulate cortical function on a moment-by-moment basis and provide a basis for state-aware brain machine interfaces across health and disease.

Neural criticality from effective latent variables.

Observations of power laws in neural activity data have raised the intriguing notion that brains may operate in a critical state. One example of this critical state is "avalanche criticality," which has been observed in various systems, including cultured neurons, zebrafish, rodent cortex, and human EEG. More recently, power laws were also observed in neural populations in the mouse under an activity coarse-graining procedure, and they were explained as a consequence of the neural activity being coupled to multiple latent dynamical variables. An intriguing possibility is that avalanche criticality emerges due to a similar mechanism. Here, we determine the conditions under which latent dynamical variables give rise to avalanche criticality. We find that populations coupled to multiple latent variables produce critical behavior across a broader parameter range than those coupled to a single, quasi-static latent variable, but in both cases, avalanche criticality is observed without fine-tuning of model parameters. We identify two regimes of avalanches, both critical but differing in the amount of information carried about the latent variable. Our results suggest that avalanche criticality arises in neural systems in which activity is effectively modeled as a population driven by a few dynamical variables and these variables can be inferred from the population activity.

Erratum: Genetically expressed voltage sensor ArcLight for imaging large scale cortical activity in the anesthetized and awake mouse (erratum).

[This corrects the article DOI: 10.1117/1.NPh.4.3.031212.].

Genetically expressed voltage sensor ArcLight for imaging large scale cortical activity in the anesthetized and awake mouse.

With the recent breakthrough in genetically expressed voltage indicators (GEVIs), there has been a tremendous demand to determine the capabilities of these sensors in vivo. Novel voltage sensitive fluorescent proteins allow for direct measurement of neuron membrane potential changes through changes in fluorescence. Here, we utilized ArcLight, a recently developed GEVI, and examined the functional characteristics in the widely used mouse somatosensory whisker pathway. We measured the resulting evoked fluorescence using a wide-field microscope and a CCD camera at 200 Hz, which enabled voltage recordings over the entire cortical region with high temporal resolution. We found that ArcLight produced a fluorescent response in the S1 barrel cortex during sensory stimulation at single whisker resolution. During wide-field cortical imaging, we encountered substantial hemodynamic noise that required additional post hoc processing through noise subtraction techniques. Over a period of 28 days, we found clear and consistent ArcLight fluorescence responses to a simple sensory input. Finally, we demonstrated the use of ArcLight to resolve cortical S1 sensory responses in the awake mouse. Taken together, our results demonstrate the feasibility of ArcLight as a measurement tool for mesoscopic, chronic imaging.

The development of cortical circuits for motion discrimination.

Stimulus discrimination depends on the selectivity and variability of neural responses, as well as the size and correlation structure of the responsive population. For direction discrimination in visual cortex, only the selectivity of neurons has been well characterized across development. Here we show in ferrets that at eye opening, the cortical response to visual stimulation exhibits several immaturities, including a high density of active neurons that display prominent wave-like activity, a high degree of variability and strong noise correlations. Over the next three weeks, the population response becomes increasingly sparse, wave-like activity disappears, and variability and noise correlations are markedly reduced. Similar changes were observed in identified neuronal populations imaged repeatedly over days. Furthermore, experience with a moving stimulus was capable of driving a reduction in noise correlations over a matter of hours. These changes in variability and correlation contribute significantly to a marked improvement in direction discriminability over development.

Local changes in neocortical circuit dynamics coincide with the spread of seizures to thalamus in a model of epilepsy.

During the generalization of epileptic seizures, pathological activity in one brain area recruits distant brain structures into joint synchronous discharges. However, it remains unknown whether specific changes in local circuit activity are related to the aberrant recruitment of anatomically distant structures into epileptiform discharges. Further, it is not known whether aberrant areas recruit or entrain healthy ones into pathological activity. Here we study the dynamics of local circuit activity during the spread of epileptiform discharges in the zero-magnesium in vitro model of epilepsy. We employ high-speed multi-photon imaging in combination with dual whole-cell recordings in acute thalamocortical (TC) slices of the juvenile mouse to characterize the generalization of epileptic activity between neocortex and thalamus. We find that, although both structures are exposed to zero-magnesium, the initial onset of focal epileptiform discharge occurs in cortex. This suggests that local recurrent connectivity that is particularly prevalent in cortex is important for the initiation of seizure activity. Subsequent recruitment of thalamus into joint, generalized discharges is coincident with an increase in the coherence of local cortical circuit activity that itself does not depend on thalamus. Finally, the intensity of population discharges is positively correlated between both brain areas. This suggests that during and after seizure generalization not only the timing but also the amplitude of epileptiform discharges in thalamus is entrained by cortex. Together these results suggest a central role of neocortical activity for the onset and the structure of pathological recruitment of thalamus into joint synchronous epileptiform discharges.