Fluctuation-response relations for integrate-and-fire models with an absolute refractory period.

We study the problem of relating the spontaneous fluctuations of a stochastic integrate-and-fire (IF) model to the response of the instantaneous firing rate to time-dependent stimulation if the IF model is endowed with a non-vanishing refractory period and a finite (stereotypical) spike shape. This seemingly harmless addition to the model is shown to complicate the analysis put forward by Lindner Phys. Rev. Lett. (2022), i.e., the incorporation of the reset into the model equation, the Rice-like averaging of the stochastic differential equation, and the application of the Furutsu-Novikov theorem. We derive a still exact (although more complicated) fluctuation-response relation (FRR) for an IF model with refractory state and a white Gaussian background noise. We also briefly discuss an approximation for the case of a colored Gaussian noise and conclude with a summary and outlook on open problems.

Logarithmically scaled, gamma distributed neuronal spiking.

Naturally log-scaled quantities abound in the nervous system. Distributions of these quantities have non-intuitive properties, which have implications for data analysis and the understanding of neural circuits. Here, we review the log-scaled statistics of neuronal spiking and the relevant analytical probability distributions. Recent work using log-scaling revealed that interspike intervals of forebrain neurons segregate into discrete modes reflecting spiking at different timescales and are each well-approximated by a gamma distribution. Each neuron spends most of the time in an irregular spiking 'ground state' with the longest intervals, which determines the mean firing rate of the neuron. Across the entire neuronal population, firing rates are log-scaled and well approximated by the gamma distribution, with a small number of highly active neurons and an overabundance of low rate neurons (the 'dark matter'). These results are intricately linked to a heterogeneous balanced operating regime, which confers upon neuronal circuits multiple computational advantages and has evolutionarily ancient origins.

The steady state and response to a periodic stimulation of the firing rate for a theta neuron with correlated noise.

The stochastic activity of neurons is caused by various sources of correlated fluctuations and can be described in terms of simplified, yet biophysically grounded, integrate-and-fire models. One paradigmatic model is the quadratic integrate-and-fire model and its equivalent phase description by the theta neuron. Here we study the theta neuron model driven by a correlated Ornstein-Uhlenbeck noise and by periodic stimuli. We apply the matrix-continued-fraction method to the associated Fokker-Planck equation to develop an efficient numerical scheme to determine the stationary firing rate as well as the stimulus-induced modulation of the instantaneous firing rate. For the stationary case, we identify the conditions under which the firing rate decreases or increases by the effect of the colored noise and compare our results to existing analytical approximations for limit cases. For an additional periodic signal we demonstrate how the linear and nonlinear response terms can be computed and report resonant behavior for some of them. We extend the method to the case of two periodic signals, generally with incommensurable frequencies, and present a particular case for which a strong mixed response to both signals is observed, i.e. where the response to the sum of signals differs significantly from the sum of responses to the single signals. We provide Python code for our computational method: https://github.com/jannikfranzen/theta_neuron .

Sparse spike trains and the limitation of rate codes underlying rapid behaviours.

Animals live in dynamic worlds where they use sensorimotor circuits to rapidly process information and drive behaviours. For example, dragonflies are aerial predators that react to movements of prey within tens of milliseconds. These pursuits are likely controlled by identified neurons in the dragonfly, which have well-characterized physiological responses to moving targets. Predominantly, neural activity in these circuits is interpreted in context of a rate code, where information is conveyed by changes in the number of spikes over a time period. However, such a description of neuronal activity is difficult to achieve in real-world, real-time scenarios. Here, we contrast a neuroscientists' post-hoc view of spiking activity with the information available to the animal in real-time. We describe how performance of a rate code is readily overestimated and outline a rate code's significant limitations in driving rapid behaviours.

Estimating the neural spike train from an unfused tetanic signal of low-threshold motor units using convolutive blind source separation.

BACKGROUND: Individual motor units have been imaged using ultrafast ultrasound based on separating ultrasound images into motor unit twitches (unfused tetanus) evoked by the motoneuronal spike train. Currently, the spike train is estimated from the unfused tetanic signal using a Haar wavelet method (HWM). Although this ultrasound technique has great potential to provide comprehensive access to the neural drive to muscles for a large population of motor units simultaneously, the method has a limited identification rate of the active motor units. The estimation of spikes partly explains the limitation. Since the HWM may be sensitive to noise and unfused tetanic signals often are noisy, we must consider alternative methods with at least similar performance and robust against noise, among other factors. RESULTS: This study aimed to estimate spike trains from simulated and experimental unfused tetani using a convolutive blind source separation (CBSS) algorithm and compare it against HWM. We evaluated the parameters of CBSS using simulations and compared the performance of CBSS against the HWM using simulated and experimental unfused tetanic signals from voluntary contractions of humans and evoked contraction of rats. We found that CBSS had a higher performance than HWM with respect to the simulated firings than HWM (97.5 ± 2.7 vs 96.9 ± 3.3, p < 0.001). In addition, we found that the estimated spike trains from CBSS and HWM highly agreed with the experimental spike trains (98.0% and 96.4%). CONCLUSIONS: This result implies that CBSS can be used to estimate the spike train of an unfused tetanic signal and can be used directly within the current ultrasound-based motor unit identification pipeline. Extending this approach to decomposing ultrasound images into spike trains directly is promising. However, it remains to be investigated in future studies where spatial information is inevitable as a discriminating factor.

Estimating Mutual Information for Spike Trains: A Bird Song Example.

Zebra finches are a model animal used in the study of audition. They are adept at recognizing zebra finch songs, and the neural pathway involved in song recognition is well studied. Here, this example is used to illustrate the estimation of mutual information between stimuli and responses using a Kozachenko-Leonenko estimator. The challenge in calculating mutual information for spike trains is that there are no obvious coordinates for the data. The Kozachenko-Leonenko estimator does not require coordinates; it relies only on the distance between data points. In the case of bird songs, estimating the mutual information demonstrates that the information content of spiking does not diminish as the song progresses.

Trial-to-Trial Variability of Spiking Delay Activity in Prefrontal Cortex Constrains Burst-Coding Models of Working Memory.

A hallmark neuronal correlate of working memory (WM) is stimulus-selective spiking activity of neurons in PFC during mnemonic delays. These observations have motivated an influential computational modeling framework in which WM is supported by persistent activity. Recently, this framework has been challenged by arguments that observed persistent activity may be an artifact of trial-averaging, which potentially masks high variability of delay activity at the single-trial level. In an alternative scenario, WM delay activity could be encoded in bursts of selective neuronal firing which occur intermittently across trials. However, this alternative proposal has not been tested on single-neuron spike-train data. Here, we developed a framework for addressing this issue by characterizing the trial-to-trial variability of neuronal spiking quantified by Fano factor (FF). By building a doubly stochastic Poisson spiking model, we first demonstrated that the burst-coding proposal implies a significant increase in FF positively correlated with firing rate, and thus loss of stability across trials during the delay. Simulation of spiking cortical circuit WM models further confirmed that FF is a sensitive measure that can well dissociate distinct WM mechanisms. We then tested these predictions on datasets of single-neuron recordings from macaque PFC during three WM tasks. In sharp contrast to the burst-coding model predictions, we only found a small fraction of neurons showing increased WM-dependent burstiness, and stability across trials during delay was strengthened in empirical data. Therefore, reduced trial-to-trial variability during delay provides strong constraints on the contribution of single-neuron intermittent bursting to WM maintenance.SIGNIFICANCE STATEMENT There are diverging classes of theoretical models explaining how information is maintained in working memory by cortical circuits. In an influential model class, neurons exhibit persistent elevated memorandum-selective firing, whereas a recently developed class of burst-coding models suggests that persistent activity is an artifact of trial-averaging, and spiking is sparse in each single trial, subserved by brief intermittent bursts. However, this alternative picture has not been characterized or tested on empirical spike-train data. Here we combine mathematical analysis, computational model simulation, and experimental data analysis to test empirically these two classes of models and show that the trial-to-trial variability of empirical spike trains is not consistent with burst coding. These findings provide constraints for theoretical models of working memory.

Inhibitory interneurons in a brainstem circuit adjust their inhibitory motifs to process multimodal input.

KEY POINTS: Inhibitory-interneuron networks, consisting of multiple forms of circuit motifs including reciprocal (inhibitory interneurons inhibiting other interneurons) and feedforward (inhibitory interneurons inhibiting principal neurons) connections, are crucial in processing sensory information. The present study applies a statistical method to in vivo multichannel spike trains of dorsal cochlear nucleus neurons to disentangle reciprocal and feedforward-inhibitory motifs. After inducing input-specific plasticity, reciprocal and feedforward inhibition are found to be differentially regulated, and the combined effect synergistically modulates circuit output. The findings highlight the interplay among different circuit motifs as a key element in neural computation. ABSTRACT: Inhibitory interneurons play an essential role in neural computations by utilizing a combination of reciprocal (interneurons inhibiting each other) and feedforward (interneuron inhibiting the principal neuron) inhibition to process information. To disentangle the interplay between the two inhibitory-circuit motifs and understand their effects on the circuit output, in vivo recordings were made from the guinea pig dorsal cochlear nucleus, a cerebellar-like brainstem circuit. Spikes from inhibitory interneurons (cartwheel cell) and principal output neurons (fusiform cell) were compared before and after manipulating their common multimodal input. Using a statistical model based on the Cox method of modulated renewal process of spike train influence, reciprocal- and feedforward-inhibition motifs were quantified. In response to altered multimodal input, reciprocal inhibition was strengthened while feedforward inhibition was weakened, and the two motifs combined to modulate fusiform cell output and acoustic-driven responses. These findings reveal the cartwheel cell's role in auditory and multimodal processing, as well as illustrated the balance between different inhibitory-circuit motifs as a key element in neural computation.

Linear Response of General Observables in Spiking Neuronal Network Models.

We establish a general linear response relation for spiking neuronal networks, based on chains with unbounded memory. This relation allow us to predict the influence of a weak amplitude time dependent external stimuli on spatio-temporal spike correlations, from the spontaneous statistics (without stimulus) in a general context where the memory in spike dynamics can extend arbitrarily far in the past. Using this approach, we show how the linear response is explicitly related to the collective effect of the stimuli, intrinsic neuronal dynamics, and network connectivity on spike train statistics. We illustrate our results with numerical simulations performed over a discrete time integrate and fire model.

Multiscale relevance and informative encoding in neuronal spike trains.

Neuronal responses to complex stimuli and tasks can encompass a wide range of time scales. Understanding these responses requires measures that characterize how the information on these response patterns are represented across multiple temporal resolutions. In this paper we propose a metric - which we call multiscale relevance (MSR) - to capture the dynamical variability of the activity of single neurons across different time scales. The MSR is a non-parametric, fully featureless indicator in that it uses only the time stamps of the firing activity without resorting to any a priori covariate or invoking any specific structure in the tuning curve for neural activity. When applied to neural data from the mEC and from the ADn and PoS regions of freely-behaving rodents, we found that neurons having low MSR tend to have low mutual information and low firing sparsity across the correlates that are believed to be encoded by the region of the brain where the recordings were made. In addition, neurons with high MSR contain significant information on spatial navigation and allow to decode spatial position or head direction as efficiently as those neurons whose firing activity has high mutual information with the covariate to be decoded and significantly better than the set of neurons with high local variations in their interspike intervals. Given these results, we propose that the MSR can be used as a measure to rank and select neurons for their information content without the need to appeal to any a priori covariate.

Reproducible Quantitative Stimulation Allows New Analysis of Crayfish Muscle Receptor Organ Responses.

The crustacean muscle receptor organ (MRO) has provided a particularly accessible preparation for the study of sensory coding, which has been widely used in introductory laboratory courses incorporating extracellular recording from sensory nerves in living preparations. We describe three innovations to the standard laboratory exercise using the MRO: (1) a new form of suction electrode to facilitate extracellular recording; (2) a new, Arduino-driven actuator to allow reproducible and quantifiable mechanical stimulation of the MRO; and (3) a new approach to the crayfish abdomen preparation that allows linear extension of the MRO muscles. These novel approaches allow the collection of data sets comprised of sensory cell spike trains under software control as important mechanical stimulus parameters are varied systematically through software. This additional level of user control facilitates a more robust quantitative approach to the analysis of MRO sensory neuron spike trains, which is facilitated by training in data analysis using python.

Discrimination of bursts and tonic activity in multifunctional sensorimotor neural network using the extended hill-valley method.

Individual neurons can exhibit a wide range of activity, including spontaneous spiking, tonic spiking, bursting, or spike-frequency adaptation, and can also transition between these activity types. Manual identification of these activity patterns can be subjective and inconsistent. The extended hill-valley (EHV) analysis discriminates tonic spiking and bursts in a spike train by detecting fluctuations in a local, history-dependent analysis signal derived from the spike train. Consequently, the EHV method is not susceptible to changes in baseline firing rate and can identify different types of activity patterns. In addition, output from the EHV method can be used to identify more complex activity patterns such as phasotonic bursting, in which a burst is immediately followed by a period of tonic spiking.NEW & NOTEWORTHY Neurons exhibit diverse spiking patterns, but automated activity classification has focused mainly on detecting bursts. The novel extended hill-valley algorithm uses a smoothed, history-dependent signal to discriminate different types of activity, such as bursts and tonic spiking.

Models of vestibular semicircular canal afferent neuron firing activity.

Semicircular canal afferent neurons transmit information about head rotation to the brain. Mathematical models of how they do this have coevolved with concepts of how brains perceive the world. A 19th-century "camera" metaphor, in which sensory neurons project an image of the world captured by sense organs into the brain, gave way to a 20th-century view of sensory nerves as communication channels providing inputs to dynamical control systems. Now, in the 21st century, brains are being modeled as Bayesian observers who infer what is happening in the world given noisy, incomplete, and distorted sense data. The semicircular canals of the vestibular apparatus provide an experimentally accessible, low-dimensional system for developing and testing dynamical Bayesian generative models of sense data. In this review, we summarize advances in mathematical modeling of information transmission by semicircular canal afferent sensory neurons since the first such model was proposed nearly a century ago. Models of information transmission by vestibular afferent neurons may provide a foundation for developing realistic models of how brains perceive the world by inferring the causes of sense data.

Stability of point process spiking neuron models.

Point process regression models, based on generalized linear model (GLM) technology, have been widely used for spike train analysis, but a recent paper by Gerhard et al. described a kind of instability, in which fitted models can generate simulated spike trains with explosive firing rates. We analyze the problem by extending the methods of Gerhard et al. First, we improve their instability diagnostic and extend it to a wider class of models. Next, we point out some common situations in which instability can be traced to model lack of fit. Finally, we investigate distinctions between models that use a single filter to represent the effects of all spikes prior to any particular time t, as in a 2008 paper by Pillow et al., and those that allow different filters for each spike prior to time t, as in a 2001 paper by Kass and Ventura. We re-analyze the data sets used by Gerhard et al., introduce an additional data set that exhibits bursting, and use a well-known model described by Izhikevich to simulate spike trains from various ground truth scenarios. We conclude that models with multiple filters tend to avoid instability, but there are unlikely to be universal rules. Instead, care in data fitting is required and models need to be assessed for each unique set of data.

Slow-gamma frequencies are optimally guarded against effects of neurodegenerative diseases and traumatic brain injuries.

We introduce a computational model for the cellular level effects of firing rate filtering due to the major forms of neuronal injury, including demyelination and axonal swellings. Based upon experimental and computational observations, we posit simple phenomenological input/output rules describing spike train distortions and demonstrate that slow-gamma frequencies in the 38-41 Hz range emerge as the most robust to injury. Our signal-processing model allows us to derive firing rate filters at the cellular level for impaired neural activity with minimal assumptions. Specifically, we model eight experimentally observed spike train transformations by discrete-time filters, including those associated with increasing refractoriness and intermittent blockage. Continuous counterparts for the filters are also obtained by approximating neuronal firing rates from spike trains convolved with causal and Gaussian kernels. The proposed signal processing framework, which is robust to model parameter calibration, is an abstraction of the major cellular-level pathologies associated with neurodegenerative diseases and traumatic brain injuries that affect spike train propagation and impair neuronal network functionality. Our filters are well aligned with the spectrum of dynamic memory fields including working memory, visual consciousness, and other higher cognitive functions that operate in a frequency band that is - at a single cell level - optimally guarded against common types of pathological effects. In contrast, higher-frequency neural encoding, such as is observed with short-term memory, are susceptible to neurodegeneration and injury.

Task-driven intra- and interarea communications in primate cerebral cortex.

Neural correlations during a cognitive task are central to study brain information processing and computation. However, they have been poorly analyzed due to the difficulty of recording simultaneous single neurons during task performance. In the present work, we quantified neural directional correlations using spike trains that were simultaneously recorded in sensory, premotor, and motor cortical areas of two monkeys during a somatosensory discrimination task. Upon modeling spike trains as binary time series, we used a nonparametric Bayesian method to estimate pairwise directional correlations between many pairs of neurons throughout different stages of the task, namely, perception, working memory, decision making, and motor report. We find that solving the task involves feedforward and feedback correlation paths linking sensory and motor areas during certain task intervals. Specifically, information is communicated by task-driven neural correlations that are significantly delayed across secondary somatosensory cortex, premotor, and motor areas when decision making takes place. Crucially, when sensory comparison is no longer requested for task performance, a major proportion of directional correlations consistently vanish across all cortical areas.

Information Entropy Production of Maximum Entropy Markov Chains from Spike Trains.

The spiking activity of neuronal networks follows laws that are not time-reversal symmetric; the notion of pre-synaptic and post-synaptic neurons, stimulus correlations and noise correlations have a clear time order. Therefore, a biologically realistic statistical model for the spiking activity should be able to capture some degree of time irreversibility. We use the thermodynamic formalism to build a framework in the context maximum entropy models to quantify the degree of time irreversibility, providing an explicit formula for the information entropy production of the inferred maximum entropy Markov chain. We provide examples to illustrate our results and discuss the importance of time irreversibility for modeling the spike train statistics.

Large Deviations Properties of Maximum Entropy Markov Chains from Spike Trains.

We consider the maximum entropy Markov chain inference approach to characterize the collective statistics of neuronal spike trains, focusing on the statistical properties of the inferred model. To find the maximum entropy Markov chain, we use the thermodynamic formalism, which provides insightful connections with statistical physics and thermodynamics from which large deviations properties arise naturally. We provide an accessible introduction to the maximum entropy Markov chain inference problem and large deviations theory to the community of computational neuroscience, avoiding some technicalities while preserving the core ideas and intuitions. We review large deviations techniques useful in spike train statistics to describe properties of accuracy and convergence in terms of sampling size. We use these results to study the statistical fluctuation of correlations, distinguishability, and irreversibility of maximum entropy Markov chains. We illustrate these applications using simple examples where the large deviation rate function is explicitly obtained for maximum entropy models of relevance in this field.

[Measurement and performance analysis of functional neural network].

The measurement of network is one of the important researches in resolving neuronal population information processing mechanism using complex network theory. For the quantitative measurement problem of functional neural network, the relation between the measure indexes, i.e. the clustering coefficient, the global efficiency, the characteristic path length and the transitivity, and the network topology was analyzed. Then, the spike-based functional neural network was established and the simulation results showed that the measured network could represent the original neural connections among neurons. On the basis of the former work, the coding of functional neural network in nidopallium caudolaterale (NCL) about pigeon's motion behaviors was studied. We found that the NCL functional neural network effectively encoded the motion behaviors of the pigeon, and there were significant differences in four indexes among the left-turning, the forward and the right-turning. Overall, the establishment method of spike-based functional neural network is available and it is an effective tool to parse the brain information processing mechanism.

Models of utricular bouton afferents: role of afferent-hair cell connectivity in determining spike train regularity.

Vestibular bouton afferent terminals in turtle utricle can be categorized into four types depending on their location and terminal arbor structure: lateral extrastriolar (LES), striolar, juxtastriolar, and medial extrastriolar (MES). The terminal arbors of these afferents differ in surface area, total length, collecting area, number of boutons, number of bouton contacts per hair cell, and axon diameter (Huwe JA, Logan CJ, Williams B, Rowe MH, Peterson EH. J Neurophysiol 113: 2420-2433, 2015). To understand how differences in terminal morphology and the resulting hair cell inputs might affect afferent response properties, we modeled representative afferents from each region, using reconstructed bouton afferents. Collecting area and hair cell density were used to estimate hair cell-to-afferent convergence. Nonmorphological features were held constant to isolate effects of afferent structure and connectivity. The models suggest that all four bouton afferent types are electrotonically compact and that excitatory postsynaptic potentials are two to four times larger in MES afferents than in other afferents, making MES afferents more responsive to low input levels. The models also predict that MES and LES terminal structures permit higher spontaneous firing rates than those in striola and juxtastriola. We found that differences in spike train regularity are not a consequence of differences in peripheral terminal structure, per se, but that a higher proportion of multiple contacts between afferents and individual hair cells increases afferent firing irregularity. The prediction that afferents having primarily one bouton contact per hair cell will fire more regularly than afferents making multiple bouton contacts per hair cell has implications for spike train regularity in dimorphic and calyx afferents.NEW & NOTEWORTHY Bouton afferents in different regions of turtle utricle have very different morphologies and afferent-hair cell connectivities. Highly detailed computational modeling provides insights into how morphology impacts excitability and also reveals a new explanation for spike train irregularity based on relative numbers of multiple bouton contacts per hair cell. This mechanism is independent of other proposed mechanisms for spike train irregularity based on ionic conductances and can explain irregularity in dimorphic units and calyx endings.