Causal connectivity measures for pulse-output network reconstruction: Analysis and applications.

The causal connectivity of a network is often inferred to understand network function. It is arguably acknowledged that the inferred causal connectivity relies on the causality measure one applies, and it may differ from the network's underlying structural connectivity. However, the interpretation of causal connectivity remains to be fully clarified, in particular, how causal connectivity depends on causality measures and how causal connectivity relates to structural connectivity. Here, we focus on nonlinear networks with pulse signals as measured output, e.g., neural networks with spike output, and address the above issues based on four commonly utilized causality measures, i.e., time-delayed correlation coefficient, time-delayed mutual information, Granger causality, and transfer entropy. We theoretically show how these causality measures are related to one another when applied to pulse signals. Taking a simulated Hodgkin-Huxley network and a real mouse brain network as two illustrative examples, we further verify the quantitative relations among the four causality measures and demonstrate that the causal connectivity inferred by any of the four well coincides with the underlying network structural connectivity, therefore illustrating a direct link between the causal and structural connectivity. We stress that the structural connectivity of pulse-output networks can be reconstructed pairwise without conditioning on the global information of all other nodes in a network, thus circumventing the curse of dimensionality. Our framework provides a practical and effective approach for pulse-output network reconstruction.

Maximum Entropy Principle Underlies Wiring Length Distribution in Brain Networks.

A brain network comprises a substantial amount of short-range connections with an admixture of long-range connections. The portion of long-range connections in brain networks is observed to be quantitatively dissimilar across species. It is hypothesized that the length of connections is constrained by the spatial embedding of brain networks, yet fundamental principles that underlie the wiring length distribution remain unclear. By quantifying the structural diversity of a brain network using Shannon's entropy, here we show that the wiring length distribution across multiple species-including Drosophila, mouse, macaque, human, and C. elegans-follows the maximum entropy principle (MAP) under the constraints of limited wiring material and the spatial locations of brain areas or neurons. In addition, by considering stochastic axonal growth, we propose a network formation process capable of reproducing wiring length distributions of the 5 species, thereby implementing MAP in a biologically plausible manner. We further develop a generative model incorporating MAP, and show that, for the 5 species, the generated network exhibits high similarity to the real network. Our work indicates that the brain connectivity evolves to be structurally diversified by maximizing entropy to support efficient interareal communication, providing a potential organizational principle of brain networks.

Dendritic computations captured by an effective point neuron model.

Complex dendrites in general present formidable challenges to understanding neuronal information processing. To circumvent the difficulty, a prevalent viewpoint simplifies the neuronal morphology as a point representing the soma, and the excitatory and inhibitory synaptic currents originated from the dendrites are treated as linearly summed at the soma. Despite its extensive applications, the validity of the synaptic current description remains unclear, and the existing point neuron framework fails to characterize the spatiotemporal aspects of dendritic integration supporting specific computations. Using electrophysiological experiments, realistic neuronal simulations, and theoretical analyses, we demonstrate that the traditional assumption of linear summation of synaptic currents is oversimplified and underestimates the inhibition effect. We then derive a form of synaptic integration current within the point neuron framework to capture dendritic effects. In the derived form, the interaction between each pair of synaptic inputs on the dendrites can be reliably parameterized by a single coefficient, suggesting the inherent low-dimensional structure of dendritic integration. We further generalize the form of synaptic integration current to capture the spatiotemporal interactions among multiple synaptic inputs and show that a point neuron model with the synaptic integration current incorporated possesses the computational ability of a spatial neuron with dendrites, including direction selectivity, coincidence detection, logical operation, and a bilinear dendritic integration rule discovered in experiment. Our work amends the modeling of synaptic inputs and improves the computational power of a modeling neuron within the point neuron framework.

Mechanisms underlying contrast-dependent orientation selectivity in mouse V1.

Recent experiments have shown that mouse primary visual cortex (V1) is very different from that of cat or monkey, including response properties-one of which is that contrast invariance in the orientation selectivity (OS) of the neurons' firing rates is replaced in mouse with contrast-dependent sharpening (broadening) of OS in excitatory (inhibitory) neurons. These differences indicate a different circuit design for mouse V1 than that of cat or monkey. Here we develop a large-scale computational model of an effective input layer of mouse V1. Constrained by experiment data, the model successfully reproduces experimentally observed response properties-for example, distributions of firing rates, orientation tuning widths, and response modulations of simple and complex neurons, including the contrast dependence of orientation tuning curves. Analysis of the model shows that strong feedback inhibition and strong orientation-preferential cortical excitation to the excitatory population are the predominant mechanisms underlying the contrast-sharpening of OS in excitatory neurons, while the contrast-broadening of OS in inhibitory neurons results from a strong but nonpreferential cortical excitation to these inhibitory neurons, with the resulting contrast-broadened inhibition producing a secondary enhancement on the contrast-sharpened OS of excitatory neurons. Finally, based on these mechanisms, we show that adjusting the detailed balances between the predominant mechanisms can lead to contrast invariance-providing insights for future studies on contrast dependence (invariance).

Neural networks of different species, brain areas and states can be characterized by the probability polling state.

Cortical networks are complex systems of a great many interconnected neurons that operate from collective dynamical states. To understand how cortical neural networks function, it is important to identify their common dynamical operating states from the probabilistic viewpoint. Probabilistic characteristics of these operating states often underlie network functions. Here, using multi-electrode data from three separate experiments, we identify and characterize a cortical operating state (the "probability polling" or "p-polling" state), common across mouse and monkey with different behaviors. If the interaction among neurons is weak, the p-polling state provides a quantitative understanding of how the high dimensional probability distribution of firing patterns can be obtained by the low-order maximum entropy formulation, effectively utilizing a low dimensional stimulus-coding structure. These results show evidence for generality of the p-polling state and in certain situations its advantage of providing a mathematical validation for the low-order maximum entropy principle as a coding strategy.

A computational investigation of electrotonic coupling between pyramidal cells in the cortex.

The existence of electrical communication among pyramidal cells (PCs) in the adult cortex has been debated by neuroscientists for several decades. Gap junctions (GJs) among cortical interneurons have been well documented experimentally and their functional roles have been proposed by both computational neuroscientists and experimentalists alike. Experimental evidence for similar junctions among pyramidal cells in the cortex, however, has remained elusive due to the apparent rarity of these couplings among neurons. In this work, we develop a neuronal network model that includes observed probabilities and strengths of electrotonic coupling between PCs and gap-junction coupling among interneurons, in addition to realistic synaptic connectivity among both populations. We use this network model to investigate the effect of electrotonic coupling between PCs on network behavior with the goal of theoretically addressing this controversy of existence and purpose of electrotonically coupled PCs in the cortex.

Determination of effective synaptic conductances using somatic voltage clamp.

The interplay between excitatory and inhibitory neurons imparts rich functions of the brain. To understand the synaptic mechanisms underlying neuronal computations, a fundamental approach is to study the dynamics of excitatory and inhibitory synaptic inputs of each neuron. The traditional method of determining input conductance, which has been applied for decades, employs the synaptic current-voltage (I-V) relation obtained via voltage clamp. Due to the space clamp effect, the measured conductance is different from the local conductance on the dendrites. Therefore, the interpretation of the measured conductance remains to be clarified. Using theoretical analysis, electrophysiological experiments, and realistic neuron simulations, here we demonstrate that there does not exist a transform between the local conductance and the conductance measured by the traditional method, due to the neglect of a nonlinear interaction between the clamp current and the synaptic current in the traditional method. Consequently, the conductance determined by the traditional method may not correlate with the local conductance on the dendrites, and its value could be unphysically negative as observed in experiment. To circumvent the challenge of the space clamp effect and elucidate synaptic impact on neuronal information processing, we propose the concept of effective conductance which is proportional to the local conductance on the dendrite and reflects directly the functional influence of synaptic inputs on somatic membrane potential dynamics, and we further develop a framework to determine the effective conductance accurately. Our work suggests re-examination of previous studies involving conductance measurement and provides a reliable approach to assess synaptic influence on neuronal computation.

The extended Granger causality analysis for Hodgkin-Huxley neuronal models.

How to extract directions of information flow in dynamical systems based on empirical data remains a key challenge. The Granger causality (GC) analysis has been identified as a powerful method to achieve this capability. However, the framework of the GC theory requires that the dynamics of the investigated system can be statistically linearized; i.e., the dynamics can be effectively modeled by linear regressive processes. Under such conditions, the causal connectivity can be directly mapped to the structural connectivity that mediates physical interactions within the system. However, for nonlinear dynamical systems such as the Hodgkin-Huxley (HH) neuronal circuit, the validity of the GC analysis has yet been addressed; namely, whether the constructed causal connectivity is still identical to the synaptic connectivity between neurons remains unknown. In this work, we apply the nonlinear extension of the GC analysis, i.e., the extended GC analysis, to the voltage time series obtained by evolving the HH neuronal network. In addition, we add a certain amount of measurement or observational noise to the time series to take into account the realistic situation in data acquisition in the experiment. Our numerical results indicate that the causal connectivity obtained through the extended GC analysis is consistent with the underlying synaptic connectivity of the system. This consistency is also insensitive to dynamical regimes, e.g., a chaotic or non-chaotic regime. Since the extended GC analysis could in principle be applied to any nonlinear dynamical system as long as its attractor is low dimensional, our results may potentially be extended to the GC analysis in other settings.

Dynamical and Coupling Structure of Pulse-Coupled Networks in Maximum Entropy Analysis.

Maximum entropy principle (MEP) analysis with few non-zero effective interactions successfully characterizes the distribution of dynamical states of pulse-coupled networks in many fields, e.g., in neuroscience. To better understand the underlying mechanism, we found a relation between the dynamical structure, i.e., effective interactions in MEP analysis, and the anatomical coupling structure of pulse-coupled networks and it helps to understand how a sparse coupling structure could lead to a sparse coding by effective interactions. This relation quantitatively displays how the dynamical structure is closely related to the anatomical coupling structure.

Spatiotemporal dynamics of neuronal population response in the primary visual cortex.

One of the fundamental questions in system neuroscience is how the brain encodes external stimuli in the early sensory cortex. It has been found in experiments that even some simple sensory stimuli can activate large populations of neurons. It is believed that information can be encoded in the spatiotemporal profile of these collective neuronal responses. Here, we use a large-scale computational model of the primary visual cortex (V1) to study the population responses in V1 as observed in experiments in which monkeys performed visual detection tasks. We show that our model can capture very well spatiotemporal activities measured by voltage-sensitive-dye-based optical imaging in V1 of the awake state. In our model, the properties of horizontal long-range connections with NMDA conductance play an important role in the correlated population responses and have strong implications for spatiotemporal coding of neuronal populations. Our computational modeling approach allows us to reveal intrinsic cortical dynamics, separating them from those statistical effects arising from averaging procedures in experiment. For example, in experiments, it was shown that there was a spatially antagonistic center-surround structure in optimal weights in signal detection theory, which was believed to underlie the efficiency of population coding. However, our study shows that this feature is an artifact of data processing.

Sparsity and compressed coding in sensory systems.

Considering that many natural stimuli are sparse, can a sensory system evolve to take advantage of this sparsity? We explore this question and show that significant downstream reductions in the numbers of neurons transmitting stimuli observed in early sensory pathways might be a consequence of this sparsity. First, we model an early sensory pathway using an idealized neuronal network comprised of receptors and downstream sensory neurons. Then, by revealing a linear structure intrinsic to neuronal network dynamics, our work points to a potential mechanism for transmitting sparse stimuli, related to compressed-sensing (CS) type data acquisition. Through simulation, we examine the characteristics of networks that are optimal in sparsity encoding, and the impact of localized receptive fields beyond conventional CS theory. The results of this work suggest a new network framework of signal sparsity, freeing the notion from any dependence on specific component-space representations. We expect our CS network mechanism to provide guidance for studying sparse stimulus transmission along realistic sensory pathways as well as engineering network designs that utilize sparsity encoding.

Bilinearity in spatiotemporal integration of synaptic inputs.

Neurons process information via integration of synaptic inputs from dendrites. Many experimental results demonstrate dendritic integration could be highly nonlinear, yet few theoretical analyses have been performed to obtain a precise quantitative characterization analytically. Based on asymptotic analysis of a two-compartment passive cable model, given a pair of time-dependent synaptic conductance inputs, we derive a bilinear spatiotemporal dendritic integration rule. The summed somatic potential can be well approximated by the linear summation of the two postsynaptic potentials elicited separately, plus a third additional bilinear term proportional to their product with a proportionality coefficient [Formula: see text]. The rule is valid for a pair of synaptic inputs of all types, including excitation-inhibition, excitation-excitation, and inhibition-inhibition. In addition, the rule is valid during the whole dendritic integration process for a pair of synaptic inputs with arbitrary input time differences and input locations. The coefficient [Formula: see text] is demonstrated to be nearly independent of the input strengths but is dependent on input times and input locations. This rule is then verified through simulation of a realistic pyramidal neuron model and in electrophysiological experiments of rat hippocampal CA1 neurons. The rule is further generalized to describe the spatiotemporal dendritic integration of multiple excitatory and inhibitory synaptic inputs. The integration of multiple inputs can be decomposed into the sum of all possible pairwise integration, where each paired integration obeys the bilinear rule. This decomposition leads to a graph representation of dendritic integration, which can be viewed as functionally sparse.

A coarse-grained framework for spiking neuronal networks: between homogeneity and synchrony.

Homogeneously structured networks of neurons driven by noise can exhibit a broad range of dynamic behavior. This dynamic behavior can range from homogeneity to synchrony, and often incorporates brief spurts of collaborative activity which we call multiple-firing-events (MFEs). These multiple-firing-events depend on neither structured architecture nor structured input, and are an emergent property of the system. Although these MFEs likely play a major role in the neuronal avalanches observed in culture and in vivo, the mechanisms underlying these MFEs cannot easily be captured using current population-dynamics models. In this work we introduce a coarse-grained framework which illustrates certain dynamics responsible for the generation of MFEs. By using a new kind of ensemble-average, this coarse-grained framework can not only address the nucleation of MFEs, but can also faithfully capture a broad range of dynamic regimes ranging from homogeneity to synchrony.

Distribution of correlated spiking events in a population-based approach for Integrate-and-Fire networks.

Randomly connected populations of spiking neurons display a rich variety of dynamics. However, much of the current modeling and theoretical work has focused on two dynamical extremes: on one hand homogeneous dynamics characterized by weak correlations between neurons, and on the other hand total synchrony characterized by large populations firing in unison. In this paper we address the conceptual issue of how to mathematically characterize the partially synchronous "multiple firing events" (MFEs) which manifest in between these two dynamical extremes. We further develop a geometric method for obtaining the distribution of magnitudes of these MFEs by recasting the cascading firing event process as a first-passage time problem, and deriving an analytical approximation of the first passage time density valid for large neuron populations. Thus, we establish a direct link between the voltage distributions of excitatory and inhibitory neurons and the number of neurons firing in an MFE that can be easily integrated into population-based computational methods, thereby bridging the gap between homogeneous firing regimes and total synchrony.

Causal and structural connectivity of pulse-coupled nonlinear networks.

We study the reconstruction of structural connectivity for a general class of pulse-coupled nonlinear networks and show that the reconstruction can be successfully achieved through linear Granger causality (GC) analysis. Using spike-triggered correlation of whitened signals, we obtain a quadratic relationship between GC and the network couplings, thus establishing a direct link between the causal connectivity and the structural connectivity within these networks. Our work may provide insight into the applicability of GC in the study of the function of general nonlinear networks.

Coarse-grained event tree analysis for quantifying Hodgkin-Huxley neuronal network dynamics.

We present an event tree analysis of studying the dynamics of the Hodgkin-Huxley (HH) neuronal networks. Our study relies on a coarse-grained projection to event trees and to the event chains that comprise these trees by using a statistical collection of spatial-temporal sequences of relevant physiological observables (such as sequences of spiking multiple neurons). This projection can retain information about network dynamics that covers multiple features, swiftly and robustly. We demonstrate that for even small differences in inputs, some dynamical regimes of HH networks contain sufficiently higher order statistics as reflected in event chains within the event tree analysis. Therefore, this analysis is effective in discriminating small differences in inputs. Moreover, we use event trees to analyze the results computed from an efficient library-based numerical method proposed in our previous work, where a pre-computed high resolution data library of typical neuronal trajectories during the interval of an action potential (spike) allows us to avoid resolving the spikes in detail. In this way, we can evolve the HH networks using time steps one order of magnitude larger than the typical time steps used for resolving the trajectories without the library, while achieving comparable statistical accuracy in terms of average firing rate and power spectra of voltage traces. Our numerical simulation results show that the library method is efficient in the sense that the results generated by using this numerical method with much larger time steps contain sufficiently high order statistical structure of firing events that are similar to the ones obtained using a regular HH solver. We use our event tree analysis to demonstrate these statistical similarities.

A striatal SOM-driven ChAT-iMSN loop generates beta oscillations and produces motor deficits.

Enhanced beta oscillations within the cortico-basal ganglia-thalamic (CBT) network are correlated with motor deficits in Parkinson's disease (PD), whose generation has been associated recently with amplified network dynamics in the striatum. However, how distinct striatal cell subtypes interact to orchestrate beta oscillations remains largely unknown. Here, we show that optogenetic suppression of dopaminergic control over the dorsal striatum (DS) elevates the power of local field potentials (LFPs) selectively at beta band (12-25 Hz), accompanied by impairments in locomotion. The amplified beta power originates from a striatal loop driven by somatostatin-expressing (SOM) interneurons and constituted by choline acetyltransferase (ChAT)-expressing interneurons and dopamine D2 receptor (D2R)-expressing medium spiny neurons (iMSNs). Moreover, closed-loop intervention selectively targeting striatal iMSNs or ChATs diminishes beta oscillations and restores motor function. Thus, we reveal a striatal microcircuit motif that underlies beta oscillation generation and accompanied motor deficits upon perturbation of dopaminergic control over the striatum.

Network mechanism for insect olfaction.

Early olfactory pathway responses to the presentation of an odor exhibit remarkably similar dynamical behavior across phyla from insects to mammals, and frequently involve transitions among quiescence, collective network oscillations, and asynchronous firing. We hypothesize that the time scales of fast excitation and fast and slow inhibition present in these networks may be the essential element underlying this similar behavior, and design an idealized, conductance-based integrate-and-fire model to verify this hypothesis via numerical simulations. To better understand the mathematical structure underlying the common dynamical behavior across species, we derive a firing-rate model and use it to extract a slow passage through a saddle-node-on-an-invariant-circle bifurcation structure. We expect this bifurcation structure to provide new insights into the understanding of the dynamical behavior of neuronal assemblies and that a similar structure can be found in other sensory systems.

Pseudo-Lyapunov exponents and predictability of Hodgkin-Huxley neuronal network dynamics.

We present a numerical analysis of the dynamics of all-to-all coupled Hodgkin-Huxley (HH) neuronal networks with Poisson spike inputs. It is important to point out that, since the dynamical vector of the system contains discontinuous variables, we propose a so-called pseudo-Lyapunov exponent adapted from the classical definition using only continuous dynamical variables, and apply it in our numerical investigation. The numerical results of the largest Lyapunov exponent using this new definition are consistent with the dynamical regimes of the network. Three typical dynamical regimes-asynchronous, chaotic and synchronous, are found as the synaptic coupling strength increases from weak to strong. We use the pseudo-Lyapunov exponent and the power spectrum analysis of voltage traces to characterize the types of the network behavior. In the nonchaotic (asynchronous or synchronous) dynamical regimes, i.e., the weak or strong coupling limits, the pseudo-Lyapunov exponent is negative and there is a good numerical convergence of the solution in the trajectory-wise sense by using our numerical methods. Consequently, in these regimes the evolution of neuronal networks is reliable. For the chaotic dynamical regime with an intermediate strong coupling, the pseudo-Lyapunov exponent is positive, and there is no numerical convergence of the solution and only statistical quantifications of the numerical results are reliable. Finally, we present numerical evidence that the value of pseudo-Lyapunov exponent coincides with that of the standard Lyapunov exponent for systems we have been able to examine.

Spectrum of Lyapunov exponents of non-smooth dynamical systems of integrate-and-fire type.

We discuss how to characterize long-time dynamics of non-smooth dynamical systems, such as integrate-and-fire (I&F) like neuronal network, using Lyapunov exponents and present a stable numerical method for the accurate evaluation of the spectrum of Lyapunov exponents for this large class of dynamics. These dynamics contain (i) jump conditions as in the firing-reset dynamics and (ii) degeneracy such as in the refractory period in which voltage-like variables of the network collapse to a single constant value. Using the networks of linear I&F neurons, exponential I&F neurons, and I&F neurons with adaptive threshold, we illustrate our method and discuss the rich dynamics of these networks.