Causal connectivity measures for pulse-output network reconstruction: Analysis and applications.

The causal connectivity of a network is often inferred to understand network function. It is arguably acknowledged that the inferred causal connectivity relies on the causality measure one applies, and it may differ from the network's underlying structural connectivity. However, the interpretation of causal connectivity remains to be fully clarified, in particular, how causal connectivity depends on causality measures and how causal connectivity relates to structural connectivity. Here, we focus on nonlinear networks with pulse signals as measured output, e.g., neural networks with spike output, and address the above issues based on four commonly utilized causality measures, i.e., time-delayed correlation coefficient, time-delayed mutual information, Granger causality, and transfer entropy. We theoretically show how these causality measures are related to one another when applied to pulse signals. Taking a simulated Hodgkin-Huxley network and a real mouse brain network as two illustrative examples, we further verify the quantitative relations among the four causality measures and demonstrate that the causal connectivity inferred by any of the four well coincides with the underlying network structural connectivity, therefore illustrating a direct link between the causal and structural connectivity. We stress that the structural connectivity of pulse-output networks can be reconstructed pairwise without conditioning on the global information of all other nodes in a network, thus circumventing the curse of dimensionality. Our framework provides a practical and effective approach for pulse-output network reconstruction.

A striatal SOM-driven ChAT-iMSN loop generates beta oscillations and produces motor deficits.

Enhanced beta oscillations within the cortico-basal ganglia-thalamic (CBT) network are correlated with motor deficits in Parkinson's disease (PD), whose generation has been associated recently with amplified network dynamics in the striatum. However, how distinct striatal cell subtypes interact to orchestrate beta oscillations remains largely unknown. Here, we show that optogenetic suppression of dopaminergic control over the dorsal striatum (DS) elevates the power of local field potentials (LFPs) selectively at beta band (12-25 Hz), accompanied by impairments in locomotion. The amplified beta power originates from a striatal loop driven by somatostatin-expressing (SOM) interneurons and constituted by choline acetyltransferase (ChAT)-expressing interneurons and dopamine D2 receptor (D2R)-expressing medium spiny neurons (iMSNs). Moreover, closed-loop intervention selectively targeting striatal iMSNs or ChATs diminishes beta oscillations and restores motor function. Thus, we reveal a striatal microcircuit motif that underlies beta oscillation generation and accompanied motor deficits upon perturbation of dopaminergic control over the striatum.

Maximum Entropy Principle Underlies Wiring Length Distribution in Brain Networks.

A brain network comprises a substantial amount of short-range connections with an admixture of long-range connections. The portion of long-range connections in brain networks is observed to be quantitatively dissimilar across species. It is hypothesized that the length of connections is constrained by the spatial embedding of brain networks, yet fundamental principles that underlie the wiring length distribution remain unclear. By quantifying the structural diversity of a brain network using Shannon's entropy, here we show that the wiring length distribution across multiple species-including Drosophila, mouse, macaque, human, and C. elegans-follows the maximum entropy principle (MAP) under the constraints of limited wiring material and the spatial locations of brain areas or neurons. In addition, by considering stochastic axonal growth, we propose a network formation process capable of reproducing wiring length distributions of the 5 species, thereby implementing MAP in a biologically plausible manner. We further develop a generative model incorporating MAP, and show that, for the 5 species, the generated network exhibits high similarity to the real network. Our work indicates that the brain connectivity evolves to be structurally diversified by maximizing entropy to support efficient interareal communication, providing a potential organizational principle of brain networks.

Network mechanism for insect olfaction.

Early olfactory pathway responses to the presentation of an odor exhibit remarkably similar dynamical behavior across phyla from insects to mammals, and frequently involve transitions among quiescence, collective network oscillations, and asynchronous firing. We hypothesize that the time scales of fast excitation and fast and slow inhibition present in these networks may be the essential element underlying this similar behavior, and design an idealized, conductance-based integrate-and-fire model to verify this hypothesis via numerical simulations. To better understand the mathematical structure underlying the common dynamical behavior across species, we derive a firing-rate model and use it to extract a slow passage through a saddle-node-on-an-invariant-circle bifurcation structure. We expect this bifurcation structure to provide new insights into the understanding of the dynamical behavior of neuronal assemblies and that a similar structure can be found in other sensory systems.

The extended Granger causality analysis for Hodgkin-Huxley neuronal models.

How to extract directions of information flow in dynamical systems based on empirical data remains a key challenge. The Granger causality (GC) analysis has been identified as a powerful method to achieve this capability. However, the framework of the GC theory requires that the dynamics of the investigated system can be statistically linearized; i.e., the dynamics can be effectively modeled by linear regressive processes. Under such conditions, the causal connectivity can be directly mapped to the structural connectivity that mediates physical interactions within the system. However, for nonlinear dynamical systems such as the Hodgkin-Huxley (HH) neuronal circuit, the validity of the GC analysis has yet been addressed; namely, whether the constructed causal connectivity is still identical to the synaptic connectivity between neurons remains unknown. In this work, we apply the nonlinear extension of the GC analysis, i.e., the extended GC analysis, to the voltage time series obtained by evolving the HH neuronal network. In addition, we add a certain amount of measurement or observational noise to the time series to take into account the realistic situation in data acquisition in the experiment. Our numerical results indicate that the causal connectivity obtained through the extended GC analysis is consistent with the underlying synaptic connectivity of the system. This consistency is also insensitive to dynamical regimes, e.g., a chaotic or non-chaotic regime. Since the extended GC analysis could in principle be applied to any nonlinear dynamical system as long as its attractor is low dimensional, our results may potentially be extended to the GC analysis in other settings.

A computational investigation of electrotonic coupling between pyramidal cells in the cortex.

The existence of electrical communication among pyramidal cells (PCs) in the adult cortex has been debated by neuroscientists for several decades. Gap junctions (GJs) among cortical interneurons have been well documented experimentally and their functional roles have been proposed by both computational neuroscientists and experimentalists alike. Experimental evidence for similar junctions among pyramidal cells in the cortex, however, has remained elusive due to the apparent rarity of these couplings among neurons. In this work, we develop a neuronal network model that includes observed probabilities and strengths of electrotonic coupling between PCs and gap-junction coupling among interneurons, in addition to realistic synaptic connectivity among both populations. We use this network model to investigate the effect of electrotonic coupling between PCs on network behavior with the goal of theoretically addressing this controversy of existence and purpose of electrotonically coupled PCs in the cortex.

Neural networks of different species, brain areas and states can be characterized by the probability polling state.

Cortical networks are complex systems of a great many interconnected neurons that operate from collective dynamical states. To understand how cortical neural networks function, it is important to identify their common dynamical operating states from the probabilistic viewpoint. Probabilistic characteristics of these operating states often underlie network functions. Here, using multi-electrode data from three separate experiments, we identify and characterize a cortical operating state (the "probability polling" or "p-polling" state), common across mouse and monkey with different behaviors. If the interaction among neurons is weak, the p-polling state provides a quantitative understanding of how the high dimensional probability distribution of firing patterns can be obtained by the low-order maximum entropy formulation, effectively utilizing a low dimensional stimulus-coding structure. These results show evidence for generality of the p-polling state and in certain situations its advantage of providing a mathematical validation for the low-order maximum entropy principle as a coding strategy.

Exponential Time Differencing Algorithm for Pulse-Coupled Hodgkin-Huxley Neural Networks.

The exponential time differencing (ETD) method allows using a large time step to efficiently evolve stiff systems such as Hodgkin-Huxley (HH) neural networks. For pulse-coupled HH networks, the synaptic spike times cannot be predetermined and are convoluted with neuron's trajectory itself. This presents a challenging issue for the design of an efficient numerical simulation algorithm. The stiffness in the HH equations are quite different, for example, between the spike and non-spike regions. Here, we design a second-order adaptive exponential time differencing algorithm (AETD2) for the numerical evolution of HH neural networks. Compared with the regular second-order Runge-Kutta method (RK2), our AETD2 method can use time steps one order of magnitude larger and improve computational efficiency more than ten times while excellently capturing accurate traces of membrane potentials of HH neurons. This high accuracy and efficiency can be robustly obtained and do not depend on the dynamical regimes, connectivity structure or the network size.

Emergence of spatially periodic diffusive waves in small-world neuronal networks.

It has been observed in experiment that the anatomical structure of neuronal networks in the brain possesses the feature of small-world networks. Yet how the small-world structure affects network dynamics remains to be fully clarified. Here we study the dynamics of a class of small-world networks consisting of pulse-coupled integrate-and-fire (I&F) neurons. Under stochastic Poisson drive, we find that the activity of the entire network resembles diffusive waves. To understand its underlying mechanism, we analyze the simplified regular-lattice network consisting of firing-rate-based neurons as an approximation to the original I&F small-world network. We demonstrate both analytically and numerically that, with strongly coupled connections, in the absence of noise, the activity of the firing-rate-based regular-lattice network spatially forms a static grating pattern that corresponds to the spatial distribution of the firing rate observed in the I&F small-world neuronal network. We further show that the spatial grating pattern with different phases comprise the continuous attractor of both the I&F small-world and firing-rate-based regular-lattice network dynamics. In the presence of input noise, the activity of both networks is perturbed along the continuous attractor, which gives rise to the diffusive waves. Our numerical simulations and theoretical analysis may potentially provide insights into the understanding of the generation of wave patterns observed in cortical networks.

Compressive Sensing Inference of Neuronal Network Connectivity in Balanced Neuronal Dynamics.

Determining the structure of a network is of central importance to understanding its function in both neuroscience and applied mathematics. However, recovering the structural connectivity of neuronal networks remains a fundamental challenge both theoretically and experimentally. While neuronal networks operate in certain dynamical regimes, which may influence their connectivity reconstruction, there is widespread experimental evidence of a balanced neuronal operating state in which strong excitatory and inhibitory inputs are dynamically adjusted such that neuronal voltages primarily remain near resting potential. Utilizing the dynamics of model neurons in such a balanced regime in conjunction with the ubiquitous sparse connectivity structure of neuronal networks, we develop a compressive sensing theoretical framework for efficiently reconstructing network connections by measuring individual neuronal activity in response to a relatively small ensemble of random stimuli injected over a short time scale. By tuning the network dynamical regime, we determine that the highest fidelity reconstructions are achievable in the balanced state. We hypothesize the balanced dynamics observed in vivo may therefore be a result of evolutionary selection for optimal information encoding and expect the methodology developed to be generalizable for alternative model networks as well as experimental paradigms.

Effective dispersion in the focusing nonlinear Schrödinger equation.

For waves described by the focusing nonlinear Schrödinger equation (FNLS), we present an effective dispersion relation (EDR) that arises dynamically from the interplay between the linear dispersion and the nonlinearity. The form of this EDR is parabolic for a robust family of "generic" FNLS waves and equals the linear dispersion relation less twice the total wave action of the wave in question multiplied by the square of the nonlinearity parameter. We derive an approximate form of this EDR explicitly in the limit of small nonlinearity and confirm it using the wave-number-frequency spectral (WFS) analysis, a Fourier-transform based method used for determining dispersion relations of observed waves. We also show that it extends to the FNLS the universal EDR formula for the defocusing Majda-McLaughlin-Tabak (MMT) model of weak turbulence. In addition, unexpectedly, even for some spatially periodic versions of multisolitonlike waves, the EDR is still a downward shifted linear-dispersion parabola, but the shift does not have a clear relation to the total wave action. Using WFS analysis and heuristic derivations, we present examples of parabolic and nonparabolic EDRs for FNLS waves and also waves for which no EDR exists.

Dendritic computations captured by an effective point neuron model.

Complex dendrites in general present formidable challenges to understanding neuronal information processing. To circumvent the difficulty, a prevalent viewpoint simplifies the neuronal morphology as a point representing the soma, and the excitatory and inhibitory synaptic currents originated from the dendrites are treated as linearly summed at the soma. Despite its extensive applications, the validity of the synaptic current description remains unclear, and the existing point neuron framework fails to characterize the spatiotemporal aspects of dendritic integration supporting specific computations. Using electrophysiological experiments, realistic neuronal simulations, and theoretical analyses, we demonstrate that the traditional assumption of linear summation of synaptic currents is oversimplified and underestimates the inhibition effect. We then derive a form of synaptic integration current within the point neuron framework to capture dendritic effects. In the derived form, the interaction between each pair of synaptic inputs on the dendrites can be reliably parameterized by a single coefficient, suggesting the inherent low-dimensional structure of dendritic integration. We further generalize the form of synaptic integration current to capture the spatiotemporal interactions among multiple synaptic inputs and show that a point neuron model with the synaptic integration current incorporated possesses the computational ability of a spatial neuron with dendrites, including direction selectivity, coincidence detection, logical operation, and a bilinear dendritic integration rule discovered in experiment. Our work amends the modeling of synaptic inputs and improves the computational power of a modeling neuron within the point neuron framework.

A Role for Electrotonic Coupling Between Cortical Pyramidal Cells.

Many brain regions communicate information through synchronized network activity. Electrical coupling among the dendrites of interneurons in the cortex has been implicated in forming and sustaining such activity in the cortex. Evidence for the existence of electrical coupling among cortical pyramidal cells, however, has been largely absent. A recent experimental study measured properties of electrical connections between pyramidal cells in the cortex deemed "electrotonic couplings." These junctions were seen to occur pair-wise, sparsely, and often coexist with electrically-coupled interneurons. Here, we construct a network model to investigate possible roles for these rare, electrotonically-coupled pyramidal-cell pairs. Through simulations, we show that electrical coupling among pyramidal-cell pairs significantly enhances coincidence-detection capabilities and increases network spike-timing precision. Further, a network containing multiple pairs exhibits large variability in its firing pattern, possessing a rich coding structure.

Maximum entropy principle analysis in network systems with short-time recordings.

In many realistic systems, maximum entropy principle (MEP) analysis provides an effective characterization of the probability distribution of network states. However, to implement the MEP analysis, a sufficiently long-time data recording in general is often required, e.g., hours of spiking recordings of neurons in neuronal networks. The issue of whether the MEP analysis can be successfully applied to network systems with data from short-time recordings has yet to be fully addressed. In this work, we investigate relationships underlying the probability distributions, moments, and effective interactions in the MEP analysis and then show that, with short-time recordings of network dynamics, the MEP analysis can be applied to reconstructing probability distributions of network states that is much more accurate than the one directly measured from the short-time recording. Using spike trains obtained from both Hodgkin-Huxley neuronal networks and electrophysiological experiments, we verify our results and demonstrate that MEP analysis provides a tool to investigate the neuronal population coding properties for short-time recordings.

Determination of effective synaptic conductances using somatic voltage clamp.

The interplay between excitatory and inhibitory neurons imparts rich functions of the brain. To understand the synaptic mechanisms underlying neuronal computations, a fundamental approach is to study the dynamics of excitatory and inhibitory synaptic inputs of each neuron. The traditional method of determining input conductance, which has been applied for decades, employs the synaptic current-voltage (I-V) relation obtained via voltage clamp. Due to the space clamp effect, the measured conductance is different from the local conductance on the dendrites. Therefore, the interpretation of the measured conductance remains to be clarified. Using theoretical analysis, electrophysiological experiments, and realistic neuron simulations, here we demonstrate that there does not exist a transform between the local conductance and the conductance measured by the traditional method, due to the neglect of a nonlinear interaction between the clamp current and the synaptic current in the traditional method. Consequently, the conductance determined by the traditional method may not correlate with the local conductance on the dendrites, and its value could be unphysically negative as observed in experiment. To circumvent the challenge of the space clamp effect and elucidate synaptic impact on neuronal information processing, we propose the concept of effective conductance which is proportional to the local conductance on the dendrite and reflects directly the functional influence of synaptic inputs on somatic membrane potential dynamics, and we further develop a framework to determine the effective conductance accurately. Our work suggests re-examination of previous studies involving conductance measurement and provides a reliable approach to assess synaptic influence on neuronal computation.

Dynamical and Coupling Structure of Pulse-Coupled Networks in Maximum Entropy Analysis.

Maximum entropy principle (MEP) analysis with few non-zero effective interactions successfully characterizes the distribution of dynamical states of pulse-coupled networks in many fields, e.g., in neuroscience. To better understand the underlying mechanism, we found a relation between the dynamical structure, i.e., effective interactions in MEP analysis, and the anatomical coupling structure of pulse-coupled networks and it helps to understand how a sparse coupling structure could lead to a sparse coding by effective interactions. This relation quantitatively displays how the dynamical structure is closely related to the anatomical coupling structure.

Mechanisms underlying contrast-dependent orientation selectivity in mouse V1.

Recent experiments have shown that mouse primary visual cortex (V1) is very different from that of cat or monkey, including response properties-one of which is that contrast invariance in the orientation selectivity (OS) of the neurons' firing rates is replaced in mouse with contrast-dependent sharpening (broadening) of OS in excitatory (inhibitory) neurons. These differences indicate a different circuit design for mouse V1 than that of cat or monkey. Here we develop a large-scale computational model of an effective input layer of mouse V1. Constrained by experiment data, the model successfully reproduces experimentally observed response properties-for example, distributions of firing rates, orientation tuning widths, and response modulations of simple and complex neurons, including the contrast dependence of orientation tuning curves. Analysis of the model shows that strong feedback inhibition and strong orientation-preferential cortical excitation to the excitatory population are the predominant mechanisms underlying the contrast-sharpening of OS in excitatory neurons, while the contrast-broadening of OS in inhibitory neurons results from a strong but nonpreferential cortical excitation to these inhibitory neurons, with the resulting contrast-broadened inhibition producing a secondary enhancement on the contrast-sharpened OS of excitatory neurons. Finally, based on these mechanisms, we show that adjusting the detailed balances between the predominant mechanisms can lead to contrast invariance-providing insights for future studies on contrast dependence (invariance).

The Dynamics of Balanced Spiking Neuronal Networks Under Poisson Drive Is Not Chaotic.

Some previous studies have shown that chaotic dynamics in the balanced state, i.e., one with balanced excitatory and inhibitory inputs into cortical neurons, is the underlying mechanism for the irregularity of neural activity. In this work, we focus on networks of current-based integrate-and-fire neurons with delta-pulse coupling. While we show that the balanced state robustly persists in this system within a broad range of parameters, we mathematically prove that the largest Lyapunov exponent of this type of neuronal networks is negative. Therefore, the irregular firing activity can exist in the system without the chaotic dynamics. That is the irregularity of balanced neuronal networks need not arise from chaos.

Causal inference in nonlinear systems: Granger causality versus time-delayed mutual information.

The Granger causality (GC) analysis has been extensively applied to infer causal interactions in dynamical systems arising from economy and finance, physics, bioinformatics, neuroscience, social science, and many other fields. In the presence of potential nonlinearity in these systems, the validity of the GC analysis in general is questionable. To illustrate this, here we first construct minimal nonlinear systems and show that the GC analysis fails to infer causal relations in these systems-it gives rise to all types of incorrect causal directions. In contrast, we show that the time-delayed mutual information (TDMI) analysis is able to successfully identify the direction of interactions underlying these nonlinear systems. We then apply both methods to neuroscience data collected from experiments and demonstrate that the TDMI analysis but not the GC analysis can identify the direction of interactions among neuronal signals. Our work exemplifies inference hazards in the GC analysis in nonlinear systems and suggests that the TDMI analysis can be an appropriate tool in such a case.