Information-Theoretical Analysis of the Cycle of Creation of Knowledge and Meaning in Brains under Multiple Cognitive Modalities.

It is of great interest to develop advanced sensory technologies allowing non-invasive monitoring of neural correlates of cognitive processing in people performing everyday tasks. A lot of progress has been reported in recent years in this research area using scalp EEG arrays, but the high level of noise in the electrode signals poses a lot of challenges. This study presents results of detailed statistical analysis of experimental data on the cycle of creation of knowledge and meaning in human brains under multiple cognitive modalities. We measure brain dynamics using a HydroCel Geodesic Sensor Net, 128-electrode dense-array electroencephalography (EEG). We compute a pragmatic information (PI) index derived from analytic amplitude and phase, by Hilbert transforming the EEG signals of 20 participants in six modalities, which combine various audiovisual stimuli, leading to different mental states, including relaxed and cognitively engaged conditions. We derive several relevant measures to classify different brain states based on the PI indices. We demonstrate significant differences between engaged brain states that require sensory information processing to create meaning and knowledge for intentional action, and relaxed-meditative brain states with less demand on psychophysiological resources. We also point out that different kinds of meanings may lead to different brain dynamics and behavioral responses.

Analysis of Meditation vs. Sensory Engaged Brain States Using Shannon Entropy and Pearson's First Skewness Coefficient Extracted from EEG Data.

It has been proposed that meditative states show different brain dynamics than other more engaged states. It is known that when people sit with closed eyes instead of open eyes, they have different brain dynamics, which may be associated with a combination of deprived sensory input and more relaxed inner psychophysiological and cognitive states. Here, we study such states based on a previously established experimental methodology, with the aid of an electro-encephalography (EEG) array with 128 electrodes. We derived the Shannon Entropy (H) and Pearson's 1st Skewness Coefficient (PSk) from the power spectrum for the modalities of meditation and video watching, including 20 participants, 11 meditators and 9 non-meditators. The discriminating performance of the indices H and PSk was evaluated using Student's t-test. The results demonstrate a statistically significant difference between the mean H and PSk values during meditation and video watch modes. We show that the H index is useful to discriminate between Meditator and Non-Meditator participants during meditation over both the prefrontal and occipital areas, while the PSk index is useful to discriminate Meditators from Non-Meditators based on the prefrontal areas for both meditation and video modes. Moreover, we observe episodes of anti-correlation between the prefrontal and occipital areas during meditation, while there is no evidence for such anticorrelation periods during video watching. We outline directions of future studies incorporating further statistical indices for the characterization of brain states.

Evolutionary Advantages of Stimulus-Driven EEG Phase Transitions in the Upper Cortical Layers.

Spatio-temporal brain activity monitored by EEG recordings in humans and other mammals has identified beta/gamma oscillations (20-80 Hz), which are self-organized into spatio-temporal structures recurring at theta/alpha rates (4-12 Hz). These structures have statistically significant correlations with sensory stimuli and reinforcement contingencies perceived by the subject. The repeated collapse of self-organized structures at theta/alpha rates generates laterally propagating phase gradients (phase cones), ignited at some specific location of the cortical sheet. Phase cones have been interpreted as neural signatures of transient perceptual experiences according to the cinematic theory of brain dynamics. The rapid expansion of essentially isotropic phase cones is consistent with the propagation of perceptual broadcasts postulated by Global Workspace Theory (GWT). What is the evolutionary advantage of brains operating with repeatedly collapsing dynamics? This question is answered using thermodynamic concepts. According to neuropercolation theory, waking brains are described as non-equilibrium thermodynamic systems operating at the edge of criticality, undergoing repeated phase transitions. This work analyzes the role of long-range axonal connections and metabolic processes in the regulation of critical brain dynamics. Historically, the near 10 Hz domain has been associated with conscious sensory integration, cortical "ignitions" linked to conscious visual perception, and conscious experiences. We can therefore combine a very large body of experimental evidence and theory, including graph theory, neuropercolation, and GWT. This cortical operating style may optimize a tradeoff between rapid adaptation to novelty vs. stable and widespread self-organization, therefore resulting in significant Darwinian benefits.

State Transitions During Discrimination Learning in the Gerbil Auditory Cortex Analyzed by Network Causality Metrics.

This work studies the evolution of cortical networks during the transition from escape strategy to avoidance strategy in auditory discrimination learning in Mongolian gerbils trained by the well-established two-way active avoidance learning paradigm. The animals were implanted with electrode arrays centered on the surface of the primary auditory cortex and electrocorticogram (ECoG) recordings were made during performance of an auditory Go/NoGo discrimination task. Our experiments confirm previous results on a sudden behavioral change from the initial naïve state to an avoidance strategy as learning progresses. We employed two causality metrics using Granger Causality (GC) and New Causality (NC) to quantify changes in the causality flow between ECoG channels as the animals switched to avoidance strategy. We found that the number of channel pairs with inverse causal interaction significantly increased after the animal acquired successful discrimination, which indicates structural changes in the cortical networks as a result of learning. A suitable graph-theoretical model is developed to interpret the findings in terms of cortical networks evolving during cognitive state transitions. Structural changes lead to changes in the dynamics of neural populations, which are described as phase transitions in the network graph model with small-world connections. Overall, our findings underscore the importance of functional reorganization in sensory cortical areas as a possible neural contributor to behavioral changes.

Improved robustness of reinforcement learning policies upon conversion to spiking neuronal network platforms applied to Atari Breakout game.

Deep Reinforcement Learning (RL) demonstrates excellent performance on tasks that can be solved by trained policy. It plays a dominant role among cutting-edge machine learning approaches using multi-layer Neural networks (NNs). At the same time, Deep RL suffers from high sensitivity to noisy, incomplete, and misleading input data. Following biological intuition, we involve Spiking Neural Networks (SNNs) to address some deficiencies of deep RL solutions. Previous studies in image classification domain demonstrated that standard NNs (with ReLU nonlinearity) trained using supervised learning can be converted to SNNs with negligible deterioration in performance. In this paper, we extend those conversion results to the domain of Q-Learning NNs trained using RL. We provide a proof of principle of the conversion of standard NN to SNN. In addition, we show that the SNN has improved robustness to occlusion in the input image. Finally, we introduce results with converting full-scale Deep Q-network to SNN, paving the way for future research to robust Deep RL applications.

Locally connected spiking neural networks for unsupervised feature learning.

In recent years, spiking neural networks (SNNs) have demonstrated great success in completing various machine learning tasks. We introduce a method for learning image features with locally connected layers in SNNs using a spike-timing-dependent plasticity (STDP) rule. In our approach, sub-networks compete via inhibitory interactions to learn features from different locations of the input space. These locally-connected SNNs (LC-SNNs) manifest key topological features of the spatial interaction of biological neurons. We explore a biologically inspired n-gram classification approach allowing parallel processing over various patches of the image space. We report the classification accuracy of simple two-layer LC-SNNs on two image datasets, which respectively match state-of-art performance and are the first results to date. LC-SNNs have the advantage of fast convergence to a dataset representation, and they require fewer learnable parameters than other SNN approaches with unsupervised learning. Robustness tests demonstrate that LC-SNNs exhibit graceful degradation of performance despite the random deletion of large numbers of synapses and neurons. Our results have been obtained using the BindsNET library, which allows efficient machine learning implementations of spiking neural networks.

The rhythm of memory: how breathing shapes memory function.

The mammalian olfactory bulb displays a prominent respiratory rhythm, which is linked to the sniff cycle and is driven by sensory input from olfactory receptors in the nasal sensory epithelium. In rats and mice, respiratory frequencies occupy the same band as the hippocampal θ-rhythm, which has been shown to be a key player in memory processes. Hippocampal and olfactory bulb rhythms were previously found to be uncorrelated except in specific odor-contingency learning circumstances. However, many recent electrophysiological studies in both rodents and humans reveal a surprising cycle-by-cycle influence of nasal respiration on neuronal activity throughout much of the cerebral cortex beyond the olfactory system, including the prefrontal cortex, hippocampus, and subcortical structures. In addition, respiratory phase has been shown to influence higher-frequency oscillations associated with cognitive functions, including attention and memory, such as the power of γ-rhythms and the timing of hippocampal sharp wave ripples. These new findings support respiration's role in cognitive function, which is supported by studies in human subjects, in which nasal respiration has been linked to memory processes. Here, we review recent reports from human and rodent experiments that link respiration to the modulation of memory function and the neurophysiological processes involved in memory in rodents and humans. We argue that respiratory influence on the neuronal activity of two key memory structures, the hippocampus and prefrontal cortex, provides a potential neuronal mechanism behind respiratory modulation of memory.

Spatial Directionality Found in Frontal-Parietal Attentional Networks.

Research in last few years on neurophysiology focused on several areas across the cortex during cognitive processing to determine the dominant direction of electrical activity. However, information about the frequency and direction of episodic synchronization related to higher cognitive functions remain unclear. Our aim was to determine whether neural oscillations carry perceptual information as spatial patterns across the cortex, which could be found in the scalp EEG of human subjects while being engaged in visual sensory stimulation. Magnitude squared coherence of neural activity during task states that "finger movement with Eyes Open (EO) or Eyes Wandering (EW)" among all electrode combinations has the smallest standard deviation and variations. Additionally, the highest coherence among the electrode pairs occurred between alpha (8-12 Hz) and beta (12-16 Hz) ranges. Our results indicate that alpha rhythms seem to be regulated during activities when an individual is focused on a given task. Beta activity, which has also been implicated in cognitive processing to neural oscillations, is seen in our work as a manner to integrate external stimuli to higher cognitive activation. We have found spatial network organization which served to classify the EEG epochs in time with respect to the stimuli class. Our findings suggest that cortical neural signaling utilizes alpha-beta phase coupling during cognitive processing states, where beta activity has been implicated in shifting cognitive states. Significance. Our approach has found frontoparietal attentional mechanisms in shifting brain states which could provide new insights into understanding the global cerebral dynamics of intentional activity and reflect how the brain allocates resources during tasking and cognitive processing states.

Mesoscopic neuron population modeling of normal/epileptic brain dynamics.

Simulations of EEG data provide the understanding of how the limbic system exhibits normal and abnormal states of the electrical activity of the brain. While brain activity exhibits a type of homeostasis of excitatory and inhibitory mesoscopic neuron behavior, abnormal neural firings found in the seizure state exhibits brain instability due to runaway oscillatory entrained neural behavior. We utilize a model of mesoscopic brain activity, the KIV model, where each network represents the areas of the limbic system, i.e., hippocampus, sensory cortex, and the amygdala. Our model initially demonstrates oscillatory entrained neural behavior as the epileptogenesis, and then by increasing the external weights that join the three networks that represent the areas of the limbic system, seizure activity entrains the entire system. By introducing an external signal into the model, simulating external electrical titration therapy, the modeled seizure behavior can be 'rebalanced' back to its normal state.

BindsNET: A Machine Learning-Oriented Spiking Neural Networks Library in Python.

The development of spiking neural network simulation software is a critical component enabling the modeling of neural systems and the development of biologically inspired algorithms. Existing software frameworks support a wide range of neural functionality, software abstraction levels, and hardware devices, yet are typically not suitable for rapid prototyping or application to problems in the domain of machine learning. In this paper, we describe a new Python package for the simulation of spiking neural networks, specifically geared toward machine learning and reinforcement learning. Our software, called BindsNET, enables rapid building and simulation of spiking networks and features user-friendly, concise syntax. BindsNET is built on the PyTorch deep neural networks library, facilitating the implementation of spiking neural networks on fast CPU and GPU computational platforms. Moreover, the BindsNET framework can be adjusted to utilize other existing computing and hardware backends; e.g., TensorFlow and SpiNNaker. We provide an interface with the OpenAI gym library, allowing for training and evaluation of spiking networks on reinforcement learning environments. We argue that this package facilitates the use of spiking networks for large-scale machine learning problems and show some simple examples by using BindsNET in practice.

Bessel-like functional distributions in brain average evoked potentials.

Average evoked potential data recorded as impulse responses of brains to electric shocks show Bessel-like functional distributions which we analyze in terms of couples of damped/amplified oscillators. This reproduces results obtained in terms of ordinary differential equations (Freeman K-sets) and offers the possibility of a direct connection with the dissipative model of brain in the quantum gauge field theory paradigm. We study the control mechanism by fine tuning the model parameters and the brain property of discriminating between two similar behaviors or perceptions. We suggest that a similar control mechanism may be useful in security communication protocols. Finally, brain activity and mental activity is considered in the light of our results.

Cinematic Operation of the Cerebral Cortex Interpreted via Critical Transitions in Self-Organized Dynamic Systems.

Measurements of local field potentials over the cortical surface and the scalp of animals and human subjects reveal intermittent bursts of beta and gamma oscillations. During the bursts, narrow-band metastable amplitude modulation (AM) patters emerge for a fraction of a second and ultimately dissolve to the broad-band random background activity. The burst process depends on previously learnt conditioned stimuli (CS), thus different AM patterns may emerge in response to different CS. This observation leads to our cinematic theory of cognition when perception happens in discrete steps manifested in the sequence of AM patterns. Our article summarizes findings in the past decades on experimental evidence of cinematic theory of cognition and relevant mathematical models. We treat cortices as dissipative systems that self-organize themselves near a critical level of activity that is a non-equilibrium metastable state. Criticality is arguably a key aspect of brains in their rapid adaptation, reconfiguration, high storage capacity, and sensitive response to external stimuli. Self-organized criticality (SOC) became an important concept to describe neural systems. We argue that transitions from one AM pattern to the other require the concept of phase transitions, extending beyond the dynamics described by SOC. We employ random graph theory (RGT) and percolation dynamics as fundamental mathematical approaches to model fluctuations in the cortical tissue. Our results indicate that perceptions are formed through a phase transition from a disorganized (high entropy) to a well-organized (low entropy) state, which explains the swiftness of the emergence of the perceptual experience in response to learned stimuli.

Reflections on a giant of brain science: How lucky we are having Walter J. Freeman as our beacon in cognitive neurodynamics research.

Walter J. Freeman was a giant of the field of neuroscience whose visionary work contributed various experimental and theoretical breakthroughs to brain research in the past 60 years. He has pioneered a number of Electroencephalogram and Electrocorticogram tools and approaches that shaped the field, while "Freeman Neurodynamics" is a theoretical concept that is widely known, used, and respected among neuroscientists all over the world. His recent death is a profound loss to neuroscience and biomedical engineering. Many of his revolutionary ideas on brain dynamics have been ahead of their time by decades. We summarize his following groundbreaking achievements: (1) Mass Action in the Nervous System, from microscopic (single cell) recordings, through mesoscopic populations, to large-scale collective brain patterns underlying cognition; (2) Freeman-Kachalsky model of multi-scale, modular brain dynamics; (3) cinematic theory of cognitive dynamics; (4) phase transitions in cortical dynamics modeled with random graphs and quantum field theory; (5) philosophical aspects of intentionality, consciousness, and the unity of brain-mind-body. His work has been admired by many of his neuroscientist colleagues and followers. At the same time, his multidisciplinary approach combining advanced concepts of control theory and the mathematics of nonlinear systems and chaos, poses significant challenges to those who wish to thoroughly understand his message. The goal of this commemorative paper is to review key aspects of Freeman's neurodynamics and to provide some handles to gain better understanding about Freeman's extraordinary intellectual achievement.

Breathing as a Fundamental Rhythm of Brain Function.

Ongoing fluctuations of neuronal activity have long been considered intrinsic noise that introduces unavoidable and unwanted variability into neuronal processing, which the brain eliminates by averaging across population activity (Georgopoulos et al., 1986; Lee et al., 1988; Shadlen and Newsome, 1994; Maynard et al., 1999). It is now understood, that the seemingly random fluctuations of cortical activity form highly structured patterns, including oscillations at various frequencies, that modulate evoked neuronal responses (Arieli et al., 1996; Poulet and Petersen, 2008; He, 2013) and affect sensory perception (Linkenkaer-Hansen et al., 2004; Boly et al., 2007; Sadaghiani et al., 2009; Vinnik et al., 2012; Palva et al., 2013). Ongoing cortical activity is driven by proprioceptive and interoceptive inputs. In addition, it is partially intrinsically generated in which case it may be related to mental processes (Fox and Raichle, 2007; Deco et al., 2011). Here we argue that respiration, via multiple sensory pathways, contributes a rhythmic component to the ongoing cortical activity. We suggest that this rhythmic activity modulates the temporal organization of cortical neurodynamics, thereby linking higher cortical functions to the process of breathing.

Comparison Analysis: Granger Causality and New Causality and Their Applications to Motor Imagery.

In this paper we first point out a fatal drawback that the widely used Granger causality (GC) needs to estimate the autoregressive model, which is equivalent to taking a series of backward recursive operations which are infeasible in many irreversible chemical reaction models. Thus, new causality (NC) proposed by Hu et al. (2011) is theoretically shown to be more sensitive to reveal true causality than GC. We then apply GC and NC to motor imagery (MI) which is an important mental process in cognitive neuroscience and psychology and has received growing attention for a long time. We study causality flow during MI using scalp electroencephalograms from nine subjects in Brain-computer interface competition IV held in 2008. We are interested in three regions: Cz (central area of the cerebral cortex), C3 (left area of the cerebral cortex), and C4 (right area of the cerebral cortex) which are considered to be optimal locations for recognizing MI states in the literature. Our results show that: 1) there is strong directional connectivity from Cz to C3/C4 during left- and right-hand MIs based on GC and NC; 2) during left-hand MI, there is directional connectivity from C4 to C3 based on GC and NC; 3) during right-hand MI, there is strong directional connectivity from C3 to C4 which is much clearly revealed by NC than by GC, i.e., NC largely improves the classification rate; and 4) NC is demonstrated to be much more sensitive to reveal causal influence between different brain regions than GC.

Random graph theory and neuropercolation for modeling brain oscillations at criticality.

Mathematical approaches are reviewed to interpret intermittent singular space-time dynamics observed in brain imaging experiments. The following aspects of brain dynamics are considered: nonlinear dynamics (chaos), phase transitions, and criticality. Probabilistic cellular automata and random graph models are described, which develop equations for the probability distributions of macroscopic state variables as an alternative to differential equations. The introduced modular neuropercolation model is motivated by the multilayer structure and dynamical properties of the cortex, and it describes critical brain oscillations, including background activity, narrow-band oscillations in excitatory-inhibitory populations, and broadband oscillations in the cortex. Input-induced and spontaneous transitions between states with large-scale synchrony and without synchrony exhibit brief episodes with long-range spatial correlations as observed in experiments.