Cholinergic modulation supports dynamic switching of resting state networks through selective DMN suppression.

Brain activity during the resting state is widely used to examine brain organization, cognition and alterations in disease states. While it is known that neuromodulation and the state of alertness impact resting-state activity, neural mechanisms behind such modulation of resting-state activity are unknown. In this work, we used a computational model to demonstrate that change in excitability and recurrent connections, due to cholinergic modulation, impacts resting-state activity. The results of such modulation in the model match closely with experimental work on direct cholinergic modulation of Default Mode Network (DMN) in rodents. We further extended our study to the human connectome derived from diffusion-weighted MRI. In human resting-state simulations, an increase in cholinergic input resulted in a brain-wide reduction of functional connectivity. Furthermore, selective cholinergic modulation of DMN closely captured experimentally observed transitions between the baseline resting state and states with suppressed DMN fluctuations associated with attention to external tasks. Our study thus provides insight into potential neural mechanisms for the effects of cholinergic neuromodulation on resting-state activity and its dynamics.

Emergent effects of synaptic connectivity on the dynamics of global and local slow waves in a large-scale thalamocortical network model of the human brain.

Slow-wave sleep (SWS), characterized by slow oscillations (SOs, <1Hz) of alternating active and silent states in the thalamocortical network, is a primary brain state during Non-Rapid Eye Movement (NREM) sleep. In the last two decades, the traditional view of SWS as a global and uniform whole-brain state has been challenged by a growing body of evidence indicating that SO can be local and can coexist with wake-like activity. However, the mechanisms by which global and local SOs arise from micro-scale neuronal dynamics and network connectivity remain poorly understood. We developed a multi-scale, biophysically realistic human whole-brain thalamocortical network model capable of transitioning between the awake state and SWS, and we investigated the role of connectivity in the spatio-temporal dynamics of sleep SO. We found that the overall strength and a relative balance between long and short-range synaptic connections determined the network state. Importantly, for a range of synaptic strengths, the model demonstrated complex mixed SO states, where periods of synchronized global slow-wave activity were intermittent with the periods of asynchronous local slow-waves. An increase in the overall synaptic strength led to synchronized global SO, while a decrease in synaptic connectivity produced only local slow-waves that would not propagate beyond local areas. These results were compared to human data to validate probable models of biophysically realistic SO. The model producing mixed states provided the best match to the spatial coherence profile and the functional connectivity estimated from human subjects. These findings shed light on how the spatio-temporal properties of SO emerge from local and global cortical connectivity and provide a framework for further exploring the mechanisms and functions of SWS in health and disease.

Multielectrode Cortical Stimulation Selectively Induces Unidirectional Wave Propagation of Excitatory Neuronal Activity in Biophysical Neural Model.

Cortical stimulation is emerging as an experimental tool in basic research and a promising therapy for a range of neuropsychiatric conditions. As multielectrode arrays enter clinical practice, the possibility of using spatiotemporal patterns of electrical stimulation to induce desired physiological patterns has become theoretically possible, but in practice can only be implemented by trial-and-error because of a lack of predictive models. Experimental evidence increasingly establishes traveling waves as fundamental to cortical information-processing, but we lack an understanding of how to control wave properties despite rapidly improving technologies. This study uses a hybrid biophysical-anatomical and neural-computational model to predict and understand how a simple pattern of cortical surface stimulation could induce directional traveling waves via asymmetric activation of inhibitory interneurons. We found that pyramidal cells and basket cells are highly activated by the anodal electrode and minimally activated by the cathodal electrodes, while Martinotti cells are moderately activated by both electrodes but exhibit a slight preference for cathodal stimulation. Network model simulations found that this asymmetrical activation results in a traveling wave in superficial excitatory cells that propagates unidirectionally away from the electrode array. Our study reveals how asymmetric electrical stimulation can easily facilitate traveling waves by relying on two distinct types of inhibitory interneuron activity to shape and sustain the spatiotemporal dynamics of endogenous local circuit mechanisms.SIGNIFICANCE STATEMENT Electrical brain stimulation is becoming increasingly useful to probe the workings of brain and to treat a variety of neuropsychiatric disorders. However, stimulation is currently performed in a trial-and-error fashion as there are no methods to predict how different electrode arrangements and stimulation paradigms will affect brain functioning. In this study, we demonstrate a hybrid modeling approach, which makes experimentally testable predictions that bridge the gap between the microscale effects of multielectrode stimulation and the resultant circuit dynamics at the mesoscale. Our results show how custom stimulation paradigms can induce predictable, persistent changes in brain activity, which has the potential to restore normal brain function and become a powerful therapy for neurological and psychiatric conditions.

Single closed-loop acoustic stimulation targeting memory consolidation suppressed hippocampal ripple and thalamo-cortical spindle activity in mice.

Brain rhythms of sleep reflect neuronal activity underlying sleep-associated memory consolidation. The modulation of brain rhythms, such as the sleep slow oscillation (SO), is used both to investigate neurophysiological mechanisms as well as to measure the impact of sleep on presumed functional correlates. Previously, closed-loop acoustic stimulation in humans targeted to the SO Up-state successfully enhanced the slow oscillation rhythm and phase-dependent spindle activity, although effects on memory retention have varied. Here, we aim to disclose relations between stimulation-induced hippocampo-thalamo-cortical activity and retention performance on a hippocampus-dependent object-place recognition task in mice by applying acoustic stimulation at four estimated SO phases compared to sham condition. Across the 3-h retention interval at the beginning of the light phase closed-loop stimulation failed to improve retention significantly over sham. However, retention during SO Up-state stimulation was significantly higher than for another SO phase. At all SO phases, acoustic stimulation was accompanied by a sharp increase in ripple activity followed by about a second-long suppression of hippocampal sharp wave ripple and longer maintained suppression of thalamo-cortical spindle activity. Importantly, dynamics of SO-coupled hippocampal ripple activity distinguished SOUp-state stimulation. Non-rapid eye movement (NREM) sleep was not impacted by stimulation, yet preREM sleep duration was effected. Results reveal the complex effect of stimulation on the brain dynamics and support the use of closed-loop acoustic stimulation in mice to investigate the inter-regional mechanisms underlying memory consolidation.

Role of Sleep in Formation of Relational Associative Memory.

Relational memory, the ability to make and remember associations between objects, is an essential component of mammalian reasoning. In relational memory tasks, it has been shown that periods of offline processing, such as sleep, are critical to making indirect associations. To understand biophysical mechanisms behind the role of sleep in improving relational memory, we developed a model of the thalamocortical network to test how slow-wave sleep affects performance on an unordered relational memory task. First, the model was trained in the awake state on a paired associate inference task, in which the model learned to recall direct associations. After a period of subsequent slow-wave sleep, the model developed the ability to recall indirect associations. We found that replay, during sleep, of memory patterns learned in awake increased synaptic connectivity between neurons representing the item that was overlapping between tasks and neurons representing the unlinked items of the different tasks; this forms an attractor that enables indirect memory recall. Our study predicts that overlapping items between indirectly associated tasks are essential for relational memory, and sleep can reactivate pathways to and from overlapping items to the unlinked objects to strengthen these pathways and form new relational memories.SIGNIFICANCE STATEMENT Experimental studies have shown that some types of associative memory, such as transitive inference and relational memory, can improve after sleep. Still, it remains unknown what specific mechanisms are responsible for these sleep-related changes. In this new work, we addressed this problem by building a thalamocortical network model that can learn relational memory tasks and that can be simulated in awake or sleep states. We found that memory traces learned in awake were replayed during slow waves of NREM sleep and revealed that replay increased connections to and from overlapping memory items to form new relational memories. Our work discovered specific mechanisms behind the role of sleep in associative memory and made testable predictions about how sleep augments associative learning.

Sleep prevents catastrophic forgetting in spiking neural networks by forming a joint synaptic weight representation.

Artificial neural networks overwrite previously learned tasks when trained sequentially, a phenomenon known as catastrophic forgetting. In contrast, the brain learns continuously, and typically learns best when new training is interleaved with periods of sleep for memory consolidation. Here we used spiking network to study mechanisms behind catastrophic forgetting and the role of sleep in preventing it. The network could be trained to learn a complex foraging task but exhibited catastrophic forgetting when trained sequentially on different tasks. In synaptic weight space, new task training moved the synaptic weight configuration away from the manifold representing old task leading to forgetting. Interleaving new task training with periods of off-line reactivation, mimicking biological sleep, mitigated catastrophic forgetting by constraining the network synaptic weight state to the previously learned manifold, while allowing the weight configuration to converge towards the intersection of the manifolds representing old and new tasks. The study reveals a possible strategy of synaptic weights dynamics the brain applies during sleep to prevent forgetting and optimize learning.

Bidirectional Interaction of Hippocampal Ripples and Cortical Slow Waves Leads to Coordinated Spiking Activity During NREM Sleep.

The dialogue between cortex and hippocampus is known to be crucial for sleep-dependent memory consolidation. During slow wave sleep, memory replay depends on slow oscillation (SO) and spindles in the (neo)cortex and sharp wave-ripples (SWRs) in the hippocampus. The mechanisms underlying interaction of these rhythms are poorly understood. We examined the interaction between cortical SO and hippocampal SWRs in a model of the hippocampo-cortico-thalamic network and compared the results with human intracranial recordings during sleep. We observed that ripple occurrence peaked following the onset of an Up-state of SO and that cortical input to hippocampus was crucial to maintain this relationship. A small fraction of ripples occurred during the Down-state and controlled initiation of the next Up-state. We observed that the effect of ripple depends on its precise timing, which supports the idea that ripples occurring at different phases of SO might serve different functions, particularly in the context of encoding the new and reactivation of the old memories during memory consolidation. The study revealed complex bidirectional interaction of SWRs and SO in which early hippocampal ripples influence transitions to Up-state, while cortical Up-states control occurrence of the later ripples, which in turn influence transition to Down-state.

Stimulation Augments Spike Sequence Replay and Memory Consolidation during Slow-Wave Sleep.

Newly acquired memory traces are spontaneously reactivated during slow-wave sleep (SWS), leading to the consolidation of recent memories. Empirical studies found that sensory stimulation during SWS can selectively enhance memory consolidation with the effect depending on the phase of stimulation. In this new study, we aimed to understand the mechanisms behind the role of sensory stimulation on memory consolidation using computational models implementing effects of neuromodulators to simulate transitions between awake and SWS sleep, and synaptic plasticity to allow the change of synaptic connections due to the training in awake or replay during sleep. We found that when closed-loop stimulation was applied during the Down states of sleep slow oscillation, particularly right before the transition from Down to Up state, it significantly affected the spatiotemporal pattern of the slow waves and maximized memory replay. In contrast, when the stimulation was presented during the Up states, it did not have a significant impact on the slow waves or memory performance after sleep. For multiple memories trained in awake, presenting stimulation cues associated with specific memory trace could selectively augment replay and enhance consolidation of that memory and interfere with consolidation of the others (particularly weak) memories. Our study proposes a synaptic-level mechanism of how memory consolidation is affected by sensory stimulation during sleep.SIGNIFICANCE STATEMENT Stimulation, such as training-associated cues or auditory stimulation, during sleep can augment consolidation of the newly encoded memories. In this study, we used a computational model of the thalamocortical system to describe the mechanisms behind the role of stimulation in memory consolidation during slow-wave sleep. Our study suggests that stimulation preferentially strengthens memory traces when delivered at a specific phase of the slow oscillation, just before the Down to Up state transition when it makes the largest impact on the spatiotemporal pattern of sleep slow waves. In the presence of multiple memories, presenting sensory cues during sleep could selectively strengthen selected memories. Our study proposes a synaptic-level mechanism of how memory consolidation is affected by sensory stimulation during sleep.

Replay in Deep Learning: Current Approaches and Missing Biological Elements.

Replay is the reactivation of one or more neural patterns that are similar to the activation patterns experienced during past waking experiences. Replay was first observed in biological neural networks during sleep, and it is now thought to play a critical role in memory formation, retrieval, and consolidation. Replay-like mechanisms have been incorporated in deep artificial neural networks that learn over time to avoid catastrophic forgetting of previous knowledge. Replay algorithms have been successfully used in a wide range of deep learning methods within supervised, unsupervised, and reinforcement learning paradigms. In this letter, we provide the first comprehensive comparison between replay in the mammalian brain and replay in artificial neural networks. We identify multiple aspects of biological replay that are missing in deep learning systems and hypothesize how they could be used to improve artificial neural networks.

Optimality of sparse olfactory representations is not affected by network plasticity.

The neural representation of a stimulus is repeatedly transformed as it moves from the sensory periphery to deeper layers of the nervous system. Sparsening transformations are thought to increase the separation between similar representations, encode stimuli with great specificity, maximize storage capacity of associative memories, and provide an energy efficient instantiation of information in neural circuits. In the insect olfactory system, odors are initially represented in the periphery as a combinatorial code with relatively simple temporal dynamics. Subsequently, in the antennal lobe this representation is transformed into a dense and complex spatiotemporal activity pattern. Next, in the mushroom body Kenyon cells (KCs), the representation is dramatically sparsened. Finally, in mushroom body output neurons (MBONs), the representation takes on a new dense spatiotemporal format. Here, we develop a computational model to simulate this chain of olfactory processing from the receptor neurons to MBONs. We demonstrate that representations of similar odorants are maximally separated, measured by the distance between the corresponding MBON activity vectors, when KC responses are sparse. Sparseness is maintained across variations in odor concentration by adjusting the feedback inhibition that KCs receive from an inhibitory neuron, the Giant GABAergic neuron. Different odor concentrations require different strength and timing of feedback inhibition for optimal processing. Importantly, as observed in vivo, the KC-MBON synapse is highly plastic, and, therefore, changes in synaptic strength after learning can change the balance of excitation and inhibition, potentially leading to changes in the distance between MBON activity vectors of two odorants for the same level of KC population sparseness. Thus, what is an optimal degree of sparseness before odor learning, could be rendered sub-optimal post learning. Here, we show, however, that synaptic weight changes caused by spike timing dependent plasticity increase the distance between the odor representations from the perspective of MBONs. A level of sparseness that was optimal before learning remains optimal post-learning.

Origin of slow spontaneous resting-state neuronal fluctuations in brain networks.

Resting- or baseline-state low-frequency (0.01-0.2 Hz) brain activity is observed in fMRI, EEG, and local field potential recordings. These fluctuations were found to be correlated across brain regions and are thought to reflect neuronal activity fluctuations between functionally connected areas of the brain. However, the origin of these infra-slow resting-state fluctuations remains unknown. Here, using a detailed computational model of the brain network, we show that spontaneous infra-slow (<0.05 Hz) activity could originate due to the ion concentration dynamics. The computational model implemented dynamics for intra- and extracellular K+ and Na+ and intracellular Cl- ions, Na+/K+ exchange pump, and KCC2 cotransporter. In the network model simulating resting awake-like brain state, we observed infra-slow fluctuations in the extracellular K+ concentration, Na+/K+ pump activation, firing rate of neurons, and local field potentials. Holding K+ concentration constant prevented generation of the infra-slow fluctuations. The amplitude and peak frequency of this activity were modulated by the Na+/K+ pump, AMPA/GABA synaptic currents, and glial properties. Further, in a large-scale network with long-range connections based on CoCoMac connectivity data, the infra-slow fluctuations became synchronized among remote clusters similar to the resting-state activity observed in vivo. Overall, our study proposes that ion concentration dynamics mediated by neuronal and glial activity may contribute to the generation of very slow spontaneous fluctuations of brain activity that are reported as the resting-state fluctuations in fMRI and EEG recordings.

Structured networks support sparse traveling waves in rodent somatosensory cortex.

Neurons responding to different whiskers are spatially intermixed in the superficial layer 2/3 (L2/3) of the rodent barrel cortex, where a single whisker deflection activates a sparse, distributed neuronal population that spans multiple cortical columns. How the superficial layer of the rodent barrel cortex is organized to support such distributed sensory representations is not clear. In a computer model, we tested the hypothesis that sensory representations in L2/3 of the rodent barrel cortex are formed by activity propagation horizontally within L2/3 from a site of initial activation. The model explained the observed properties of L2/3 neurons, including the low average response probability in the majority of responding L2/3 neurons, and the existence of a small subset of reliably responding L2/3 neurons. Sparsely propagating traveling waves similar to those observed in L2/3 of the rodent barrel cortex occurred in the model only when a subnetwork of strongly connected neurons was immersed in a much larger network of weakly connected neurons.

NMDA receptors promote hippocampal sharp-wave ripples and the associated coactivity of CA1 pyramidal cells.

Hippocampal sharp-wave ripples (SWRs) support the reactivation of memory representations, relaying information to neocortex during "offline" and sleep-dependent memory consolidation. While blockade of NMDA receptors (NMDAR) is known to affect both learning and subsequent consolidation, the specific contributions of NMDAR activation to SWR-associated activity remain unclear. Here, we combine biophysical modeling with in vivo local field potential (LFP) and unit recording to quantify changes in SWR dynamics following inactivation of NMDAR. In a biophysical model of CA3-CA1 SWR activity, we find that NMDAR removal leads to reduced SWR density, but spares SWR properties such as duration, cell recruitment and ripple frequency. These predictions are confirmed by experiments in which NMDAR-mediated transmission in rats was inhibited using three different NMDAR antagonists, while recording dorsal CA1 LFP. In the model, loss of NMDAR-mediated conductances also induced a reduction in the proportion of cell pairs that co-activate significantly above chance across multiple events. Again, this prediction is corroborated by dorsal CA1 single-unit recordings, where the NMDAR blocker ketamine disrupted correlated spiking during SWR. Our results are consistent with a framework in which NMDA receptors both promote activation of SWR events and organize SWR-associated spiking content. This suggests that, while SWR are short-lived events emerging in fast excitatory-inhibitory networks, slower network components including NMDAR-mediated currents contribute to ripple density and promote consistency in the spiking content across ripples, underpinning mechanisms for fine-tuning of memory consolidation processes.

Differential Covariance: A New Method to Estimate Functional Connectivity in fMRI.

Measuring functional connectivity from fMRI recordings is important in understanding processing in cortical networks. However, because the brain's connection pattern is complex, currently used methods are prone to producing false functional connections. We introduce differential covariance analysis, a new method that uses derivatives of the signal for estimating functional connectivity. We generated neural activities from dynamical causal modeling and a neural network of Hodgkin-Huxley neurons and then converted them to hemodynamic signals using the forward balloon model. The simulated fMRI signals, together with the ground-truth connectivity pattern, were used to benchmark our method with other commonly used methods. Differential covariance achieved better results in complex network simulations. This new method opens an alternative way to estimate functional connectivity.

Selective recruitment of cortical neurons by electrical stimulation.

Despite its critical importance in experimental and clinical neuroscience, at present there is no systematic method to predict which neural elements will be activated by a given stimulation regime. Here we develop a novel approach to model the effect of cortical stimulation on spiking probability of neurons in a volume of tissue, by applying an analytical estimate of stimulation-induced activation of different cell types across cortical layers. We utilize the morphology and properties of axonal arborization profiles obtained from publicly available anatomical reconstructions of the twelve main categories of neocortical neurons to derive the dependence of activation probability on cell type, layer and distance from the source. We then propagate this activity through the local network incorporating connectivity, synaptic and cellular properties. Our work predicts that (a) intracranial cortical stimulation induces selective activation across cell types and layers; (b) superficial anodal stimulation is more effective than cathodal at cell activation; (c) cortical surface stimulation focally activates layer I axons, and (d) there is an optimal stimulation intensity capable of eliciting cell activation lasting beyond the end of stimulation. We conclude that selective effects of cortical electrical stimulation across cell types and cortical layers are largely driven by their different axonal arborization and myelination profiles.

Timing between Cortical Slow Oscillations and Heart Rate Bursts during Sleep Predicts Temporal Processing Speed, but Not Offline Consolidation.

Central and autonomic nervous system activities are coupled during sleep. Cortical slow oscillations (SOs; <1 Hz) coincide with brief bursts in heart rate (HR), but the functional consequence of this coupling in cognition remains elusive. We measured SO-HR temporal coupling (i.e., the peak-to-peak interval between downstate of SO event and HR burst) during a daytime nap and asked whether this SO-HR timing measure was associated with temporal processing speed and learning on a texture discrimination task by testing participants before and after a nap. The coherence of SO-HR events during sleep strongly correlated with an individual's temporal processing speed in the morning and evening test sessions, but not with their change in performance after the nap (i.e., consolidation). We confirmed this result in two additional experimental visits and also discovered that this association was visit-specific, indicating a state (not trait) marker. Thus, we introduce a novel physiological index that may be a useful marker of state-dependent processing speed of an individual.

Ionic and synaptic mechanisms of seizure generation and epileptogenesis.

The biophysical mechanisms underlying epileptogenesis and the generation of seizures remain to be better understood. Among many factors triggering epileptogenesis are traumatic brain injury breaking normal synaptic homeostasis and genetic mutations disrupting ionic concentration homeostasis. Impairments in these mechanisms, as seen in various brain diseases, may push the brain network to a pathological state characterized by increased susceptibility to unprovoked seizures. Here, we review recent computational studies exploring the roles of ionic concentration dynamics in the generation, maintenance, and termination of seizures. We further discuss how ionic and synaptic homeostatic mechanisms may give rise to conditions which prime brain networks to exhibit recurrent spontaneous seizures and epilepsy.

Circuit mechanisms of hippocampal reactivation during sleep.

The hippocampus is important for memory and learning, being a brain site where initial memories are formed and where sharp wave - ripples (SWR) are found, which are responsible for mapping recent memories to long-term storage during sleep-related memory replay. While this conceptual schema is well established, specific intrinsic and network-level mechanisms driving spatio-temporal patterns of hippocampal activity during sleep, and specifically controlling off-line memory reactivation are unknown. In this study, we discuss a model of hippocampal CA1-CA3 network generating spontaneous characteristic SWR activity. Our study predicts the properties of CA3 input which are necessary for successful CA1 ripple generation and the role of synaptic interactions and intrinsic excitability in spike sequence replay during SWRs. Specifically, we found that excitatory synaptic connections promote reactivation in both CA3 and CA1, but the different dynamics of sharp waves in CA3 and ripples in CA1 result in a differential role for synaptic inhibition in modulating replay: promoting spike sequence specificity in CA3 but not in CA1 areas. Finally, we describe how awake learning of spatial trajectories leads to synaptic changes sufficient to drive hippocampal cells' reactivation during sleep, as required for sleep-related memory consolidation.

Coupling of autonomic and central events during sleep benefits declarative memory consolidation.

While anatomical pathways between forebrain cognitive and brainstem autonomic nervous centers are well-defined, autonomic-central interactions during sleep and their contribution to waking performance are not understood. Here, we analyzed simultaneous central activity via electroencephalography (EEG) and autonomic heart beat-to-beat intervals (RR intervals) from electrocardiography (ECG) during wake and daytime sleep. We identified bursts of ECG activity that lasted 4-5 s and predominated in non-rapid-eye-movement sleep (NREM). Using event-based analysis of NREM sleep, we found an increase in delta (0.5-4 Hz) and sigma (12-15 Hz) power and an elevated density of slow oscillations (0.5-1 Hz) about 5 s prior to peak of the heart rate burst, as well as a surge in vagal activity, assessed by high-frequency (HF) component of RR intervals. Using regression framework, we show that these Autonomic/Central Events (ACE) positively predicted post-nap improvement in a declarative memory task after controlling for the effects of spindles and slow oscillations from sleep periods without ACE. No such relation was found between memory performance and a control nap. Additionally, NREM ACE negatively correlated with REM sleep and learning in a non-declarative memory task. These results provide the first evidence that coordinated autonomic and central events play a significant role in declarative memory consolidation.

Differential roles of sleep spindles and sleep slow oscillations in memory consolidation.

Sleep plays an important role in the consolidation of recent memories. However, the cellular and synaptic mechanisms of consolidation during sleep remain poorly understood. In this study, using a realistic computational model of the thalamocortical network, we tested the role of Non-Rapid Eye Movement (NREM) sleep in memory consolidation. We found that sleep spindles (the hallmark of N2 stage sleep) and slow oscillations (the hallmark of N3 stage sleep) both promote replay of the spike sequences learned in the awake state and replay was localized at the trained network locations. Memory performance improved after a period of NREM sleep but not after the same time period in awake. When multiple memories were trained, the local nature of the spike sequence replay during spindles allowed replay of the distinct memory traces independently, while slow oscillations promoted competition that could prevent replay of the weak memories in a presence of the stronger memory traces. This could lead to extinction of the weak memories unless when sleep spindles (N2 sleep) preceded slow oscillations (N3 sleep), as observed during the natural sleep cycle. Our study presents a mechanistic explanation for the role of sleep rhythms in memory consolidation and proposes a testable hypothesis how the natural structure of sleep stages provides an optimal environment to consolidate memories.