Cholinergic modulation supports dynamic switching of resting state networks through selective DMN suppression.

Brain activity during the resting state is widely used to examine brain organization, cognition and alterations in disease states. While it is known that neuromodulation and the state of alertness impact resting-state activity, neural mechanisms behind such modulation of resting-state activity are unknown. In this work, we used a computational model to demonstrate that change in excitability and recurrent connections, due to cholinergic modulation, impacts resting-state activity. The results of such modulation in the model match closely with experimental work on direct cholinergic modulation of Default Mode Network (DMN) in rodents. We further extended our study to the human connectome derived from diffusion-weighted MRI. In human resting-state simulations, an increase in cholinergic input resulted in a brain-wide reduction of functional connectivity. Furthermore, selective cholinergic modulation of DMN closely captured experimentally observed transitions between the baseline resting state and states with suppressed DMN fluctuations associated with attention to external tasks. Our study thus provides insight into potential neural mechanisms for the effects of cholinergic neuromodulation on resting-state activity and its dynamics.

Emergent effects of synaptic connectivity on the dynamics of global and local slow waves in a large-scale thalamocortical network model of the human brain.

Slow-wave sleep (SWS), characterized by slow oscillations (SO, <1Hz) of alternating active and silent states in the thalamocortical network, is a primary brain state during Non-Rapid Eye Movement (NREM) sleep. In the last two decades, the traditional view of SWS as a global and uniform whole-brain state has been challenged by a growing body of evidence indicating that SO can be local and can coexist with wake-like activity. However, the understanding of how global and local SO emerges from micro-scale neuron dynamics and network connectivity remains unclear. We developed a multi-scale, biophysically realistic human whole-brain thalamocortical network model capable of transitioning between the awake state and slow-wave sleep, and we investigated the role of connectivity in the spatio-temporal dynamics of sleep SO. We found that the overall strength and a relative balance between long and short-range synaptic connections determined the network state. Importantly, for a range of synaptic strengths, the model demonstrated complex mixed SO states, where periods of synchronized global slow-wave activity were intermittent with the periods of asynchronous local slow-waves. Increase of the overall synaptic strength led to synchronized global SO, while decrease of synaptic connectivity produced only local slow-waves that would not propagate beyond local area. These results were compared to human data to validate probable models of biophysically realistic SO. The model producing mixed states provided the best match to the spatial coherence profile and the functional connectivity estimated from human subjects. These findings shed light on how the spatio-temporal properties of SO emerge from local and global cortical connectivity and provide a framework for further exploring the mechanisms and functions of SWS in health and disease.

Thalamic feedback shapes brain responses evoked by cortical stimulation in mice and humans.

Cortical stimulation with single pulses is a common technique in clinical practice and research. However, we still do not understand the extent to which it engages subcortical circuits which contribute to the associated evoked potentials (EPs). Here we find that cortical stimulation generates remarkably similar EPs in humans and mice, with a late component similarly modulated by the subject's behavioral state. We optogenetically dissect the underlying circuit in mice, demonstrating that the late component of these EPs is caused by a thalamic hyperpolarization and rebound. The magnitude of this late component correlates with the bursting frequency and synchronicity of thalamic neurons, modulated by the subject's behavioral state. A simulation of the thalamo-cortical circuit highlights that both intrinsic thalamic currents as well as cortical and thalamic GABAergic neurons contribute to this response profile. We conclude that the cortical stimulation engages cortico-thalamo-cortical circuits highly preserved across different species and stimulation modalities.

Plasticity in inhibitory networks improves pattern separation in early olfactory processing.

Distinguishing between nectar and non-nectar odors presents a challenge for animals due to shared compounds in complex mixtures, where changing ratios often signify differences in reward. Changes in nectar production throughout the day and potentially many times within a forager's lifetime add to the complexity. The honeybee olfactory system, containing less than a 1000 of principal neurons in the early olfactory relay, the antennal lobe (AL), must learn to associate diverse volatile blends with rewards. We used a computational network model and live imaging of the honeybee's AL to explore the neural mechanisms and functions of the AL plasticity. Our findings revealed that when trained with a set of rewarded and unrewarded odors, the AL inhibitory network suppresses shared chemical compounds while enhancing responses to distinct compounds. This results in improved pattern separation and a more concise and efficient neural code. Our Ca2+ imaging data support our model's predictions. Furthermore, we applied these contrast enhancement principles to a Graph Convolutional Network (GCN) and found that similar mechanisms could enhance the performance of artificial neural networks. Our model provides insights into how plasticity at the inhibitory network level reshapes coding for efficient learning of complex odors.

Single closed-loop acoustic stimulation targeting memory consolidation suppressed hippocampal ripple and thalamo-cortical spindle activity in mice.

Brain rhythms of sleep reflect neuronal activity underlying sleep-associated memory consolidation. The modulation of brain rhythms, such as the sleep slow oscillation (SO), is used both to investigate neurophysiological mechanisms as well as to measure the impact of sleep on presumed functional correlates. Previously, closed-loop acoustic stimulation in humans targeted to the SO Up-state successfully enhanced the slow oscillation rhythm and phase-dependent spindle activity, although effects on memory retention have varied. Here, we aim to disclose relations between stimulation-induced hippocampo-thalamo-cortical activity and retention performance on a hippocampus-dependent object-place recognition task in mice by applying acoustic stimulation at four estimated SO phases compared to sham condition. Across the 3-h retention interval at the beginning of the light phase closed-loop stimulation failed to improve retention significantly over sham. However, retention during SO Up-state stimulation was significantly higher than for another SO phase. At all SO phases, acoustic stimulation was accompanied by a sharp increase in ripple activity followed by about a second-long suppression of hippocampal sharp wave ripple and longer maintained suppression of thalamo-cortical spindle activity. Importantly, dynamics of SO-coupled hippocampal ripple activity distinguished SOUp-state stimulation. Non-rapid eye movement (NREM) sleep was not impacted by stimulation, yet preREM sleep duration was effected. Results reveal the complex effect of stimulation on the brain dynamics and support the use of closed-loop acoustic stimulation in mice to investigate the inter-regional mechanisms underlying memory consolidation.

The role of age-related sleep EEG changes in memory decline: experiments and computational modeling.

The slow oscillation (SO) observed during deep sleep is known to facilitate memory consolidation. However, the impact of age-related changes in sleep electroencephalography (EEG) oscillations and memory remains unknown. In this study, we aimed to investigate the contribution of age-related changes in sleep SO and its role in memory decline by combining EEG recordings and computational modeling. Based on the detected SO events, we found that older adults exhibit lower SO density, lower SO frequency, and longer Up and Down state durations during N3 sleep compared to young and middle-aged groups. Using a biophysically detailed thalamocortical network model, we simulated the "aged" brain as a partial loss of synaptic connections between neurons in the cortex. Our simulations showed that the changes in sleep SO properties in the "aged" brain, similar to those observed in older adults, resulting in impaired memory consolidation. Overall, this study provides mechanistic insights into how age-related changes modulate sleep SOs and memory decline.Clinical Relevance- This study contributes towards finding feasible biomarkers and target mechanism for designing therapy in older adults with memory deficits, such as Alzheimer's disease patients.

Multielectrode Cortical Stimulation Selectively Induces Unidirectional Wave Propagation of Excitatory Neuronal Activity in Biophysical Neural Model.

Cortical stimulation is emerging as an experimental tool in basic research and a promising therapy for a range of neuropsychiatric conditions. As multielectrode arrays enter clinical practice, the possibility of using spatiotemporal patterns of electrical stimulation to induce desired physiological patterns has become theoretically possible, but in practice can only be implemented by trial-and-error because of a lack of predictive models. Experimental evidence increasingly establishes traveling waves as fundamental to cortical information-processing, but we lack an understanding of how to control wave properties despite rapidly improving technologies. This study uses a hybrid biophysical-anatomical and neural-computational model to predict and understand how a simple pattern of cortical surface stimulation could induce directional traveling waves via asymmetric activation of inhibitory interneurons. We found that pyramidal cells and basket cells are highly activated by the anodal electrode and minimally activated by the cathodal electrodes, while Martinotti cells are moderately activated by both electrodes but exhibit a slight preference for cathodal stimulation. Network model simulations found that this asymmetrical activation results in a traveling wave in superficial excitatory cells that propagates unidirectionally away from the electrode array. Our study reveals how asymmetric electrical stimulation can easily facilitate traveling waves by relying on two distinct types of inhibitory interneuron activity to shape and sustain the spatiotemporal dynamics of endogenous local circuit mechanisms.SIGNIFICANCE STATEMENT Electrical brain stimulation is becoming increasingly useful to probe the workings of brain and to treat a variety of neuropsychiatric disorders. However, stimulation is currently performed in a trial-and-error fashion as there are no methods to predict how different electrode arrangements and stimulation paradigms will affect brain functioning. In this study, we demonstrate a hybrid modeling approach, which makes experimentally testable predictions that bridge the gap between the microscale effects of multielectrode stimulation and the resultant circuit dynamics at the mesoscale. Our results show how custom stimulation paradigms can induce predictable, persistent changes in brain activity, which has the potential to restore normal brain function and become a powerful therapy for neurological and psychiatric conditions.

Olfactory receptor neurons generate multiple response motifs, increasing coding space dimensionality.

Odorants binding to olfactory receptor neurons (ORNs) trigger bursts of action potentials, providing the brain with its only experience of the olfactory environment. Our recordings made in vivo from locust ORNs showed that odor-elicited firing patterns comprise four distinct response motifs, each defined by a reliable temporal profile. Different odorants could elicit different response motifs from a given ORN, a property we term motif switching. Further, each motif undergoes its own form of sensory adaptation when activated by repeated plume-like odor pulses. A computational model constrained by our recordings revealed that organizing responses into multiple motifs provides substantial benefits for classifying odors and processing complex odor plumes: each motif contributes uniquely to encode the plume's composition and structure. Multiple motifs and motif switching further improve odor classification by expanding coding dimensionality. Our model demonstrated that these response features could provide benefits for olfactory navigation, including determining the distance to an odor source.

Sleep-like unsupervised replay reduces catastrophic forgetting in artificial neural networks.

Artificial neural networks are known to suffer from catastrophic forgetting: when learning multiple tasks sequentially, they perform well on the most recent task at the expense of previously learned tasks. In the brain, sleep is known to play an important role in incremental learning by replaying recent and old conflicting memory traces. Here we tested the hypothesis that implementing a sleep-like phase in artificial neural networks can protect old memories during new training and alleviate catastrophic forgetting. Sleep was implemented as off-line training with local unsupervised Hebbian plasticity rules and noisy input. In an incremental learning framework, sleep was able to recover old tasks that were otherwise forgotten. Previously learned memories were replayed spontaneously during sleep, forming unique representations for each class of inputs. Representational sparseness and neuronal activity corresponding to the old tasks increased while new task related activity decreased. The study suggests that spontaneous replay simulating sleep-like dynamics can alleviate catastrophic forgetting in artificial neural networks.

Differential thalamocortical interactions in slow and fast spindle generation: A computational model.

Cortical slow oscillations (SOs) and thalamocortical sleep spindles are two prominent EEG rhythms of slow wave sleep. These EEG rhythms play an essential role in memory consolidation. In humans, sleep spindles are categorized into slow spindles (8-12 Hz) and fast spindles (12-16 Hz), with different properties. Slow spindles that couple with the up-to-down phase of the SO require more experimental and computational investigation to disclose their origin, functional relevance and most importantly their relation with SOs regarding memory consolidation. To examine slow spindles, we propose a biophysical thalamocortical model with two independent thalamic networks (one for slow and the other for fast spindles). Our modeling results show that fast spindles lead to faster cortical cell firing, and subsequently increase the amplitude of the cortical local field potential (LFP) during the SO down-to-up phase. Slow spindles also facilitate cortical cell firing, but the response is slower, thereby increasing the cortical LFP amplitude later, at the SO up-to-down phase of the SO cycle. Neither the SO rhythm nor the duration of the SO down state is affected by slow spindle activity. Furthermore, at a more hyperpolarized membrane potential level of fast thalamic subnetwork cells, the activity of fast spindles decreases, while the slow spindles activity increases. Together, our model results suggest that slow spindles may facilitate the initiation of the following SO cycle, without however affecting expression of the SO Up and Down states.

Sleep prevents catastrophic forgetting in spiking neural networks by forming a joint synaptic weight representation.

Artificial neural networks overwrite previously learned tasks when trained sequentially, a phenomenon known as catastrophic forgetting. In contrast, the brain learns continuously, and typically learns best when new training is interleaved with periods of sleep for memory consolidation. Here we used spiking network to study mechanisms behind catastrophic forgetting and the role of sleep in preventing it. The network could be trained to learn a complex foraging task but exhibited catastrophic forgetting when trained sequentially on different tasks. In synaptic weight space, new task training moved the synaptic weight configuration away from the manifold representing old task leading to forgetting. Interleaving new task training with periods of off-line reactivation, mimicking biological sleep, mitigated catastrophic forgetting by constraining the network synaptic weight state to the previously learned manifold, while allowing the weight configuration to converge towards the intersection of the manifolds representing old and new tasks. The study reveals a possible strategy of synaptic weights dynamics the brain applies during sleep to prevent forgetting and optimize learning.

Role of Sleep in Formation of Relational Associative Memory.

Relational memory, the ability to make and remember associations between objects, is an essential component of mammalian reasoning. In relational memory tasks, it has been shown that periods of offline processing, such as sleep, are critical to making indirect associations. To understand biophysical mechanisms behind the role of sleep in improving relational memory, we developed a model of the thalamocortical network to test how slow-wave sleep affects performance on an unordered relational memory task. First, the model was trained in the awake state on a paired associate inference task, in which the model learned to recall direct associations. After a period of subsequent slow-wave sleep, the model developed the ability to recall indirect associations. We found that replay, during sleep, of memory patterns learned in awake increased synaptic connectivity between neurons representing the item that was overlapping between tasks and neurons representing the unlinked items of the different tasks; this forms an attractor that enables indirect memory recall. Our study predicts that overlapping items between indirectly associated tasks are essential for relational memory, and sleep can reactivate pathways to and from overlapping items to the unlinked objects to strengthen these pathways and form new relational memories.SIGNIFICANCE STATEMENT Experimental studies have shown that some types of associative memory, such as transitive inference and relational memory, can improve after sleep. Still, it remains unknown what specific mechanisms are responsible for these sleep-related changes. In this new work, we addressed this problem by building a thalamocortical network model that can learn relational memory tasks and that can be simulated in awake or sleep states. We found that memory traces learned in awake were replayed during slow waves of NREM sleep and revealed that replay increased connections to and from overlapping memory items to form new relational memories. Our work discovered specific mechanisms behind the role of sleep in associative memory and made testable predictions about how sleep augments associative learning.

Novelty detection in early olfactory processing of the honey bee, Apis mellifera.

Animals are constantly bombarded with stimuli, which presents a fundamental problem of sorting among pervasive uninformative stimuli and novel, possibly meaningful stimuli. We evaluated novelty detection behaviorally in honey bees as they position their antennae differentially in an air stream carrying familiar or novel odors. We then characterized neuronal responses to familiar and novel odors in the first synaptic integration center in the brain-the antennal lobes. We found that the neurons that exhibited stronger initial responses to the odor that was to be familiarized are the same units that later distinguish familiar and novel odors, independently of chemical identities. These units, including both tentative projection neurons and local neurons, showed a decreased response to the familiar odor but an increased response to the novel odor. Our results suggest that the antennal lobe may represent familiarity or novelty to an odor stimulus in addition to its chemical identity code. Therefore, the mechanisms for novelty detection may be present in early sensory processing, either as a result of local synaptic interaction or via feedback from higher brain centers.

Replay in Deep Learning: Current Approaches and Missing Biological Elements.

Replay is the reactivation of one or more neural patterns that are similar to the activation patterns experienced during past waking experiences. Replay was first observed in biological neural networks during sleep, and it is now thought to play a critical role in memory formation, retrieval, and consolidation. Replay-like mechanisms have been incorporated in deep artificial neural networks that learn over time to avoid catastrophic forgetting of previous knowledge. Replay algorithms have been successfully used in a wide range of deep learning methods within supervised, unsupervised, and reinforcement learning paradigms. In this letter, we provide the first comprehensive comparison between replay in the mammalian brain and replay in artificial neural networks. We identify multiple aspects of biological replay that are missing in deep learning systems and hypothesize how they could be used to improve artificial neural networks.

A computational study of suppression of sharp wave ripple complexes by controlling calcium and gap junctions in pyramidal cells.

The hippocampus plays a key role in memory formation and learning. According to the concept of active systems memory consolidation, transiently stored memory traces are transferred from the hippocampus into the neocortex for permanent storage. This phenomenon relies on hippocampal network oscillations, particularly sharp wave ripples [SPW-Rs). In this process prior saved data in the hippocampus may be reactivated. Recent investigations reveal that several neurotransmitters and neuromodulators including norepinephrine, acetylcholine, serotonin, etc., suppress SPW-Rs activity in rodents' hippocampal slices. This suppression of SPW-Rs may depend on various presynaptic and postsynaptic parameters including decrease in calcium influx, hyperpolarization/depolarization and alteration in gap junctions' function in pyramidal cells. In this study, we demonstrate the impact of calcium influx and gap junctions on pyramidal cells for the modulation of SPW-Rs in a computational model of CA1.We used,SPW-Rs model with some modifications. SPW-Rs are simulated with gradual reduction of calcium and with decreasing conductance through gap junctions in PCs. Both, with calcium reduction as well as with conductance reduction through gap junctions, SPW-Rs are suppressed. Both effects add up synergistically in combination.

Bidirectional Interaction of Hippocampal Ripples and Cortical Slow Waves Leads to Coordinated Spiking Activity During NREM Sleep.

The dialogue between cortex and hippocampus is known to be crucial for sleep-dependent memory consolidation. During slow wave sleep, memory replay depends on slow oscillation (SO) and spindles in the (neo)cortex and sharp wave-ripples (SWRs) in the hippocampus. The mechanisms underlying interaction of these rhythms are poorly understood. We examined the interaction between cortical SO and hippocampal SWRs in a model of the hippocampo-cortico-thalamic network and compared the results with human intracranial recordings during sleep. We observed that ripple occurrence peaked following the onset of an Up-state of SO and that cortical input to hippocampus was crucial to maintain this relationship. A small fraction of ripples occurred during the Down-state and controlled initiation of the next Up-state. We observed that the effect of ripple depends on its precise timing, which supports the idea that ripples occurring at different phases of SO might serve different functions, particularly in the context of encoding the new and reactivation of the old memories during memory consolidation. The study revealed complex bidirectional interaction of SWRs and SO in which early hippocampal ripples influence transitions to Up-state, while cortical Up-states control occurrence of the later ripples, which in turn influence transition to Down-state.

NMDA receptors promote hippocampal sharp-wave ripples and the associated coactivity of CA1 pyramidal cells.

Hippocampal sharp-wave ripples (SWRs) support the reactivation of memory representations, relaying information to neocortex during "offline" and sleep-dependent memory consolidation. While blockade of NMDA receptors (NMDAR) is known to affect both learning and subsequent consolidation, the specific contributions of NMDAR activation to SWR-associated activity remain unclear. Here, we combine biophysical modeling with in vivo local field potential (LFP) and unit recording to quantify changes in SWR dynamics following inactivation of NMDAR. In a biophysical model of CA3-CA1 SWR activity, we find that NMDAR removal leads to reduced SWR density, but spares SWR properties such as duration, cell recruitment and ripple frequency. These predictions are confirmed by experiments in which NMDAR-mediated transmission in rats was inhibited using three different NMDAR antagonists, while recording dorsal CA1 LFP. In the model, loss of NMDAR-mediated conductances also induced a reduction in the proportion of cell pairs that co-activate significantly above chance across multiple events. Again, this prediction is corroborated by dorsal CA1 single-unit recordings, where the NMDAR blocker ketamine disrupted correlated spiking during SWR. Our results are consistent with a framework in which NMDA receptors both promote activation of SWR events and organize SWR-associated spiking content. This suggests that, while SWR are short-lived events emerging in fast excitatory-inhibitory networks, slower network components including NMDAR-mediated currents contribute to ripple density and promote consistency in the spiking content across ripples, underpinning mechanisms for fine-tuning of memory consolidation processes.

Differential Covariance: A New Method to Estimate Functional Connectivity in fMRI.

Measuring functional connectivity from fMRI recordings is important in understanding processing in cortical networks. However, because the brain's connection pattern is complex, currently used methods are prone to producing false functional connections. We introduce differential covariance analysis, a new method that uses derivatives of the signal for estimating functional connectivity. We generated neural activities from dynamical causal modeling and a neural network of Hodgkin-Huxley neurons and then converted them to hemodynamic signals using the forward balloon model. The simulated fMRI signals, together with the ground-truth connectivity pattern, were used to benchmark our method with other commonly used methods. Differential covariance achieved better results in complex network simulations. This new method opens an alternative way to estimate functional connectivity.

Can sleep protect memories from catastrophic forgetting?

Continual learning remains an unsolved problem in artificial neural networks. The brain has evolved mechanisms to prevent catastrophic forgetting of old knowledge during new training. Building upon data suggesting the importance of sleep in learning and memory, we tested a hypothesis that sleep protects old memories from being forgotten after new learning. In the thalamocortical model, training a new memory interfered with previously learned old memories leading to degradation and forgetting of the old memory traces. Simulating sleep after new learning reversed the damage and enhanced old and new memories. We found that when a new memory competed for previously allocated neuronal/synaptic resources, sleep replay changed the synaptic footprint of the old memory to allow overlapping neuronal populations to store multiple memories. Our study predicts that memory storage is dynamic, and sleep enables continual learning by combining consolidation of new memory traces with reconsolidation of old memory traces to minimize interference.

Optimality of sparse olfactory representations is not affected by network plasticity.

The neural representation of a stimulus is repeatedly transformed as it moves from the sensory periphery to deeper layers of the nervous system. Sparsening transformations are thought to increase the separation between similar representations, encode stimuli with great specificity, maximize storage capacity of associative memories, and provide an energy efficient instantiation of information in neural circuits. In the insect olfactory system, odors are initially represented in the periphery as a combinatorial code with relatively simple temporal dynamics. Subsequently, in the antennal lobe this representation is transformed into a dense and complex spatiotemporal activity pattern. Next, in the mushroom body Kenyon cells (KCs), the representation is dramatically sparsened. Finally, in mushroom body output neurons (MBONs), the representation takes on a new dense spatiotemporal format. Here, we develop a computational model to simulate this chain of olfactory processing from the receptor neurons to MBONs. We demonstrate that representations of similar odorants are maximally separated, measured by the distance between the corresponding MBON activity vectors, when KC responses are sparse. Sparseness is maintained across variations in odor concentration by adjusting the feedback inhibition that KCs receive from an inhibitory neuron, the Giant GABAergic neuron. Different odor concentrations require different strength and timing of feedback inhibition for optimal processing. Importantly, as observed in vivo, the KC-MBON synapse is highly plastic, and, therefore, changes in synaptic strength after learning can change the balance of excitation and inhibition, potentially leading to changes in the distance between MBON activity vectors of two odorants for the same level of KC population sparseness. Thus, what is an optimal degree of sparseness before odor learning, could be rendered sub-optimal post learning. Here, we show, however, that synaptic weight changes caused by spike timing dependent plasticity increase the distance between the odor representations from the perspective of MBONs. A level of sparseness that was optimal before learning remains optimal post-learning.