Correction: Data-driven analyses of motor impairments in animal models of neurological disorders.

[This corrects the article DOI: 10.1371/journal.pbio.3000516.].

An orexigenic subnetwork within the human hippocampus.

Only recently have more specific circuit-probing techniques become available to inform previous reports implicating the rodent hippocampus in orexigenic appetitive processing1-4. This function has been reported to be mediated at least in part by lateral hypothalamic inputs, including those involving orexigenic lateral hypothalamic neuropeptides, such as melanin-concentrating hormone5,6. This circuit, however, remains elusive in humans. Here we combine tractography, intracranial electrophysiology, cortico-subcortical evoked potentials, and brain-clearing 3D histology to identify an orexigenic circuit involving the lateral hypothalamus and converging in a hippocampal subregion. We found that low-frequency power is modulated by sweet-fat food cues, and this modulation was specific to the dorsolateral hippocampus. Structural and functional analyses of this circuit in a human cohort exhibiting dysregulated eating behaviour revealed connectivity that was inversely related to body mass index. Collectively, this multimodal approach describes an orexigenic subnetwork within the human hippocampus implicated in obesity and related eating disorders.

Biologically-inspired neuronal adaptation improves learning in neural networks.

Since humans still outperform artificial neural networks on many tasks, drawing inspiration from the brain may help to improve current machine learning algorithms. Contrastive Hebbian learning (CHL) and equilibrium propagation (EP) are biologically plausible algorithms that update weights using only local information (without explicitly calculating gradients) and still achieve performance comparable to conventional backpropagation. In this study, we augmented CHL and EP with Adjusted Adaptation, inspired by the adaptation effect observed in neurons, in which a neuron's response to a given stimulus is adjusted after a short time. We add this adaptation feature to multilayer perceptrons and convolutional neural networks trained on MNIST and CIFAR-10. Surprisingly, adaptation improved the performance of these networks. We discuss the biological inspiration for this idea and investigate why Neuronal Adaptation could be an important brain mechanism to improve the stability and accuracy of learning.

Sensory experience selectively reorganizes the late component of evoked responses.

In response to sensory stimulation, the cortex exhibits an early transient response followed by late and slower activation. Recent studies suggest that the early component represents features of the stimulus while the late component is associated with stimulus perception. Although very informative, these studies only focus on the amplitude of the evoked responses to study its relationship with sensory perception. In this work, we expand upon the study of how patterns of evoked and spontaneous activity are modified by experience at the mesoscale level using voltage and extracellular glutamate transient recordings over widespread regions of mouse dorsal neocortex. We find that repeated tactile or auditory stimulation selectively modifies the spatiotemporal patterns of cortical activity, mainly of the late evoked response in anesthetized mice injected with amphetamine and also in awake mice. This modification lasted up to 60 min and results in an increase in the amplitude of the late response after repeated stimulation and in an increase in the similarity between the spatiotemporal patterns of the late early evoked response. This similarity increase occurs only for the evoked responses of the sensory modality that received the repeated stimulation. Thus, this selective long-lasting spatiotemporal modification of the cortical activity patterns might provide evidence that evoked responses are a cortex-wide phenomenon. This work opens new questions about how perception-related cortical activity changes with sensory experience across the cortex.

Combining backpropagation with Equilibrium Propagation to improve an Actor-Critic reinforcement learning framework.

Backpropagation (BP) has been used to train neural networks for many years, allowing them to solve a wide variety of tasks like image classification, speech recognition, and reinforcement learning tasks. But the biological plausibility of BP as a mechanism of neural learning has been questioned. Equilibrium Propagation (EP) has been proposed as a more biologically plausible alternative and achieves comparable accuracy on the CIFAR-10 image classification task. This study proposes the first EP-based reinforcement learning architecture: an Actor-Critic architecture with the actor network trained by EP. We show that this model can solve the basic control tasks often used as benchmarks for BP-based models. Interestingly, our trained model demonstrates more consistent high-reward behavior than a comparable model trained exclusively by BP.

Neurons learn by predicting future activity.

Understanding how the brain learns may lead to machines with human-like intellectual capacities. It was previously proposed that the brain may operate on the principle of predictive coding. However, it is still not well understood how a predictive system could be implemented in the brain. Here we demonstrate that the ability of a single neuron to predict its future activity may provide an effective learning mechanism. Interestingly, this predictive learning rule can be derived from a metabolic principle, where neurons need to minimize their own synaptic activity (cost), while maximizing their impact on local blood supply by recruiting other neurons. We show how this mathematically derived learning rule can provide a theoretical connection between diverse types of brain-inspired algorithms, thus, offering a step toward development of a general theory of neuronal learning. We tested this predictive learning rule in neural network simulations and in data recorded from awake animals. Our results also suggest that spontaneous brain activity provides "training data" for neurons to learn to predict cortical dynamics. Thus, the ability of a single neuron to minimize surprise: i.e. the difference between actual and expected activity, could be an important missing element to understand computation in the brain.

Epileptic seizures and link to memory processes.

Epileptogenesis is a complex and not well understood phenomenon. Here, we explore the hypothesis that epileptogenesis could be "hijacking" normal memory processes, and how this hypothesis may provide new directions for epilepsy treatment. First, we review similarities between the hypersynchronous circuits observed in epilepsy and memory consolidation processes involved in strengthening neuronal connections. Next, we describe the kindling model of seizures and its relation to long-term potentiation model of synaptic plasticity. We also examine how the strengthening of epileptic circuits is facilitated during the physiological slow wave sleep, similarly as episodic memories. Furthermore, we present studies showing that specific memories can directly trigger reflex seizures. The neuronal hypersynchrony in early stages of Alzheimer's disease, and the use of anti-epileptic drugs to improve the cognitive symptoms in this disease also suggests a connection between memory systems and epilepsy. Given the commonalities between memory processes and epilepsy, we propose that therapies for memory disorders might provide new avenues for treatment of epileptic patients.

Spatiotemporal structure of sensory-evoked and spontaneous activity revealed by mesoscale imaging in anesthetized and awake mice.

Stimuli-evoked and spontaneous brain activity propagates across the cortex in diverse spatiotemporal patterns. Despite extensive studies, the relationship between spontaneous and evoked activity is poorly understood. We investigate this relationship by comparing the amplitude, speed, direction, and complexity of propagation trajectories of spontaneous and evoked activity elicited with visual, auditory, and tactile stimuli using mesoscale wide-field imaging in mice. For both spontaneous and evoked activity, the speed and direction of propagation is modulated by the amplitude. However, spontaneous activity has a higher complexity of the propagation trajectories. For low stimulus strengths, evoked activity amplitude and speed is similar to that of spontaneous activity but becomes dissimilar at higher stimulus strengths. These findings are consistent with observations that primary sensory areas receive widespread inputs from other cortical regions, and during rest, the cortex tends to reactivate traces of complex multisensory experiences that might have occurred in exhibition of different behaviors.

A Neural Network Reveals Motoric Effects of Maternal Preconception Exposure to Nicotine on Rat Pup Behavior: A New Approach for Movement Disorders Diagnosis.

Neurodevelopmental disorders can stem from pharmacological, genetic, or environmental causes and early diagnosis is often a key to successful treatment. To improve early detection of neurological motor impairments, we developed a deep neural network for data-driven analyses. The network was applied to study the effect of maternal nicotine exposure prior to conception on 10-day-old rat pup motor behavior in an open field task. Female Long-Evans rats were administered nicotine (15 mg/L) in sweetened drinking water (1% sucralose) for seven consecutive weeks immediately prior to mating. The neural network outperformed human expert designed animal locomotion measures in distinguishing rat pups born to nicotine exposed dams vs. control dams (87 vs. 64% classification accuracy). Notably, the network discovered novel movement alterations in posture, movement initiation and a stereotypy in "warm-up" behavior (repeated movements along specific body dimensions) that were predictive of nicotine exposure. The results suggest novel findings that maternal preconception nicotine exposure delays and alters offspring motor development. Similar behavioral symptoms are associated with drug-related causes of disorders such as autism spectrum disorder and attention-deficit/hyperactivity disorder in human children. Thus, the identification of motor impairments in at-risk offspring here shows how neuronal networks can guide the development of more accurate behavioral tests to earlier diagnose symptoms of neurodevelopmental disorders in infants and children.

Predictive Neuronal Adaptation as a Basis for Consciousness.

Being able to correctly predict the future and to adjust own actions accordingly can offer a great survival advantage. In fact, this could be the main reason why brains evolved. Consciousness, the most mysterious feature of brain activity, also seems to be related to predicting the future and detecting surprise: a mismatch between actual and predicted situation. Similarly at a single neuron level, predicting future activity and adapting synaptic inputs accordingly was shown to be the best strategy to maximize the metabolic energy for a neuron. Following on these ideas, here we examined if surprise minimization by single neurons could be a basis for consciousness. First, we showed in simulations that as a neural network learns a new task, then the surprise within neurons (defined as the difference between actual and expected activity) changes similarly to the consciousness of skills in humans. Moreover, implementing adaptation of neuronal activity to minimize surprise at fast time scales (tens of milliseconds) resulted in improved network performance. This improvement is likely because adapting activity based on the internal predictive model allows each neuron to make a more "educated" response to stimuli. Based on those results, we propose that the neuronal predictive adaptation to minimize surprise could be a basic building block of conscious processing. Such adaptation allows neurons to exchange information about own predictions and thus to build more complex predictive models. To be precise, we provide an equation to quantify consciousness as the amount of surprise minus the size of the adaptation error. Since neuronal adaptation can be studied experimentally, this can allow testing directly our hypothesis. Specifically, we postulate that any substance affecting neuronal adaptation will also affect consciousness. Interestingly, our predictive adaptation hypothesis is consistent with multiple ideas presented previously in diverse theories of consciousness, such as global workspace theory, integrated information, attention schema theory, and predictive processing framework. In summary, we present a theoretical, computational, and experimental support for the hypothesis that neuronal adaptation is a possible biological mechanism of conscious processing, and we discuss how this could provide a step toward a unified theory of consciousness.

Spatiotemporal patterns of neocortical activity around hippocampal sharp-wave ripples.

A prevalent model is that sharp-wave ripples (SWR) arise 'spontaneously' in CA3 and propagate recent memory traces outward to the neocortex to facilitate memory consolidation there. Using voltage and extracellular glutamate transient recording over widespread regions of mice dorsal neocortex in relation to CA1 multiunit activity (MUA) and SWR, we find that the largest SWR-related modulation occurs in retrosplenial cortex; however, contrary to the unidirectional hypothesis, neocortical activation exhibited a continuum of activation timings relative to SWRs, varying from leading to lagging. Thus, contrary to the model in which SWRs arise 'spontaneously' in the hippocampus, neocortical activation often precedes SWRs and may thus constitute a trigger event in which neocortical information seeds associative reactivation of hippocampal 'indices'. This timing continuum is consistent with a dynamics in which older, more consolidated memories may in fact initiate the hippocampal-neocortical dialog, whereas reactivation of newer memories may be initiated predominantly in the hippocampus.

Using Neuron Spiking Activity to Trigger Closed-Loop Stimuli in Neurophysiological Experiments.

Closed-loop neurophysiological systems use patterns of neuronal activity to trigger stimuli, which in turn affect brain activity. Such closed-loop systems are already found in clinical applications, and are important tools for basic brain research. A particularly interesting recent development is the integration of closed-loop approaches with optogenetics, such that specific patterns of neuronal activity can trigger optical stimulation of selected neuronal groups. However, setting up an electrophysiological system for closed-loop experiments can be difficult. Here, a ready-to-apply Matlab code is provided for triggering stimuli based on the activity of single or multiple neurons. This sample code can be easily modified based on individual needs. For instance, it shows how to trigger sound stimuli and how to change it to trigger an external device connected to a PC serial port. The presented protocol is designed to work with a popular neuronal recording system for animal studies (Neuralynx). The implementation of closed-loop stimulation is demonstrated in an awake rat.

Data-driven analyses of motor impairments in animal models of neurological disorders.

Behavior provides important insights into neuronal processes. For example, analysis of reaching movements can give a reliable indication of the degree of impairment in neurological disorders such as stroke, Parkinson disease, or Huntington disease. The analysis of such movement abnormalities is notoriously difficult and requires a trained evaluator. Here, we show that a deep neural network is able to score behavioral impairments with expert accuracy in rodent models of stroke. The same network was also trained to successfully score movements in a variety of other behavioral tasks. The neural network also uncovered novel movement alterations related to stroke, which had higher predictive power of stroke volume than the movement components defined by human experts. Moreover, when the regression network was trained only on categorical information (control = 0; stroke = 1), it generated predictions with intermediate values between 0 and 1 that matched the human expert scores of stroke severity. The network thus offers a new data-driven approach to automatically derive ratings of motor impairments. Altogether, this network can provide a reliable neurological assessment and can assist the design of behavioral indices to diagnose and monitor neurological disorders.

Anodal transcranial direct current stimulation with monopolar pulses improves limb use after stroke by enhancing inter-hemispheric coherence.

Post-stroke neurological deficits, such as sensorimotor impairments, are often permanent and a leading cause of disability. Stroke is also associated with changes in neuronal synchrony among different brain areas. Multiple studies demonstrated that non-invasive brain stimulation, such as transcranial direct current stimulation (tDCS), enhances the efficacy of existing rehabilitative therapies. We hypothesized that the therapeutic effects of tDCS could be due to its influence on neuronal synchrony. To study this, we recorded local field potentials in rats treated with anodal tDCS (a-tDCS) after unilateral ischemic motor cortex lesion. To enhance the effect of a-tDCS on neuronal synchrony, we added monopolar pulses (a-tDCSmp) during a treatment. We found that ischemic lesions reduced interhemispheric coherence in the low gamma frequency range. By contrast, a-tDCSmp treatment increased interhemispheric coherence along with motor improvement in a skilled reaching task. These observations indicate that increased neuronal coherence is a likely mechanism by which tDCS improves stroke recovery. Moreover, this work adds to previous evidence that measures of brain coherence could be used as a biomarker of stroke recovery, which may help in the design of more effective tDCS protocols for stroke rehabilitation.

Effect of body position on relieve of foreign body from the airway.

Foreign body airway obstruction (FBAO), or commonly known as choking, is an extremely dangerous event. The European Resuscitation Council recommends that back blows and abdominal thrusts should be performed for relieving FBAO in conscious adults. Reviewed here evidence suggests that applying a prone or a head-down position increases effectiveness of the above standard approaches to relieve obstruction, due to help of gravity.

Phase of electroencephalography theta oscillation during stimulus encoding affects accuracy of memory recall.

Oscillatory activity is a ubiquitous property of brain signals, and yet relatively few studies have investigated how the phase of such ongoing oscillations affects our cognition. One of the main findings in this field is that the phase of electroencephalography (EEG) in the alpha band can affect perception of milliseconds-long stimuli. However, the importance of the phase of EEG for processing more naturalistic stimuli, which have a much longer duration, is still not clear. To address this question here, we presented word-nonword pairs, each of which was visible for 5 s and measured the effect of EEG phase during stimulus onset on later memory recall. The task consisted of an encoding (learning) phase in which 20 novel word-nonword pairs were presented, followed by a test phase in which participants were shown one of the seen words with four target nonwords to choose from. We found that memory recall performance was higher when the words during encoding were presented at a descending phase of the theta oscillation. This effect was the strongest in the frontal cortex. These results suggest that the phase of ongoing cortical activity can affect memorization of seconds-long stimuli that are an integral part of many daily tasks.

Learning to Predict Consequences as a Method of Knowledge Transfer in Reinforcement Learning.

The reinforcement learning (RL) paradigm allows agents to solve tasks through trial-and-error learning. To be capable of efficient, long-term learning, RL agents should be able to apply knowledge gained in the past to new tasks they may encounter in the future. The ability to predict actions' consequences may facilitate such knowledge transfer. We consider here domains where an RL agent has access to two kinds of information: agent-centric information with constant semantics across tasks, and environment-centric information, which is necessary to solve the task, but with semantics that differ between tasks. For example, in robot navigation, environment-centric information may include the robot's geographic location, while agent-centric information may include sensor readings of various nearby obstacles. We propose that these situations provide an opportunity for a very natural style of knowledge transfer, in which the agent learns to predict actions' environmental consequences using agent-centric information. These predictions contain important information about the affordances and dangers present in a novel environment, and can effectively transfer knowledge from agent-centric to environment-centric learning systems. Using several example problems including spatial navigation and network routing, we show that our knowledge transfer approach can allow faster and lower cost learning than existing alternatives.

Involvement of fast-spiking cells in ictal sequences during spontaneous seizures in rats with chronic temporal lobe epilepsy.

See Lenck-Santini (doi:10.1093/awx205) for a scientific commentary on this article. Epileptic seizures represent altered neuronal network dynamics, but the temporal evolution and cellular substrates of the neuronal activity patterns associated with spontaneous seizures are not fully understood. We used simultaneous recordings from multiple neurons in the hippocampus and neocortex of rats with chronic temporal lobe epilepsy to demonstrate that subsets of cells discharge in a highly stereotypical sequential pattern during ictal events, and that these stereotypical patterns were reproducible across consecutive seizures. In contrast to the canonical view that principal cell discharges dominate ictal events, the ictal sequences were predominantly composed of fast-spiking, putative inhibitory neurons, which displayed unusually strong coupling to local field potential even before seizures. The temporal evolution of activity was characterized by unique dynamics where the most correlated neuronal pairs before seizure onset displayed the largest increases in correlation strength during the seizures. These results demonstrate the selective involvement of fast spiking interneurons in structured temporal sequences during spontaneous ictal events in hippocampal and neocortical circuits in experimental models of chronic temporal lobe epilepsy.

UP-DOWN cortical dynamics reflect state transitions in a bistable network.

In the idling brain, neuronal circuits transition between periods of sustained firing (UP state) and quiescence (DOWN state), a pattern the mechanisms of which remain unclear. Here we analyzed spontaneous cortical population activity from anesthetized rats and found that UP and DOWN durations were highly variable and that population rates showed no significant decay during UP periods. We built a network rate model with excitatory (E) and inhibitory (I) populations exhibiting a novel bistable regime between a quiescent and an inhibition-stabilized state of arbitrarily low rate. Fluctuations triggered state transitions, while adaptation in E cells paradoxically caused a marginal decay of E-rate but a marked decay of I-rate in UP periods, a prediction that we validated experimentally. A spiking network implementation further predicted that DOWN-to-UP transitions must be caused by synchronous high-amplitude events. Our findings provide evidence of bistable cortical networks that exhibit non-rhythmic state transitions when the brain rests.