A generalized reinforcement learning based deep neural network agent model for diverse cognitive constructs.

Human cognition is characterized by a wide range of capabilities including goal-oriented selective attention, distractor suppression, decision making, response inhibition, and working memory. Much research has focused on studying these individual components of cognition in isolation, whereas in several translational applications for cognitive impairment, multiple cognitive functions are altered in a given individual. Hence it is important to study multiple cognitive abilities in the same subject or, in computational terms, model them using a single model. To this end, we propose a unified, reinforcement learning-based agent model comprising of systems for representation, memory, value computation and exploration. We successfully modeled the aforementioned cognitive tasks and show how individual performance can be mapped to model meta-parameters. This model has the potential to serve as a proxy for cognitively impaired conditions, and can be used as a clinical testbench on which therapeutic interventions can be simulated first before delivering to human subjects.

Thalamic control of sensory processing and spindles in a biophysical somatosensory thalamoreticular circuit model of wakefulness and sleep.

Thalamoreticular circuitry plays a key role in arousal, attention, cognition, and sleep spindles, and is linked to several brain disorders. A detailed computational model of mouse somatosensory thalamus and thalamic reticular nucleus has been developed to capture the properties of over 14,000 neurons connected by 6 million synapses. The model recreates the biological connectivity of these neurons, and simulations of the model reproduce multiple experimental findings in different brain states. The model shows that inhibitory rebound produces frequency-selective enhancement of thalamic responses during wakefulness. We find that thalamic interactions are responsible for the characteristic waxing and waning of spindle oscillations. In addition, we find that changes in thalamic excitability control spindle frequency and their incidence. The model is made openly available to provide a new tool for studying the function and dysfunction of the thalamoreticular circuitry in various brain states.

A Multi-Scale Computational Model of Levodopa-Induced Toxicity in Parkinson's Disease.

Parkinson's disease (PD) is caused by the progressive loss of dopaminergic cells in substantia nigra pars compacta (SNc). The root cause of this cell loss in PD is still not decisively elucidated. A recent line of thinking has traced the cause of PD neurodegeneration to metabolic deficiency. Levodopa (L-DOPA), a precursor of dopamine, used as a symptom-relieving treatment for PD, leads to positive and negative outcomes. Several researchers inferred that L-DOPA might be harmful to SNc cells due to oxidative stress. The role of L-DOPA in the course of the PD pathogenesis is still debatable. We hypothesize that energy deficiency can lead to L-DOPA-induced toxicity in two ways: by promoting dopamine-induced oxidative stress and by exacerbating excitotoxicity in SNc. We present a systems-level computational model of SNc-striatum, which will help us understand the mechanism behind neurodegeneration postulated above and provide insights into developing disease-modifying therapeutics. It was observed that SNc terminals are more vulnerable to energy deficiency than SNc somas. During L-DOPA therapy, it was observed that higher L-DOPA dosage results in increased loss of terminals in SNc. It was also observed that co-administration of L-DOPA and glutathione (antioxidant) evades L-DOPA-induced toxicity in SNc neurons. Our proposed model of the SNc-striatum system is the first of its kind, where SNc neurons were modeled at a biophysical level, and striatal neurons were modeled at a spiking level. We show that our proposed model was able to capture L-DOPA-induced toxicity in SNc, caused by energy deficiency.

Influence of energy deficiency on the subcellular processes of Substantia Nigra Pars Compacta cell for understanding Parkinsonian neurodegeneration.

Parkinson's disease (PD) is the second most prominent neurodegenerative disease around the world. Although it is known that PD is caused by the loss of dopaminergic cells in substantia nigra pars compacta (SNc), the decisive cause of this inexorable cell loss is not clearly elucidated. We hypothesize that "Energy deficiency at a sub-cellular/cellular/systems level can be a common underlying cause for SNc cell loss in PD." Here, we propose a comprehensive computational model of SNc cell, which helps us to understand the pathophysiology of neurodegeneration at the subcellular level in PD. The aim of the study is to see how deficits in the supply of energy substrates (glucose and oxygen) lead to a deficit in adenosine triphosphate (ATP). The study also aims to show that deficits in ATP are the common factor underlying the molecular-level pathological changes, including alpha-synuclein aggregation, reactive oxygen species formation, calcium elevation, and dopamine dysfunction. The model suggests that hypoglycemia plays a more crucial role in leading to ATP deficits than hypoxia. We believe that the proposed model provides an integrated modeling framework to understand the neurodegenerative processes underlying PD.

A Multiscale, Systems-Level, Neuropharmacological Model of Cortico-Basal Ganglia System for Arm Reaching Under Normal, Parkinsonian, and Levodopa Medication Conditions.

In order to understand the link between substantia nigra pars compacta (SNc) cell loss and Parkinson's disease (PD) symptoms, we developed a multiscale computational model that can replicate the symptoms at the behavioural level by incorporating the key cellular and molecular mechanisms underlying PD pathology. There is a modelling tradition that links dopamine to reward and uses reinforcement learning (RL) concepts to model the basal ganglia. In our model, we replace the abstract representations of reward with the realistic variable of extracellular DA released by a network of SNc cells and incorporate it in the RL-based behavioural model, which simulates the arm reaching task. Our results successfully replicated the impact of SNc cell loss and levodopa (L-DOPA) medication on reaching performance. It also shows the side effects of medication, such as wearing off and peak dosage dyskinesias. The model demonstrates how differential dopaminergic axonal degeneration in basal ganglia results in various cardinal symptoms of PD. It was able to predict the optimum L-DOPA medication dosage for varying degrees of cell loss. The proposed model has a potential clinical application where drug dosage can be optimised as per patient characteristics.

A Multi-Scale Computational Model of Excitotoxic Loss of Dopaminergic Cells in Parkinson's Disease.

Parkinson's disease (PD) is a neurodegenerative disorder caused by loss of dopaminergic neurons in substantia nigra pars compacta (SNc). Although the exact cause of cell death is not clear, the hypothesis that metabolic deficiency is a key factor has been gaining attention in recent years. In the present study, we investigated this hypothesis using a multi-scale computational model of the subsystem of the basal ganglia comprising the subthalamic nucleus (STN), globus pallidus externa (GPe), and SNc. The proposed model is a multiscale model in that interaction among the three nuclei are simulated using more abstract Izhikevich neuron models, while the molecular pathways involved in cell death of SNc neurons are simulated in terms of detailed chemical kinetics. Simulation results obtained from the proposed model showed that energy deficiencies occurring at cellular and network levels could precipitate the excitotoxic loss of SNc neurons in PD. At the subcellular level, the models show how calcium elevation leads to apoptosis of SNc neurons. The therapeutic effects of several neuroprotective interventions are also simulated in the model. From neuroprotective studies, it was clear that glutamate inhibition and apoptotic signal blocker therapies were able to halt the progression of SNc cell loss when compared to other therapeutic interventions, which only slowed down the progression of SNc cell loss.

Neurodegenerative Diseases - Is Metabolic Deficiency the Root Cause?

Neurodegenerative diseases, including Alzheimer, Parkinson, Huntington, and amyotrophic lateral sclerosis, are a prominent class of neurological diseases currently without a cure. They are characterized by an inexorable loss of a specific type of neurons. The selective vulnerability of specific neuronal clusters (typically a subcortical cluster) in the early stages, followed by the spread of the disease to higher cortical areas, is a typical pattern of disease progression. Neurodegenerative diseases share a range of molecular and cellular pathologies, including protein aggregation, mitochondrial dysfunction, glutamate toxicity, calcium load, proteolytic stress, oxidative stress, neuroinflammation, and aging, which contribute to neuronal death. Efforts to treat these diseases are often limited by the fact that they tend to address any one of the above pathological changes while ignoring others. Lack of clarity regarding a possible root cause that underlies all the above pathologies poses a significant challenge. In search of an integrative theory for neurodegenerative pathology, we hypothesize that metabolic deficiency in certain vulnerable neuronal clusters is the common underlying thread that links many dimensions of the disease. The current review aims to present an outline of such an integrative theory. We present a new perspective of neurodegenerative diseases as metabolic disorders at molecular, cellular, and systems levels. This helps to understand a common underlying mechanism of the many facets of the disease and may lead to more promising disease-modifying therapeutic interventions. Here, we briefly discuss the selective metabolic vulnerability of specific neuronal clusters and also the involvement of glia and vascular dysfunctions. Any failure in satisfaction of the metabolic demand by the neurons triggers a chain of events that precipitate various manifestations of neurodegenerative pathology.

A Computational Model of Loss of Dopaminergic Cells in Parkinson's Disease Due to Glutamate-Induced Excitotoxicity.

Parkinson's disease (PD) is a neurodegenerative disease associated with progressive and inexorable loss of dopaminergic cells in Substantia Nigra pars compacta (SNc). Although many mechanisms have been suggested, a decisive root cause of this cell loss is unknown. A couple of the proposed mechanisms, however, show potential for the development of a novel line of PD therapeutics. One of these mechanisms is the peculiar metabolic vulnerability of SNc cells compared to other dopaminergic clusters; the other is the SubThalamic Nucleus (STN)-induced excitotoxicity in SNc. To investigate the latter hypothesis computationally, we developed a spiking neuron network-model of SNc-STN-GPe system. In the model, prolonged stimulation of SNc cells by an overactive STN leads to an increase in 'stress' variable; when the stress in a SNc neuron exceeds a stress threshold, the neuron dies. The model shows that the interaction between SNc and STN involves a positive-feedback due to which, an initial loss of SNc cells that crosses a threshold causes a runaway-effect, leading to an inexorable loss of SNc cells, strongly resembling the process of neurodegeneration. The model further suggests a link between the two aforementioned mechanisms of SNc cell loss. Our simulation results show that the excitotoxic cause of SNc cell loss might initiate by weak-excitotoxicity mediated by energy deficit, followed by strong-excitotoxicity, mediated by a disinhibited STN. A variety of conventional therapies were simulated to test their efficacy in slowing down SNc cell loss. Among them, glutamate inhibition, dopamine restoration, subthalamotomy and deep brain stimulation showed superior neuroprotective-effects in the proposed model.