A generalized reinforcement learning based deep neural network agent model for diverse cognitive constructs.

Human cognition is characterized by a wide range of capabilities including goal-oriented selective attention, distractor suppression, decision making, response inhibition, and working memory. Much research has focused on studying these individual components of cognition in isolation, whereas in several translational applications for cognitive impairment, multiple cognitive functions are altered in a given individual. Hence it is important to study multiple cognitive abilities in the same subject or, in computational terms, model them using a single model. To this end, we propose a unified, reinforcement learning-based agent model comprising of systems for representation, memory, value computation and exploration. We successfully modeled the aforementioned cognitive tasks and show how individual performance can be mapped to model meta-parameters. This model has the potential to serve as a proxy for cognitively impaired conditions, and can be used as a clinical testbench on which therapeutic interventions can be simulated first before delivering to human subjects.

A Multiscale, Systems-Level, Neuropharmacological Model of Cortico-Basal Ganglia System for Arm Reaching Under Normal, Parkinsonian, and Levodopa Medication Conditions.

In order to understand the link between substantia nigra pars compacta (SNc) cell loss and Parkinson's disease (PD) symptoms, we developed a multiscale computational model that can replicate the symptoms at the behavioural level by incorporating the key cellular and molecular mechanisms underlying PD pathology. There is a modelling tradition that links dopamine to reward and uses reinforcement learning (RL) concepts to model the basal ganglia. In our model, we replace the abstract representations of reward with the realistic variable of extracellular DA released by a network of SNc cells and incorporate it in the RL-based behavioural model, which simulates the arm reaching task. Our results successfully replicated the impact of SNc cell loss and levodopa (L-DOPA) medication on reaching performance. It also shows the side effects of medication, such as wearing off and peak dosage dyskinesias. The model demonstrates how differential dopaminergic axonal degeneration in basal ganglia results in various cardinal symptoms of PD. It was able to predict the optimum L-DOPA medication dosage for varying degrees of cell loss. The proposed model has a potential clinical application where drug dosage can be optimised as per patient characteristics.