Changes in corticostriatal connectivity during reinforcement learning in humans.

Many computational models assume that reinforcement learning relies on changes in synaptic efficacy between cortical regions representing stimuli and striatal regions involved in response selection, but this assumption has thus far lacked empirical support in humans. We recorded hemodynamic signals with fMRI while participants navigated a virtual maze to find hidden rewards. We fitted a reinforcement-learning algorithm to participants' choice behavior and evaluated the neural activity and the changes in functional connectivity related to trial-by-trial learning variables. Activity in the posterior putamen during choice periods increased progressively during learning. Furthermore, the functional connections between the sensorimotor cortex and the posterior putamen strengthened progressively as participants learned the task. These changes in corticostriatal connectivity differentiated participants who learned the task from those who did not. These findings provide a direct link between changes in corticostriatal connectivity and learning, thereby supporting a central assumption common to several computational models of reinforcement learning.

Deficient Functioning of Frontostriatal Circuits During the Resolution of Cognitive Conflict in Cannabis-Using Youth.

OBJECTIVE: Disturbances in self-regulatory control are involved in the initiation and maintenance of addiction, including cannabis use disorder. In adults, long-term cannabis use is associated with disturbances in frontostriatal circuits during tasks that require the engagement of self-regulatory control, including the resolution of cognitive conflict. Understudied are the behavioral and neural correlates of these processes earlier in the course of cannabis use disentangled from effects of long-term use. The present study investigated the functioning of frontostriatal circuits during the resolution of cognitive conflict in cannabis-using youth. METHOD: Functional magnetic resonance imaging data were acquired from 28 cannabis-using youth and 32 age-matched healthy participants during the performance of a Simon task. General linear modeling was used to compare patterns of brain activation during correct responses to conflict stimuli across groups. Psychophysiologic interaction analyses were used to examine conflict-related frontostriatal connectivity across groups. Associations of frontostriatal activation and connectivity with cannabis use measures were explored. RESULTS: Decreased conflict-related activity was detected in cannabis-using versus healthy control youth in frontostriatal regions, including the ventromedial prefrontal cortex, striatum, pallidum, and thalamus. Frontostriatal connectivity did not differ across groups, but negative connectivity between the ventromedial prefrontal cortex and striatum was detected in the 2 groups. CONCLUSION: These findings are consistent with previous reports of cannabis-associated disturbances in frontostriatal circuits in adults and point to the specific influence of cannabis on neurodevelopmental changes in youth. Future studies should examine whether frontostriatal functioning is a reliable marker of cannabis use disorder severity and a potential target for circuit-based interventions.

Weeding Out the Truth: Adolescents and Cannabis: Case and Discussion.

This clinical case conference discusses the case of an adolescent presenting with a marijuana use disorder. Information about a real patient is presented to expert clinicians, who respond to the information by sharing their reasoning and recommendations, followed by a summary of the clinical discussion.

Reward-Based Spatial Learning in Teens With Bulimia Nervosa.

OBJECTIVE: To assess the functioning of mesolimbic and fronto-striatal areas involved in reward-based spatial learning in teenaged girls with bulimia nervosa (BN) that might be involved in the development and maintenance of maladaptive behaviors characteristic of the disorder. METHOD: We compared functional magnetic resonance imaging blood oxygen level-dependent response in 27 adolescent girls with BN to that of 27 healthy, age-matched control participants during a reward-based learning task that required learning to use extra-maze cues to navigate a virtual 8-arm radial maze to find hidden rewards. We compared groups in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudo-randomly to experimentally prevent learning. RESULTS: Both groups learned to navigate the maze to find hidden rewards, but group differences in brain activity associated with maze navigation and reward processing were detected in the fronto-striatal regions and right anterior hippocampus. Unlike healthy adolescents, those with BN did not engage the right inferior frontal gyrus during maze navigation, activated the right anterior hippocampus during the receipt of unexpected rewards (control condition), and deactivated the left superior frontal gyrus and right anterior hippocampus during expected reward receipt (learning condition). These patterns of hippocampal activation in the control condition were significantly associated with the frequency of binge-eating episodes. CONCLUSION: Adolescents with BN displayed abnormal functioning of the anterior hippocampus and fronto-striatal regions during reward-based spatial learning. These findings suggest that an imbalance in control and reward circuits may arise early in the course of BN. Clinical trial registration information-An fMRI Study of Self-Regulation in Adolescents With Bulimia Nervosa; https://clinicaltrials.gov/; NCT00345943.

Reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder.

OBJECTIVE: The authors assessed the functioning of mesolimbic and striatal areas involved in reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder (OCD). METHOD: Functional MRI blood-oxygen-level-dependent response was compared in 33 unmedicated adults with OCD and 33 healthy, age-matched comparison subjects during a reward-based learning task that required learning to use extramaze cues to navigate a virtual eight-arm radial maze to find hidden rewards. The groups were compared in their patterns of brain activation associated with reward-based spatial learning versus a control condition in which rewards were unexpected because they were allotted pseudorandomly to experimentally prevent learning. RESULTS: Both groups learned to navigate the maze to find hidden rewards, but group differences in neural activity during navigation and reward processing were detected in mesolimbic and striatal areas. During navigation, the OCD group, unlike the healthy comparison group, exhibited activation in the left posterior hippocampus. Unlike healthy subjects, participants in the OCD group did not show activation in the left ventral putamen and amygdala when anticipating rewards or in the left hippocampus, amygdala, and ventral putamen when receiving unexpected rewards (control condition). Signal in these regions decreased relative to baseline during unexpected reward receipt among those in the OCD group, and the degree of activation was inversely associated with doubt/checking symptoms. CONCLUSIONS: Participants in the OCD group displayed abnormal recruitment of mesolimbic and ventral striatal circuitry during reward-based spatial learning. Whereas healthy comparison subjects exhibited activation in this circuitry in response to the violation of reward expectations, unmedicated OCD participants did not and instead over-relied on the posterior hippocampus during learning. Thus, dopaminergic innervation of reward circuitry may be altered, and future study of anterior/posterior hippocampal dysfunction in OCD is warranted.

Morphological features of the neonatal brain following exposure to regional anesthesia during labor and delivery.

INTRODUCTION: Recent animal and human epidemiological studies suggest that early childhood exposure to anesthesia may have adverse effects on brain development. As more than 50% of pregnant women in the United States and one-third in the United Kingdom receive regional anesthesia during labor and delivery, understanding the effects of perinatal anesthesia on postnatal brain development has important public health relevance. METHODS: We used high-resolution magnetic resonance imaging (MRI) to assess the effects of regional anesthesia during labor and delivery as part of a larger study of perinatal exposures on the morphological features of the neonatal brain. We mapped morphological features of the cortical surface in 37 healthy infants, 24 exposed and 13 unexposed to regional anesthesia at delivery, who were scanned within the first 6 weeks of life. RESULTS: Infants exposed to maternal anesthesia compared with unexposed infants had greater local volumes in portions of the frontal and occipital lobes bilaterally and right posterior portion of the cingulate gyrus. Longer durations of exposure to anesthesia correlated positively with local volumes in the occipital lobe. CONCLUSIONS: Anesthesia exposure during labor and delivery was associated with larger volumes in portions of the frontal and occipital lobes and cingulate gyrus in neonates. Longitudinal MRI studies are needed to determine whether these morphological effects of anesthesia persist and what their consequences on cognition and behavior may be.

Clinical Strategies for Integrating Medication Interventions Into Behavioral Treatment for Adolescent ADHD: The Medication Integration Protocol.

Attention-Deficit/Hyperactivity Disorder (ADHD) is highly prevalent among adolescents enrolled in behavioral health services but remains undertreated in this age group. Also the first-line treatment for adolescent ADHD, stimulant medication, is underutilized in routine practice. This article briefly describes three behavioral interventions designed to promote stronger integration of medication interventions into treatment planning for adolescent ADHD: family ADHD psychoeducation, family-based medication decision-making, and behavior therapist leadership in coordinating medication integration. It then introduces the Medication Integration Protocol (MIP), which incorporates all three interventions into a five-task protocol: ADHD Assessment and Medication Consult; ADHD Psychoeducation and Client Acceptance; ADHD Symptoms and Family Relations; ADHD Medication and Family Decision-Making; and Medication Management and Integration Planning. The article concludes by highlighting what behavior therapists should know about best practices for medication integration across diverse settings and populations: integrating medication interventions into primary care, managing medication priorities and polypharmacy issues for adolescents with multiple diagnoses, providing ADHD medications to adolescent substance users, and the compatibility of MIP intervention strategies with everyday practice conditions.

Neural correlates of reward-based spatial learning in persons with cocaine dependence.

Dysfunctional learning systems are thought to be central to the pathogenesis of and impair recovery from addictions. The functioning of the brain circuits for episodic memory or learning that support goal-directed behavior has not been studied previously in persons with cocaine dependence (CD). Thirteen abstinent CD and 13 healthy participants underwent MRI scanning while performing a task that requires the use of spatial cues to navigate a virtual-reality environment and find monetary rewards, allowing the functional assessment of the brain systems for spatial learning, a form of episodic memory. Whereas both groups performed similarly on the reward-based spatial learning task, we identified disturbances in brain regions involved in learning and reward in CD participants. In particular, CD was associated with impaired functioning of medial temporal lobe (MTL), a brain region that is crucial for spatial learning (and episodic memory) with concomitant recruitment of striatum (which normally participates in stimulus-response, or habit, learning), and prefrontal cortex. CD was also associated with enhanced sensitivity of the ventral striatum to unexpected rewards but not to expected rewards earned during spatial learning. We provide evidence that spatial learning in CD is characterized by disturbances in functioning of an MTL-based system for episodic memory and a striatum-based system for stimulus-response learning and reward. We have found additional abnormalities in distributed cortical regions. Consistent with findings from animal studies, we provide the first evidence in humans describing the disruptive effects of cocaine on the coordinated functioning of multiple neural systems for learning and memory.

Normal development of brain circuits.

Spanning functions from the simplest reflex arc to complex cognitive processes, neural circuits have diverse functional roles. In the cerebral cortex, functional domains such as visual processing, attention, memory, and cognitive control rely on the development of distinct yet interconnected sets of anatomically distributed cortical and subcortical regions. The developmental organization of these circuits is a remarkably complex process that is influenced by genetic predispositions, environmental events, and neuroplastic responses to experiential demand that modulates connectivity and communication among neurons, within individual brain regions and circuits, and across neural pathways. Recent advances in neuroimaging and computational neurobiology, together with traditional investigational approaches such as histological studies and cellular and molecular biology, have been invaluable in improving our understanding of these developmental processes in humans in both health and illness. To contextualize the developmental origins of a wide array of neuropsychiatric illnesses, this review describes the development and maturation of neural circuits from the first synapse through critical periods of vulnerability and opportunity to the emergent capacity for cognitive and behavioral regulation, and finally the dynamic interplay across levels of circuit organization and developmental epochs.

A virtual reality-based FMRI study of reward-based spatial learning.

Although temporo-parietal cortices mediate spatial navigation in animals and humans, the neural correlates of reward-based spatial learning are less well known. Twenty-five healthy adults performed a virtual reality fMRI task that required learning to use extra-maze cues to navigate an 8-arm radial maze and find hidden rewards. Searching the maze in the spatial learning condition compared to the control conditions was associated with activation of temporo-parietal regions, albeit not including the hippocampus. The receipt of rewards was associated with activation of the hippocampus in a control condition when using the extra-maze cues for navigation was rendered impossible by randomizing the spatial location of cues. Our novel experimental design allowed us to assess the differential contributions of the hippocampus and other temporo-parietal areas to searching and reward processing during reward-based spatial learning. This translational research will permit parallel studies in animals and humans to establish the functional similarity of learning systems across species; cellular and molecular studies in animals may then inform the effects of manipulations on these systems in humans, and fMRI studies in humans may inform the interpretation and relevance of findings in animals.