ABSTRACT
The ventromedial striatum (VMS) is a node in circuits underpinning both affect and reinforcement learning. The cellular bases of these functions and especially their potential linkages have been unclear. VMS cholinergic interneurons, however, have been singled out as being related both to affect and to reinforcement-based conditioning, raising the possibility that unique aspects of their signaling could account for these functions. Here we show that VMS tonically active neurons (TANs), including putative cholinergic interneurons, generate unique bidirectional outcome responses during reward-based learning, reporting both positive (reward) and negative (reward omission) outcomes when behavioral change is prompted by switches in reinforcement contingencies. VMS output neurons (SPNs), by contrast, are nearly insensitive to switches in reinforcement contingencies, gradually losing outcome signaling while maintaining responses at trial initiation and goal approach. Thus, TANs and SPNs in the VMS provide distinct signals optimized for different aspects of the learning process.
Subject(s)
Basal Ganglia/physiology , Cholinergic Neurons/physiology , Learning/physiology , Neurons/physiology , Reinforcement, Psychology , Action Potentials/physiology , Animals , Basal Ganglia/cytology , Maze Learning/physiology , Rats , Rats, Long-Evans , RewardABSTRACT
Rhythmic brain activity is thought to reflect, and to help organize, spike activity in populations of neurons during on-going behavior. We report that during learning, a major transition occurs in task-related oscillatory activity in the ventromedial striatum, a striatal region related to motivation-dependent learning. Early on as rats learned a T-maze task, bursts of 70- to 90-Hz high-γ activity were prominent during T-maze runs, but these gradually receded as bursts of 15- to 28-Hz ß-band activity became pronounced. Populations of simultaneously recorded neurons synchronized their spike firing similarly during both the high-γ-band and ß-band bursts. Thus, the structure of spike firing was reorganized during learning in relation to different rhythms. Spiking was concentrated around the troughs of the ß-oscillations for fast-spiking interneurons and around the peaks for projection neurons, indicating alternating periods of firing at different frequencies as learning progressed. Spike-field synchrony was primarily local during high-γ-bursts but was widespread during ß-bursts. The learning-related shift in the probability of high-γ and ß-bursting thus could reflect a transition from a mainly focal rhythmic inhibition during early phases of learning to a more distributed mode of rhythmic inhibition as learning continues and behavior becomes habitual. These dynamics could underlie changing functions of the ventromedial striatum during habit formation. More generally, our findings suggest that coordinated changes in the spatiotemporal relationships of local field potential oscillations and spike activity could be hallmarks of the learning process.