5-HT 2A and 5-HT 2C receptor antagonism differentially modulate reinforcement learning and cognitive flexibility: behavioural and computational evidence.

RATIONALE: Cognitive flexibility, the ability to adapt behaviour in response to a changing environment, is disrupted in several neuropsychiatric disorders, including obsessive-compulsive disorder and major depressive disorder. Evidence suggests that flexibility, which can be operationalised using reversal learning tasks, is modulated by serotonergic transmission. However, how exactly flexible behaviour and associated reinforcement learning (RL) processes are modulated by 5-HT action on specific receptors is unknown. OBJECTIVES: We investigated the effects of 5-HT2A receptor (5-HT2AR) and 5-HT2C receptor (5-HT2CR) antagonism on flexibility and underlying RL mechanisms. METHODS: Thirty-six male Lister hooded rats were trained on a touchscreen visual discrimination and reversal task. We evaluated the effects of systemic treatments with the 5-HT2AR and 5-HT2CR antagonists M100907 and SB-242084, respectively, on reversal learning and performance on probe trials where correct and incorrect stimuli were presented with a third, probabilistically rewarded, stimulus. Computational models were fitted to task choice data to extract RL parameters, including a novel model designed specifically for this task. RESULTS: 5-HT2AR antagonism impaired reversal learning only after an initial perseverative phase, during a period of random choice and then new learning. 5-HT2CR antagonism, on the other hand, impaired learning from positive feedback. RL models further differentiated these effects. 5-HT2AR antagonism decreased punishment learning rate (i.e. negative feedback) at high and low doses. The low dose also decreased reinforcement sensitivity (beta) and increased stimulus and side stickiness (i.e., the tendency to repeat a choice regardless of outcome). 5-HT2CR antagonism also decreased beta, but reduced side stickiness. CONCLUSIONS: These data indicate that 5-HT2A and 5-HT2CRs both modulate different aspects of flexibility, with 5-HT2ARs modulating learning from negative feedback as measured using RL parameters and 5-HT2CRs for learning from positive feedback assessed through conventional measures.

Threat history controls flexible escape behavior in mice.

In many instances, external sensory-evoked neuronal activity is used by the brain to select the most appropriate behavioral response. Predator-avoidance behaviors such as freezing and escape1,2 are of particular interest since these stimulus-evoked responses are behavioral manifestations of a decision-making process that is fundamental to survival.3,4 Over the lifespan of an individual, however, the threat value of agents in the environment is believed to undergo constant revision,5 and in some cases, repeated avoidance of certain stimuli may no longer be an optimal behavioral strategy.6 To begin to study this type of adaptive control of decision-making, we devised an experimental paradigm to probe the properties of threat escape in the laboratory mouse Mus musculus. First, we found that while robust escape to visual looming stimuli can be observed after 2 days of social isolation, mice can also rapidly learn that such stimuli are non-threatening. This learned suppression of escape (LSE) is extremely robust and can persist for weeks and is not a generalized adaptation, since flight responses to novel live prey and auditory threat stimuli in the same environmental context were maintained. We also show that LSE cannot be explained by trial number or a simple form of stimulus desensitization since it is dependent on threat-escape history. We propose that the action selection process mediating escape behavior is constantly updated by recent threat history and that LSE can be used as a robust model system to understand the neurophysiological mechanisms underlying experience-dependent decision-making.

Mice learn multi-step routes by memorizing subgoal locations.

The behavioral strategies that mammals use to learn multi-step routes are unknown. In this study, we investigated how mice navigate to shelter in response to threats when the direct path is blocked. Initially, they fled toward the shelter and negotiated obstacles using sensory cues. Within 20 min, they spontaneously adopted a subgoal strategy, initiating escapes by running directly to the obstacle's edge. Mice continued to escape in this manner even after the obstacle had been removed, indicating use of spatial memory. However, standard models of spatial learning-habitual movement repetition and internal map building-did not explain how subgoal memories formed. Instead, mice used a hybrid approach: memorizing salient locations encountered during spontaneous 'practice runs' to the shelter. This strategy was also used during a geometrically identical food-seeking task. These results suggest that subgoal memorization is a fundamental strategy by which rodents learn efficient multi-step routes in new environments.