Flexible decision-making is related to strategy learning, vicarious trial and error, and medial prefrontal rhythms during spatial set-shifting.

Flexible decision-making requires a balance between exploring features of an environment and exploiting prior knowledge. Behavioral flexibility is typically measured by how long it takes subjects to consistently make accurate choices after reward contingencies switch or task rules change. This measure, however, only allows for tracking flexibility across multiple trials, and does not assess the degree of flexibility. Plus, although increases in decision-making accuracy are strong indicators of learning, other decision-making behaviors have also been suggested as markers of flexibility, such as the on-the-fly decision reversals known as vicarious trial and error (VTE) or switches to a different, but incorrect, strategy. We sought to relate flexibility, learning, and neural activity by comparing choice history-derived evaluation of strategy use with changes in decision-making accuracy and VTE behavior while recording from the medial prefrontal cortex (mPFC) in rats. Using a set-shifting task that required rats to repeatedly switch between spatial decision-making strategies, we show that a previously developed strategy likelihood estimation procedure could identify putative learning points based on decision history. We confirm the efficacy of learning point estimation by showing increases in decision-making accuracy aligned to the learning point. Additionally, we show increases in the rate of VTE behavior surrounding identified learning points. By calculating changes in strategy likelihoods across trials, we tracked flexibility on a trial-by-trial basis and show that flexibility scores also increased around learning points. Further, we demonstrate that VTE behaviors could be separated into indecisive and deliberative subtypes depending on whether they occurred during periods of high or low flexibility and whether they led to correct or incorrect choice outcomes. Field potential recordings from the mPFC during decisions exhibited increased beta band activity on trials with VTE compared to non-VTE trials, as well as increased gamma during periods when learned strategies could be exploited compared to prelearning, exploratory periods. This study demonstrates that increased behavioral flexibility and VTE rates are often aligned to task learning. These relationships can break down, however, suggesting that VTE is not always an indicator of deliberative decision-making. Additionally, we further implicate the mPFC in decision-making and learning by showing increased beta-based activity on VTE trials and increased gamma after learning.

A Machine Learning Approach for Detecting Vicarious Trial and Error Behaviors.

Vicarious trial and error behaviors (VTEs) indicate periods of indecision during decision-making, and have been proposed as a behavioral marker of deliberation. In order to understand the neural underpinnings of these putative bridges between behavior and neural dynamics, researchers need the ability to readily distinguish VTEs from non-VTEs. Here we utilize a small set of trajectory-based features and standard machine learning classifiers to identify VTEs from non-VTEs for rats performing a spatial delayed alternation task (SDA) on an elevated plus maze. We also show that previously reported features of the hippocampal field potential oscillation can be used in the same types of classifiers to separate VTEs from non-VTEs with above chance performance. However, we caution that the modest classifier success using hippocampal population dynamics does not identify many trials where VTEs occur, and show that combining oscillation-based features with trajectory-based features does not improve classifier performance compared to trajectory-based features alone. Overall, we propose a standard set of features useful for trajectory-based VTE classification in binary decision tasks, and support previous suggestions that VTEs are supported by a network including, but likely extending beyond, the hippocampus.

A selective role for the mPFC during choice and deliberation, but not spatial memory retention over short delays.

Important interactions between memory and decision-making processes are required to maintain high-levels of spatial working memory task performance. Past research reveals that the medial prefrontal cortex (mPFC) and hippocampus (HPC) are both vital structures involved in these processes. Recent evidence suggests that interactions between these two structures are dynamic and task dependent. However, there exists uncertainty surrounding the specific conditions that recruit mPFC contributions to these tasks, specifically regarding its role in retaining information online during delay periods. To address this issue, we tested rats on a spatial-delayed alternation task in which we utilized a closed-loop optogenetic system to transiently disrupt mPFC activity during different task epochs (delay, choice, return). By analyzing the effects of mPFC disruption on choice accuracy and a deliberative behavior known as vicarious-trial-and-error (VTE), our study revealed several interesting findings regarding the role of the mPFC in spatial-working memory tasks. The main findings include: (a) choice accuracy in the spatial-delayed alternation (SDA) task was impaired when the mPFC was disrupted during the choice epoch and not delay or return epochs, (b) mPFC disruption resulted in a non-epoch specific reduction in VTE occurrence which correlated with impairments in task performance. Taken together, findings from this study suggest that, during spatial decision-making, contributions made by the mPFC are specific to points of deliberation and choice (not delay), and that VTEs are a deliberative behavior which relies on intact mPFC function.

Using Head-Mounted Ethanol Sensors to Monitor Olfactory Information and Determine Behavioral Changes Associated with Ethanol-Plume Contact during Mouse Odor-Guided Navigation.

Olfaction guides navigation and decision-making in organisms from multiple animal phyla. Understanding how animals use olfactory cues to guide navigation is a complicated problem for two main reasons. First, the sensory cues used to guide animals to the source of an odor consist of volatile molecules, which form plumes. These plumes are governed by turbulent air currents, resulting in an intermittent and spatiotemporally varying olfactory signal. A second problem is that the technologies for chemical quantification are cumbersome and cannot be used to detect what the freely moving animal senses in real time. Understanding how the olfactory system guides this behavior requires knowing the sensory cues and the accompanying brain signals during navigation. Here, we present a method for real-time monitoring of olfactory information using low-cost, lightweight sensors that robustly detect common solvent molecules, like alcohols, and can be easily mounted on the heads of freely behaving mice engaged in odor-guided navigation. To establish the accuracy and temporal response properties of these sensors we compared their responses with those of a photoionization detector (PID) to precisely controlled ethanol stimuli. Ethanol-sensor recordings, deconvolved using a difference-of-exponentials kernel, showed robust correlations with the PID signal at behaviorally relevant time, frequency, and spatial scales. Additionally, calcium imaging of odor responses from the olfactory bulbs (OBs) of awake, head-fixed mice showed strong correlations with ethanol plume contacts detected by these sensors. Finally, freely behaving mice engaged in odor-guided navigation showed robust behavioral changes such as speed reduction that corresponded to ethanol plume contacts.