Sunk cost sensitivity during change-of-mind decisions is informed by both the spent and remaining costs.

Sunk cost sensitivity describes escalating decision commitment with increased spent resources. On neuroeconomic foraging tasks, mice, rats, and humans show similar escalations from sunk costs while quitting an ongoing countdown to reward. In a new analysis taken across computationally parallel foraging tasks across species and laboratories, we find that these behaviors primarily occur on choices that are economically inconsistent with the subject's other choices, and that they reflect not only the time spent, but also the time remaining, suggesting that these are change-of-mind re-evaluation processes. Using a recently proposed change-of-mind drift-diffusion model, we find that the sunk cost sensitivity in this model arises from decision-processes that directly take into account the time spent (costs sunk). Applying these new insights to experimental data, we find that sensitivity to sunk costs during re-evaluation decisions depends on the information provided to the subject about the time spent and the time remaining.

Disrupting the medial prefrontal cortex with designer receptors exclusively activated by designer drug alters hippocampal sharp-wave ripples and their associated cognitive processes.

The hippocampus and medial prefrontal cortex (mPFC) interact during a myriad of cognitive processes including decision-making and long-term memory consolidation. Exactly how the mPFC and hippocampus interact during goal-directed decision-making remains to be fully elucidated. During periods of rest, bursts of high-frequency oscillations, termed sharp-wave ripple (SWR), appear in the local field potential. Impairing SWRs on the maze or during post-learning rest can interfere with memory-guided decision-making and memory consolidation. We hypothesize that the hippocampus and mPFC bidirectionally interact during SWRs to support memory consolidation and decision-making. Rats were trained on the neuroeconomic spatial decision-making task, Restaurant Row, to make serial stay-skip decisions where the amount of effort (delay to reward) varied upon entry to each restaurant. Hippocampal cells and SWRs were recorded in rats with the mPFC transduced with inhibitory DREADDs. We found that disrupting the mPFC impaired consolidating SWRs in the hippocampus. Hippocampal SWR rates depended on the internalized value of the reward (derived from individual flavor preferences), a parameter important in decision-making, and disrupting the mPFC changed this relationship. Additionally, we found a dissociation between SWRs that occurred while rats were on the maze dependent upon whether those SWRs occurred while the rat was anticipating food reward or during post-reward consumption.

Certainty and uncertainty of the future changes planning and sunk costs.

Many foraging experiments have found that subjects are suboptimal in foraging tasks, waiting out delays longer than they should given the reward structure of the environment. Additionally, theories of decision-making suggest that actions arise from interactions between multiple decision-making systems and that these systems should depend on the availability of information about the future. To explore suboptimal behavior on foraging tasks and how varying the amount of future information changed behavior, we ran rats on two matching neuroeconomic foraging tasks, Known Delay (KD) and Randomized Delay (RD), with the only difference between them being the certainty of the cost of future opportunities. Rats' decision-making strategies differed significantly based on the amount of future certainty. Rats on both tasks still showed suboptimality in decision-making through a sensitivity to sunk costs; however, rats on KD showed significantly less sensitivity to sunk costs than rats on RD. Additionally, on neither task did the rats account for travel and postreward lingering times as heavily as prereward foraging times providing evidence problematic for the Marginal Value Theorem model of foraging behavior. This suggests that while future certainty reduced decision-making errors, more complex decision-making processes unaffected by future certainty were involved and likely produced these decision-making errors within subjects on these foraging tasks. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Disrupting the medial prefrontal cortex alters hippocampal sequences during deliberative decision making.

Current theories of deliberative decision making suggest that deliberative decisions arise from imagined simulations that require interactions between the prefrontal cortex and hippocampus. In rodent navigation experiments, hippocampal theta sequences advance from the location of the rat ahead to the subsequent goal. To examine the role of the medial prefrontal cortex (mPFC) on the hippocampus, we disrupted the mPFC with DREADDs (designer receptors exclusively activated by designer drugs). Using the Restaurant Row foraging task, we found that mPFC disruption resulted in decreased vicarious trial and error behavior, reduced the number of theta sequences, and impaired theta sequences in hippocampus. mPFC disruption led to larger changes in the initiation of the hippocampal theta sequences that represent the current location of the rat rather than to the later portions that represent the future outcomes. These data suggest that the mPFC likely provides an important component to the initiation of deliberative sequences and provides support for an episodic-future thinking, working memory interpretation of deliberation. NEW & NOTEWORTHY The medial prefrontal cortex (mPFC) and hippocampus interact during deliberative decision making. Disruption of the mPFC impaired hippocampal processes, including the local and nonlocal representations of space along each theta cycle and the initiation of hippocampal theta sequences, while sparing place cell firing characteristics and phase precession. mPFC disruption reduced the deliberative behavioral process vicarious trial and error and improved economic behaviors on this task.

Sensitivity to "sunk costs" in mice, rats, and humans.

Sunk costs are irrecoverable investments that should not influence decisions, because decisions should be made on the basis of expected future consequences. Both human and nonhuman animals can show sensitivity to sunk costs, but reports from across species are inconsistent. In a temporal context, a sensitivity to sunk costs arises when an individual resists ending an activity, even if it seems unproductive, because of the time already invested. In two parallel foraging tasks that we designed, we found that mice, rats, and humans show similar sensitivities to sunk costs in their decision-making. Unexpectedly, sensitivity to time invested accrued only after an initial decision had been made. These findings suggest that sensitivity to temporal sunk costs lies in a vulnerability distinct from deliberation processes and that this distinction is present across species.

The Web-Surf Task: A translational model of human decision-making.

Animal models of decision-making are some of the most highly regarded psychological process models; however, there remains a disconnection between how these models are used for pre-clinical applications and the resulting treatment outcomes. This may be due to untested assumptions that different species recruit the same neural or psychological mechanisms. We propose a novel human foraging paradigm (Web-Surf Task) that we translated from a rat foraging paradigm (Restaurant Row) to evaluate cross-species decision-making similarities. We examined behavioral parallels in human and non-human animals using the respective tasks. We also compared two variants of the human task, one using videos and the other using photos as rewards, by correlating revealed and stated preferences. We demonstrate similarities in choice behaviors and decision reaction times in human and rat subjects. Findings also indicate that videos yielded more reliable and valid results. The joint use of the Web-Surf Task and Restaurant Row is therefore a promising approach for functional translational research, aiming to bridge pre-clinical and clinical lines of research using analogous tasks.

Age-related decrease in theta and gamma coherence across dorsal ca1 pyramidale and radiatum layers.

In both humans and rodents, aging is linked to impairments in hippocampus dependent learning. Given such deficits, one would expect corresponding changes in hippocampal local field potentials, which represent the integration of multiple inputs onto a given dendritic field within the hippocampus. The current experiment examined coherence of theta and gamma in young and aged rats at sub-millimeter and millimeter distant locations both within and across layers in CA1 of the dorsal hippocampus. The degree to which different dendritic layers show coherent oscillations indicates the uniformity of the inputs and local circuitry, and may form an important element for processing information. Aged rats had lower coherence in all frequency ranges; this was most marked within a layer as the distance between electrodes increased. Notably, unlike younger rats, in the aged rats coherence was not affected by running on the maze. Furthermore, despite the previously reported effects of cholinergic activation on theta frequency and power, there was no effect of the cholinomimetic physostigmine on coherence. These data indicate an age related fragmentation in hippocampal processing that may underlie some of the observed learning and memory deficits.

Dissociation between dorsal and ventral hippocampal theta oscillations during decision-making.

Hippocampal theta oscillations are postulated to support mnemonic processes in humans and rodents. Theta oscillations facilitate encoding and spatial navigation, but to date, it has been difficult to dissociate the effects of volitional movement from the cognitive demands of a task. Therefore, we examined whether volitional movement or cognitive demands exerted a greater modulating factor over theta oscillations during decision-making. Given the anatomical, electrophysiological, and functional dissociations along the dorsal-ventral axis, theta oscillations were simultaneously recorded in the dorsal and ventral hippocampus in rats trained to switch between place and motor-response strategies. Stark differences in theta characteristics were found between the dorsal and ventral hippocampus in frequency, power, and coherence. Theta power increased in the dorsal, but decreased in the ventral hippocampus, during the decision-making epoch. Interestingly, the relationship between running speed and theta power was uncoupled during the decision-making epoch, a phenomenon limited to the dorsal hippocampus. Theta frequency increased in both the dorsal and ventral hippocampus during the decision epoch, although this effect was greater in the dorsal hippocampus. Despite these differences, ventral hippocampal theta was responsive to the navigation task; theta frequency, power, and coherence were all affected by cognitive demands. Theta coherence increased within the dorsal hippocampus during the decision-making epoch on all three tasks. However, coherence selectively increased throughout the hippocampus (dorsal to ventral) on the task with new hippocampal learning. Interestingly, most results were consistent across tasks, regardless of hippocampal-dependent learning. These data indicate increased integration and cooperation throughout the hippocampus during information processing.

Conflict between place and response navigation strategies: effects on vicarious trial and error (VTE) behaviors.

Navigation can be accomplished through multiple decision-making strategies, using different information-processing computations. A well-studied dichotomy in these decision-making strategies compares hippocampal-dependent "place" and dorsal-lateral striatal-dependent "response" strategies. A place strategy depends on the ability to flexibly respond to environmental cues, while a response strategy depends on the ability to quickly recognize and react to situations with well-learned action-outcome relationships. When rats reach decision points, they sometimes pause and orient toward the potential routes of travel, a process termed vicarious trial and error (VTE). VTE co-occurs with neurophysiological information processing, including sweeps of representation ahead of the animal in the hippocampus and transient representations of reward in the ventral striatum and orbitofrontal cortex. To examine the relationship between VTE and the place/response strategy dichotomy, we analyzed data in which rats were cued to switch between place and response strategies on a plus maze. The configuration of the maze allowed for place and response strategies to work competitively or cooperatively. Animals showed increased VTE on trials entailing competition between navigational systems, linking VTE with deliberative decision-making. Even in a well-learned task, VTE was preferentially exhibited when a spatial selection was required, further linking VTE behavior with decision-making associated with hippocampal processing.

Hippocampal theta, gamma, and theta-gamma coupling: effects of aging, environmental change, and cholinergic activation.

Hippocampal theta and gamma oscillations coordinate the timing of multiple inputs to hippocampal neurons and have been linked to information processing and the dynamics of encoding and retrieval. One major influence on hippocampal rhythmicity is from cholinergic afferents. In both humans and rodents, aging is linked to impairments in hippocampus-dependent function along with degradation of cholinergic function. Cholinomimetics can reverse some age-related memory impairments and modulate oscillations in the hippocampus. Therefore, one would expect corresponding changes in these oscillations and possible rescue with the cholinomimetic physostigmine. Hippocampal activity was recorded while animals explored a familiar or a novel maze configuration. Reexposure to a familiar situation resulted in minimal aging effects or changes in theta or gamma oscillations. In contrast, exploration of a novel maze configuration increased theta power; this was greater in adult than old animals, although the deficit was reversed with physostigmine. In contrast to the theta results, the effects of novelty, age, and/or physostigmine on gamma were relatively weak. Unrelated to the behavioral situation were an age-related decrease in the degree of theta-gamma coupling and the fact that physostigmine lowered the frequency of theta in both adult and old animals. The results indicate that age-related changes in gamma and theta modulation of gamma, while reflecting aging changes in hippocampal circuitry, seem less related to aging changes in information processing. In contrast, the data support a role for theta and the cholinergic system in encoding and that hippocampal aging is related to impaired encoding of new information.

Cognitive demands induce selective hippocampal reorganization: Arc expression in a place and response task.

Place cells in the hippocampus can maintain multiple representations of a single environment and respond to physical and/or trajectory changes by remapping. Within the hippocampus there are anatomical, electrophysiological, and behavioral dissociations between the dorsal and ventral hippocampus and within dorsal CA1. Arc expression was used to measure the recruitment of ensembles across different hippocampal subregions in rats trained to utilize two different cognitive strategies while traversing an identical trajectory. This behavioral paradigm allowed for the measurement of remapping in the absence of changes in external cues, trajectory traversed (future/past), running speed, motivation, or different stages of learning. Changes in task demands induced remapping in only some hippocampal regions: reorganization of cell ensembles was observed in dorsal CA1 but not in dorsal CA3. Moreover, a gradient was found in the degree of remapping within dorsal CA1 that corresponds to entorhinal connectivity to this region. Remapping was not seen in the ventral hippocampus: neither ventral CA1 nor CA3 exhibited ensemble changes with different cognitive demands. This contrasts with findings of remapping in both the dorsal and ventral dentate gyrus using this task. The results suggest that the dorsal pole of the hippocampus is more sensitive to changes in task demands.

Disambiguating the similar: the dentate gyrus and pattern separation.

The human hippocampus supports the formation of episodic memory without confusing new memories with old ones. To accomplish this, the brain must disambiguate memories (i.e., accentuate the differences between experiences). There is convergent evidence linking pattern separation to the dentate gyrus. Damage to the dentate gyrus reduces an organism's ability to differentiate between similar objects. The dentate gyrus has tenfold more principle cells than its cortical input, allowing for a divergence in information flow. Dentate gyrus granule neurons also show a very different pattern of representing the environment than "classic" place cells in CA1 and CA3, or grid cells in the entorhinal cortex. More recently immediate early genes have been used to "timestamp" activity of individual cells throughout the dentate gyrus. These data indicate that the dentate gyrus robustly differentiates similar situations. The degree of differentiation is non-linear, with even small changes in input inducing a near maximal response in the dentate. Furthermore this differentiation occurs throughout the dentate gyrus longitudinal (dorsal-ventral) axis. Conversely, the data point to a divergence in information processing between the dentate gyrus suprapyramidal and infrapyramidal blades possibly related to differences in organization within these regions. The accumulated evidence from different approaches converges to support a role for the dentate gyrus in pattern separation. There are however inconsistencies that may require incorporation of neurogenesis and hippocampal microcircuits into the currents models. They also suggest different roles for the dentate gyrus suprapyramidal and infrapyramidal blades, and the responsiveness of CA3 to dentate input.

Changes in task demands alter the pattern of zif268 expression in the dentate gyrus.

Granule cells of the dentate gyrus (DG) are thought to disambiguate similar experiences--a process termed pattern separation. Using zif268 as a marker of cellular activity, DG function was assessed in rats performing two tasks: a place task (go east) and a response task (turn right). As these tasks occurred within the same physical space (a plus maze) without any physical cue to indicate the correct strategy in a given trial, this scenario critically involves disambiguation of task demands and presumably pattern separation. Performance of the two tasks induced zif268 expression in distinct populations of granule cells within the suprapyramidal but not the infrapyramidal blade of the DG. Repeated performance of the same task (i.e., two response-task trials or two place-task trials), however, elicited zif268 expression within a single subset of the granule cell population. This differential transcription pattern shows that the retrieval of different behavioral strategies or mnemonic demands recruit distinct ensembles of granule cells, possibly to prevent interference between memories of events occurring within the same physical space to permit the selection of appropriate responses.

Hippocampal and striatal dependent navigation: sex differences are limited to acquisition.

Estrogen has been demonstrated to enhance the use of hippocampal-based place learning while reducing the use of striatal-based motor-response strategy (Korol, D.L., Malin, E.L., Borden, K.A., Busby, R.A., & Couper-Leo, J. (2004). Shifts in preferred learning strategy across the estrous cycle in female rats. Horm. Behav. 45, 330-338). Previous research has focused on task acquisition and the switch from a place to motor-response navigation with training. The current paradigm allowed an examination of the interplay between these two systems by having well-trained animals switch strategies "on demand." Female and male Sprague-Dawley rats were taught a motor-response task on a plus maze. The rats were then introduced to a place task and taught to switch, by cue, from the motor-response to place strategy. Finally, the rats were trained to continuously alternate between place and motor-responses strategies. The maze configuration allowed for an analysis of cooperative choices (both strategies result in the same goal arm), competitive choices (both strategies result in different goal arms), and single strategy choices (can only use the motor-response strategy). The results indicate that sex and estrogen-related effects on navigation strategy are limited to the initial stages of learning a task. The role of sex and estrogen is diminished once the task is well learned, and presumably, the relative involvement of the hippocampal and striatal systems is established.