Pushing the boundaries of behavioral analysis could aid psychiatric drug discovery.

Drug discovery for psychiatric conditions is stagnating. Behavioral changes could be used as a primary phenotypic screen for new drug candidates, if enough useful data can be generated from behavioral models. Could machine learning be the answer to extracting the data we need?

Mice learn to avoid regret.

Regret can be defined as the subjective experience of recognizing that one has made a mistake and that a better alternative could have been selected. The experience of regret is thought to carry negative utility. This typically takes two distinct forms: augmenting immediate postregret valuations to make up for losses, and augmenting long-term changes in decision-making strategies to avoid future instances of regret altogether. While the short-term changes in valuation have been studied in human psychology, economics, neuroscience, and even recently in nonhuman-primate and rodent neurophysiology, the latter long-term process has received far less attention, with no reports of regret avoidance in nonhuman decision-making paradigms. We trained 31 mice in a novel variant of the Restaurant Row economic decision-making task, in which mice make decisions of whether to spend time from a limited budget to achieve food rewards of varying costs (delays). Importantly, we tested mice longitudinally for 70 consecutive days, during which the task provided their only source of food. Thus, decision strategies were interdependent across both trials and days. We separated principal commitment decisions from secondary reevaluation decisions across space and time and found evidence for regret-like behaviors following change-of-mind decisions that corrected prior economically disadvantageous choices. Immediately following change-of-mind events, subsequent decisions appeared to make up for lost effort by altering willingness to wait, decision speed, and pellet consumption speed, consistent with past reports of regret in rodents. As mice were exposed to an increasingly reward-scarce environment, we found they adapted and refined distinct economic decision-making strategies over the course of weeks to maximize reinforcement rate. However, we also found that even without changes in reinforcement rate, mice transitioned from an early strategy rooted in foraging to a strategy rooted in deliberation and planning that prevented future regret-inducing change-of-mind episodes from occurring. These data suggest that mice are learning to avoid future regret, independent of and separate from reinforcement rate maximization.

Altering gain of the infralimbic-to-accumbens shell circuit alters economically dissociable decision-making algorithms.

The nucleus accumbens shell (NAcSh) is involved in reward valuation. Excitatory projections from infralimbic cortex (IL) to NAcSh undergo synaptic remodeling in rodent models of addiction and enable the extinction of disadvantageous behaviors. However, how the strength of synaptic transmission of the IL-NAcSh circuit affects decision-making information processing and reward valuation remains unknown, particularly because these processes can conflict within a given trial and particularly given recent data suggesting that decisions arise from separable information-processing algorithms. The approach of many neuromodulation studies is to disrupt information flow during on-going behaviors; however, this limits the interpretation of endogenous encoding of computational processes. Furthermore, many studies are limited by the use of simple behavioral tests of value which are unable to dissociate neurally distinct decision-making algorithms. We optogenetically altered the strength of synaptic transmission between glutamatergic IL-NAcSh projections in mice trained on a neuroeconomic task capable of separating multiple valuation processes. We found that induction of long-term depression in these synapses produced lasting changes in foraging processes without disrupting deliberative processes. Mice displayed inflated reevaluations to stay when deciding whether to abandon continued reward-seeking investments but displayed no changes during initial commitment decisions. We also developed an ensemble-level measure of circuit-specific plasticity that revealed individual differences in foraging valuation tendencies. Our results demonstrate that alterations in projection-specific synaptic strength between the IL and the NAcSh are capable of augmenting self-control economic valuations within a particular decision-making modality and suggest that the valuation mechanisms for these multiple decision-making modalities arise from different circuits.

Beyond simple tests of value: measuring addiction as a heterogeneous disease of computation-specific valuation processes.

Addiction is considered to be a neurobiological disorder of learning and memory because addiction is capable of producing lasting changes in the brain. Recovering addicts chronically struggle with making poor decisions that ultimately lead to relapse, suggesting a view of addiction also as a neurobiological disorder of decision-making information processing. How the brain makes decisions depends on how decision-making processes access information stored as memories in the brain. Advancements in circuit-dissection tools and recent theories in neuroeconomics suggest that neurally dissociable valuation processes access distinct memories differently, and thus are uniquely susceptible as the brain changes during addiction. If addiction is to be considered a neurobiological disorder of memory, and thus decision-making, the heterogeneity with which information is both stored and processed must be taken into account in addiction studies. Addiction etiology can vary widely from person to person. We propose that addiction is not a single disease, nor simply a disorder of learning and memory, but rather a collection of symptoms of heterogeneous neurobiological diseases of distinct circuit-computation-specific decision-making processes.

Neonatal hyperglycemia induces CXCL10/CXCR3 signaling and microglial activation and impairs long-term synaptogenesis in the hippocampus and alters behavior in rats.

BACKGROUND: Hyperglycemia is common in extremely low gestational age newborns (ELGAN) and is associated with increased mortality and morbidity, including abnormal neurodevelopment. Hippocampus-mediated cognitive deficits are common in this population, but the specific effects of hyperglycemia on the developing hippocampus are not known. METHODS: The objective of this study was to determine the acute and long-term effects of hyperglycemia on the developing hippocampus in neonatal rats using a streptozotocin (STZ)-induced model of hyperglycemia. STZ was injected on postnatal day (P) 2, and littermates in the control group were injected with an equivalent volume of citrate buffer. The acute effects of hyperglycemia on markers of oxidative stress, inflammatory cytokines, microglial activation, and reactive astrocytosis in the hippocampus were determined in the brain tissue collected on P6. The long-term effects on hippocampus-mediated behavior and hippocampal dendrite structure were determined on P90. RESULTS: On P6, the transcript and protein expression of markers of oxidative stress and inflammatory cytokines, including the CXCL10/CXCR3 pathway, were upregulated in the hyperglycemia group. Histological evaluation revealed microglial activation and astrocytosis. The long-term assessment on P90 demonstrated abnormal performance in Barnes maze neurobehavioral testing and altered dendrite structure in the hippocampus of formerly hyperglycemic rats. CONCLUSIONS: Neonatal hyperglycemia induces CXCL10/CXCR3 signaling, microglial activation, and astrocytosis in the rat hippocampus and alters long-term synaptogenesis and behavior. These results may explain the hippocampus-specific cognitive deficits common in ELGAN who experience neonatal hyperglycemia.

Ketamine reverses stress-induced hypersensitivity to sunk costs.

How mood interacts with information processing in the brain is thought to mediate the maladaptive behaviors observed in depressed individuals. However, the neural mechanisms underlying impairments in emotion-cognition interactions are poorly understood. This includes influencing the balance between how past-sensitive vs. future-looking one is during decision-making. Recent insights from the field of neuroeconomics offer novel approaches to study changes in such valuation processes in a manner that is biologically tractable and readily translatable across species. We recently discovered that rodents are sensitive to "sunk costs" - a feature of higher cognition previously thought to be unique to humans. The sunk costs bias describes the phenomenon in which an individual overvalues and escalates commitment to continuing an ongoing endeavor, even if suboptimal, as a function of irrecoverable past (sunk) losses - information that, according to classic economic theory, should be ignored. In the present study, mice were exposed to chronic social defeat stress paradigm, a well-established animal model used for the study of depression. Mice were then tested on our longitudinal neuroeconomic foraging task, Restaurant Row. We found mice exposed to this severe stressor displayed an increased sensitivity to sunk costs, without altering overall willingness to wait. Mice were then randomly assigned to receive a single intraperitoneal injection of either saline or ketamine (20 mg/kg). We discovered that stress-induced hypersensitivity to sunk costs was renormalized following a single dose of ketamine. Interestingly, in non-defeated mice, ketamine treatment completely abolished sunk cost sensitivity, causing mice to no longer value irrecoverable losses during re-evaluation decisions who instead based choices solely on the future investment required to obtain a goal. These findings suggest that the antidepressant effects of ketamine may be mediated in part through changes in the processing of past-sensitive information during on-going decision-making, reducing its weight as a potential source of cognitive dissonance that could modulate behavior and instead promoting more future-thinking behavior.

A Double Hit of Social and Economic Stress in Mice Precipitates Changes in Decision-Making Strategies.

BACKGROUND: Economic stress can serve as a second hit for people who have already accumulated a history of adverse life experiences. How one recovers from a setback is a core feature of resilience but is seldom captured in animal studies. METHODS: We challenged mice in a novel 2-hit stress model by first exposing them to chronic social defeat stress and then testing adaptations to increasing reward scarcity on a neuroeconomic task. Mice were tested across months on the Restaurant Row task, during which they foraged daily for their primary source of food while on a limited time budget in a closed-economy system. An abrupt transition into a reward-scarce environment elicits an economic challenge, precipitating a drop in food intake and body weight to which mice must respond to survive. RESULTS: We found that mice with a history of social stress mounted a robust behavioral response to this economic challenge that was achieved through a complex redistribution of time allocation among competing opportunities. Interestingly, we found that mice with a history of social defeat displayed changes in the development of decision-making policies during the recovery process that are important not only for ensuring food security necessary for survival but also prioritizing subjective value and that these changes emerged only for certain types of choices. CONCLUSIONS: These findings indicate that an individual's capacity to recover from economic challenges depends on that person's prior history of stress and can affect multiple decision-making aspects of subjective well-being, thus highlighting a motivational balance that may be altered in stress-related disorders such as depression.

Diabetes alters neuroeconomically dissociable forms of mental accounting.

Those with diabetes mellitus are at high-risk of developing psychiatric disorders, yet the link between hyperglycemia and alterations in motivated behavior has not been explored in detail. We characterized value-based decision-making behavior of a streptozocin-induced diabetic mouse model on a naturalistic neuroeconomic foraging paradigm called Restaurant Row. Mice made self-paced choices while on a limited time-budget accepting or rejecting reward offers as a function of cost (delays cued by tone-pitch) and subjective value (flavors), tested daily in a closed-economy system across months. We found streptozocin-treated mice disproportionately undervalued less-preferred flavors and inverted their meal-consumption patterns shifted toward a more costly strategy that overprioritized high-value rewards. We discovered these foraging behaviors were driven by impairments in multiple decision-making systems, including the ability to deliberate when engaged in conflict and cache the value of the passage of time in the form of sunk costs. Surprisingly, diabetes-induced changes in behavior depended not only on the type of choice being made but also the salience of reward-scarcity in the environment. These findings suggest complex relationships between glycemic regulation and dissociable valuation algorithms underlying unique cognitive heuristics and sensitivity to opportunity costs can disrupt fundamentally distinct computational processes and could give rise to psychiatric vulnerabilities.

A quadruple dissociation of reward-related behaviour in mice across excitatory inputs to the nucleus accumbens shell.

The nucleus accumbens shell (NAcSh) is critically important for reward valuations, yet it remains unclear how valuation information is integrated in this region to drive behaviour during reinforcement learning. Using an optogenetic spatial self-stimulation task in mice, here we show that contingent activation of different excitatory inputs to the NAcSh change expression of different reward-related behaviours. Our data indicate that medial prefrontal inputs support place preference via repeated actions, ventral hippocampal inputs consistently promote place preferences, basolateral amygdala inputs produce modest place preferences but as a byproduct of increased sensitivity to time investments, and paraventricular inputs reduce place preferences yet do not produce full avoidance behaviour. These findings suggest that each excitatory input provides distinct information to the NAcSh, and we propose that this reflects the reinforcement of different credit assignment functions. Our finding of a quadruple dissociation of NAcSh input-specific behaviours provides insights into how types of information carried by distinct inputs to the NAcSh could be integrated to help drive reinforcement learning and situationally appropriate behavioural responses.

Postoperative mometasone irrigations improve quality of life in skull base tumor patients.

Objectives: The use of topical corticosteroids to manage postoperative sinonasal symptoms after endoscopic skull base surgery (ESBS) has not been well studied. We quantified long-term impact of postoperative steroid irrigations (SIs) on quality of life of patients after ESBS. Methods: Retrospective review of patients at the University of Pennsylvania undergoing ESBS from 2010 to 2019. Data on patient demographics and postoperative treatment with nasal saline irrigation twice daily with and without dissolved steroids (mometasone or budesonide) was collected. Preoperative, and 1-, 3-, 6-, 12-, 18-, and 24-month postoperative Sino-Nasal Outcome Test (SNOT-22) scores were assessed. Results: A total of 727 patients were assessed (53.4% males), with 479 patients in the no SI group and 248 patients in the SI group. Preoperative SNOT-22 scores did not differ significantly (P = 0.19). 1-, 3-, 6-, 12-, 18-, and 24-month post-op SNOT-22 scores did not significantly differ between groups. However, mometasone irrigations resulted in significantly lower postoperative 2-year SNOT-22 scores compared to budesonide (P < 0.01) and saline (P = 0.03). Conclusions: Though corticosteroid irrigations are routine in managing inflammatory sinus disease, their role in postoperative management after ESBS for tumors is unclear. Our findings suggest that mometasone irrigation may be effective at improving postoperative quality of life in patients after ESBS.

Sunk cost sensitivity during change-of-mind decisions is informed by both the spent and remaining costs.

Sunk cost sensitivity describes escalating decision commitment with increased spent resources. On neuroeconomic foraging tasks, mice, rats, and humans show similar escalations from sunk costs while quitting an ongoing countdown to reward. In a new analysis taken across computationally parallel foraging tasks across species and laboratories, we find that these behaviors primarily occur on choices that are economically inconsistent with the subject's other choices, and that they reflect not only the time spent, but also the time remaining, suggesting that these are change-of-mind re-evaluation processes. Using a recently proposed change-of-mind drift-diffusion model, we find that the sunk cost sensitivity in this model arises from decision-processes that directly take into account the time spent (costs sunk). Applying these new insights to experimental data, we find that sensitivity to sunk costs during re-evaluation decisions depends on the information provided to the subject about the time spent and the time remaining.

Distinct forms of regret linked to resilience versus susceptibility to stress are regulated by region-specific CREB function in mice.

Regret describes recognizing alternative actions could have led to better outcomes. It remains unclear whether regret derives from generalized mistake appraisal or instead comprises dissociable, action-specific processes. Using a neuroeconomic task, we found that mice were sensitive to fundamentally distinct types of regret following exposure to chronic social defeat stress or manipulations of CREB, a transcription factor implicated in stress action. Bias to make compensatory decisions after rejecting high-value offers (regret type I) was unique to stress-susceptible mice. Bias following the converse operation, accepting low-value offers (regret type II), was enhanced in stress-resilient mice and absent in stress-susceptible mice. CREB function in either the prefrontal cortex or nucleus accumbens was required to suppress regret type I but bidirectionally regulated regret type II. We provide insight into how maladaptive stress response traits relate to distinct forms of counterfactual thinking, which could steer therapy for mood disorders, such as depression, toward circuit-specific computations through a careful description of decision narrative.

Dynamic and heterogeneous neural ensembles contribute to a memory engram.

In the century since the notion of the 'engram' was first introduced to describe the physical manifestation of memory, new technologies for identifying cellular activity have enabled us to deepen our understanding of the possible physical substrate of memory. A number of studies have shown that memories are stored in a sparse population of neurons known as a neural ensemble or engram cells. While earlier investigations highlighted that the stability of neural ensembles underlies a memory representation, recent studies have found that neural ensembles are more dynamic and fluid than previously understood. Additionally, a number of studies have begun to dissect the cellular and molecular diversity of functionally distinct subpopulations of cells contained within an engram. We propose that ensemble fluidity and compositional heterogeneity support memory flexibility and functional diversity.

Differences in management outcome for first branchial cleft anomalies: A comparison of infants and toddlers to older children.

OBJECTIVE: First branchial cleft anomalies (FBCAs) are rare and often misdiagnosed, which can delay proper management and increase surgical risks. Complete excision often requires parotidectomy with facial nerve dissection. The literature reports that younger patients more often have lesions deep to the nerve with higher rates of nerve injury. We hypothesized that the rate of nerve injury and complications in children with FBCAs was not different in those ≤2 years of age compared to those >2 years of age. METHODS: Retrospective review of pediatric patients who underwent resection of histopathologically confirmed FBCAs between 2007 and 2017 at a tertiary care, pediatric hospital. Presenting symptoms, lesion classification, prior procedures, imaging techniques, extent of surgery performed, facial nerve position, and complications were reviewed and compared between patients ≤2 years of age and >2 years of age at time of surgery. RESULTS: 43 cases of FBCAs were included in the study: 12 in the younger group and 31 in the older group. There was no difference between groups regarding the presenting symptoms, gender breakdown, lesion classification, prior procedures performed, or extent of surgery. Lesions were more commonly deep to or running between branches of the facial nerve in the younger group (33.3% vs 9.7%, p = .0496). Rates of postoperative complications and facial nerve weakness were comparable between the younger and older groups (8.3% vs 25.8%, p = .206; 25.0% vs 16.1%, p = .503). In combining the age groups, FBCAs located deep to the facial nerve had increased risk of nerve weakness postoperatively (RR 7.2) and those with a history of prior incision and drainage or resection had increased risk of postoperative complications (RR 2.36). Imaging was obtained on all subjects with accuracy rates of 80-100%. CONCLUSION: Presenting characteristics of FBCAs in patients ≤2 years of age and >2 years of age are comparable, but lesions in younger subjects had a greater likelihood of being deep to or coursing between branches of the facial nerve. However, the rates of facial nerve injury and postoperative complications are comparable in younger and older children, owing likely to accurate preoperative imaging and appropriate surgical planning.

Prolonged abstinence from cocaine or morphine disrupts separable valuations during decision conflict.

Neuroeconomic theories propose changes in decision making drive relapse in recovering drug addicts, resulting in continued drug use despite stated wishes not to. Such conflict is thought to arise from multiple valuation systems dependent on separable neural components, yet many neurobiology of addiction studies employ only simple tests of value. Here, we tested in mice how prolonged abstinence from different drugs affects behavior in a neuroeconomic foraging task that reveals multiple tests of value. Abstinence from repeated cocaine and morphine disrupts separable decision-making processes. Cocaine alters deliberation-like behavior prior to choosing a preferred though economically unfavorable offer, while morphine disrupts re-evaluations after rapid initial decisions. These findings suggest that different drugs have long-lasting effects precipitating distinct decision-making vulnerabilities. Our approach can guide future refinement of decision-making behavioral paradigms and highlights how grossly similar behavioral maladaptations may mask multiple underlying, parallel, and dissociable processes that treatments for addiction could potentially target.

Sensitivity to "sunk costs" in mice, rats, and humans.

Sunk costs are irrecoverable investments that should not influence decisions, because decisions should be made on the basis of expected future consequences. Both human and nonhuman animals can show sensitivity to sunk costs, but reports from across species are inconsistent. In a temporal context, a sensitivity to sunk costs arises when an individual resists ending an activity, even if it seems unproductive, because of the time already invested. In two parallel foraging tasks that we designed, we found that mice, rats, and humans show similar sensitivities to sunk costs in their decision-making. Unexpectedly, sensitivity to time invested accrued only after an initial decision had been made. These findings suggest that sensitivity to temporal sunk costs lies in a vulnerability distinct from deliberation processes and that this distinction is present across species.

A modified beam-walking apparatus for assessment of anxiety in a rodent model of blast traumatic brain injury.

The elevated plus maze (EPM) is used to assess anxiety in rodents. Beam-walking tasks are used to assess vestibulomotor function. Brain injury in rodents can disrupt performance on both of these tasks. Developing novel paradigms that integrate tasks like these can reduce the need for multiple tests when attempting to assess multiple behaviors in the same animal. Using adult male rats, we evaluated the use of a modified beam-walking (MBW) apparatus as a surrogate indicator for anxiety. We used a model of blast-induced traumatic brain injury (bTBI). A total of 39 rats were assessed before and at 3, 6, 24, 72, and 168h either post- bTBI (n=33) or no-injury (n=6) using both EPM and MBW. A novel anxiety index was calculated that encompassed peeks and re-emergences on MBW. The proposed MBW anxiety index was compared with the standard anxiety index calculated from exploration into different sections of EPM. Post- bTBI, rats had an increased anxiety index when measured using EPM. Similarly, they peeked or fully emerged less out of the safe box on MBW. It was found that this novel MBW anxiety index captured similar aspects of behavior when compared to the standard anxiety index obtained from EPM. Further, these effects were dissociated from the effects of bTBI on motor function simultaneously measured on MBW. Over the course of 168h post-bTBI, rats gradually recovered on both EPM and MBW. The MBW apparatus succeeded at capturing and dissociating two separate facets of rat behavior, motor function and anxiety, simultaneously.

Comparisons between Garcia, Modo, and Longa rodent stroke scales: Optimizing resource allocation in rat models of focal middle cerebral artery occlusion.

The use of rodent stroke models allow for the understanding of stroke pathophysiology. There is currently no gold standard neurological assessment to measure deficits and recovery from stroke in rodent models. Agreement on a universal preclinical stroke scale allows for comparison of the outcomes among conducted studies. The present study aimed to compare three routinely used neurological assessments in rodent studies (i.e., Garcia, Modo, and Longa) to determine which is most effective for accurately and consistently quantifying neurological deficits in the context of focal middle cerebral artery occlusion (MCAo) in rats. Focal MCAo was induced in 22 male Wistar rats using a novel transfemoral approach. Rodents were assessed for neurological deficit pre-injury as well as 3 and 24h post-injury. Data was analyzed to determine Pearson correlation coefficients in addition to McNemar's χ(2) values between each pair of neurological assessments. All three stroke scales, Garcia, Modo, and Longa, showed statistically significant changes between the baseline and the 3-hour neurological assessments. A trend towards neurological recovery was observed in all three stroke scales between the 3 and 24-hour endpoints. The three scales were highly correlated with each other, with Garcia and Modo having the strongest correlation. Of the three pairwise analyses, the comparison between the Garcia and Longa tests demonstrated the highest McNemar's χ(2) value, indicating least marginal homogeneity between these two tests. The combination of high correlation between Garcia and Modo tests along with greatest marginal heterogeneity observed between the Garcia and Longa test lead us to recommend the use of Garcia and Longa neurological scales when researchers are hoping to capture the broadest range of neurological factors using only two stroke scales.