Active and passive waiting in impulsive choice: Effects of fixed-interval and fixed-time delays.

Behavioral interventions to improve self-control, preference for a larger-later (LL) reward over a smaller-sooner (SS) reward, involve experience with delayed rewards. Whether they involve timing processes remains controversial. In rats, there have been inconsistent results on whether timing processes may be involved in intervention-induced improvements in self-control. Interventions that improved self-control with corresponding timing improvements used fixed-interval (FI) delays, whereas interventions that failed to find corresponding timing improvements used fixed-time (FT) delays. The FI schedule includes a response contingency (active waiting), whereas the FT schedule delivers reward automatically (passive waiting). The present study compared the effects of FI and FT schedules in interventions and impulsive choice tasks to evaluate effects on self-control and timing behavior. The impulsive choice task evaluated preference for an SS option (one pellet after 10-, 15-, 20-, 25-, and 30-s delays) versus an LL option (two pellets after a 30-s delay). The intervention task included forced-choice SS (one pellet after 10 s) and LL (two pellets after 30 s) sessions under FI or FT schedules. FI schedules produced greater sensitivity to SS delay in the impulsive choice task. Both FI and FT interventions increased LL choices. Following choice testing, temporal bisection and peak interval tasks revealed better timing precision for rats with an FI delay experience. Overall, the FI choice contingency was associated with improved temporal attention and timing precision.

Effects of the estrous cycle on impulsive choice and interval timing in female rats.

Research in humans and animals shows differences in impulsive choice, which is a failure to wait for larger, delayed rewards, when comparing males and females. It is possible that fluctuations in sex hormones (estradiol and progesterone) across the reproductive cycle contribute to sex differences in impulsive choice. The current study delivered an impulsive choice task with peak interval trials to female rats while estrous cycles, the rodent reproductive cycle, were tracked over the course of the task. Female rats were more sensitive to changes in delay in the proestrus phase of the estrous cycle and made more larger-later choices when in estrus, particularly when the delay to the smaller reward was short. Estradiol increases dramatically during proestrus while progesterone peaks during estrus, suggesting that estradiol and progesterone may affect impulsive choice through mechanisms such as delay discounting, delay aversion, and/or timing processes. Analyses of timing of the choice task delays showed inconsistent effects of the estrous cycle across delays, suggesting that reward-timing interactions may have complicated how hormone fluctuations affected interval timing. Further research is needed to determine the mechanism underlying increased larger-later choices during the estrus phase, increased delay sensitivity during the proestrus phase, and variability in interval timing across delays and estrous cycle stages.

Effects of methylphenidate on impulsive choice and delay aversion in Lewis rats.

Attention-deficit/hyperactivity disorder (ADHD), a common behavioral disorder in children and young adults, is characterized by symptoms of impulsivity, inattention, and hyperactivity. The purpose of this study was to evaluate the Lewis rat strain as a model of ADHD by testing their impulsive choices. Lewis rats were compared to their source strain, the Wistar rat, on an impulsive choice task. Rats completed the tasks on and off methylphenidate, a commonly prescribed medication for ADHD. Off methylphenidate, Lewis rats made more impulsive choices than Wistar rats. Analyses of acquisition of choice behavior suggested that both strains were able to discriminate reward sizes, but Lewis rats still chose the smaller-sooner option more than the larger-later (LL) option when the delays to reward were the same. This may be due to an aversion to the LL lever, which was associated with the longest delays to reward. Higher doses of methylphenidate increased LL choices in Lewis rats but decreased LL choices in Wistar rats. Altogether, these results suggest Lewis rats may be a viable model for ADHD in individuals whose symptoms are characterized by impulsive choices.

Mechanisms of impulsive choice: Experiments to explore and models to map the empirical terrain.

Impulsive choice is preference for a smaller-sooner (SS) outcome over a larger-later (LL) outcome when LL choices result in greater reinforcement maximization. Delay discounting is a model of impulsive choice that describes the decaying value of a reinforcer over time, with impulsive choice evident when the empirical choice-delay function is steep. Steep discounting is correlated with multiple diseases and disorders. Thus, understanding the processes underlying impulsive choice is a popular topic for investigation. Experimental research has explored the conditions that moderate impulsive choice, and quantitative models of impulsive choice have been developed that elegantly represent the underlying processes. This review spotlights experimental research in impulsive choice covering human and nonhuman animals across the domains of learning, motivation, and cognition. Contemporary models of delay discounting designed to explain the underlying mechanisms of impulsive choice are discussed. These models focus on potential candidate mechanisms, which include perception, delay and/or reinforcer sensitivity, reinforcement maximization, motivation, and cognitive systems. Although the models collectively explain multiple mechanistic phenomena, there are several cognitive processes, such as attention and working memory, that are overlooked. Future research and model development should focus on bridging the gap between quantitative models and empirical phenomena.

The relationship between dietary fat intake, impulsive choice, and metabolic health.

Unhealthful foods are convenient, ubiquitous, and inexpensive. Overconsumption of unhealthful foods can result in disease states such as obesity and Type 2 diabetes. In addition to the physiological consequences of unhealthful foods, research in rats has shown that diets high in processed fat and sugar induce impulsive choice behavior. Research in humans has demonstrated a link between metabolic health and impulsive choice, but most investigations have not included diet. We investigated how dietary fat intake interacts with body fat percentage, fasting glucose, insulin response, and systemic inflammation levels to predict impulsive choices in humans. Participants were split into either Control (<35% calories from fat) or High-Fat (≥40% calories from fat) groups based on self-reported dietary intake, completed an impulsive choice task, and underwent testing to determine their body fat, glucose, insulin response, and inflammation levels. High-fat diets were not predictive of impulsive choices, but added sugar was predictive. Body fat percentage was associated with impulsive choices only in the group who reported consuming high-fat diets. In addition, fasting glucose was associated with impulsive choices in the control group. Therefore, metabolic health and dietary fat intake interacted to predict impulsive choices. These findings indicate that knowledge of dietary patterns coupled with metabolic health markers may help us better understand impulsive choices, thereby improving our ability to target individuals who could benefit from interventions to reduce impulsive choice behavior, with the goal of promoting more self-controlled food choices.

An assessment tool for evaluating the National Institute of General Medical Sciences COBRE and INBRE mentoring programs.

The National Institute of General Medical Sciences (NIGMS) mandates that its Centers of Biomedical Research Excellence (COBRE) and Institutional Development Award Networks of Biomedical Research Excellence (INBRE) institute formal mentoring programs to promote the core program objective of junior investigator development. Despite this NIGMS requirement, and the many career-related benefits associated with mentoring, few tools exist for purposes of rigorously evaluating COBRE and INBRE mentoring programs. The purpose of this project was to develop a mentoring assessment tool to aid in the evaluation of COBRE and INBRE mentoring programs. In study 1, a list of items comprising the tool was created via a multiphase item generation process based on input received from subject matter experts within the Cognitive and Neurobiological Approaches to Plasticity Center. In study 2, feedback about this tool was solicited from 78 grant directors, mentees, and mentors representing 21 unique COBRE programs and 8 unique INBRE programs from across the United States. The results provide initial evidence that this tool possesses suitable psychometric properties, is a flexible instrument with many potential uses, and represents a valuable resource for helping evaluate COBRE and INBRE mentoring programs. Having a tool for evaluating mentoring can help promote the grant success and career development of junior investigators in COBRE and INBRE programs and help program directors develop more sustainable research centers.

Tracking of unpredictable moving stimuli by pigeons.

Despite being observed throughout the animal kingdom, catching a moving object is a complex task and little is known about the mechanisms that underlie this behavior in non-human animals. Three experiments examined the role of prediction in capture of a moving object by pigeons. In Experiment 1, a stimulus moved in a linear trajectory, but sometimes made an unexpected 90o turn. The sudden turn had only a modest effect on capture and error location, and the analyses suggested that the birds had adjusted their tracking to the novel motion. In Experiment 2, the role of visual input during a turn was tested by inserting disappearances (either 1.5 cm or 4.5 cm) on both the straight and turn trials. The addition of the disappearance had little effect on capture success, but delayed capture location with the larger disappearance leading to greater delay. Error analyses indicated that the birds adapted to the post-turn, post-disappearance motion. Experiment 3 tested the role of visual input when the motion disappeared behind an occluder and emerged in either a straight line or at a 90o angle. The occluder produced a disruption in capture success but did not delay capture. Error analyses indicated that the birds did not adjust their tracking to the new motion on turn trials following occlusion. The combined results indicate that pigeons can anticipate the future position of a stimulus, and can adapt to sudden, unpredictable changes in motion but do so better after a disappearance than after an occlusion.

Dietary effects on the determinants of food choice: Impulsive choice, discrimination, incentive motivation, preference, and liking in male rats.

The current study sought to understand how long-term exposure to diets high in saturated fat and refined sugar affected impulsive choice behavior, discrimination abilities, incentive motivation, food preferences, and liking of fat and sugar in male rats. The results showed that 8 weeks of dietary exposure impaired impulsive choice behavior; rats exposed to diets high in processed fat or sugar were more sensitive to changes in delay, a marker of impulsivity. For the high-fat group, these deficits in impulsive choice may stem from poor time discrimination, as their performance was impaired on a temporal discrimination task. The high-fat group also showed reduced magnitude sensitivity in the impulsive choice task, and they earned fewer rewards during lever press training indicating potentially reduced incentive motivation. The high-fat group also developed a preference for high-fat foods compared to the chow and high-sugar group who both preferred sugar. In contrast, dietary exposure did not alter the liking of fat or sugar as measured by a taste reactivity task. Together, the results suggest that the alterations in impulsive choice, time discrimination, incentive motivation, and food preferences induced by consumption of a high-fat diet could make individuals vulnerable to overeating, and thus obesity.

Females in the forefront: time-based intervention effects on impulsive choice and interval timing in female rats.

Impulsive choice has been implicated in substance abuse, gambling, obesity, and other maladaptive behaviors. Deficits in interval timing may increase impulsive choices, and therefore, could serve as an avenue through which suboptimal impulsive choices can be moderated. Temporal interventions have successfully attenuated impulsive choices in male rats, but the efficacy of a temporal intervention has yet to be assessed in female rats. As such, this experiment examined timing and choice behavior in female rats, and evaluated the ability of a temporal intervention to mitigate impulsive choice behavior. The temporal intervention administered in this study was successful in reducing impulsive choices compared to a control group. Results of a temporal bisection task indicated that the temporal intervention increased long responses at the shorter durations. Further, results from the peak trials within the choice task combined with the progressive interval task suggest that the intervention increased sensitivity to delay and enhanced timing confidence. Overall, these results indicate that a temporal intervention can be a successful avenue for reducing impulsive choice behavior in female rats, and could contribute to the development of behavioral interventions to prevent impulsive choice and maladaptive behaviors that can be applied to both sexes.

Accumbens D2: Raters of the Loss Outcome.

Zalocusky et al. (Nature 531:642-646, 2016) recently showed that activity in D2R+ cells in the nucleus accumbens is associated with loss sensitivity to prior outcomes and reduced subsequent risky choice, and that optogenetic stimulation of these cells decreased risky choices in risk-prone rats. While their findings are important for understanding trait-level risk-taking, future research should aim to examine the neuronal mechanisms of a broader range of facets of gain and loss processing with respect to different potential reference points.

Abbreviated fixed-interval interventions promote self-control in rats.

Impulsive choice, defined as choices of a smaller-sooner reward over a larger-later reward, can be reduced by time-based interventions that expose rats to delayed rewards. These interventions improve temporal processing concurrent with reducing impulsive choice. Exposure to delayed reinforcement has produced improvements in self-control after 30 sessions of intervention exposure (Renda et al., 2021). Experiment 1 of the present study used a pre-/post-test design to investigate a range of intervention exposures (6, 15, 30, and 45 sessions), including shorter exposures that have not previously been examined. Peak-interval timing was also assessed to determine whether different intervention exposures would improve temporal processing. All intervention exposures, including the abbreviated intervention, reduced impulsive choice, and improved temporal processing. Experiment 2 showed that the 6-session intervention improved self-control relative to a no-delay control, further strengthening the proposal that an abbreviated intervention may be sufficient to reduce impulsive choice. Moreover, improvements in peak-interval timing were observed in groups receiving a pre-intervention impulsive choice assessment, suggesting that exposure to the impulsive choice task may improve temporal processing.

Generalizability of time-based interventions: Effects of choice procedure and smaller-sooner delay.

Interventions exposing rats to delayed-reward contingencies attenuate suboptimal impulsive choices, a preference for a smaller-sooner (SS) over a larger-later (LL) reward. Interventions may potentially improve delay-tolerance, timing of delays, and/or discrimination of reward magnitudes. Generalization from the intervention to impulsive choice under different procedures can provide insights into the processes that underlie the intervention effects. Experiment 1 tested intervention effects on systematic-delay (SYS) and adjusting-delay (ADJ) procedures, predicting that intervention effects would be more effective on the SYS procedure with predictable delays. The ADJ procedure did not benefit significantly from intervention, but the SYS procedure, unexpectedly, showed greater impulsive choices following intervention. Experiment 2 tested whether short (5 s) SS intervention delays may have promoted greater impulsivity in the SYS impulsive choice procedure in Experiment 1. Short SS delays in choice and intervention procedures increased impulsive choices in comparison to longer (10 s) delays. Incongruent SS delays in the intervention/choice procedures resulted in negative intervention effects. The results suggest that short SS delays are detrimental to self-control and that specific temporal information generalizes from the intervention to the SYS choice task, but not the ADJ choice task.

Tracking and capture of constant and varying velocity stimuli: a cross-species comparison of pigeons and humans.

The mechanisms underlying tracking and capture of moving objects in non-human animals are poorly understood. This set of experiments sought to further explore aspects of anticipatory tracking in pigeons and to conduct comparisons with human participants. In Experiment 1a, pigeons were presented with two types of varying velocities (fast-slow-fast or slow-fast-slow) in separate phases. They were readily able to track and anticipate both of these motion types. To examine the effects of predictability on anticipatory tracking, Experiment 1b presented the pigeons with the same two varying velocities randomly intermixed within a session. This resulted in reduced capture success, later capture, and errors that no longer anticipated ahead of the motion, suggesting that the anticipatory mechanism had been disrupted. This implies that the mechanisms involved in pigeon tracking are different from the predictive extrapolation mechanism proposed in humans. Experiment 2 tested this by presenting adult humans with a tracking task that was similar to tasks previously received by the pigeons. The capture behavior of humans was similar to the pigeons, but the errors revealed different processes underlying their tracking behavior.

Hazard function effects on promoting self-control in variable interval time-based interventions in rats.

The present experiments investigated properties of time-based interventions used to increase self-control. Rats received impulsive-choice assessments before and after interventions that consisted of different distributions of delays to reinforcement. In Experiment 1, rats received an intervention with an increasing hazard function where delays were more evenly distributed, a decreasing hazard function where delays were mostly short, or a constant hazard function where delays were exponentially distributed. Surprisingly, rats that received the decreasing hazard function made the most self-controlled choices. Response rates during intervention trials showed that rats anticipated reinforcement based on the shape of the distributions they received. In Experiment 2, rats received an intervention with a decreasing hazard function with a steep slope or a shallow slope. Both time-based interventions increased self-control and produced similar response-rate patterns, indicating that the slope of the decreasing hazard function may not play a strong role in intervention efficacy. While this research aligns with previous literature showing that time-based interventions improved self-control, exposure to short delays produced the biggest improvements. Ultimately, exposure to short delays may increase the subjective value of the larger-later choice while occasional long delays may promote the ability to wait, which may have important implications for translational applications.

A time-based intervention to treat impulsivity in male and female rats.

Time-based interventions have emerged as promising treatments for disorders associated with impulsivity. These interventions can be implemented to test their efficacy in preventing or treating impulsive choice in animal models of diseases related to impulsivity such as drug abuse. Impulsive choice is typically defined as choosing a smaller-sooner (SS) reward over a larger-later (LL) reward when the LL is relatively more optimal. Previous research has shown that these interventions promote LL choices in males and females, but sex differences have not been assessed. Because sex differences can complicate the application of therapies, it is critical to compare the effects of the intervention in males and females. The intervention group received exposure to 10-s and 30-s interval schedules, and the control rats received no delay to reward. Different impulsive choice tasks were used to assess the intervention efficacy across the two experiments. Following the intervention, reductions in impulsive choice were found in male and female rats, but the degree of improvement was inconsistent across sex and task. Bayesian analyses that combined the results revealed robust evidence of an overall intervention effect with the intervention group showing greater self-control, but there was no evidence for the intervention affecting males and females differently. Taken together, these results suggest that time-based interventions are effective tools to treat impulsivity in both males and females and offer promising translational capability to humans.

Visually guided capture of a moving stimulus by the pigeon (Columba livia).

Although the pigeon is a popular model for studying visual perception, relatively little is known about its perception of motion. Three experiments examined the pigeons' ability to capture a moving stimulus. In Experiment 1, the effect of manipulating stimulus speed and the length of the stimulus was examined using a simple rightward linear motion. This revealed a clear effect of length on capture and speed on errors. Errors were mostly anticipatory and there appeared to be two processes contributing to response locations: anticipatory peck bias and lag time. Using the same birds as Experiment 1, Experiment 2 assessed transfer of tracking and capture to novel linear motions. The birds were able to capture other motion directions, but they displayed a strong rightward peck bias, indicating that they had learned to peck to the right of the stimulus in Experiment 1. Experiment 3 used the same task as Experiment 2 but with naïve birds. These birds did not show the rightward bias in pecking and instead pecked more evenly around the stimulus. The combined results indicate that the pigeon can engage in anticipatory tracking and capture of a moving stimulus, and that motion properties and training experience influence capture.

Cognitive and behavioral training interventions to promote self-control.

This review article discusses various cognitive and behavioral interventions that have been developed with the goal of promoting self-controlled responding. Self-control can exert a significant impact on human health and impulsive behaviors are associated with a wide range of diseases and disorders, leading to the suggestion that impulsivity is a trans-disease process. The self-control interventions include effort exposure, reward discrimination, reward bundling, interval schedules of reinforcement, impulse control training, and mindfulness training. Most of the interventions have been consistently shown to increase self-control, except for mindfulness training. Some of the successful interventions are long-lasting, whereas others may be transient. Most interventions are domain-specific, targeting specific cognitive and behavioral processes that relate to self-control rather than targeting overall self-control. For example, effort exposure appears to primarily increase effort tolerance, which in turn can improve self-control. Similarly, interval schedules primarily target interval timing, which promotes self-controlled responses. A diagram outlining a proposed set of intervention effects on self-control is introduced to motivate further research in this area. The diagram suggests that the individual target processes of the interventions may potentially summate to produce general self-control, or perhaps even produce synergistic effects. In addition, it is suggested that developing a self-control profile may be advantageous for aligning specific interventions to mitigate specific deficits. Overall, the results indicate that interventions are a promising avenue for promoting self-control and may help to contribute to changing health outcomes associated with a wide variety of diseases and disorders. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Experience Matters: The Effects of Hypothetical versus Experiential Delays and Magnitudes on Impulsive Choice in Delay Discounting Tasks.

Impulsive choice in humans is typically measured using hypothetical delays and rewards. In two experiments, we determined how experiencing the delay and/or the reward affected impulsive choice behavior. Participants chose between two amounts of real or hypothetical candy (M&Ms) after a real or hypothetical delay (5-30 s), where choosing the shorter delay was the impulsive choice. Experiment 1 compared choice behavior on a real-delay, real-reward (RD/RR) task where participants received M&Ms after experiencing the delays versus a real-delay, hypothetical-reward (RD/HR) task where participants accumulated hypothetical M&Ms after experiencing the delays. Experiment 2 compared the RD/HR task and a hypothetical-delay, hypothetical-reward (HD/HR) task where participants accumulated hypothetical M&Ms after hypothetical delays. The results indicated that choices did not differ between real and hypothetical M&Ms (Experiment 1), and participants were less sensitive to delay and more larger-later (LL)-preferring with hypothetical delays compared to real delays (Experiment 2). Experiencing delays to reward may be important for modeling real-world impulsive choices where delays are typically experienced. These novel experiential impulsive choice tasks may improve translational methods for comparison with animal models and may be improved procedures for predicting real-life choice behavior in humans.

Temporal map formation in appetitive second-order conditioning in rats.

Three experiments examined whether second-order conditioning resulted in the formation of a fully-featured temporal map, as proposed by the temporal coding hypothesis. Experiments 1 and 2 examined second-order conditioning with different first- and second-order relationships. Measures of the strength of second-order conditioning were mostly consistent with the temporal coding hypothesis; second-order conditioning was best with arrangements in which CS2 occurred prior to the time that the US normally occurred during CS1-US presentations. However, there was no evidence of anticipatory timing during CS2 during second-order conditioning. A third experiment directly examined whether a fully-featured temporal map was formed during second-order conditioning by examining the acquisition of anticipatory timing in subsequent reinforced second-order trials. The results of Experiment 3 suggested that the effects obtained in Experiments 1 and 2 were due to learning of the temporal order and coincidence of events that resulted in the formation of an ordinal temporal map, but that precise durations were not encoded.

Resurrecting the individual in behavioral analysis: Using mixed effects models to address nonsystematic discounting data.

Delay and probability discounting functions typically take a monotonic form, but some individuals produce functions that are nonsystematic. Johnson and Bickel (2008) developed an algorithm for classifying nonsystematic functions on the basis of two different criteria. Type 1 functions were identified as nonsystematic due to random choices and Type 2 functions were identified as nonsystematic due to relatively shallow slopes, suggesting poor sensitivity to choice parameters. Since their original publication, the algorithm has become widely used in the human discounting literature for removal of participants, with studies often removing approximately 20% of the original sample (Smith & Lawyer, 2017). Because subject removal may not always be feasible due to loss of power or other factors, the present report applied a mixed effects regression modeling technique (Wileyto, Audrain-Mcgovern, Epstein, & Lerman, 2004; Young, 2017) to account for individual differences in DD and PD functions. Assessment of the model estimates for Type 1 and 2 nonsystematic functions indicated that both types of functions deviated systematically from the rest of the sample in that nonsystematic participants were more likely to show shallower slopes and increased biases for larger amounts. The results indicate that removing these participants would fundamentally alter the properties of the final sample in undesirable ways. Because mixed effects models account for between-participant variation with random effects, we advocate for the use of these models for future analyses of a wide range of functions within the behavioral analysis field, with the benefit of avoiding the negative consequences associated with subject removal.