The timing database: An open-access, live repository for interval timing studies.

Interval timing refers to the ability to perceive and remember intervals in the seconds to minutes range. Our contemporary understanding of interval timing is derived from relatively small-scale, isolated studies that investigate a limited range of intervals with a small sample size, usually based on a single task. Consequently, the conclusions drawn from individual studies are not readily generalizable to other tasks, conditions, and task parameters. The current paper presents a live database that presents raw data from interval timing studies (currently composed of 68 datasets from eight different tasks incorporating various interval and temporal order judgments) with an online graphical user interface to easily select, compile, and download the data organized in a standard format. The Timing Database aims to promote and cultivate key and novel analyses of our timing ability by making published and future datasets accessible as open-source resources for the entire research community. In the current paper, we showcase the use of the database by testing various core ideas based on data compiled across studies (i.e., temporal accuracy, scalar property, location of the point of subjective equality, malleability of timing precision). The Timing Database will serve as the repository for interval timing studies through the submission of new datasets.

Cortico-Striatal Control over Adaptive Goal-Directed Responding Elicited by Cues Signaling Sucrose Reward or Punishment.

The medial prefrontal cortex (mPFC) and nucleus accumbens (NAc) have been associated with the expression of adaptive and maladaptive behavior elicited by fear-related and drug-associated cues. However, reported effects of mPFC manipulations on cue-elicited natural reward-seeking and inhibition thereof have been varied, with few studies examining cortico-striatal contributions in tasks that require adaptive responding to cues signaling reward and punishment within the same session. The current study aimed to better elucidate the role of mPFC and NAc subdivisions, and their functional connectivity in cue-elicited adaptive responding using a novel discriminative cue responding task. Male Long-Evans rats learned to lever-press on a VR5 schedule for a discriminative cue signaling reward, and to avoid pressing the same lever in the presence of another cue signaling punishment. Postacquisition, prelimbic (PL) and infralimbic (IL) areas of the mPFC, NAc core, shell, PL-core, or IL-shell circuits were pharmacologically or chemogenetically inhibited while animals performed under (1) nonreinforced (extinction) conditions, where the appetitive and aversive cues were presented in alternating trials alone or as a compound stimulus; and (2) reinforced conditions, whereby cued responding was accompanied by associated outcomes. PL and IL inactivation attenuated nonreinforced and reinforced goal-directed cue responding, whereas NAc core and shell inactivation impaired nonreinforced responding for the appetitive, but not aversive cue. Furthermore, PL-core and IL-shell inhibition disinhibited nonreinforced but not reinforced cue responding. Our findings implicate the mPFC as a site of confluence of motivationally significant cues and outcomes, and in the regulation of nonreinforced cue responding via downstream NAc targets.SIGNIFICANCE STATEMENT The ability to discriminate and respond appropriately to environmental cues that signal availability of reward or punishment is essential for survival. The medial prefrontal cortex (mPFC) and nucleus accumbens (NAc) have been implicated in adaptive and maladaptive behavior elicited by fear-related and drug-associated cues. However, less is known about the role they play in orchestrating adaptive responses to natural reward and punishment cues within the same behavioral task. Here, using a novel discriminative cue responding task combined with pharmacological or chemogenetic inhibition of mPFC, NAc and mPFC-NAc circuits, we report that mPFC is critically involved in responding to changing cued response-outcomes, both when the responses are reinforced, and nonreinforced. Furthermore, the mPFC coordinates nonreinforced discriminative cue responding by suppressing inappropriate responding via downstream NAc targets.

Ventral hippocampus inactivation enhances the extinction of active avoidance responses in the presence of safety signals but leaves discrete trial operant active avoidance performance intact.

The acquisition of active avoidance (AA) behavior is typically aided by the presence of two signals-the warning signal, which predicts the future occurrence of an aversive event (e.g., shocks), and the safety signal, which is presented upon successful avoidance of oncoming shocks. While the warning signal could be conceived to act as a Pavlovian fear cue, and is likely mediated by brain areas that underlie Pavlovian fear cue conditioning, the neural substrates underlying safety signaling are less clear, largely due to the unavailability of AA tasks that are devoid of an explicit warning signal. The present study sought to investigate the role of the ventral hippocampus (VH) in safety signaled AA performance acquired without an explicit warning signal, using a novel discrete trial paradigm. Adult male Long Evans rats were divided into two groups and trained to acquire AA responses with, or without a safety signal. Analysis of the acquisition and stable state performance data revealed that the availability of a safety signal alone did not improve the acquisition or performance of AA responses. Furthermore, post-training, reversible VH inactivation did not impact stable state avoidance behavior. However, extinction of avoidance responses was facilitated in the group trained with a safety signal, and this effect was further potentiated by VH inactivation. Additional elevated plus maze (EPM), light-dark box, and locomotor tests demonstrated that VH inactivation reduced anxiety without affecting locomotor activity. Taken together, these results demonstrate the importance of VH in the extinction of persistent pathological avoidance behavior when safety is signaled.

Probabilistic numerical discrimination in mice.

Previous studies showed that both human and non-human animals can discriminate between different quantities (i.e., time intervals, numerosities) with a limited level of precision due to their endogenous/representational uncertainty. In addition, other studies have shown that subjects can modulate their temporal categorization responses adaptively by incorporating information gathered regarding probabilistic contingencies into their time-based decisions. Despite the psychophysical similarities between the interval timing and nonverbal counting functions, the sensitivity of count-based decisions to probabilistic information remains an unanswered question. In the current study, we investigated whether exogenous probabilistic information can be integrated into numerosity-based judgments by mice. In the task employed in this study, reward was presented either after few (i.e., 10) or many (i.e., 20) lever presses, the last of which had to be emitted on the lever associated with the corresponding trial type. In order to investigate the effect of probabilistic information on performance in this task, we manipulated the relative frequency of different trial types across different experimental conditions. We evaluated the behavioral performance of the animals under models that differed in terms of their assumptions regarding the cost of responding (e.g., logarithmically increasing vs. no response cost). Our results showed for the first time that mice could adaptively modulate their count-based decisions based on the experienced probabilistic contingencies in directions predicted by optimality.

The ventral hippocampus CA3 is critical in regulating timing uncertainty in temporal decision-making.

Timing uncertainty is a critical component of temporal decision-making, as it determines the decision strategies that maximize reward rate. However, little is known about the biological substrates of timing uncertainty. In this study, we report that the CA3 subregion of the ventral hippocampus (vCA3), a relatively unexplored area in timing, is critical in regulating timing uncertainty that informs temporal decision making. Using a variant of the differential reinforcement of low rates of responding (DRL) task that incorporates differential levels of approach-avoidance conflict, rats were trained to wait a minimum of 6 s to earn a reward that was paired with varying durations of foot shock. Post-training chemogenetic inhibition of the vCA3 reduced timing uncertainty without affecting mean wait times, irrespective of the level of conflict experienced. Simulations based on the information-processing variant of scalar expectancy theory (SET) revealed that the vCA3 may be important in modulating decision threshold or switch closure latency variability.

The ventral hippocampus is necessary for cue-elicited, but not outcome driven approach-avoidance conflict decisions: a novel operant choice decision-making task.

Approach-avoidance conflict is induced when an organism encounters a stimulus that carries both positive and negative attributes. Accumulating evidence implicates the ventral hippocampus (VH) in the detection and resolution of approach-avoidance conflict, largely on the basis of maze-based tasks assaying innate and conditioned responses to situations of conflict. However, its role in discrete trial approach-avoidance decision-making has yet to be elucidated. In this study, we designed a novel cued operant conflict decision-making task in which rats were required to choose and respond for a low reward option or high reward option paired with varying shock intensities on a differential reinforcement of low rates of responding schedule. Post training, the VH was chemogenetically inhibited while animals performed the task with the usual outcomes delivered, and with the presentation of cues associated with the reward vs. conflict options only (extinction condition). We found that VH inhibition led to an avoidance of the conflict option and longer latency to choose this option when decision-making was being made on the basis of cues alone with no outcomes. Consistent with these findings, VH-inhibited animals spent more time in the central component of the elevated plus maze (EPM), indicating a potential deficit in decision-making under innate forms of approach-avoidance conflict. Taken together, these findings implicate the VH in cue-driven approach-avoidance decisions in the face of motivational conflict.

The hippocampus contributes to temporal duration memory in the context of event sequences: A cross-species perspective.

Although a large body of research has implicated the hippocampus in the processing of memory for temporal duration, there is an exigent degree of inconsistency across studies that obfuscates the precise contributions of this structure. To shed light on this issue, the present review article surveys both historical and recent cross-species evidence emanating from a wide variety of experimental paradigms, identifying areas of convergence and divergence. We suggest that while factors such as time-scale (e.g. the length of durations involved) and the nature of memory processing (e.g. prospective vs. retrospective memory) are very helpful in the interpretation of existing data, an additional important consideration is the context in which the duration information is experienced and processed, with the hippocampus being preferentially involved in memory for durations that are embedded within a sequence of events. We consider the mechanisms that may underpin temporal duration memory and how the same mechanisms may contribute to memory for other aspects of event sequences such as temporal order.

Mice can count and optimize count-based decisions.

Previous studies showed that rats and pigeons can count their responses, and the resultant count-based judgments exhibit the scalar property (also known as Weber's Law), a psychophysical property that also characterizes interval-timing behavior. Animals were found to take a nearly normative account of these well-established endogenous uncertainty characteristics in their time-based decision-making. On the other hand, no study has yet tested the implications of scalar property of numerosity representations for reward-rate maximization in count-based decision-making. The current study tested mice on a task that required them to press one lever for a minimum number of times before pressing the second lever to collect the armed reward (fixed consecutive number schedule, FCN). Fewer than necessary number of responses reset the response count without reinforcement, whereas emitting responses at least for the minimum number of times reset the response counter with reinforcement. Each mouse was tested with three different FCN schedules (FCN10, FCN20, FCN40). The number of responses emitted on the first lever before pressing the second lever constituted the main unit of analysis. Our findings for the first time showed that mice count their responses with scalar property. We then defined the reward-rate maximizing numerical decision strategies in this task based on the subject-based estimates of the endogenous counting uncertainty. Our results showed that mice learn to maximize the reward-rate by incorporating the uncertainty in their numerosity judgments into their count-based decisions. Our findings extend the scope of optimal temporal risk-assessment to the domain of count-based decision-making.

Time-based reward maximization.

Humans and animals time intervals from seconds to minutes with high accuracy but limited precision. Consequently, time-based decisions are inevitably subjected to our endogenous timing uncertainty, and thus require temporal risk assessment. In this study, we tested temporal risk assessment ability of humans when participants had to withhold each subsequent response for a minimum duration to earn reward and each response reset the trial time. Premature responses were not penalized in Experiment 1 but were penalized in Experiment 2. Participants tried to maximize reward within a fixed session time (over eight sessions) by pressing a key. No instructions were provided regarding the task rules/parameters. We evaluated empirical performance within the framework of optimality that was based on the level of endogenous timing uncertainty and the payoff structure. Participants nearly tracked the optimal target inter-response times (IRTs) that changed as a function of the level of timing uncertainty and maximized the reward rate in both experiments. Acquisition of optimal target IRT was rapid and abrupt without any further improvement or worsening. These results constitute an example of optimal temporal risk assessment performance in a task that required finding the optimal trade-off between the 'speed' (timing) and 'accuracy' (reward probability) of timed responses for reward maximization.

Epistasis effects of dopamine genes on interval timing and reward magnitude in humans.

We tested human participants on a modified peak procedure in order to investigate the relation between interval timing and reward processing, and examine the interaction of this relation with three different dopamine-related gene polymorphisms. These gene polymorphisms affected the expression of catechol-o-methyltransferase, which catabolizes synaptic dopamine primarily in the prefrontal cortex (COMT Val158Met polymorphism), D2 dopamine receptors primarily in the striatum (DRD2/ANKK1-Taq1a polymorphism), and dopamine transporters, which clear synaptic dopamine in the striatum (DAT 3' VNTR variant). The inclusion of these polymorphisms allowed us to investigate dissociable aspects of the dopamine system and their interaction with reward magnitude manipulations in shaping timed behavior. These genes were chosen for their roles in reward processing and cortico-striatal information processing that have been implicated for interval timing. Consistent with recent animal studies, human participants initiated their timed anticipatory responding earlier when expecting a larger reward in the absence of any changes in the timing of response termination or perceived time. This effect however was specific to two out of four evaluated COMT and DRD2 polymorphism combinations that lead to high prefrontal dopamine coupled with high D2 density and low prefrontal dopamine coupled with low D2 density. Larger rewards also decreased timing precision indices, some of which interacted with the COMT polymorphism. Furthermore, the COMT polymorphism that leads to higher prefrontal dopamine resulted in weaker manifestation of memory variability (relative to threshold variability) in timed behavior. There was no effect of DAT polymorphisms on any of the core behavioral measures. These results suggest that the reward modulates decision thresholds rather than clock speed, and that these effects are specific to COMT and DRD2 epistasis effects that presumably constitute a balanced prefrontal and striatal dopamine transmission.