Rats delay gratification during a time-based diminishing returns task.

The rat is a common animal model used to uncover the neural underpinnings of decision making and their disruption in psychiatric illness. Here, we ask if rats can perform a decision-making task that assesses self-control by delayed gratification in the context of diminishing returns. In this task, rats could choose to press one of two levers. One lever was associated with a fixed delay (FD) schedule that delivered reward after a fixed time delay (10 s). The other lever was associated with a progressive delay (PD) schedule; the delay increased by a fixed amount of time (1 s) after each PD lever press. Rats were tested under two conditions: a reset condition where rats could reset the PD schedule back to its initial 0-s delay by pressing the FD lever and a no-reset condition in which resetting the PD schedule was unavailable. We found that rats adapted behavior within reset sessions by delaying gratification to obtain more reward in the long run. That is, they selected the FD lever with the longer delay to reset the PD delay back to zero prior to the equality point, thus achieving more reward over the course of the session. These results are consistent with other species, demonstrating that rats can also maximize the net rate of reward by selecting an option that is not immediately beneficial. Moreover, use of this task in rodents might provide insights into how the brain governs normal and abnormal behavior, as well as treatments that can improve self-control. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Dopamine signals related to appetitive and aversive events in paradigms that manipulate reward and avoidability.

Using environmental cues to acquire good and avoid harmful things is critical for survival. Rewarding and aversive outcomes both drive behavior through reinforcement learning and sometimes occur together in the environment, but it remains unclear how these signals are encoded within the brain and if signals for positive and negative reinforcement are encoded similarly. Recent studies demonstrate that the dopaminergic system and interconnected brain regions process both positive and negative reinforcement necessary for approach and avoidance behaviors, respectively. Here, we review these data with a special focus on behavioral paradigms that manipulate both expected reward and the avoidability of aversive events to reveal neural correlates related to value, prediction error encoding, motivation, and salience.

Improving in Situ Electrode Calibration with Principal Component Regression for Fast-Scan Cyclic Voltammetry.

Fast-scan cyclic voltammetry with a carbon-fiber microelectrode is an increasingly popular technique for in vivo measurements of electroactive neurotransmitters, most notably dopamine. Calibration of these electrodes is essential for many uses, but it is complicated by the many factors that affect an electrode's sensitivity when it is implanted in neural tissue. Experienced practitioners of fast-scan cyclic voltammetry are well aware that an electrode's sensitivity to dopamine depends on both the size and shape of the electrode's background waveform. In vitro electrode calibration is still the standard method, although a strategy for in situ calibration based on the size of the electrode's background waveform has previously been published. We reasoned that the accuracy and transferability of in situ calibration could be improved by using principal component regression to capture information contained in the shape of the background waveform. We use leave-one-out cross-validation to estimate the ability of this strategy to predict unknown electrodes and to compare its performance with that of the total-background-current strategy. The principal-component-regression strategy has significantly greater predictive performance than the total-background-current strategy, and the resulting calibration models can be transferred across independent laboratories. Importantly, multivariate quality-control statistics establish the applicability of the strategy to in vivo data. Adoption of the principal-component-regression strategy for in situ calibration will improve the interpretation of in vivo fast-scan cyclic voltammetry data.

Modafinil Activates Phasic Dopamine Signaling in Dorsal and Ventral Striata.

Modafinil (MOD) exhibits therapeutic efficacy for treating sleep and psychiatric disorders; however, its mechanism is not completely understood. Compared with other psychostimulants inhibiting dopamine (DA) uptake, MOD weakly interacts with the dopamine transporter (DAT) and modestly elevates striatal dialysate DA, suggesting additional targets besides DAT. However, the ability of MOD to induce wakefulness is abolished with DAT knockout, conversely suggesting that DAT is necessary for MOD action. Another psychostimulant target, but one not established for MOD, is activation of phasic DA signaling. This communication mode during which burst firing of DA neurons generates rapid changes in extracellular DA, the so-called DA transients, is critically implicated in reward learning. Here, we investigate MOD effects on phasic DA signaling in the striatum of urethane-anesthetized rats with fast-scan cyclic voltammetry. We found that MOD (30-300 mg/kg i.p.) robustly increases the amplitude of electrically evoked phasic-like DA signals in a time- and dose-dependent fashion, with greater effects in dorsal versus ventral striata. MOD-induced enhancement of these electrically evoked amplitudes was mediated preferentially by increased DA release compared with decreased DA uptake. Principal component regression of nonelectrically evoked recordings revealed negligible changes in basal DA with high-dose MOD (300 mg/kg i.p.). Finally, in the presence of the D2 DA antagonist, raclopride, low-dose MOD (30 mg/kg i.p.) robustly elicited DA transients in dorsal and ventral striata. Taken together, these results suggest that activation of phasic DA signaling is an important mechanism underlying the clinical efficacy of MOD.

Amphetamine elevates nucleus accumbens dopamine via an action potential-dependent mechanism that is modulated by endocannabinoids.

The reinforcing effects of abused drugs are mediated by their ability to elevate nucleus accumbens dopamine. Amphetamine (AMPH) was historically thought to increase dopamine by an action potential-independent, non-exocytotic type of release called efflux, involving reversal of dopamine transporter function and driven by vesicular dopamine depletion. Growing evidence suggests that AMPH also acts by an action potential-dependent mechanism. Indeed, fast-scan cyclic voltammetry demonstrates that AMPH activates dopamine transients, reward-related phasic signals generated by burst firing of dopamine neurons and dependent on intact vesicular dopamine. Not established for AMPH but indicating a shared mechanism, endocannabinoids facilitate this activation of dopamine transients by broad classes of abused drugs. Here, using fast-scan cyclic voltammetry coupled to pharmacological manipulations in awake rats, we investigated the action potential and endocannabinoid dependence of AMPH-induced elevations in nucleus accumbens dopamine. AMPH increased the frequency, amplitude and duration of transients, which were observed riding on top of slower dopamine increases. Surprisingly, silencing dopamine neuron firing abolished all AMPH-induced dopamine elevations, identifying an action potential-dependent origin. Blocking cannabinoid type 1 receptors prevented AMPH from increasing transient frequency, similar to reported effects on other abused drugs, but not from increasing transient duration and inhibiting dopamine uptake. Thus, AMPH elevates nucleus accumbens dopamine by eliciting transients via cannabinoid type 1 receptors and promoting the summation of temporally coincident transients, made more numerous, larger and wider by AMPH. Collectively, these findings are inconsistent with AMPH eliciting action potential-independent dopamine efflux and vesicular dopamine depletion, and support endocannabinoids facilitating phasic dopamine signalling as a common action in drug reinforcement.

Neurochemostat: A Neural Interface SoC With Integrated Chemometrics for Closed-Loop Regulation of Brain Dopamine.

This paper presents a 3.3×3.2 mm(2) system-on-chip (SoC) fabricated in AMS 0.35 µm 2P/4M CMOS for closed-loop regulation of brain dopamine. The SoC uniquely integrates neurochemical sensing, on-the-fly chemometrics, and feedback-controlled electrical stimulation to realize a "neurochemostat" by maintaining brain levels of electrically evoked dopamine between two user-set thresholds. The SoC incorporates a 90 µW, custom-designed, digital signal processing (DSP) unit for real-time processing of neurochemical data obtained by 400 V/s fast-scan cyclic voltammetry (FSCV) with a carbon-fiber microelectrode (CFM). Specifically, the DSP unit executes a chemometrics algorithm based upon principal component regression (PCR) to resolve in real time electrically evoked brain dopamine levels from pH change and CFM background-current drift, two common interferents encountered using FSCV with a CFM in vivo. Further, the DSP unit directly links the chemically resolved dopamine levels to the activation of the electrical microstimulator in on-off-keying (OOK) fashion. Measured results from benchtop testing, flow injection analysis (FIA), and biological experiments with an anesthetized rat are presented.