Runway extinction in terrestrial toads (Rhinella arenarum): Instrumental or Pavlovian?

Instrumental appetitive extinction involves the reduction of a previously reinforced response when its occurrence is no longer rewarded. Two experiments with terrestrial toads (Rhinella arenarum) tested whether the occurrence of a nonreinforced response is necessary for response extinction by varying the time of exposure to nonrewarded goal-box stimuli across groups. In Experiment 1, toads that received the same acquisition training (15 sessions, 1 session/day, 300 s of access to water in the goal box) were randomly assigned to two groups. In Group 600 (n=12), animals spent 600 s in the goal box in 8 daily extinction sessions (water present but inaccessible). In Group 0 (n=11), toads performed the runway response (i.e., walking from the start to the goal box) but were removed as soon as they entered the goal box, thus having minimal exposure to nonrewarded goal-box stimuli. The runway response was weakened in Group 600 across extinction trials, but exhibited little change in Group 0. In Experiment 2, toads were randomly assigned to two groups after the same acquisition training. Group 0 (n=7) was treated the same as Group 0 in the previous experiment. In Group RI (retention interval, n=7), toads remained in their home cage for 13 days. Finally, all animals received 4 extinction sessions with 300 s in the empty goal box. There was little behavioral change in Group 0 during the 13 sessions with minimal exposure to the goal box. In extinction, both groups reduced their runway response at similar rates. Although the procedures were instrumental, extinction of the runway response in toads can be accounted for in terms of a Pavlovian approach response to stimuli paired with reward and nonreward in the goal box.

Instrumental successive negative contrast in rats: Trial distribution, reward magnitude, and prefrontal cortex activation.

Successive negative contrast (SNC) has been used to study reward relativity, reward loss, and frustration for decades. In instrumental SNC (iSNC), the anticipatory performance of animals downshifted from a large reward to a small reward is compared to that of animals always reinforced with the small reward. iSNC involves a transient deterioration of anticipatory behavior in downshifted animals compared to unshifted controls. There is scattered information on the optimal parameters to produce this effect and even less information about its neural basis. Five experiments with rats trained in a runway to collect food pellets explored the effects of trial distribution (massed or spaced), amount of preshift training, reward disparity, and reward magnitude on the development of an iSNC effect. Start, run, and goal latencies were measured. Using spaced trials (one trial per day), evidence of the iSNC effect was observed with 24 preshift trials and a 32-to-4 pellet disparity. With massed trials (4 trials per session separated by 30-s intertrial intervals), evidence of iSNC was found with 12 preshift sessions (a total of 48 trials) and a 16-to-2 pellet disparity. The massed-training procedure was then used to assess neural activity in three prefrontal cortex areas using c-Fos expression in animals perfused after the first downshift session. There was evidence of increased activation in the anterior cingulate cortex and a trend toward increased activation in the infralimbic and prelimbic cortices. These procedures open a venue for studying the neural basis of the instrumental behavior of animals that experience reward loss.

Duration of extinction trials as a determinant of instrumental extinction in terrestrial toads (Rhinella arenarum).

Instrumental learning guides behavior toward resources. When such resources are no longer available, approach to previously reinforced locations is reduced, a process called extinction. The present experiments are concerned with factors affecting the extinction of acquired behaviors in toads. In previous experiments, total reward magnitude in acquisition and duration of extinction trials were confounded. The present experiments were designed to test the effects of these factors in factorial designs. Experiment 1 varied reward magnitude (900, 300, or 100 s of water access per trial) and amount of acquisition training (5 or 15 daily trials). With total amount of water access equated in acquisition, extinction with large rewards was faster (longer latencies in 900/5 than 300/15), but with total amount of training equated, extinction with small rewards was faster (longer latencies in 100/15 than 300/15). Experiment 2 varied reward magnitude (1200 or 120 s of water access per trial) while holding constant the number of acquisition trials (5 daily trials) and the duration of extinction trials (300 s). Extinction performance was lower with small, rather than large reward magnitude (longer latencies in 120/300 than in 1200/300). Thus, instrumental extinction depends upon the amount of time toads are exposed to the empty goal compartment during extinction trials.

Telencephalic neural activation following passive avoidance learning in a terrestrial toad.

The present study explores passive avoidance learning and its neural basis in toads (Rhinella arenarum). In Experiment 1, two groups of toads learned to move from a lighted compartment into a dark compartment. After responding, animals in the experimental condition were exposed to an 800-mM strongly hypertonic NaCl solution that leads to weight loss. Control animals received exposure to a 300-mM slightly hypertonic NaCl solution that leads to neither weight gain nor loss. After 10 daily acquisition trials, animals in the experimental group showed significantly longer latency to enter the dark compartment. Additionally, 10 daily trials in which both groups received the 300-mM NaCl solution after responding eliminated this group effect. Thus, experimental animals showed gradual acquisition and extinction of a passive avoidance respond. Experiment 2 replicated the gradual acquisition effect, but, after the last trial, animals were sacrificed and neural activation was assessed in five brain regions using AgNOR staining for nucleoli-an index of brain activity. Higher activation in the experimental animals, relative to controls, was observed in the amygdala and striatum. Group differences in two other regions, lateral pallium and septum, were borderline, but nonsignificant, whereas group differences in the medial pallium were nonsignificant. These preliminary results suggest that a striatal-amygdala activation could be a key component of the brain circuit controlling passive avoidance learning in amphibians. The results are discussed in relation to the results of analogous experiments with other vertebrates.

Vulnerability of long-term memory to temporal delays in amphibians.

Two experiments with toads were designed to test the memory-decay hypothesis that extinction (i.e., nonreinforced) performance is a function of time since the last reinforcement. In Experiment 1, toads (Rhinella arenarum, formerly Bufo arenarum) received 15 daily acquisition trials each reinforced with access to water during 300 s in a runway and were then randomly assigned to one of 6 retention intervals (RIs): 1, 4, 8, 16, 32, and 64 days. Extinction started after the RI and lasted 8 additional daily trials. Overall extinction performance was a logarithmic function of the RI. Although 4 extinction trials produced similar performance than 4 days of RI (consistent with memory decay), 8 extinction trials produced lower performance than 8 days of RI (consistent with a decremental effect of nonreinforcement). In Experiment 2, two groups of toads received 15 daily acquisition trials each reinforced with access to water for either 30 or 600 s, thus producing two reward magnitudes. After an 8-day RI, extinction performance was weaker after training with the small, than with the large reward magnitude. These results suggest that, at least in early extinction, the instrumental performance of toads is strongly influenced by the time since the last reinforcement.