Region-Specific Summation Patterns Inform the Role of Cortical Areas in Selecting Motor Plans.

Given an instruction regarding which effector to move and what location to move to, simply adding the effector and spatial signals together will not lead to movement selection. For this, a nonlinearity is required. Thresholds, for example, can be used to select a particular response and reject others. Here we consider another useful nonlinearity, a supralinear multiplicative interaction. To help select a motor plan, spatial and effector signals could multiply and thereby amplify each other. Such an amplification could constitute one step within a distributed network involved in response selection, effectively boosting one response while suppressing others. We therefore asked whether effector and spatial signals sum supralinearly for planning eye versus arm movements from the parietal reach region (PRR), the lateral intraparietal area (LIP), the frontal eye field (FEF), and a portion of area 5 (A5) lying just anterior to PRR. Unlike LIP neurons, PRR, FEF, and, to a lesser extent, A5 neurons show a supralinear interaction. Our results suggest that selecting visually guided eye versus arm movements is likely to be mediated by PRR and FEF but not LIP.

Free-operant avoidance behavior by rats after reinforcer revaluation using opioid agonists and D-amphetamine.

The associative processes that support free-operant instrumental avoidance behavior are still unknown. We used a revaluation procedure to determine whether the performance of an avoidance response is sensitive to the current value of the aversive, negative reinforcer. Rats were trained on an unsignaled, free-operant lever press avoidance paradigm in which each response avoided or escaped shock and produced a 5 s feedback stimulus. The revaluation procedure consisted of noncontingent presentations of the shock in the absence of the lever either paired or unpaired with systemic morphine and in a different cohort with systemic d-amphetamine. Rats were then tested drug free during an extinction test. In both the d-amphetamine and morphine groups, pairing of the drug and shock decreased subsequent avoidance responding during the extinction test, suggesting that avoidance behavior was sensitive to the current incentive value of the aversive negative reinforcer. Experiment 2 used central infusions of D-Ala(2), NMe-Phe(4), Gly-ol(5)]-enkephalin (DAMGO), a mu-opioid receptor agonist, in the periacqueductal gray and nucleus accumbens shell to revalue the shock. Infusions of DAMGO in both regions replicated the effects seen with systemic morphine. These results are the first to demonstrate the impact of revaluation of an aversive reinforcer on avoidance behavior using pharmacological agents, thereby providing potential therapeutic targets for the treatment of avoidance behavior symptomatic of anxiety disorders.

Safety signals as instrumental reinforcers during free-operant avoidance.

Safety signals provide "relief" through predicting the absence of an aversive event. At issue is whether these signals also act as instrumental reinforcers. Four experiments were conducted using a free-operant lever-press avoidance paradigm in which each press avoided shock and was followed by the presentation of a 5-sec auditory safety signal. When given a choice between two levers in Experiment 1, both avoiding shock, rats preferentially responded on the lever that produced the safety signal as feedback, even when footshock was omitted. Following avoidance training with a single lever in Experiment 2, removal of the signal led to a decrease in avoidance responses and an increase in responses during the safety period normally denoted by the signal. These behavioral changes demonstrate the dual conditioned reinforcing and fear inhibiting properties of the safety signal. The associative processes that support the reinforcing properties of a safety signal were tested using a novel revaluation procedure. Prior experience of systemic morphine during safety signal presentations resulted in an increased rate of avoidance responses to produce the safety signal during a drug-free extinction test, a finding not seen with d-amphetamine in Experiment 3. Morphine revaluation of the safety signal was repeated in Experiment 4 followed by a drug-free extinction test in which responses did not produce the signal for the first 10 min of the session. Instrumental avoidance in the absence of the signal was shown to be insensitive to prior signal revaluation, suggesting that the signal reinforces free-operant avoidance behavior through a habit-like mechanism.

Mechanisms of motivation-cognition interaction: challenges and opportunities.

Recent years have seen a rejuvenation of interest in studies of motivation-cognition interactions arising from many different areas of psychology and neuroscience. The present issue of Cognitive, Affective, & Behavioral Neuroscience provides a sampling of some of the latest research from a number of these different areas. In this introductory article, we provide an overview of the current state of the field, in terms of key research developments and candidate neural mechanisms receiving focused investigation as potential sources of motivation-cognition interaction. However, our primary goal is conceptual: to highlight the distinct perspectives taken by different research areas, in terms of how motivation is defined, the relevant dimensions and dissociations that are emphasized, and the theoretical questions being targeted. Together, these distinctions present both challenges and opportunities for efforts aiming toward a more unified and cross-disciplinary approach. We identify a set of pressing research questions calling for this sort of cross-disciplinary approach, with the explicit goal of encouraging integrative and collaborative investigations directed toward them.

Dual-system free-operant avoidance: Extension of a theory.

Our theory of positively reinforced free-operant behavior (Perez & Dickinson, 2020) assumes that responding is controlled by two systems. One system is sensitive to the correlation between response and reinforcement rates and controls goal-directed behavior, whereas a habitual system learns by reward prediction error. We present an extension of this theory to the aversive domain that explains why free-operant avoidance responding increases with both the experienced rate of negative reinforcement and the difference between this rate and that programmed by the avoidance schedule. The theory also assumes that the habitual component is reinforced by the acquisition of aversive inhibitory properties by the feedback stimuli generated by responding, which then act as safety signals that reinforce habit performance. Our analysis suggests that the distinction between habitual and goal-directed control of rewarded behavior can also be applied to the aversive domain. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Resolution of outcome-induced response conflict by humans after extended training.

Studies of incongruent discrimination learning, where the outcome event of one response acts as the discriminative stimulus for the opposite response, suggest that humans rely on habitual stimulus-response (S-R) associations when outcome-response (O-R) associations would cause response conflict. Here, two experiments were conducted to investigate the robustness of this habitual strategy. In Experiment 1, we found that extensive instrumental discrimination training supported learning about the incongruent R → O contingencies, as assessed by an outcome devaluation test. Differential representations of the stimulus and the (associatively retrieved) outcome may have allowed for goal-directed incongruent performance. Experiment 2 failed to provide evidence for this possibility; direct presentation as well as associative retrieval of the incongruent events (by Pavlovian stimuli) activated the response that was associated with each event in its role of stimulus as opposed to outcome. We did find that participants successfully acquired explicit knowledge of the incongruent contingencies, which raises the possibility that propositional encoding allowed them to overcome the response conflict caused by O-R associations. Alternative associative and propositional accounts of successful goal-directed incongruent performance with extensive training will be discussed.

Rational action selection in 1½- to 3-year-olds following an extended training experience.

Previous studies failed to find evidence for rational action selection in children under 2 years of age. The current study investigated whether younger children required more training to encode the relevant causal relationships. Children between 1½ and 3 years of age were trained over two sessions to perform actions on a touch-sensitive screen to obtain video clips as outcomes. Subsequently, a visual habituation procedure was employed to devalue one of the training outcomes. As in previous studies, 2- and 3-year-olds chose actions associated with an expected valued outcome significantly more often during a subsequent choice test. Moreover, analysis of children's first responses in the post-devaluation test revealed evidence of rational action selection even in the youngest age group (18-23 months). Consistent with dual-process accounts of action control, the findings support the view that the ability to make rational action choices develops gradually.

Habitual versus goal-directed action control in Parkinson disease.

This study presents the first direct investigation of the hypothesis that dopamine depletion of the dorsal striatum in mild Parkinson disease leads to impaired stimulus-response habit formation, thereby rendering behavior slow and effortful. However, using an instrumental conflict task, we show that patients are able to rely on direct stimulus-response associations when a goal-directed strategy causes response conflict, suggesting that habit formation is not impaired. If anything our results suggest a disease severity-dependent deficit in goal-directed behavior. These results are discussed in the context of Parkinson disease and the neurobiology of habitual and goal-directed behavior.

Sense of agency, associative learning, and schizotypy.

Despite the fact that the role of learning is recognised in empirical and theoretical work on sense of agency (SoA), the nature of this learning has, rather surprisingly, received little attention. In the present study we consider the contribution of associative mechanisms to SoA. SoA can be measured quantitatively as a temporal linkage between voluntary actions and their external effects. Using an outcome blocking procedure, it was shown that training action-outcome associations under conditions of increased surprise augmented this temporal linkage. Moreover, these effects of surprise were correlated with schizotypy scores, suggesting that individual differences in higher level experiences are related to associative learning and to its impact on SoA. These results are discussed in terms of models of SoA, and our understanding of disrupted SoA in certain disorders.

Choice and goal-directed behavior in preschool children.

Preschool children (3-4 years old) were trained to perform two actions to gain different outcomes, in the form of video clips from different cartoons, before one of these outcomes was devalued by noncontingent exposure. The effect of outcome devaluation was subsequently assessed in an extinction test by giving children the opportunity to perform both actions in the absence of any outcomes. When the two actions were trained concurrently, performance during the test was modulated by outcome value and children showed a preference for the action trained with the currently valued outcome. By contrast, when each action was trained separately on different trials, test performance was insensitive to outcome devaluation. These effects of the training schedules are interpreted in terms of dual-process theories of action control.

Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans.

According to dual-system accounts, instrumental learning is supported by both a goal-directed and a habitual system. Although behavioral control by the goal-directed system, through outcome-action associations, dominates with moderate training, stimulus-response associations are thought to form concurrently in the habit system. It is therefore challenging to isolate the neural substrate of the goal-directed system in neuroimaging research with healthy human volunteers. Recently, however, de Wit et al. (2007) developed an instrumental discrimination task that distinguishes between goal-directed and habit-based responding. In this task, cues are congruent, unrelated, or incongruent with subsequent outcomes. Whereas performance on congruent and control trials can be supported by both the goal-directed and habitual system, performance on the incongruent discrimination relies solely on the habit system. In the present study, we used this task with healthy participants undergoing functional magnetic resonance imaging to demonstrate that engagement of the goal-directed system during learning is reflected in increased activity in the ventromedial prefrontal cortex. Moreover, using a subsequent outcome devaluation manipulation, we show that this area is involved in guiding decision making when goal values change, even in the absence of external cues to guide performance. We can therefore exclude a purely Pavlovian account of ventromedial prefrontal function and unequivocally demonstrate its involvement in the acquisition as well as deployment of goal-directed knowledge.

Appetitive and aversive taste conditioning in a computer game influences real-world decision making and subsequent activation in insular cortex.

A stimulus, by virtue of its pairing with a rewarding or an aversive outcome, can acquire motivating properties reflecting that outcome. However, there is uncertainty concerning the extent to which such properties might be carried across contexts. In the current study we sought to determine whether conditioning-dependent motivational properties can transfer from a computer game to the real world and, further, whether this conditioning might be expressed in terms of brain responses measured using functional magnetic resonance imaging (fMRI). We studied healthy participants conditioned with aversive and appetitive drinks in the context of a virtual cycling race. Three days after conditioning, participants returned for a fMRI session. We took this opportunity to observe the impact of incidental presentation of conditioned stimuli on a real-world decision (seat choice). We found a significant influence of conditioning on seat choice and, moreover, noted that individual susceptibility to this influence was reflected in differential insula cortex responses during subsequent scanning. The choice was also predicted by participants' personality scores and, as a statistical trend (p=0.07), by their sense of immersion in the game environment. Our data show that motivational properties of stimuli can transfer from the virtual to the real world. While much concern has been expressed over the impact of virtual experience on general levels of aggression and mood, our data point to another important consideration: the fact that a stimulus in the virtual environment can acquire motivational properties that persist and modify behavior in the real world.

Western scrub-jays anticipate future needs independently of their current motivational state.

Planning for the future has been considered to be a uniquely human trait [1-3]. However, recent studies challenge this hypothesis by showing that food-caching Western scrub-jays (Aphelocoma californica) can relate their previous experience as thieves to the possibility of future cache theft by another bird [4], are sensitive to the state of their caches at recovery ([5] and S. De Kort, S.P.C.C., D. Alexis, A.D., and N.S.C., unpublished data), and can plan for tomorrow's breakfast [6]. Although these results suggest that scrub-jays are capable of future planning, the degree to which these birds act independently of their current motivational state is a matter of contention. The Bischof-Köhler hypothesis [1] holds that nonhuman animals cannot anticipate and act toward the satisfaction of a future need not currently experienced or cued by their present motivational state. Using specific satiety to control for the jays' current and future motivational states, here we specifically test this hypothesis by dissociating current and future motivational states. We report that Western scrub-jays anticipate the recovery of their caches, as well as their own future needs, by acting independently of their current motivational state and immediate needs. The fact that the birds act in favor of a future need as opposed to the current one challenges the hypothesis that this ability is unique to humans.

Non-competitive liking for brands. No blocking in evaluative conditioning.

In the first experiment, we demonstrated evaluative conditioning using a novel across-modality procedure in which pictorial abstract brand logos acted as conditioned stimulus (CSs) and self-selected foods of different hedonic valence functioned as unconditioned stimuli (USs). We then investigated whether this form of learning of likes discriminates against redundant CSs using a blocking paradigm in the second experiment. The strength of evaluative conditioning accruing to the target CSs during compound training was unaffected by whether the other element of the compound was pretrained with a hedonic US. The observation that contingency learning about the target CS was blocked by the pretraining suggests that learning of likes and predictive learning are mediated by different processes.

A theory of actions and habits: The interaction of rate correlation and contiguity systems in free-operant behavior.

Contemporary theories of instrumental performance assume that responding can be controlled by 2 behavioral systems, 1 goal-directed that encodes the outcome of an action, and 1 habitual that reinforces the response strength of the same action. Here we present a model of free-operant behavior in which goal-directed control is determined by the correlation between the rates of the action and the outcome whereas the total prediction error generated by contiguous reinforcement by the outcome controls habitual response strength. The outputs of these two systems summate to generate a total response strength. This cooperative model addresses the difference in the behavioral impact of ratio and interval schedules, the transition from goal-directed to habitual control with extended training, the persistence of goal-directed control under choice procedures and following extinction, among other phenomena. In these respects, this dual-system model is unique in its account of free-operant behavior. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Evaluation of Insertion Energy as Novel Parameter for Dental Implant Stability.

Insertion energy has been advocated as a novel measure for primary implant stability, but the effect of implant length, diameter, or surgical protocol remains unclear. Twenty implants from one specific bone level implant system were placed in layered polyurethane foam measuring maximum insertion torque, torque-time curves, and primary stability using resonance frequency analysis (RFA). Insertion energy was calculated as area under torque-time curve applying the trapezoidal formula. Statistical analysis was based on analysis of variance, Tukey honest differences tests and Pearson's product moment correlation tests (α = 0.05). Implant stability (p = 0.01) and insertion energy (p < 0.01) differed significantly among groups, while maximum insertion torque did not (p = 0.17). Short implants showed a significant decrease in implant stability (p = 0.01), while reducing implant diameter did not cause any significant effect. Applying the drilling protocol for dense bone resulted in significantly increased insertion energy (p = 0.02) but a significant decrease in implant stability (p = 0.04). Insertion energy was not found to be a more reliable parameter for evaluating primary implant stability when compared to maximum insertion torque and resonance frequency analysis.

Limb-specific representation for reaching in the posterior parietal cortex.

To reach for something we see, the brain must integrate the target location with the limb to be used for reaching. Neuronal activity in the parietal reach region (PRR) located in the posterior parietal cortex represents targets for reaching. Does this representation depend on the limb to be used? We found a continuum of limb-dependent and limb-independent responses: some neurons represented targets for movements of either limb, whereas others represented only contralateral-limb targets. Only a few cells represented ipsilateral-limb targets. Furthermore, these representations were not dependent on preferred direction. Additional experiments provide evidence that the PRR is specifically involved in contralateral-limb movements: firing rates are correlated with contralateral- but not ipsilateral-limb reaction times. The current study therefore provides novel evidence that the PRR operates as a limb-dependent stage that lies further along the sensory-motor transformation for visually guided reaching than previously expected.

Resolution of conflict between goal-directed actions: outcome encoding and neural control processes.

According to O-R theory of instrumental learning, incongruent biconditional discriminations should be impossible to solve in a goal-directed manner because the event acting as the outcome of one response also acts as a discriminative stimulus for an opposite response. Each event should therefore be associated with two competing responses. However, Dickinson and de Wit (2003) have presented evidence that rats can learn incongruent discriminations. The present study investigated whether rats were able to engage additional processes to solve incongruent discriminations in a goal-directed manner. Experiment 1 provides evidence that rats resolve the response conflict that arises in the incongruent discrimination by differentially encoding events in their roles as discriminative stimulus and as outcome. Furthermore, Experiment 2 shows that once goal-directed control has been established the dorsomedial prefrontal cortex is not directly involved in its maintenance but rather plays a central role in conflict resolution processes.

Associative theories of goal-directed behaviour: a case for animal-human translational models.

Associative accounts of goal-directed action, developed in the fields of human ideomotor action and that of animal learning, can capture cognitive belief-desire psychology of human decision-making. Whereas outcome-response accounts can account for the fact that the thought of a goal can call to mind the action that has previously procured this goal, response-outcome accounts capture decision-making processes that start out with the consideration of possible response alternatives followed only in the second instance by evaluation of their consequences. We argue that while the outcome-response mechanism plays a crucial role in response priming effects, the response-outcome mechanism is particularly important for action selection on the basis of current needs and desires. We therefore develop an integrative account that encapsulates these two routes of action selection within the framework of the associative-cybernetic model. This model has the additional benefit of providing mechanisms for the incentive modulation of goal-directed action and for the development of behavioural autonomy, and therefore provides a promising account of the multi-faceted process of animal as well as human instrumental decision-making.

Detection versus sustained attention to drug cues have dissociable roles in mediating drug seeking behavior.

It is commonly thought that attentional bias for drug cues plays an important role in motivating human drug-seeking behavior. To assess this claim, two groups of smokers were trained in a discrimination task in which a tobacco-seeking response was rewarded only in the presence of 1 particular stimulus (the S+). The key manipulation was that whereas 1 group could control the duration of S+ presentation, for the second group, this duration was fixed. The results showed that the fixed-duration group acquired a sustained attentional bias to the S+ over training, indexed by greater dwell time and fixation count, which emerged in parallel with the control exerted by the S+ over tobacco-seeking behavior. By contrast, the controllable-duration group acquired no sustained attentional bias for S+ and instead used efficient detection of the S+ to achieve a comparable level of control over tobacco seeking. These data suggest that detection and sustained attention to drug cues have dissociable roles in enabling drug cues to motivate drug-seeking behavior, which has implications for attentional retraining as a treatment for addiction.