Just do it: A neuropsychological theory of agency, cognition, mood, and dopamine.

Agency is the sense that one has control over one's own actions and the consequences of those actions. Despite the critical role that agency plays in the human condition, little is known about its neural basis. A novel theory proposes that increases in agency disinhibit the dopamine system and thereby increase the number of tonically active dopamine neurons in the ventral tegmental area. The theory, called ADDS (Agency Disinhibits the Dopamine System), proposes a specific neural network that mediates these effects. ADDS accurately predicts a variety of relevant neuroscience results, and makes many novel predictions, including that increases in an agency will (a) increase motivation, (b) improve executive function, (c) facilitate procedural learning, but only in the presence of immediate trial-by-trial feedback, (d) have little or no effect on learning-related effects of stimulus repetition or on standard eyeblink conditioning, (e) facilitate the development of automatic behaviors, but have little or no effect on the production of behaviors that are already automatized, (f) amplify the cognitive benefits of positive mood, and (g) reduce pain. The implications of this new theory are considered for several purely psychological theories that assign prominent roles to agency, including self-efficacy theory, hope theory, and goal-focused positive psychotherapy. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

A general recognition theory model for identifying an ideal stimulus.

A probabilistic, multidimensional model is described that accounts for sensory and hedonic ratings that are collected from the same experiment. The model combines a general recognition theory model of the sensory ratings with Coombs' unfolding model of the hedonic ratings. The model uses sensory ratings to build a probabilistic, multidimensional representation of the sensory experiences elicited by exposure to each stimulus, and it also builds a similar representation of the hypothetical ideal stimulus in this same space. It accounts for hedonic ratings by measuring differences between the presented stimulus and the imagined ideal on each rated sensory dimension. Therefore, it provides precise estimates of the sensory qualities of the ideal on all rated sensory dimensions. The model is tested successfully against data from a new experiment.

On what it means to automatize a rule.

The results of two experiments are reported that included a combined total of approximately 633,000 categorization trials. The experiments investigated the nature of what is automatized after lengthy practice with a rule-guided behavior. The results of both experiments suggest that an abstract rule, if interpreted as a verbal-based strategy, was not automatized during training, but rather the automatization linked a set of stimuli with similar values on one visual dimension to a common motor response. The experiments were designed to test and refine a recent neurocomputational model of how rule-guided behaviors become automatic (Kovacs, Hélie, Tran, & Ashby, 2021). The model assumes that rule-guided behaviors are initially controlled by a distributed neural network centered on rule units in prefrontal cortex, and that in addition to initiating behavior, this network also trains a faster and more direct network that includes projections from visual cortex directly to the rule-sensitive neurons in premotor cortex. The present results support this model and suggest that the projections from visual cortex to prefrontal and premotor cortex are restricted to visual representations of the relevant stimulus dimension only.

Linear separability, irrelevant variability, and categorization difficulty.

In rule-based (RB) category-learning tasks, the optimal strategy is a simple explicit rule, whereas in information-integration (II) tasks, the optimal strategy is impossible to describe verbally. This study investigates the effects of two different category properties on learning difficulty in category learning tasks-namely, linear separability and variability on stimulus dimensions that are irrelevant to the categorization decision. Previous research had reported that linearly separable II categories are easier to learn than nonlinearly separable categories, but Experiment 1, which compared performance on linearly and nonlinearly separable categories that were equated as closely as possible on all other factors that might affect difficulty, found that linear separability had no effect on learning. Experiments 1 and 2 together also established a novel dissociation between RB and II category learning: increasing variability on irrelevant stimulus dimensions impaired II learning but not RB learning. These results are all predicted by the best available measures of difficulty in RB and II tasks. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

When instructions don't help: Knowing the optimal strategy facilitates rule-based but not information-integration category learning.

Providing verbal or written instructions on how to perform optimally in a task is one of the most common ways to teach beginners. This practice is so widely accepted that scholarship primarily focuses on how to provide instructions, not whether these instructions help or not. Here we investigate the benefits of prior instruction on rule-based (RB) category-learning, in which the optimal strategy is a simple explicit rule, and information-integration (II) category-learning, in which the optimal strategy is similarity-based. Participants (N = 58) learned either RB or II categories, with or without verbal and written instruction about the optimal categorization strategy. Instructions significantly improved performance with RB categories but had no effect with II categories. The theoretical and practical implication of these results is discussed. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Modulation of Dopamine for Adaptive Learning: A Neurocomputational Model.

There have been many proposals that learning rates in the brain are adaptive, in the sense that they increase or decrease depending on environmental conditions. The majority of these models are abstract and make no attempt to describe the neural circuitry that implements the proposed computations. This article describes a biologically detailed computational model that overcomes this shortcoming. Specifically, we propose a neural circuit that implements adaptive learning rates by modulating the gain on the dopamine response to reward prediction errors, and we model activity within this circuit at the level of spiking neurons. The model generates a dopamine signal that depends on the size of the tonically active dopamine neuron population and the phasic spike rate. The model was tested successfully against results from two single-neuron recording studies and a fast-scan cyclic voltammetry study. We conclude by discussing the general applicability of the model to dopamine mediated tasks that transcend the experimental phenomena it was initially designed to address.

A neurocomputational theory of how rule-guided behaviors become automatic.

This article introduces a biologically detailed computational model of how rule-guided behaviors become automatic. The model assumes that initially, rule-guided behaviors are controlled by a distributed neural network centered in the prefrontal cortex, and that in addition to initiating behavior, this network also trains a faster and more direct network that includes projections from sensory association cortex directly to rule-sensitive neurons in the premotor cortex. After much practice, the direct network is sufficient to control the behavior, without prefrontal involvement. The model is implemented as a biologically detailed neural network constructed from spiking neurons and displaying a biologically plausible form of Hebbian learning. The model successfully accounts for single-unit recordings and human behavioral data that are problematic for other models of automaticity. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

A role for the medial temporal lobes in category learning.

Despite much research, the role of the medial temporal lobes (MTL) in category learning is unclear. Two unstructured categorization experiments explored conditions that might recruit MTL category learning and memory systems-namely, whether the stimulus display includes one or two stimuli, and whether category membership depends on configural properties of the stimulus features. The results supported three conclusions. First, in agreement with prior research, learning with single stimulus displays depended on striatal-mediated procedural learning. Second, and most important, learning with pair displays was mediated by MTL declarative memory systems. Third, the use of stimuli in which category membership depends on configural properties of the stimulus features made MTL learning slightly more likely. Overall, the results suggested that the MTL are most likely to mediate learning when the participant must decide which of two configural stimuli belongs to a selected category.

Dissociations between rule-based and information-integration categorization are not caused by differences in task difficulty.

In rule-based (RB) category-learning tasks, the optimal strategy is a simple explicit rule, whereas in information-integration (II) tasks, the optimal strategy is impossible to describe verbally. Many studies have reported qualitative dissociations between training and performance in RB and II tasks. Virtually all of these studies were testing predictions of the dual-systems model of category learning called COVIS. The most prominent alternative account to COVIS is that humans have one learning system that is used in all tasks, and that the observed dissociations occur because the II task is more difficult than the RB task. This article describes the first attempt to test this difficulty hypothesis against anything more than a single set of data. First, two novel predictions are derived that discriminate between the difficulty and multiple-systems hypotheses. Next, these predictions are tested against a wide variety of published categorization data. Overall, the results overwhelmingly reject the difficulty hypothesis and instead strongly favor the multiple-systems account of the many RB versus II dissociations.

A difficulty predictor for perceptual category learning.

Predicting human performance in perceptual categorization tasks in which category membership is determined by similarity has been historically difficult. This article proposes a novel biologically motivated difficulty measure that can be generalized across stimulus types and category structures. The new measure is compared to 12 previously proposed measures on four extensive data sets that each included multiple conditions that varied in difficulty. The studies were highly diverse and included experiments with both continuous- and binary-valued stimulus dimensions, a variety of different stimulus types, and both linearly and nonlinearly separable categories. Across these four applications, the new measure was the most successful at predicting the observed rank ordering of conditions by difficulty, and it was also the most accurate at predicting the numerical values of the mean error rates in each condition.

Novel representations that support rule-based categorization are acquired on-the-fly during category learning.

Humans learn categorization rules that are aligned with separable dimensions through a rule-based learning system, which makes learning faster and easier to generalize than categorization rules that require integration of information from different dimensions. Recent research suggests that learning to categorize objects along a completely novel dimension changes its perceptual representation, making it more separable and discriminable. Here, we asked whether such newly learned dimensions could support rule-based category learning. One group received extensive categorization training and a second group did not receive such training. Later, both groups were trained in a task that made use of the category-relevant dimension, and then tested in an analogical transfer task (Experiment 1) and a button-switch interference task (Experiment 2). We expected that only the group with extensive pre-training (with well-learned dimensional representations) would show evidence of rule-based behavior in these tasks. Surprisingly, both groups performed as expected from rule-based learning. A third experiment tested whether a single session (less than 1 h) of training in a categorization task would facilitate learning in a task requiring executive function. There was a substantial learning advantage for a group with brief pre-training with the relevant dimension. We hypothesize that extensive experience with separable dimensions is not required for rule-based category learning; rather, the rule-based system may learn representations "on the fly" that allow rule application. We discuss what kind of neurocomputational model might explain these data best.

Testing analogical rule transfer in pigeons (Columba livia).

Categorization is an essential cognitive process useful for transferring knowledge from previous experience to novel situations. The mechanisms by which trained categorization behavior extends to novel stimuli, especially in animals, are insufficiently understood. To understand how pigeons learn and transfer category membership, seven pigeons were trained to classify controlled, bi-dimensional stimuli in a two-alternative forced-choice task. Following either dimensional, rule-based (RB) or information integration (II) training, tests were conducted focusing on the "analogical" extension of the learned discrimination to novel regions of the stimulus space (Casale, Roeder, & Ashby, 2012). The pigeons' results mirrored those from human and non-human primates evaluated using the same analogical task structure, training and testing: the pigeons transferred their discriminative behavior to the new extended values following RB training, but not after II training. Further experiments evaluating rule-based models and association-based models suggested the pigeons use dimensions and associations to learn the task and mediate transfer to stimuli within the novel region of the parametric stimulus space.

Linking signal detection theory and encoding models to reveal independent neural representations from neuroimaging data.

Many research questions in visual perception involve determining whether stimulus properties are represented and processed independently. In visual neuroscience, there is great interest in determining whether important object dimensions are represented independently in the brain. For example, theories of face recognition have proposed either completely or partially independent processing of identity and emotional expression. Unfortunately, most previous research has only vaguely defined what is meant by "independence," which hinders its precise quantification and testing. This article develops a new quantitative framework that links signal detection theory from psychophysics and encoding models from computational neuroscience, focusing on a special form of independence defined in the psychophysics literature: perceptual separability. The new theory allowed us, for the first time, to precisely define separability of neural representations and to theoretically link behavioral and brain measures of separability. The framework formally specifies the relation between these different levels of perceptual and brain representation, providing the tools for a truly integrative research approach. In particular, the theory identifies exactly what valid inferences can be made about independent encoding of stimulus dimensions from the results of multivariate analyses of neuroimaging data and psychophysical studies. In addition, commonly used operational tests of independence are re-interpreted within this new theoretical framework, providing insights on their correct use and interpretation. Finally, we apply this new framework to the study of separability of brain representations of face identity and emotional expression (neutral/sad) in a human fMRI study with male and female participants.

Increased cognitive load enables unlearning in procedural category learning.

Interventions for drug abuse and other maladaptive habitual behaviors may yield temporary success but are often fragile and relapse is common. This implies that current interventions do not erase or substantially modify the representations that support the underlying addictive behavior-that is, they do not cause true unlearning. One example of an intervention that fails to induce true unlearning comes from Crossley, Ashby, and Maddox (2013, Journal of Experimental Psychology: General), who reported that a sudden shift to random feedback did not cause unlearning of category knowledge obtained through procedural systems, and they also reported results suggesting that this failure is because random feedback is noncontingent on behavior. These results imply the existence of a mechanism that (a) estimates feedback contingency and (b) protects procedural learning from modification when feedback contingency is low (i.e., during random feedback). This article reports the results of an experiment in which increasing cognitive load via an explicit dual task during the random feedback period facilitated unlearning. This result is consistent with the hypothesis that the mechanism that protects procedural learning when feedback contingency is low depends on executive function. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Trial-by-trial switching between procedural and declarative categorization systems.

Considerable evidence suggests that human category learning recruits multiple memory systems. A popular assumption is that procedural memory is used to form stimulus-to-response mappings, whereas declarative memory is used to form and test explicit rules about category membership. The multiple systems framework has been successful in motivating and accounting for a broad array of empirical observations over the past 20 years. Even so, only a couple of studies have examined how the different categorization systems interact. Both previous studies suggest that switching between explicit and procedural responding is extremely difficult. But they leave unanswered the critical questions of whether trial-by-trial system switching is possible, and if so, whether it is qualitatively different than trial-by-trial switching between two explicit tasks. The experiment described in this article addressed these questions. The results (1) confirm that effective trial-by-trial system switching, although difficult, is possible; (2) suggest that switching between tasks mediated by different memory systems is more difficult than switching between two declarative memory tasks; and (3) point to a serious shortcoming of current category-learning theories.

Retinal-specific category learning.

Virtually all cognitive theories of category learning (such as prototype theory1-5 and exemplar theory6-8) view this important skill as a high-level process that uses abstract representations of objects in the world. Because these representations are removed from visual characteristics of the display, such theories suggest that category learning occurs in higher-level (such as association) areas and therefore should be immune to the visual field dependencies that characterize processing of objects mediated by representations in low-level visual areas. Here we challenge that view by describing a fully controlled demonstration of visual-field dependence in category learning. Eye-tracking was used to control gaze while participants either learned rule-based categories known to recruit prefrontal-based explicit reasoning, or information-integration categories known to depend on basal-ganglia-mediated procedural learning9. Results showed that learning was visual-field dependent with information-integration categories, but we found no evidence of visual-field dependence with rule-based categories. A theoretical interpretation of this difference is offered in terms of the underlying neurobiology. Finally, these results are situated within the broad perceptual-learning literature in an attempt to motivate further research on the similarities and differences between category and perceptual learning.

Testing Separability and Independence of Perceptual Dimensions with General Recognition Theory: A Tutorial and New R Package (grtools).

Determining whether perceptual properties are processed independently is an important goal in perceptual science, and tools to test independence should be widely available to experimental researchers. The best analytical tools to test for perceptual independence are provided by General Recognition Theory (GRT), a multidimensional extension of signal detection theory. Unfortunately, there is currently a lack of software implementing GRT analyses that is ready-to-use by experimental psychologists and neuroscientists with little training in computational modeling. This paper presents grtools, an R package developed with the explicit aim of providing experimentalists with the ability to perform full GRT analyses using only a couple of command lines. We describe the software and provide a practical tutorial on how to perform each of the analyses available in grtools. We also provide advice to researchers on best practices for experimental design and interpretation of results when applying GRT and grtools.

A neural interpretation of exemplar theory.

Exemplar theory assumes that people categorize a novel object by comparing its similarity to the memory representations of all previous exemplars from each relevant category. Exemplar theory has been the most prominent cognitive theory of categorization for more than 30 years. Despite its considerable success in providing good quantitative fits to a wide variety of accuracy data, it has never had a detailed neurobiological interpretation. This article proposes a neural interpretation of exemplar theory in which category learning is mediated by synaptic plasticity at cortical-striatal synapses. In this model, categorization training does not create new memory representations, rather it alters connectivity between striatal neurons and neurons in sensory association cortex. The new model makes identical quantitative predictions as exemplar theory, yet it can account for many empirical phenomena that are either incompatible with or outside the scope of the cognitive version of exemplar theory. (PsycINFO Database Record

Perceptual category learning and visual processing: An exercise in computational cognitive neuroscience.

The field of computational cognitive neuroscience (CCN) builds and tests neurobiologically detailed computational models that account for both behavioral and neuroscience data. This article leverages a key advantage of CCN-namely, that it should be possible to interface different CCN models in a plug-and-play fashion-to produce a new and biologically detailed model of perceptual category learning. The new model was created from two existing CCN models: the HMAX model of visual object processing and the COVIS model of category learning. Using bitmap images as inputs and by adjusting only a couple of learning-rate parameters, the new HMAX/COVIS model provides impressively good fits to human category-learning data from two qualitatively different experiments that used different types of category structures and different types of visual stimuli. Overall, the model provides a comprehensive neural and behavioral account of basal ganglia-mediated learning.

Hierarchical control of procedural and declarative category-learning systems.

Substantial evidence suggests that human category learning is governed by the interaction of multiple qualitatively distinct neural systems. In this view, procedural memory is used to learn stimulus-response associations, and declarative memory is used to apply explicit rules and test hypotheses about category membership. However, much less is known about the interaction between these systems: how is control passed between systems as they interact to influence motor resources? Here, we used fMRI to elucidate the neural correlates of switching between procedural and declarative categorization systems. We identified a key region of the cerebellum (left Crus I) whose activity was bidirectionally modulated depending on switch direction. We also identified regions of the default mode network (DMN) that were selectively connected to left Crus I during switching. We propose that the cerebellum-in coordination with the DMN-serves a critical role in passing control between procedural and declarative memory systems.