Instrumental learning and behavioral persistence in children with attention-deficit/hyperactivity-disorder: does reinforcement frequency matter?

BACKGROUND: Prominent theoretical accounts of attention-deficit/hyperactivity-disorder (ADHD) hypothesize that reinforcement learning deficits underlie symptoms of ADHD. The Dynamic Developmental Theory and the Dopamine Transfer Deficit hypothesis assume impairments in both the acquisition and extinction of behavior, especially when learning occurs under partial (non-continuous) reinforcement, and subsequently the Partial Reinforcement Extinction Effect (PREE). Few studies have evaluated instrumental learning in ADHD and the results are inconsistent. The current study investigates instrumental learning under partial and continuous reinforcement schedules and subsequent behavioral persistence when reinforcement is withheld (extinction) in children with and without ADHD. METHODS: Large well-defined samples of children with ADHD (n = 93) and typically developing (TD) children (n = 73) completed a simple instrumental learning task. The children completed acquisition under continuous (100%) or partial (20%) reinforcement, followed by a 4-min extinction phase. Two-way (diagnosis by condition) ANOVAs evaluated responses needed to reach the learning criterion during acquisition, and target and total responses during extinction. RESULTS: Children with ADHD required more trials to reach criterion compared to TD children under both continuous and partial reinforcement. After partial reinforcement, children with ADHD executed fewer target responses during extinction than TD children. Children with ADHD executed more responses than TD children during extinction, irrespective of learning condition. CONCLUSIONS: The findings demonstrate general difficulties in instrumental learning in ADHD, that is, slower learning irrespective of reinforcement schedule. They also show faster extinction following learning under partial reinforcement in those with ADHD, that is, a diminished PREE. Children with ADHD executed more responses during extinction. Results are theoretically important, with clinical implications for understanding and managing learning difficulties in those with ADHD, as they suggest poorer reinforcement learning and lower behavioral persistence.

Conditional Learning Deficits in Children with ADHD can be Reduced Through Reward Optimization and Response-Specific Reinforcement.

When children with ADHD are presented with behavioral choices, they struggle more than Typically Developing [TD] children to take into account contextual information necessary for making adaptive choices. The challenge presented by this type of behavioral decision making can be operationalized as a Conditional Discrimination Learning [CDL] task. We previously showed that CDL is impaired in children with ADHD. The present study explores whether this impairment can be remediated by increasing reward for correct responding or by reinforcing correct conditional choice behavior with situationally specific outcomes (Differential Outcomes). An arbitrary Delayed Matching-To-Sample [aDMTS] procedure was used, in which children had to learn to select the correct response given the sample stimulus presented (CDL). We compared children with ADHD (N = 45) and TD children (N = 49) on a baseline aDMTS task and sequentially adapted the aDMTS task so that correct choice behavior was rewarded with a more potent reinforcer (reward manipulation) or with sample-specific (and hence response-specific) reinforcers (Differential Outcomes manipulation). At baseline, children with ADHD performed significantly worse than TD children. Both manipulations (reward optimization and Differential Outcomes) improved performance in the ADHD group, resulting in a similar level of performance to the TD group. Increasing the reward value or the response-specificity of reinforcement enhances Conditional Discrimination Learning in children with ADHD. These behavioral techniques may be effective in promoting the learning of adaptive behavioral choices in children with ADHD.

Systematic Review: Attention-Deficit/Hyperactivity Disorder and Instrumental Learning.

OBJECTIVE: Although instrumental learning deficits are, among other deficits, assumed to contribute to attention-deficit/hyperactivity disorder (ADHD), no comprehensive systematic review of instrumental learning deficits in ADHD exists. This review examines differences between ADHD and typically developing (TD) children in basic instrumental learning and the effects of reinforcement form, magnitude, schedule, and complexity, as well as effects of medication, on instrumental learning in children with ADHD. METHOD: A systematic search of PubMed, PsyINFO, CINAHL, EMBASE+EMBASE CLASSIC, ERIC, and Web of Science was conducted for articles up to March 16, 2020. Experimental studies comparing instrumental learning between groups (ADHD versus TD) or a manipulation of reinforcement/medication within an ADHD sample were included. Quality of studies was assessed with an adapted version of the Hombrados and Waddington criteria to assess risk of bias in (quasi-) experimental studies. RESULTS: A total of 19 studies from among 3,384 non-duplicate screened articles were included. No difference in basic instrumental learning was found between children with ADHD and TD children, nor effects of form or magnitude of reinforcement. Results regarding reinforcement schedule and reversal learning were mixed, but children with ADHD seemed to show deficits in conditional discrimination learning compared to TD children. Methylphenidate improved instrumental learning in children with ADHD. Quality assessment showed poor quality of studies with respect to sample sizes and outcome and missing data reporting. CONCLUSION: The review identified very few and highly heterogenous studies, with inconsistent findings. No clear deficit was found in instrumental learning under laboratory conditions. Children with ADHD do show deficits in complex forms of learning, that is, conditional discrimination learning. Clearly more research is needed, using more similar task designs and manipulations.

Reinforcement Contingency Learning in Children with ADHD: Back to the Basics of Behavior Therapy.

Reinforcement deficits in ADHD may affect basic operant learning processes relevant for Behavioral Treatment. Behavior acquired under partial reinforcement extinguishes less readily after the discontinuation of reinforcement than behavior acquired under continuous reinforcement, a phenomenon known as the Partial Reinforcement Extinction Effect [PREE], which has great relevance for the emergence of behavioral persistence. The present study examined acquisition and extinction of operant responding under partial and continuous reinforcement in children with and without ADHD. In addition, we evaluated the effectiveness of gradual stretching the reinforcement rate during acquisition for remedying potential acquisition or extinction deficits under partial reinforcement in ADHD. In an operant learning task designed to mimic the task confronted by an animal in a Skinner box, 62 typically developing and 49 children with ADHD (age: 8-12) were presented with a continuous, partial or gradually stretching reinforcement scheme followed by extinction. Both groups of children acquired the instrumental response more slowly and exhibited more behavioral persistence (reduced extinction) when responding was initially reinforced under partial relative to continuous reinforcement, with no differences between groups. Progressive ratio stretching resulted in faster acquisition than partial reinforcement yet promoted equal behavioral persistence, again without differences between ADHD and TD groups. Unlike suggested by previous research, children with ADHD exhibit neither an acquisition deficit under partial reinforcement nor a deficit in PREE. Of relevance for Behavioral Treatment, gradual reinforcement stretching can be used to facilitate response acquisition over purely partial reinforcement while maintaining equal behavioral persistence upon reward discontinuation.