Instrumental learning and behavioral persistence in children with attention-deficit/hyperactivity-disorder: does reinforcement frequency matter?

BACKGROUND: Prominent theoretical accounts of attention-deficit/hyperactivity-disorder (ADHD) hypothesize that reinforcement learning deficits underlie symptoms of ADHD. The Dynamic Developmental Theory and the Dopamine Transfer Deficit hypothesis assume impairments in both the acquisition and extinction of behavior, especially when learning occurs under partial (non-continuous) reinforcement, and subsequently the Partial Reinforcement Extinction Effect (PREE). Few studies have evaluated instrumental learning in ADHD and the results are inconsistent. The current study investigates instrumental learning under partial and continuous reinforcement schedules and subsequent behavioral persistence when reinforcement is withheld (extinction) in children with and without ADHD. METHODS: Large well-defined samples of children with ADHD (n = 93) and typically developing (TD) children (n = 73) completed a simple instrumental learning task. The children completed acquisition under continuous (100%) or partial (20%) reinforcement, followed by a 4-min extinction phase. Two-way (diagnosis by condition) ANOVAs evaluated responses needed to reach the learning criterion during acquisition, and target and total responses during extinction. RESULTS: Children with ADHD required more trials to reach criterion compared to TD children under both continuous and partial reinforcement. After partial reinforcement, children with ADHD executed fewer target responses during extinction than TD children. Children with ADHD executed more responses than TD children during extinction, irrespective of learning condition. CONCLUSIONS: The findings demonstrate general difficulties in instrumental learning in ADHD, that is, slower learning irrespective of reinforcement schedule. They also show faster extinction following learning under partial reinforcement in those with ADHD, that is, a diminished PREE. Children with ADHD executed more responses during extinction. Results are theoretically important, with clinical implications for understanding and managing learning difficulties in those with ADHD, as they suggest poorer reinforcement learning and lower behavioral persistence.

The Effect of Social Information Use Without Learning on the Evolution of Social Behavior.

In a recent article by Borg and Channon it was shown that social information alone, decoupled from any within-lifetime learning, can result in improved performance on a food-foraging task compared to when social information is unavailable. Here we assess whether access to social information leads to significant behavioral differences both when access to social information leads to improved performance on the task, and when it does not: Do any behaviors resulting from social information use, such as movement and increased agent interaction, persist even when the ability to discriminate between poisonous and non-poisonous food is no better than when social information is unavailable? Using a neuroevolutionary artificial life simulation, we show that social information use can lead to the emergence of behaviors that differ from when social information is unavailable, and that these behaviors act as a promoter of agent interaction. The results presented here suggest that the introduction of social information is sufficient, even when decoupled from within-lifetime learning, for the emergence of pro-social behaviors. We believe this work to be the first use of an artificial evolutionary system to explore the behavioral consequences of social information use in the absence of within-lifetime learning.

The Long-Term Effects of Functional Communication Training Conducted in Young Children's Home Settings.

This article describes the results of a series of studies that involved functional communication training (FCT) conducted in children's homes by their parents. The 103 children who participated were six years old or younger, had developmental delays, and engaged in destructive behaviors such as self-injury. The core procedures used in each study were functional analyses (FA) and FCT conducted by parents with coaching by the investigators. The overall results of the projects showed that the FA plus FCT intervention package produced substantial reductions in destructive behavior (M = 90%), which were often maintained following treatment. In terms of behavioral momentum theory, these results suggest that analyses of behavioral persistence provide an explicit technology of maintenance.

The relationship between behavior acquisition and persistence abilities: Involvement of adult hippocampal neurogenesis.

The influence of the learning process on the persistence of the newly acquired behavior is relevant both for our knowledge of the learning/memory mechanisms and for the educational policy. However, it is unclear whether during an operant conditioning process with a continuous reinforcement paradigm, individual differences in acquisition are also associated to differences in persistence of the acquired behavior. In parallel, adult neurogenesis has been implicated in spatial learning and memory, but the specific role of the immature neurons born in the adult brain is not well known for this process. We have addressed both questions by analyzing the relationship between water maze task acquisition scores, the persistence of the acquired behavior, and the size of the different subpopulations of immature neurons in the adult murine hippocampus. We have found that task acquisition and persistence rates were negatively correlated: the faster the animals find the water maze platform at the end of acquisition stage, the less they persist in searching for it at the learned position in a subsequent non-reinforced trial; accordingly, the correlation in the number of some new neurons' subpopulations and the acquisition rate is negative while with persistence in acquired behavior is positive. These findings reveal an unexpected relationship between the efficiency to learn a task and the persistence of the new behavior after a non-reinforcement paradigm, and suggest that the immature neurons might be involved in different roles in acquisition and persistence/extinction of a learning task. © 2016 Wiley Periodicals, Inc.

Effects of inter-food interval on the variety effect in an instrumental food-seeking task. Clarifying the role of habituation.

Food variety increases consumption and the rate of instrumental behavior that is reinforced by food in humans and animals. The present experiment investigated the relationship between the variety effect and habituation to food by testing the role of the interval between successive food presentations on responding in an operant food-seeking task. Habituation to food was expected at short, but not long, interfood intervals. The effects of variety on food's long-term reinforcing value were also tested. Four groups of rats were trained to lever-press on different random-interval (RI) schedules of reinforcement to earn 45-mg food pellets. Half the rats in each group received an unpredictable mix of grain and sucrose pellets, while the other half consistently received sucrose pellets. Response rate began at a high rate and then decreased within each 30-min session for groups that received short inter-pellet intervals (i.e., RI-3 s and RI-6 s reinforcement schedules) but not in groups that received longer inter-pellet intervals (i.e., RI-12 s and RI-24 s). A variety effect in the form of higher responding in the mix group than the sucrose-only group was also only evident at the shorter intervals. Habituation and variety effects were also most evident with the short intervals when we controlled for the number of reinforcers earned, suggesting that they were not merely due to rapid satiation. The variety effect also appeared quickly when groups trained with longer inter-pellet intervals (RI-12 s and RI-24 s) were transitioned to shorter intervals (RI-3 s and RI-6 s). There was no effect of variety on resistance to extinction or on resistance to the response-suppressing effects of pre-session feeding. The results more clearly link this version of the variety effect to the short-term effect of variety on food habituation.

Maintaining exercise in fitness centre settings: insights from the physical activity maintenance theory.

PURPOSE: This study examines factors that influence long-term fitness centre participation, applying the Physical Activity Maintenance Theory to assess psychological and contextual influences on exercise adherence. METHODS: Semi-structured interviews were conducted with 17 regular fitness centre attendees in Taubaté, São Paulo, Brazil. Data were analysed using Bardin's Content Analysis, exploring the participants' experiences and the factors contributing to their sustained activity. RESULTS: Autonomous motivation, such as enjoyment and satisfaction from workouts, along with self-efficacy, emerged as crucial for continued fitness centre attendance. The environment, including ambiance, social support, and facility quality, significantly impacted exercise persistence. However, challenges like time constraints, weather conditions, and personal issues occasionally hindered engagement. The study also highlights the role of personalized fitness programmes in supporting long-term adherence, suggesting that tailoring these programmes to individual goals could further enhance commitment. CONCLUSIONS: The findings underscore the importance of fitness centres creating environments that align with individual needs and preferences. Customized programmes that cater to both personal and communal needs could bolster long-term adherence. Future research should explore the impact of personalized, community-integrated fitness approaches on sustaining active lifestyles, emphasizing the importance of accommodating individual preferences in maintaining regular exercise habits.

Modeling Behavioral Persistence with Resurgence as Choice in Context (RaC2): A Tutorial.

Resurgence as Choice in Context (RaC2) is a quantitative model for evaluating the reemergence of a previously extinguished response when alternative reinforcement is worsened. Rooted in the matching law, RaC2 proposes that allocation between target and alternative responding is based on changes in the relative value of each response option over time, accounting for periods with and without alternative reinforcement. Given that practitioners and applied researchers may have limited experience with constructing quantitative models, we provide a step-by-step task analysis for building RaC2 using Microsoft Excel 2013. We also provide a few basic learning activities to help readers better understand RaC2 itself, the variables that affect the model's predictions, and the clinical implications of those predictions. Supplementary Information: The online version contains supplementary material available at 10.1007/s40617-023-00796-y.

Using Personalized Anchors to Establish Routine Meditation Practice With a Mobile App: Randomized Controlled Trial.

BACKGROUND: Physical and mental health benefits can be attained from persistent, long-term performance of mindfulness meditation with a mobile meditation app, but in general, few mobile health app users persistently engage at a level necessary to attain the corresponding health benefits. Anchoring or pairing meditation with a mobile app to an existing daily routine can establish an unconsciously initiated meditation routine that may improve meditation persistence. OBJECTIVE: The purpose of this study was to test the use of either personalized anchors or fixed anchors for establishing a persistent meditation app routine with the mobile app, Calm. METHODS: We conducted a randomized controlled trial and randomly assigned participants to one of 3 study groups: (1) a personalized anchor (PA) group, (2) fixed anchor (FA) group, or (3) control group that did not use the anchoring strategy. All participants received app-delivered reminder messages to meditate for at least 10 minutes a day using the Calm app for an 8-week intervention period, and app usage data continued to be collected for an additional 8-week follow-up period to measure meditation persistence. Baseline, week 8, and week 16 surveys were administered to assess demographics, socioeconomic status, and changes in self-reported habit strength. RESULTS: A total of 101 participants across the 3 study groups were included in the final analysis: (1) PA (n=56), (2) FA (n=49), and (3) control group (n=62). Participants were predominantly White (83/101, 82.2%), female (77/101, 76.2%), and college educated (ie, bachelor's or graduate degree; 82/101, 81.2%). The FA group had a significantly higher average odds of daily meditation during the intervention (1.14 odds ratio [OR]; 95% CI 1.02-1.33; P=.04), and all participants experienced a linear decline in their odds of daily meditation during the 8-week intervention (0.96 OR; 95% CI 0.95-0.96; P<.001). Importantly, the FA group showed a significantly smaller decline in the linear trend of their odds of daily meditation during the 8-week follow-up (their daily trend increased by 1.04 OR from their trend during the intervention; 95% CI 1.01-1.06; P=.03). Additionally, those who more frequently adhered to their anchoring strategy during the intervention typically used anchors that occurred in the morning and showed a significantly smaller decline in their odds of daily meditation during the 8-week follow-up period (1.13 OR; 95% CI 1.02-1.35; P=.007). CONCLUSIONS: The FA group had more persistent meditation with the app, but participants in the FA or PA groups who more frequently adhered to their anchoring strategy during the intervention had the most persistent meditation routines, and almost all of these high anchorers used morning anchors. These findings suggest that the anchoring strategy can create persistent meditation routines with a mobile app. However, future studies should combine anchoring with additional intervention tools (eg, incentives) to help more participants successfully establish an anchored meditation routine. TRIAL REGISTRATION: ClinicalTrials.gov NCT04378530; https://clinicaltrials.gov/ct2/show/NCT04378530.

Persistence and resistance to extinction in the domestic dog: Basic research and applications to canine training.

This review summarizes the research investigating behavioral persistence and resistance to extinction in the dog. The first part of this paper reviews Behavioral Momentum Theory and its applications to Applied Behavior Analysis and training of pet dogs with persistent behavioral problems. I also highlight how research on Behavioral Momentum Theory can be applied to the training of detection dogs in an attempt to enhance detection performance in the presence of behavioral disruptors common in operational settings. In the second part of this review, I highlight more basic research on behavioral persistence with dogs, and how breed differences and experiences with humans as alternative sources of reinforcement can influence dogs' resistance to extinction of a target behavior. Applied Behavior Analysis and Behavior Momentum Theory have important applications for behavioral treatments to reduce the persistence of problem behavior in dogs and for the development of enhanced training methods that enhance the persistence of working dogs. Dogs can also be leveraged as natural models of stereotypic behavior and for exploring individual differences in behavioral persistence by evaluating breed and environmental variables associated with differences in canine persistance.

Relations between rate of negative reinforcement and the persistence of task completion.

Research has shown that differential reinforcement of alternative behavior (DRA) can be an effective intervention to address problem behavior maintained by negative reinforcement emitted by young children. However, few studies have evaluated the variables that are related to long-term maintenance (i.e., persistence) of treatment effects. Research on behavioral persistence predicts that the rate of reinforcement provided for a target behavior is correlated with its persistence when challenged. There were 2 purposes of the current investigation. First, we evaluated the effects of the rate of negative reinforcement on the persistence of task completion. Second, we applied the findings regarding rate of reinforcement to a treatment context for 3 participants who engaged in destructive behavior that was reinforced by escape from demands. Results were evaluated within a multielement design and indicated that the rate of negative reinforcement had a moderate influence on the persistence of task completion. These results contribute to the existing literature by extending analyses of persistence to treatment contexts.

Examining Early Behavioral Persistence as a Dynamic Process: Correlates and Consequences Spanning Ages 3-10 Years.

We investigated systematic changes in 3-year-olds' effortful persistence in a dyadic problem-solving context and explored their correlates (i.e., parenting behavior and demographic characteristics at 3 years) and consequences (i.e., child externalizing behavior at 3, 6, and 10 years) within a sample of 241 middle-income families (118 girls). Results indicated that children may be grouped into three classes based on their behavioral profiles of persistence. Children who were highly persistent over the course of the task were more likely to have higher levels of IQ and mothers who were observed to be more behaviorally responsive than those who showed consistently low levels of task-related behavior. Additionally, children who demonstrated stably low levels of persistence were rated by teachers to display more externalizing behavior at 6 and 10 years than those in the other groups. Profiles of persistence did not predict concurrent levels of child externalizing behavior at the age of 3 years. The findings are discussed with respect to expanding the scope of research on child self-regulation by defining it as a time based construct and tracking its dynamic changes.

Contextual Influences on Distress Intolerance: Priming Effects on Behavioral Persistence.

Distress intolerance (DI), the inability to tolerate stressful experiences, has been linked to multiple psychiatric conditions and maladaptive coping patterns. Although DI is often considered a trait-like variable, evidence indicates that self-report and behavioral indices of DI can be manipulated by contextual factors. Understanding such contextual influences is important given evidence of unexpected variability in these presumed trait-like measures over brief intervals. The current study examined the influence of context (manipulated by priming concepts of "Interminability" and "Brevity") in predicting behavioral persistence, in relation to self-reported DI. Results indicated that priming Brevity was associated with terminating a cold-pressor task more quickly. Self-reported DI was linked to earlier termination, but there was no interaction between self-reported DI and priming condition. Results indicate that contextual cues modulate performance on behavioral measures of DI. Hence, models of DI should consider both trait-like and contextual factors in understanding variability in DI measures.

Association between increased behavioral persistence and stereotypy in the pet dog.

The aim of the present study was to evaluate whether dogs that exhibit stereotypy also show higher behavioral persistence in an extinction-learning task. Thirteen pet dogs with stereotypy and 13 breed-matched control dogs were assessed on a resistance to extinction test. Each dog was trained for 40 trials using a food reinforcer to nose-touch the experimenter's hand on a continuous reinforcement schedule. After acquisition, the dogs entered an extinction phase, during which food was no longer delivered. The numbers of nose-touches as well as inter-response times during this phase were recorded. A linear regression found that stereotypy status (t=-2.46, P=.027) and breed type (t=2.44, P=.023) were significant predictors of the number of responses in extinction. Dogs with stereotypy responded more in extinction than control dogs. The mean number of responses was 13.4 (SD=14.7) in the control group and 26.0 (SD=15.3) in the stereotypy group. These results suggest a link between previous laboratory and zoo animal findings on the neurophysiology of stereotypy and the pet dog population. They also have implications for the use of extinction procedures to reduce stereotypic behaviors in pet dogs, as these dogs show enhanced resistance to extinction.

Extensão da história em FR e o desempenho subsequente em FI com custo / History extension in FR and the subsequent performance in FI-cost

Resumo Alguns estudos indicam que taxas altas de respostas, produzidas por uma história de exposição ao esquema FR, tendem a persistir no esquema FI-custo. Todavia, esse resultado é controverso. Nos estudos em que foi observada a persistência de taxas altas, a extensão da história em FR era de 10 h e, naqueles em que não houve persistência, a extensão do FR foi de 45 min a 3 h. O presente trabalho investigou o efeito da extensão da história de reforço sobre a persistência comportamental. Três grupos de participantes foram expostos a diferentes extensões de treino em FR (2 h 30 min, 5 h e 10 h), seguido por FI-custo. Os resultados indicaram diminuição da taxa de respostas para a maioria dos participantes; quando houve persistência comportamental, ela não foi correlacionada com a extensão da história.

Abstract Some studies have indicated that high response rate, produced by a exposition history to a FR, persist in a FI-cost. However, this is a controversial result. In studies which high response rate was observed, the FR extension history was 10 hours and in those which no persistence was seen the duration of FR ranged from 45 minutes to 3 hours. The present paper investigated the effect of the extension of history of reinforcement on behavioral persistence. Three groups of participants were exposed to different training extensions in FR (2 h 30 min; 5 h e 10 h), followed by an FI-cost. The results indicated a decrease on the response rate to most participants; when behavioral persistence happened was not correlated to history extension.

Resistance to disruption in a classroom setting.

Substantial experimental evidence indicates that behavior reinforced on a denser schedule is more resistant to disruption than is behavior reinforced on a thinner schedule. The present experiment studied resistance to disruption in a natural educational environment. Responding during familiar activities was reinforced on a multiple variable-interval (VI) 7-s VI 30-s schedule for 6 participants with developmental disabilities. Resistance to disruption was measured by presenting a distracting item. Response rates in the disruption components were compared to within-session response rates in prior baseline components. Results were consistent with the predictions of behavioral momentum theory for 5 of 6 participants.

An evaluation of persistence of treatment effects during long-term treatment of destructive behavior.

Eight young children who displayed destructive behavior maintained, at least in part, by negative reinforcement received long-term functional communication training (FCT). During FCT, the children completed a portion of a task and then touched a communication card attached to a microswitch to obtain brief breaks. Prior to and intermittently throughout FCT, extinction probes were conducted within a withdrawal design in which task completion, manding, and destructive behavior were placed on extinction to evaluate the relative persistence of appropriate and destructive behavior over the course of treatment. FCT continued until appropriate behavior persisted and destructive behavior failed to recur at baseline levels during extinction probes. The completion of FCT was followed by four challenges to the persistence of treatment effects conducted within mixed- or multiple-schedule designs: (a) extended extinction sessions (from 5 to 15 min), (b) introduction of a novel task, (c) removal of the microswitch and communication card, and (d) a mixed schedule of reinforcement in which both appropriate and destructive behavior produced reinforcement. The results showed that although FCT often resulted in quick reductions in destructive behavior and increases in appropriate behavior, destructive behavior often recurred during the extinction probes conducted during the initial treatment. When the effects of treatment persisted during the extinction probes, the remaining challenges to treatment effects resulted in only mild to moderate disruptions in behavior. These results are consistent with the quantitative predictions of behavioral momentum theory and may provide an alternative definition of maintenance as constituting behavioral persistence.