Pavlovian learning and conditioned reinforcement.

Conditioned reinforcers are widely used in applied behavior analysis. Basic research evidence reveals that Pavlovian learning plays an important role in the acquisition and efficacy of new conditioned-reinforcer functions. Thus, a better understanding of Pavlovian principles holds the promise of improving the efficacy of conditioned reinforcement in applied research and practice. This paper surveys how (and if) Pavlovian principles are presented in behavior-analytic textbooks; imprecisions and knowledge gaps within contemporary Pavlovian empirical findings are highlighted. Thereafter, six practical principles of Pavlovian conditioning are presented along with empirical support and knowledge gaps that should be filled by applied and translational behavior-analytic researchers. Innovative applications of these principles are outlined for research in language acquisition, token reinforcement, and self-control.

Reduction in X-ray Retake Rate Using the Token Economy Method.

Excessive retakes of X-ray images increase labor and material costs, as well as result in excess radiation exposure for patients and a long waiting time. In this study, we evaluated the effectiveness of the token economy method as a management method for reducing X-ray retake rate among radiology technicians. The results showed a 2.5% reduction in retake rate, indicating the effectiveness of our method. In addition, we suggest that the token-economy-based approach can be applied to other hospital management problems.

Uso de la técnica de economía de fichas para incrementar conductas de tratamiento en adultos mayores con sarcopenia / Use of a token economy to increase target behaviors in older people with sarcopenia

La sarcopenia está caracterizada por la baja masa y fuerza muscular en los adultos mayores. La implementación de técnicas de modificación de la conducta como la técnica de economía de fichas (TEF) puede fungir como estrategia para mejorar la adherencia al tratamiento. El objetivo fue evaluar el efecto de la TEF sobre las conductas de tratamiento: realizar la rutina de ejercicio de resistencia, consumir el suplemento de proteína y consumir el suplemento de vitamina D. Se realizó un estudio de caso de múltiples sujetos en ocho adultos mayores con sarcopenia. El estudio estuvo conformado por tres fases: pre-intervención, intervención conductual y post-intervención conductual. Se evaluó la frecuencia de las conductas de tratamiento en las tres fases, además de los cambios en masa y fuerza muscular. El análisis de los datos se realizó por medio de estadística descriptiva. Los resultados mostraron que la frecuencia de las conductas de tratamiento aumentó en el 100% de los participantes en la etapa de intervención conductual al comparar con la fase pre-intervención, valores que no regresaron a cero en la fase post-intervención conductual. El 83.3 % de los participantes dejaron de tener el diagnóstico de sarcopenia con base en los cambios de masa y fuerza muscular.

Sarcopenia is characterized by low muscle mass and strength in older adults. It is caused by decreased physical activity and quality of dietary intake. Therefore, the implementation of behavior modification techniques such as the token economy technique can serve as a strategy to improve treatment. The aim of the current study was to evaluate the effect of the token economy technique on treatment behaviors. A multiple case studies with an ABC-type design was conducted in eight older adults with sarcopenia. The intervention consisted of modification of treatment-related behaviors; in addition, changes in muscle mass and strength were assessed. The results showed that the frequency of target behaviors increased in 100% of the participants in the intervention stage compared to baseline. The frequency of the target behaviors did not return to the obtained baseline compared to the maintenance stage. 83.3% of the participants changed their sarcopenia diagnosis.

Using a Token Economy to Treat Escape-Maintained Problem Behavior Without Extinction.

The use of extinction procedures when treating escape-maintained problem behavior can be undesirable and impractical for practitioners to use. To mitigate the risks associated with escape extinction, we explored the effectiveness of a delayed reinforcement token system without the use of extinction in school and home settings to treat escape-maintained problem behavior of students with autism spectrum disorder. In lieu of escape extinction (e.g., blocking), the researchers implemented a 30 s break contingent on problem behaviors and a token (to be exchanged at the end of the session) contingent on compliance. The results of a multiple probe design indicated substantial increases in compliance and reductions in problem behavior for all four participants. These findings suggest that extinction is not necessary to eliminate escape-maintained problem behavior in children with autism.

Improving Beverage Choice in Adults with Developmental Disabilities: Implementation of a Token Reinforcement System in a Community Residential Setting.

Individuals with developmental disabilities (DD) are twice as likely to have obesity than non-disabled individuals. Replacing the consumption of sugar sweetened beverages (SSBs) with water has many health benefits, including weight reduction. In this study, a token reinforcement system was implemented to increase water consumption and decrease the consumption of SSBs with 14 adult participants with DD living in a community-based independent supported living (ISL) center. Token reinforcement reduced the consumption of SSBs, with associated reductions in calorie consumption and body weight. Findings are especially important for treatment settings where resources for individualized meal planning and staffing to support comprehensive behavioral interventions may be limited.

Systematic Review and Meta-Analysis of Token Economy Practices in K-5 Educational Settings, 2000 to 2019.

Token economy systems have been widely used as an evidence-based classroom management strategy to reinforce and improve prosocial responses. While token economies have been widely applied to educational settings, there have been mixed results regarding the effectiveness depending on the classroom type. To better understand the components contributing to the effectiveness, the researchers analyzed 24 token economy studies conducted in general and special education classrooms from kindergarten to fifth grade between 2000 and 2019. Eight token economy components and effect sizes were identified for each study and compared across different classroom types. The results showed that the token economy intervention yielded large effect sizes for both general and special education classroom types. There were differences in the usage of token components including backup reinforcer types, token production rate, and exchange production rate based on classroom types. Implications for future research and practice for educators and clinicians are discussed.

Mechanism Design of Health Care Blockchain System Token Economy: Development Study Based on Simulated Real-World Scenarios.

BACKGROUND: Despite the fact that the adoption rate of electronic health records has increased dramatically among high-income nations, it is still difficult to properly disseminate personal health records. Token economy, through blockchain smart contracts, can better distribute personal health records by providing incentives to patients. However, there have been very few studies regarding the particular factors that should be considered when designing incentive mechanisms in blockchain. OBJECTIVE: The aim of this paper is to provide 2 new mathematical models of token economy in real-world scenarios on health care blockchain platforms. METHODS: First, roles were set for the health care blockchain platform and its token flow. Second, 2 scenarios were introduced: collecting life-log data for an incentive program at a life insurance company to motivate customers to exercise more and recruiting participants for clinical trials of anticancer drugs. In our 2 scenarios, we assumed that there were 3 stakeholders: participants, data recipients (companies), and data providers (health care organizations). We also assumed that the incentives are initially paid out to participants by data recipients, who are focused on minimizing economic and time costs by adapting mechanism design. This concept can be seen as a part of game theory, since the willingness-to-pay of data recipients is important in maintaining the blockchain token economy. In both scenarios, the recruiting company can change the expected recruitment time and number of participants. Suppose a company considers the recruitment time to be more important than the number of participants and rewards. In that case, the company can increase the time weight and adjust cost. When the reward parameter is fixed, the corresponding expected recruitment time can be obtained. Among the reward and time pairs, the pair that minimizes the company's cost was chosen. Finally, the optimized results were compared with the simulations and analyzed accordingly. RESULTS: To minimize the company's costs, reward-time pairs were first collected. It was observed that the expected recruitment time decreased as rewards grew, while the rewards decreased as time cost grew. Therefore, the cost was represented by a convex curve, which made it possible to obtain a minimum-an optimal point-for both scenarios. Through sensitivity analysis, we observed that, as the time weight increased, the optimized reward increased, while the optimized time decreased. Moreover, as the number of participants increased, the optimization reward and time also increased. CONCLUSIONS: In this study, we were able to model the incentive mechanism of blockchain based on a mechanism design that recruits participants through a health care blockchain platform. This study presents a basic approach to incentive modeling in personal health records, demonstrating how health care organizations and funding companies can motivate one another to join the platform.

Trading mental effort for confidence in the metacognitive control of value-based decision-making.

Why do we sometimes opt for actions or items that we do not value the most? Under current neurocomputational theories, such preference reversals are typically interpreted in terms of errors that arise from the unreliable signaling of value to brain decision systems. But, an alternative explanation is that people may change their mind because they are reassessing the value of alternative options while pondering the decision. So, why do we carefully ponder some decisions, but not others? In this work, we derive a computational model of the metacognitive control of decisions or MCD. In brief, we assume that fast and automatic processes first provide initial (and largely uncertain) representations of options' values, yielding prior estimates of decision difficulty. These uncertain value representations are then refined by deploying cognitive (e.g., attentional, mnesic) resources, the allocation of which is controlled by an effort-confidence tradeoff. Importantly, the anticipated benefit of allocating resources varies in a decision-by-decision manner according to the prior estimate of decision difficulty. The ensuing MCD model predicts response time, subjective feeling of effort, choice confidence, changes of mind, as well as choice-induced preference change and certainty gain. We test these predictions in a systematic manner, using a dedicated behavioral paradigm. Our results provide a quantitative link between mental effort, choice confidence, and preference reversals, which could inform interpretations of related neuroimaging findings.

Acquisition of object-robbing and object/food-bartering behaviours: a culturally maintained token economy in free-ranging long-tailed macaques.

The token exchange paradigm shows that monkeys and great apes are able to use objects as symbolic tools to request specific food rewards. Such studies provide insights into the cognitive underpinnings of economic behaviour in non-human primates. However, the ecological validity of these laboratory-based experimental situations tends to be limited. Our field research aims to address the need for a more ecologically valid primate model of trading systems in humans. Around the Uluwatu Temple in Bali, Indonesia, a large free-ranging population of long-tailed macaques spontaneously and routinely engage in token-mediated bartering interactions with humans. These interactions occur in two phases: after stealing inedible and more or less valuable objects from humans, the macaques appear to use them as tokens, by returning them to humans in exchange for food. Our field observational and experimental data showed (i) age differences in robbing/bartering success, indicative of experiential learning, and (ii) clear behavioural associations between value-based token possession and quantity or quality of food rewards rejected and accepted by subadult and adult monkeys, suggestive of robbing/bartering payoff maximization and economic decision-making. This population-specific, prevalent, cross-generational, learned and socially influenced practice may be the first example of a culturally maintained token economy in free-ranging animals. This article is part of the theme issue 'Existence and prevalence of economic behaviours among non-human primates'.

Quantity-quality trade-off in the acquisition of token preference by capuchin monkeys (Sapajus spp.).

Money represents a cornerstone of human modern economies and how money emerged as a medium of exchange is a crucial question for social sciences. Although non-human primates have not developed monetary systems, they can estimate, combine and exchange tokens. Here, we evaluated quantity-quality trade-offs in token choices in tufted capuchin monkeys as a first step in the investigation of the generalizability of tokens as reinforcers, which is a potentially relevant factor underlying the emergence of money in humans. We measured capuchins' exchange preferences when they were repeatedly provided with 10 units of three token types yielding food combinations varying in quantity and quality. Overall, capuchins maximized their quantitative payoff, preferring tokens associated with a higher food amount, rather than showing violations of rationality. However, some individuals did not maximize their qualitative payoff, possibly because of conditional valuation effects or owing to the choice overload phenomenon, according to which too many options reduce the accuracy of choice. Our study supports the importance of comparative research to finely analyse the multiple components shaping the economic behaviours of other species, possibly to achieve a more comprehensive, evolutionary- and ecologically based understanding of human economic behaviour. This article is part of the theme issue 'Existence and prevalence of economic behaviours among non-human primates'.

Financial incentives to promote retention in care and viral suppression in adults with HIV initiating antiretroviral therapy in Tanzania: a three-arm randomised controlled trial.

BACKGROUND: Financial incentives promote use of HIV services and might support adherence to the sustained antiretroviral therapy (ART) necessary for viral suppression, but few studies have assessed a biomarker of adherence or evaluated optimal implementation. We sought to determine whether varying sized financial incentives for clinic attendance effected viral suppression in patients starting ART in Tanzania. METHODS: In a three-arm, parallel-group, randomised controlled trial at four health facilities in Shinyanga region, Tanzania, adults aged 18 years or older with HIV who had started ART within the past 30 days were randomly assigned (1:1:1) using a tablet-based application (stratified by site) to receive usual care (control group) or to receive a cash incentive for monthly clinic attendance in one of two amounts: 10 000 Tanzanian Shillings (TZS; about US$4·50) or 22 500 TZS (about $10·00). There were no formal exclusion criteria. Participants were masked to the existence of two incentive sizes. Incentives were provided for up to 6 months via mobile health technology (mHealth) that linked biometric attendance monitoring to automated mobile payments. We evaluated the primary outcome of retention in care with viral suppression (<1000 copies per mL) at 6 months using logistic regression. This trial is registered with ClinicalTrials.gov, NCT03351556. FINDINGS: Between April 24 and Dec 14, 2018, 530 participants were randomly assigned to an incentive strategy (184 in the control group, 172 in the smaller incentive group, and 174 in the larger incentive group). All participants were included in the primary intention-to-treat analysis. At 6 months, approximately 134 (73%) participants in the control group remained in care and had viral suppression, compared with 143 (83%) in the smaller incentive group (risk difference [RD] 9·8, 95% CI 1·2 to 18·5) and 150 (86%) in the larger incentive group (RD 13·0, 4·5 to 21·5); we identified a positive trend between incentive size and viral suppression (p trend=0·0032), although the incentive groups did not significantly differ (RD 3·2, -4·6 to 11·0). Adverse events included seven (4%) deaths in the control group and 11 (3%) deaths in the intervention groups, none related to study participation. INTERPRETATION: Small financial incentives delivered using mHealth can improve retention in care and viral suppression in adults starting HIV treatment. Although further research should investigate the durability of effects from short-term incentives, these findings strengthen the evidence for implementing financial incentives within standard HIV care. FUNDING: National Institute of Mental Health at the US National Institutes of Health.

Optimal Design of Population-Level Financial Incentives of Influenza Vaccination for the Elderly.

OBJECTIVES: To identify how monetary incentives affect influenza vaccination uptake rate using a randomized control experiment and to subsequently design an optimal incentive program in Singapore, a high-income country with a market-based healthcare system. METHODS: 4000 people aged ≥65 were randomly assigned to 4 treatment groups (1000 each) and were offered a monetary incentive (in shopping vouchers) if they chose to participate. The baseline group was invited to complete a questionnaire with incentives of 10 Singapore dollars (SGD; where 1 SGD ≈ 0.73 USD), whereas the other three groups were invited to complete the questionnaire and be vaccinated against influenza at their own cost of around 32 SGD, in return for incentives of 10, 20, or 30 SGD. RESULTS: Increasing the total incentive for vaccination and reporting from 10 to 20 SGD increased participation in vaccination from 4.5% to 7.5% (P < .001). Increasing the total incentive from 20 to 30 SGD increased the participation rate to 9.2%, but this was not statistically significantly different from a 20-SGD incentive. The group of nonworking elderly were more sensitive to changes in incentives than those who worked. In addition to working status, the effects of increasing incentives on influenza vaccination rates differed by ethnicity, socio-economic status, household size, and a measure of social resilience. There were no significant differential effects by age group, gender, or education, however. The cost of the program per completed vaccination under a 20-SGD incentive is 36.80 SGD, which was the lowest among the three intervention arms. For a hypothetical population-level financial incentive program to promote influenza vaccination among the elderly, accounting for transmission dynamics, an incentive between 10 and 20 SGD minimizes the cost per completed vaccination from both governmental and health system perspectives. CONCLUSIONS: Appropriate monetary incentives can boost influenza vaccination rates. Increasing monetary incentives for vaccination from 10 to 20 SGD can improve the influenza vaccination uptake rate, but further increasing the monetary incentive to 30 SGD results in no additional gains. A partial incentive may therefore be considered to improve vaccination coverage in this high-risk group.

Swiss chocolate and free beverages to increase the motivation for scientific work amongst residents: a prospective interventional study in a non-academic teaching hospital in Switzerland.

BACKGROUND: The success of a clinical trial depends on its recruitment of eligible patients; therefore, the recruitment period requires special attention. We hypothesized that with a new approach focused on continuous information and gratification, resident motivation to participate in scientific work will increase and recruitment rates will improve. METHODS: Our new recruitment approach was applied to the recruitment phase of two prospective randomized trials (registered at the German Clinical Trials Register). Randomization of these trials was performed first using blinded envelopes; later a soft drink machine was used as the delivery tool of randomization as a lighthearted motivation to join scientific work and to reward the resident with free soft drinks for each recruitment. Residents were informed about the trial via a lecture and by mail. To increase interest everyone received Swiss chocolate. With a multiple choice survey we investigated the success of our actions at 6 and 12 months. Recruitment rates of the trials were evaluated and associated with the motivational approaches. RESULTS: Our residents rated their awareness of the trials with median 9 (IQR 7;9) during the first and 8 (IQR 5;9) during the second survey and their interest in scientific work with median 7 (IQR 4;8) and 6 (IQR 5;8). The percentage of residents feeling highly motivated improved from 58% to 70%. The recruitment rates stayed stably high over time with 73% and 72% in trial 1 and 90% and 85% in trial 2; 24% of residents stated their motivation could be increased by gratifications. CONCLUSIONS: After implementation of our new recruitment approach we found positively motivated residents and high recruitment rates in the corresponding trials. We propose this procedure may help to ensure the successful initiation of clinical trials. Larger studies testing this approach are warranted.

Comparing the reinforcing efficacy of tokens and primary reinforcers.

Token economies are one of the most commonly used behavior-analytic interventions. Despite literature supporting the use of tokens as tools for behavior change, little is known about the efficacy of tokens compared to that of the items for which they are exchanged. Results of previous research comparing the reinforcing efficacy of tokens and primary reinforcers have shown that both produce similar effects on responding. However, published findings have been confounded given the inclusion of primary reinforcers in the token-reinforcer test conditions. In this study, we established novel tokens as reinforcers. We then conducted a conditioned-reinforcer assessment using a tandem control to ensure that the tokens functioned as reinforcers. We used progressive-ratio schedules to compare the reinforcing efficacy of the tokens to high- and low-preference edibles that were also used as backup reinforcers. For both participants, we found that high-preference primary reinforcers maintained higher response frequencies than did tokens.

Short- & long-term effects of monetary and non-monetary incentives to cooperate in public good games: An experiment.

Using a common experimental framework, this paper addresses both the question of the short-term and the long-lasting effects of temporary monetary and non-monetary incentive mechanisms on increasing individual contributions to the public good. The results show that both punishments and rewards significantly increase contributions compared to the baseline, but that monetary sanctions lead to the highest contributions, whereas non-monetary sanctions lead to the lowest contributions. The four types of incentives display long-lasting effects, i.e., contributions do not go back to baseline levels directly after the withdrawal of the incentives. However, rewards appear to have much stronger persistent effects than sanctions, revealing some sort of delayed reciprocity.

Financial incentives for physical activity in adults: systematic review and meta-analysis.

OBJECTIVE: The use of financial incentives to promote physical activity (PA) has grown in popularity due in part to technological advances that make it easier to track and reward PA. The purpose of this study was to update the evidence on the effects of incentives on PA in adults. DATA SOURCES: Medline, PubMed, Embase, PsychINFO, CCTR, CINAHL and COCH. ELIGIBILITY CRITERIA: Randomised controlled trials (RCT) published between 2012 and May 2018 examining the impact of incentives on PA. DESIGN: A simple count of studies with positive and null effects ('vote counting') was conducted. Random-effects meta-analyses were also undertaken for studies reporting steps per day for intervention and post-intervention periods. RESULTS: 23 studies involving 6074 participants were included (64.42% female, mean age = 41.20 years). 20 out of 22 studies reported positive intervention effects and four out of 18 reported post-intervention (after incentives withdrawn) benefits. Among the 12 of 23 studies included in the meta-analysis, incentives were associated with increased mean daily step counts during the intervention period (pooled mean difference (MD), 607.1; 95% CI: 422.1 to 792.1). Among the nine of 12 studies with post-intervention daily step count data incentives were associated with increased mean daily step counts (pooled MD, 513.8; 95% CI:312.7 to 714.9). CONCLUSION: Demonstrating rising interest in financial incentives, 23 RCTs were identified. Modest incentives ($1.40 US/day) increased PA for interventions of short and long durations and after incentives were removed, though post-intervention 'vote counting' and pooled results did not align. Nonetheless, and contrary to what has been previously reported, these findings suggest a short-term incentive 'dose' may promote sustained PA.

Using a guest- and confederate-delivered token economy to increase employee-guest interactions at a zoo.

The present study used a token economy to promote guest greetings by employees at a zoological facility. Guests and confederate guests delivered tokens to zoo employees for making eye contact from 10 ft (3.05 m) away and verbally greeting guests from 5 ft (1.52 m) away (called a 10-5 interaction) and the tokens were exchangeable for small prizes. An ABAB design was used to evaluate the intervention. Results showed increases of 35.3 and 45.0% in correct employee-guest interactions in each intervention phase compared to baseline, thus suggesting that a guest-delivered token economy is an effective way to improve guest greetings. Limitations of the current study and opportunities for future research are discussed.

An analysis of the value of token reinforcement using a multiple-schedule assessment.

Token systems are widely used in clinical settings, necessitating the development of methods to evaluate the reinforcing value of these systems. In the current paper, we replicated the use of a multiple-schedule reinforcer assessment (MSA; Smaby, MacDonald, Ahearn, & Dube, 2007) to evaluate the components of a token economy system for 4 learners with autism. Token systems had reinforcing value similar to primary reinforcers for 2 of the 4 learners, but resulted in lower rates of responding than primary reinforcers for the other 2 learners. Differentiated responding across learners may warrant variation in clinical recommendations on the use of tokens. The results of this study support formal assessment of token system effectiveness, and the MSA procedure provides an efficient method by which to conduct such assessments.

Randomized Trial of an Intervention to Improve Blood Pressure Control in Stroke Survivors.

BACKGROUND: We conducted the first-of-its kind randomized stroke trial in Africa to test whether a THRIVES (Tailored Hospital-based Risk reduction to Impede Vascular Events after Stroke) intervention improved blood pressure (BP) control among patients with stroke. METHODS AND RESULTS: Intervention comprised a patient global risk factor control report card, personalized phone text-messaging, and educational video. Four hundred patients recruited from 4 distinct medical facilities in Nigeria, aged ≥18 years with stroke-onset within one-year, were randomized to THRIVES intervention and control group. The control group also received text messages, and both groups received modest financial incentives. The primary outcome was mean change in systolic BP (SBP) at 12 months. There were 36.5% females, 72.3% with ischemic stroke; mean age was 57.2±11.7 years; 93.5% had hypertension and mean SBP was 138.33 (23.64) mm Hg. At 12 months, there was no significant difference in SBP reduction from baseline in the THRIVES versus control group (2.32 versus 2.01 mm Hg, P=0.82). In an exploratory analysis of subjects with baseline BP >140/90 mm Hg (n=168), THRIVES showed a significant mean SBP (diastolic BP) decrease of 11.7 (7.0) mm Hg while control group showed a significant mean SBP (diastolic BP) decrease of 11.2 (7.9) mm Hg at 12 months. CONCLUSIONS: THRIVES intervention did not significantly reduce SBP compared with controls. However, there was similar significant decrease in mean BP in both treatment arms in the subgroup with baseline hypertension. As text-messaging and a modest financial incentive were the common elements between both treatment arms, further research is required to establish whether these measures alone can improve BP control among stroke survivors. CLINICAL TRIAL REGISTRATION: URL: http://www.clinicaltrials.gov. Unique identifier: NCT01900756.