RESUMEN
INTRODUCTION: Emerging adults (EAs) in the criminal legal system are at high risk for substance use and related negative outcomes. EAs also have low levels of engagement in treatment services, a pattern exacerbated for those living in rural communities. This pilot study investigated implementation outcomes of task-shifting an evidence-based substance use intervention, via a developmentally targeted program, provided by probation officers (POs) to selected EA clients. METHODS: Ten POs recruited from two counties in Oregon who provide services to rural clients were trained and supported in delivering contingency management for EAs (CM-EA) to 17 EAs on their current caseloads. The pilot took place entirely during the COVID-19 pandemic. POs submitted session audiotapes and checklists from meetings with participating EA clients and participated in focus groups. EA clients completed baseline interviews and agreed to have their adult criminal records collected. Ten semi-structured interviews were completed with probation/parole administration and staff from four rural counties across three states highly impacted by the opioid epidemic about the barriers and facilitators for delivering a program like CM-EA in their offices. RESULTS: Based on self-reports and observational coding, POs demonstrated fidelity and adoption as they delivered all CM-EA components and engaged in CM-EA quality assurance protocols. Penetration was demonstrated by the selection of EAs reflecting the demographics of their local offices (i.e., White, non-Hispanic, balanced across sex), struggling with polysubstance use, and primarily holding felony convictions. Emerging themes from focus groups and interviews revealed feasibility, acceptability, and appropriateness of CM-EA, including use with clients not currently in the research program and reported intentions to continue CM-EA use. Barriers for future use include those found for the delivery of other programs in rural areas such as resource limitations. CONCLUSIONS: There is initial support for the implementation outcomes related to task-shifting a program like CM-EA to POs, particularly those serving rural clients, to increase access to evidence-based substance use services for EAs. Future research with larger samples and multiple follow-ups will allow for effectiveness testing and further program refinement for this high-priority population.
RESUMEN
BACKGROUND: Emerging adults (aged 18-26 years) are the most at-risk yet underserved age group among people with substance use disorder, especially rural emerging adults, and polysubstance use is common. Recovery capital is lower among emerging adults than older adults, and evidence-based treatments are typically unavailable or not developmentally tailored, especially in rural areas. Both supportive parents (or parental figures) and peer recovery support services (PRSS) can be leveraged to better support these emerging adults. Previous research indicates parents can be engaged to deliver contingency management (CM), an extensively researched evidence-based intervention for substance use. OBJECTIVE: This protocol describes a funded pilot of Launch, a novel, scalable service package that pairs web-based coaching for parents to deliver CM for emerging adults (CM-EA) at home and in-person PRSS with educational and vocational goal setting. Specifically, this protocol describes feasibility, acceptability, and appropriateness testing (implementation-related outcomes) and steps taken to prepare for a future large-scale trial of Launch. METHODS: Upon the recruitment of 48 emerging adult and parent pairs from sites serving primarily rural clients, participants will be randomized into 1 of 3 conditions for this randomized controlled trial: virtual parent coaching to deliver CM-EA, in-person PRSS for emerging adults, or both sets of services. Emerging adult eligibility includes polysubstance use, a substance use disorder, and availability of a consenting parent. Emerging adults will be interviewed at baseline and 6 months about substance use, quality of life, recovery capital, parental relationship, and Launch implementation-related outcomes (6-month follow-up only). Parents, peer workers delivering PRSS, and parent CM-EA coaches will be interviewed about implementation-related outcomes at the end of the study period. Peer workers and CM-EA coaches will be asked to complete checklists of services delivered after each session. Finally, payers and providers will be interviewed for additional insights into Launch implementation and to identify key outcomes of Launch. Data analysis for emerging adult outcomes will be primarily descriptive, but parent CM-EA training adherence will be assessed using nested mixed-effects regression models of repeated measures. RESULTS: Launch is currently ongoing, with funding received in August 2023, and is expected to end in September 2025, with data analysis and results in December 2026. Participants are expected to begin enrolling in June 2024. CONCLUSIONS: While this pilot is limited by the small sample size and restriction to emerging adults with an involved parent, this is mitigated by the study's strengths and is appropriate for the pilot stage. Launch uses an innovative combination of existing strategies to generate better outcomes for emerging adults while remaining scalable. This pilot will provide insights into the feasibility and acceptability of Launch from the perspectives of service recipients, providers, and payers to inform a larger-scale effectiveness trial. TRIAL REGISTRATION: ClinicalTrials.gov NCT06414993; https://clinicaltrials.gov/study/NCT06414993. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/60671.
Asunto(s)
Estudios de Factibilidad , Padres , Grupo Paritario , Trastornos Relacionados con Sustancias , Adolescente , Adulto , Femenino , Humanos , Masculino , Adulto Joven , Padres/psicología , Padres/educación , Proyectos Piloto , Trastornos Relacionados con Sustancias/rehabilitación , Trastornos Relacionados con Sustancias/terapiaRESUMEN
BACKGROUND: Risky sexual behaviour (RSB) is a serious public health problem for adolescents. We examined whether a contingency management intervention implemented by juvenile probation officers (JPOs) targeting substance use also impacted RSB. METHODS: A total of 218 adolescents on probation were randomly assigned to contingency management or to probation as usual. RESULTS: The substance use intervention delivered by JPOs reduced rates of RSB over time (ß =-0.32, P =0.041 at 6months; ß =-0.32, P =0.036 at 9months). CONCLUSIONS: Adolescents receiving a substance use intervention from JPOs demonstrated reduced/prevented RSB. Interventions targeting single risk behaviours in juvenile probation populations should measure changes in other risk behaviours . Under-resourced communities lacking clinicians might consider JPOs delivering interventions.
Asunto(s)
Trastornos Relacionados con Sustancias , Humanos , Adolescente , Trastornos Relacionados con Sustancias/prevención & control , Conducta Sexual , Asunción de RiesgosRESUMEN
Background: Adherence to intervention training implementation strategies is at the foundation of fidelity; however, few studies have linked training adherence to trainee attitudes and leadership behaviors to identify what practically matters for the adoption and dissemination of evidence-based practices. Through the conduct of this hybrid type 3 effectiveness-implementation cluster randomized controlled trial, we collected Exploration, Preparation, Implementation, and Sustainment (EPIS) data and merged it with tailored motivational interviewing training adherence data, to elucidate the relationship between provider attitudes toward evidence-based practices, leadership behaviors, and training implementation strategy (e.g., workshop attendance and participation in one-on-one coaching) adherence. Method: Our sample included data from providers who completed baseline (pre-intervention) surveys that captured inner and outer contexts affecting implementation and participated in tailored motivational interviewing training, producing a dataset that included training implementation strategies adherence and barriers and facilitators to implementation (N = 77). Leadership was assessed by two scales: the director leadership scale and implementation leadership scale. Attitudes were measured with the evidence-based practice attitude scale (EBPAS-50). Adherence to training implementation strategies was modeled as a continuous outcome with a Gaussian distribution. Analyses were conducted in SPSS. Results: Of the nine general attitudes toward evidence-based practice, openness was associated with training adherence (estimate [EST] = 0.096, p < .001; 95% CI = [0.040, 0.151]). Provider general (EST = 0.054, 95% CI = [0.007, 0.102]) and motivational interviewing-specific (EST = 0.044, 95% CI = [0.002, 0.086]) leadership behaviors were positively associated with training adherence (p < .05). Of the four motivational interviewing-specific leadership domains, knowledge and perseverant were associated with training adherence (p < .05). As these leadership behaviors increased, knowledge (EST = 0.042, 95% CI = [0.001, 0.083]) and perseverant (EST = 0.039, 95% CI = [0.004, 0.075]), so did provider adherence to training implementation strategies. Conclusions: As implementation science places more emphasis on assessing readiness prior to delivering evidence-based practices by evaluating organizational climate, funding streams, and change culture, consideration should also be given to metrics of leadership. A potential mechanism to overcome resistance is via the implementation of training strategies focused on addressing leadership prior to conducting training for the evidence-based practice of interest.
Researchers and practitioners, who aim to improve the uptake of evidence-based practices, continue to seek ways in which to improve provider participation in training implementation strategies. The persistent challenge in addressing provider disengagement, while linking this disinterest to poor patient outcomes, has been ascertaining how to quantify relevant delivery considerations, for example, provider attitudes and leadership behaviors that may influence commitment to learning or apathy to behavior change, concurrently with training adherence. Through the conduct of this study, we collected both types of data: (1) provider attitudes and leadership behaviors and (2) training adherence outcomes. We found that provider openness, general leadership behaviors, and motivational interviewing-specific leadership behaviors were associated with adherence to training implementation strategies. As more emphasis is placed on assessing clinic readiness prior to adopting new evidence-based practices, a discussion on including metrics of provider attitudes to evidence-based practice, innovation, and the specific intervention is warranted, alongside consideration for how implementation training strategies focused on addressing leadership can bolster change-supportive behaviors prior to delivery of innovations.
RESUMEN
BACKGROUND: Most implementations fail before the corresponding services are ever delivered. Measuring implementation process fidelity may reveal when and why these attempts fail. This knowledge is necessary to support the achievement of positive implementation milestones, such as delivering services to clients (program start-up) and competency in treatment delivery. The present study evaluates the extent to which implementation process fidelity at different implementation stages predicts achievement of those milestones. METHODS: Implementation process fidelity data-as measured by the Stages of Implementation Completion (SIC)-from 1287 implementing sites across 27 evidence-informed programs were examined in mixed effects regression models with sites nested within programs. Implementation process fidelity, as measured by the proportion of implementation activities completed during the three stages of the SIC Pre-Implementation phase and overall Pre-Implementation (Phase 1) and Implementation (Phase 2) proportion scores, was assessed as a predictor of sites achieving program start-up (i.e., delivering services) and competency in program delivery. RESULTS: The predicted probability of start-up across all sites was low at 35% (95% CI [33%, 38%]). When considering the evidence-informed program being implemented, that probability was nearly twice as high (64%; 95% CI [42%, 82%]), and 57% of the total variance in program start-up was attributable to the program. Implementation process fidelity was positively and significantly associated with achievement of program start-up and competency. The magnitude of this relationship varied significantly across programs for Pre-Implementation Stage 1 (i.e., Engagement) only. Compared to other stages, completing more Pre-Implementation Stage 3 (Readiness Planning) activities resulted in the most rapid gains in probability of achieving program start-up. The predicted probability of achieving competency was very low unless sites had high scores in both Pre-Implementation and Implementation phases. CONCLUSIONS: Strong implementation process fidelity-as measured by SIC Pre-Implementation and Implementation phase proportion scores-was associated with sites' achievement of program start-up and competency in program delivery, with early implementation process fidelity being especially potent. These findings highlight the importance of a rigorous Pre-Implementation process.
Asunto(s)
Práctica Clínica Basada en la Evidencia , ConocimientoRESUMEN
BACKGROUND: Knowing how future-oriented repetitive thought - i.e., repeated consideration of whether positive or negative outcomes will happen in one's future - leads to hopelessness-related cognitions may elucidate the role of anticipating the future in depressive symptoms and suicide ideation. This study examined future-event fluency and depressive predictive certainty - i.e., the tendency to make pessimistic future-event predictions with certainty - as mechanisms explaining the relation between future-oriented repetitive thought, depressive symptoms, and suicide ideation. METHODS: Young adults (N = 354), oversampled for suicide ideation or attempt history, completed baseline measures of pessimistic future-oriented repetitive thought (i.e., the degree to which people consider whether negative outcomes will happen or positive outcomes will not happen in their futures), future-event fluency, depressive predictive certainty, depressive symptoms, and suicide ideation severity and were followed up 6 months later (N = 324). RESULTS: Pessimistic future-oriented repetitive thought predicted depressive predictive certainty at 6-months, partially mediated by lower positive but not increased negative future-event fluency. There was an indirect relationship between pessimistic future-oriented repetitive thought and 6-month suicide ideation severity via 6-month depressive predictive certainty through 6-month depressive symptoms, and also via 6-month depressive symptoms (but not depressive predictive certainty) alone. LIMITATIONS: Lack of an experimental design limits inferences about causality, and a predominantly female sample may limit generalizability by sex. CONCLUSION: Clinical interventions should address pessimistic future-oriented repetitive thought - and its impact on how easily people can think about positive future outcomes - as one potential way to reduce depressive symptoms and, indirectly, suicide ideation.
Asunto(s)
Depresión , Intento de Suicidio , Adulto Joven , Humanos , Femenino , Masculino , Ideación Suicida , Predicción , CogniciónRESUMEN
Probation is a common sanction for youth substance users, and as such, juvenile probation officers (JPOs) shoulder much of the burden for treatment and rehabilitation. To improve youth outcomes and alleviate some of the burden, JPOs may seek parental involvement in the probation and substance use desistance processes. Using focus group data, we analyzed JPO perceptions of the role parents play in contingency management (CM)-an incentive system designed to produce and reward decreased substance use-and whether they perceived any value in CM. We found that most JPOs perceived parental involvement as critical to the success of both substance use treatment and CM for youth. Our findings also suggest JPOs found parental involvement in CM valuable given that CM was employed on nonstudy clients and future clients. This has implications for the practicality and sustainability of CM as a youth probation intervention.
RESUMEN
Evidence-based programs (EBPs) delivered in elementary schools show great promise in reducing risk for emotional and behavioral disorders (EBDs). However, efforts to sustain EBPs in school face barriers. Improving EBP sustainment thus represents a priority, but little research exists to inform the development of sustainment strategies. To address this gap, the Sustaining Evidenced-Based Innovations through Multi-level Implementation Constructs (SEISMIC) project will: (a) Determine if malleable individual, intervention, and organizational factors predict EBP treatment fidelity and modifications during implementation, sustainment, or both; (b) Assess the impact of EBP fidelity and modifications on child outcomes during implementation and sustainment; and (c) Explore the mechanisms through which individual, intervention, and organizational factors influence sustainment outcomes. This protocol paper describes SEISMIC, which builds upon a federally-funded RCT evaluating BEST in CLASS, a teacher-delivered program for K-3rd grade children at risk for EBDs. The sample will include 96 teachers, 384 children, and 12 elementary schools. A multi-level, interrupted time series design will be used to examine the relationship between baseline factors, treatment fidelity, modifications, and child outcomes, followed by a mixed-method approach to elucidate the mechanisms that influence sustainment outcomes. Findings will be used to create a strategy to improve EBP sustainment in schools.
RESUMEN
OBJECTIVE: Efficient and effective fidelity measurement is necessary to improve rigor and reduce burden of motivational interviewing (MI) implementation studies for both fidelity outcomes and quality improvement strategies. This article reports on such a measure developed with rigorous methodology and tested in community-based substance abuse treatment settings. METHODS: This scale development study analyzed data from a National Institute on Drug Abuse study testing the Leadership and Organizational Change for Implementation (LOCI) strategy. Utilizing item response theory (IRT) methods and Rasch modeling, we analyzed coded recordings (N = 1089) of intervention sessions of 238 providers from 60 substance use treatment clinics across nine agencies in an implementation trial focusing on MI. RESULTS: These methods yielded a reliable and valid 12-item scale representing single construct dimensionality, strong item-session maps, good rating scale functionality, and item fit. Separation reliability and absolute agreement for adjacent categories was high. No items were significantly misfitting, though one was borderline. The LOCI community providers were less likely to be scored in the advanced competence range and items were more difficult compared to the original development sample. CONCLUSIONS: The 12-item Motivational Interviewing Coach Rating Scale (MI-CRS) showed excellent performance in a large sample of community-based substance use treatment providers using real recordings. The MI-CRS is the first efficient and effective fidelity measure appropriate for diverse ethnic groups, with interventions that are MI only or interventions that integrate MI with other treatments, and with adolescents and adults. Follow-up coaching by trained supervisors may be needed for community-based providers to achieve the highest level of MI competence.
Asunto(s)
Entrevista Motivacional , Trastornos Relacionados con Sustancias , Adulto , Humanos , Adolescente , Entrevista Motivacional/métodos , Reproducibilidad de los Resultados , Trastornos Relacionados con Sustancias/diagnóstico , LiderazgoRESUMEN
There is a significant gap in research examining the prevalence of problem behaviors among youth involved in the juvenile justice system in rural areas. The current study sought to address this gap by exploring the behavioral patterns of 210 youth who were on juvenile probation in predominantly rural counties and who were identified as having a substance use disorder. First, we examined the correlation among 7 problem behaviors representing different forms of substance use, delinquency, and sexual risk-taking and 8 risk factors related to recent service utilization, internalizing and externalizing difficulties, and social support networks. Then, we used latent class analysis (LCA) to identify distinct behavioral profiles based on the observed problem behaviors. LCA identified a 3-class model representing distinct groups labeled Experimenting (70%), Polysubstance Use + Delinquent Behaviors (24%), and Diverse Delinquent Behaviors (6%). Finally, we assessed differences (i.e., ANOVA, χ2) in each risk factor across the behavioral profiles. Important similarities and differences in the association among the problem behaviors, behavioral profiles, and the risk factors were revealed. These findings underscore the need for an interconnected behavioral health model within rural juvenile justice systems that is able to address youths' multidimensional needs including criminogenic, behavioral, and physical health needs.
RESUMEN
OBJECTIVES: To evaluate the association between provider adherence to Tailored Motivational Interviewing implementation strategy and motivational interviewing (MI) competence. METHODS: 156 youth-focused HIV providers enrolled in a parent implementation science trial completed: a) quarterly standardized patient assessments (SPI) during Baseline; b) a workshop, individual coaching sessions, and quarterly SPI plus feedback during Implementation; and c) quarterly SPI during Sustainment. Competence was measured using the MI-CRS and tracking data was used to assess adherence. We examined overall adherence as well as adherence to each implementation strategy in relation to MI competence. RESULTS: Overall adherence was not associated with overall MI competence. MI competence significantly increased from Baseline to Implementation and Baseline to Sustainment. Some individual implementation strategies were associated with change in competence and the probability of achieving Intermediate/Advanced competence. CONCLUSIONS: The results suggest that 100% percent adherence to all TMI implementation strategies may not be necessary. Completing some of the TMI implementation strategies yielded improvements in MI competence. The use of routine tracking data to measure adherence maybe more pragmatic than using observational coders and more objective than self-reports. PRACTICE IMPLICATIONS: In busy HIV clinics, MI training should focus on strategies most directly associated with increased provider competence.
Asunto(s)
Competencia Clínica , Adhesión a Directriz , Entrevista Motivacional , Adolescente , Humanos , Infecciones por VIH/prevención & control , Entrevista Motivacional/métodos , Autoinforme , Adhesión a Directriz/estadística & datos numéricos , Competencia Clínica/estadística & datos numéricosRESUMEN
Accurate and timely intervention in the justice system is particularly critical in rural communities, given documented barriers to accessible, evidence-based services for youth. As youth in the juvenile justice system have a high prevalence of behavioral health needs, accurate assessment of those needs is a critical first step in linking youth to appropriate care. The goal of the current study is to examine the reliability of a brief assessment (the Brief Problem Checklist [BPC]) among a sample of 222 justice-involved youth and their caregivers who primarily reside in rural communities in the United States. Using a series of reliability analyses and tests of agreement, we examined whether youth and caregiver BPC produces reliable scales, the strength of the convergence among each of the BPC scales, and youth and caregiver agreement on the BPC scales. Findings support the reliability of the BPC, but not inter-rater reliability. Poor agreement between youth and caregiver reports exists for both youth internalizing and externalizing problems. Additionally, the BPC was significantly related to several theoretically relevant constructs, including treatment, substance use disorder severity, and family history of substance use. These findings lend merit to discussions about the need for more research on the reliability and validity of assessment instruments before their widespread use in guiding youth- and agency case planning decisions, along with informing conclusions about program effectiveness.
RESUMEN
Evidence-based practices and programs (EBPs) have been adopted in juvenile probation agencies nationwide to maximize the number of successful probation cases. However, various pragmatic studies have found that JPOs are not yielding the expected benefits when compared to efficacy studies (Lipsey et al., 2010; Taxman & Belenko, 2011). Using focus group and survey data, the current study sought to increase our understanding of the gap between pragmatic and efficacy studies in juvenile probation settings by examining JPOs' perceptions and utilization of EBPs. The findings suggest that JPOs are misunderstanding how to use EBPs in daily practice, leaving them with negative perceptions of EBPs. Implications for improving JPO understanding and use of EBPs are discussed.
RESUMEN
Purpose: This paper reports findings from a randomized controlled trial of a front-end diversion program for prison-bound individuals with property crime convictions, concurrent substance use problems, and no prior violent crime convictions. Methods: Two counties in Oregon participated in the trial, labeled "County A" and "County B." Across counties, 272 individuals (mean age = 32.7 years; 67.6% male) were recruited and randomized to receive either the diversion program (Senate Bill 416 [SB416]) or probation as usual (PAU). The primary outcome was recidivism, defined as any arrest, conviction, or incarceration for a new crime within three years of diversion from prison. Results: In County A, SB416 did not outperform PAU on any recidivism outcome. However, in County B, SB416 yielded significantly greater improvements across various configurations of the arrest, conviction, and incarceration outcomes, relative to PAU. Conclusions: SB416 can yield reduced recidivism when implemented in a setting like County B, which when compared to County A, had fewer justice system resources and a limited history of cross-system collaboration. More research on SB416 is needed, including an examination of its mechanisms of change and its cost-effectiveness relative to standard criminal justice system processing.
RESUMEN
Workplace-based clinical supervision is common in community based mental health care for youth and families and could be a leveraged to scale and improve the implementation of evidence-based treatment (EBTs). Accurate methods are needed to measure, monitor, and support supervisor performance with limited disruption to workflow. Audit and Feedback (A&F) interventions may offer some promise in this regard. The study-a randomized controlled trial with 60 clinical supervisors measured longitudinally for 7 months-had two parts: (1) psychometric evaluation of an observational coding system for measuring adherence and competence of EBT supervision and (2) evaluation of an experimental Supervisor Audit and Feedback (SAF) intervention on outcomes of supervisor adherence and competence. All supervisors recorded and uploaded weekly supervision sessions for 7 months, and those in the experimental condition were provided a single, monthly web-based feedback report. Psychometric performance was evaluated using measurement models based in Item Response Theory, and the effect of the SAF intervention was evaluated using mixed-effects regression models. The observational instrument performed well across psychometric indicators of dimensionality, rating scale functionality, and item fit; however, coder reliability was lower for competence than for adherence. Statistically significant A&F effects were largely in the expected directions and consistent with hypotheses. The observational coding system performed well, and a monthly electronic feedback report showed promise in maintaining or improving community-based clinical supervisors' adherence and, to a lesser extent, competence. Limitations discussed include unknown generalizability to the supervision of other EBTs.
Asunto(s)
Lugar de Trabajo , Adolescente , Retroalimentación , Humanos , Psicometría , Reproducibilidad de los ResultadosRESUMEN
BACKGROUND: Prescription drug misuse (PDM) is a significant public health problem associated with mental health symptoms. OBJECTIVES: This project investigates the connections between PDM motivations and mental health to inform intervention efforts. METHODS: Using nationally representative adult data from the 2016-2018 National Survey on Drug Use and Health (N = 128,205; 53% female) this project investigated which motivations for misuse are related to past-year mental health problems including any mental illness, serious mental illness, major depressive episode, and suicidal thoughts. Complex samples logistic regression models of the main motivation of PDM for each mental health problem were conducted separately for each prescription drug class (i.e., opioids, tranquilizers, sedatives, and stimulants) while controlling for demographic characteristics. RESULTS: Adults that reported PDM were more likely than those with no PDM to endorse past year mental health problems. Compared to those that reported PDM of other medications, those misusing prescription opioids and tranquilizers to help with emotions and misusing sedatives to "relax or relieve tension" were more likely to have all categories of mental health problems. Those that misused prescription stimulants to "help study" had lower odds of all mental health problems. CONCLUSIONS: While there were differences based on prescription drug class, a range of motivations increased adults' likelihood to have mental health problems and common themes were found across drug classes. While causality is still undetermined, prevention and intervention efforts that are multifaceted and individualized, while broadly providing adults with other ways to cope with negative emotions are likely to help reduce PDM.
Asunto(s)
Estimulantes del Sistema Nervioso Central , Trastorno Depresivo Mayor , Mal Uso de Medicamentos de Venta con Receta , Medicamentos bajo Prescripción , Trastornos Relacionados con Sustancias , Tranquilizantes , Adulto , Analgésicos Opioides/uso terapéutico , Estimulantes del Sistema Nervioso Central/uso terapéutico , Trastorno Depresivo Mayor/tratamiento farmacológico , Femenino , Humanos , Hipnóticos y Sedantes/uso terapéutico , Masculino , Salud Mental , Motivación , Trastornos Relacionados con Sustancias/diagnósticoRESUMEN
In juvenile probation, noncompliance with probation conditions is a common occurrence. To deal with this, juvenile probation officers (JPOs) may use different strategies, such as sanctions and incentives. This study uses survey and focus group data from 19 JPOs to evaluate their perceptions of the effectiveness of sanctions and incentives in reducing youth noncompliance, specifically in the form of substance use. Results show that there are two distinct groups of JPOs: those who believe sanctions are an effective deterrent strategy and those who do not. Perceptually and demographically these two groups contain significant differences. Notably, both groups have similar views of social incentives, but JPOs who believe sanctions are ineffective are significantly more likely to have positive views of tangible incentives. This study has implications for how the field of juvenile probation can target JPO perceptions to move toward incentive-based strategies rather than sanction-based strategies for reducing youth substance use.
RESUMEN
Background: Clinical supervision is a common quality assurance method for supporting the implementation and sustainment of evidence-based interventions (EBIs) in community mental health settings. However, assessing and supporting supervisor fidelity requires efficient and effective measurement methods. This study evaluated two observational coding approaches that are potentially more efficient than coding full sessions: a randomly selected 15-min segment and the first case discussion of the session. Method: Data were leveraged from a randomized trial of an Audit and Feedback (A&F) intervention for supervisor Adherence and Competence. Supervisors (N = 57) recorded and uploaded weekly group supervision sessions for 7 months, with one session observationally coded each month (N = 374). Of the coded sessions, one was randomly selected for each supervisor, and a random 15-min segment was coded. Additionally, the first case discussion was coded for the full sample of sessions. Results: Across all models (and controlling for the proportion of the session covered by the partial observation), Adherence and Competence scores from partial observations were positively and significantly associated with scores from full sessions. In all cases, partial observations were most accurate when the level of Adherence and Competence was moderate. At lower levels, partial observations were underestimates, and at higher levels, they were overestimates. Conclusions: The results suggest that efficient observational measurement can be achieved while retaining a general level of measurement effectiveness. Practically, first-case discussions are easier to implement, whereas 15-min segments have fewer potential threats to validity. Evaluation of resource requirements is needed, along with determining whether A&F effects are retained if feedback is based on partial observations. Nevertheless, more efficient observational coding could increase the feasibility of routine fidelity monitoring and quality assurance strategies, including A&F, which ultimately could support the implementation and sustainment of effective supervision practices and EBIs in community practice settings.Plain Language Summary: When delivering evidence-based mental health interventions in community-based practice settings, a common quality assurance method is clinical supervision. To support supervisors, assessment methods are needed, and those methods need to be both efficient and effective. Ideally, supervision sessions would be recorded, and trained coders would rate the supervisor's use of specific strategies. In most settings, though, this requires too many resources. The present study evaluated a more efficient approach. The data came from an existing randomized trial of an Audit and Feedback intervention for enhancing supervisor Adherence and Competence. This included 57 supervisors and 374 sessions across seven months of monitoring. Instead of rating full supervision sessions, a more efficient approach was to have coders rate partial sessions. Two types of partial observations were considered: a randomly selected 15-minute segment of the session and the first case discussion of the session. The aim was to see if partial observations and full observations led to similar conclusions about Adherence and Competence. In all cases, they did. The scores were most similar for sessions with moderate levels of Adherence and Competence. If Adherence and Competence were low, partial observations were underestimates, but if they were high, partial observations were overestimates. Observing partial sessions is more efficient, but in terms of accuracy, the benefits and limitations should be evaluated in light of how the scores will be used. Additionally, future research should consider whether Audit and Feedback interventions have the same effect if feedback is based on observations of partial sessions.
RESUMEN
Limited evidence-based practices exist to address the unique treatment needs of families involved in the child welfare system with parental substance abuse. Specifically, parental opioid and methamphetamine abuse have increased over the last decade, with associated increases of families reported to the child welfare system. The Families Actively Improving Relationships (FAIR) program was developed to address the complexities of these families. Evidence-based strategies to address the interrelated needs of parents-including substance abuse and mental health treatment, parent skills training, and supportive case management to improve access to ancillary needs-are integrated in an intensive community outpatient program. This study examined the clinical effectiveness of FAIR when delivered in a Medicaid billable outpatient clinic. Parents (n = 99) were randomized either to the immediate FAIR condition or to the Waitlist (WL) condition, using a dynamic wait-listed design, with all parents provided the opportunity to eventually receive FAIR. Outcomes show statistically and clinically significant reductions in parental opioid and methamphetamine use, mental health symptoms, and parenting risk, and improvements in stability in parents receiving FAIR. Providing services to families who require travel in excess of 20 miles for sessions has challenging implications for program costs under a Medicaid structure. Study outcomes highlight the need for policies to support funding of intensive family-based programs.
RESUMEN
INTRODUCTION: Studies have found that psychological treatments produce positive clinical outcomes for many problems experienced by youth. However, there is limited research on whether therapist adherence and competence in delivering these treatments are related to differential clinical outcomes. METHOD: We examined the relationship of therapist adherence and competence to clinical outcomes in a sample of 51 youth aged 7-14 years (M age = 10.36, SD = 1.90; 86.3% white; 60.8% male) treated for anxiety disorders with a manualized individual cognitive-behavioral therapy. Adherence and competence were measured via coding of recorded treatment session content and outcomes were measured by caregiver and youth report across multiple timepoints. We used two-level mixed-effects regression models to test the degree to which adherence and competence predicted differential youth clinical outcomes. RESULTS: Across multiple caregiver- and child-reported symptom and diagnostic outcomes, we found no statistically significant relationship between adherence or competence and clinical outcomes. DISCUSSION: Although there was variability in both treatment integrity and clinical outcome, neither adherence to nor competence in youth anxiety treatment was related to clinical outcomes for youth with anxiety disorders treated with individual cognitive-behavioral treatment (CBT) in a research clinic-based efficacy trial. (PsycInfo Database Record (c) 2021 APA, all rights reserved).