A Practitioner's Guide to Measuring Procedural Fidelity.

Ensuring high levels of procedural fidelity during behavior-analytic interventions is a crucial component of providing effective behavior-analytic services. However, few resources are available to help guide practitioners through measuring procedural fidelity. In fact, most published behavior-analytic research on procedural fidelity analyzes a single treatment procedure, which might not completely reflect the process of monitoring and addressing the procedural fidelity of a robust treatment package that might be necessary in clinical settings. The purpose of this article is to guide behavior analysts through the process of creating and using procedural fidelity measurement systems, with a focus on direct observation of implementation as a means of fidelity data collection. This process consists of six steps: (1) task analyze treatment procedures into measurable units; (2) assign measures to each treatment component; (3) plan the direct observation; (4) collect procedural fidelity data; (5) analyze and interpret procedural fidelity data; and (6) take action to improve procedural fidelity. Each step is described and discussed in the article.

Comparison of Enhanced and Standard Data Sheets on Treatment Fidelity and Data Collection for Tact Training.

Specifically designed data sheets have been recommended to assist with the fidelity of implementation of treatment procedures. The present study extended previous research (e.g., Bottini et al. Behavior Analysis: Research & Practice 21(2), 140-152, 2021; LeBlanc et al. Behavior Analysis in Practice 13(1), 53-62, 2020) by comparing an enhanced data sheet (i.e., the inclusion of randomized targets, prompts for treatment components of securing attending and reinforcement) to a standard data sheet (i.e., targets not preset, no prompts for treatment components) on the fidelity of tact training of features. Ten behavior therapists participated in each condition (n = 20). Participants first watched a brief instructional video explaining the teaching procedure and their assigned data sheet, followed by conducting a treatment session with a confederate serving as a child with autism spectrum disorder. The enhanced data sheet resulted in higher fidelity on multiple variables including randomizing of targets and data collection.

Defining the therapeutic relationship in the context of alcohol use, other drug use, and behavior change: Principles and practices.

OVERVIEW: This article contributes to knowledge and practice of core processes that are shared by evidence-based alcohol or other drug (AOD) therapies. It is the fourth in a series with this aim, and here we discuss perhaps the most universally acknowledged ingredient of effective therapy - the therapeutic relationship. We consider various related terms and definitions in the literature, but in the present review, we offer a definition that underscores the context of behavior change. METHOD: This study conducted a literature review and qualitative content analysis to derive a set of principles and practices for facilitating and maintaining the therapeutic relationship. The sources for this review included government-issued practice guidelines, therapy manuals or books, demonstration videos, and peer-reviewed articles (61 sources). The content analysis was performed in NVIVO, and reliability analysis showed moderate agreement between raters (kappa = 0.60). RESULTS: Six principles and 16 practices were identified. The distribution of principles and practices could be broken into three categories: 1) the facilitation of client behavior change mechanisms (i.e., self-determination, motivation, self-efficacy), 2) partnership considerations (e.g., goal and task alignment), and 3) therapist interpersonal skills (e.g., empathy). CONCLUSIONS: The therapeutic relationship is foundational to the behavior change process. We frame it as a combination of broader interpersonal considerations and attention to key mechanisms of client behavior change. The present work provides a novel resource for trainees, clinicians, and clinical supervisors interested in fostering therapy relationships with clients in AOD or other behavior change settings.

Metacognitive therapy versus exposure and response prevention for obsessive-compulsive disorder - A non-inferiority randomized controlled trial.

OBJECTIVE: Exposure with response prevention (ERP) is the first-line treatment for obsessive-compulsive disorder (OCD). However, refusals, dropouts and the required high time and logistic effort constitute barriers to the use of ERP. In a non-inferiority randomized controlled trial, we compared metacognitive therapy (MCT) to exposure with response prevention (ERP) as treatments for OCD. METHOD: 74 outpatients received 12 weekly sessions of either manualized MCT or ERP, with primary outcomes assessed by blinded assessors using the Yale-Brown Obsessive Compulsive Scale (Y-BOCS) at pre-treatment, mid-treatment, post-treatment, and 6-month follow-up. Secondary outcomes included measures of depression and anxiety. Non-inferiority margin was specified at no less than d = 0.38 below the improvement reached by ERP, corresponding to a difference of about 3 points on the Y-BOCS. RESULTS: Drop-out rates were low (<14%) and similar in both groups. Linear models indicated non-inferiority of MCT to ERP at post-treatment, but not at 6-month follow-up. While both groups showed comparable Y-BOCS improvements, the MCT group demonstrated a significantly greater reduction in state anxiety scores at post-treatment and follow-up. CONCLUSIONS: Overall, MCT was not inferior to ERP, especially at post-treatment, suggesting it could be a treatment alternative. However, further research is needed to explore differential treatment indications.

Using Adherence and Competence Measures Based on Practice Elements to Evaluate Treatment Fidelity for Two CBT Programs for Youth Anxiety.

Measures designed to assess the quantity and quality of practices found across treatment programs for specific youth emotional or behavioral problems may be a good fit for evaluating treatment fidelity in effectiveness and implementation research. Treatment fidelity measures must demonstrate certain reliability and validity characteristics to realize this potential. This study examines the extent to which two observational measures, the Cognitive-Behavioral Treatment for Anxiety in Youth Adherence Scale (CBAY-A) and the CBAY Competence Scale (CBAY-C), can assess the quantity (the degree to which prescribed therapeutic techniques are delivered as intended) or quality (the competence with which prescribed techniques are delivered) of practices found in two distinct treatment programs for youth anxiety. Treatment sessions (N = 796) from 55 youth participants (M age = 9.89 years, SD = 1.71; 46% female; 55% White) with primary anxiety problems who participated in an effectiveness study were independently coded by raters who coded quantity, quality, and the youth-clinician alliance. Youth received one of three treatments: (a) standard (i.e., cognitive-behavioral therapy program), (b) modular (i.e., a cognitive-behavioral and parent-training program), and (c) usual clinical care. Interrater reliability for the CBAY-A items was good across the standard and modular conditions but mixed for the CBAY-C items. Across the standard and modular conditions, the CBAY-A Model subscale scores demonstrated evidence of construct validity, but the CBAY-C Model subscale scores showed mixed evidence. The results provide preliminary evidence that the CBAY-A can be used across different treatment programs but raise concerns about the generalizability of the CBAY-C.

A RCT to explore the effectiveness of supporting adherence to nebuliser medication in adults with cystic fibrosis: fidelity assessment of study interventions.

BACKGROUND: A multi-component self-management intervention 'CFHealthHub' was developed to reduce pulmonary exacerbations in adults with Cystic Fibrosis (CF) by supporting adherence to nebuliser medication. It was evaluated in a randomized controlled trial (RCT) involving 19 CF centres, with 32 interventionists, 305 participants in the intervention group, and 303 participants in the standard care arm. Ensuring treatment fidelity of intervention delivery was crucial to ensure that the intervention produced the expected outcomes. METHODS: Fidelity of the CFHealthHub intervention and standard care was assessed using different methods for each of the five fidelity domains defined by the Borrelli framework: study design, training, treatment delivery, receipt, and enactment. Study design ensured that the groups received the intended intervention or standard care. Interventionists underwent training and competency assessments to be deemed certified to deliver the intervention. Audio-recorded intervention sessions were assessed for fidelity drift. Receipt was assessed by identifying whether participants set Action and Coping Plans, while enactment was assessed using click analytics on the CFHealthHub digital platform. RESULTS: Design: There was reasonable agreement (74%, 226/305) between the expected versus actual intervention dose received by participants in the CFHealthHub intervention group. The standard care group did not include focused adherence support for most centres and participants. Training: All interventionists were trained. Treatment delivery: The trial demonstrated good fidelity (overall fidelity by centre ranged from 79 to 97%), with only one centre falling below the mean threshold (> 80%) on fidelity drift assessments. Receipt: Among participants who completed the 12-month intervention, 77% (205/265) completed at least one action plan, and 60% (160/265) completed at least one coping plan. Enactment: 88% (268/305) of participants used web/app click analytics outside the intervention sessions. The mean (SD) number of web/app click analytics per participant was 31.2 (58.9). Additionally, 64% (195/305) of participants agreed to receive notifications via the mobile application, with an average of 53.6 (14.9) notifications per participant. CONCLUSIONS: The study demonstrates high fidelity throughout the RCT, and the CFHealthHub intervention was delivered as intended. This provides confidence that the results of the RCT are a valid reflection of the effectiveness of the CFHealthHub intervention compared to standard care. TRIAL REGISTRATION: ISRCTN registry: ISRCTN55504164 (date of registration: 12/10/2017).

Exploring the Use of the Picture Exchange Communication System (PECS) in Special Education Settings.

The Picture Exchange Communication System (PECS) is an Augmentative and Alternative Communication (AAC) system which is widely used to support children with developmental disabilities. In the present study, we surveyed individuals responsible for implementing PECS in special educational settings in the United Kingdom (N=283). We explored knowledge of and adherence to the  intervention, with a view to identifying training and support needs. Specifically, we examined participants' knowledge, implementation accuracy, training experiences, access to resources, and attitudes towards PECS. We developed hierarchical logistic regression models to explore the association between training experience and both knowledge and use of PECS. We pre-registered our methods, predictions and the analysis plan on the Open Science Framework (OSF).We found considerable variation in practitioner knowledge and implementation of PECS. Formal training predicted greater knowledge and more accurate implementation when practitioner role and the degree of setting support were accounted for. While PECS was rated by a large majority to be effective and practical, many participants identified that time and the availability of resources were barriers to implementation. We also found that the purpose of PECS was not always fully understood by practitioners, and we identified some consistent gaps in knowledge and implementation.  This study contributes new information regarding the real-world  use of PECS in educational settings and offers new insights for supporting practitioners.

A case study of pragmatic measure development of the Treatment Integrity for Elementary Settings self-report measure for teachers.

Introduction: Due to usability, feasibility, and acceptability concerns, observational treatment fidelity measures are often challenging to deploy in schools. Teacher self-report fidelity measures with specific design features might address some of these barriers. This case study outlines a community-engaged, iterative process to adapt the observational Treatment Integrity for Elementary Settings (TIES-O) to a teacher self-report version designed to assess the use of practices to support children's social-emotional competencies in elementary classrooms. Method: Cognitive walkthrough interviews were conducted with teachers to improve the usability of the teacher self-report measure, called the Treatment Integrity for Elementary Schools-Teacher Report (TIES-T). Qualitative content analysis was used to extract themes from the interviews and inform changes to the measure. Results: Increasing clarity and interactive elements in the measure training were the dominant themes, but suggestions for the measure format and jargon were also suggested. Conclusion: The suggested changes resulted in a brief measure, training, and feedback system designed to support the teacher's use of practices to support children's social-emotional competencies in elementary classrooms. Future research with the TIES-T will examine the score reliability and validity of the measure.

Collecting observational data in schools is challenging, so developing teacher self-report measures and involving teachers in the design process is important to help make them easier to use. This paper reports on the development of a teacher self-report measure designed to collect information about the instructional practices teachers deliver to promote positive student behavior.

Ensuring treatment fidelity in intervention studies: Developing a checklist and scoring system within a behaviour change paradigm.

BACKGROUND: Treatment fidelity refers to the degree to which an intervention is implemented as intended. Promoting treatment fidelity is important to achieve a valid comparison in intervention research. However, it is often underreported: few studies detail the use and development of fidelity measures. This study aims to promote the treatment fidelity of a modified version of the Derbyshire Language Scheme (M-DLS), a manualised intervention for children with language difficulties, by exploring participants' opinions on training and intervention delivery. Results inform development of a checklist and scoring system to monitor and promote treatment fidelity in a comparison trial. METHOD: Ten student speech and language therapists (SLTs) and two research assistants (RAs) participated in the study. All received training on the M-DLS, and 10 were video-recorded completing role-plays of an M-DLS session in small groups. Feedback was gathered after training and role-plays in focus groups and interviews. Feedback was interpreted using the constructs of the Theoretical Domains Framework (TDF). A treatment fidelity checklist was then developed using the feedback. The first author and two RAs rated role-play videos using the checklist to trial it to inform amendments and to promote interrater reliability. Interrater agreement was calculated using Spearman's test of correlation. RESULTS: Participants discussed the importance of having clear materials and time to practise sessions. They suggested amendments to the materials and training to promote treatment fidelity. The checklist and scoring system accounted for participants' suggestions, with amendments detailed in a log. Spearman's correlation results suggested agreement between the raters was strong. CONCLUSIONS: Results emphasise the importance of training quality, practice and reflective opportunities and clear materials to promote treatment fidelity. The construction of the checklist and scoring system was described in detail, informing the development of future checklists. After further trialling, the checklist can be used to ensure the M-DLS is delivered with high treatment fidelity in the comparison trial. WHAT THIS PAPER ADDS: What is already known on this subject Treatment fidelity is an essential component of intervention effectiveness and efficacy studies, ensuring the intervention is delivered as intended. It is also an essential component of evidence-based clinical practice. However, few research studies report the treatment fidelity process or publish the checklists used, depriving clinicians of useful information for implementation. What this study adds This study describes in detail the iterative process of treatment fidelity checklist development, engaging those implementing the intervention in development. This ensured clarity and interrater reliability of the checklist. Furthermore, a novel scoring system was developed so that accuracy of implementation can be easily compared across users and across practice attempts. What are the clinical implications of this work? The importance of treatment fidelity when implementing effective and efficacious interventions cannot be overstated. The treatment fidelity checklist developed for research can be easily adopted to support accurate implementation in clinical practice through an audit process.

Understanding the Role of Therapist Quality in Accounting for Heterogeneity of Patient Outcomes in Psychosocial Chronic Pain Treatments.

A variety of evidence-based psychosocial treatments now exist for chronic pain. However, on average, effect sizes have tended to be modest and there is a high degree of heterogeneity in treatment response. In this focus article, we explore the potential role that therapist quality in delivering treatment may have in accounting for a degree of this variability in outcome. Therapist quality refers to the skillful delivery of treatment, harnessing both specific and common therapeutic factors during sessions. While recognized as important to assess and report in clinical trials by some reporting guidelines, few randomized controlled trials evaluating psychosocial treatments for chronic pain have reported on therapist factors. We reviewed the clinical trials included in three systematic reviews and meta-analyses of trials of cognitive-behavioral therapy (mainly), mindfulness-based interventions, and acceptance and commitment therapy. We found that of the 134 trials included, only nine assessed and reported therapist quality indicators, with a variety of procedures used. This is concerning as without knowledge of the quality in which treatments are delivered, the estimates of effect sizes reported may be misrepresented. We contextualize this finding by drawing on the broader psychotherapy literature which has shown that more skillful, effective therapists demonstrated ten times better patient response rates. Examination of the characteristics associated with these more effective therapists tends to indicate that skillful engagement of common factors in therapy sessions represents a distinguishing feature. We conclude by providing recommendations for assessing and reporting on therapist quality within clinical trials evaluating psychosocial treatments for chronic pain. PERSPECTIVE: Therapist quality in the delivery of psychosocial treatments for chronic pain has rarely been assessed in clinical trials. We propose that therapist quality indicators are an under-studied mechanism that potentially contributes to the heterogeneity of treatment outcomes. We provide recommendations for assessing and reporting on therapist quality in future trials.

Developing and Implementing a Culturally Consonant Treatment Fidelity Support Plan with the Apsáalooke Nation.

Treatment fidelity remains underreported in health intervention research, particularly among Indigenous communities. One explanation for this gap is the lack of culturally consonant strategies listed in the National Institutes of Health (NIH) Behavior Change Consortium (BCC) treatment fidelity framework, the gold standard for understanding and measuring fidelity. This paper focuses on the development and implementation of a culturally consonant treatment fidelity support plan across two of the five BCC fidelity areas, provider training and treatment delivery, within a chronic illness self-management program for the Apsáalooke (Crow) Nation. Our team selected and adapted strategies from, and added strategies to, the BCC framework, that centered on relational accountability and the Apsáalooke culture. To be culturally consonant, we approached treatment fidelity as supporting Aakbaabaaniilea (Apsáalooke program facilitators) rather than monitoring them. This resulted in the development of a fifth treatment fidelity area: building and fostering relationships. We propose that fidelity to relational accountability is the foundation of successful programs in Indigenous communities. This suggests an important shift from tracking what was conducted in an intervention to prioritizing how things were conducted. We encourage others to view the BCC framework as a starting point in developing fidelity strategies that are consonant with local cultures.

A machine learning approach to improve implementation monitoring of family-based preventive interventions in primary care.

Background: Evidence-based parenting programs effectively prevent the onset and escalation of child and adolescent behavioral health problems. When programs have been taken to scale, declines in the quality of implementation diminish intervention effects. Gold-standard methods of implementation monitoring are cost-prohibitive and impractical in resource-scarce delivery systems. Technological developments using computational linguistics and machine learning offer an opportunity to assess fidelity in a low burden, timely, and comprehensive manner. Methods: In this study, we test two natural language processing (NLP) methods [i.e., Term Frequency-Inverse Document Frequency (TF-IDF) and Bidirectional Encoder Representations from Transformers (BERT)] to assess the delivery of the Family Check-Up 4 Health (FCU4Health) program in a type 2 hybrid effectiveness-implementation trial conducted in primary care settings that serve primarily Latino families. We trained and evaluated models using 116 English and 81 Spanish-language transcripts from the 113 families who initiated FCU4Health services. We evaluated the concurrent validity of the TF-IDF and BERT models using observer ratings of program sessions using the COACH measure of competent adherence. Following the Implementation Cascade model, we assessed predictive validity using multiple indicators of parent engagement, which have been demonstrated to predict improvements in parenting and child outcomes. Results: Both TF-IDF and BERT ratings were significantly associated with observer ratings and engagement outcomes. Using mean squared error, results demonstrated improvement over baseline for observer ratings from a range of 0.83-1.02 to 0.62-0.76, resulting in an average improvement of 24%. Similarly, results demonstrated improvement over baseline for parent engagement indicators from a range of 0.81-27.3 to 0.62-19.50, resulting in an approximate average improvement of 18%. Conclusions: These results demonstrate the potential for NLP methods to assess implementation in evidence-based parenting programs delivered at scale. Future directions are presented. Trial registration: NCT03013309 ClinicalTrials.gov.

Research has shown that evidence-based parenting programs effectively prevent the onset and escalation of child and adolescent behavioral health problems. However, if they are not implemented with fidelity, there is a potential that they will not produce the same effects. Gold-standard methods of implementation monitoring include observations of program sessions. This is expensive and difficult to implement in delivery settings with limited resources. Using data from a trial of the Family Check-Up 4 Health program in primary care settings that served Latino families, we investigated the potential to make use of a form of machine learning called natural language processing (NLP) to monitor program delivery. NLP-based ratings were significantly associated with independent observer ratings of fidelity and participant engagement outcomes. These results demonstrate the potential for NLP methods to monitor implementation in evidence-based parenting programs delivered at scale.

Pragmatic fidelity measurement in youth service settings.

Background: Fidelity measurement is critical for developing, evaluating, and implementing evidence-based treatments (EBTs). However, traditional fidelity measurement tools are often not feasible for community-based settings. We developed a short fidelity rating form for the Collaborative Problem Solving (CPS) approach from an existing manualized coding system that requires extensive training. We examined the reliability and accuracy of this short form when completed by trained observers, untrained observers, and self-reporting providers to evaluate multiple options for reducing barriers to fidelity measurement in community-based settings. Methods: Community-based treatment providers submitted recordings of youth service sessions in which they did, or did not, use CPS. For 60 recordings, we compared short-form fidelity ratings assigned by trained observers and untrained observers to those provided by trained observers on the manualized coding system. For 141 recordings, we compared providers' self-reported fidelity on the short form to ratings provided by trained observers on the manualized coding system and examined providers' accuracy as a function of their global fidelity. Results & Conclusions: The short form was reliable and accurate for trained observers. An assigned global integrity score and a calculated average of component scores on the short form, but not component scores themselves, were reliable and accurate for observers who had CPS expertise but no specific training on rating CPS fidelity. When providers self-reported fidelity on the short form, their global integrity score was a reliable estimate of their CPS integrity; however, providers with better CPS fidelity were most accurate in their self-reports. We discuss the costs and benefits of these more pragmatic fidelity measurement options in community-based settings.

Developing brief, easy-to-use, and reliable tools to measure how well providers deliver evidence-based treatments (EBTs) in community clinical settings is critical to ensure the benefits of EBTs. However, reliable tools are often too time-consuming and not feasible to use in community settings because they require independent observers to receive intensive training on a coding system and to observe live or recorded treatment sessions for reliable and accurate evaluation. This paper describes steps we took to develop a more practical measure of how well providers deliver one EBT, Collaborative Problem Solving (CPS), based on a previously validated measure, to explore whether the quality of the measure can be maintained while reducing the need for training independent observers and the need for recording treatment sessions. This work contributes to the growing efforts of developing more pragmatic fidelity measures and introduces a new tool, the CPS Practice Integrity Form (CPS-PIF), as a promising measure for community-based clinical settings using CPS.

The adaptation and fidelity tool to support social service practitioners in balancing fidelity and adaptations: Longitudinal, mixed-method evaluation study.

Background: Evidence-based interventions (EBIs) seldom fit seamlessly into a setting and are often adapted. The literature identifies practitioners' management of fidelity and adaptations as problematic but offers little guidance. This study aimed to investigate practitioners' perceptions of the feasibility and usability of an intervention aimed to support them in fidelity and adaptation management when working with EBIs. Methods: The intervention, the adaptation and fidelity tool (A-FiT), was developed based on the literature, along with input from social service practitioners and social services' Research and Development units' personnel. The intervention consisted of two workshops where the participants were guided through a five-step process to manage fidelity and adaptations. It was tested in a longitudinal mixed-method intervention study with 103 practitioners from 19 social service units in Stockholm, Sweden. A multimethod data collection was employed, which included interviews at follow-up, questionnaires at baseline and follow-up (readiness for change and self-rated knowledge), workshop evaluation questionnaires (usability and feasibility) after each workshop, and documentation (participants' notes on worksheets). To analyze the data, qualitative content analysis, Kruskal-Wallis tests, and Wilcoxon rank-sum tests were performed. Results: Overall, the practitioners had a positive perception of the intervention and perceived it as relevant for fidelity and adaptation management (mean ratings over 7.0 on usability and feasibility). The workshops also provided new knowledge and skills to manage fidelity and adaptations. Furthermore, the intervention provided insights into the practitioners' understanding about adaptation and fidelity through a more reflective approach. Conclusion: Practical tools are needed to guide professionals not only to adhere to intervention core elements but also to help them to manage fidelity and adaptation. The proposed A-FiT intervention for practitioners' management of both fidelity and adaptation is a novel contribution to the implementation literature. Potentially, the next step is an evaluation of the intervention's impact in an experimental design.

This study describes practitioners' perceptions of an intervention that aims to support them in fidelity and adaptation management when working with evidence-based interventions (EBIs). This is an important issue because social services practitioners are expected to use EBIs that seldom fit seamlessly into a specific setting and are often adapted. The practitioners perceived the intervention as relevant for their fidelity and adaptation management and states that it helped them develop a plan and increased their knowledge on the topic. Professionals require practical guiding tools not only to adhere to intervention content but also to balance them with fidelity and adaptation. This proposed intervention for practitioners' management of both fidelity and adaptation is a novel contribution to the implementation literature. We propose that researchers further evaluate this intervention as a potential next step.

Is adherence to dialectic behaviour therapy for post-traumatic stress disorder (PTSD) and cognitive processing therapy related to treatment outcome in PTSD after childhood abuse?

Background: Literature on the association between therapist adherence and treatment success in the treatment of post-traumatic stress disorder (PTSD) is scarce, and the results are mixed.Objective: To examine the relationship between therapist adherence to dialectical behaviour therapy for PTSD (DBT-PTSD) and cognitive processing therapy (CPT) on treatment outcome in women with PTSD and emotion regulation difficulties after interpersonal childhood abuse.Method: Videotaped therapy sessions from 160 female participants of a large randomized controlled trial [Bohus, M., Kleindienst, N., Hahn, C., Müller-Engelmann, M., Ludäscher, P., Steil, R., Fydrich, T., Kuehner, C., Resick, P. A., Stiglmayr, C., Schmahl, C., & Priebe, K. (2020). Dialectical behavior therapy for posttraumatic stress disorder (DBT-PTSD) compared with cognitive processing therapy (CPT) in complex presentations of PTSD in women survivors of childhood abuse. JAMA Psychiatry, 77(12), 1235. jamapsychiatry.2020.2148] were rated. Adherence to CPT and DBT-PTSD was assessed using two specifically developed rating scales.Results: Higher therapist adherence was associated with a greater reduction of clinician-rated PTSD symptom severity. This effect was more pronounced in the CPT group than in the DBT-PTSD group. Adherence was also related to a greater reduction of self-rated PTSD symptoms, borderline symptoms, and dissociation intensity.Conclusion: Our results indicate that higher therapist adherence can lead to better treatment outcomes in PTSD treatments, especially in CPT.

Higher therapist adherence to cognitive processing therapy was associated with higher treatment gains in women with post-traumatic stress disorder (PTSD) after childhood abuse.Adherence was related to higher reductions in symptom severity of PTSD, borderline symptoms, and dissociation intensity.Adherence to dialectical behaviour therapy for PTSD did not show a strong association with treatment outcome.

Efficacy of a Parent-Implemented Pivotal Response Treatment for Children with Autism Spectrum Disorder.

PURPOSE: Pivotal response treatment (PRT) is a well-established intervention addressing core symptoms of autism spectrum disorder (ASD), with parent involvement as a key component. The current study aimed to examine the effects of PRT parent training on parent fidelity and provide descriptive analyses of parent-child interactions before and after parent training. It also probed parental acceptance and satisfaction with the program. METHODS: A concurrent multiple baseline design across participants was used to evaluate the effectiveness of the parent training program. Four parents (range 32-47 years old) and their children with ASD participated in the study. The intervention comprised 12 one-on-one parent training sessions over six consecutive weeks. The visual analysis and effect size calculation (Tau-U) were used to evaluate functional relationship between independent and dependent variables. The descriptive analysis was used to analyze parent-child interaction data. RESULTS: The findings reveal that all parents learned and maintained PRT with a high level of fidelity, they also enhanced awareness to create more opportunities for interactions during free play, and the parents were very satisfied with the program. The results also indicate that the six-week parent training program is effective in teaching parents to implement PRT with their children. CONCLUSION: These results suggest that the parent training program may be a promising treatment model that is effective, efficient, and cost-effective. Implications for future research and practice are then discussed.

How does training format and clinical education model impact fidelity and confidence in a speech-language pathology rotation?

Clinical education rotations typically involve an initial training phase followed by supervised clinical practice. However, little research has explored the separate contributions of each component to the development of student confidence and treatment fidelity. The dual purpose of this study was to compare the impact of clinical training format (synchronous vs. asynchronous) and education model (traditional vs. collaborative) on student confidence and treatment fidelity. Thirty-six speech-language pathology graduate students completed this two-phase study during a one-term clinical rotation. Phase 1 investigated the impact of training condition (synchronous, asynchronous guided, asynchronous unguided) on student confidence and treatment fidelity. Phase 2 explored the impact of education model (traditional vs. collaborative) on student confidence and treatment fidelity. Treatment fidelity was measured at the conclusion of Phases 1 and 2. Students rated their confidence at six-time points throughout the study. Our results indicate that training condition did not differentially impact student confidence or treatment fidelity; however, education model did: students in the collaborative education model reported increased confidence compared to students in the traditional education model. Students in the collaborative education model also trended towards having higher treatment fidelity than students in the traditional education model. These results demonstrate that pre-clinical trainings can be effective in several different formats provided they cover the discrete skills needed for the clinical rotation. While preliminary, our results further suggest that students may benefit from working with peers during their clinical rotations.

Stigma and Social Determinants of Health Associated With Fidelity to Guideline-Concordant Therapy in Patients With Breast Cancer Living With and Without HIV in Botswana.

BACKGROUND: Patients with breast cancer in sub-Saharan Africa (SSA) experience a disproportionate burden of mortality. Fidelity to treatment guidelines, defined as receiving optimal dose and frequency of prescribed treatments, improves survival. We sought to identify patient factors associated with treatment fidelity and how this may differ for people with HIV (PWH) and breast cancer. METHODS: We conducted a qualitative study of women who initiated outpatient treatment for stages I-III breast cancer in Botswana, with deviance sampling of high- and low-fidelity patients. One-on-one interviews were conducted using semi-structured guides informed by the Theory of Planned Behavior. The sample size was determined by thematic saturation. Transcribed interviews were double coded with an integrated analytic approach. RESULTS: We enrolled 15 high- and 15 low-fidelity participants from August 25, 2020 to December 15, 2020, including 10 PWH (4 high, 6 low fidelity). Ninety-three percent had stage III disease. Barriers to treatment fidelity included stigma, social determinants of health (SDOH), and health system barriers. Acceptance and de-stigmatization, peer and other social support, increased knowledge and self-efficacy were identified as facilitators. The COVID-19 pandemic amplified existing socioeconomic stressors. Unique barriers and facilitators identified by PWH included intersectional stigma, and HIV and cancer care integration, respectively. CONCLUSION: We identified multilevel modifiable patient and health system factors associated with fidelity. The facilitators provide opportunities for leveraging existing strengths within the Botswana context to design implementation strategies to increase treatment fidelity to guideline-concordant breast cancer therapy. However, PWH experienced unique barriers, suggesting that interventions to address fidelity may need to be tailored to specific comorbidities.

Adapted motivational interviewing for brief healthcare consultations: A systematic review and meta-analysis of treatment fidelity in real-world evaluations of behaviour change counselling.

BACKGROUND: Behaviour change counselling (BCC) is an adaptation of motivational interviewing (MI) designed to maximize the effectiveness of time-limited health behaviour change consultations. To improve intervention quality and understanding of treatment effects, it is recommended that evaluations of health behaviour change interventions incorporate existing fidelity frameworks (e.g. The National Institutes of Health [NIH] Behaviour Change Consortium) and ensure that treatment fidelity is assessed and reported. PURPOSE: This systematic review was designed to examine (a) adherence to NIH fidelity recommendations, (b) provider fidelity to BCC and (c) impact of these variables on the real-world effectiveness of BCC for adult health behaviours and outcomes. METHODS AND RESULTS: Searches of 10 electronic databases yielded 110 eligible publications describing 58 unique studies examining BCC delivered within real-world healthcare settings by existing providers. Mean study adherence to NIH fidelity recommendations was 63.31% (Range 26.83%-96.23%). Pooled effect size (Hedges g) for short-term and long-term outcomes was .19 (95% CI [.11, .27]) and .09 (95% CI [.04, .13]), respectively. In separate, random-effects meta-regressions, neither short-term nor long-term effect sizes were significantly modified by adherence to NIH fidelity recommendations. For the subgroup of short-term alcohol studies (n = 10), a significant inverse relationship was detected (Coefficient = -.0114, 95% CI [-.0187, -.0041], p = .0021). Inadequate and inconsistent reporting within the included studies precluded planned meta-regression between provider fidelity and BCC effect size. CONCLUSIONS: Further evidence is needed to clarify whether adherence to fidelity recommendations modifies intervention effects. Efforts to promote transparent consideration, evaluation and reporting of fidelity are urgently needed. Research and clinical implications are discussed.

Machine Learning Model to Predict Assignment of Therapy Homework in Behavioral Treatments: Algorithm Development and Validation.

BACKGROUND: Therapeutic homework is a core element of cognitive and behavioral interventions, and greater homework compliance predicts improved treatment outcomes. To date, research in this area has relied mostly on therapists' and clients' self-reports or studies carried out in academic settings, and there is little knowledge on how homework is used as a treatment intervention in routine clinical care. OBJECTIVE: This study tested whether a machine learning (ML) model using natural language processing could identify homework assignments in behavioral health sessions. By leveraging this technology, we sought to develop a more objective and accurate method for detecting the presence of homework in therapy sessions. METHODS: We analyzed 34,497 audio-recorded treatment sessions provided in 8 behavioral health care programs via an artificial intelligence (AI) platform designed for therapy provided by Eleos Health. Therapist and client utterances were captured and analyzed via the AI platform. Experts reviewed the homework assigned in 100 sessions to create classifications. Next, we sampled 4000 sessions and labeled therapist-client microdialogues that suggested homework to train an unsupervised sentence embedding model. This model was trained on 2.83 million therapist-client microdialogues. RESULTS: An analysis of 100 random sessions found that homework was assigned in 61% (n=61) of sessions, and in 34% (n=21) of these cases, more than one homework assignment was provided. Homework addressed practicing skills (n=34, 37%), taking action (n=26, 28.5%), journaling (n=17, 19%), and learning new skills (n=14, 15%). Our classifier reached a 72% F1-score, outperforming state-of-the-art ML models. The therapists reviewing the microdialogues agreed in 90% (n=90) of cases on whether or not homework was assigned. CONCLUSIONS: The findings of this study demonstrate the potential of ML and natural language processing to improve the detection of therapeutic homework assignments in behavioral health sessions. Our findings highlight the importance of accurately capturing homework in real-world settings and the potential for AI to support therapists in providing evidence-based care and increasing fidelity with science-backed interventions. By identifying areas where AI can facilitate homework assignments and tracking, such as reminding therapists to prescribe homework and reducing the charting associated with homework, we can ultimately improve the overall quality of behavioral health care. Additionally, our approach can be extended to investigate the impact of homework assignments on therapeutic outcomes, providing insights into the effectiveness of specific types of homework.