A Randomized Trial to Identify Accurate Measurement Methods for Adherence to Cognitive-Behavioral Therapy.

Clinician fidelity to cognitive behavioral therapy (CBT) is an important mechanism by which desired clinical outcomes are achieved and is an indicator of care quality. Despite its importance, there are few fidelity measurement methods that are efficient and have demonstrated reliability and validity. Using a randomized trial design, we compared three methods of assessing CBT adherence-a core component of fidelity-to direct observation, the gold standard. Clinicians recruited from 27 community mental health agencies (n = 126; M age = 37.69 years, SD = 12.84; 75.7% female) were randomized 1:1:1 to one of three fidelity conditions: self-report (n = 41), chart-stimulated recall (semistructured interviews with the chart available; n = 42), or behavioral rehearsal (simulated role-plays; n = 43). All participating clinicians completed fidelity assessments for up to three sessions with three different clients that were recruited from clinicians' caseloads (n = 288; M age = 13.39 years SD = 3.89; 41.7% female); sessions were also audio-recorded and coded for comparison to determine the most accurate method. All fidelity measures had parallel scales that yielded an adherence maximum score (i.e., the highest-rated intervention in a session), a mean of techniques observed, and a count total of observed techniques. Results of three-level mixed effects regression models indicated that behavioral rehearsal produced comparable scores to observation for all adherence scores (all ps > .01), indicating no difference between behavioral rehearsal and observation. Self-report and chart-stimulated recall overestimated adherence compared to observation (ps < .01). Overall, findings suggested that behavioral rehearsal indexed CBT adherence comparably to direct observation, the gold-standard, in pediatric populations. Behavioral rehearsal may at times be able to replace the need for resource-intensive direct observation in implementation research and practice.

Stakeholder intention to engage in fidelity measurement methods in community mental health settings: A mixed methods study.

Background: The current gold standard for measuring fidelity (specifically, adherence) to cognitive behavioral therapy (CBT) is direct observation, a costly, resource-intensive practice that is not feasible for many community organizations to implement regularly. Recent research indicates that behavioral rehearsal (i.e., role-play between clinician and individual with regard to session delivery) and chart-stimulated recall (i.e., brief structured interview between clinician and individual about what they did in session; clinicians use the client chart to prompt memory) may provide accurate and affordable alternatives for measuring adherence to CBT in such settings, with behavioral rehearsal yielding greater correspondence with direct observation. Methods: Drawing on established causal theories from social psychology and leading implementation science frameworks, this study evaluates stakeholders' intention to use behavioral rehearsal and chart-stimulated recall. Specifically, we measured attitudes, self-efficacy, and subjective norms toward using each, and compared these factors across the two methods. We also examined the relationship between attitudes, self-efficacy, subjective norms, and intention to use each method. Finally, using an integrated approach we asked stakeholders to discuss their perception of contextual factors that may influence beliefs about using each method. These data were collected from community-based supervisors (n = 17) and clinicians (n = 66). Results: Quantitative analyses suggest moderately strong intention to use both methods across stakeholders. There were no differences in supervisors' or clinicians' attitudes, self-efficacy, subjective norms, or intention across methods. More positive attitudes and greater reported subjective norms were associated with greater reported intention to use either measure. Qualitative analyses identified participants' specific beliefs about using each fidelity measure in their organization, and results were organized using the Consolidated Framework for Implementation Research. Conclusions: Strategies are warranted to overcome or minimize potential barriers to using fidelity measurement methods and to further increase the strength of intention to use them.Plain Language Summary: The best way to measure fidelity, or how closely a clinician follows the protocol, to Cognitive Behavioral Therapy (CBT) is watching the session. This is an expensive practice that is not feasible for many community organizations to do regularly. Recent research indicates that behavioral rehearsal, or a role-play between the clinician and individual with regard to session delivery, and chart-stimulated recall, or a brief discussion between an individual and the clinician about what they did in session with the clinician having access to the chart to help them remember, may provide accurate and affordable alternatives for measuring fidelity to CBT. We just completed a study demonstrating that both methods are promising, with behavioral rehearsal offering scores that are the most similar to watching the session. Drawing on established theories from social psychology and leading implementation science frameworks, this study evaluates future supervisor and clinician motivation to use these fidelity measurement methods. Specifically, we measured supervisor (n = 17) and clinician (n = 66) attitudes, norms, self-efficacy, intentions, and anticipated barriers and facilitators to using each of these fidelity measurement tools. Quantitative and qualitative analyses suggest similar intention to use both methods, and concerns about barriers to using each method. Further research is warranted to minimize the burden associated with implementing fidelity measurement methods and deploying strategies to increase use.

Screening Adolescents for Sensitive Health Topics in Primary Care: A Scoping Review.

We sought to aggregate common barriers and facilitators to screening adolescents for sensitive health topics (e.g., depression, chlamydia) in primary care, as well as those that are unique to a given health topic. We conducted a literature search of three databases (PsycInfo, MEDLINE, and CINAHL) and reference lists of included articles. Studies focused on barriers and facilitators to screening adolescents (ages 12-17 years) for sensitive health topics in primary care that are recommended by national guidelines. Articles were peer-reviewed, presented empirical data, and were published in English in 2006-2021. We coded barriers and facilitators using the Consolidated Framework for Implementation Research, a well-established framework within implementation science. In total, 39 studies met inclusion criteria and spanned several health topics: depression, suicide, substance use, HIV, and chlamydia. We found common barriers and facilitators to screening across health topics, with most relating to characteristics of the primary care clinics (e.g., time constraints). Other factors relevant to screening implementation ranged from confidentiality concerns to clinician knowledge. Barriers and facilitators specific to certain health topics, such as the availability of on-site laboratories for HIV screening, were also noted. Findings can guide refinements to screening implementation.

The TPOCS-self-reported Therapist Intervention Fidelity for Youth (TPOCS-SeRTIFY): A case study of pragmatic measure development.

Background: Developing pragmatic assessment tools to measure clinician use of evidence-based practices is critical to advancing implementation of evidence-based practices in mental health. This case study details our community-partnered process of developing the Therapy Process Observation Coding Scale-Self-Reported Therapist Intervention Fidelity for Youth (TPOCS-SeRTIFY), a pragmatic, clinician-report instrument to measure cognitive behavioral therapy (CBT) delivery. Approach: We describe a five-step community-partnered development process. Initial goals were to create a self-report instrument that paralleled an existing direct observation measure of clinician delivery of CBT use to facilitate later assessment of measure performance. Cognitive interviews with community clinicians (n = 6) and consultation with CBT experts (n = 6) were used to enhance interpretability and usability as part of an iterative refinement process. The instrument was administered to 247 community clinicians along with an established self-reported measure of clinician delivery of CBT and other treatments to assess preliminary psychometric performance. Preliminary psychometrics were promising. Conclusion: Our community-partnered development process showed promising success and can guide future development of pragmatic implementation measures both to facilitate measurement of ongoing implementation efforts and future research aimed at building learning mental health systems. Plain language summary: Developing brief, user-friendly, and accurate tools to measure how therapists deliver cognitive behavioral therapy (CBT) in routine practice is important for advancing the reach of CBT into community settings. To date, developing such "pragmatic" measures has been difficult. There is little known about how researchers can best develop these types of assessment tools so that they (1) are easy for clinicians in practice to use and (2) provide valid and useful information about implementation outcomes. As a result, there are few well-validated measures in existence that measure therapist use of CBT that are feasible for use in community practice. This paper contributes to the literature by describing our community-partnered process for developing a measure of therapist use of CBT (Therapy Process Observation Coding Scale -Self-Reported Therapist Intervention Fidelity for Youth; TPOCS-SeRTIFY). This descriptive case study outlines the community-partnered approach we took to develop this measure. This case study will contribute to future research by serving as a guide to others aiming to develop pragmatic implementation measures. In addition, the TPOCS-SeRTIFY is a pragmatic measure of clinician use of CBT that holds promise for its use by both researchers and clinicians to measure the success of CBT implementation efforts.

Promoting parent-infant responsiveness in families experiencing homelessness.

My Baby's First Teacher is an intervention designed specifically for parents with infants staying in emergency homeless shelters. Infants are overrepresented in shelter populations and face considerable risk to their development, including mental health. We utilized a randomized controlled design across three family shelters to evaluate the program's effectiveness with 24 dyads assigned to the intervention compared to 21 dyads in care-as-usual. Dyads were randomized by round at each site to account for shelter effects. We used path analysis to illustrate change over time and in relation to intervention assignment.

El Primer Maestro de mi Bebé es una intervención diseñada específicamente para progenitores con infantes que se alojan en refugios de emergencia para personas sin casa. En la población de los refugios, los infantes están sobrerrepresentados y enfrentan un considerable riesgo en cuanto a su desarrollo, incluyendo la salud mental. Utilizamos un diseño de control al azar a través de tres refugios de familias para evaluar la eficacia del programa con 24 díadas asignadas al grupo de intervención que fueron comparadas con 21 díadas bajo el cuidado usual. A las díadas se les colocó al azar por etapas en cada lugar para tener en cuenta los efectos del refugio. Usamos un análisis de trayectoria para ilustrar el cambio a través del tiempo y en relación con la asignación de intervención. Resultados claves: los resultados indicaron mejoras en la observada sensibilidad de progenitor-infante relacionada con la intervención en el lugar, con un control en cuanto a los niveles iniciales de sensibilidad. Los resultados fueron consistentes entre un modelo de intención de tratar y un modelo para probar la participación cierta en la intervención. No encontramos ningún efecto significativo para el estrés de crianza o la ansiedad del progenitor, aunque las tendencias sugirieron más altos puntajes para las familias de la intervención. Implicaciones para la práctica y las políticas: presentamos los resultados considerando retos específicos en contextos de casos sin casa para la salud mental infantil. Este trabajo puede servir de base para los esfuerzos de quienes proveen servicios y encuentran familias que experimentan el estar sin casa, así como también las políticas sobre los recursos para programaciones en albergues de emergencia.

Le Premier Enseignant de Mon Bébé est une intervention conçue spécialement pour les parents dont les bébés restent dans des foyers d'urgence pour sans-abris. Les bébés sont sur-représentés dans les populations de ces foyers et ils font face à un risque considérable pour leur développement, y compris pour ce qui concerne leur santé mentale. Nous avons utilisé un schéma expérimental contrôlé pour 3 trois foyers familiaux afin d'évaluer l'efficacité du programme avec 24 dyades désignées pour l'intervention comparé à 21 dyades dans le groupe de soins habituels. Les dyades ont été randomisées par ronde sur chaque site afin de contrôler les effets du foyer. Nous avons utilisé une analyse causale pour illustrer le changement au fil du temps et en relation au groupe d'intervention. Constatations Clés: Résultats a indiqué des améliorations dans la réaction observée parent-bébé liée à l'intervention en fin d'étude, contrôlant les niveaux initiaux de réaction. Les résultats sont cohérents entre un modèle intention-de-traiter et un modèle testant la véritable participation à l'intervention. Nous n'avons trouvé aucun effet important pour le stress de parentage ou la détresse du parent, bien que des tendances suggèrent des scores plus élevés pour les familles d'intervention. Nous présentons des résultats en considérant les défis uniques aux contextes de la vie des sans-abris pour la santé mentale du nourrisson. Ce travail peut orienter les efforts des prestataires de services qui rencontrent des familles faisant l'expérience d'une vie sans abri ainsi que les lois et pratiques concernant les ressources pour des programmes dans des foyers d'accueil d'urgence.