A Randomized Trial to Identify Accurate Measurement Methods for Adherence to Cognitive-Behavioral Therapy.

Clinician fidelity to cognitive behavioral therapy (CBT) is an important mechanism by which desired clinical outcomes are achieved and is an indicator of care quality. Despite its importance, there are few fidelity measurement methods that are efficient and have demonstrated reliability and validity. Using a randomized trial design, we compared three methods of assessing CBT adherence-a core component of fidelity-to direct observation, the gold standard. Clinicians recruited from 27 community mental health agencies (n = 126; M age = 37.69 years, SD = 12.84; 75.7% female) were randomized 1:1:1 to one of three fidelity conditions: self-report (n = 41), chart-stimulated recall (semistructured interviews with the chart available; n = 42), or behavioral rehearsal (simulated role-plays; n = 43). All participating clinicians completed fidelity assessments for up to three sessions with three different clients that were recruited from clinicians' caseloads (n = 288; M age = 13.39 years SD = 3.89; 41.7% female); sessions were also audio-recorded and coded for comparison to determine the most accurate method. All fidelity measures had parallel scales that yielded an adherence maximum score (i.e., the highest-rated intervention in a session), a mean of techniques observed, and a count total of observed techniques. Results of three-level mixed effects regression models indicated that behavioral rehearsal produced comparable scores to observation for all adherence scores (all ps > .01), indicating no difference between behavioral rehearsal and observation. Self-report and chart-stimulated recall overestimated adherence compared to observation (ps < .01). Overall, findings suggested that behavioral rehearsal indexed CBT adherence comparably to direct observation, the gold-standard, in pediatric populations. Behavioral rehearsal may at times be able to replace the need for resource-intensive direct observation in implementation research and practice.

Community Mental Health Clinicians' Perspectives on Telehealth During the COVID-19 Pandemic: Mixed Methods Study.

BACKGROUND: In March 2020, a rapid shift to telehealth occurred in community mental health settings in response to the need for physical distancing to decrease transmission of the virus causing COVID-19. Whereas treatment delivered over telehealth was previously utilized sparingly in community settings, it quickly became the primary mode of treatment delivery for the vast majority of clinicians, many of whom had little time to prepare for this shift and limited to no experience using telehealth. Little is known about community mental health clinicians' experiences using telehealth. Although telehealth may make mental health treatment more accessible for some clients, it may create additional barriers for others given the high rates of poverty among individuals seeking treatment from community mental health centers. OBJECTIVE: We examined community mental health clinicians' perspectives on using telehealth to deliver trauma-focused cognitive behavioral therapy to youth. We sought to better understand the acceptability of using telehealth, as well as barriers and facilitators to usage. METHODS: We surveyed 45 clinicians across 15 community clinics in Philadelphia. Clinicians rated their satisfaction with telehealth using a quantitative scale and shared their perspectives on telehealth in response to open-ended questions. Therapists' responses were coded using an open-coding approach wherein coders generated domains, themes, and subthemes. RESULTS: Clinicians rated telehealth relatively positively on the quantitative survey, expressing overall satisfaction with their current use of telehealth during the pandemic, and endorsing telehealth as a helpful mode of connecting with clients. Responses to open-ended questions fell into five domains. Clinicians noted that (1) telehealth affects the content (ie, what is discussed) and process (ie, how it is discussed) of therapy; (2) telehealth alters engagement, retention, and attendance; (3) technology is a crucial component of utilizing telehealth; (4) training, resources, and support are needed to facilitate telehealth usage; and (5) the barriers, facilitators, and level of acceptability of telehealth differ across individual clinicians and clients. CONCLUSIONS: First, telehealth is likely a better fit for some clients and clinicians than others, and attention should be given to better understanding who is most likely to succeed using this modality. Second, although telehealth increased convenience and accessibility of treatment, clinicians noted that across the board, it was difficult to engage clients (eg, young clients were easily distracted), and further work is needed to identify better telehealth engagement strategies. Third, for many clients, the telehealth modality may actually create an additional barrier to care, as children from families living in poverty may not have the requisite devices or quality broadband connection to make telehealth workable. Better strategies to address disparities in access to and quality of digital technologies are needed to render telehealth an equitable option for all youth seeking mental health services.

The TPOCS-self-reported Therapist Intervention Fidelity for Youth (TPOCS-SeRTIFY): A case study of pragmatic measure development.

Background: Developing pragmatic assessment tools to measure clinician use of evidence-based practices is critical to advancing implementation of evidence-based practices in mental health. This case study details our community-partnered process of developing the Therapy Process Observation Coding Scale-Self-Reported Therapist Intervention Fidelity for Youth (TPOCS-SeRTIFY), a pragmatic, clinician-report instrument to measure cognitive behavioral therapy (CBT) delivery. Approach: We describe a five-step community-partnered development process. Initial goals were to create a self-report instrument that paralleled an existing direct observation measure of clinician delivery of CBT use to facilitate later assessment of measure performance. Cognitive interviews with community clinicians (n = 6) and consultation with CBT experts (n = 6) were used to enhance interpretability and usability as part of an iterative refinement process. The instrument was administered to 247 community clinicians along with an established self-reported measure of clinician delivery of CBT and other treatments to assess preliminary psychometric performance. Preliminary psychometrics were promising. Conclusion: Our community-partnered development process showed promising success and can guide future development of pragmatic implementation measures both to facilitate measurement of ongoing implementation efforts and future research aimed at building learning mental health systems. Plain language summary: Developing brief, user-friendly, and accurate tools to measure how therapists deliver cognitive behavioral therapy (CBT) in routine practice is important for advancing the reach of CBT into community settings. To date, developing such "pragmatic" measures has been difficult. There is little known about how researchers can best develop these types of assessment tools so that they (1) are easy for clinicians in practice to use and (2) provide valid and useful information about implementation outcomes. As a result, there are few well-validated measures in existence that measure therapist use of CBT that are feasible for use in community practice. This paper contributes to the literature by describing our community-partnered process for developing a measure of therapist use of CBT (Therapy Process Observation Coding Scale -Self-Reported Therapist Intervention Fidelity for Youth; TPOCS-SeRTIFY). This descriptive case study outlines the community-partnered approach we took to develop this measure. This case study will contribute to future research by serving as a guide to others aiming to develop pragmatic implementation measures. In addition, the TPOCS-SeRTIFY is a pragmatic measure of clinician use of CBT that holds promise for its use by both researchers and clinicians to measure the success of CBT implementation efforts.

Pathways from early adversity to later adjustment: Tests of the additive and bidirectional effects of executive control and diurnal cortisol in early childhood.

Additive and bidirectional effects of executive control and hypothalamic-pituitary-adrenal (HPA) axis regulation on children's adjustment were examined, along with the effects of low income and cumulative risk on executive control and the HPA axis. The study utilized longitudinal data from a community sample of preschool age children (N = 306, 36-39 months at Time 1) whose families were recruited to overrepresent low-income contexts. We tested the effects of low income and cumulative risk on levels and growth of executive control and HPA axis regulation (diurnal cortisol level), the bidirectional effects of executive control and the HPA axis on each other, and their additive effects on children's adjustment problems, social competence and academic readiness. Low income predicted lower Time 4 executive control, and cumulative risk predicted lower Time 4 diurnal cortisol level. There was little evidence of bidirectional effects of executive control and diurnal cortisol. However, both executive control and diurnal cortisol predicted Time 4 adjustment, suggesting additive effects. There were indirect effects of income on all three adjustment outcomes through executive control, and of cumulative risk on adjustment problems and social competence through diurnal cortisol. The results provide evidence that executive control and diurnal cortisol additively predict children's adjustment and partially account for the effects of income and cumulative risk on adjustment.

Parenting as a moderator of the effects of cumulative risk on children's social-emotional adjustment and academic readiness.

This study examined whether parenting moderated the association between cumulative risk and preschool children's adjustment problems, social competence and academic readiness. The sample consisted of 306 families representing the full range of income, with 29% at or near poverty and 28% lower income. Cumulative risk and observed maternal parenting behaviors were assessed when the children were 36-40 months, and teachers rated outcomes at 63-68 months. Greater cumulative risk was more strongly related to higher adjustment problems when scaffolding was low, and unrelated when it was high, suggesting a protective effect. Consistent limit setting was associated with higher academic readiness regardless of risk level, and at low levels of risk it was associated with the highest levels of social competence. A pattern potentially indicating differential effectiveness emerged for warmth, such that at lower levels of risk, higher warmth was associated with better outcomes, but at higher levels of risk, it was associated with higher levels of problems and poorer social competence and academic readiness. Results suggest that buffering effects of particular parenting behaviors, both alone and in combination, may be context-specific.

Bidirectional Relations Between Temperament and Parenting Predicting Preschool-Age Children's Adjustment.

Bidirectional associations between child temperament (fear, frustration, positive affect, effortful control) and parenting behaviors (warmth, negativity, limit setting, scaffolding, responsiveness) were examined as predictors of preschool-age children's adjustment problems and social competence. Participants were a community sample of children (N = 306; 50% female, 64% European American) and their mothers. Observational measures of child temperament and parenting were obtained using laboratory tasks at two time points (children's ages 36 and 54 months). Teacher-reported adjustment measures were collected at the first and third time points (children's ages 36 and 63 months). Cross-lagged analyses were performed to examine whether child temperament and parenting predict changes in one another, whether they each contribute independently to children's adjustment, and whether these transactional relations account for adjustment outcomes. Maternal negativity at 36 months predicted increases in child frustration at 54 months. Maternal negativity and child effortful control predicted decreases in each other from 36 to 54 months. Maternal warmth predicted increases in child effortful control over time. Child frustration, child effortful control, maternal warmth, and maternal negativity at 54 months each independently predicted child adjustment problems at 63 months, controlling for problems at 36 months. Child executive control at 54 months predicted increases in child social competence at 63 months. The findings suggest that temperament and parenting have independent and additive effects on preschool-age child adjustment, with some support for a bidirectional relation.

Developmental change in emotion expression in frustrating situations: The roles of context and gender.

Emotion expression is a central aspect of social-emotional functioning. Theorists assert that emotion expression undergoes significant changes in the preschool period. There is, however, limited observational evidence of those changes, which may vary by interpersonal context and gender. The present longitudinal study examined developmental changes in emotion expressions from ages 3 to 5 years in 120 children from rural economically strained families. Children's facial, vocal, and postural sadness, anger, and happiness expressions were observed in frustrating tasks in 3 social contexts (a perfect circles task with an experimenter, a toy wait task with mother, a locked box task when alone). Findings indicted that sadness expressions decreased with age in all 3 contexts. Anger expressions increased with age in the frustrating task with the experimenter and when alone but not with the mother. From age 4 to 5 years, happiness expressions decreased in the task with experimenter but increased when alone and increased marginally with mother. In terms of gender, girls expressed greater happiness (and lower sadness) than boys but only in the task with the experimenter. Findings suggest that sadness expressions decrease over the preschool years. Developmental changes in happiness and anger expressions (and gender differences) likely depend on context.