Mental Health Provider Reach and Engagement in a Countywide Training Initiative.

Many training initiatives are underway to increase implementation of evidence-based practice (EBPs) in mental healthcare. However, little is known about what types of trainings and supports yield the highest reach and engagement. Supported by a tax-funded, countywide initiative to improve access to quality care for youths, the current mixed methods study evaluates mental health (MH) provider reach, or registering for the training initiative, and engagement, or participation in training activities, for several EBP training and implementation supports. MH providers were offered free 1) formal EBP workshops, 2) a biweekly learning community, 3) individual case consultation, and 4) confidential online clinical feedback system. To register, interested providers (N = 698) completed a web-based assessment measuring clinical practice information, organizational implementation climate, and EBP knowledge, attitudes, and practices. Thirteen providers, selected via purposeful sampling stratified by level of participation, completed semi-structured qualitative interviews. While the training initiative achieved high reach (66% of county agencies had a provider register), far fewer providers engaged substantially in training. Quantitative results indicated that providers whose professional discipline was not psychology, had higher baseline EBP knowledge, more extensive use of common evidence-based strategies, and less extensive use of other therapy strategies, engaged in more training. Rapid qualitative analysis of interviews expanded upon these findings and illuminated provider, organizational, system, practical, and training activity-specific barriers and facilitators to engagement. Findings suggest the importance of identifying strategies for improving provider engagement in training activities beyond workshops. Implications for future research and training initiatives are discussed.

A Structural Model of Organization and Clinician Factors Associated with Standardized Measure Use in a National Survey of Youth Mental Health Providers.

Standardized assessment measures are important for accurate diagnosis of mental health problems and for treatment planning and evaluation. However, little is known about youth mental health providers' typical use of standardized measures across disciplines and outside the context of evidence-based practice initiatives. A multidisciplinary national survey examined the frequency with which 674 youth mental health providers administer standardized and unstandardized measures, and the extent to which organizational (i.e., implementation climate, rigid hierarchical organizational structure) and provider (i.e., attitudes toward standardized assessment measures, highest degree, practice setting) characteristics are associated with standardized measure use. Providers used unstandardized measures far more frequently than standardized measures. Providers' perceptions (a) that standardized measures are practical or feasible, (b) that their organization supports and values evidence-based practices, and (c) that their organization has a rigid hierarchical structure predicted greater use of standardized measures. Working in schools predicted less frequent SMU, while working in higher education and other professional settings predicted more frequent SMU. Standardized measures were not routinely used in this community-based sample. A rigid hierarchical organizational structure may be conducive to more frequent administration of standardized measures, but it is unclear whether such providers actually utilize these measures for clinical decision-making. Alternative strategies to promote standardized measure use may include promoting organizational cultures that value empirical data and encouraging use of standardized measures and training providers to use pragmatic standardized measures for clinical decision making.

Implementation of a Low-Cost, Multi-component, Web-Based Training for Trauma-Focused Cognitive-Behavioral Therapy.

Effective, interactive trainings in evidence-based practices remain expensive and largely inaccessible to most practicing clinicians. To address this need, the current study evaluated the impact of a low-cost, multi-component, web-based training for Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT) on clinicians' TF-CBT knowledge, strategy use, adherence and skill. Clinician members of a practice-based research network were recruited via email and randomized to either an immediate training group (N = 89 assigned) or waitlist control group (N = 74 assigned) that was offered access to the same training after six months, with half of each group further randomized to receive or not receive incentives for participation. Clinicians completed assessments at baseline, 6 months, and 12 months covering TF-CBT knowledge, strategy use, and for a subset of clinicians (n = 28), TF-CBT adherence and skill. Although significant differences in overall TF-CBT skillfulness and readiness were found, there were no significant differences between the training and waitlist control group on TF-CBT knowledge and strategy use at six months. However, there was considerable variability in the extent of training completed by clinicians. Subsequent post-hoc analyses indicated a significant, positive association between the extent of training completed by clinicians and clinician TF-CBT knowledge, strategy use, demonstrated adherence and skill across the three TF-CBT components, and overall TF-CBT readiness. We also explored whether incentives predicted training participation and found no differences in training activity participation between clinicians who were offered an incentive and those who were not. Findings highlight the limitations of self-paced web-based trainings. Implications for web-based trainings are discussed.

Role-Play Assessment of Therapist Adherence and Skill in Implementation of Trauma-Focused Cognitive-Behavioral Therapy.

Numerous efforts are underway to train clinicians in evidence-based practices. Unfortunately, the field has few practical measures of therapist adherence and skill with which to judge the success of these training and implementation efforts. One possible assessment method is using behavioral rehearsal, or role-play, as an analogue for therapist in-session behavior. The current study describes aspects of reliability, validity and utility of a behavioral role-play assessment developed to evaluate therapist adherence and skill in implementing Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT). TF-CBT role-play assessments were conducted with a sample of 43 therapists as part of a larger training study. The TF-CBT role-play assessments were independently coded for TF-CBT adherence and skill by a certified TF-CBT trainer and three clinical psychology doctoral students. Findings indicated good interrater reliability for the individual items (ICC: M = .71, SD = .15). Regarding utility, 67.19% (n = 43/64) of contacted therapists completed the role-play assessment, which took an average of 30 min (M = 31.42, SD = 5.65) to complete and 60 min (M = 62.84, SD = 11.31) to code. Therapists with a master's degree were more likely to complete the role-play assessment than those with other degrees but no other differences in demographic variables, practice characteristics, or TF-CBT knowledge or training were found between participants and nonparticipants. Role-play assessments may offer an alternative to observational coding for assessing therapist adherence and skill, particularly in contexts where session recordings are not feasible.

A Second and Third Look at FIRST: Testing Adaptations of A Principle-Guided Youth Psychotherapy.

Objective: We examined the acceptability, integrity, and symptom trajectories associated with FIRST, a principle-guided treatment for youth internalizing and externalizing problems designed to support efficient uptake and implementation.Method: We conducted two open trials of an adapted FIRST, focusing on uptake and implementation by novice trainees in a university-affiliated clinic, limiting treatment duration to six sessions, and benchmarking findings against a 2017 FIRST trial with community therapists. In Study 1, trainees received a two-day training and weekly two-hour supervision (N = 22 youths, ages 7-17, 50% female, 54.54% Caucasian, 4.55% Latinx). In Study 2, trainees received a one-day training and weekly one-hour supervision, delivering the six-session FIRST in a predetermined sequence (N = 26 youths, ages 11-17, 42.31% female, 65.38% Caucasian, 7.69% Latinx). In Study 3, the original study therapists - now practitioners - evaluated FIRST's effectiveness and implementation difficulty, and reported their own post-study FIRST use.Results: Acceptability (treatment completion, session attendance, caregiver participation) and integrity (adherence, competence) were comparable across Study 1, Study 2 and the 2017 trial. Improvement effect sizes across ten outcome measures were in the large range in all three trials: M ES = 1.10 in the 2017 trial, 0.83 in Study 1, and 0.81 in Study 2. Study 3 showed high effectiveness ratings, low difficulty ratings, and continued use of FIRST by a majority of clinicians.Conclusions: Across two open trials and a follow-up survey, FIRST showed evidence of acceptability and integrity, with youth symptom reduction comparable to that in prior research.

Evidence-Based Treatment Strategies in Youth Mental Health Services: Results from a National Survey of Providers.

Previous surveys indicate infrequent use of evidence-based treatment (EBT) manuals in usual care youth mental health, but the extent to which providers use core and common EBT strategies and what contextual factors impact EBT strategy implementation need further study. In a national, multidisciplinary survey of 1092 youth-serving providers, providers reported regular use of many EBT strategies. Provider learning theory orientation, more recent degree, more standardized and ongoing assessment use, more positive attitudes toward innovation and evidence, fewer low-income clients, and perceptions that their agency valued quality care and provided fewer training resources predicted more frequent EBT strategy use.

Monitoring Treatment Progress and Providing Feedback is Viewed Favorably but Rarely Used in Practice.

Numerous trials demonstrate that monitoring client progress and using feedback for clinical decision-making enhances treatment outcomes, but available data suggest these practices are rare in clinical settings and no psychometrically validated measures exist for assessing attitudinal barriers to these practices. This national survey of 504 clinicians collected data on attitudes toward and use of monitoring and feedback. Two new measures were developed and subjected to factor analysis: The monitoring and feedback attitudes scale (MFA), measuring general attitudes toward monitoring and feedback, and the attitudes toward standardized assessment scales-monitoring and feedback (ASA-MF), measuring attitudes toward standardized progress tools. Both measures showed good fit to their final factor solutions, with excellent internal consistency for all subscales. Scores on the MFA subscales (Benefit, Harm) indicated that clinicians hold generally positive attitudes toward monitoring and feedback, but scores on the ASA-MF subscales (Clinical Utility, Treatment Planning, Practicality) were relatively neutral. Providers with cognitive-behavioral theoretical orientations held more positive attitudes. Only 13.9 % of clinicians reported using standardized progress measures at least monthly and 61.5 % never used them. Providers with more positive attitudes reported higher use, providing initial support for the predictive validity of the ASA-MF and MFA. Thus, while clinicians report generally positive attitudes toward monitoring and feedback, routine collection of standardized progress measures remains uncommon. Implications for the dissemination and implementation of monitoring and feedback systems are discussed.

Mental Health Clinicians' Participation in Web-Based Training for an Evidence Supported Intervention: Signs of Encouragement and Trouble Ahead.

Comprehensive scalable clinician training is needed to increase the impact of evidence-supported psychotherapies. This study was designed to ascertain clinician participation in different low-cost training activities, what predicts their training participation, and how participation can be increased. The study enrolled 163 clinicians. Of these, 105 completed a follow-up survey and 20 completed a more in-depth qualitative interview. Some activities (web training) attracted greater participation than others (e.g., discussion boards, role playing). Key findings include the desirability of self-paced learning and the flexibility it afforded practicing clinicians. However, some found the lack of accountability insurmountable. Many desired in-person training as a way to introduce accountability and motivation. While low-cost, relevant, self-paced learning appeals to practicing clinicians, it may need to be combined with opportunities for in-person training and accountability mechanisms in order to encourage large numbers of clinicians to complete training.

Characterizing supervision-as-usual: Findings from two provider surveys.

Although clinical supervision is widely seen as critical for professional training and for safeguarding and promoting client well-being in mental health care, it is understudied, particularly in publicly funded services. In surveys of two large samples of youth mental health service providers (a state sample of providers billing Medicaid [N = 1,057] and a national sample of professional guild members [N = 1,720]), we examined the amount of time providers reported spending in supervision and consultation in a typical workweek and its covariation with characteristics of providers' caseloads and work settings. Across both samples, providers reported spending an average of 2-3 hr per week in supervision. Serving higher percentages of low-income clients was associated with significantly more supervision time. Working in private practice was associated with less supervision, while community mental health and residential facilities were each associated with more supervision time. The national survey also measured providers' perceptions of their current supervision. On average, providers endorsed feeling comfortable with the amount of supervision received and supported by their supervisors. However, working with more low-income clients was associated with greater need for supervisor approval and oversight and with less comfort in the amount of supervision received. Those working with more low-income clientele may benefit from additional supervision time or more focused supervision coverage of the specific needs of clients with low-income. More in-depth research on critical processes and content in supervision is a much-needed future direction for supervision research. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Adapted group-based dialectical behaviour therapy for binge eating in a practicing clinic: clinical outcomes and attrition.

Research evidence has been accumulating for the efficacy of dialectical behaviour therapy (DBT) for binge eating. However, support for its effectiveness and transportability beyond efficacy trials is lacking. The current study evaluated the feasibility of group-based DBT for binge eating within the context of an operating community clinic. Women ages 24-49 (M = 39.60, SD = 9.53) with either subthreshold and full-threshold binge eating disorder or bulimia nervosa formed the group and comprised the sample (n = 5 treatment completers). Positive outcomes included significant improvement in both binge eating and secondary outcomes with the Eating Disorder Inventory subscales of Bulimia, Ineffectiveness, Perfectionism and Interpersonal Distrust. Attrition was elevated compared with previous efficacy trials, suggesting the need for increased attention to how to improve retention within routine practice settings. Given our limited sample size, these findings are viewed as promising but preliminary.

Influence of caregiver network support and caregiver psychopathology on child mental health need and service use in the LONGSCAN study.

Using structural equation modeling, this study examined the relationship of caregiver network support on caregiver and child mental health need, as well as child mental health service use among 1075 8-year-old children participating in the LONGSCAN study. The final model showed acceptable fit (χ(2) = 301.476, df = 136, p<0.001; RMSEA = 0.052; CFI = 0.95). Caregiver and child mental health needs were positively related. As predicted, caregiver network support exerted a protective effect, with greater levels of caregiver network support predictive of lower caregiver and child need. Contrary to prediction, however, caregiver network support was not directly related to child service use. Higher child need was directly related to child service use, especially among children whose caregivers had mental health problems. The findings appear to indicate that lower levels of caregiver network support may exert its impact on child service use indirectly by increasing caregiver and child need, rather than by directly increasing the likelihood of receiving services, especially for African American children.

Measuring Evidence-Based Treatment Strategies in Youth Community Mental Health Care: the Evidence-Based Strategies Scale.

While there are established measures for fidelity to specific evidence-based treatments, there is no widely accepted, feasible measure of the use of evidence-based treatment strategies in youth mental health (MH) care. This study examined the factor structure of a provider self-report measure of evidence-based treatment strategy use, the Evidence-Based Strategies Scale (EBSS). MH providers completed the EBSS as part of a larger mailed survey. The factor structure of the EBSS was examined using exploratory factor analysis in a national, multidisciplinary sample of MH providers (N = 1092), and confirmatory factor analysis was subsequently conducted to replicate this factor structure in a state-wide, multidisciplinary sample of Medicaid MH providers (N = 780). Findings indicated a three-factor structure, representing working alliance, youth-focused, and family-focused evidence-based treatment strategies factors. The EBSS offers a potential method for measuring the evidence-based treatment strategies being delivered in youth community MH care, though more research is needed.

Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness Scale.

There is a well-documented gap between research and practice in the treatment of mental health problems. One promising approach to bridging this gap is training community-based providers in evidence-based practices (EBPs). However, a paucity of valid, reliable measures to assess a range of outcomes of such trainings impedes our ability to evaluate and improve training toward this end. The current study examined the factor structure of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a provider-report measure that assesses three perceptual implementation outcomes of trainings that may be leading indicators of training success (i.e., acceptability, feasibility, and appropriateness). Providers who attended half-day EBP trainings for common mental health problems reported on the acceptability, feasibility, and appropriateness of these trainings using the AFAS (N = 298). Confirmatory factor analysis indicates good fit to the hypothesized three-factor structure (RMSEA = .058, CFI = .990, TLI = .987). Acceptability, feasibility, and appropriateness were three distinct but related constructs. Cronbach's alpha ranged from .86 to .91, indicating acceptable internal consistency for the three subscales. Acceptability and feasibility, but not appropriateness, scores varied between workshops, though variability across workshops was generally limited. This initial evaluation of the AFAS is in line with recent efforts to enhance psychometric reporting practices for implementation outcome measures and provides future directions for further development and refinement of the AFAS. Plain Language Summary: Clinician training in evidence-based practices is often used to increase implementation of evidence-based practices in mental health service settings. However, one barrier to evaluating the success of clinician trainings is the lack of measures that reliably and accurately assess clinician training outcomes. This study was the initial evaluation of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a measure that assesses the immediate outcomes of clinician trainings. This study found some evidence supporting the AFAS reliability and its three subscales. With additional item refinement and psychometric testing, the AFAS could become a useful measure of a training's immediate impact on providers.

Understanding clinicians' diagnostic practices: attitudes toward the utility of diagnosis and standardized diagnostic tools.

Data on clinician diagnostic practices suggest they may not align with evidence-based guidelines. To better understand these practices, a multidisciplinary survey of 1,678 child clinicians examined attitudes toward the utility of diagnosis and standardized diagnostic tools. Psychiatrists were more likely than other disciplines to value diagnosis, whereas psychologists were more likely than others to value standardized diagnostic tools. Private practitioners held less positive views in both domains than other practitioners. Both attitude scales predicted self-reported diagnostic practices, although views of diagnosis utility were more associated with diagnosing in general, whereas views of diagnostic tools were more predictive of standardized tool use.

Evidence-Based Assessment in Routine Mental Health Services for Youths.

OBJECTIVE: Evidence-based assessment (EBA) plays a critical role in the delivery of effective treatments. However, little is known about the assessment practices of mental health clinicians who treat youths and the factors that support EBA. The authors examined when, how, and under what conditions clinicians conduct EBA. METHODS: In two multidisciplinary surveys (combined N=2,575), clinicians reported how frequently they conducted pretreatment, ongoing, and posttreatment assessments and how frequently they used standardized measures in usual care of youths. RESULTS: Although clinicians reported frequent pretreatment, ongoing, and posttreatment assessments, use of standardized measures was rare. Clinician and practice setting characteristics predicted standardized measure use, and a lack of practical assessment tools appears to be a barrier to use of standardized measures in EBA of youths. CONCLUSIONS: Many clinicians conduct assessments during treatment, but more practical measures and clinician training may improve the integration of standardized measures into routine practice.

A mixed-method evaluation of the adoption and implementation of the College Alcohol Intervention Matrix among prevention experts: a study protocol.

BACKGROUND: Risky drinking among college campuses has been a long-standing concern and there have been dedicated efforts to develop evidence-based prevention and treatment strategies (EBSs) to decrease alcohol use and increase healthy behaviors among college students. Further, the College Alcohol Intervention Matrix (CollegeAIM) was developed as a tool with accompanying resources, to assist institutions of higher education in selecting EBSs that are appropriate and a good fit for their campuses. However, the CollegeAIM tool and selection of prevention strategies from stakeholders' perspectives has yet to be evaluated. This study protocol describes the methodology for a research project evaluating CollegeAIM from an implementation science perspective using the Exploration, Preparation, Implementation, and Sustainment framework. METHODS: The aims of this study will be accomplished with a mixed-method design comprised of reviews of strategic planning documents, quantitative surveys and interviews with prevention experts, and focus groups to identify key components of a decision-support program for prevention experts to support the use of CollegeAIM. Participants are members of the multi-site Missouri Partners in Prevention coalition to reduce risky substance use on college campuses across the state. DISCUSSION: The results of this study will provide key information to support the development of additional supportive tools for campuses that can improve their selection and implementation of EBSs that fit the needs of their respective campuses. This work is important to further advance the implementation and sustainment of extant EBSs for risky college alcohol use.

Understanding barriers to evidence-based assessment: clinician attitudes toward standardized assessment tools.

In an era of evidence-based practice, why are clinicians not typically engaged in evidence-based assessment? To begin to understand this issue, a national multidisciplinary survey was conducted to examine clinician attitudes toward standardized assessment tools. There were 1,442 child clinicians who provided opinions about the psychometric qualities of these tools, their benefit over clinical judgment alone, and their practicality. Doctoral-level clinicians and psychologists expressed more positive ratings in all three domains than master's-level clinicians and nonpsychologists, respectively, although only the disciplinary differences remained significant when predictors were examined simultaneously. All three attitude scales were predictive of standardized assessment tool use, although practical concerns were the strongest and only independent predictor of use.

Do noncontingent incentives increase survey response rates among mental health providers? A randomized trial comparison.

Surveys can be a useful tool for mental health services research. Unfortunately, clinicians typically show low response rates to surveys. To determine whether noncontingent incentives would increase responses among clinicians, we compared no incentive versus four incentives (mood magnet, $1, $2, $5) on response to a 7-page self-report survey of mental health assessment and treatment practices in a sample of 500 clinicians from the 5 largest professional guilds. Noncontingent monetary incentives significantly increased response rate compared to no incentive across all disciplines. Noncontingent monetary incentives are discussed as a cost-effective method for increasing survey response rate among mental health clinicians.