Integrated Treatment Group Curriculum for People with Serious Mental Health Conditions Who Use Substances.

Without proper treatment, people with co-occurring mental health and substance use problems are at great risk for poor outcomes and high treatment costs in multiple domains. Intermediary organizations can provide support to programs implementing integrated treatment and other evidence-based practices; this includes developing practical tools for programs built to encourage fidelity to a particular practice. In this paper, we describe a group curriculum workbook designed to help practitioners provide integrated treatment with fidelity and a pilot learning collaborative to evaluate whether this workbook is a helpful tool for programs to support people with serious mental health conditions and substance use in identifying and achieving personal goals. Results of the pilot found that nearly all participants demonstrated progress with respect to their identified goals, and group facilitators reported that the workbook was easy to use, that participants enjoyed the material, and that they intended to continue offering the group as part of their regular programming.

Self- Evaluation Tool to Support Implementation of Treatment for Tobacco Use Disorder in Behavioral Health Programs.

Tobacco use in people with behavioral health conditions remain two to three times higher than the general population causing premature death and impacting recovery negatively across several domains. Intermediary organizations can provide practical tools, training, and technical assistance to help programs improve capacity to treat tobacco use. This report describes the construction and application of the Tobacco Integration Self-Evaluation Tool (TiSET) for behavioral health programs, a 20-item scale inspired by the DDCMHT and additional content from the Facility Tobacco Policy and Treatment Practices Self-Evaluation tool that one of the study authors (JW) used previously with addiction treatment programs. Completing the TiSET is an important step for behavioral health programs to evaluate their ability to effectively treat people that use tobacco. An important next step is to use those results to facilitate a quality improvement process. We include large agency example illustrating how the TiSET can be applied in real-world practice.

Behavioral Health Workforce Development in the era of COVID-19: Examples From a State-Funded Intermediary Organization.

Intermediary and purveyor organizations (IPOs) play a key role in disseminating and implementing behavioral health evidence-based practices. The COVID-19 pandemic created a time of crisis and disruption to behavioral health care delivery. Using the conceptual framework of basic, targeted, and intensive technical assistance (TA) from the Training and Technology Transfer Centers, case studies are used to describe how programs at The Center for Practice Innovations a state funded-intermediary organization, adapted its training and technical assistance to be delivered entirely remotely, to include content related to COVID-19 and to provide guidance on telehealth-based behavioral health care.

Support From Intermediary Organizations for Evidence-Based Practices in Behavioral Health Care.

Intermediary and purveyor organizations play a key role in disseminating and implementing evidence-based behavioral health best practices (EBPs). The authors provide a case example to describe how state-funded intermediaries can enhance the implementation and sustainment of EBP. Benefits of using state-funded intermediaries include the ability to collaborate with state entities to address barriers to and then incentivize best practices, access to resources to develop a robust infrastructure to support EBP training and implementation, and enhanced capacity to support organizations beyond individual EBPs (e.g., developing an internal quality-improvement process, supporting cross-cutting competencies, and helping organizations to identify synergies across EBP and to prioritize what to implement first).

Staff Time in the Community: An Enduring Critical Component of Individual Placement and Support in the Digital Age.

OBJECTIVE: This study examined the relationship between individual placement and support (IPS) employment specialists' time spent in the community and employment outcomes in the current digital age, featuring increased technology use and online hiring practices. METHODS: The authors examined the relationship between employment outcomes and IPS employment specialists' time spent in the community at 78 sites in 2018 and 84 sites in 2019. RESULTS: The amount of time staff spent in the community was significantly and positively associated with better employment outcomes. CONCLUSIONS: These data support the continued importance of employment specialists' spending time in the community with employers and IPS recipients to achieve optimal outcomes for recipients.

Recommendations for Integrated Systems and Services for People With Co-occurring Mental Health and Substance Use Conditions.

People with co-occurring mental and substance use disorders experience poor outcomes and incur high costs in multiple domains. Efforts to develop and disseminate evidence-based integrated programs for people with such co-occurring disorders began to wane in the past decade as efforts shifted toward integrating primary health care. Several recent trends underscore the need to refocus efforts on providing integrated care for people with both mental and substance use disorders. The authors summarize what is known about integrated care for people with these co-occurring disorders and recommend advancing implementation and research on integration and improving outcomes with existing resources.

Does assertive community treatment increase medication adherence for people with co-occurring psychotic and substance use disorders?

OBJECTIVE: This study analyzed data from a randomized trial to examine the impact on medication adherence of integrated treatment delivered via assertive community treatment (ACT) versus standard clinical case management (SCCM). METHOD: Data from the original study included 198 study participants with co-occurring psychotic and substance use disorders who were randomly assigned to receive integrated treatment via ACT or SCCM and were followed for 3 years. We applied mixed-effects logistic regression to estimate group (ACT vs. SCCM) by time effects on a self-report measure of medication adherence. Adherence was dichotomized as 20% or more missed medication days ("poor adherence") versus less than 20% missed medication days ("adequate adherence"). RESULTS: Participants who were assigned to ACT reported significant improvement in medication adherence compared with those assigned to SCCM. CONCLUSIONS: Integrated treatment delivered via ACT may benefit persons with co-occurring psychotic and substance use disorders who are poorly adherent to medications.

Applying Implementation Drivers to Scale-up Evidence-Based Practices in New York State.

Mental health authorities in several states, often working with academic partners, have played important roles in disseminating evidence-based practices (EBPs) for adults diagnosed with serious mental illness. This work has been facilitated by intermediary organizations that work directly with providers to implement EBPs. This report uses two case studies to describe how the Center for Practice Innovations (CPI), an intermediary organization, has used the Active Implementation Research Network's nine implementation drivers to successfully implement EBPs across the large state of New York. One case study focuses on supported employment and the second on integrated treatment for co-occurring mental health and substance use conditions. We provide these case studies to illustrate how intermediary organizations can use implementation science to organize and select effective support strategies to disseminate and implement a range of EBPs within a state system.

Applying Motivational Interviewing Strategies to Enhance Organizational Readiness and Facilitate Implementation Efforts.

Motivational interviewing (MI) is an empirically supported clinical method to help individuals make behavioral changes to achieve a personal goal. Through a set of specific techniques, MI helps individuals mobilize their own intrinsic values and goals to explore and resolve ambivalence about change. This article examines how MI-informed approaches can be applied to help staff adopt new evidence-based practices in organizational settings. Although the implementation science literature offers strategies for implementing new practices within organizations, leaders of quality improvement initiatives often encounter ambivalence about change among staff. Implementation approaches that require staff to make substantial changes may be facilitated by drawing from MI strategies. These include building a sense of collaboration from the beginning, eliciting "change talk," and addressing any ambivalence encountered. Motivational interviewing techniques may be particularly helpful in working with those in a stage of precontemplation (who have yet to see a reason for change) and those who are contemplating change (who see that a problem exists but are ambivalent about change). This article provides examples of how an MI-informed approach can be applied to help facilitate change in staff within organizations that are implementing quality improvement initiatives. These techniques are illustrated using a representative scenario.

Does switching to a new antipsychotic improve outcomes? Data from the CATIE Trial.

PURPOSE: Previous analysis of data from CATIE showed that patients randomly assigned to switch to a new medication were more likely to discontinue study drug than those who stayed on the medication they had been taking prior to randomization. This study addresses additional outcomes measures evaluating symptoms, neurocognition, quality of life, neurological side effects, weight, and health costs. First, considering patients randomized to olanzapine or risperidone, outcomes among patients who had been on the drug to which they were randomized prior to CATIE (N=129 "stayers") were compared to outcomes of those who switched to either of these two drugs (N=269 "switchers"). A second set of analyses considered patients on baseline monotherapy with olanzapine (N=297); risperidone (N=252) or quetiapine (n=87) and compared those randomly assigned to stay on each of these medications with those assigned to switch to any of the other five phase 1 medications in CATIE. In mixed models of each outcome the independent variable of primary interest represented stay vs. switch, with multivariate adjustment for potential confounding factors. RESULTS: With one exception, there were no significant differences between stayers and switchers on any outcome measure in either set of analyses. The exception was that, in the second set of analyses, patients who stayed on olanzapine showed greater weight gain than those who switched from olanzapine to other drugs. CONCLUSION: Switching to a new medication yielded no advantage over staying on the previous medication. Staying on olanzapine was associated with greater weight gain.

Use of integrated dual disorder treatment via assertive community treatment versus clinical case management for persons with co-occurring disorders and antisocial personality disorder.

We conducted secondary analyses of data from a randomized trial testing the effectiveness of Assertive Community Treatment (ACT) in delivery of integrated dual disorder treatment (IDDT) to explore the impact of IDDT delivered through ACT teams compared with standard clinical case management for dually-disordered persons with and without antisocial personality disorder (ASPD). This analysis included 36 individuals with ASPD and 88 individuals without ASPD. Participants with ASPD assigned to ACT showed a significantly greater reduction in alcohol use and were less likely to go to jail than those in standard clinical case management, whereas participants without ASPD did not differ between the 2 case management approaches. There were no significant differences for other substance use or criminal justice outcomes. This study provides preliminary evidence that persons with co-occurring serious mental illness, substance use disorders, and ASPD may benefit from delivery of IDDT through ACT teams.

Effectiveness of the NAMI Homefront Program for Military and Veteran Families: In-Person and Online Benefits.

OBJECTIVE: This study aimed to evaluate the effectiveness of Homefront, a six-session, peer-taught family education program by the National Alliance on Mental Illness (NAMI), delivered in person or online, for families or support persons of military service members or of veterans with mental illness. METHODS: Program participants completed online surveys at baseline, at the end of the program (postprogram), and at 3-month follow-up, which measured subjective empowerment, burden, coping, psychological distress, family functioning, experience of caregiving, and knowledge of mental illness. A mixed-effects model examined change over time. RESULTS: A total of 119 individuals (in person, N=63 [53%]; online, N=56 [47%]) enrolled. Participants showed statistically significant improvement on all dimensions between baseline, postprogram, and follow-up, except for subjective burden, which improved between baseline and follow-up. Results for in-person and online formats did not differ. CONCLUSIONS: The six-session NAMI Homefront program was associated with benefits for military and veteran family members and support persons.

Implications of CATIE for mental health services researchers.

The authors discuss the implications of the Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) for mental health services researchers, in particular the need to monitor and change prescriber behavior to encourage informed medication selection. Given the complexity and variability of response to antipsychotic medications in CATIE, use of restricted formularies is not the answer. Rather, services researchers should collaborate with service systems to develop interventions to identify questionable prescriber practices and develop interventions to change them. The CATIE results also suggest that some quality measures for antipsychotic treatment, such as the proportion of a population taking second-generation antipsychotics, need to be revisited by researchers. Also, because the CATIE findings highlighted the prevalence of cardiac and metabolic disorders among treatment populations and the potential impact of antipsychotics on these conditions, services researchers should use secondary data to monitor whether prescribers are providing appropriate screening and treatment. Given the health risks of some antipsychotics, services researchers should develop ways to identify individuals at risk, encourage behavior change among prescribers, and support informed and shared decision making about medications. Mental health services researchers can build relationships with multiple stakeholders, including service system administrators, service providers, and consumers, to help translate results from trials such as CATIE into policy and practice.

Comparative Initial and Sustained Engagement in Web-based Training by Behavioral Healthcare Providers in New York State.

Improved dissemination is critical to implementation of evidence-based practice in community behavioral healthcare settings. Web-based training modalities are a promising strategy for dissemination of evidence-based practice in community behavioral health settings. Initial and sustained engagement of these modalities in large, multidisciplinary community provider samples is not well understood. This study evaluates comparative engagement and user preferences by provider type in a web-based training platform in a large, multidisciplinary community sample of behavioral health staff in New York State. Workforce make-up among platform registrants was compared to the general NYS behavioral health workforce. Training completion by functional job type was compared to characterize user engagement and preferences. Frequently completed modules were classified by credit and requirement incentives. High initial training engagement across professional role was demonstrated, with significant differences in initial and sustained engagement by professional role. The most frequently completed modules across functional job types contained credit or requirement incentives. The analysis demonstrated that high engagement of a web-based training in a multidisciplinary provider audience can be achieved without tailoring content to specific professional roles. Overlap between frequently completed modules and incentives suggests a role for incentives in promoting engagement of web-based training. These findings further the understanding of strategies to promote large-scale dissemination of evidence-based practice in community behavioral health settings.

Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State.

BACKGROUND: Implementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs) that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support. OBJECTIVE: This report describes the application of an instructional design framework-Analyze, Design, Develop, Implement, and Evaluate (ADDIE) model-in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS), a model of supported employment for community behavioral health treatment programs, in New York State. METHODS: We applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR). Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change) quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation. RESULTS: Formative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book. Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning management system. Summative evaluation revealed that learners rated the modules positively, and self-report of knowledge acquisition was high (mean range: 4.4-4.6 out of 5). About half of learners indicated that they would change their practice after watching the modules (range: 48-51%). All learners who completed the level 1 evaluation demonstrated 80% or better mastery of knowledge on the level 2 evaluation embedded in each module. The CFIR was used to identify implementation barriers and facilitators among the evaluation data which facilitated planning for subsequent implementation support activities in the IPS initiative. CONCLUSION: Instructional design approaches such as ADDIE may offer implementation scientists and practitioners a flexible and systematic approach for the development of e-learning modules as a single component or one strategy in a multifaceted approach for training in EBPs.

Relationship Between Self-Assessed Fidelity and Self-Reported Employment in the Individual Placement and Support Model of Supported Employment.

OBJECTIVE: A growing body of literature demonstrates that high-fidelity implementation of the individual placement and support (IPS) model of supported employment increases the chances of achieving desired outcomes. This study examined the relationship between IPS fidelity, as self-reported by program sites, and employment outcomes and determined whether this relationship was maintained over time. METHODS: A total of 78 outpatient programs in New York State provided data on self-reported IPS fidelity and employment outcomes. Pearson correlations were used to determine the relationship between fidelity scores and competitive employment rates. A mixed-effects model examined the relationship between repeated fidelity and employment measures over time. RESULTS: A significant positive relationship was found between better self-reported IPS fidelity and greater employment. The relationship between IPS fidelity and employment was sustained over time (up to one year). CONCLUSIONS: Higher-fidelity implementation of the IPS model, as self-assessed by program sites, was associated with higher employment rates, which were sustained over time.

Relationship between diabetes and mortality among persons with co-occurring psychotic and substance use disorders.

OBJECTIVE: Individuals with diabetes and individuals with serious mental illness are more likely than the general population to die prematurely. The study examined the impact of diabetes on mortality among 197 individuals with co-occurring psychotic and substance use disorders who participated in a randomized controlled study of integrated mental health and substance abuse treatment. METHODS: The authors examined Medicaid claims for evidence of diabetes and applied survival analyses to examine whether time from study entry until death was different for individuals with and without evidence of diabetes. RESULTS: Of individuals with co-occurring psychotic and substance use disorders, 21% had evidence of diabetes. In a 12-year period, 41% of those with evidence of diabetes died compared with 10% of those without evidence of diabetes. CONCLUSIONS: Interventions targeted for diabetes prevention and diabetes management are critical for persons with serious mental illness, particularly among those who also abuse substances.

Is There a Role for Fidelity Self-Assessment in the Individual Placement and Support Model of Supported Employment?

OBJECTIVE: Fidelity assessments help ensure that evidence-based practices are implemented properly. Although assessments are typically conducted by independent raters, some programs have implemented self-assessments because of resource constraints. Self-assessments were compared with independent assessments of programs implementing individual placement and support supported employment. METHODS: Eleven community-based outpatient programs in New York State completed both self- and independent assessments. Intraclass correlation coefficients and paired t tests were used to compare scores from self- and independent assessments. RESULTS: For both assessment methods, mean scores for all programs were within the range of fair fidelity. Self- and independent assessment total scores were not significantly different; however, significant differences were found on some scale items in this small sample. CONCLUSIONS: Self-assessment may be valid for examining a program's overall functioning and useful when resource constraints prevent independent assessment. Independent assessors may be able to identify nuances, particularly on individual assessment items, that can point to areas for program improvement.

Effectiveness of switching antipsychotic medications.

OBJECTIVE: Changing antipsychotics is common despite the dearth of information on risks and benefits associated with medication changes. The authors examined phase 1 findings from the Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) study to explore whether it was more advantageous to continue taking the medication being received at baseline or to switch to a different antipsychotic. METHOD: First, for patients randomly assigned to treatment with olanzapine (N=314) or risperidone (N=321), the authors assessed the impact of being assigned to stay with the medication they were receiving at entry into the study versus being assigned to switch to these medications from a different antipsychotic. Second, for patients whose baseline antipsychotic was olanzapine (N=319), risperidone (N=271), or quetiapine (N=94), the authors examined the impact of being randomly assigned to stay with the same antipsychotic versus switch. Finally, the authors assessed the impact of removing the data of 209 patients whose random assignment was to stay with their baseline antipsychotic. The authors followed analysis strategies for CATIE; primary outcome was time until all-cause treatment discontinuation. RESULTS: Individuals randomly assigned to olanzapine and risperidone who were continuing with their baseline medication had significantly longer times until discontinuation than did those assigned to switch antipsychotics. When these "stayers" were removed, differences seen in the original CATIE phase 1 analyses were attenuated, although the original pattern of results remained. CONCLUSIONS: Comparisons of medication effectiveness should take into account whether medications being compared were each newly initiated. Further, unless the clinical situation requires a medication change, prescribers may want to take steps to optimize current medication regimens (e.g., dosage adjustments, behavioral or psychosocial interventions) before switching medications.