Examination of Adaptations to the Evidence Based Supported Employment Model: Individual Placement and Support.

Individual Placement and Support (IPS) is a long-standing and innovative employment service for individuals with mental illness with dozens of clinical trials demonstrating effectiveness. Little is known, however, about intentional adaptations to IPS, especially those outside of the context of research studies. Using an implementation science framework, we conducted an exploratory study to better understand the characteristics of stakeholder-reported adaptions to IPS, the impetus for their development, and perceived impacts. We conducted qualitative interviews to analyze and describe these adaptations. Numerous adaptations of IPS were found that address the needs of new and underserved populations both within and outside of the mental health field. Programs reported adapting IPS because of the dearth of other evidence-based employment services, to serve diverse populations in need, and based on financial incentives. Benefits of adaptations were weighed against impacts on fidelity. As evidence-based practices (EBPs) are adapted, developers of EBPs should determine how fidelity of a program or service can be assessed or preserved in light of adaptations. This is critical with the increase in different service delivery methods, new populations, new service recipient needs, and new settings in need of EBPs.

Outcomes During and After Early Intervention Services for First-Episode Psychosis: Results Over 5 Years From the RAISE-ETP Site-Randomized Trial.

To examine long-term effects of early intervention services (EIS) for first-episode psychosis, we compared Heinrichs-Carpenter Quality of Life (QLS) and Positive and Negative Syndrome Scale (PANSS) scores and inpatient hospitalization days over 5 years with data from the site-randomized RAISE-ETP trial that compared the EIS NAVIGATE (17 sites; 223 participants) and community care (CC) (17 sites; 181 participants). Inclusion criteria were: age 15-40 years; DSM-IV diagnoses of schizophrenia, schizoaffective disorder, schizophreniform disorder, brief psychotic disorder, or psychotic disorder not otherwise specified; first psychotic episode; antipsychotic medication taken for ≤6 months. NAVIGATE-randomized participants could receive NAVIGATE from their study entry date until NAVIGATE ended when the last-enrolled NAVIGATE participant completed 2 years of treatment. Assessments occurred every 6 months. 61% of participants had assessments conducted ≥2 years; 31% at 5 years. Median follow-up length was CC 30 months and NAVIGATE 38 months. Primary analyses assumed data were not-missing-at-random (NMAR); sensitivity analyses assumed data were missing-at-random (MAR). MAR analyses found no significant treatment-by-time interactions for QLS or PANSS. NMAR analyses revealed that NAVIGATE was associated with a 13.14 (95%CI:6.92,19.37) unit QLS and 7.73 (95%CI:2.98,12.47) unit PANSS better improvement and 2.53 (95%CI:0.59,4.47) fewer inpatient days than CC (all comparisons significant). QLS and PANSS effect sizes were 0.856 and 0.70. NAVIGATE opportunity length (mean 33.8 (SD = 5.1) months) was not associated (P = .72) with QLS outcome; duration of untreated psychosis did not moderate (P = .32) differential QLS outcome. While conclusions are limited by the low rate of five-year follow-up, the data support long-term benefit of NAVIGATE compared to community care.

Implementation and fidelity assessment of the NAVIGATE treatment program for first episode psychosis in a multi-site study.

The NAVIGATE program was developed for the Recovery After Initial Schizophrenia Episode-Early Treatment Program (RAISE-ETP) study, which compared NAVIGATE to usual Community Care in a cluster randomized design involving 34 sites and 404 patients. This article describes the approach to training and implementing the NAVIGATE program at the 17 sites (including 134 practitioners) randomized to provide it, and to evaluating the fidelity of service delivery to the NAVIGATE model. Fidelity was evaluated to five different components of the program, all of which were standardized in manuals in advance of implementation. The components included four interventions (Individualized Resiliency Training, Family Education Program, Supported Employment and Education, Personalized Medication Management) and the overall organization (staffing and structure) of the NAVIGATE team. Most of the sites demonstrated acceptable or higher levels of fidelity in their implementation of the four interventions and the organization of the program, with all 17 sites demonstrating at least acceptable overall fidelity to the NAVIGATE program. The results indicate that the NAVIGATE program can be implemented with good fidelity to the treatment model in a diverse array of community mental health care settings serving persons with a first episode psychosis.

Supported employment and education in comprehensive, integrated care for first episode psychosis: Effects on work, school, and disability income.

BACKGROUND: Participation in work and school are central objectives for first episode psychosis (FEP) programs, but evidence effectiveness has been mixed in studies not focused exclusively on supported employment and education (SEE). Requirements for current motivation to work or go to school limit the generalizability of such studies. METHODS: FEP participants (N=404) at thirty-four community treatment clinics participated in a cluster randomized trial that compared usual Community Care (CC) to NAVIGATE, a comprehensive, team-based treatment program that included ≥5h of SEE services per week, , grounded in many of the principles of the Individual Placement and Support model of supported employment combined with supported education services. All study participants were offered SEE regardless of their initial interest in work or school. Monthly assessments over 24months recorded days of employment and attendance at school, days of participation in SEE, and both employment and public support income (including disability income). General Estimation Equation models were used to compare CC and NAVIGATE on work and school participation, employment and public support income, and the mediating effect of receiving ≥3 SEE visits on these outcomes. RESULTS: NAVIGATE treatment was associated with a greater increase in participation in work or school (p=0.0486) and this difference appeared to be mediated by SEE. No group differences were observed in earnings or public support payments. CONCLUSION: A comprehensive, team-based FEP treatment approach was associated with greater improvement in work or school participation, and this effect appears to be mediated, in part, by participation in SEE.

Comprehensive Versus Usual Community Care for First-Episode Psychosis: 2-Year Outcomes From the NIMH RAISE Early Treatment Program.

OBJECTIVE: The primary aim of this study was to compare the impact of NAVIGATE, a comprehensive, multidisciplinary, team-based treatment approach for first-episode psychosis designed for implementation in the U.S. health care system, with community care on quality of life. METHOD: Thirty-four clinics in 21 states were randomly assigned to NAVIGATE or community care. Diagnosis, duration of untreated psychosis, and clinical outcomes were assessed via live, two-way video by remote, centralized raters masked to study design and treatment. Participants (mean age, 23) with schizophrenia and related disorders and ≤6 months of antipsychotic treatment (N=404) were enrolled and followed for ≥2 years. The primary outcome was the total score of the Heinrichs-Carpenter Quality of Life Scale, a measure that includes sense of purpose, motivation, emotional and social interactions, role functioning, and engagement in regular activities. RESULTS: The 223 recipients of NAVIGATE remained in treatment longer, experienced greater improvement in quality of life and psychopathology, and experienced greater involvement in work and school compared with 181 participants in community care. The median duration of untreated psychosis was 74 weeks. NAVIGATE participants with duration of untreated psychosis of <74 weeks had greater improvement in quality of life and psychopathology compared with those with longer duration of untreated psychosis and those in community care. Rates of hospitalization were relatively low compared with other first-episode psychosis clinical trials and did not differ between groups. CONCLUSIONS: Comprehensive care for first-episode psychosis can be implemented in U.S. community clinics and improves functional and clinical outcomes. Effects are more pronounced for those with shorter duration of untreated psychosis.

The NAVIGATE Program for First-Episode Psychosis: Rationale, Overview, and Description of Psychosocial Components.

Comprehensive coordinated specialty care programs for first-episode psychosis have been widely implemented in other countries but not in the United States. The National Institute of Mental Health's Recovery After an Initial Schizophrenia Episode (RAISE) initiative focused on the development and evaluation of first-episode treatment programs designed for the U.S. health care system. This article describes the background, rationale, and nature of the intervention developed by the RAISE Early Treatment Program project-known as the NAVIGATE program-with a particular focus on its psychosocial components. NAVIGATE is a team-based, multicomponent treatment program designed to be implemented in routine mental health treatment settings and aimed at guiding people with a first episode of psychosis (and their families) toward psychological and functional health. The core services provided in the NAVIGATE program include the family education program (FEP), individual resiliency training (IRT), supported employment and education (SEE), and individualized medication treatment. NAVIGATE embraces a shared decision-making approach with a focus on strengths and resiliency and on collaboration with clients and family members in treatment planning and reviews. The NAVIGATE program has the potential to fill an important gap in the U.S. health care system by providing a comprehensive intervention specially designed to meet the unique treatment needs of persons recovering from a first episode of psychosis. A cluster-randomized controlled trial comparing NAVIGATE with usual community care has recently been completed.

The State Health Authority Yardstick (SHAY).

State mental health authorities have a leadership role in implementing evidence-based practices (EBPs), but few instruments are available to assess the impact of this role. We describe the development of the State Mental Health Authority Yardstick (SHAY), a behaviorally anchored instrument designed to assess state-level facilitating conditions associated with successful implementation of EBPs in community mental health centers. The SHAY assesses the SMHA role in seven domains: Planning, Financing, Training, Leadership, Policies and Regulations, Quality Improvement, and Stakeholders. Preliminary evidence from the National Evidence-Based Practices Project partially supports the construct and criterion-oriented validity of this instrument for rating state-level activities supporting or blocking the implementation of evidence-based practices.

The role of staff turnover in the implementation of evidence-based practices in mental health care.

OBJECTIVES: This study examined turnover rates of teams implementing psychosocial evidence-based practices in public-sector mental health settings. It also explored the relationship between turnover and implementation outcomes in an effort to understand whether practitioner perspectives on turnover are related to implementation outcomes. METHODS: Team turnover was measured for 42 implementing teams participating in a national demonstration project examining implementation of five evidence-based practices between 2002 and 2005. Regression techniques were used to analyze the effects of team turnover on penetration and fidelity. Qualitative data collected throughout the project were blended with the quantitative data to examine the significance of team turnover to those attempting to implement the practices. RESULTS: High team turnover was common (M+/-SD=81%+/-46%) and did not vary by practice. The 24-month turnover rate was inversely related to fidelity scores at 24 months (N=40, beta=-.005, p=.01). A negative trend was observed for penetration. Further analysis indicated that 71% of teams noted that turnover was a relevant factor in implementation. CONCLUSIONS: The behavioral health workforce remains in flux. High turnover most often had a negative impact on implementation, although some teams were able to use strategies to improve implementation through turnover. Implementation models must consider turbulent behavioral health workforce conditions.

Strategies for state-wide implementation of supported employment: the Johnson & Johnson-Dartmouth Community Mental Health Program.

This paper reviews key strategies for implementing evidence-based supported employment statewide. The Johnson & Johnson-Dartmouth Community Mental Health Program collaborates with 9 states and the District of Columbia to implement supported employment in a sustainable way. Technical assistance and teambased training help agencies develop high fidelity programs that result in good employment outcomes for people with severe mental illness.

Promoting the implementation of practices that are supported by research: the National Implementing Evidence-Based Practice Project.

The National Implementing Evidence-Based Practice Project is an ongoing effort to promote the implementation of effective practices for adults who have severe mental illnesses. The project members designed and developed integrated packages of materials and services to help practice sites implement evidence-based practices and is field-testing the approach in eight states. These implementations are being evaluated carefully to learn how to make the technology transfer process more efficient in the future. This article describes the project and provides some early reflections on the implementation experience.

Implementing evidence-based practices for people with severe mental illness.

Persons with severe mental illnesses (SMI) often lack access to effective treatments. The authors describe the Implementing Evidence-Based Practices (EBPs) Project, designed to increase access for people with SMI to empirically supported interventions. The EBP Project aims to improve access through development of standardized implementation packages, created in collaboration with different stakeholders, including clinicians, consumers, family members, clinical supervisors, program leaders, and mental health authorities. The background and philosophy of the EBP Project are described, including the six EBPs identified for initial package development: collaborative psychopharmacology, assertive community treatment, family psychoeducation, supported employment, illness management and recovery skills, and integrated dual disorders treatment. The components of the implementation packages are described as well as the planned phases of the project. Improving access to EBPs for consumers with SMI may enhance outcomes in a cost-effective manner, helping them pursue their personal recovery goals with the support of professionals, family, and friends.

The challenge of implementing and sustaining integrated dual disorders treatment programs.

Integrated dual disorders treatment programs for people with severe mental illness and co-occurring substance use disorder have been implemented in a variety of community mental health center sites across the U.S. and in several other countries over the past 15 years. Consumers who receive services from programs that offer integrated dual diagnosis treatments that are faithful to evidence-based principles achieve significant improvements in their outcomes. Unfortunately, not all programs that attempt implementation are successful, and the quality of high-fidelity programs sometimes erodes over time. This article outlines implementation strategies that have been used by successful programs. As a general rule, success is achieved by involving all major participants (consumers, family members, clinicians, program leaders, and state or county mental health authorities) in the process and attending to the three phases of change: motivating, enacting, and sustaining implementation.