ABSTRACT
Semi-structured interviews were conducted with nine Individual Placement and Support (IPS) employment specialists who expanded and enhanced the IPS model for the youngest of working age youth with mental health conditions (ages 16-21). Semi-structured interviews were conducted with 100% of the providers delivering IPS-based career services for high school aged youth during an exploratory pilot. Content coding was applied to interview transcripts. Findings reflect the complexities of providing career services to high school age youth, suggesting components needed for effective services. These components include: provision of supports that help youth complete high school and negotiate the transition to college, coaching and skill development to improve executive functioning for work and school, coping skills coaching for mental health symptoms, flexible engagement strategies that assure youth self-determination of goals, longer range career and goal planning, and close collaboration with families.
Subject(s)
Employment, Supported , Mental Disorders , Humans , Adolescent , Child , Young Adult , Adult , Rehabilitation, Vocational , Mental Disorders/therapy , Mental Disorders/psychology , Mental Health , MotivationABSTRACT
Young adults with mental health conditions want to work and advance their education, but many need help attaining these goals. Individual Placement and Support (IPS), originally developed for working-age adults with serious mental illness, is an evidence-based employment model that may benefit young adults. This study is the first systematic review and meta-analysis of randomized controlled trials (RCTs) of IPS for this population. We conducted a systematic review of the effectiveness of IPS for young adults with mental health conditions, supplementing our electronic search of the published literature with secondary analyses of two published RCTs. Using meta-analysis, we evaluated employment rate, job duration, and education rate. Seven studies met the inclusion criteria. Four evaluated IPS for young adults with early psychosis and three evaluated IPS for other young adult subgroups. All found a significantly higher employment rate for IPS than the control group. Overall, 208 (58.3%) of 357 IPS participants and 110 (32.4%) of 340 control participants were competitively employed during follow-up, yielding an overall risk ratio of 1.69 (95% CI 1.43, 1.99), z = 6.24, p < 0.001. Six of the seven studies also reported longer job duration for IPS than the control group, yielding an overall g = 0.34 (95% CI 0.09, 0.58), z = 2.72, p < 0.01. None of four RCTs examining education outcomes found a significant difference favoring IPS, but the overall risk ratio was significant: 1.33 (95% CI 1.06, 1.66), z = 2.51, p < 0.01. Although the empirical literature is limited, IPS appears to be effective in helping young adults with serious mental illness or early psychosis gain and keep competitive jobs. The impact of IPS on education outcomes is unclear. Future research should evaluate the generalizability of these findings to the broad range of young adults with mental health conditions needing help with their employment goals.
Subject(s)
Employment, Supported , Mental Disorders , Psychotic Disorders , Young Adult , Humans , Mental Health , Mental Disorders/psychology , Rehabilitation, VocationalABSTRACT
ABSTRACT: Military personnel face numerous challenges transitioning from military jobs to meaningful civilian employment. The Independence Project compared an innovative employment program (National Career Coach Program) with standard employment services (Local Community Resources) in a randomized controlled trial. Study participants were transitioning veterans with self-reported service-connected disabilities seeking permanent employment. The primary outcomes were paid employment and disability ratings over 1 year. Secondary outcomes included health and well-being. At 1-year follow-up, National Career Coach Program participants were significantly more likely to work, had significantly greater earnings, and reported significantly greater improvements in physical and mental health compared with participants assigned to Local Community Resources. Both groups increased in disability ratings over 12 months, with no difference between groups. Multifaceted supports delivered by the National Career Coach Program increased employment, earnings, mental health, and physical health over 1 year. These significant differences appeared even though control group participants achieved considerable employment success.
Subject(s)
Disabled Persons , Military Personnel , Veterans , Employment , Humans , Mental Health , Veterans/psychologyABSTRACT
BACKGROUND: Military personnel face numerous challenges transitioning from military jobs to meaningful civilian employment. Many veterans seek help finding employment, but few veteran employment programs have been rigorously studied. Transitioning veterans generally have access to Local Community Resources (LCR), which include the Veterans Health Administration vocational rehabilitation services, the state-federal Vocational Rehabilitation program, and the Department of Labor's American Job Centers. By contrast, the innovative National Career Coach Program (NCCP) offers intensive career coaching and financial incentives for working. METHODS: This study used a randomized controlled design to compare the NCCP and LCR approaches for 208 transitioning service members (recent or pending transition). Researchers conducted interviews by telephone every four months for two years. Outcomes included earnings, months worked, and standardized self-report measures of health and well-being. Findings At two-year follow-up, significantly more NCCP participants had worked in paid employment than LCR participants (95% vs. 83%). NCCP participants averaged $2568 in monthly earnings compared to $1865 for LCR participants, thus averaging $16,872 more total income per participant over the two-year period. Employment outcomes significantly improved between Year 1 and Year 2. NCCP participants also reported significantly greater improvements in both physical and mental health compared to LCR participants. Average monthly earnings correlated with changes in health outcomes. CONCLUSIONS: Veterans receiving multi-faceted employment services early in the transition from the military showed sustained benefit over a two-year period with increased earnings over time and improved mental and physical outcomes. Positive employment outcomes may have contributed to improved health outcomes.
Subject(s)
Employment, Supported , Military Personnel , Veterans , Humans , United States , Veterans/psychology , Rehabilitation, Vocational , EmploymentABSTRACT
BACKGROUND: Despite widespread use of learning collaboratives, few randomized trials have evaluated their effectiveness as a strategy for implementing evidence based practices. This randomized trial evaluated the effectiveness of a virtual learning collaborative (VLC) in the implementation of a health promotion program for persons with serious mental illness (SMI) aimed at reducing cardiovascular risk reduction in routine mental health settings, compared to routine technical assistance (TA). METHODS: Fifty-five mental health provider organizations were recruited to participate in a Hybrid Type 3 cluster randomized implementation-effectiveness trial of the InSHAPE health promotion program for persons with SMI. Sites were stratified by size and randomized prior to implementation to an 18-month group-based VLC with monthly learning sessions or individual site TA with four scheduled conference calls over 18 months. Primary implementation and service outcomes were InSHAPE program fidelity, participation, and reach. Primary clinical outcomes were weight loss, cardiorespiratory fitness, and cardiovascular risk reduction (≥ 5% weight loss or > 50 m increase on the 6-Minute Walk Test). Program fidelity was assessed at 6, 12, and 24 months; program participation and participant-level outcomes were assessed at 3, 6, 9, and 12 months. RESULTS: VLC (N = 27) and TA (N = 28) sites were similar in organizational characteristics (all p > 0.05). At 12-month follow-up mean program fidelity score was higher in VLC compared to TA (90.5 vs. 79.1; p = 0.002), with over double the proportion with good fidelity (VLC = 73.9% vs. TA = 34.8%; p = 0.009). Over half of individuals in both VLC and TA achieved cardiovascular risk-reduction at 6-month follow-up (VLC: 51.0%; TA: 53.5%; p = 0.517) and at 12-month follow-up (62% VLC and TA; p = 0.912). At 12-month follow-up VLC compared to TA was associated with greater participation (VLC 69.5% vs. TA 56.4% attending at least 50% of sessions, p = 0.002); larger caseloads (VLC = 16 vs. TA = 11; p = 0.024); greater reach consisting of 45% greater number of participants receiving InSHAPE (VLC = 368 vs. TA = 253), and 58% greater number of participants achieving cardiovascular risk reduction (VLC = 150 vs. TA = 95). CONCLUSION: Virtual learning collaboratives compared to routine technical assistance as an implementation strategy for evidence-based health promotion promote greater intervention fidelity, greater levels of intervention participation, greater reach, and a greater number of participants achieving clinically significant risk reduction outcomes, while achieving similarly high levels of intervention effectiveness for participants who completed at least 6 months of the program.
Subject(s)
Education, Distance , Mental Health , Humans , Health Promotion , Weight Loss , Evidence-Based PracticeABSTRACT
Post-traumatic stress disorder (PTSD) leads to significant disability, unemployment, and substantial healthcare costs. The cost-effectiveness of vocational rehabilitation (VR) interventions is important to consider when determining which services to offer. This study assesses the cost-effectiveness and return on investment of Individual Placement and Support (IPS) compared to transitional work (TW) programs. Employment outcomes from a multisite randomized trial comparing IPS to TW in military veterans with PTSD (n = 541) were linked to Veterans Health Administration (VHA) archival medical record databases to examine the comparative cost-effectiveness and return on investment. Effectiveness was defined as hours worked and income earned in competitive jobs. Costs for VR, mental health, and medical care and income earned from competitive sources were annualized and adjusted to 2019 US dollars. The annualized mean cost per person of outpatient (including vocational services) were $3970 higher for IPS compared to TW ($23,245 vs. $19,276, respectively; P = 0.004). When TW income was included in costs, mean grand total costs per person per year were similar between groups ($29,828 IPS vs. $26,772 TW; P = 0.17). The incremental cost-effectiveness analysis showed that while IPS is more costly, it is also more effective. The return on investment (excluding TW income) was 32.9% for IPS ($9762 mean income/$29,691 mean total costs) and 29.6% for TW ($7326 mean income/$24,781 mean total costs). IPS significantly improves employment outcomes for individuals with PTSD with negligible increase in healthcare costs and yields very good return on investment compared to non-IPS VR services.
Subject(s)
Employment, Supported , Mental Disorders , Stress Disorders, Post-Traumatic , Veterans , Cost-Benefit Analysis , Humans , Mental Disorders/rehabilitation , Rehabilitation, Vocational , Stress Disorders, Post-Traumatic/rehabilitationABSTRACT
Psychiatric crisis care in the U.S. exemplifies the "more is less paradox" of U.S. health care. We spend more for health care than any other high-income country, yet our outcomes are typically poor compared to these other countries (OECD in OECD health statistics. Retrieved from https://www.oced.org/health/health-data.html , 2020). We do this, in part, by emphasizing medical treatments for problems that are inherently social, rather than addressing social determinants of health. Medical interventions for socio-economic problems are usually expensive and ineffective. For mental health crisis care, adding unfunded, untested, medical interventions to the current mélange of poorly funded, disorganized arrangements will not help. Instead, the U.S. should address social determinants, emphasize research-based interventions, and emphasize prevention-proven strategies that decrease costs and improve outcomes.
Subject(s)
Delivery of Health Care , Income , HumansABSTRACT
The COVID-19 pandemic has caused massive unemployment, exacerbated pre-existing behavioral health (mental health and substance use) disorders for many people, and created new disorders for others. Although policy changes have increased health care and unemployment benefits, most people want jobs and self-sufficiency rather than handouts. A robust evidence base shows that supported employment can enable unemployed people with behavioral health conditions to find competitive, integrated employment and behavioral health supports. Millions of U.S. citizens may need these services as the pandemic recedes and jobs become available. Government attention to supported employment is necessary now more than ever.
Subject(s)
COVID-19/epidemiology , Employment, Supported/organization & administration , Mental Health , Unemployment/psychology , Humans , Pandemics , SARS-CoV-2 , United States/epidemiologyABSTRACT
Evidence-based supported employment has become a core community mental health service in much of the U.S. Although a national learning community has facilitated progress in about half of the states, other states have tried to implement evidence-based supported employment on their own. Many studies have examined site-level factors influencing implementation of supported employment, but few have focused on the role of state agency policies and actions. This study examined four states that have not joined the learning community, comparing two that have implemented with success (adopting states) and two that have faced challenges (non-adopting states). This comparative case study approach compared barriers, facilitators, and strategies in two states adopting IPS to two states that did not. The authors examined quantitative data from public records and conducted content analysis of qualitative and quantitative data from key informant interviews. The two non-adopting states lacked model clarity, funding, focus on people with serious mental illness, and collaboration between state mental health and vocational rehabilitation agencies. The two successful states experienced similar barriers but overcame them following lawsuit settlements that required implementation of evidence-based supported employment. Key strategies for successful implementation were funding, fidelity monitoring, technical assistance, and collaboration between state mental health and vocational rehabilitation agencies. With legal settlements serving as the catalyst, states facing challenges to implementing evidence-based supported employment can achieve success using standard implementation strategies to fund and ensure the quality of services.
Subject(s)
Employment, Supported , Mental Disorders , Government Agencies , Humans , Policy , Rehabilitation, VocationalABSTRACT
PURPOSE: Service providers need effective strategies to implement evidence-based practices (EBPs) with high fidelity. This study aimed to evaluate an intensive implementation support strategy to increase fidelity to EBP standards in treatment of patients with psychosis. METHODS: The study used a cluster randomized design with pairwise assignment of practices within each of 39 Norwegian mental health clinics. Each site chose two of four practices for implementation: physical health care, antipsychotic medication management, family psychoeducation, illness management and recovery. One practice was assigned to the experimental condition (toolkits, clinical training, implementation facilitation, data-based feedback) and the other to the control condition (manual only). The outcome measure was fidelity to the EBP, measured at baseline and after 6, 12, and 18 months, analyzed using linear mixed models and effect sizes. RESULTS: The increase in fidelity scores (within a range 1-5) from baseline to 18 months was significantly greater for experimental sites than for control sites for the combined four practices, with mean difference in change of 0.86 with 95% CI (0.21; 1.50), p = 0.009). Effect sizes for increase in group difference of mean fidelity scores were 2.24 for illness management and recovery, 0.68 for physical health care, 0.71 for antipsychotic medication management, and 0.27 for family psychoeducation. Most improvements occurred during the first 12 months. CONCLUSIONS: Intensive implementation strategies (toolkits, clinical training, implementation facilitation, data-based feedback) over 12 months can facilitate the implementation of EBPs for psychosis treatment. The approach may be more effective for some practices than for others.
Subject(s)
Psychotic Disorders , Evidence-Based Practice , Humans , Norway , Psychotic Disorders/therapyABSTRACT
PURPOSE: Individual placement and support (IPS) is an evidence-based supported employment intervention. Quality of IPS implementation is assessed using a validated fidelity scale. Previous studies found a positive association between fidelity and employment outcomes at a single time-point. This study examines the longitudinal associations between IPS fidelity scores and employment outcomes. METHODS: We examined fidelity and employment outcome data for 27 IPS programs in the Netherlands providing IPS. These programs received at least one fidelity assessment and reported quarterly employment outcomes for at least one year to a central registry between 2014 and 2019. We first examined changes over time for fidelity and employment outcome. Then we analyzed the longitudinal associations between the quarterly employment outcomes and the IPS fidelity assessments on multiple time-points using a mixed-model analysis for the 17 programs with at least two fidelity assessments. RESULTS: Both IPS fidelity and employment outcomes improved over time, with the largest improvement in employment outcomes achieved after 18 months of implementation. We found a significant positive longitudinal association between IPS-fidelity and employment. CONCLUSIONS: Improvement of fidelity is associated with improvement of employment outcomes over time. Future research should be focused on the improvement of specific elements of IPS implementation and their influence on employment outcomes.
Subject(s)
Employment, Supported , Mental Disorders , Humans , Marriage , Mental Disorders/therapy , Netherlands , Rehabilitation, VocationalABSTRACT
Background: People with severe mental illness (SMI) and criminal justice involvement (CJI) are able to achieve competitive employment when provided with evidence-based services, but outcomes are modest compared to studies of SMI in general.Aims: To investigate barriers to employment facing people with SMI and CJI receiving employment services.Method: Employment service providers assessed top three barriers to employment for 87 people with SMI and CJI enrolled in a randomized controlled trial comparing a job club program to supported employment. Main barriers were identified and differences between programs were analyzed. Associations between barriers and client background characteristics were investigated.Results: The most common barriers were failure to engage and disengagement from services, followed by substance abuse. Staff from the two employment programs reported similar barriers.Conclusions: Engagement problems were the single most important barrier to employment across programs. Surprisingly, criminal history was rarely mentioned. This may be explained by barriers arising earlier in the process, before achieving employer contact. The results call for recognition and awareness of the importance of motivational issues as well as factors that may inhibit engagement in services, highlighting possible augmentations to evidence-based employment services that may be necessary in the rehabilitation of this patient group.
Subject(s)
Criminals , Employment, Supported , Mental Disorders , Criminal Law , Humans , MotivationABSTRACT
Evidence-based practices are effective only when implemented faithfully. This paper explicates the history, standardization, and methods for developing and validating measures of fidelity. We overviewed the past 20 years of developing fidelity measures, summarized standardization of the development procedures, and described needed psychometric assessments. Fidelity assessment has become the sine qua non of implementation, technical assistance, and research on evidence-based practices. Researchers have established standardized procedures for scale development and psychometric testing. Widescale use of fidelity measurement remains challenging. The implementation of evidence-based practice and the development and validation of fidelity measures are interdependent. International improvements of mental health care will require attention to both.
Subject(s)
Evidence-Based Practice , Humans , PsychometricsABSTRACT
This study examined the psychometric properties and feasibility of the Illness Management and Recovery (IMR) Fidelity scale. Despite widespread use of the scale, the psychometric properties have received limited attention. Trained fidelity assessors conducted assessments four times over 18 months at 11 sites implementing IMR. The IMR Fidelity scale showed excellent interrater reliability (.99), interrater item agreement (94%), internal consistency (.91-.95 at three time points), and sensitivity to change. Frequency distributions generally showed that item ratings included the entire range. The IMR Fidelity scale has excellent psychometric properties and should be used to evaluate and guide the implementation of IMR.Trial registration: ClinicalTrials.gov Identifier: NCT03271242.
Subject(s)
Mental Disorders , Humans , Mental Disorders/therapy , Psychometrics , Reproducibility of ResultsABSTRACT
To assess the implementation of effective practices, mental health programs need standardized measures. The General Organizational Index (GOI), although widely used for this purpose, has received minimal psychometric research. For this study, we assessed psychometric properties of the GOI scale administered four times over 18 months during the implementation of a new program in 11 sites. The GOI scale demonstrated high levels of interrater reliability (.97), agreement between assessors on item ratings (86% overall), internal consistency (.77-.80 at three time points), sensitivity to change, and feasibility. We conclude that the GOI scale has acceptable psychometric properties, and its use may enhance implementation and research on evidence-based mental health practices.Trial registration: REK2015/2169. ClinicalTrials.gov Identifier: NCT03271242.
Subject(s)
Evidence-Based Practice , Quality Improvement , Humans , Organizations , Psychometrics , Reproducibility of ResultsABSTRACT
Mental health programs need an instrument to monitor adherence to evidence-based physical health care for people with serious mental illness. The paper describes the Physical Health Care Fidelity Scale and study interrater reliability, frequency distribution, sensitivity to change and feasibility. Four fidelity assessments were conducted over 18 months at 13 sites randomized to implementation support for evidence-based physical health care. We found good to excellent interrater reliability, adequate sensitivity for change, good feasibility and wide variability in fidelity across sites after 18 months of implementation. Programs were more successful in establishing Policies stating physical health care standards than in implementing these Policies. The Physical Health Care Fidelity Scale measures and guides implementation of evidence-based physical health care reliably.Trial registration: ClinicalTrials.gov Identifier: NCT03271242.
Subject(s)
Delivery of Health Care , Evidence-Based Practice , Humans , Psychometrics , Reproducibility of ResultsABSTRACT
The paper describes the Antipsychotic Medication Management Fidelity Scale and its psychometric properties, including interrater reliability, frequency distribution, sensitivity to change and feasibility. Fidelity assessors conducted fidelity reviews four times over 18 months at eight sites receiving implementation support for evidence-based antipsychotic medication management. Data analyses shows good to fair interrater reliability, adequate sensitivity to change over time and good feasibility. At 18 months, item ratings varied from poor to full fidelity on most items. Use of the scale can assess fidelity to evidence-based guidelines for antipsychotic medication management and guide efforts to improve practice. Further research should improve and better calibrate some items, and improve the procedures for access to information.Trial registration: ClinicalTrials.gov Identifier: NCT03271242.
Subject(s)
Antipsychotic Agents , Antipsychotic Agents/therapeutic use , Data Collection , Humans , Medication Therapy Management , Psychometrics , Reproducibility of ResultsABSTRACT
Individual Placement and Support is a standardized model of supported employment, developed initially for people with serious mental disorders and now applied to people with a range of disabilities. More than two dozen randomized controlled trials around the world show that the approach helps a majority of participants to succeed in competitive employment. Individual Placement and Support is spreading rapidly across the USA and in many other high-income countries, with facilitation by an international learning community.
Subject(s)
Employment, Supported , Mental Disorders/rehabilitation , Humans , JapanABSTRACT
For people with psychiatric disabilities, demographic characteristics and measures of clinical status are often used to allocate scarce employment services. This study examined a battery of potential client predictors of competitive employment, testing the hypothesis that evidence-based supported employment would mitigate the negative effects of poor work history, uncontrolled symptoms, substance abuse, and other client factors. In a secondary analysis of 2055 unemployed Social Security Disability Insurance beneficiaries with schizophrenia or affective disorders, we examined 20 baseline client factors as predictors of competitive employment. The analysis used logistic regression to identify significant client predictors and then examined interactions between significant predictors and receipt of evidence-based supported employment. Work history was a strong predictor of employment, and other client measures (fewer years on disability rolls, Hispanic ethnicity, and fewer physical health problems) were modestly predictive. Evidence-based supported employment mitigated negative client factors, including poor work history. Participants with a poor work history benefitted from supported employment even more than those with a recent work experience. Evidence-based supported employment helps people with serious mental illness, especially those with poor job histories, to obtain competitive employment. Factors commonly considered barriers to employment, such as diagnosis, substance use, hospitalization history, and misconceptions about disability benefits, often have little or no impact on competitive employment outcomes.
Subject(s)
Employment/statistics & numerical data , Mood Disorders/epidemiology , Schizophrenia/epidemiology , Social Security/statistics & numerical data , Adult , Employment, Supported/statistics & numerical data , Female , Health Status , Hospitalization/statistics & numerical data , Humans , Male , Middle Aged , Quality of Life , Socioeconomic Factors , Substance-Related Disorders/epidemiologyABSTRACT
Youth with developmental and psychiatric disabilities encounter significant vocational challenges, even when they receive supported employment services. We examined the barriers to employment for 280 transition-age youth with disabilities enrolled in supported employment in eight community rehabilitation centers. Employment team members identified each youth's top three barriers to employment using a 21-item checklist. Lack of work experience, transportation problems, and program engagement issues represented common barriers for both youth with developmental disabilities (53, 36, and 25%) and youth with psychiatric disabilities (20, 33, and 26%). Additional common barriers among youth with developmental disabilities included cognitive problems (32%) and lack of social skills (23%) and among youth with psychiatric disabilities included poor control of psychiatric symptoms (23%). Despite receiving evidence-based employment services, youth with disabilities encounter many barriers to employment. Awareness of typical barriers for transition-age youth, including those specific to different disability groups, may help employment programs anticipate challenges and develop strategies that avoid these barriers and their effects on employment opportunities.