Evaluation of a Train-The-Trainers Model for Family Peer Advocates in Children's Mental Health.

Standardized training and credentialing is increasingly important to states and healthcare systems. Workforce shortages in children's mental health can be addressed through training and credentialing of professional peer parents (called family peer advocates or FPAs), who deliver a range of services to caregivers. A theory-based training program for FPAs targeting skills and knowledge about childhood mental health services (Parent Empowerment Program, or PEP) was developed through a partnership among a statewide family-run organization, state policy leaders, and academic researchers. Prior studies by this team using highly-experienced family peer advocates (who were also co-developers of the training program) as trainers found improvements in knowledge about mental health services and self-efficacy. In 2010, to meet demands and scale the model, a training of trainers (TOT) model was developed to build a cohort of locally-trained FPAs to deliver PEP training. A pre/post design was used to evaluate the impact of TOT model on knowledge and self-efficacy among 318 FPAs across the state. Participants showed significant pre-post (6 month) changes in knowledge about mental health services and self-efficacy. There were no significant associations between any FPA demographic characteristics and their knowledge or self-efficacy scores. A theory-based training model for professional peer parents working in the children's mental health system can be taught to local FPAs, and it improves knowledge about the mental health system and self-efficacy. Studies that evaluate the effectiveness of different training modalities are critical to ensure that high-quality trainings are maintained.

A Response to Proposed Budget Cuts Affecting Children's Mental Health: Protecting Policies and Programs That Promote Collective Efficacy.

Children stand to lose if the federal government follows through on threats to cut funding for critical safety-net programs that have long supported families and communities. Although cuts directly targeting children's mental health are a great concern, cuts to policies that support health, housing, education, and family income are equally disturbing. These less publicized proposed cuts affect children indirectly, but they have direct effects on their families and communities. The importance of these services is supported by an extensive body of social learning research that promotes collective efficacy-neighbors positively influencing each other-shown to have positive long-term effects on children's development and adult outcomes. In this article, the authors describe two federal programs that by virtue of their impact on families and communities are likely to promote collective efficacy and positively affect children's mental health; both programs are facing severe cutbacks. They suggest that states adopt a cross-system approach to promote policies and programs in general medical health, mental health, housing, education, welfare and social services, and juvenile justice systems as a viable strategy to strengthen families and communities and promote collective efficacy. The overall goal is to advance a comprehensive national mental health policy for children that enhances collaboration across systems and strengthens families and communities, which is especially critical for children living in marginalized communities.

Parent Burden in Accessing Outpatient Psychiatric Services for Adolescent Depression in a Large State System.

OBJECTIVE: This study examined barriers facing parents who seek outpatient psychiatric care in a large state system for adolescents with depression. METHODS: A total of 264 outpatient facilities licensed to treat youths in New York were contacted by using a mystery shopper methodology. Callers tracked the number of call attempts, in-person appointments, and other steps required prior to seeing a psychiatrist. RESULTS: Fewer than two-thirds of parents made a psychiatry, therapy, or intake appointment. Of those who did not make an appointment, 19% received no referrals. Most callers made at least two calls and spoke with at least two people before initiating scheduling. Virtually all clinics required at least one intake or therapy appointment before receipt of a psychiatry appointment. Parental burden did not differ by region, urbanicity, clinic type, seasonality (spring or summer), or insurance status. CONCLUSIONS: Families of youths with mental health needs face considerable burden in accessing timely treatment.

Using a Theory-Guided Learning Collaborative Model to Improve Implementation of EBPs in a State Children's Mental Health System: A Pilot Study.

Learning collaboratives (LCs) are used widely to promote implementation of evidence-based practices. However, there has been limited research on the effectiveness of LCs and models vary widely in their structure, focus and components. The goal of the present study was to develop and field test a theory-based LC model to augment a state-led, evidence-based training program for clinicians providing mental health services to children. Analysis of implementation outcomes contrasted LC sites to matched comparison sites that participated in the clinical training program alone. Results suggested that clinicians from sites participating in the LC were more highly engaged in the state-led clinical training program and were more likely to complete program requirements.

What Predicts Clinician Dropout from State-Sponsored Managing and Adapting Practice Training.

Dropouts from system-wide evidence-based practice trainings are high; yet there are few studies on what predicts dropouts. This study examined multilevel predictors of clinician dropout from a statewide training on the Managing and Adapting Practice program. Extra-organizational structural variables, intra-organizational variables and clinician variables were examined. Using multivariable logistic regression analysis, state administrative data and prospectively collected clinician participation data were used to predict dropout. Two characteristics were predictive: younger clinicians and those practicing in upstate-rural areas compared to downstate-urban areas were less likely to drop out from training. Implications for research and policy are described.

The Family Value of Information, Community Support, and Experience Study: Rationale, Design, and Methods of a "Family-Centered" Research Study.

The Patient Protection and Affordable Care Act focuses on improving consumer engagement and patient-centered care. This article describes the design and rationale of a study targeting family engagement in pediatric mental health services. The study is a 90-day randomized trial of a telephone-delivered Family Navigator services versus usual care for parents of Medicaid-insured youth younger than 13 years with serious mental illness. Youth are identified through a pediatric antipsychotic medication preauthorization program. Family Navigators offer peer support to empower and engage parents in their child's recovery. Outcomes include parent report of empowerment, social support, satisfaction with child mental health services, and child functioning as well as claims-based measures of psychotherapy service utilization and antipsychotic medication dosage. The focus on "family-centered" care in this study is strongly supported by the active role of consumers in study design and implementation.

Detection and treatment of mental health issues by pediatric PCPs in New York State: an evaluation of Project TEACH.

OBJECTIVE: The authors evaluated Project TEACH (PT), a statewide training and consultation program for pediatric primary care providers (PCPs) on identification and treatment of mental health conditions. METHODS: An intervention group of 176 PCPs who volunteered for PT training was compared with a stratified random sample of 200 PCPs who did not receive PT training. Data on prescription practices, diagnoses, and follow-up care were from New York State Medicaid files (2009-2013) for youths seen by the trained (N=21,784) and untrained (N=46,607) PCPs. RESULTS: The percentage of children prescribed psychotropic medication increased after PT training (9% to 12%, p<.001), a larger increase than in the untrained group (4% to 5%, p<.001) (comparison, p<.001). Fewer differences were noted in diagnoses and in medication use and follow-up care among children with depression. CONCLUSIONS: This intervention may have an impact on providers' behaviors, but further research is needed to clarify its effectiveness.

Parent Depression and Anger in Peer-Delivered Parent Support Services.

Knowledge about parents who seek peer-delivered parent support services in children's mental health is limited. In this prospective study, characteristics of 124 parents who sought peer parent advocate services related to their children's behavioral difficulties are described. This urban sample consisted primarily of low-income mothers of color, 80% of whom were caring for children with clinically significant behavioral problems. Of these parents, 64% endorsed clinically significant levels of depressive symptoms at baseline. Linear mixed effects models were used to examine associations between parent depression and anger expression with working alliances with peer advocates. No independent or combined effects of parent depression or anger expression on working alliance were found. However, adjusting for family demographic factors, caregiver strain and child symptoms, parent depression interacted with anger expression to influence working alliances, primarily around agreement and mutual engagement on goals. Among parents who endorsed clinically significant depressive symptoms, anger expression did not influence working alliance but among non-depressed parents, anger expression was negatively associated with working alliance. Implications for training peer parent advocates to more effectively engage low income parents are discussed.

Innovations in the Identification and Referral of Mothers at Risk for Depression: Development of a Peer-to-Peer Model.

This paper describes a feasibility study of a peer-delivered prevention intervention to identify mothers at high risk for depression and facilitate engagement in mental health services for their emotional health. Sixteen family peer advocates and their supervisors partnered with academic researchers over a period of six months to develop a four-session intervention that focused on identifying symptoms of depression, providing education about depression and treatment, actively linking caregivers to treatment for their own emotional health, and assisting caregivers in becoming active participants in their mental health care. Collaborating with peers to develop the model enhanced its perceived relevance and utility, and resulted in an intervention that was complimentary to their roles and the mission of peer-delivered support services. Peer/professional partnerships may be beneficial for enhancing the feasibility and acceptability of research efforts; the impact of peers' participation in the current project and the need for future research to develop and study peer-delivered models is discussed.

A literature review of learning collaboratives in mental health care: used but untested.

OBJECTIVE: Policy makers have increasingly turned to learning collaboratives (LCs) as a strategy for improving usual care through the dissemination of evidence-based practices. The purpose of this review was to characterize the state of the evidence for use of LCs in mental health care. METHODS: A systematic search of major academic databases for peer-reviewed articles on LCs in mental health care generated 421 unique articles across a range of disciplines; 28 mental health articles were selected for full-text review, and 20 articles representing 16 distinct studies met criteria for final inclusion. Articles were coded to identify the LC components reported, the focus of the research, and key findings. RESULTS: Most of the articles included assessments of provider- or patient-level variables at baseline and post-LC. Only one study included a comparison condition. LC targets ranged widely, from use of a depression screening tool to implementation of evidence-based treatments. Fourteen crosscutting LC components (for example, in-person learning sessions, phone meetings, data reporting, leadership involvement, and training in quality improvement methods) were identified. The LCs reviewed reported including, on average, seven components, most commonly in-person learning sessions, plan-do-study-act cycles, multidisciplinary quality improvement teams, and data collection for quality improvement. CONCLUSIONS: LCs are being used widely in mental health care, although there is minimal evidence of their effectiveness and unclear reporting in regard to specific components. Rigorous observational and controlled research studies on the impact of LCs on targeted provider- and patient-level outcomes are greatly needed.

Scaling up evidence-based practices for children and families in New York State: toward evidence-based policies on implementation for state mental health systems.

Dissemination of innovations is widely considered the sine qua non for system improvement. At least two dozen states are rolling out evidence-based mental health practices targeted at children and families using trainings, consultations, webinars, and learning collaboratives to improve quality and outcomes. In New York State (NYS) a group of researchers, policymakers, providers, and family support specialists have worked in partnership since 2002 to redesign and evaluate the children's mental health system. Five system strategies driven by empirically based practices and organized within a state-supported infrastructure have been used in the child and family service system with more than 2,000 providers: (a) business practices, (b) use of health information technologies in quality improvement, (c) specific clinical interventions targeted at common childhood disorders, (d) parent activation, and (e) quality indicator development. The NYS system has provided a laboratory for naturalistic experiments. We describe these initiatives, key findings and challenges, lessons learned for scaling, and implications for creating evidence-based implementation policies in state systems.

Quality indicators for family support services and their relationship to organizational social context.

Quality measurement is an important component of healthcare reform. The relationship of quality indicators (QIs) for parent-delivered family support services to organizational social contexts known to improve quality is unexamined. This study employs data collected from 21 child mental health programs that deliver team-based family support services. Performance on two levels of QIs-those targeting the program and staff-were significantly associated with organizational social context profiles and dimensions. High quality program policies are associated with positive organizational cultures and engaging climates. Inappropriate staff practices are associated with resistant cultures. Implications for organizational strategies to improve service quality are discussed.

What family support specialists do: examining service delivery.

This study describes services provided by family support specialists (FSS), peer advocates in programs for children with serious psychiatric conditions, to delineate differences between recommended components of FSS services and services actually provided. An analysis of qualitative interview and observational data and quantitative survey data from 63 staff at 21 mental health programs in New York identified that FSS and other staff have generally similar ideas about FSS services, and that these perceptions of activities are generally congruent with what FSS actually did. Implications of findings are discussed in the context of developing competencies and quality indicators for FSS.

Understanding the components of quality improvement collaboratives: a systematic literature review.

CONTEXT: In response to national efforts to improve quality of care, policymakers and health care leaders have increasingly turned to quality improvement collaboratives (QICs) as an efficient approach to improving provider practices and patient outcomes through the dissemination of evidence-based practices. This article presents findings from a systematic review of the literature on QICs, focusing on the identification of common components of QICs in health care and exploring, when possible, relations between QIC components and outcomes at the patient or provider level. METHODS: A systematic search of five major health care databases generated 294 unique articles, twenty-four of which met our criteria for inclusion in our final analysis. These articles pertained to either randomized controlled trials or quasi-experimental studies with comparison groups, and they reported the findings from twenty different studies of QICs in health care. We coded the articles to identify the components reported for each collaborative. FINDINGS: We found fourteen crosscutting components as common ingredients in health care QICs (e.g., in-person learning sessions, phone meetings, data reporting, leadership involvement, and training in QI methods). The collaboratives reported included, on average, six to seven of these components. The most common were in-person learning sessions, plan-do-study-act (PDSA) cycles, multidisciplinary QI teams, and data collection for QI. The outcomes data from these studies indicate the greatest impact of QICs at the provider level; patient-level findings were less robust. CONCLUSIONS: Reporting on specific components of the collaborative was imprecise across articles, rendering it impossible to identify active QIC ingredients linked to improved care. Although QICs appear to have some promise in improving the process of care, there is great need for further controlled research examining the core components of these collaboratives related to patient- and provider-level outcomes.

Family support in prevention programs for children at risk for emotional/behavioral problems.

We conducted a review of empirically based prevention programs to identify prevalence and types of family support services within these programs. A total of 238 articles published between 1990 and 2011 that included a family support component were identified; 37 met criteria for inclusion. Following the Institute of Medicine's typology, prevention programs were categorized as universal, selective, or indicated; programs containing more than one prevention level were characterized as multi-level. Family support types included those led by a mental health professional, led by a peer, or team-led. Among the 37 prevention programs reviewed, 27% (n=10) were universal, 41% (n=15) were selective, 16% (n=6) were indicated, and 16% (n=6) were multi-level. The predominant model of family support was professionally led (95%, n=35). Two (n=5%) provided team-led services. None were purely peer-led. In terms of content of family support services, all (100%, n=37) provided instruction/skill build. Information and education was provided by 70% (n=26), followed by emotional support (n=11, 30%) and instrumental or concrete assistance (n=11, 30%). Only 14% (n=5) provided assistance with advocacy. The distribution of models and content of services in prevention studies differ from family support within treatment studies. As family support is likely to be an enduring component of the child and family mental health service continuum, comparative effectiveness studies are needed to inform future development.

Impact of Empowerment Training on the Professional Work of Family Peer Advocates.

A pilot study using a prospective design examined the impact of a collaboratively developed training model, called the Parent Empowerment Program (PEP), for professionally-employed family peer advocates who work with caregivers of children with mental health needs. This training used a combination of didactic, practice exercises, and group discussion. It targeted specific mental health knowledge content and collaborative skills to facilitate the work of family peer advocates in empowering caregivers. Co-delivered by a family peer advocate and clinician, the training consisted of a 40-hour face-to-face training, followed by six monthly face-to-face booster sessions. A total of 15 advocates participated in assessments conducted at baseline and post-training. This group of experienced family peer advocates showed no significant increase in knowledge about mental health content, but post-training assessments indicated increased collaborative skills and mental health services self-efficacy. This initial evaluation has implications for expanding training and support for the emergent workforce of professionally-employed family peer advocates in children's mental health.

The Application of Behavior Change Theory to Family-Based Services: Improving Parent Empowerment in Children's Mental Health.

We describe the development of a parent empowerment program (PEP) using a community-based participatory research approach. In collaboration with a group of dedicated family advocates working with the Mental Health Association of New York City and state policy makers, academic researchers took an iterative approach to crafting and refining PEP to better prepare family advocates to help bridge the gaps in service access among children with emotional and behavioral problems. Despite the growth of family-led, family support programs nationally, research that demonstrates the positive benefits of such programs is scarce in the children's mental health literature. The PEP model is based on research data about barriers families face in mental health service utilization (e.g., stigma, perceptions of providers, attitudes towards mental illness, service availability, etc.). PEP is premised on (a) the concept of empowerment as a process, (b) the need to engage parents in becoming active agents of change, and (c) the application of an integrated framework to empower parents, called the Parents as Agents of Change model. Our paper focuses on describing the application of a Unified Theory of Behavior Change as a theoretical framework to help activate parents as change agents in meeting their children's mental health needs. Based on an integrated model of grassroots driven Principles of Parent Support and research-based Unified Theory of Behavior Change, PEP's Parents as Agents of Change model provides a conceptual framework for testing the effectiveness of family support services in children's mental health, a much-needed area for future research.

The NIMH blueprint for change report: research priorities in child and adolescent mental health.

The National Institute of Mental Health established a special subgroup of its National Advisory Mental Health Council to review major research findings on child and adolescent psychiatric disorders over the past decade and to recommend research priorities for the next decade. This Workgroup on Child and Adolescent Mental Health Intervention Development and Deployment published its report, titled Blueprint for Change: Research on Child and Adolescent Mental Health, in August 2001, and several new research announcements reflecting these new directions have been issued since that time. This article summarizes the rationale for and background to the report, its major conclusions, and the reasons why interdisciplinary and translational approaches to research questions in child and adolescent mental health will help to maximize scientific advances.