ABSTRACT
Public-academic partnership-based program evaluations can generate actionable evidence for policymaking, program design and implementation in improving school-based mental health service delivery. The University of Pennsylvania Center for Mental Health and public behavioral health care agencies in Philadelphia in the United States have evaluated Philadelphia's school mental health programs reimbursable through Medicaid billing since 2008. The variety of evaluations include (1) examining acute mental health service use of children receiving school-based mental health care and Medicaid expenditure, (2) examining children's externalizing and internalizing behaviors to measure school mental health providers' performance, and (3) examining effects of different types of school mental health programs on children's behavioral health functioning, school outcomes, and other out-of-school service use. This paper reports key findings of these evaluations, discusses how programs have been refined based on evaluation results, and shares lessons learned for successful public-academic partnership-based evaluations to promote use of actionable evidence.
Subject(s)
Mental Health Services , School Mental Health Services , Child , Humans , United States , Mental Health , Schools , Program EvaluationABSTRACT
BACKGROUND: Healthcare and human services increasingly rely on teams of individuals to deliver services. Implementation of evidence-based practices and other innovations in these settings requires teams to work together to change processes and behaviors. Accordingly, team functioning may be a key determinant of implementation outcomes. This systematic review will identify and summarize empirical research examining associations between team functioning and implementation outcomes in healthcare and human service settings. METHODS: We will conduct a comprehensive search of bibliographic databases (e.g., MEDLINE, PsycINFO, CINAHL, ERIC) for articles published from January 2000 or later. We will include peer-reviewed empirical articles and conference abstracts using quantitative, qualitative, or mixed methods. We will include experimental or observational studies that report on the implementation of an innovation in a healthcare or human service setting and examine associations between team functioning and implementation outcomes. Implementation outcomes of interest are acceptability, adoption, appropriateness, cost, feasibility, fidelity, penetration, and sustainability. Two reviewers will independently screen all titles/abstracts, review full-text articles, and extract data from included articles. We will use the Mixed Methods Appraisal Tool to assess methodological quality/bias and conduct a narrative synthesis without meta-analysis. DISCUSSION: Understanding how team functioning influences implementation outcomes will contribute to our understanding of team-level barriers and facilitators of change. The results of this systematic review will inform efforts to implement evidence-based practices in team-based service settings. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42020220168.
Subject(s)
Delivery of Health Care , Health Facilities , Evidence-Based Practice , Humans , Meta-Analysis as Topic , Systematic Reviews as TopicABSTRACT
PURPOSE: We developed and implemented a new model of collaborative care that includes a triage and referral management system. We present initial implementation metrics using the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework. METHODS: Primary care clinicians in 8 practices referred patients with any unmet mental health needs to the Penn Integrated Care program. Assessments were conducted using validated measures. Patients were primarily triaged to collaborative care (26%) or specialty mental health care with active referral management (70%). We conducted 50 qualitative interviews to understand the implementation process and inform program refinement. Our primary outcomes were reach and implementation metrics, including referral and encounter rates derived from the electronic health record. RESULTS: In 12 months, 6,124 unique patients were referred. Assessed patients reported symptoms consistent with a range of conditions from mild to moderate depression and anxiety to serious mental illnesses including psychosis and acute suicidal ideation. Among patients enrolled in collaborative care, treatment entailed a mean of 7.2 (SD 5.1) encounters over 78.1 (SD 51.3) days. Remission of symptoms was achieved by 32.6% of patients with depression and 39.5% of patients with anxiety. Stakeholders viewed the program favorably and had concrete suggestions to ensure sustainability. CONCLUSIONS: The Penn Integrated Care program demonstrated broad reach. Implementation was consistent with collaborative care as delivered in seminal studies of the model. Our results provide insight into a model for launching and implementing collaborative care to meet the needs of a diverse group of patients with the full range of mental health conditions seen in primary care.
Subject(s)
Delivery of Health Care, Integrated/organization & administration , Mental Disorders/therapy , Patient Care Team , Primary Health Care/methods , Anxiety , Cooperative Behavior , Humans , Mental Health , Program Development , Program EvaluationABSTRACT
BACKGROUND: Public schools in the United States are the main providers of mental health services to children but are often ill equipped to provide quality mental health care, especially in low-income urban communities. Schools often rely on partnerships with community organizations to provide mental health services to students. However, collaboration and communication challenges often hinder implementation of evidence-based mental health strategies. Interventions informed by team science, such as Team Strategies and Tools to Enhance Performance and Patient Safety (TeamSTEPPS), have the potential to improve treatment implementation and collaboration within schools. OBJECTIVE: The objective of this study is to improve communication and collaboration strategies among mental health and school staff by adapting an evidence-based team science intervention for school settings. We present a protocol for a hybrid effectiveness-implementation study to adapt TeamSTEPPS using stakeholder feedback, develop a tailored implementation plan, and pilot the adapted content in eight schools. METHODS: Study participants will be recruited from public and charter schools and agencies overseeing school mental health services in the local metro area. We will characterize current services by conducting a needs assessment including stakeholder interviews, observations, and review of administrative data. Thereafter, we will establish an advisory board to understand challenges and develop possible solutions to guide additional TeamSTEPPS adaptations along with a complementary implementation plan. In aim 3, we will implement the adapted TeamSTEPPS plus tailored implementation strategies in eight schools using a pre-post design. The primary outcome measures include the feasibility and acceptability of the adapted TeamSTEPPS. In addition, self-report measures of interprofessional collaboration and teamwork will be collected from 80 participating mental health and school personnel. School observations will be conducted prior to and at three time points following the intervention along with stakeholder interviews. The analysis plan includes qualitative, quantitative, and mixed methods analysis of feasibility and acceptability, school observations, stakeholder interviews, and administrative data of behavioral health and school outcomes for students receiving mental health services. RESULTS: Recruitment for the study has begun. Goals for aim 1 are expected to be completed in Spring 2021. CONCLUSIONS: This study utilizes team science to improve interprofessional collaboration among school and mental health staff and contributes broadly to the team science literature by developing and specifying implementation strategies to promote sustainability. Results from this study will provide knowledge about whether interventions to improve school culture and climate can ready both mental health and school systems for implementation of evidence-based mental health practices. TRIAL REGISTRATION: ClinicalTrials.gov NCT04440228; https://clinicaltrials.gov/ct2/show/NCT04440228. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/26567.
ABSTRACT
OBJECTIVE: Continuous pulse oximetry monitoring (cSpO2) in children with bronchiolitis does not improve clinical outcomes and has been associated with increased resource use and alarm fatigue. It is critical to understand the factors that contribute to cSpO2 overuse in order to reduce overuse and its associated harms. METHODS: This multicenter qualitative study took place in the context of the Eliminating Monitor Overuse (EMO) SpO2 study, a cross-sectional study to establish rates of cSpO2 in bronchiolitis. We conducted semistructured interviews, informed by the Consolidated Framework for Implementation Research, with a purposive sample of stakeholders at sites with high and low cSpO2 use rates to identify barriers and facilitators to addressing cSpO2 overuse. Interviews were audio recorded and transcribed. Analyses were conducted using an integrated approach. RESULTS: Participants (n = 56) included EMO study site principal investigators (n = 12), hospital administrators (n = 8), physicians (n = 15), nurses (n = 12), and respiratory therapists (n = 9) from 12 hospitals. Results suggest that leadership buy-in, clear authoritative guidelines for SpO2 use incorporated into electronic order sets, regular education about cSpO2 in bronchiolitis, and visual reminders may be needed to reduce cSpO2 utilization. Parental perceptions and individual clinician comfort affect cSpO2 practice. CONCLUSION: We identified barriers and facilitators to deimplementation of cSpO2 for stable patients with bronchiolitis across children's hospitals with high- and low-cSpO2 use. Based on these data, future deimplementation efforts should focus on clear protocols for cSpO2, EHR changes, and education for hospital staff on bronchiolitis features and rationale for reducing cSpO2.