Implementation-as-Usual in Community-Based Organizations Providing Specialized Services to Individuals with Autism Spectrum Disorder: A Mixed Methods Study.

Autism spectrum disorder (ASD) is a highly prevalent neurodevelopmental disorder. ASD community-based organizations (ASD-CBOs) underutilize or inconsistently utilize evidence-based practices (ASD-EBPs) despite numerous available EBPs to treat ASD. Nonetheless, ASD-CBOs implement changes to practices regularly. Understanding ASD-CBO's implementation-as-usual (IAU) processes may assist to develop strategies to facilitate ASD-EBP adoption, implementation and sustainment. A convergent mixed methods (quan + QUAL) design was utilized. Twenty ASD-CBO agency leaders (ALs) and 26 direct providers (DPs), from 21 ASD-CBOs, completed the Autism Model of Implementation Survey Battery, including demographic and agency IAU process questions. Surveys were analyzed through descriptive and content analyses. A subset of 10 ALs provided qualitative interview data that were analyzed using coding, consensus and comparison methods to allow for a more comprehensive understanding of the IAU process within their ASD-CBOs. Quantitative analyses and qualitative coding were merged utilizing a joint display and compared. Results suggest that the IAU process follows some phases identified in the Exploration, Preparation, Implementation, Sustainment (EPIS) framework but were conducted in an informal manner-lacking specificity, structure and consistency across and within ASD-CBOs. Moreover, data suggest adding a specific adoption decision phase to the framework. Nonetheless, most ALs felt previous implementation efforts were successful. IAU processes were explored to determine whether the implementation process may be an area for intervention to increase ASD-EBP utilization in ASD-CBOs. Developing a systematized implementation process may facilitate broader utilization of high quality ASD-EBPs within usual care settings, and ultimately improve the quality of life for individuals with ASD and their families.

Advancing successful implementation of task-shifted mental health care in low-resource settings (BASIC): protocol for a stepped wedge cluster randomized trial.

BACKGROUND: The mental health treatment gap-the difference between those with mental health need and those who receive treatment-is high in low- and middle-income countries. Task-shifting has been used to address the shortage of mental health professionals, with a growing body of research demonstrating the effectiveness of mental health interventions delivered through task-shifting. However, very little research has focused on how to embed, support, and sustain task-shifting in government-funded systems with potential for scale up. The goal of the Building and Sustaining Interventions for Children (BASIC) study is to examine implementation policies and practices that predict adoption, fidelity, and sustainment of a mental health intervention in the education sector via teacher delivery and the health sector via community health volunteer delivery. METHODS: BASIC is a Hybrid Type II Implementation-Effectiveness trial. The study design is a stepped wedge, cluster randomized trial involving 7 sequences of 40 schools and 40 communities surrounding the schools. Enrollment consists of 120 teachers, 120 community health volunteers, up to 80 site leaders, and up to 1280 youth and one of their primary guardians. The evidence-based mental health intervention is a locally adapted version of Trauma-focused Cognitive Behavioral Therapy, called Pamoja Tunaweza. Lay counselors are trained and supervised in Pamoja Tunaweza by local trainers who are experienced in delivering the intervention and who participated in a Train-the-Trainer model of skills transfer. After the first sequence completes implementation, in-depth interviews are conducted with initial implementing sites' counselors and leaders. Findings are used to inform delivery of implementation facilitation for subsequent sequences' sites. We use a mixed methods approach including qualitative comparative analysis to identify necessary and sufficient implementation policies and practices that predict 3 implementation outcomes of interest: adoption, fidelity, and sustainment. We also examine child mental health outcomes and cost of the intervention in both the education and health sectors. DISCUSSION: The BASIC study will provide knowledge about how implementation of task-shifted mental health care can be supported in government systems that already serve children and adolescents. Knowledge about implementation policies and practices from BASIC can advance the science of implementation in low-resource contexts. TRIAL REGISTRATION: Trial Registration: ClinicalTrials.gov Identifier: NCT03243396. Registered 9th August 2017, https://clinicaltrials.gov/ct2/show/NCT03243396.

Discrepancies and Agreement in Perceptions of Implementation Leadership: Associations with Dosage of School-Based Evidence-Based Practices for Children with Autism.

Studies demonstrate that discrepancies among leader-follower perceptions of leadership are related to organizational processes that may impact evidence-based practice (EBP) implementation. However, it is unknown whether discrepancies in leadership perceptions also predict EBP use. This study examined the association of principal-staff alignment and discrepancy in perceptions of implementation leadership with the dosage of three Autism-focused school-based EBPs, Discrete Trial Training, Pivotal Response Training (PRT), and Visual Schedules. PRT dosage was higher when principals under-rated their implementation leadership and when it was agreed upon that implementation leadership was low. Findings have implications for leaders support of EBPs implemented in school-based settings.

Community-Academic Partnerships: A Systematic Review of the State of the Literature and Recommendations for Future Research.

POLICY POINTS: Communities, funding agencies, and institutions are increasingly involving community stakeholders as partners in research, to provide firsthand knowledge and insight. Based on our systematic review of major literature databases, we recommend using a single term, community-academic partnership (CAP), and a conceptual definition to unite multiple research disciplines and strengthen the field. Interpersonal and operational factors that facilitate or hinder the collaborative process have been consistently identified, including "trust among partners" and "respect among partners" (facilitating interpersonal factors) and "excessive time commitment" (hindering operational factor). Once CAP processes and characteristics are better understood, the effectiveness of collaborative partner involvement can be tested. CONTEXT: Communities, funding agencies, and institutions are increasingly involving community stakeholders as partners in research. Community stakeholders can provide firsthand knowledge and insight, thereby increasing research relevance and feasibility. Despite the greater emphasis and use of community-academic partnerships (CAP) across multiple disciplines, definitions of partnerships and methodologies vary greatly, and no systematic reviews consolidating this literature have been published. The purpose of this article, then, is to facilitate the continued growth of this field by examining the characteristics of CAPs and the current state of the science, identifying the facilitating and hindering influences on the collaborative process, and developing a common term and conceptual definition for use across disciplines. METHODS: Our systematic search of 6 major literature databases generated 1,332 unique articles, 50 of which met our criteria for inclusion and provided data on 54 unique CAPs. We then analyzed studies to describe CAP characteristics and to identify the terms and methods used, as well as the common influences on the CAP process and distal outcomes. FINDINGS: CAP research spans disciplines, involves a variety of community stakeholders, and focuses on a large range of study topics. CAP research articles, however, rarely report characteristics such as membership numbers or duration. Most studies involved case studies using qualitative methods to collect data on the collaborative process. Although various terms were used to describe collaborative partnerships, few studies provided conceptual definitions. Twenty-three facilitating and hindering factors influencing the CAP collaboration process emerged from the literature. Outcomes from the CAPs most often included developing or refining tangible products. CONCLUSIONS: Based on our systematic review, we recommend using a single term, community-academic partnership, as well as a conceptual definition to unite multiple research disciplines. In addition, CAP characteristics and methods should be reported more systematically to advance the field (eg, to develop CAP evaluation tools). We have identified the most common influences that facilitate and hinder CAPs, which in turn should guide their development and sustainment.

Getting cozy with causality: Advances to the causal pathway diagramming method to enhance implementation precision.

Background: Implementation strategies are theorized to work well when carefully matched to implementation determinants and when factors-preconditions, moderators, etc.-that influence strategy effectiveness are prospectively identified and addressed. Existing methods for strategy selection are either imprecise or require significant technical expertise and resources, undermining their utility. This article outlines refinements to causal pathway diagrams (CPDs), a method for articulating the causal process through which implementation strategies work and offers illustrations of their use. Method: CPDs are a visualization tool to represent an implementation strategy, its mechanism(s) (i.e., the processes through which a strategy is thought to operate), determinants it is intended to address, factors that may impede or facilitate its effectiveness, and the series of outcomes that should be expected if the strategy is operating as intended. We offer principles for constructing CPDs and describe their key functions. Results: Applications of the CPD method by study teams from two National Institute of Health-funded Implementation Science Centers and a research grant are presented. These include the use of CPDs to (a) match implementation strategies to determinants, (b) understand the conditions under which an implementation strategy works, and (c) develop causal theories of implementation strategies. Conclusions: CPDs offer a novel method for implementers to select, understand, and improve the effectiveness of implementation strategies. They make explicit theoretical assumptions about strategy operation while supporting practical planning. Early applications have led to method refinements and guidance for the field.

Advances to the Causal Pathway Diagramming Method to Enhance Implementation Precision Plain Language Summary Implementation strategies often fail to produce meaningful improvements in the outcomes we hope to impact. Better tools for choosing, designing, and evaluating implementation strategies may improve their performance. We developed a tool, causal pathway diagrams (CPD), to visualize and describe how implementation strategies are expected to work. In this article, we describe refinements to the CPD tool and accompanying approach. We use real illustrations to show how CPDs can be used to improve how to match strategies to barriers, understand the conditions in which those strategies work best, and develop generalizable theories describing how implementation strategies work. CPDs can serve as both a practical and scientific tool to improve the planning, deployment, and evaluation of implementation strategies. We demonstrate the range of ways that CPDs are being used, from a highly practical tool to improve implementation practice to a scientific approach to advance testing and theorizing about implementation strategies.

Implementation science in plain language: The use of nonjargon terms to facilitate collaboration.

Background: Interdisciplinary collaboration and stakeholder engagement are key ingredients in implementation science research. However, effective and efficient collaboration can be limited by the complexity of implementation science terms. In this article, we argue that the development and use of plain language implementation science terms is an essential step to facilitate collaboration and engagement. Method: We present an example of plain language development to portray the process and the potential benefits plain language can have on implementation science research. Implementation scientists and intervention experts codeveloped plain language implementation terms as a part of an implementation-effectiveness trial in western Kenya and in preparation for a stakeholder collaborative design meeting. Results: The developed plain language terms facilitated wider stakeholder understanding and integration of implementation science findings that could inform the design of a stakeholder-led implementation coaching program. Conclusions: We encourage the use of the plain language terms presented in this article, further translation, and additional development of other plain language terms for implementation science constructs.

Implementation science jargon can limit research collaborations with community and research partners. This article describes the importance of using plain language in implementation research and provides readers with an example of plain language terms used in a global implementation research project. We encourage implementation scientists and practitioners to use plain language when describing implementation science constructs to improve research and practice collaboration.

Theorizing is for everybody: Advancing the process of theorizing in implementation science.

There has been a call to shift from treating theories as static products to engaging in a process of theorizing that develops, modifies, and advances implementation theory through the accumulation of knowledge. Stimulating theoretical advances is necessary to improve our understanding of the causal processes that influence implementation and to enhance the value of existing theory. We argue that a primary reason that existing theory has lacked iteration and evolution is that the process for theorizing is obscure and daunting. We present recommendations for advancing the process of theorizing in implementation science to draw more people in the process of developing and advancing theory.

Study protocol: Novel Methods for Implementing Measurement-Based Care with youth in Low-Resource Environments (NIMBLE).

BACKGROUND: For youth receiving care in community mental health centers, comorbidities are the rule rather than the exception. Using measurement-based care (MBC), or the routine evaluation of symptoms to inform care decisions, as the foundation of treatment for youth with comorbid problems significantly improves the impact of psychotherapy by focusing care and building engagement and alliance. MBC increases the rate of symptom improvement, detects clients who would otherwise deteriorate, and alerts clinicians to non-responders. Despite its demonstrated utility, MBC is rarely implemented with fidelity; less than 15% of providers report using MBC per recommendations. Previous efforts to support MBC implementation have yielded suboptimal outcomes, in part, due to organizations' challenges with identifying and prioritizing barriers and selecting and developing strategies to overcome them. New methods are needed for identifying and prioritizing barriers, and matching strategies to barriers to optimize MBC implementation and treatment quality to improve youth mental health outcomes in community settings. METHODS: Pragmatic implementation methods will be piloted in four diverse community mental health centers. Methods include (a) rapid evidence synthesis; (b) rapid ethnography; (c) design kits (e.g., kits with disposable cameras, journals, maps); (d) barrier prioritization, and (e) causal pathway diagramming. These activities will generate actionable barriers; subsequently, we will use facilitated group processes to prioritize barriers and develop causal pathway diagrams to match strategies to barriers to create implementation plans that optimize MBC fidelity (Aim 1). We will track strategy deployment for 6 months, then compare MBC fidelity for another 6 months post-implementation with data from 2 years of historical controls (Aim 2). Finally, we will co-design a toolkit for design kit methods with youth and the practice and scientific communities (Aim 3). DISCUSSION: Optimizing MBC implementation in community mental health centers could transform youth mental health care by ensuring the most pressing symptoms are targeted early in treatment. The discussion section highlights expected challenges and limits to using the five methods, including recruitment and engagement given the high pressure on community mental health settings. TRIAL REGISTRATION: Clinicaltrials.gov. NCT05644756 . Registered on 18 November 2022. This trial was retrospectively registered.

Clinical supervision approach predicts evidence-based trauma treatment delivery in children's mental health.

Objective: Observational studies of practices used in clinical supervision-as-usual can be leveraged to advance the limited research on workplace-based supervision as an evidence-based treatment (EBT) implementation strategy. This exploratory observational study examined the presence of supervision approaches (comprised of supervision techniques) and whether these predicted clinicians' EBT technique delivery. Methods: Participants included 28 supervisors, 70 clinician supervisees, and 60 youth clients and guardians from 17 public mental health organizations. Data included audio recorded supervision-as-usual sessions over 1 year, audio recorded Trauma-focused Cognitive Behavioral Therapy (TF-CBT) treatment sessions with youth for 6 months, and youth-reported post-traumatic stress severity scores. Audio recordings of 438 supervision sessions were coded for session duration and the presence of 13 supervision techniques and intensity of their coverage. Audio recordings of 465 treatment sessions were coded for presence and intensity of coverage of TF-CBT practice elements. Agglomerative hierarchical cluster analysis examined the presence of clusters of supervision technique use, termed supervision approaches. Generalized estimating equations estimated the relation between supervision approaches and delivery of TF-CBT elements. Results: Two supervision approaches were identified- Supportive-Directive and Supportive- that discriminated between use of five supervision techniques. Clinicians who received a higher proportion of supportive-directive supervision sessions had greater odds of delivering the trauma narrative with a client. Conclusion: Findings suggest that patterns of supervision techniques can be identified and may shape EBT delivery. Supervision approaches show some evidence of being tailored to individual clinicians. Implications for the development of supervision implementation strategies and future directions are discussed.

The mechanics of implementation strategies and measures: advancing the study of implementation mechanisms.

BACKGROUND: There is a fundamental gap in understanding the causal mechanisms by which strategies for implementing evidence-based practices address local barriers to effective, appropriate service delivery. Until this gap is addressed, scientific knowledge and practical guidance about which implementation strategies to use in which contexts will remain elusive. This research project aims to identify plausible strategy-mechanism linkages, develop causal models for mechanism evaluation, produce measures needed to evaluate such linkages, and make these models, methods, and measures available in a user-friendly website. The specific aims are as follows: (1) build a database of strategy-mechanism linkages and associated causal pathway diagrams, (2) develop psychometrically strong, pragmatic measures of mechanisms, and (3) develop and disseminate a website of implementation mechanisms knowledge for use by diverse stakeholders. METHODS: For the first aim, a combination of qualitative inquiry, expert panel methods, and causal pathway diagramming will be used to identify and confirm plausible strategy-mechanism linkages and articulate moderators, preconditions, and proximal and distal outcomes associated with those linkages. For the second aim, rapid-cycle measure development and testing methods will be employed to create reliable, valid, pragmatic measures of six mechanisms of common strategies for which no high-quality measures exist. For the third aim, we will develop a user-friendly website and searchable database that incorporates user-centered design, disseminating the final product using social marketing principles. DISCUSSION: Once strategy-mechanism linkages are identified using this multi-method approach, implementation scientists can use the searchable database to develop tailored implementation strategies and generate more robust evidence about which strategies work best in which contexts. Moreover, practitioners will be better able to select implementation strategies to address their specific implementation problems. New horizons in implementation strategy development, optimization, evaluation, and deployment are expected to be more attainable as a result of this research, which will lead to enhanced implementation of evidence-based interventions for cancer control, and ultimately improvements in patient outcomes.

Application of Evidence-Based Treatment in Community Mental Health Settings: Examining EBT Delivery Duration and Client Discharge.

Characterizing community mental health (CMH) treatment duration and discharge is an important step toward understanding how to better meet client needs. This report describes patterns of treatment duration and discharge among clinicians participating in a state-funded evidence-based treatment (EBT) training initiative. After training and consultation, clinicians (N = 376) reported on treatment duration and discharge for their "most complete case." On average, clinicians delivered 12.4 sessions (SD = 5.1) of the treatment. After completing treatment, half of clinicians (58.7%) continued with regularly scheduled therapy, either using EBT elements or switching to supportive therapy. Clinicians who continued with regularly scheduled therapy delivered treatment in approximately the same number of sessions. Results revealed that CMH clinicians often do not discontinue therapy after completing a treatment protocol. These findings suggest it may be essential to better understand clinician decision-making around applying EBTs to their caseloads.

The relationship between first-level leadership and inner-context and implementation outcomes in behavioral health: a scoping review.

BACKGROUND: First-level leadership is uniquely positioned to support evidence-based practice (EBP) implementation for behavioral health due to first-level leaders' access to and relationship with service providers. First-level leaders are individuals who directly supervise and manage frontline employees who do not manage others. However, first-level leadership is underrepresented in existing reviews of the impact of leadership on EBP implementation. This review describes the relationship between first-level leadership and implementation determinants and outcomes. METHODS: A scoping review was performed to synthesize the literature on the relationship between first-level leadership and inner-context and implementation outcomes. A literature search was conducted in PubMed, Eric, PsycINFO, CINAHL, Scopus, and Web of Science. To be eligible, studies had to examine first-level leadership, be conducted in settings providing behavioral health services, and examine the relationship between first-level leadership and an implementation or inner-context outcome. Data extraction and synthesis were performed to describe study characteristics, leader-outcome relationships, and overlap in leadership frameworks. RESULTS: Twenty-one records met our inclusion criteria. Studies primarily relied on observational designs and were often cross-sectional. Studies more often examined general leadership rather than leadership strategically focused on EBP implementation (i.e., strategic implementation leadership). Our findings suggest that several forms of first-level leadership are inconsistently related to a broad set of implementation determinants, with infrequent examination of specific implementation outcomes. The broad set of implementation determinants studied, limited number of replications, and inconsistent findings have resulted in sparse evidence for any specific leadership-outcome relationship. The greatest accumulation of evidence exists for general leadership's positive relationship with providers' EBP attitudes, most notably in the form of transformational leadership. This was followed by evidence for strategic implementation leadership facilitating general implementation. Our synthesis revealed moderate conceptual overlap of strategic implementation leadership behaviors described in the theory of implementation leadership and theory of middle managers' role in implementation. CONCLUSIONS: Our findings suggest that first-level leadership may play an important role in shaping implementation determinants and outcomes, but consistent empirical support is sparse and confidence dampened by methodological issues. To advance the field, we need studies that adopt stronger methodological rigor, address the conceptual overlap in leadership frameworks, examine a broader set of implementation outcomes, and examine conditions under which leadership impacts implementation. TRIAL REGISTRATION: This review was not registered.

Implementing Mental Health Services for Children and Adolescents: Caregiver Involvement in School-Based Care.

OBJECTIVE: This study compared clinician contact with clients' caregivers by service setting, specifically schools, which are the most common service setting for youths. METHODS: Data were from a state-funded cognitive-behavioral therapy training initiative. Clinicians (N=177) completed pretraining and postconsultation surveys including retrospective reports of caregiver contact and amount of school-based practice. RESULTS: School-based clinicians were less likely than non-school-based clinicians to report any contact with caregivers. Full-time school-based clinicians were less likely than part-time school-based clinicians to report any contact with caregivers. School-based clinicians also were less likely than clinicians in other settings to have in-person contact with caregivers, and full-time school-based clinicians were less likely than part-time school-based clinicians to report in-person contact with caregivers. CONCLUSIONS: Given the inherent advantages of school-based treatment, integration of mental health services for youths in schools is increasingly supported by funding and policy. The findings of this study suggest, however, that investing in strategies to engage caregivers in such treatment may be worthwhile.

Barriers and facilitators of child and guardian attendance in task-shifted mental health services in schools in western Kenya.

BACKGROUND: Globally, nearly 140 million children have experienced the death of one or both parents, and as a result many experience higher rates of mental health problems. Trauma-focused cognitive behavioral therapy (TF-CBT) delivered by lay counselors has been shown to improve mental health outcomes for children experiencing traumatic grief due to parental loss; however, challenges with treatment attendance limit the public health impact of mental health services. This study used qualitative methods to assess barriers and facilitators of child and guardian attendance of school-based lay counselor delivered TF-CBT. METHODS: Semi-structured interviews were conducted with 36 lay counselors (18 teachers; 18 community health volunteers) who delivered TF-CBT to explore their perceptions of barriers of facilitators of child and guardian attendance of group-based sessions delivered in schools. RESULTS: Counselors identified attendance barriers and facilitators related to the delivery setting, resources, participant characteristics, intervention characteristics and counselor behaviors. The findings revealed a greater number of facilitators than barriers. Common facilitators included participant and counselor resources, counselor commitment behaviors and communication efforts to encourage attendance. Barriers were less frequently endorsed, with participant resources, child or guardian illness and communication challenges most commonly mentioned. CONCLUSIONS: Attention to barriers and facilitators of attendance in the context in which mental health interventions are delivered allows for identification of ways to improve attendance and treatment engagement and achieve the potential promise of providing accessible mental health services.

Leadership profiles associated with the implementation of behavioral health evidence-based practices for autism spectrum disorder in schools.

Implementation of evidence-based practice (EBP) for autism spectrum disorder (ASD) in the education system is a public health priority. Leadership is a critical driver of EBP implementation but little is known about the types of leadership behaviors exhibited by school leaders and how this influences the context of EBP implementation, particularly for students with ASD. The objectives of this study were to determine (1) the leadership profiles of principals involved in EBP implementation for students with ASD and (2) how these leadership profiles related to school characteristics and implementation climate. The Exploration, Preparation, Implementation, Sustainment (EPIS) framework was used to guide the design and analysis of this study. Participants (n = 296) included principals, teachers, and classroom support staff. They provided demographic information and completed the Multifactor Leadership Questionnaire and Implementation Climate Scale. Using latent profile analysis, a three-pattern solution was identified: Disengaged (6% of sample), Undifferentiated (23% of sample), and Optimal (71% of sample). Principals in schools with higher proportions of students with an individualized education program were more likely to be classified as Undifferentiated than Optimal. The Optimal group was associated with more positive implementation climate than the Undifferentiated or Disengaged groups. Findings suggest that leadership behaviors rated by principals and their staff involved in implementation of common autism EBPs can be meaningfully clustered into three discernible profiles that are shaped by organizational context and linked to strategic implementation climate. Our study findings have implications for leadership training and service delivery in schools by underscoring the critical nature of school leadership during implementation of EBPs for children with autism and the interplay between specific leadership behaviors and strategic implementation climate.

Lay Counselor Perspectives of Providing a Child-Focused Mental Health Intervention for Children: Task-Shifting in the Education and Health Sectors in Kenya.

The global mental health treatment gap has increasingly been addressed using task-shifting; however, very little research has focused on lay counselors' perspectives on the acceptability, feasibility, and appropriateness of mental health interventions in specific government-supported sectors that might scale up and sustain mental health care for children and adolescents. In western Kenya, these sectors include Education and Health. Data come from a large hybrid effectiveness-implementation study examining implementation practices and policies in either or both sectors that support successful implementation of a child-focused intervention, Trauma-focused Cognitive Behavioral Therapy (TF-CBT), for children and adolescents who had experienced parental death. We examined lay counselors' self-report of acceptability, feasibility, and appropriateness of TF-CBT. Lay counselors were teachers (n = 30) from the Education sector and Community Health Volunteers (CHVs; n = 30) from the Health sector, who were part of Sequence 1 of a large stepped-wedge, cluster randomized trial. Lay counselor self-report surveys included reflective and formative measurement of acceptability, feasibility, and appropriateness administered after lay counselors in both sectors had experience delivering the locally-adapted, group-based TF-CBT intervention. Descriptive statistics (means, standard deviations) were used to understand counselors' perspectives stratified by sector. Both teachers and CHVs endorsed high acceptability, feasibility, and appropriateness of TF-CBT, with lay counselors' responses on items from the formative measures providing some insight into specific aspects of acceptability, feasibility, and appropriateness that may be important to consider when planning for implementation support. These early findings suggest that both sectors may hold promise for task-shifting of mental health care for children and adolescents but also underline the importance of considering the multiple facets of these three implementation outcomes as well as lay counselor context (Education vs. Health).