The Role of Implementation Climate in Moderating Educator Use of Evidence-Based Practices and Outcomes for Autistic Students.

Ensuring effective use of evidence-based practice (EBP) for autism in schools is imperative due to the significantly increasing number of autistic students receiving school services each year. High-quality EBP use has proven challenging in schools. Research indicates implementation climate, or how EBP are supported, rewarded, and valued, and EBP resources are related to successful implementation. However, limited understanding of system-level contextual factors that impact EBP implementation for school-based providers makes development of appropriate implementation supports challenging. Understanding these factors is crucial for selecting and tailoring implementation strategies to support EBP scale up. In this observational study, California school-based providers (n = 1084) completed surveys related to implementation climate, leadership, autism experience and EBP implementation (use, competence, knowledge). Student outcomes included state level academic and behavioral indicators. Using an implementation science framework (Aarons et al., in Administration and Policy in Mental Health and Mental Health Services Research 38:4-23, 2011) and multilevel modeling, we examined the relationship between EBP Implementation and student outcomes and the moderation effects of provider and district level factors. Higher implementation climate predicted better EBP implementation outcomes, and proved more impactful when provider hands-on autism experience was low. Greater EBP resources predicted a higher percentage of students who met math standards only when district poverty level was high. Our findings suggested moderating effects on EBP implementation from both provider and system level factors. Implementation climate and resources may be especially key in addressing equity issues related to high poverty schools in which teachers often have less autism experience.

Building Better Bridges: Outcomes of a Community-Partnered New School Transition Intervention for Students on the Autism Spectrum.

New school transitions can be challenging for students on the autism spectrum. No published, evidence-based interventions exist to support families and teachers of students transitioning to elementary and secondary school during this critical period. Using Community Partnered Participatory Research, we developed Building Better Bridges (BBB), a caregiver coaching intervention that includes training on effective school communication, educational rights, advocacy, and child preparation strategies. We compared BBB (n = 83) to a module/resources-only comparison (n = 87) in a four-site randomized controlled trial in racially and ethnically diverse, under-resourced communities. In our intent-to-treat analysis, caregivers and teachers in BBB rated students' transitions to the new classroom as more positive, relative to the comparison group. Results suggest this low-cost intervention can improve the transition process for families and students at high risk of poor transitions.

Role of Primary Care Clinician Concern During Screening for Early Identification of Autism.

OBJECTIVE: The aim of this study was to evaluate the added value of primary care clinician (PCC)-indicated concern during primary care universal standardized screening in early identification of autism. METHODS: Toddlers were screened for autism during primary care checkups (n = 7,039, aged 14.24-22.43 months) in 2 studies. Parents completed the Modified Checklist for Autism in Toddlers, Revised, with Follow-Up. For each participant, PCCs indicated whether they had autism concerns (optional in 1 study-before or after viewing screening results, required before viewing screen results in the other). Children at high likelihood for autism from screen result and/or PCC concern (n = 615) were invited for a diagnostic evaluation; 283 children attended the evaluation. RESULTS: Rates of PCC-indicated autism concerns were similar whether PCCs were required or encouraged to indicate concerns. High likelihood of autism indication on both screen and PCC concern resulted in the highest positive predictive value for autism and positive predictive value for any developmental disorder, as well as the highest evaluation attendance, with no significant difference between the positive screen-only and PCC concern-only groups. Although the frequency of PCC-indicated autism concern did not differ significantly based on the child's cognitive level, PCCs were more likely to identify children with more obvious autism characteristics compared with more subtle autism characteristics as having autism. CONCLUSION: The findings support the recommendation of the American Academy of Pediatrics that both screening and surveillance for autism be incorporated into well-child visits. High likelihood of autism on either screen or PCC concern should trigger a referral for an evaluation.

A mixed-methods evaluation of organization and individual factors influencing provider intentions to use caregiver coaching in community-based early intervention.

BACKGROUND: Most psycho-social interventions contain multiple components. Practitioners often vary in their implementation of different intervention components. Caregiver coaching is a multicomponent intervention for young autistic children that is highly effective but poorly implemented in community-based early intervention (EI). Previous research has shown that EI providers' intentions, and the determinants of their intentions, to implement caregiver coaching vary across components. Organizational culture and climate likely influence these psychological determinants of intention by affecting beliefs that underlie attitudes, norms, and self-efficacy to implement an intervention. Research in this area is limited, which limits the development of theoretically driven, multilevel implementation strategies to support multi-component interventions. This mixed methods study evaluated the relationships among organizational leadership, culture and climate, attitudes, norms, self-efficacy, and EI providers' intentions to implement the components of caregiver coaching. METHODS: We surveyed 264 EI providers from 37 agencies regarding their intentions and determinants of intentions to use caregiver coaching. We also asked questions about the organizational culture, climate, and leadership in their agencies related to caregiver coaching. We used multilevel structural equation models to estimate associations among intentions, psychological determinants of intentions (attitudes, descriptive norms, injunctive norms, and self-efficacy), and organizational factors (implementation climate and leadership). We conducted qualitative interviews with 36 providers, stratified by strength of intentions to use coaching. We used mixed-methods analysis to gain an in-depth understanding of the organization and individual-level factors. RESULTS: The associations among intentions, psychological determinants of intentions, and organizational factors varied across core components of caregiver coaching. Qualitative interviews elucidated how providers describe the importance of each component. For example, providers' attitudes toward coaching caregivers and their perceptions of caregivers' expectations for service were particularly salient themes related to their use of caregiver coaching. CONCLUSION: Results highlight the importance of multi-level strategies that strategically target individual intervention components as well as organization-level and individual-level constructs. This approach holds promise for improving the implementation of complex, multicomponent, psychosocial interventions in community-based service systems.

Implementation readiness for evidence-based autism practices in school systems.

Background: The increase in the number of autistic children being identified has led to increased demand on public schools to provide high-quality services. Effectively scaling up evidence-based practice (EBP) use for autistic students is challenging, given the complicated organization of special education. Teachers have significant challenges implementing autism EBP with fidelity. Factors such as implementation leadership and climate and attitudes toward EBP are linked to successful EBP use and may vary at different levels of the education system. Examining mechanisms of successful implementation is a critical step to support scale-up. Method: In this observational study, conducted from September 2018 to March 2020, California school personnel (n = 2273) at multiple levels of the system completed surveys related to implementation climate, leadership, and attitudes toward EBP. Data were collected throughout California at the Special Education Local Plan Areas, County Office of Education, and district and school levels from educators and administrators working in public schools supporting autistic students. Multi-level modeling was conducted to characterize implementation readiness. Results: Overall, implementation climate and leadership scores are low across levels with regional levels rated more positively than districts or schools. Attitudes toward EBP were moderate, with those working in schools having the poorest ratings and specialists/trainers and related service providers (e.g., speech-language pathologists) having the highest ratings. Conclusions: Outcomes provide a unique opportunity to compare implementation factors across organizational levels with a large, statewide sample. These data provide guidance for developing implementation interventions at multiple levels of the education system to increase readiness for effective scale-up of autism EBP in schools. Personnel and leaders at different organizational levels may need differentiated training targeting improved implementation climate and leadership. Personnel within districts and schools may experience a particular benefit from leadership support for EBP implementation.

The increase in the number of autistic children being identified in schools is increasing. To address this, schools are trying to do a better job of using high-quality practices based on research. However, teachers have had difficulty using research-based strategies for autistic students the way the manuals indicate they should be used. This might be due to the complexity of the strategies or limited support from special education leadership and infrastructure. Research shows that leaders can be very important in helping teachers use effective strategies. Over 2200 school personnel in California, including administrators, professional development providers, teachers, and paraprofessionals completed surveys asking about how their leaders, schools, districts, and regions supported the use of research practices for autistic students. Overall, limited support is provided in special education, with regional agencies providing more support than districts or schools. These data suggest that school and district leaders need training in how to support educators in using autism-specific strategies.

Parent Coaching in Early Intervention for Autism Spectrum Disorder: A Brief Report.

Coaching caregivers of young children on the autism spectrum is a critical component of parent-mediated interventions. Little information is available about how providers implement parent coaching for children on the autism spectrum in publicly funded early intervention systems. This study evaluated providers' use of parent coaching in an early intervention system. Twenty-five early intervention sessions were coded for fidelity to established caregiver coaching techniques. We found low use of coaching techniques overall, with significant variability in use of coaching across providers. When providers did coach caregivers, they used only a few coaching strategies (e.g., collaboration and in-vivo feedback). Results indicate that targeted training and implementation strategies focused on individual coaching components, instead of coaching more broadly, may be needed to improve the use of individual coaching strategies. A focus on strengthening the use of collaboration and in-vivo feedback may be key to improving coaching fidelity overall.

Initial diagnostic impressions of trainees during autism evaluations: High specificity but low sensitivity.

Reducing the age of first autism diagnosis facilitates access to critical early intervention services. A current "waitlist crisis" for autism diagnostic evaluation thus demands that we consider novel use of available clinical resources. Previous work has found that expert autism clinicians can identify autism in young children with high specificity after only a brief observation; rapid identification by non-experts remains untested. In the current study, 252 children ages 12-53 months presented for a comprehensive autism diagnostic evaluation. We found that junior clinicians in training to become autism specialists (n = 29) accurately determined whether or not a young child would be diagnosed with autism in the first five minutes of the clinic visit in 75% of cases. Specificity of brief observations was high (0.92), suggesting that brief observations may be an effective tool for triaging young children toward autism-specific interventions. In contrast, the lower negative predictive value (0.71) of brief observations, suggest that they should not be used to rule out autism. When trainees expressed more confidence in their initial impression, their impression was more likely to match the final diagnosis. These findings add to a body of literature showing that clinical observations of suspected autism should be taken seriously, but lack of clinician concern should not be used to rule out autism or overrule other indicators of likely autism, such as parent concern or a positive screening result.

Does Treatment Fidelity of the Early Start Denver Model Impact Skill Acquisition in Young Children with Autism?

There is increasing evidence supporting the effectiveness of the Early Start Denver Model (ESDM) for children on the autism spectrum. However, substantial variability in response to the ESDM has been reported across participants. We examined the plausible yet untested hypothesis that variations in the fidelity level of therapists delivering the intervention contribute to variability in children's response to the ESDM. Videotaped sessions (n = 40) of toddlers on the autism spectrum who received the ESDM from trained therapists were coded to obtain measures of therapist fidelity and children's learning in response to the therapists' instruction. Variations in overall fidelity, along with variations in most items included in the ESDM fidelity checklist, contributed to the children's learning response during the sessions.

Overcoming tensions between family-centered care and fidelity within Early Intervention implementation research.

LAY ABSTRACT: Early Intervention systems provide therapeutic services to families of young children birth to 3 years with developmental delays and are considered a natural access point to services for young children and their families. Research studies in the autism field have been interested in training providers to deliver evidence-based practices in Early Intervention systems to increase access to services for young children with an increased likelihood of being autistic. However, research has often overlooked that Early Intervention systems prioritize family-centered care, an approach to working with families that honors and respects their values and choices and that provides supports to strengthen family functioning. This commentary points out that family-centered care deserves greater attention in research being done in Early Intervention systems. We describe how family-centered care may shape how interventions are delivered, and discuss directions for future research to evaluate the impact of family-centered care alongside intervention delivery.

A Waitlist Randomized Implementation Trial of Classroom Pivotal Response Teaching for Students With Autism.

Classroom Pivotal Response Teaching (CPRT) is a community-partnered adaptation of a naturalistic developmental behavioral intervention identified as an evidence-based practice for autistic children. The current study evaluated student outcomes in a randomized, wait-list controlled implementation trial across classrooms. Participants included teachers (n = 126) and students with autism (n = 308). Teachers participated in 12 hours of didactic, interactive training and additional in-classroom coaching. Generalized Estimating Equations accounted for clustering. Adjusted models evaluated the relative effects of training group, CPRT fidelity, and classroom quality on student outcomes. Results indicate higher CPRT fidelity was associated with greater increases in student learning. Having received CPRT training predicted increased student engagement and greater decreases in reported approach/withdrawal problems. These differences may be linked to the theoretical foundations of CPRT of increasing student motivation and engagement and collaborative adaptation to increase feasibility in schools. Overall, results suggest CPRT may be a beneficial approach for supporting autistic students.

Using Novel Implementation Tools for Evidence-based Intervention Delivery (UNITED) across public service systems for three evidence-based autism interventions in under-resourced communities: study protocol.

BACKGROUND: There are a growing number of evidence-based interventions (EBIs) for autistic individuals, but few are successfully implemented with fidelity in under-resourced communities and with families from traditionally disenfranchised groups. Implementation science offers tools to increase EBI use in communities, but most implementation strategies are designed specific to a single EBI. It is not feasible to develop a new implementation strategy each time a new EBI is introduced in the community. Therefore, to test the effectiveness and generalizability of implementation strategies we are developing and testing a multifaceted implementation strategy with three EBIs concurrently. The goal of this protocol paper is to describe the randomized field trial of an implementation strategy for use across autism EBIs, diverse settings and participants, with the goal of increasing rapid uptake of effective practices to reach our most vulnerable children. METHODS: We developed a multifaceted implementation strategy called Using Novel Implementation Tools for Evidence-based intervention Delivery (UNITED) to facilitate the implementation and sustainment of three EBIs in under-resourced settings. We will compare fidelity to, and effectiveness of, each intervention [Mind the Gap (MTG), Remaking Recess (RR), Self-Determined Learning Model of Instruction (SDLMI)] with and without UNITED in a randomized field trial. Randomization will be stratified using a minimization allocation method. We will train community practitioners using remote delivery of modules specific to the intervention, and active coaching via Zoom for at least 6 sessions and up to 12 as dictated by each EBI. Our primary outcome is fidelity to each EBI, and our secondary outcome is at the child or family level (family empowerment for MTG, child peer social engagement for RR, and adolescent self-determination for SDLMI, respectively). We will measure progress through the implementation phases using the Stages of Implementation Completion and cost-effectiveness of UNITED. DISCUSSION: The results of this study will provide rigorous data on the effectiveness and generalizability of one relatively light-touch implementation strategy in increasing use of autism EBIs and associated outcomes in diverse under resourced public service settings for underrepresented autistic youth. TRIAL REGISTRATION: Mind the Gap: Clinicaltrials.gov Identifier:  NCT04972825 (Date registered July 22, 2021); Remaking Recess: Clinicaltrials.gov Identifier:  NCT04972838 (Date registered July 22, 2021); Self-Determined Learning Model of Instruction: Clinicaltrials.gov Identifier:  NCT04972851 (Date registered July 22, 2021).

Provider perspectives and reach of an evidence-based intervention in community services for toddlers.

LAY ABSTRACT: Expert recommendations for toddlers who are likely to develop autism include caregivers being actively involved in the services children receive. However, many services available in the community may not follow these recommendations. Evidence suggests that an intervention named Project ImPACT for Toddlers demonstrates positive parent and child outcomes for families in the community. Project ImPACT for Toddlers was designed specifically for toddlers by a group of parents, clinicians, researchers, and funders. It teaches parents of young children strategies to support their child's development in daily routines. This study reports the perspectives of early intervention providers who learned to use Project ImPACT for Toddlers on whether the intervention was a good fit for their practice and easy to use. The study also examines how many agencies are using Project ImPACT for Toddlers and how many families have received the intervention in the community. The goal of the study is to inform the continued use of Project ImPACT for Toddlers in the community and support offering the intervention in other regions. Participants include 38 community providers who participated in a training study of Project ImPACT for Toddlers and completed a survey and semi-structured interview after approximately 3 months of using Project ImPACT for Toddlers with families. Participants perceived the training model as acceptable and appropriate, and identified the group-based model of training, comprehensive materials, and agency support as strengths of the approach. Survey findings complemented the results from the interviews. Data indicate an increasing number of agencies and families accessing Project ImPACT for Toddlers. Efforts to expand evidence-based intervention in early intervention should continue to build upon the model used for Project ImPACT for Toddlers.

Practice-driven research for statewide scale up: Implementation outcomes of the California Autism Professional Training and Information Network.

LAY ABSTRACT: Supporting use of evidence-based practice in public service programs for autistic individuals is critical. The California Autism Professional Training and Information Network (CAPTAIN) brings together best practices from intervention and implementation research to support scale up of autism services. The current study was designed to evaluate the impact of CAPTAIN on provider-level outcomes including attitude toward, knowledge, fidelity, and use of autism EBPs and overall classroom quality. Overall, results indicated variability across measures, with some significant differences between CAPTAIN-trained and non-CAPTAIN-trained providers. These preliminary findings show promise for the efficacy of the CAPTAIN model to increase dissemination and implementation of EBP at the classroom level.

Choosing strategies that work from the start: A mixed methods study to understand effective development of community-academic partnerships.

Community-academic partnerships are believed to increase the effectiveness and feasibility of action research. While factors facilitating and hindering community-academic partnerships have been identified, their influence on the collaborative process is unknown, especially during community-academic partnership initiation and development. This explanatory sequential mixed methods study (quantitative→QUALITATIVE) evaluated perspectives of members in an autism community-academic partnership to determine frequently endorsed and influential factors facilitating and hindering the collaborative process during the community-academic partnership's development. Participants (n = 11; community stakeholders, implementation scientist, and researchers) endorsed and ranked the importance of factors present in the formation of the community-academic partnership then completed a semi-structured qualitative interview to elaborate on survey responses. Interviews were coded using a coding, comparison, and consensus method and analyzed using the Rapid Assessment Process for frequency and salience of themes across interviews. Integrating mixed methods yielded ranked factors that were perceived to facilitate and hinder the development of the community-academic partnership, and highlighted the relative influence of interpersonal factors on the facilitation of community-academic partnership processes and organizational factors on the hindrance of community-academic partnership processes during development. Some discrepancies emerged between community and academic partners. Results may assist to improve the development of community-academic partnerships, which is becoming increasingly important in healthcare services research, dissemination, and implementation.

Pre-treatment clinical and gene expression patterns predict developmental change in early intervention in autism.

Early detection and intervention are believed to be key to facilitating better outcomes in children with autism, yet the impact of age at treatment start on the outcome is poorly understood. While clinical traits such as language ability have been shown to predict treatment outcome, whether or not and how information at the genomic level can predict treatment outcome is unknown. Leveraging a cohort of toddlers with autism who all received the same standardized intervention at a very young age and provided a blood sample, here we find that very early treatment engagement (i.e., <24 months) leads to greater gains while controlling for time in treatment. Pre-treatment clinical behavioral measures predict 21% of the variance in the rate of skill growth during early intervention. Pre-treatment blood leukocyte gene expression patterns also predict the rate of skill growth, accounting for 13% of the variance in treatment slopes. Results indicated that 295 genes can be prioritized as driving this effect. These treatment-relevant genes highly interact at the protein level, are enriched for differentially histone acetylated genes in autism postmortem cortical tissue, and are normatively highly expressed in a variety of subcortical and cortical areas important for social communication and language development. This work suggests that pre-treatment biological and clinical behavioral characteristics are important for predicting developmental change in the context of early intervention and that individualized pre-treatment biology related to histone acetylation may be key.

Disrupted Care Continuity: Testing Associations between Social Networks and Transition Success for Children with Autism.

Children with autism situated in lower income families often receive intensive educational interventions as their primary form of treatment, due to financial barriers for community interventions. However, the continuity of care can be disrupted by school transitions. The quality of social relationships during the transition to a new school among parents, school staff and community providers, called the team-around-the-child (TAC), can potentially buffer a child with autism from the adverse effects caused by care disruptions. Qualities of social relationships, including trust and collaborative problem solving, can be measured using social network analysis. This study investigates if two different types of TAC relationships, defined as (1) the level of trust among team members and (2) the degree of collaborative problem solving among team members, are associated with perceived successful transitions for children with autism from lower income families. Findings suggested that TAC trust is significantly associated with the outcome of transition success for children with autism immediately post-transition.

Can the Early Start Denver Model Be Considered ABA Practice?

The Early Start Denver Model (ESDM) is an evidence-based early intervention approach for young children with autism spectrum disorder. Although the ESDM is described by its authors as being rooted in applied behavior analysis (ABA), some states, agencies, and scholars consider the ESDM to qualify as ABA practice, whereas others do not. The purpose of this article is to examine the status of the ESDM in relation to the 7 dimensions established by Baer, Wolf, and Risley ("Some Current Dimensions of Applied Behavior Analysis," Journal of Applied Behavior Analysis, 1(1): 91-97, 1968) to define applied behavior-analytic research and intervention, as well as to discuss implications for the field.

Implementation-as-Usual in Community-Based Organizations Providing Specialized Services to Individuals with Autism Spectrum Disorder: A Mixed Methods Study.

Autism spectrum disorder (ASD) is a highly prevalent neurodevelopmental disorder. ASD community-based organizations (ASD-CBOs) underutilize or inconsistently utilize evidence-based practices (ASD-EBPs) despite numerous available EBPs to treat ASD. Nonetheless, ASD-CBOs implement changes to practices regularly. Understanding ASD-CBO's implementation-as-usual (IAU) processes may assist to develop strategies to facilitate ASD-EBP adoption, implementation and sustainment. A convergent mixed methods (quan + QUAL) design was utilized. Twenty ASD-CBO agency leaders (ALs) and 26 direct providers (DPs), from 21 ASD-CBOs, completed the Autism Model of Implementation Survey Battery, including demographic and agency IAU process questions. Surveys were analyzed through descriptive and content analyses. A subset of 10 ALs provided qualitative interview data that were analyzed using coding, consensus and comparison methods to allow for a more comprehensive understanding of the IAU process within their ASD-CBOs. Quantitative analyses and qualitative coding were merged utilizing a joint display and compared. Results suggest that the IAU process follows some phases identified in the Exploration, Preparation, Implementation, Sustainment (EPIS) framework but were conducted in an informal manner-lacking specificity, structure and consistency across and within ASD-CBOs. Moreover, data suggest adding a specific adoption decision phase to the framework. Nonetheless, most ALs felt previous implementation efforts were successful. IAU processes were explored to determine whether the implementation process may be an area for intervention to increase ASD-EBP utilization in ASD-CBOs. Developing a systematized implementation process may facilitate broader utilization of high quality ASD-EBPs within usual care settings, and ultimately improve the quality of life for individuals with ASD and their families.