RESUMO
As the most common setting where youth access behavioral healthcare, the education sector frequently employs training and follow-up consultation as cornerstone implementation strategies to promote the implementation of evidence-based practices (EBPs). However, these strategies alone are not sufficient to promote desirable implementation (e.g., intervention fidelity) and youth behavioral outcomes (e.g., mitigated externalizing behaviors). Theory-informed pragmatic pre-implementation enhancement strategies (PIES) are needed to prevent the lackluster outcomes of training and consultation. Specifically, social cognitive theory explicates principles that inform the design of PIES content and specify mechanisms of behavior change (e.g., "intentions to implement" (ITI)) to target increasing providers' responsiveness to training and consultation. This triple-blind parallel randomized controlled trial preliminarily examined the efficacy of a pragmatic PIES based on social cognitive theories (SC-PIES) to improve implementation and youth behavioral outcomes from universal preventive EBPs in the education sector. Teachers from a diverse urban district were recruited and randomly assigned to the treatment (SC-PIES; ntreatment = 22) or active control condition (administrative meeting; ncontrol = 21). Based on the condition assigned, teachers received the SC-PIES or met with administrators before their EBP training. We assessed teachers' ITI, intervention fidelity, and youth behavioral outcome (academic engagement as an incompatible behavior to externalizing disorders) at baseline, immediately after training, and 6 weeks afterward. A series of ANCOVAs detected sizeable effects of SC-PIES, where teachers who received SC-PIES demonstrated significantly larger improvement in their ITI, intervention fidelity, and youth behaviors as compared to the control. Conditional analyses indicated that teachers' ITI partially mediated the effect of SC-PIES on intervention fidelity, which in turn led to improved youth behaviors. Findings suggest that theory-informed pragmatic PIES targeting providers' ITI can boost their responsiveness to implementation strategies, as reflected in improved implementation behaviors and youth behavioral outcomes. The results have implications for targeting motivational mechanisms of behavior change and situating preventive implementation strategies at the intersection between the preparation and active implementation stages of an implementation process. Limitations and implications for research and practice are discussed. Clinicaltrials.gov: NCT05240222. Registered on: 2/14/2022. Retrospectively registered. https://clinicaltrials.gov/show/NCT05240222.
Assuntos
Pessoal de Educação , Instituições Acadêmicas , Adolescente , Humanos , Prática Clínica Baseada em Evidências , Escolaridade , Encaminhamento e ConsultaRESUMO
Training and consultation are core implementation strategies used to support the adoption and delivery of evidence-based prevention programs (EBPPs), but are often insufficient alone to effect teacher behavior change. Motivational interviewing (MI) and related behavior change techniques (e.g., strategic education, social influence, implementation planning) delivered in a group format offer promising supplements to training and consultation to improve EBPP implementation. Beliefs and Attitudes for Successful Implementation in Schools for Teachers (BASIS-T) is a theoretically informed, motivational implementation strategy delivered in a group format prior to and immediately after EBPP training. The purpose of this study was to examine the proximal effects of BASIS-T on hypothesized mechanisms of behavior change (e.g., attitudes, subjective norms, intentions to implement) in the context of teachers receiving training and consultation to implement the Good Behavior Game. As part of a pilot trial, 83 elementary school teachers from 9 public elementary schools were randomly assigned (at the school-level to reduce contamination across participants) to a BASIS-T (n = 44) or active comparison control (n = 39) condition, with both conditions receiving Good Behavior Game (GBG) training and consultation. A series of mixed effects models revealed meaningful effects favoring BASIS-T on a number of hypothesized mechanisms of behavior change leading to increased motivation to implement GBG. The implications, limitations, and directions for future research on the use of MI with groups of individuals and other behavior change techniques to increase the yield of training and consultation are discussed.
Assuntos
Pessoal de Educação , Entrevista Motivacional , Humanos , Motivação , Professores Escolares , Instituições AcadêmicasRESUMO
OBJECTIVE: To assess the efficacy of a train-the-trainer model for sporting coaches delivering a youth sports-based resilience program. DESIGN: A quasi-experimental design was applied, with a pre-post comparison, utilising purposive sampling to take advantage of an existing naturally formed group. SETTING AND PARTICIPANTS: A total of 11 coaches and 86 athletes involved in a community rowing program. MAIN OUTCOME MEASURE(S): Coaches responded to paper-based measures of resilience and knowledge/attitudes pre- and post-completion of a training workshop. Athletes responded to online measures of stress, efficacy and life satisfaction pre- and post-completion of a resilience program. RESULTS: Following the completion of the train-the-trainer workshop, coaches reported significant increases in general knowledge and confidence in teaching resilience skills. Following the delivery of the resilience program, athlete self-efficacy and satisfaction with life scores were significantly higher, with significant reductions in reported stress for athletes trained by the varsity-level coaches. CONCLUSION: There is support for investing in a train-the-trainer model for the delivery of a resilience skills program within a sports context. Caution is given to investing in the training and support of the coaches, particularly coaches with less coaching experience. These results are consistent with previous research and demonstrate support for coach-led resilience programs being effective in community settings, with implications for rural and remote locations.
Assuntos
Atletas/psicologia , Conhecimentos, Atitudes e Prática em Saúde , Resiliência Psicológica , Esportes/psicologia , Capacitação de Professores/métodos , Adolescente , Adulto , Feminino , Humanos , Masculino , Avaliação de Programas e Projetos de Saúde , AutoeficáciaRESUMO
Schools, like other service sectors, are confronted with an implementation gap, with the slow adoption and uneven implementation of evidence-based practices (EBP) as part of routine service delivery, undermining efforts to promote better youth behavioral health outcomes. Implementation researchers have undertaken systematic efforts to publish taxonomies of implementation strategies (i.e., methods or techniques that are used to facilitate the uptake, use, and sustainment of EBP), such as the Expert Recommendations for Implementing Change (ERIC) Project. The 73-strategy ERIC compilation was developed in the context of healthcare and largely informed by research and practice experts who operate in that service sector. Thus, the comprehensibility, contextual appropriateness, and utility of the existing compilation to other service sectors, such as the educational setting, remain unknown. The purpose of this study was to initiate the School Implementation Strategies, Translating ERIC Resources (SISTER) Project to iteratively adapt the ERIC compilation to the educational sector. The results of a seven-step adaptation process resulted in 75 school-adapted strategies. Surface-level changes were made to the majority of the original ERIC strategies (52 out of 73), while five of the strategies required deeper modifications for adaptation to the school context. Six strategies were deleted and seven new strategies were added based on existing school-based research. The implications of this study's findings for prevention scientists engaged in implementation research (e.g., creating a common nomenclature for implementation strategies) and limitations are discussed.
Assuntos
Difusão de Inovações , Prática Clínica Baseada em Evidências , Pesquisa , Instituições Acadêmicas , Comportamentos Relacionados com a SaúdeRESUMO
Social-emotional learning (SEL) curricula, such as Second Step, are increasingly being adopted and implemented as universal supports in schools in order to prevent social-emotional and behavioral problems and promote wellbeing and success. Notwithstanding the empirical support for SEL as a universal prevention strategy, a closer look at the literature indicates that students display differential responses to SEL based on their behavioral functioning at baseline; those students with the highest need benefit the most from SEL. The primary purpose of this study was to evaluate whether a widely-adopted SEL program produces significant effects for different theoretically-constructed groups of students who are representative of the full spectrum of students in a school. Using data from a large-scale randomized controlled trial evaluating Second Step, analyses examined the extent to which group membership according to the dual continua model of mental health differentially changed based on whether the student was in the intervention or control condition. Overall, results evidenced significant effects favoring the intervention condition across groups in line with our general hypotheses, although both conditions experienced transitions in membership. As expected, those in the intervention condition experienced greater transition between groups, which was indicative of either treatment or prevention effects. Implications, limitations, and future directions of the findings for SEL programming in schools are discussed.
Assuntos
Saúde Mental , Serviços de Saúde Escolar , Aprendizado Social , Estudantes/psicologia , Criança , Currículo , Feminino , Humanos , Masculino , Ajustamento Social , Inquéritos e QuestionáriosRESUMO
BACKGROUND: Integrated care involves care provided by a team of professionals, often in non-traditional settings. A common example worldwide is integrated school-based mental health (SBMH), which involves externally employed clinicians providing care at schools. Integrated mental healthcare can improve the accessibility and efficiency of evidence-based practices (EBPs) for vulnerable populations suffering from fragmented traditional care. However, integration can complicate EBP implementation due to overlapping organizational contexts, diminishing the public health impact. Emerging literature suggests that EBP implementation may benefit from the similarities in the implementation context factors between the different organizations in integrated care, which we termed inter-organizational alignment (IOA). This study quantitatively explored whether and how IOA in general and implementation context factors are associated with implementation outcomes in integrated SBMH. METHODS: SBMH clinicians from community-based organizations (CBOs; nclinician = 27) and their proximal student-support school staff (nschool = 99) rated their schools and CBOs (clinician only) regarding general (organizational culture and molar climate) and implementation context factors (Implementation Climate and Leadership), and nine common implementation outcomes (e.g., treatment integrity, service access, acceptability). The levels of IOA were estimated by intra-class correlations (ICCs). We fitted multilevel models to estimate the standalone effects of context factors from CBOs and schools on implementation outcomes. We also estimated the 2-way interaction effects between CBO and school context factors (i.e., between-setting interdependence) on implementation outcomes. RESULTS: The IOA in general context factors exceeded those of implementation context factors. The standalone effects of implementation context factors on most implementation outcomes were larger than those of general context factors. Similarly, implementation context factors between CBOs and schools showed larger 2-way interaction effects on implementation outcomes than general context factors. CONCLUSIONS: This study preliminarily supported the importance of IOA in context factors for integrated SBMH. The findings shed light on how IOA in implementation and general context factors may be differentially associated with implementation outcomes across a broad array of integrated mental healthcare settings.
Assuntos
Prestação Integrada de Cuidados de Saúde , Cultura Organizacional , Humanos , Adolescente , Estudos Transversais , Criança , Prestação Integrada de Cuidados de Saúde/organização & administração , Feminino , Masculino , Liderança , Prática Clínica Baseada em Evidências/organização & administração , Ciência da Implementação , Serviços de Saúde Mental/organização & administração , Serviços de Saúde Mental Escolar/organização & administração , Adulto , Serviços de Saúde Escolar/organização & administraçãoRESUMO
Existing literature has established the effectiveness of school-wide positive behavioral interventions and supports (SWPBIS) for improving school-level student behavioral and academic outcomes. Implementation of SWPBIS in uncontrolled settings is often suboptimal, leading to lackluster outcomes. Researchers have developed and validated several implementation strategies to improve individual-level implementation determinants (e.g., educators' supportive beliefs) to promote the successful delivery of universal programs (e.g., SWPBIS). However, empirical studies are needed to explore the mechanisms of change through which school-level educators' beliefs influence their delivery of SWPBIS. This school-level quasi-experimental study tested a mediational mechanism of change where changes in educators' beliefs work through their intervention fidelity of SWPBIS to influence student outcomes. We delivered the Supportive Belief Intervention (a school-wide implementation strategy used before training to promote educators' supportive beliefs about SWPBIS) and then Tier 1 SWPBIS training to 81 elementary schools serving diverse student populations. At the start of the academic year, school-level educators' beliefs were assessed before the Supportive Belief Intervention. At the end of the academic year, educators' beliefs, intervention fidelity, and rates of student reading proficiency and suspension were assessed. Conditional process analyses with nonparametric bootstrapping (mediational and first stage moderated mediational models) revealed that, at the school level, a larger increase in educators' supportive beliefs was associated with enhanced SWPBIS fidelity and better corollary student outcomes (increased reading proficiency and reduced suspension), while student socioeconomic status moderated the size of the mediation effect. Implications for research and practices about the implementation of SWPBIS and school context were discussed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
RESUMO
Background: Few "intervention agnostic" strategies have been developed that can be applied to the broad array of evidence-based practices (EBPs) in schools. This paper describes two studies that reflect the initial iterative redesign phases of an effective leadership-focused implementation strategy-Leadership and Organizational Change for Implementation (LOCI)-to ensure its acceptability, feasibility, contextual appropriateness, and usability when used in elementary schools. Our redesigned strategy-Helping Educational Leaders Mobilize Evidence (HELM)-is designed to improve principals' use of strategic implementation leadership to support the adoption and high-fidelity delivery of a universal EBP to improve student outcomes. Method: In Study 1, focus groups were conducted (n = 6) with 54 district administrators, principals, and teachers. Stakeholders provided input on the appropriateness of original LOCI components to maximize relevance and utility in schools. Transcripts were coded using conventional content analysis. Key themes referencing low appropriateness were summarized to inform LOCI adaptations. We then held a National Expert Summit (Study 2) with 15 research and practice experts. Participants provided feedback via a nominal group process (NGP; n = 6 groups) and hackathon (n = 4 groups). The research team rated each NGP suggestion for how actionable, impactful/effective, and feasible it was. We also coded hackathon notes for novel ideas or alignment with LOCI components. Results: Study 1 suggestions included modifications to LOCI content and delivery. Study 2's NGP results revealed most recommendations to be actionable, impactful/effective, and feasible. Hackathon results surfaced two novel ideas (distributed leadership teams and leaders' knowledge to support educators EBP use) and several areas of alignment with LOCI components. Conclusion: Use of these iterative methods informed the redesign of LOCI and the development of HELM. Because it was collaboratively constructed, HELM has the potential to be an effective implementation strategy to support the use of universal EBP in schools.
Our research team designed a strategy (HELM) for school principals to improve the support they provide to staff to implement practices proven to work in research for improving student outcomes. We designed HELM by conducting focus groups with school district administrators, principals, and teachers. Participants were asked for their feedback on how to adapt an existing leadership strategy (LOCI) to the school context. After collecting this feedback, we held a meeting with 15 research and practice experts. During this meeting, the group of experts reviewed the focus group feedback and decided how to incorporate it into the design of the HELM strategy. We believe that collecting this feedback and involving research and practice experts in interpreting and integrating participant feedback into the HELM strategy will make HELM a more effective strategy for supporting school principals' in implementing supports in their schools.
RESUMO
BACKGROUND: For approximately one in five children who have social, emotional, and behavioral (SEB) challenges, accessible evidence-based prevention practices (EBPPs) are critical. In the USA, schools are the primary setting for children's SEB service delivery. Still, EBPPs are rarely adopted and implemented by front-line educators (e.g., teachers) with sufficient fidelity to see effects. Given that individual behavior change is ultimately required for successful implementation, focusing on individual-level processes holds promise as a parsimonious approach to enhance impact. Beliefs and Attitudes for Successful Implementation in Schools for Teachers (BASIS-T) is a pragmatic, multifaceted pre-implementation strategy targeting volitional and motivational mechanisms of educators' behavior change to enhance implementation and student SEB outcomes. This study protocol describes a hybrid type 3 effectiveness-implementation trial designed to evaluate the main effects, mediators, and moderators of the BASIS-T implementation strategy as applied to Positive Greetings at the Door, a universal school-based EBPP previously demonstrated to reduce student disruptive behavior and increase academic engagement. METHODS: This project uses a blocked randomized cohort design with an active comparison control (ACC) condition. We will recruit and include approximately 276 teachers from 46 schools randomly assigned to BASIS-T or ACC conditions. Aim 1 will evaluate the main effects of BASIS-T on proximal implementation mechanisms (attitudes, subjective norms, self-efficacy, intentions to implement, and maintenance self-efficacy), implementation outcomes (adoption, reach, fidelity, and sustainment), and child outcomes (SEB, attendance, discipline, achievement). Aim 2 will examine how, for whom, under what conditions, and how efficiently BASIS-T works, specifically by testing whether the effects of BASIS-T on child outcomes are (a) mediated via its putative mechanisms of behavior change, (b) moderated by teacher factors or school contextual factors, and (c) cost-effective. DISCUSSION: This study will provide a rigorous test of BASIS-T-a pragmatic, theory-driven, and generalizable implementation strategy designed to target theoretically-derived motivational mechanisms-to increase the yield of standard EBPP training and support strategies. TRIAL REGISTRATION: ClinicalTrials.gov ID: NCT05989568. Registered on May 30, 2023.
Assuntos
Motivação , Autoeficácia , Criança , Humanos , Emoções , Estudantes , Instituições Acadêmicas , Ensaios Clínicos Controlados Aleatórios como AssuntoRESUMO
Background: The Evidence-Based Practice Attitudes Scale (EBPAS) is widely used in implementation research, but it has not been adapted and validated for use among general education teachers, who are most likely to deliver evidence-based prevention programs in schools, the most common setting where youth access social, emotional, and behavioral health services. Method: School-based stakeholders and a research team comprised of experts in the implementation of evidence-based practices in schools adapted the EBPAS for teachers (the S-EBPAS). The adapted instrument was administered to a representative sample (n = 441) of general education teachers (grades K-5) to assess the reliability and internal consistency via factor analyses. The S-EBPAS included two forms (i.e., EBP-agnostic and EBP-specific item referents), therefore, a multiple-group confirmatory factor analysis (CFA) was also performed to establish measurement invariance between the two forms. Results: After adaptation and refinement, a 9-item, 3-factor structure was confirmed, with the final model supporting three first-order factors that load onto a second-order factor capturing attitudes toward adopting evidence-based practices. Multiple-group CFA analyses of measurement invariance indicated there were no significant differences between the two forms. Conclusions: Overall, this study provides a brief, flexible instrument capturing attitudes toward adopting EBPs that has high reliability and internal consistency, which support its use among general education teachers in school settings implementing evidence-based practices. Plain Language Summary: The Evidence-Based Practice Attitudes Scale (EBPAS) is a popular instrument for measuring attitudes toward evidence-based practices (EBPs). This instrument provides valuable information during implementation initiatives, such as whether providers or front-line implementers have favorable attitudes toward a given practice. The EBPAS has been used in many different settings, such as in community-based mental health clinics, medical hospitals, and in child welfare. However, it's use in schools has been limited, and it has not yet been tested with general education teachers, who are key implementers of evidence-based practices in schools. In order to trust that the scores from an instrument are accurate, it needs to be evaluated when scaling it out to new populations and settings. One popular method to determine this is to use factor analysis, which was employed in this study. This study fills the identified gap by assessing the reliability (i.e., accuracy) and internal consistency of the EBPAS among a representative sample of general education teachers. Findings from this study indicate that the school-adapted EBPAS (S-EBPAS) is a brief, nine-item instrument that provides a reliable estimate of teachers' attitudes toward evidence-based practices. Our results also provide evidence that the S-EBPAS can be used to capture attitudes toward specific EBPs as well as attitudes toward EBP-agnostic. This study provides a flexible instrument that can be used by school-based implementation researchers, practitioners, and intermediaries at multiple phases of implementation projects, such as when exploring a new EBP to adopt.
RESUMO
Group-based didactic training is a cornerstone implementation strategy used to support the adoption and delivery of evidence-based prevention programs (EBPP) by teachers in schools, but it is often insufficient to drive successful implementation. Beliefs and Attitudes for Successful Implementation in Schools for Teachers (BASIS-T) is a theory-based, motivational implementation strategy designed to increase the yield of EBPP training and consultation. The purpose of this study was to examine the longitudinal effects of BASIS-T on hypothesized mechanisms of behavior change (e.g., attitudes toward EBPP, self-efficacy, intentions to implement) and implementation and student outcomes associated with a well-established universal prevention program-the good behavior game (GBG). This pilot trial included 82 elementary school teachers from nine public elementary schools who were randomly assigned at the school-level to the BASIS-T (n = 43) or active comparison (n = 39) condition, with both conditions receiving training and consultation of the good behavior game by a third-party purveyor. Analyses included mixed-effects and multilevel growth modeling of adoption, mechanisms of behavior change, and student behavior outcomes. Meaningful effects were found favoring BASIS-T on immediate adoption of the GBG within the first month of school (74% vs. 40%) and self-efficacy (p < 0.05). These findings advance our understanding of the type of implementation strategies that complement pre-implementation training and post-training consultation in schools by identifying the importance of task self-efficacy as a mechanism of behavior change related to adoption for prevention programming. Supplementary Information: The online version contains supplementary material available at 10.1007/s12310-022-09536-z.
RESUMO
In-service training is a critical and frequently utilized implementation strategy to support the adoption and delivery of evidence-based practice (EBP) across service settings, but is characteristically ineffective in producing provider behavior changes, particularly when delivered in single exposure didactic events. EBP trainers are in a strategic position to leverage their trainee-perceived characteristics to influence trainees' attitudes, motivation, and intentions to implement, and ultimately increase the likelihood of successful uptake of skills. The purpose of this study was to extend research on the measure of effective attributes of trainers (MEAT) by examining its underlying factor structure and reliability in the context of in-service EBP training for teachers (i.e., structural validity). This study also examined the predictive validity of the MEAT by examining relationships with a measure of teacher intentions to implement EBPs following a standardized training experience (i.e., predictive validity). An exploratory factor analysis (EFA) was employed to determine the latent factors (i.e., subscales of characteristics) that underlie the data. Additionally, a forward selection, stepwise regression was conducted to determine the extent to which trainer attributes could explain variance in intentions to implement. Results indicated that the MEAT was a valid and reliable measure to examine trainer attributes in school settings. Moreover, findings suggested that trainer attributes, particularly those related to trainee perceptions of the trainers' welcoming disposition (i.e., related to trainers' warm, positive temperament and internal character traits), were significantly associated with trainees' intentions to implement the trained upon EBP.
RESUMO
Over 60 years of research reveal that informants who observe youth in clinically relevant contexts (e.g., home, school)-typically parents, teachers, and youth clients themselves-often hold discrepant views about that client's needs for mental health services (i.e., informant discrepancies). The last 10 years of research reveal that these discrepancies reflect the reality that (a) youth clients' needs may vary within and across contexts and (b) informants may vary in their expertise for observing youth clients within specific contexts. Accordingly, collecting and interpreting multi-informant data comprise "best practices" in research and clinical care. Yet, professionals across settings (e.g., health, mental health, school) vary in their use of multi-informant data. Specifically, professionals differ in how or to what degree they leverage multi-informant data to determine the goals of services designed to meet youth clients' needs. Further, even when professionals have access to multiple informants' reports, their clinical decisions often signal reliance on one informant's report, thereby omitting reports from other informants. Together, these issues highlight an understudied research-to-practice gap that limits the quality of services for youth. We advance a framework-the Needs-to-Goals Gap-to characterize the role of informant discrepancies in identifying youth clients' needs and the goals of services to meet those needs. This framework connects the utility of multi-informant data with the reality that services often target an array of needs within and across contexts, and that making decisions without accurately integrating multiple informants' reports may result in suboptimal care. We review evidence supporting the framework and outline directions for future research.
Assuntos
Serviços de Saúde Mental , Saúde Mental , Adolescente , Objetivos , Humanos , Pais , Instituições AcadêmicasRESUMO
Educational researchers have produced a variety of evidence-based practices (EBP) to address social, emotional, and behavioral (SEB) needs among students. Yet, these practices are often insufficiently adopted and implemented with fidelity by teachers to produce the beneficial outcomes associated with the EBP, leaving students at risk for developing SEB problems. If ignored, SEB problems can lead to other negative outcomes, such as academic failure. Therefore, implementation strategies (i.e., methods and procedures designed to promote implementation outcomes) are needed to improve teachers' uptake and delivery of EBPs with fidelity. This meta-analysis sought to examine the types and magnitude of effect of implementation strategies that have been designed and tested to improve teacher adherence to SEB EBPs. Included studies (a) used single case experimental designs, (b) employed at least one implementation strategy, (c) targeted general education teachers, and (d) evaluated adherence as a core dimension of fidelity related to the delivery of EBPs. In total, this study included 28 articles and evaluated 122 effect sizes. A total of 15 unique implementation strategies were categorized. Results indicated that, on average, implementation strategies were associated with increases in teacher adherence to EBPs above baseline and group-based pre-implementation trainings alone (g = 2.32, tau = 0.77). Moderator analysis also indicated that larger effects were associated with implementation strategies that used a greater number of unique behavior change techniques (p < .001). Implications and future directions for research and practice regarding use of implementation strategies for general education teachers are discussed.
Assuntos
Pessoal de Educação , Prática Clínica Baseada em Evidências , Emoções , Humanos , Professores Escolares , EstudantesRESUMO
Check-in/Check-out (CICO) is a widely implemented evidence-based program for supporting students with at-risk levels of social and emotional behavior concerns. It is comprised of several core features described in the previous literature, including practice elements, which are the specific actions that are delivered directly to students, and implementation components, which are actions that support the implementation by adults. Practice elements and implementation components are both important to implementation but have been combined and conflated in descriptions of CICO implementation. Well-defined and differentiated practice elements could provide improved clarity in communicating implementation expectations to front-line implementers as well as support future research into essential active ingredients and measures of front-line intervention fidelity. The purpose of the present study was to distill, differentiate, and operationally define the student-facing practice elements of CICO. A panel of research experts and practice experts participated in a three-round modified e-Delphi process that led to the identification and operational definition of 19 discreet practice elements organized into five domains. Results are discussed in terms in implications for future development of measures of commitment and intervention fidelity, future research into active ingredients of CICO, and in terms of how well-defined practice elements can improve communication of implementation expectations for front-line implementers of CICO such as teachers. Supplementary Information: The online version contains supplementary material available at 10.1007/s12310-021-09495-x.
RESUMO
Background: Implementation climate is an organizational construct theorized to facilitate the adoption and delivery of evidence-based practices. Within schools, teachers often are tasked with implementing universal prevention programs. Therefore, they are ideal informants when assessing school implementation climate for initial and continuous implementation improvement efforts. The purpose of this study was to examine the construct validity (i.e., factor structure and convergent/divergent validity) of a school-adapted measure of strategic implementation climate called the School Implementation Climate Scale (SICS). Methods: Confirmatory factor analyses of SICS data, collected from 441 teachers in 52 schools, were used to compare uncorrelated and correlated first-order factor models and a second-order hierarchical model. Correlations with other school measures were examined to assess SICS convergent and divergent validities. Results: Results demonstrated acceptable internal consistency for each SICS subscale (αs > 0.80 for all subscales) and construct validity of the hypothesized factor structure of the SICS with three new scales. The hierarchical second-order factor structure with eight first-order factors was found to best model the SICS data. Correlations with other school measures were in the expected direction and magnitude. Conclusions: Results from this study provide psychometric evidence that supports the use of the SICS to inform the implementation research and practice in schools. Plain Language Summary: Schools are busy trying to implement various universal programs and systems to help support kids in their growth. Beginning and sustaining these efforts is quite challenging, and there is need for tools and ideas to help those implementation efforts. One concept is implementation climate, which is broadly the school staff's perception of the implementation support for a given practice. However, no measure currently exists to help schools assess their implementation climate. The goal of our study was to adapt a measure of implementation climate used in other settings to the school environment. We used feedback from educational experts to make changes and used various analyses to determine if the newly adapted measure was psychometrically sound. Findings suggest the new measure is usable to guide implementation efforts in schools.
RESUMO
Student-teacher relationships are important to student outcomes and may be especially pivotal at the high school transition and for minoritized racial/ethnic groups. Although interventions exist to improve student-teacher relationships, none have been shown to be effective among high school students or in narrowing racial/ethnic disparities in student outcomes. This study was conducted to examine the effects of an equity-explicit student-teacher relationship intervention (Equity-Explicit Establish Maintain Restore, or E-EMR) for high school teachers and students. A cluster-randomized pilot trial was conducted with 94 ninth grade teachers and 417 ninth grade students in six high schools. Teachers in three schools were randomized to receive E-EMR training and follow-up supports for one year. Teachers in three control schools conducted business as usual. Student-teacher relationships, sense of school belonging, academic motivation, and academic engagement were collected via student self-report in September and January of their ninth-grade year. Longitudinal models revealed non-significant main effects of E-EMR. However, there were targeted benefits for students who started with low scores at baseline, for Asian, Latinx, multicultural, and (to a lesser extent) Black students. We also found some unexpected effects, where high-performing and/or advantaged groups in the E-EMR condition had less favorable outcomes at post, compared to those in the control group, which may be a result of the equity-explicit focus of E-EMR. Implications and directions for future research are discussed.
RESUMO
Objectives: We conducted a mixed-method focus group study to (a) assess the appropriateness and likely effectiveness of strategies that target individual behavior change mechanisms associated with perceived barriers of lack of time and unsupportive leadership and (b) identify recommendations regarding strategies for overcoming the barriers. Method: Sample included 39 school-based staff (80% female, 77% White) across two districts in the Midwest. Mixed methods included a simultaneous approach. Results: Lack of time and supportive leadership continue to pervade school-based implementation efforts. Recommendations centered around the need for school leaders to give teachers the power to re-prioritize how they spend their time as well as providing protected, facilitated time for teachers to collaborate and learn practical skills targeting self-advocacy. Conclusion: Our findings provide compelling evidence for the use of implementation methodology to strategically target mechanisms of individual behavior change during the process of incorporating new and innovative practices in schools.
RESUMO
Effective mental health services require accurate assessment of psychosocial impairments linked to mental health concerns. Youth who experience these impairments do so within and across various contexts (e.g., school, home). Youth may display symptoms of mental health concerns without co-occurring impairments, and vice versa. Yet, nearly all impairment measures presume that those assessed display mental health concerns. Consequently, we recently developed youth and parent versions of a five-item measure of youth psychosocial impairments (i.e., Work and Social Adjustment Scale for Youth [WSASY]), structured to assess any youth, regardless of mental health status. Across two studies, we developed and tested a WSASY teacher version, in a large sample of 382 student teacher reports (Study 1), and a subsample of 66 youth who, along with their parents and teachers, completed the WSASY and a series of school- and home-based behavioral tasks (Study 2). In Study 1, WSASY teacher reports demonstrated excellent internal consistency and unique relations with teacher reports on well-established measures of psychosocial strengths and difficulties. In Study 2, teacher, youth, and parent WSASY reports demonstrated low correspondence with each other and context-specific relations with criterion variables. This low correspondence allowed us to capitalize on an integrative approach designed to optimize informant-specific variance. Integrative scores demonstrated robust, large-magnitude relations with criterion variables across multiple information sources. These findings provide important psychometric support for use of WSASY teacher reports, and pave the way toward integrating WSASY reports from multiple informants who observe youth psychosocial impairments within different contexts and from different perspectives. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Assuntos
Pais , Ajustamento Social , Adolescente , Humanos , Saúde Mental , Psicometria , Professores Escolares , Instituições AcadêmicasRESUMO
BACKGROUND: Strategic implementation leadership is a critical determinant of successful implementation, hypothesized to create a more supportive implementation climate conducive to the adoption and use of evidence-based practices. Implementation leadership behaviors may vary significantly across contexts, necessitating studies that examine the validity of established measurement tools in novel health service delivery sectors. The education sector is the most common site for delivering mental health services to children and adolescents in the USA, but research focused on implementation leadership in schools is in the early phases, and there is a need for adaptation and expansion of instruments in order to tailor to the school context. The current study adapted and validated the School Implementation Leadership Scale (SILS) (based on the Implementation Leadership Scale) in a sample of elementary school personnel from six school districts who were implementing one of two well-established prevention programs for supporting children's mental health. METHODS: Participants were 441 public school teachers from 52 elementary schools in the Midwest and West Coast of the USA. Participants completed a survey that contained: (1) an adapted and expanded version of the SILS with additional items generated for four existing subscales as well as three new subscales (communication, vision/mission, and availability), and (2) additional tools to evaluate convergent and divergent validity (i.e., measures of general/molar leadership and teaching attitudes). Data underwent (1) examination of item characteristic curves to reduce items and ensure a pragmatic instrument, (2) confirmatory factor analyses to establish structural validity, and (3) evaluation of convergent and divergent validity. RESULTS: Item reduction analyses resulted in seven subscales of three items each. Results indicated acceptable fit for a seven-factor structural model (CFI = .995, TLI = .99, RMSEA = .07, SRMR = 0.02). Second-order factor loadings were high (λ = .89 to .96), suggesting that the SILS subscales comprise a higher-order implementation leadership factor. All subscales demonstrated good inter-item reliability (α = .91-.96). Convergent and divergent validity results were generally as hypothesized, with moderate to high correlations between SILS subscales and general leadership, moderate correlations with teaching attitudes, and low correlations with school demographics. CONCLUSIONS: Overall, results provided strong structural, convergent, and divergent validity evidence for the 21-item, 7-factor SILS instrument. Implications for the measurement of implementation leadership in schools are discussed, as well as strategies to support leaders to enhance their strategic behaviors related to the implementation of mental health prevention programs (e.g., adaptation of existing leadership-focused implementation strategies).