Fidelity of implementation of national guidelines on malaria diagnosis for children under-five years in Rivers State, Nigeria.

BACKGROUND: Malaria is still a disease of global public health importance and children under-five years of age are the most vulnerable to the disease. Nigeria adopted the "test and treat" strategy in the national malaria guidelines as one of the ways to control malaria transmission. The level of adherence to the guidelines is an important indicator for the success or failure of the country's roadmap to malaria elimination by 2030. This study aimed to assess the fidelity of implementation of the national guidelines on malaria diagnosis for children under-five years and examine its associated moderating factors in health care facilities in Rivers State, Nigeria. METHODS: This was a descriptive, cross-sectional study conducted in Port Harcourt metropolis. Data were collected from 147 public, formal private and informal private health care facilities. The study used a questionnaire developed based on Carroll's Conceptual Framework for Implementation Fidelity. Frequency, mean and median scores for implementation fidelity and its associated factors were calculated. Associations between fidelity and the measured predictors were examined using Mann Whitney U test, Kruskal Wallis test, and multiple linear regression modelling using robust estimation of errors. Regression results are presented in adjusted coefficient (ß) and 95% confidence intervals. RESULTS: The median (IQR) score fidelity score for all participants was 65% (43.3, 85). Informal private facilities (proprietary patent medicine vendors) had the lowest fidelity scores (47%) compared to formal private (69%) and public health facilities (79%). Intervention complexity had a statistically significant inverse relationship to implementation fidelity (ß = - 1.89 [- 3.42, - 0.34]). Increase in participant responsiveness (ß = 8.57 [4.83, 12.32]) and the type of malaria test offered at the facility (e.g., RDT vs. no test, ß = 16.90 [6.78, 27.03]; microscopy vs. no test, ß = 21.88 [13.60, 30.16]) were positively associated with fidelity score. CONCLUSIONS: This study showed that core elements of the "test and treat" strategy, such as testing all suspected cases with approved diagnostic methods before treatment, are still not fully implemented by health facilities. There is a need for strategies to increase fidelity, especially in the informal private health sector, for malaria elimination programme outcomes to be achieved.

Teachers' Perceptions of the Impact of the COVID-19 Pandemic and Their Implementation of an Evidence-based HIV Prevention Program in the Bahamas.

Information on how school-based programs is implemented and sustained during crises is limited. In this study, we assessed the impact of the COVID-19 pandemic on the implementation of a HIV prevention intervention in The Bahamas. Data were collected from 139 Grade 6 teachers in 2021-2022. Teachers attended virtual training and received implementation monitoring from coordinators. On average, teachers taught 26.4 (SD = 9.2) of the 35 core activities, and 7.4 (SD = 2.4) out of 9 sessions. More than half (58.3%) of teachers completed 28 or more core activities; 69.1% covered eight or all nine sessions, which is equivalent to 80% of the HIV intervention curriculum. Almost half of the teachers (43%) reported that the pandemic negatively impacted their ability to teach the program; 72% of teachers maintained that the program remained "very important" during times of crisis. Greater self-efficacy and supports increased implementation fidelity.

Evaluation of the implementation fidelity of comprehensive emergency obstetric and newborn care at University of Gondar comprehensive specialized hospital, Northwest Ethiopia: a mixed-method evaluation.

BACKGROUND: Approximately 15% of births worldwide result in life-threatening complications during pregnancy, delivery, or postpartum. Comprehensive Emergency Management of Obstetric and Newborn Care (CEmONC) is intended as one of the measures for maternal healthcare services to reduce the high burden with regard to childbirth complications. However, its state of implementation fidelity has not been well investigated. Therefore, this study aimed to evaluate the implementation fidelity of CEmONC services at University of Gondar Comprehensive Specialized Hospital, Ethiopia. METHOD: A case-study design with an embedded mixed method was employed. Adherence, quality of delivery, and participant responsiveness dimensions from Carroll's conceptual framework were used in this evaluation. Four hundred four exit interviews, 423 retrospective document reviews and 10 key informants were conducted. Moreover, a binary logistic regression model was fitted. The qualitative data were transcribed, translated, coded, and analysed using a thematic analysis approach. The overall implementation fidelity of the CEmONC was judged based on the pre-seated judgmental criteria. RESULTS: Overall the implementation fidelity of the CEmONC service was 75.5%. Quality of delivery, participant responsiveness and adherence were 72.7%, 76.6% and 77.2% respectively. Signal functions like parenteral antibiotics and removal of retained products were insufficiently performed against the recommended protocols which was also evidenced by the key informant interviews. Healthcare providers' respect for the clients was less. Age ≥ 35 years (AOR = 0.48, 95% CI: 0.24,0.98), educational status of college and above (AOR = 2.61, 95% CI: 1.46,4.66), being government employed (AOR = 1.85, 95% CI: 1.08,3.18), having ANC follow-up (AOR = 5.50, 95% CI: 1.83, 16.47) and grand multigravida (AOR = 2.17, 95% CI: 1.08, 4.38) were factors significantly associated with participant responsiveness towards the services. CONCLUSIONS: The overall implementation fidelity of the CEmONC services was implemented in good fidelity. Moreover, the quality of delivery was judged as implemented in fair fidelity. Parenteral antibiotics and removal of retained products were not found to be sufficiently performed. Respect for the clients was insufficiently delivered. Therefore, it is recommended that parenteral antibiotics drugs be adequately provided and training for healthcare providers regarding compassionate and respectful care shall be facilitated. Moreover, healthcare providers are strongly recommended to adhere to the recommended guidelines.

A Longitudinal Analysis of Trajectories and Predictors of Fidelity Using the SafeCare Parenting Model.

Evidence-based practice (EBP) fidelity, understood as the extent to which a program is implemented as the developers intended, is a key implementation variable which likely relates to consumer outcomes. However, studies that track fidelity longitudinally and at large scale are uncommon, and finding reliable predictors of fidelity has proven to be a complex challenge. Further, attitudes toward EBP are a potentially important predictor of fidelity, but results across the literature have been mixed. The purpose of the present study is to use data from the ongoing implementation and dissemination of the SafeCare model to better understand (1) the characteristics of SafeCare implementation fidelity trajectories, and (2) whether individual level factors predict differences in fidelity and fidelity trajectories, especially provider attitudes toward EBP. The analyses reported here include 14,778 observed fidelity sessions by 868 providers in 172 agencies. We use multilevel modeling to examine fidelity, fidelity trajectories over time, and several potential individual-level predictors of fidelity, including demographics, work history, and attitudes toward EBP. We found: (1) that SafeCare fidelity begins high at baseline (93.85% on average); (2) that SafeCare fidelity displays a statistically significant trend of positive linear growth, even among those with less positive attitudes; and (3) that positive attitudes are associated with slightly higher fidelity on average and at baseline, while negative attitudes are associated with slightly lower fidelity on average and at baseline. To our knowledge, this is the largest longitudinal analysis of EBP fidelity in a child welfare program to date, and our findings support the notion that intensive coaching supports which are titrated over time can be sufficient to ensure sustained high fidelity, at least in some cases. Further, these findings indicate that robust training and coaching processes can ensure high fidelity and fidelity growth even among providers with less positive attitudes toward EBP.

Implementation fidelity of infection prevention practices at Debre Tabor comprehensive specialized hospital, Northwest Ethiopia.

BACKGROUND: Healthcare-Acquired Infections are a major problem in the world and within the healthcare delivery system. An estimated 5-10% and around 25% of hospitalized patients have healthcare-acquired infections in developed and developing countries, respectively. Infection prevention and control programs have proven to be successful in lowering the incidence and spread of infections. Thus, this evaluation aims to evaluate the implementation fidelity of infection prevention practices at Debre Tabor comprehensive specialized hospital in Northwest Ethiopia. METHODS: A facility-based cross-sectional design with a concurrent mixed method was used to evaluate the implementation fidelity of infection prevention practices. A total of 36 indicators were used to measure adherence, participant responsiveness, and facilitation strategy dimensions. A total of 423 clients were administered for an interview, an inventory checklist, a document review, 35 non-participatory observations, and 11 key informant interviews were conducted. A multivariable logistic regression analysis was used to identify factors significantly associated with the satisfaction of clients. The findings were presented using descriptions, tables, and graphs. RESULT: The overall implementation fidelity of the infection prevention practices was 61.8%. The dimensions of adherence to infection prevention and control guidelines were 71.4%, participant responsiveness was 60.6%, and facilitation strategy was 48%. In multivariable analysis, ward admission and educational level had a p-value of below 0.05 and were significantly associated with the satisfaction of clients with infection prevention practices at the hospital. The major themes that emerged in qualitative data analysis were healthcare worker-related factors, management-related factors, and patient- and visitor-related factors. CONCLUSION: The evaluation result of this study concluded that the overall implementation fidelity of infection prevention practice was judged to be medium and needed improvement. It included dimensions of adherence and participant responsiveness that were rated as medium, as well as a facilitation strategy that was rated as low. Enablers and barriers were thematized into factors related to healthcare providers, management, institutions, and patient and visitor relations.

Implementation fidelity to a behavioral diabetes prevention intervention in two New York City safety net primary care practices.

BACKGROUND: It is critical to assess implementation fidelity of evidence-based interventions and factors moderating fidelity, to understand the reasons for their success or failure. However, fidelity and fidelity moderators are seldom systematically reported. The study objective was to conduct a concurrent implementation fidelity evaluation and examine fidelity moderators of CHORD (Community Health Outreach to Reduce Diabetes), a pragmatic, cluster-randomized, controlled trial to test the impact of a Community Health Workers (CHW)-led health coaching intervention to prevent incident type 2 Diabetes Mellitus in New York (NY). METHODS: We applied the Conceptual Framework for Implementation Fidelity to assess implementation fidelity and factors moderating it across the four core intervention components: patient goal setting, education topic coaching, primary care (PC) visits, and referrals to address social determinants of health (SDH), using descriptive statistics and regression models. PC patients with prediabetes receiving care from safety-net patient-centered medical homes (PCMHs) at either, VA NY Harbor or at Bellevue Hospital (BH) were eligible to be randomized into the CHW-led CHORD intervention or usual care. Among 559 patients randomized and enrolled in the intervention group, 79.4% completed the intake survey and were included in the analytic sample for fidelity assessment. Fidelity was measured as coverage, content adherence and frequency of each core component, and the moderators assessed were implementation site and patient activation measure. RESULTS: Content adherence was high for three components with nearly 80.0% of patients setting ≥ 1 goal, having ≥ 1 PC visit and receiving ≥ 1 education session. Only 45.0% patients received ≥ 1 SDH referral. After adjusting for patient gender, language, race, ethnicity, and age, the implementation site moderated adherence to goal setting (77.4% BH vs. 87.7% VA), educational coaching (78.9% BH vs. 88.3% VA), number of successful CHW-patient encounters (6 BH vs 4 VA) and percent of patients receiving all four components (41.1% BH vs. 25.7% VA). CONCLUSIONS: The fidelity to the four CHORD intervention components differed between the two implementation sites, demonstrating the challenges in implementing complex evidence-based interventions in different settings. Our findings underscore the importance of measuring implementation fidelity in contextualizing the outcomes of randomized trials of complex multi-site behavioral interventions. TRIAL REGISTRATION: The trial was registered with ClinicalTrials.gov on 30/12/2016 and the registration number is NCT03006666 .

Process evaluation of a kindergarten-based intervention for obesity prevention in early childhood: the Toybox study Malaysia.

BACKGROUND: Toybox is a kindergarten-based intervention program that targets sedentary behavior, snacking and drinking habits, as well as promoting physical activity in an effort to improve healthy energy balance-related behaviors among children attending kindergartens in Malaysia. The pilot of this program was conducted as a randomized controlled trial (RCT) involving 837 children from 22 intervention kindergartens and 26 control kindergartens respectively. This paper outlines the process evaluation of this intervention. METHODS: We assessed five process indicators: recruitment, retention, dosage, fidelity, and satisfaction for the Toybox program. Data collection was conducted via teachers' monthly logbooks, post-intervention feedback through questionnaires, and focus group discussions (FGD) with teachers, parents, and children. Data were analyzed using quantitative and qualitative data analysis methods. RESULTS: A total of 1072 children were invited. Out of the 1001 children whose parents consented to join, only 837 completed the program (Retention rate: 88.4%). As high as 91% of the 44 teachers and their assistants engaged positively in one or more of the process evaluation data collection methods. In terms of dosage and fidelity, 76% of parents had received newsletters, tip cards, and posters at the appropriate times. All teachers and their assistants felt satisfied with the intervention program. However, they also mentioned some barriers to its implementation, including the lack of suitable indoor environments to conduct activities and the need to make kangaroo stories more interesting to captivate the children's attention. As for parents, 88% of them were satisfied with the family-based activities and enjoyed them. They also felt that the materials provided were easy to understand and managed to improve their knowledge. Lastly, the children showed positive behaviors in consuming more water, fruits, and vegetables. CONCLUSIONS: The Toybox program was deemed acceptable and feasible to implement by the parents and teachers. However, several factors need to be improved before it can be expanded and embedded as a routine practice across Malaysia.

Assessing implementation fidelity of an on-site pharmacist intervention within Australian residential aged care facilities: A mixed methods study.

BACKGROUND: An on-site pharmacist (OSP) intervention was implemented which sought to improve medication management within residential aged care facilities (RACFs) in the Australian Capital Territory, Australia. The objectives of this mixed methods study were to evaluate the implementation fidelity of the OSP intervention and to determine the moderating factors which influenced delivery of this intervention. METHODS: This convergent parallel mixed methods study was underpinned by Hasson's conceptual framework for implementation fidelity. Implementation fidelity for seven intervention RACFs was quantitatively assessed using three quantitative data sets: (1) range of OSP intervention activities delivered; (2) random sample of 10% of medication reviews assessed for quality; (3) proportion of residents who received at least one medication review. Semi-structured interviews (n = 14) with managers and OSPs across the intervention RACFs were conducted to identify moderating factors which may have influenced OSP intervention delivery. RESULTS: The OSP intervention was generally delivered as intended with overall medium levels of implementation fidelity. This delivery was supported by a range of facilitation strategies with most participants perceiving that the intervention was delivered to a high standard. RACF managers and OSPs were mostly well engaged and responsive. A number of potential barriers (including the part-time OSP role, COVID-19 pandemic, RACFs spread out over a large area with significant distance between resident dwellings) and facilitators (including the pharmacist support meetings, OSPs who took time to establish relationships, RACF managers who actively supported OSPs and worked with them) for OSP intervention delivery were identified which have potential implications for the roll out of OSPs within Australian RACFs. CONCLUSION: In this study, the implementation fidelity of OSP intervention delivery was assessed with overall medium levels of fidelity found across the intervention RACFs. This suggested that the OSP intervention can generally be delivered as intended in real world RACFs. OSP intervention delivery was influenced by a range of moderating factors, some of which posed barriers and others which facilitated the OSP intervention being delivered as intended.

Implementation fidelity to HIV assisted partner services (aPS) during scale-up in western Kenya: a convergent mixed methods study.

BACKGROUND: HIV assisted partner services (aPS) is an intervention to improve HIV status awareness among sex and drug-injecting partners of people newly diagnosed with HIV (index clients). Implementation fidelity-the degree to which an intervention is conducted as intended - is critical to effectiveness, but there are limited data about aPS fidelity when delivered by HIV testing service (HTS) providers. We explored factors affecting implementation fidelity to aPS in two high-HIV prevalence counties in western Kenya. METHODS: We used convergent mixed methods adapting the conceptual framework for implementation fidelity within the aPS scale-up project. This was an implementation study examining scale-up of APS within HTS programs in Kisumu and Homa Bay counties that recruited male sex partners (MSPs) of female index clients. We defined implementation fidelity as the extent to which HTS providers followed the protocol for phone and in-person participant tracing at six expected tracing attempts. Quantitative data were collected from tracing reports in 31 facilities between November 2018 and December 2020, and in-depth interviews (IDIs) were conducted with HTS providers. Descriptive statistics were used to describe tracing attempts. IDIs were analyzed using thematic content analysis. RESULTS: Overall, 3017 MSPs were mentioned of whom 98% (2969/3017) were traced, with most tracing attempts being successful (2831/2969, 95%). Fourteen HTS providers participated in the IDIs-mostly females (10/14, 71%) with a median age of 35 years (range 25-52), who all had post-secondary education (14/14, 100%). The proportion of tracing attempts occurring by phone ranged from 47 to 66%, with the highest proportion occurring on the first attempt and lowest on the sixth attempt. Contextual factors either enhanced or impeded implementation fidelity to aPS. Positive provider attitudes towards aPS and conducive work environment factors promoted implementation fidelity, while negative MSP responses and challenging tracing conditions impeded it. CONCLUSION: Interactions at the individual (provider), interpersonal (client-provider), and health systems (facility) levels affected implementation fidelity to aPS. As policymakers prioritize strategies to reduce new HIV infections, our findings highlight the importance of conducting fidelity assessments to better anticipate and mitigate the impact of contextual factors during the scale-up of interventions.

Evaluating the implementation fidelity to a successful nurse-led model (INTERCARE) which reduced nursing home unplanned hospitalisations.

BACKGROUND: Implementation fidelity assesses the degree to which an intervention is delivered as it should be. Fidelity helps to determine if the outcome(s) of an intervention are attributed to the intervention itself or to a failure of its implementation. Little is known about how fidelity impacts the intended outcome(s) and what elements or moderators can affect the fidelity trajectory over time. We exemplify the meaning of implementation fidelity with INTERCARE, a nurse-led care model that was implemented in eleven Swiss nursing homes (NHs) and showed effectiveness in reducing unplanned hospital transfers. INTERCARE comprises six core elements, including advance care planning and tools to support inter- and interprofessional communication, which were introduced with carefully developed implementation strategies. METHODS: A mixed-methods convergent/triangulation design was used to investigate the influence of implementation fidelity on unplanned transfers. A fidelity questionnaire measuring the degree of fidelity to INTERCARE's core components was fielded at four time points in the participating NHs. Two-monthly meetings were conducted with NHs (September 2018-January 2020) and structured notes were used to determine moderators affecting fidelity (e.g., participant responsiveness). We used the fidelity scores and generalized linear mixed models to analyze the quantitative data. The Framework method was used for the qualitative analysis. The quantitative and qualitative findings were integrated using triangulation. RESULTS: A higher overall fidelity score showed a decreasing rate of unplanned hospital transfers post-intervention (OR: 0.65 (CI = 0.43-0.99), p = 0.047). A higher fidelity score to advance care planning was associated with lower unplanned transfers (OR = 0.24 (CI 0.13-0.44), p = < 0.001) and a lower fidelity score for communication tools (e.g., ISBAR) to higher rates in unplanned transfers (OR = 1.69 (CI 1.30-2.19), p = < 0.003). In-house physicians with a collaborative approach and staff's perceived need for nurses working in extended roles, were important moderators to achieve and sustain high fidelity. CONCLUSION: Implementation fidelity is challenging to measure and report, especially in complex interventions, yet is crucial to better understand how such interventions may be tailored for scale-up. This study provides both a detailed description of how fidelity can be measured and which ingredients highly contributed to reducing unplanned NH transfers. TRIAL REGISTRATION: The INTERCARE study was registered at clinicaltrials.gov Protocol Record NCT03590470.

Assessing the Fidelity of an Affirmative Cognitive Behavioral Group Intervention.

Purpose: Support implementation fidelity in intervention research with lesbian, gay, bisexual, transgender, queer, and sexual and gender diverse (LGBTQ+) populations, this study explores the systematic development of a fidelity process for AFFIRM, an evidence-based, affirmative cognitive behavioral therapy group intervention for LGBTQ+ youth and adults. Method: As part of a clinical trial, the AFFIRM fidelity checklist was designed to assess clinician adherence. A total of 151 audio-recorded group sessions were coded by four trained raters. Results: Adherence was high with a mean fidelity score of 84.13 (SD = 12.50). Inter-rater reliability was 81%, suggesting substantial agreement. Qualitative thematic analysis of low-rated sessions identified deviations from the manual and difficulties in group facilitation, while high-rated sessions specified affirmative and effective clinical responses. Discussion: Findings were integrated into clinical training and coaching. The fidelity process provides insights into the challenges of implementing social work interventions effectively with LGBTQ+ populations in community settings.

Partially Automated Training for Implementing, Summarizing, and Interpreting Trial-Based Functional Analyses.

Trial-based functional analysis (TBFA) is an accurate and ecologically valid assessment of challenging behavior. Further, there is evidence to suggest that individuals with minimal exposure to behavior analytic assessment methodology (e.g., parents, teachers) can quickly be trained to conduct TBFAs in naturalistic settings (e.g., schools, homes). Notwithstanding, the response effort associated with training development can be prohibitive and may preclude incorporation of TBFA into practice. To address this, we developed a partially automated training package, intended to increase the methodology's accessibility. Using a multiple-probe across skills design, we assessed the degree to which the package increased caregiver accuracy in (a) implementing TBFAs, (b) interpreting TBFA outcomes, and (c) managing TBFA data. Six caregivers completed this study and all demonstrated proficiency following training, first during structured roleplays and again during assessment of their child's actual challenging behavior.

Implementation fidelity of a nurse-led RCT-tested complex intervention, care coordination for health promotion and activities in Parkinson's disease (CHAPS) in meeting challenges in care management.

BACKGROUND: Parkinson's disease (PD) complexity poses challenges for individuals with Parkinson's, providers, and researchers. A recent multisite randomized trial of a proactive, telephone-based, nurse-led care management intervention - Care Coordination for Health Promotion and Activities in Parkinson's Disease (CHAPS) - demonstrated improved PD care quality. Implementation details and supportive stakeholder feedback were subsequently published. To inform decisions on dissemination, CHAPS Model components require evaluations of their fidelity to the Chronic Care Model and to their implementation. Additionally, assessment is needed on whether CHAPS addresses care challenges cited in recent literature. METHODS: These analyses are based on data from a subset of 140 intervention arm participants and other CHAPS data. To examine CHAPS Model fidelity, we identified CHAPS components corresponding to the Chronic Care Model's six essential elements. To assess implementation fidelity of these components, we examined data corresponding to Hasson's modified implementation fidelity framework. Finally, we identified challenges cited in current Parkinson's care management literature, grouped these into themes using open card sorting techniques, and examined CHAPS data for evidence that CHAPS met these challenges. RESULTS: All Chronic Care Model essential elements were addressed by 17 CHAPS components, thus achieving CHAPS Model fidelity. CHAPS implementation fidelity was demonstrated by adherence to content, frequency, and duration with partial fidelity to telephone encounter frequency. We identified potential fidelity moderators for all six of Hasson's moderator types. Through card sorting, four Parkinson's care management challenge themes emerged: unmet needs and suggestions for providers (by patient and/or care partner), patient characteristics needing consideration, and standardizing models for Parkinson's care management. CHAPS activities and stakeholder perceptions addressed all these themes. CONCLUSIONS: CHAPS, a supportive nurse-led proactive Parkinson's care management program, improved care quality and is designed to be reproducible and supportive to clinicians. Findings indicated CHAPS Model fidelity occurred to the Chronic Care Model and fidelity to implementation of the CHAPS components was demonstrated. Current Parkinson's care management challenges were met through CHAPS activities. Thus, dissemination of CHAPS merits consideration by those responsible for implementing changes in clinical practice and reaching people in need. TRIAL REGISTRATION: ClinicalTrials.gov as NCT01532986 , registered on January 13, 2012.

Comparing standard versus enhanced implementation of an evidence-based HIV prevention program among Bahamian sixth grade students: findings from nationwide implementation trials.

BACKGROUND: Effective implementation strategies are needed to address the challenges encountered by teachers in implementation of evidence-based HV prevention programs in schools. The current study: 1) compares implementation fidelity of Focus on Youth in the Caribbean (FOYC) plus Caribbean Informed Parents and Children Together (CImPACT) intervention using enhanced implementation strategies (including biweekly monitoring/feedback and site-based mentoring) to those using more traditional approach (teacher training only); and 2) evaluates the impact of school coordinators' and mentors' performance on teachers' implementation fidelity and student outcomes. METHODS: Data from an enhanced implementation trial in 2019-2020, involving 24 government primary schools, 79 teachers, and 2252 students, were compared to data from a standard implementation trial in 2011-2012, involving 35 government primary schools, 110 teachers and 2811 students using mixed-effects modeling and structural equation modeling. FINDINGS: Teachers in the 2019-2020 trial taught more core activities (28.3 vs. 16.3, t = 10.80, P < 0.001) and sessions (7.2 vs. 4.4, t = 9.14, P < 0.001) than those participating in the 2011-2012 trial. Teachers taught > 80% of the intervention curriculum in 2019-2020 compared to 50% curriculum delivery in 2011-2012. Teachers who had a "very good" or "excellent" school coordinator in their schools taught more core activities than those who had a "satisfactory" school coordinator (30.4 vs. 29.6 vs. 22.3, F = 18.54, P < 0.001). Teachers who worked in a school which had a "very good" mentor, taught more core activities than those teachers who did not have a mentor or had only a "satisfactory" mentor (30.4 vs. 27.6; t = 2.96; p = 0.004). Teachers' confidence in implementing core activities, comfort level with the curriculum, attitudes towards sex education in schools, and perceived principal support were significantly related to increased self-efficacy, which in turn was related to teachers' implementation fidelity. The degree of implementation was significantly associated with improved student outcomes. IMPLICATIONS/CONCLUSION: An evidence-based HIV prevention intervention can achieve a high degree of implementation when delivered with enhanced implementation strategies and implementation monitoring. Future program implementers should consider the purposeful selection and training of school coordinators and mentors to support low-implementing teachers as a potentially important strategy when attempting to achieve high-quality implementation of school-based interventions.

Implementation of a pharmacist-led transitional pharmaceutical care programme: Process evaluation of Medication Actions to Reduce hospital admissions through a collaboration between Community and Hospital pharmacists (MARCH).

WHAT IS KNOWN AND OBJECTIVE: The recently conducted Medication Actions to Reduce hospital admissions through a collaboration between Community and Hospital pharmacists (MARCH) transitional care programme, which aimed to test the effectiveness of a transitional care programme on the occurrence of ADEs post-discharge, did not show a significant effect. To clarify whether this non-significant effect was due to poor implementation or due to ineffectiveness of the intervention as such, a process evaluation was conducted. The aim of the study was to gain more insight into the implementation fidelity of MARCH. METHODS: A mixed methods design and the modified Conceptual Framework for Implementation Fidelity was used. For evaluation, the implementation fidelity and moderating factors of four key MARCH intervention components (teach-back, the pharmaceutical discharge letter, the post-discharge home-visit and the transitional medication review) were assessed. Quantitative data were collected during and after the intervention. Qualitative data were collected using semi-structured interviews with MARCH healthcare professionals (community pharmacists, clinical pharmacists, pharmacy assistants and pharmaceutical consultants) and analysed using thematic analysis. RESULTS AND DISCUSSION: Not all key intervention components were implemented as intended. Teach-back was not always performed. Moreover, 63% of the pharmaceutical discharge letters, 35% of the post-discharge home-visits and 44% of the transitional medication reviews were not conducted within their planned time frames. Training sessions, structured manuals and protocols with detailed descriptions facilitated implementation. Intervention complexity, time constraints and the multidisciplinary coordination were identified as barriers for the implementation. WHAT IS NEW AND CONCLUSION: Overall, the implementation fidelity was considered to be moderate. Not all key intervention components were carried out as planned. Therefore, the non-significant results of the MARCH programme on ADEs may at least partly be explained by poor implementation of the programme. To successfully implement transitional care programmes, healthcare professionals require full integration of these programmes in the standard work-flow including IT improvements as well as compensation for the time investment.

Facility-based simulation as a programmatic tool for implementing a statewide contraceptive initiative.

BACKGROUND: Assessing implementation fidelity is highly recommended, but successful approaches can be challenging. Family Planning Elevated (FPE) is a statewide contraceptive initiative which partnered with 28 health clinics across Utah. To assess implementation fidelity, we developed in-situ high-fidelity simulation training to both determine clinic adherence to FPE and offer education to implementing teams. This study aimed to develop, pilot, and assess the use of simulation as a tool for measuring implementation fidelity. METHODS: We developed two simulation scenarios to determine implementation fidelity: one scenario wherein a client is seeking a new method of contraception and another in which the same client has returned to discontinue the method. Both simulations contained multiple aspects of program implementation (e.g., determining program eligibility). We then offered simulations to all FPE partner organizations. To assess simulation training as a tool for determining implementation fidelity, we developed strategies aligned with each aspect of an adapted RE-AIM framework, including pre-post surveys, acceptability and self-efficacy testing, a checklist for programmatic adherence, field notes, action planning and analysis of monitoring data. RESULTS: Fifteen clinical sites and 71 team members participated in the in-situ simulations. Assessment of the checklist showed that 90% of the clinics successfully demonstrated key program components, including person-centered counseling techniques such as sitting at the patient's level (95.8%); asking open-ended questions (100%); and explaining how to use the contraceptive method selected (91.7%). More than half of clinics fell short in programmatic areas including: confirmation that the FPE program covered same-day intrauterine device insertion (54.2%), and education on health risks associated with the selected contraceptive method (58.3%). After simulation, participants reported improved knowledge of how FPE works (p = < 0.001), increased ability to identify FPE-eligible clients (p = 0.02) and heightened self-efficacy in helping clients select a method (p = 0.03). Participants were satisfied with the simulations, with most (84.1%) reporting that the simulation exceeded their expectations. CONCLUSIONS: Highly-realistic in-situ family planning simulations are acceptable to participants, positively change knowledge and clinical team confidence, and can identify systems gaps in clinical care and program implementation. Simulation offers a reciprocal way of monitoring implementation fidelity of a family planning access initiative. TRIAL REGISTRATION: This project was determined to be exempt by the IRB of the University of Utah, the larger Family Planning Elevated program under which this pilot study was nested is registered at ClinicalTrials.gov Identifier: NCT03877757 .

Implementation barriers and facilitators to a COVID-19 intervention in Bangladesh: The benefits of engaging the community for the delivery of the programme.

BACKGROUND: BRAC (Bangladesh Rural Advancement Committee), the largest NGO globally, implemented a community-based comprehensive social behavior communication intervention to increase community resilience through prevention, protection, and care for COVID-19. We conducted implementation research to assess fidelity and explore the barriers and facilitators of this intervention implementation. METHODS: We adopted a concurrent mixed-method triangulation design. We interviewed 666 members of 60 Community Corona Protection Committees (CCPCs) and 80 members of 60 Community Support Teams (CSTs) through multi-stage cluster sampling using a structured questionnaire. The qualitative components relied on 54 key informant interviews with BRAC implementers and government providers. RESULTS: The knowledge about wearing mask, keeping social distance, washing hands and COVID-19 symptoms were high (on average more than 70%) among CCPC and CST members. While 422 (63.4%) CCPC members reported they 'always' wear a mask while going out, 69 (86.3%) CST members reported the same practice. Only 247 (37.1%) CCPC members distributed masks, and 229 (34.4%) donated soap to the underprivileged population during the last two weeks preceding the survey. The key facilitators included influential community members in the CCPC, greater acceptability of the front-line health workers, free-of-cost materials, and telemedicine services. The important barriers identified were insufficient training, irregular participation of the CCPC members, favouritism of CCPC members in distributing essential COVID-19 preventive materials, disruption in supply and shortage of the COVID-19 preventative materials, improper use of handwashing station, the non-compliant attitude of the community people, challenges to ensure home quarantine, challenges regarding telemedicine with network interruptions, lack of coordination among stakeholders, the short duration of the project. CONCLUSIONS: Engaging the community in combination with health services through a Government-NGO partnership is a sustainable strategy for implementing the COVID-19 prevention program. Engaging the community should be promoted as an integral component of any public health intervention for sustainability. Engagement structures should incorporate a systems perspective to facilitate the relationships, ensure the quality of the delivery program, and be mindful of the heterogeneity of different community members concerning capacity building. Finally, reaching out to the underprivileged through community engagement is also an effective mechanism to progress through universal health coverage.

Implementation fidelity of a transition program for adolescents with congenital heart disease: the STEPSTONES project.

BACKGROUND: Although transition programs have been evaluated for adolescents with chronic conditions, these have rarely involved process evaluations. Indeed, outcomes of complex interventions are dependent on how the intervention is implemented in practice and evaluations of implementation process are therefore pivotal. The aim of this study was to evaluate the extent to which a transition program for adolescents with congenital heart disease was delivered as intended. Research questions were 1) to what level of fidelity was the program delivered? and 2) what potential moderating factors affected the delivery of the program and overall fidelity? METHODS: A mixed methods design was used, where a process evaluation was embedded in the STEPSTONES randomized controlled trial in Sweden. The implementation fidelity framework by Carrol (2007) and Hasson (2010) was used to design, collect and analyze data. Quantitative data consisted of intervention records on adherence and were analyzed with descriptive statistics. Qualitative data on moderators affecting fidelity were collected through interviews, log-books and focus group interviews with healthcare professionals implementing the intervention and participatory observations of the implementation process. Data were analyzed with deductive content analysis. Triangulation was used to integrate quantitative and qualitative data within the fidelity framework. RESULTS: Six out of eight components of the transition program were delivered to an extent that adhered to the program theory or achieved a high level of fidelity. However, components involving peer support had a low attendance by the participating sample (32.2%), and the joint transfer meeting was challenging to implement, despite achieving high adherence. Moderators affecting the implementation process were the adolescent's and healthcare professional's engagement in the intervention, contextual factors and a lack of standard operating procedures for all components in the program. CONCLUSION: Barriers and facilitators for a future implementation of transition programs have been illuminated in this study. The use of an implementation fidelity framework in the process evaluation proved successful in providing a comprehensive evaluation of factors affecting the implementation process. However, implementation fidelity must be considered in relation to adaptations to the local and personal prerequisites in order to create interventions that can achieve fit.

Objective risk assessment vs standard care for acute coronary syndromes-The Australian GRACE Risk tool Implementation Study (AGRIS): a process evaluation.

BACKGROUND: Structured risk-stratification to guide clinician assessment and engagement with evidence-based therapies may reduce care variance and improve patient outcomes for Acute Coronary Syndrome (ACS). The Australian Grace Risk score Intervention Study (AGRIS) explored the impact of the GRACE Risk Tool for stratification of ischaemic and bleeding risk in ACS. While hospitals in the active arm had a higher overall rate of invasive ACS management, there was neutral impact on important secondary prevention prescriptions/referrals, hospital performance measures, myocardial infarction and 12-month mortality leading to early trial cessation. Given the Grace Risk Tool is under investigation internationally, this process evaluation study provides important insights into the possible contribution of implementation fidelity on the AGRIS study findings. METHODS: Using maximum variation sampling, five hospitals were selected from the 12 centres enrolled in the active arm of AGRIS. From these facilities, 16 local implementation stakeholders (Cardiology advanced practice nurses, junior and senior doctors, study coordinators) consented to a semi-structured interview guided by the Theoretical Domains Framework. Directed Content Analysis of qualitative data was structured using the Capability/Opportunity/Motivation-Behaviour (COM-B) model. RESULTS: Physical capability was enhanced by tool usability. While local stakeholders supported educating frontline clinicians, non-cardiology clinicians struggled with specialist terminology. Physical opportunity was enhanced by the paper-based format but was hampered when busy clinicians viewed risk-stratification as one more thing to do, or when form visibility was neglected. Social opportunity was supported by a culture of research/evidence yet challenged by clinical workflow and rotating medical officers. Automatic motivation was strengthened by positive reinforcement. Reflective motivation revealed the GRACE Risk Tool as supporting but potentially overriding clinical judgment. Divergent professional roles and identity were a major barrier to integration of risk-stratification into routine Emergency Department practice. The cumulative result revealed poor form completion behaviors and a failure to embed risk-stratification into routine patient assessment, communication, documentation, and clinical practice behaviors. CONCLUSIONS: Numerous factors negatively influenced AGRIS implementation fidelity. Given the prominence of risk assessment recommendations in United States, European and Australian guidelines, strategies that strengthen collaboration with Emergency Departments and integrate automated processes for risk-stratification may improve future translation internationally.

Facilitators and barriers when implementing a new clinical visit for fathers at Stockholm County child health centres: A qualitative study of nurse-managers at top-performing centres.

BACKGROUND: In 2017, a new clinical visit for non-birthing parents (e.g. fathers) of three-to-five month old infants was implemented in Stockholm County. In 2018, 19 out of 134 child health centres (CHCs) saw 62% of all fathers at the father visit and these CHCs had the highest fidelity scores. The aim of the current study was to assess nurse-managers' perceptions of facilitators and barriers to implementating the father visit. METHODOLOGY: Semi-structured interviews were conducted with nurse-managers from seven CHCs. Interviews were audio-recorded, transcribed and then analysed using systematic text condensation. Hasson's modified version of the Conceptual Framework for Implementation Fidelity was used to interpret the findings. RESULTS: Six themes emerged during the analysis, which were sorted into perceived facilitators and barriers regarding the implementation of the father visit. Facilitators included: 1) nurses are facilitators of change, 2) fathers are worthy of change, 3) a child has two parents and 4) effective cooperation. The barriers included: 5) money talks and 6) nurses under pressure. CONCLUSION: These findings provide insight into factors that moderated the implementation fidelity of the father visits at CHCs with some of the highest levels of father attendance. This provides a model of good practice that can be applied to other settings to maximise fidelity, as well as increase attendance at father visits. Findings also provide insight into the relationship between potential moderators and implementation fidelity.