Evaluation of the implementation fidelity of comprehensive emergency obstetric and newborn care at University of Gondar comprehensive specialized hospital, Northwest Ethiopia: a mixed-method evaluation.

BACKGROUND: Approximately 15% of births worldwide result in life-threatening complications during pregnancy, delivery, or postpartum. Comprehensive Emergency Management of Obstetric and Newborn Care (CEmONC) is intended as one of the measures for maternal healthcare services to reduce the high burden with regard to childbirth complications. However, its state of implementation fidelity has not been well investigated. Therefore, this study aimed to evaluate the implementation fidelity of CEmONC services at University of Gondar Comprehensive Specialized Hospital, Ethiopia. METHOD: A case-study design with an embedded mixed method was employed. Adherence, quality of delivery, and participant responsiveness dimensions from Carroll's conceptual framework were used in this evaluation. Four hundred four exit interviews, 423 retrospective document reviews and 10 key informants were conducted. Moreover, a binary logistic regression model was fitted. The qualitative data were transcribed, translated, coded, and analysed using a thematic analysis approach. The overall implementation fidelity of the CEmONC was judged based on the pre-seated judgmental criteria. RESULTS: Overall the implementation fidelity of the CEmONC service was 75.5%. Quality of delivery, participant responsiveness and adherence were 72.7%, 76.6% and 77.2% respectively. Signal functions like parenteral antibiotics and removal of retained products were insufficiently performed against the recommended protocols which was also evidenced by the key informant interviews. Healthcare providers' respect for the clients was less. Age ≥ 35 years (AOR = 0.48, 95% CI: 0.24,0.98), educational status of college and above (AOR = 2.61, 95% CI: 1.46,4.66), being government employed (AOR = 1.85, 95% CI: 1.08,3.18), having ANC follow-up (AOR = 5.50, 95% CI: 1.83, 16.47) and grand multigravida (AOR = 2.17, 95% CI: 1.08, 4.38) were factors significantly associated with participant responsiveness towards the services. CONCLUSIONS: The overall implementation fidelity of the CEmONC services was implemented in good fidelity. Moreover, the quality of delivery was judged as implemented in fair fidelity. Parenteral antibiotics and removal of retained products were not found to be sufficiently performed. Respect for the clients was insufficiently delivered. Therefore, it is recommended that parenteral antibiotics drugs be adequately provided and training for healthcare providers regarding compassionate and respectful care shall be facilitated. Moreover, healthcare providers are strongly recommended to adhere to the recommended guidelines.

Teachers' Perceptions of the Impact of the COVID-19 Pandemic and Their Implementation of an Evidence-based HIV Prevention Program in the Bahamas.

Information on how school-based programs is implemented and sustained during crises is limited. In this study, we assessed the impact of the COVID-19 pandemic on the implementation of a HIV prevention intervention in The Bahamas. Data were collected from 139 Grade 6 teachers in 2021-2022. Teachers attended virtual training and received implementation monitoring from coordinators. On average, teachers taught 26.4 (SD = 9.2) of the 35 core activities, and 7.4 (SD = 2.4) out of 9 sessions. More than half (58.3%) of teachers completed 28 or more core activities; 69.1% covered eight or all nine sessions, which is equivalent to 80% of the HIV intervention curriculum. Almost half of the teachers (43%) reported that the pandemic negatively impacted their ability to teach the program; 72% of teachers maintained that the program remained "very important" during times of crisis. Greater self-efficacy and supports increased implementation fidelity.

Fidelity of implementation of national guidelines on malaria diagnosis for children under-five years in Rivers State, Nigeria.

BACKGROUND: Malaria is still a disease of global public health importance and children under-five years of age are the most vulnerable to the disease. Nigeria adopted the "test and treat" strategy in the national malaria guidelines as one of the ways to control malaria transmission. The level of adherence to the guidelines is an important indicator for the success or failure of the country's roadmap to malaria elimination by 2030. This study aimed to assess the fidelity of implementation of the national guidelines on malaria diagnosis for children under-five years and examine its associated moderating factors in health care facilities in Rivers State, Nigeria. METHODS: This was a descriptive, cross-sectional study conducted in Port Harcourt metropolis. Data were collected from 147 public, formal private and informal private health care facilities. The study used a questionnaire developed based on Carroll's Conceptual Framework for Implementation Fidelity. Frequency, mean and median scores for implementation fidelity and its associated factors were calculated. Associations between fidelity and the measured predictors were examined using Mann Whitney U test, Kruskal Wallis test, and multiple linear regression modelling using robust estimation of errors. Regression results are presented in adjusted coefficient (ß) and 95% confidence intervals. RESULTS: The median (IQR) score fidelity score for all participants was 65% (43.3, 85). Informal private facilities (proprietary patent medicine vendors) had the lowest fidelity scores (47%) compared to formal private (69%) and public health facilities (79%). Intervention complexity had a statistically significant inverse relationship to implementation fidelity (ß = - 1.89 [- 3.42, - 0.34]). Increase in participant responsiveness (ß = 8.57 [4.83, 12.32]) and the type of malaria test offered at the facility (e.g., RDT vs. no test, ß = 16.90 [6.78, 27.03]; microscopy vs. no test, ß = 21.88 [13.60, 30.16]) were positively associated with fidelity score. CONCLUSIONS: This study showed that core elements of the "test and treat" strategy, such as testing all suspected cases with approved diagnostic methods before treatment, are still not fully implemented by health facilities. There is a need for strategies to increase fidelity, especially in the informal private health sector, for malaria elimination programme outcomes to be achieved.

Implementing Clinical Guidelines for the Treatment of Psychosis: The Frontline Leaders' Point of View. A Qualitative Study.

Background: Despite the large amount of leadership and implementation theories and recommendations, healthcare services continue to struggle with efficiently incorporating new knowledge. The questioning of conventional leadership approaches in healthcare organizations prompted us to investigate how frontline leaders comprehend their own implementation intentions and actions, and how these intentions and actions may impact the implementation of clinical guidelines in mental healthcare in Norway. Methods: Employing a theory-driven qualitative design, we conducted nine semi-structured interviews with frontline leaders who had recently led implementation of clinical guidelines for the treatment of psychosis in mental health. We employed Systematic Text Condensation, informed by Normalization Process Theory, to structure and analyze the data and used fidelity scales to measure the degree of implementation and distinguish between leaders' levels of success in implementation. Results: Frontline leaders in units that achieved high success in implementation described their intentions and actions differently, from those with less success. The former group's actions aligned more closely with the constructs of the Normalization Process Theory compared to the latter group when describing their actions. Frontline leaders leading units with a high degree of implementation success describe relation-orientation, trust, and providing adaptive space for staff members to take initiative. In contrast, those leading units with less implementation success describe more control and guidance of co-operators and place more emphasize on information and knowledge. Conclusion: Differences in how frontline leaders describe their actions and intentions to achieve clinical guideline implementation suggest that the leadership approach of these frontline leaders is an important factor to consider when planning and conducting implementation. To better understand the implementation process, it is important to pay attention to how frontline leaders customize their leadership approaches to the dynamics of complex organizations, and how they interact with their team and superiors.

A Longitudinal Analysis of Trajectories and Predictors of Fidelity Using the SafeCare Parenting Model.

Evidence-based practice (EBP) fidelity, understood as the extent to which a program is implemented as the developers intended, is a key implementation variable which likely relates to consumer outcomes. However, studies that track fidelity longitudinally and at large scale are uncommon, and finding reliable predictors of fidelity has proven to be a complex challenge. Further, attitudes toward EBP are a potentially important predictor of fidelity, but results across the literature have been mixed. The purpose of the present study is to use data from the ongoing implementation and dissemination of the SafeCare model to better understand (1) the characteristics of SafeCare implementation fidelity trajectories, and (2) whether individual level factors predict differences in fidelity and fidelity trajectories, especially provider attitudes toward EBP. The analyses reported here include 14,778 observed fidelity sessions by 868 providers in 172 agencies. We use multilevel modeling to examine fidelity, fidelity trajectories over time, and several potential individual-level predictors of fidelity, including demographics, work history, and attitudes toward EBP. We found: (1) that SafeCare fidelity begins high at baseline (93.85% on average); (2) that SafeCare fidelity displays a statistically significant trend of positive linear growth, even among those with less positive attitudes; and (3) that positive attitudes are associated with slightly higher fidelity on average and at baseline, while negative attitudes are associated with slightly lower fidelity on average and at baseline. To our knowledge, this is the largest longitudinal analysis of EBP fidelity in a child welfare program to date, and our findings support the notion that intensive coaching supports which are titrated over time can be sufficient to ensure sustained high fidelity, at least in some cases. Further, these findings indicate that robust training and coaching processes can ensure high fidelity and fidelity growth even among providers with less positive attitudes toward EBP.

Assessing the fidelity of a behavioural intervention involving academic detailing in general practice: a sub-study of the 'Implementing work-related Mental health guidelines in general PRacticE' (IMPRovE) trial.

BACKGROUND: Assessing the fidelity of intervention components enables researchers to make informed judgements about the influence of those components on the observed outcome. The 'Implementing work-related Mental health guidelines in general PRacticE' (IMPRovE) trial is a hybrid III trial aiming to increase adherence to the 'Clinical Guidelines for the diagnosis and management of work-related mental health conditions in general practice'. IMPRovE is a multifaceted intervention, with one of the central components being academic detailing (AD). This study describes the fidelity to the protocol for the AD component of the IMPRovE intervention. METHOD: All AD sessions for the trial were audio-recorded and a sample of 22% were randomly selected for fidelity assessment. Fidelity was assessed using a tailored proforma based on the Modified Conceptual Framework for fidelity assessment, measuring duration, coverage, frequency and content. A descriptive analysis was used to quantify fidelity to the protocol and a content analysis was used to elucidate qualitative aspects of fidelity. RESULTS: A total of eight AD sessions were included in the fidelity assessment. The average fidelity score was 89.2%, ranging from 80 to 100% across the eight sessions. The sessions were on average 47 min long and addressed all of the ten chapters in the guideline. Of the guideline chapters, 9 were frequently discussed. The least frequently discussed chapter related to management of comorbid conditions. Most general practitioner (GP) participants used the AD sessions to discuss challenges with managing secondary mental conditions. In line with the protocol, opinion leaders who delivered the AD sessions largely offered evidence-based strategies aligning with the clinical guideline recommendations. CONCLUSIONS/IMPLICATIONS: The IMPRovE AD intervention component was delivered to high fidelity. The sessions adhered to the intended duration, coverage, frequency, and content allowing participating GPs to comprehend the implementation of the guideline in their own practice. This study also demonstrates that the Modified Conceptual Fidelity Framework with a mixed methods approach can support the assessment of implementation fidelity of a behavioural intervention in general practice. The findings enhance the trustworthiness of reported outcomes from IMPRovE and show that assessing fidelity is amenable for AD and should be incorporated in other studies using AD. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry ACTRN 12620001163998, November 2020.

Assessing implementation fidelity of an on-site pharmacist intervention within Australian residential aged care facilities: A mixed methods study.

BACKGROUND: An on-site pharmacist (OSP) intervention was implemented which sought to improve medication management within residential aged care facilities (RACFs) in the Australian Capital Territory, Australia. The objectives of this mixed methods study were to evaluate the implementation fidelity of the OSP intervention and to determine the moderating factors which influenced delivery of this intervention. METHODS: This convergent parallel mixed methods study was underpinned by Hasson's conceptual framework for implementation fidelity. Implementation fidelity for seven intervention RACFs was quantitatively assessed using three quantitative data sets: (1) range of OSP intervention activities delivered; (2) random sample of 10% of medication reviews assessed for quality; (3) proportion of residents who received at least one medication review. Semi-structured interviews (n = 14) with managers and OSPs across the intervention RACFs were conducted to identify moderating factors which may have influenced OSP intervention delivery. RESULTS: The OSP intervention was generally delivered as intended with overall medium levels of implementation fidelity. This delivery was supported by a range of facilitation strategies with most participants perceiving that the intervention was delivered to a high standard. RACF managers and OSPs were mostly well engaged and responsive. A number of potential barriers (including the part-time OSP role, COVID-19 pandemic, RACFs spread out over a large area with significant distance between resident dwellings) and facilitators (including the pharmacist support meetings, OSPs who took time to establish relationships, RACF managers who actively supported OSPs and worked with them) for OSP intervention delivery were identified which have potential implications for the roll out of OSPs within Australian RACFs. CONCLUSION: In this study, the implementation fidelity of OSP intervention delivery was assessed with overall medium levels of fidelity found across the intervention RACFs. This suggested that the OSP intervention can generally be delivered as intended in real world RACFs. OSP intervention delivery was influenced by a range of moderating factors, some of which posed barriers and others which facilitated the OSP intervention being delivered as intended.

Development and pilot testing a communication simulation training for interpreters to improve pain communication between primary care providers and patients with limited English proficiency.

Context: Health disparities in patients with limited English proficiency are worsened due to scarcity of interpreter-focused communication interventions and trainings. Objectives: To develop a high-fidelity simulation training for interpreters to use a novel pain communication tool, i.e., Pain Assessment Information Visualization (InfoViz) Tool, and evaluate interpreters' implementation fidelity during a pilot study. Methods: This research methodology study involved training interpreters through high-fidelity simulations and assessing the implementation fidelity of 20 patient-provider visits in primary care clinics. Descriptive statistics were calculated for the assessment and fidelity. Debriefing interviews were conducted after the training and at the study completion. These were transcribed and analyzed using thematic analysis. Results: Four interpreters completed training, requesting an average of 2.5 practice simulation studies prior to assessment (M = 54 min, score: M = 95%). Interviews revealed two themes: positive experiences and suggestions for improvement. Interpreters averaged 83% for implementation fidelity for the 20 visits. Post-study interviews revealed positive experiences and the need for refresher training. Conclusion: The communication simulation training for interpreters is feasible, acceptable, and can ensure accurate use of the Pain InfoViz Tool during provider-patient communication. Innovation: We applied a InfoViz Tool in pain simulations and extended high-fidelity training to medical interpreting.

Effects of Teacher Training and Continued Support on the Delivery of an Evidence-Based HIV Prevention Program: Findings From a National Implementation Study in the Bahamas.

BACKGROUND: Few studies have investigated the effects of teacher training and continued support on teachers' delivery of evidence-based HIV prevention programs. We examined these factors in a national implementation study of an evidence-based HIV risk reduction intervention for adolescents in the sixth grade in the Bahamas. METHODS: Data were collected from 126 grade 6 teachers and 3,118 students in 58 government elementary schools in the Bahamas in 2019-2021. This is a Hybrid Type III implementation study guided by the Exploration, Preparation, Implementation, Sustainment (EPIS) model. Teachers attended 2-day training workshops. Trained school coordinators and peer mentors provided biweekly monitoring and mentorship. We used mixed-effects models to assess the effects of teacher training and continued support on implementation fidelity. RESULTS: Teachers who received training in-person or both in-person and online taught the most core activities (27.0 and 27.2 of 35), versus only online training (21.9) and no training (14.9) (F = 15.27, p < .001). Teachers with an "excellent" or "very good" school coordinator taught more core activities than those with a "satisfactory" coordinator or no coordinator (29.2 vs. 27.8 vs. 19.3 vs. 14.8, F = 29.20, p < .001). Teachers with a "very good" mentor taught more core activities and sessions than those with a "satisfactory" mentor or no mentor (30.4 vs. 25.0 vs. 23.1; F = 7.20; p < .01). Teacher training, implementation monitoring, peer mentoring, teachers' self-efficacy, and school-level support were associated with implementation fidelity, which in turn was associated with improved student outcomes (HIV/AIDS knowledge, preventive reproductive health skills, self-efficacy, and intention to use protection). CONCLUSION: Teachers receiving in-person training and those having higher-rated school coordinator and mentor support taught a larger number of HIV prevention core activities. Effective teacher training, implementation monitoring, and peer mentoring are critical for improving implementation fidelity and student outcomes.

The relative value of Pre-Implementation stages for successful implementation of evidence-informed programs.

BACKGROUND: Most implementations fail before the corresponding services are ever delivered. Measuring implementation process fidelity may reveal when and why these attempts fail. This knowledge is necessary to support the achievement of positive implementation milestones, such as delivering services to clients (program start-up) and competency in treatment delivery. The present study evaluates the extent to which implementation process fidelity at different implementation stages predicts achievement of those milestones. METHODS: Implementation process fidelity data-as measured by the Stages of Implementation Completion (SIC)-from 1287 implementing sites across 27 evidence-informed programs were examined in mixed effects regression models with sites nested within programs. Implementation process fidelity, as measured by the proportion of implementation activities completed during the three stages of the SIC Pre-Implementation phase and overall Pre-Implementation (Phase 1) and Implementation (Phase 2) proportion scores, was assessed as a predictor of sites achieving program start-up (i.e., delivering services) and competency in program delivery. RESULTS: The predicted probability of start-up across all sites was low at 35% (95% CI [33%, 38%]). When considering the evidence-informed program being implemented, that probability was nearly twice as high (64%; 95% CI [42%, 82%]), and 57% of the total variance in program start-up was attributable to the program. Implementation process fidelity was positively and significantly associated with achievement of program start-up and competency. The magnitude of this relationship varied significantly across programs for Pre-Implementation Stage 1 (i.e., Engagement) only. Compared to other stages, completing more Pre-Implementation Stage 3 (Readiness Planning) activities resulted in the most rapid gains in probability of achieving program start-up. The predicted probability of achieving competency was very low unless sites had high scores in both Pre-Implementation and Implementation phases. CONCLUSIONS: Strong implementation process fidelity-as measured by SIC Pre-Implementation and Implementation phase proportion scores-was associated with sites' achievement of program start-up and competency in program delivery, with early implementation process fidelity being especially potent. These findings highlight the importance of a rigorous Pre-Implementation process.

Fidelity, Feasibility and Adaptation of a Family Planning Intervention for Young Women in Zimbabwe: Provider Perspectives and Experiences.

The CHIEDZA (Community-based Interventions to improve HIV outcomes in youth: a cluster randomised trial in Zimbabwe) trial evaluated an integrated package of HIV and sexual and reproductive health services for young people aged 16-24 years in Zimbabwe. The family planning component aimed to improve access to information, services, and contraceptives delivered by trained youth-friendly providers within a community-based setting for young women. Responsively adapting the intervention was a part of the intervention design's rationale. We investigated the factors influencing implementation fidelity, quality, and feasibility using provider experiences and perspectives. We conducted provider interviews (N = 42), non-participant (N = 18), and participant observation (N = 30) of intervention activities. The data was analyzed thematically. CHIEDZA providers were receptive to providing the family planning intervention, but contexts outside of the intervention created challenges to the intervention's fidelity. Strategic adaptations were required to ensure service quality within a youth-friendly context. These adaptations strengthened service delivery but also resulted in longer wait times, more frequent visits, and variability of Long-Acting Reversible contraceptives (LARCS) provision which depended on target-driven programming by partner organization. This study was a practical example of how tracking adaptations is vital within process evaluation methods in implementation science. Anticipating that changes will occur is a necessary pre-condition of strong evaluations and tracking adaptations ensures that lessons on feasibility of design, contextual factors, and health system factors are responded to during implementation and can improve quality. Some contextual factors are unpredictable, and implementation should be viewed as a dynamic process where responsive adaptations are necessary, and fidelity is not static. Trial registration ClinicalTrials.gov Identifier: NCT03719521. Supplementary Information: The online version contains supplementary material available at 10.1007/s43477-023-00075-6.

Process evaluation of a kindergarten-based intervention for obesity prevention in early childhood: the Toybox study Malaysia.

BACKGROUND: Toybox is a kindergarten-based intervention program that targets sedentary behavior, snacking and drinking habits, as well as promoting physical activity in an effort to improve healthy energy balance-related behaviors among children attending kindergartens in Malaysia. The pilot of this program was conducted as a randomized controlled trial (RCT) involving 837 children from 22 intervention kindergartens and 26 control kindergartens respectively. This paper outlines the process evaluation of this intervention. METHODS: We assessed five process indicators: recruitment, retention, dosage, fidelity, and satisfaction for the Toybox program. Data collection was conducted via teachers' monthly logbooks, post-intervention feedback through questionnaires, and focus group discussions (FGD) with teachers, parents, and children. Data were analyzed using quantitative and qualitative data analysis methods. RESULTS: A total of 1072 children were invited. Out of the 1001 children whose parents consented to join, only 837 completed the program (Retention rate: 88.4%). As high as 91% of the 44 teachers and their assistants engaged positively in one or more of the process evaluation data collection methods. In terms of dosage and fidelity, 76% of parents had received newsletters, tip cards, and posters at the appropriate times. All teachers and their assistants felt satisfied with the intervention program. However, they also mentioned some barriers to its implementation, including the lack of suitable indoor environments to conduct activities and the need to make kangaroo stories more interesting to captivate the children's attention. As for parents, 88% of them were satisfied with the family-based activities and enjoyed them. They also felt that the materials provided were easy to understand and managed to improve their knowledge. Lastly, the children showed positive behaviors in consuming more water, fruits, and vegetables. CONCLUSIONS: The Toybox program was deemed acceptable and feasible to implement by the parents and teachers. However, several factors need to be improved before it can be expanded and embedded as a routine practice across Malaysia.

Implementation fidelity of infection prevention practices at Debre Tabor comprehensive specialized hospital, Northwest Ethiopia.

BACKGROUND: Healthcare-Acquired Infections are a major problem in the world and within the healthcare delivery system. An estimated 5-10% and around 25% of hospitalized patients have healthcare-acquired infections in developed and developing countries, respectively. Infection prevention and control programs have proven to be successful in lowering the incidence and spread of infections. Thus, this evaluation aims to evaluate the implementation fidelity of infection prevention practices at Debre Tabor comprehensive specialized hospital in Northwest Ethiopia. METHODS: A facility-based cross-sectional design with a concurrent mixed method was used to evaluate the implementation fidelity of infection prevention practices. A total of 36 indicators were used to measure adherence, participant responsiveness, and facilitation strategy dimensions. A total of 423 clients were administered for an interview, an inventory checklist, a document review, 35 non-participatory observations, and 11 key informant interviews were conducted. A multivariable logistic regression analysis was used to identify factors significantly associated with the satisfaction of clients. The findings were presented using descriptions, tables, and graphs. RESULT: The overall implementation fidelity of the infection prevention practices was 61.8%. The dimensions of adherence to infection prevention and control guidelines were 71.4%, participant responsiveness was 60.6%, and facilitation strategy was 48%. In multivariable analysis, ward admission and educational level had a p-value of below 0.05 and were significantly associated with the satisfaction of clients with infection prevention practices at the hospital. The major themes that emerged in qualitative data analysis were healthcare worker-related factors, management-related factors, and patient- and visitor-related factors. CONCLUSION: The evaluation result of this study concluded that the overall implementation fidelity of infection prevention practice was judged to be medium and needed improvement. It included dimensions of adherence and participant responsiveness that were rated as medium, as well as a facilitation strategy that was rated as low. Enablers and barriers were thematized into factors related to healthcare providers, management, institutions, and patient and visitor relations.

Fidelity to the ACT SMART Toolkit: an instrumental case study of implementation strategy fidelity.

BACKGROUND: Evidence-based practices (EBPs) are shown to improve a variety of outcomes for autistic children. However, EBPs often are mis-implemented or not implemented in community-based settings where many autistic children receive usual care services. A blended implementation process and capacity-building implementation strategy, developed to facilitate the adoption and implementation of EBPs for autism spectrum disorder (ASD) in community-based settings, is the Autism Community Toolkit: Systems to Measure and Adopt Research-based Treatments (ACT SMART Toolkit). Based on an adapted Exploration, Adoption decision, Preparation, Implementation, Sustainment (EPIS) Framework, the multi-phased ACT SMART Toolkit is comprised of (a) implementation facilitation, (b) agency-based implementation teams, and (c) a web-based interface. In this instrumental case study, we developed and utilized a method to evaluate fidelity to the ACT SMART Toolkit. This study responds to the need for implementation strategy fidelity evaluation methods and may provide evidence supporting the use of the ACT SMART Toolkit. METHODS: We used an instrumental case study approach to assess fidelity to the ACT SMART Toolkit during its pilot study with six ASD community agencies located in southern California. We assessed adherence, dose, and implementation team responsiveness for each phase and activity of the toolkit at both an aggregate and individual agency level. RESULTS: Overall, we found that adherence, dose, and implementation team responsiveness to the ACT SMART Toolkit were high, with some variability by EPIS phase and specific activity as well as by ASD community agency. At the aggregate level, adherence and dose were rated notably lowest during the preparation phase of the toolkit, which is a more activity-intensive phase of the toolkit. CONCLUSIONS: This evaluation of fidelity to the ACT SMART Toolkit, utilizing an instrumental case study design, demonstrated the potential for the strategy to be used with fidelity in ASD community-based agencies. Findings related to the variability of implementation strategy fidelity in the present study may also inform future adaptations to the toolkit and point to broader trends of how implementation strategy fidelity may vary by content and context.

Implementation fidelity to HIV assisted partner services (aPS) during scale-up in western Kenya: a convergent mixed methods study.

BACKGROUND: HIV assisted partner services (aPS) is an intervention to improve HIV status awareness among sex and drug-injecting partners of people newly diagnosed with HIV (index clients). Implementation fidelity-the degree to which an intervention is conducted as intended - is critical to effectiveness, but there are limited data about aPS fidelity when delivered by HIV testing service (HTS) providers. We explored factors affecting implementation fidelity to aPS in two high-HIV prevalence counties in western Kenya. METHODS: We used convergent mixed methods adapting the conceptual framework for implementation fidelity within the aPS scale-up project. This was an implementation study examining scale-up of APS within HTS programs in Kisumu and Homa Bay counties that recruited male sex partners (MSPs) of female index clients. We defined implementation fidelity as the extent to which HTS providers followed the protocol for phone and in-person participant tracing at six expected tracing attempts. Quantitative data were collected from tracing reports in 31 facilities between November 2018 and December 2020, and in-depth interviews (IDIs) were conducted with HTS providers. Descriptive statistics were used to describe tracing attempts. IDIs were analyzed using thematic content analysis. RESULTS: Overall, 3017 MSPs were mentioned of whom 98% (2969/3017) were traced, with most tracing attempts being successful (2831/2969, 95%). Fourteen HTS providers participated in the IDIs-mostly females (10/14, 71%) with a median age of 35 years (range 25-52), who all had post-secondary education (14/14, 100%). The proportion of tracing attempts occurring by phone ranged from 47 to 66%, with the highest proportion occurring on the first attempt and lowest on the sixth attempt. Contextual factors either enhanced or impeded implementation fidelity to aPS. Positive provider attitudes towards aPS and conducive work environment factors promoted implementation fidelity, while negative MSP responses and challenging tracing conditions impeded it. CONCLUSION: Interactions at the individual (provider), interpersonal (client-provider), and health systems (facility) levels affected implementation fidelity to aPS. As policymakers prioritize strategies to reduce new HIV infections, our findings highlight the importance of conducting fidelity assessments to better anticipate and mitigate the impact of contextual factors during the scale-up of interventions.

Assessing the Fidelity of an Affirmative Cognitive Behavioral Group Intervention.

Purpose: Support implementation fidelity in intervention research with lesbian, gay, bisexual, transgender, queer, and sexual and gender diverse (LGBTQ+) populations, this study explores the systematic development of a fidelity process for AFFIRM, an evidence-based, affirmative cognitive behavioral therapy group intervention for LGBTQ+ youth and adults. Method: As part of a clinical trial, the AFFIRM fidelity checklist was designed to assess clinician adherence. A total of 151 audio-recorded group sessions were coded by four trained raters. Results: Adherence was high with a mean fidelity score of 84.13 (SD = 12.50). Inter-rater reliability was 81%, suggesting substantial agreement. Qualitative thematic analysis of low-rated sessions identified deviations from the manual and difficulties in group facilitation, while high-rated sessions specified affirmative and effective clinical responses. Discussion: Findings were integrated into clinical training and coaching. The fidelity process provides insights into the challenges of implementing social work interventions effectively with LGBTQ+ populations in community settings.

Implementation fidelity to a behavioral diabetes prevention intervention in two New York City safety net primary care practices.

BACKGROUND: It is critical to assess implementation fidelity of evidence-based interventions and factors moderating fidelity, to understand the reasons for their success or failure. However, fidelity and fidelity moderators are seldom systematically reported. The study objective was to conduct a concurrent implementation fidelity evaluation and examine fidelity moderators of CHORD (Community Health Outreach to Reduce Diabetes), a pragmatic, cluster-randomized, controlled trial to test the impact of a Community Health Workers (CHW)-led health coaching intervention to prevent incident type 2 Diabetes Mellitus in New York (NY). METHODS: We applied the Conceptual Framework for Implementation Fidelity to assess implementation fidelity and factors moderating it across the four core intervention components: patient goal setting, education topic coaching, primary care (PC) visits, and referrals to address social determinants of health (SDH), using descriptive statistics and regression models. PC patients with prediabetes receiving care from safety-net patient-centered medical homes (PCMHs) at either, VA NY Harbor or at Bellevue Hospital (BH) were eligible to be randomized into the CHW-led CHORD intervention or usual care. Among 559 patients randomized and enrolled in the intervention group, 79.4% completed the intake survey and were included in the analytic sample for fidelity assessment. Fidelity was measured as coverage, content adherence and frequency of each core component, and the moderators assessed were implementation site and patient activation measure. RESULTS: Content adherence was high for three components with nearly 80.0% of patients setting ≥ 1 goal, having ≥ 1 PC visit and receiving ≥ 1 education session. Only 45.0% patients received ≥ 1 SDH referral. After adjusting for patient gender, language, race, ethnicity, and age, the implementation site moderated adherence to goal setting (77.4% BH vs. 87.7% VA), educational coaching (78.9% BH vs. 88.3% VA), number of successful CHW-patient encounters (6 BH vs 4 VA) and percent of patients receiving all four components (41.1% BH vs. 25.7% VA). CONCLUSIONS: The fidelity to the four CHORD intervention components differed between the two implementation sites, demonstrating the challenges in implementing complex evidence-based interventions in different settings. Our findings underscore the importance of measuring implementation fidelity in contextualizing the outcomes of randomized trials of complex multi-site behavioral interventions. TRIAL REGISTRATION: The trial was registered with ClinicalTrials.gov on 30/12/2016 and the registration number is NCT03006666 .

Exploring the Association between Individual-Level Attributes and Fidelity to a Vocational Rehabilitation Intervention within a Randomised Controlled Trial.

Understanding what attributes or characteristics of those delivering interventions affect intervention fidelity and patient outcomes is important for contextualising intervention effectiveness. It may also inform implementation of interventions in future research and clinical practice. This study aimed to explore the relationships between attributes of Occupational Therapists (OTs), their faithful delivery of an early stroke specialist vocational rehabilitation intervention (ESSVR), and stroke survivor return-to-work (RTW) outcomes. Thirty-nine OTs were surveyed about their experience and knowledge of stroke and vocational rehabilitation and were trained to deliver ESSVR. ESSVR was delivered across 16 sites in England and Wales between February 2018 and November 2021. OTs received monthly mentoring to support ESSVR delivery. The amount of mentoring each OT received was recorded in OT mentoring records. Fidelity was assessed using an intervention component checklist completed using retrospective case review of one randomly selected participant per OT. Linear and logistic regression analyses explored relationships between OT attributes, fidelity, and stroke survivor RTW outcome. Fidelity scores ranged from 30.8 to 100% (Mean: 78.8%, SD: 19.2%). Only OT engagement in mentoring was significantly associated with fidelity (b = 0.29, 95% CI = 0.05-0.53, p < 0.05). Increased fidelity (OR = 1.06, 95% CI = 1.01-1.1, p = 0.01) and increasing years of stroke rehabilitation experience (OR = 1.17, 95% CI = 1.02-1.35) was significantly associated with positive stroke survivor RTW outcomes. Findings of this study suggest that mentoring OTs may increase fidelity of delivery of ESSVR, which may also be associated with positive stroke survivor return-to-work outcomes. The results also suggest that OTs with more experience of stroke rehabilitation may be able to support stroke survivors to RTW more effectively. Upskilling OTs to deliver complex interventions, such as ESSVR, in clinical trials may require mentoring support in addition to training to ensure fidelity.

Evaluating the implementation fidelity to a successful nurse-led model (INTERCARE) which reduced nursing home unplanned hospitalisations.

BACKGROUND: Implementation fidelity assesses the degree to which an intervention is delivered as it should be. Fidelity helps to determine if the outcome(s) of an intervention are attributed to the intervention itself or to a failure of its implementation. Little is known about how fidelity impacts the intended outcome(s) and what elements or moderators can affect the fidelity trajectory over time. We exemplify the meaning of implementation fidelity with INTERCARE, a nurse-led care model that was implemented in eleven Swiss nursing homes (NHs) and showed effectiveness in reducing unplanned hospital transfers. INTERCARE comprises six core elements, including advance care planning and tools to support inter- and interprofessional communication, which were introduced with carefully developed implementation strategies. METHODS: A mixed-methods convergent/triangulation design was used to investigate the influence of implementation fidelity on unplanned transfers. A fidelity questionnaire measuring the degree of fidelity to INTERCARE's core components was fielded at four time points in the participating NHs. Two-monthly meetings were conducted with NHs (September 2018-January 2020) and structured notes were used to determine moderators affecting fidelity (e.g., participant responsiveness). We used the fidelity scores and generalized linear mixed models to analyze the quantitative data. The Framework method was used for the qualitative analysis. The quantitative and qualitative findings were integrated using triangulation. RESULTS: A higher overall fidelity score showed a decreasing rate of unplanned hospital transfers post-intervention (OR: 0.65 (CI = 0.43-0.99), p = 0.047). A higher fidelity score to advance care planning was associated with lower unplanned transfers (OR = 0.24 (CI 0.13-0.44), p = < 0.001) and a lower fidelity score for communication tools (e.g., ISBAR) to higher rates in unplanned transfers (OR = 1.69 (CI 1.30-2.19), p = < 0.003). In-house physicians with a collaborative approach and staff's perceived need for nurses working in extended roles, were important moderators to achieve and sustain high fidelity. CONCLUSION: Implementation fidelity is challenging to measure and report, especially in complex interventions, yet is crucial to better understand how such interventions may be tailored for scale-up. This study provides both a detailed description of how fidelity can be measured and which ingredients highly contributed to reducing unplanned NH transfers. TRIAL REGISTRATION: The INTERCARE study was registered at clinicaltrials.gov Protocol Record NCT03590470.