Lessons from polio eradication: a synthesis of implementation strategies for global health services delivery from a scoping review.

Introduction: There is limited guidance on strategies for delivering complex global health programs. We synthesized available evidence on implementation strategies and outcomes utilized in the global polio eradication initiative (GPEI) across low and middle-income country (LMIC) settings. Methods: We nested our scoping review into a literature review conducted as part of a parent study, STRIPE. This review systematically searched PubMed for articles between 1 January 1988 and 25 April 2018 using polio search terms. Strategies from included studies were organized according to the Expert Recommendations for Implementing Change (ERIC) framework, specified using Proctor's framework, and linked to various outcomes (implementation, services delivery, impact). Results: 152 unique articles fulfilled our inclusion criteria (from 1,885 articles included in the parent study). Only 43 out of the 152 articles described a suitable quantitative study design for evaluating outcomes. We extracted 66 outcomes from the 43 unique studies. Study publication dates ranged from 1989 to 2018 and represented diverse country settings. The most common implementation strategies were developing mechanisms for feedback, monitoring, and evaluation (n = 69); increasing awareness among the population (n = 58); involving stakeholders, workers, and consumers in the implementation efforts (n = 46); conducting workshops (n = 33); using mass media (n = 31); and building robust record systems to capture outcomes (n = 31). Coverage (n = 13) and morbidity (n = 12) were the most frequently identified outcomes, followed by effectiveness (n = 9) and fidelity (n = 6). Feasibility and sustainability were rarely evaluated. Conclusions: This review provides a catalogue of implementation strategies and outcomes relevant for advancing global health services delivery in LMICs drawing from the GPEI. Implementation strategies reviewed were poorly described and not adequately linked to outcomes. It calls for additional implementation research to unravel the mechanisms of implementation strategies and their effectiveness, and adaptation of the ERIC framework in LMICs.

Implementation outcomes from a multi-site stepped wedge cluster randomized family caregiver skills training trial.

OBJECTIVE: To assess whether a team collaboration strategy (CONNECT) improves implementation outcomes of a family caregiver skills training program (iHI-FIVES). DATA SOURCES AND STUDY SETTING: iHI-FIVES was delivered to caregivers at eight Veterans Affairs (VA) medical centers. Data sources were electronic health records, staff surveys, and interviews. STUDY DESIGN: In a stepped wedge cluster randomized trial, sites were randomized to a 6-month time interval start date for iHI-FIVES launch. Sites were then randomized 1:1 to either (i) CONNECT, a team collaboration training strategy plus Replicating Effective Programs (REP), brief technical support training for staff, or (ii) REP only (non-CONNECT arm). Implementation outcomes included reach (proportion of eligible caregivers enrolled) and fidelity (proportion of expected trainings delivered). Staff interviews and surveys assessed team function including communication, implementation experience, and their relation to CONNECT and iHI-FIVES implementation outcomes. DATA COLLECTION/EXTRACTION METHODS: The sample for assessing implementation outcomes included 571 Veterans referred to VA home- and community-based services and their family caregivers eligible for iHI-FIVES. Prior to iHI-FIVES launch, staff completed 65 surveys and 62 interviews. After the start of iHI-FIVES, staff completed 52 surveys and 38 interviews. Mixed methods evaluated reach and fidelity by arm. PRINCIPAL FINDINGS: Fidelity was high overall with 88% of expected iHI-FIVES trainings delivered, and higher among REP only (non-CONNECT) compared with CONNECT sites (95% vs. 80%). Reach was 18% (average proportion of reach across eight sites) and higher among non-CONNECT compared with CONNECT sites (22% vs. 14%). Qualitative interviews revealed strong leadership support at high-reach sites. CONNECT did not influence self-reported team function. CONCLUSIONS: A team collaboration strategy (CONNECT), added to REP, required more resources to implement iHI-FIVES than REP only and did not substantially enhance reach or fidelity. Leadership support was a key condition of implementation success and may be an important factor for improving iHI-FIVES reach with national expansion.

Implementation strategies and outcomes in the delivery of HIV test services (HTS) in community pharmacies in Nigeria.

BACKGROUND: Studies have shown that training interventions fail when proper strategies are not in place for their implementation. The study described the implementation strategies used in the delivery of the HIV test services (HTS) and measured implementation outcomes in the delivery of the services. METHODS: The study was conducted between August and November 2019 among 50 selected community pharmacies in Oyo State, Nigeria using a mixed-method quantitative and qualitative data survey design. The implementation strategies and activities used in the delivery of HTS in the pharmacies and during outreaches were described while both observational and survey methods were used to collect data. Implementation outcomes were measured and analysed in terms of penetration, adoption, acceptability, feasibility, fidelity, and appropriateness of the intervention. RESULTS: Penetration among respondents was 90%. Acceptability of the HTS was high (77.3%) among clients 20-49 years of age with 919 clients participating in the HIV screening. While 919 HIV tests were conducted, only 19 (2.1%) were positive. Adherence to the protocol of delivery of HTS (fidelity) indicated that all the respondents conducted rapid HIV testing, pre-testing counselling (43, 95.6%), post-testing counselling (40, 88.9%), and provision of confidential test results (39, 86.7%). Respondents' responsiveness indicated that 23 (51.1%%) of the respondents could use up to 80% and above of the test strips given within the period. Researchers' observations showed respondents' ability to perform the tests as intended with little challenges. Participants felt that rendering the services was an interesting experience, and fulfilling, and allowed them to improve on their professional deliverables and practice. It also showcased the relevance of pharmacists in rendering HTS, creating awareness of the menace of HIV/AIDS, and helping people to stop the spread. CONCLUSION: The study showed that HTS is acceptable, appropriate, feasible, and easy to adopt in community pharmacies and penetration was high. For sustainability, community pharmacists should be well remunerated, and need for an established policy to include this scope in community pharmacy practice.

How the experiences of implementation support recipients contribute to implementation outcomes.

Introduction: There is a growing body of literature on the activities and competencies of implementation support practitioners (ISPs) and the outcomes of engaging ISPs to support implementation efforts. However, there remains limited knowledge about the experiences of implementation support recipients who engage with ISPs and how these experiences shape the trajectory of implementation and contribute to implementation outcomes. This study aimed to extend the research on ISPs by describing the experiences of professionals who received implementation support and inform our understanding of the mechanisms by which ISPs produce behavior change and contribute to implementation outcomes. Methods: Thirteen individuals with roles in supporting implementation efforts at a private foundation participated in semi-structured interviews. Data were analyzed using qualitative narrative analysis and episode profile analysis approaches. Iterative diagramming was used to visualize the pathway of experiences of implementation support recipients evidenced by the interview data. Results: The majority of recipients described how positive experiences and trusting relationships with ISPs increased acceptance of implementation science throughout the foundation and increased the perception of implementation science as both an appropriate and feasible approach for strengthening the impact of foundation strategies. As perceptions of appropriateness and feasibility increased, recipients of implementation support described increasing knowledge and application of implementation science in their funding engagements and internal foundation strategies. Finally, recipients reported that the application of implementation science across the foundation led to sustained implementation capacity and better outcomes. Discussion: The experiences of implementation support recipients described in this paper provide a source for further understanding the mechanisms of change for delivering effective implementation support leading to better implementation quality. Insights from these experiences can enhance our understanding for building implementation capacity and the rationales for evolving approaches that emphasize the dynamic, emotional, and highly relational nature of supporting others to use evidence in practice.

Teamwork and implementation of innovations in healthcare and human service settings: a systematic review.

BACKGROUND: Implementation of new practices in team-based settings requires teams to work together to respond to new demands and changing expectations. However, team constructs and team-based implementation approaches have received little attention in the implementation science literature. This systematic review summarizes empirical research examining associations between teamwork and implementation outcomes when evidence-based practices and other innovations are implemented in healthcare and human service settings. METHODS: We searched MEDLINE, CINAHL, APA PsycINFO and ERIC for peer-reviewed empirical articles published from January 2000 to March 2022. Additional articles were identified by searches of reference lists and a cited reference search for included articles (completed in February 2023). We selected studies using quantitative, qualitative, or mixed methods to examine associations between team constructs and implementation outcomes in healthcare and human service settings. We used the Mixed Methods Appraisal Tool to assess methodological quality/risk of bias and conducted a narrative synthesis of included studies. GRADE and GRADE-CERQual were used to assess the strength of the body of evidence. RESULTS: Searches identified 10,489 results. After review, 58 articles representing 55 studies were included. Relevant studies increased over time; 71% of articles were published after 2016. We were unable to generate estimates of effects for any quantitative associations because of very limited overlap in the reported associations between team variables and implementation outcomes. Qualitative findings with high confidence were: 1) Staffing shortages and turnover hinder implementation; 2) Adaptive team functioning (i.e., positive affective states, effective behavior processes, shared cognitive states) facilitates implementation and is associated with better implementation outcomes; Problems in team functioning (i.e., negative affective states, problematic behavioral processes, lack of shared cognitive states) act as barriers to implementation and are associated with poor implementation outcomes; and 3) Open, ongoing, and effective communication within teams facilitates implementation of new practices; poor communication is a barrier. CONCLUSIONS: Teamwork matters for implementation. However, both team constructs and implementation outcomes were often poorly specified, and there was little overlap of team constructs and implementation outcomes studied in quantitative studies. Greater specificity and rigor are needed to understand how teamwork influences implementation processes and outcomes. We provide recommendations for improving the conceptualization, description, assessment, analysis, and interpretation of research on teams implementing innovations. TRIAL REGISTRATION: This systematic review was registered in PROSPERO, the international prospective register of systematic reviews. REGISTRATION NUMBER: CRD42020220168.

Statistical analysis plan for the NU IMPACT stepped-wedge cluster randomized trial.

BACKGROUND: As part of the IMPACT Consortium of three effectiveness-implementation trials, the NU IMPACT trial was designed to evaluate implementation and effectiveness outcomes for an electronic health record (EHR)-embedded symptom monitoring and management program for outpatient cancer care. NU IMPACT uses a unique stepped-wedge cluster randomized design, involving six clusters of 26 clinics, for evaluation of implementation outcomes with an embedded patient-level randomized trial to evaluate effectiveness outcomes. Collaborative, consortium-wide efforts to ensure use of the most robust and recent analytic methodologies for stepped-wedge trials motivated updates to the statistical analysis plan for implementation outcomes in the NU IMPACT trial. METHODS: In the updated statistical analysis plan for NU IMPACT, the primary implementation outcome patient adoption, as measured by clinic-level monthly proportions of patient engagement with the EHR-based cancer symptom monitoring system, will be analyzed using generalized least squares linear regression with auto-regressive errors and adjustment for cluster and time effects (underlying secular trends). A similar strategy will be used for secondary patient and provider implementation outcomes. DISCUSSION: The analytic updates described here resulted from highly iterative, collaborative efforts among statisticians, implementation scientists, and trial leads in the IMPACT Consortium. This updated statistical analysis plan will serve as the a priori specified approach for analyzing implementation outcomes for the NU IMPACT trial.

Understanding pathways from implementation to sustainment: a longitudinal, mixed methods analysis of promising practices implemented in the Veterans Health Administration.

BACKGROUND: The Veterans Health Administration (VHA) is the United States largest learning health system. The Diffusion of Excellence (DoE) program is a large-scale model of diffusion that identifies and diffuses evidence-informed practices across VHA. During the period of 2016-2021, 57 evidence-informed practices were implemented across 82 VHA facilities. This setting provides a unique opportunity to understand sustainment determinants and pathways. Our objective was to characterize the longitudinal pathways of practices as they transition from initial implementation to long-term sustainment at each facility. METHODS: A longitudinal, mixed-methods evaluation of 82 VHA facilities. Eighty-two facility representatives, chosen by leadership as points-of-contact for 57 DoE practices, were eligible for post-implementation interviews and annual sustainment surveys. Primary outcomes (implementation, sustainment), and secondary outcomes (institutionalization, effectiveness, anticipated sustainment) at four time-points were collected. We performed descriptive statistics and directed content analysis using Hailemariam et al.'s factors influencing sustainment. RESULTS: After approximately five years post-implementation (e.g., 2021 sustainment outcomes), of the 82 facilities, about one-third fully sustained their practice compared to one-third that did not fully sustain their practice because it was in a "liminal" stage (neither sustained nor discontinued) or permanently discontinued. The remaining one-third of facilities had missing 2021 sustainment outcomes. A higher percentage of facilities (70%) had inconsistent primary outcomes (changing over time) compared to facilities (30%) with consistent primary outcomes (same over time). Thirty-four percent of facilities with sustained practices reported resilience since they overcame implementation and sustainment barriers. Facilities with sustained practices reported more positive secondary outcomes compared to those that did not sustain their practice. Key factors facilitating practice sustainment included: demonstrating practice effectiveness/benefit, sufficient organizational leadership, sufficient workforce, and adaptation/alignment with local context. Key factors hindering practice sustainment included: insufficient workforce, not able to maintain practice fidelity/integrity, critical incidents related to the COVID-19 pandemic, organizational leadership did not support sustainment of practice, and no ongoing support. CONCLUSIONS: We identified diverse pathways from implementation to sustainment, and our data underscore that initial implementation outcomes may not determine long-term sustainment outcomes. This longitudinal evaluation contributes to understanding impacts of the DoE program, including return on investment, achieving learning health system goals, and insights into achieving high-quality healthcare in VHA.

An investigation into the acceptability, adoption, appropriateness, feasibility, and fidelity of implementation strategies for birth companionship in Tehran: a qualitative inquiry on mitigating mistreatment of women during childbirth.

BACKGROUND: A birth companion is a powerful mechanism for preventing mistreatment during childbirth and is a key component of respectful maternity care (RMC). Despite a growing body of evidence supporting the benefits of birth companions in enhancing the quality of care and birth experience, the successful implementation of this practice continues to be a challenge, particularly in developing countries. Our aim was to investigate the acceptability, adoption, appropriateness, feasibility, and fidelity of implementation strategies for birth companions to mitigate the mistreatment of women during childbirth in Tehran. METHODS: This exploratory descriptive qualitative study was conducted between April and August 2023 at Valiasr Hospital in Tehran, Iran. Fifty-two face-to-face in-depth interviews were conducted with a purposive sample of women, birth companions, and maternity healthcare providers. Interviews were audio-recorded, transcribed verbatim, and analyzed using content analysis, with a deductive approach based on the Implementation Outcomes Framework in the MAXQDA 18. RESULTS: Participants found the implemented program to be acceptable and beneficial, however the implementation team noticed that some healthcare providers were initially reluctant to support it and perceived it as an additional burden. However, its adoption has increased over time. Healthcare providers felt that the program was appropriate and feasible, and it improved satisfaction with care and the birth experience. Participants, however, highlighted several issues that need to be addressed. These include the need for training birth companions prior to entering the maternity hospital, informing women about the role of birth companions, assigning a dedicated midwife to provide training, and addressing any physical infrastructure concerns. CONCLUSION: Despite some issues raised by the participants, the acceptability, adoption, appropriateness, feasibility, and fidelity of the implementation strategies for birth companions to mitigate the mistreatment of women during childbirth were well received. Future research should explore the sustainability of this program. The findings of this study can be used to support the implementation of birth companions in countries with comparable circumstances.

Getting cozy with causality: Advances to the causal pathway diagramming method to enhance implementation precision.

Background: Implementation strategies are theorized to work well when carefully matched to implementation determinants and when factors-preconditions, moderators, etc.-that influence strategy effectiveness are prospectively identified and addressed. Existing methods for strategy selection are either imprecise or require significant technical expertise and resources, undermining their utility. This article outlines refinements to causal pathway diagrams (CPDs), a method for articulating the causal process through which implementation strategies work and offers illustrations of their use. Method: CPDs are a visualization tool to represent an implementation strategy, its mechanism(s) (i.e., the processes through which a strategy is thought to operate), determinants it is intended to address, factors that may impede or facilitate its effectiveness, and the series of outcomes that should be expected if the strategy is operating as intended. We offer principles for constructing CPDs and describe their key functions. Results: Applications of the CPD method by study teams from two National Institute of Health-funded Implementation Science Centers and a research grant are presented. These include the use of CPDs to (a) match implementation strategies to determinants, (b) understand the conditions under which an implementation strategy works, and (c) develop causal theories of implementation strategies. Conclusions: CPDs offer a novel method for implementers to select, understand, and improve the effectiveness of implementation strategies. They make explicit theoretical assumptions about strategy operation while supporting practical planning. Early applications have led to method refinements and guidance for the field.

Advances to the Causal Pathway Diagramming Method to Enhance Implementation Precision Plain Language Summary Implementation strategies often fail to produce meaningful improvements in the outcomes we hope to impact. Better tools for choosing, designing, and evaluating implementation strategies may improve their performance. We developed a tool, causal pathway diagrams (CPD), to visualize and describe how implementation strategies are expected to work. In this article, we describe refinements to the CPD tool and accompanying approach. We use real illustrations to show how CPDs can be used to improve how to match strategies to barriers, understand the conditions in which those strategies work best, and develop generalizable theories describing how implementation strategies work. CPDs can serve as both a practical and scientific tool to improve the planning, deployment, and evaluation of implementation strategies. We demonstrate the range of ways that CPDs are being used, from a highly practical tool to improve implementation practice to a scientific approach to advance testing and theorizing about implementation strategies.

Psychometric properties of two implementation measures: Normalization MeAsure Development questionnaire (NoMAD) and organizational readiness for implementing change (ORIC).

Background: Effective interventions need to be implemented successfully to achieve impact. Two theory-based measures exist for measuring the effectiveness of implementation strategies and monitor implementation progress. The Normalization MeAsure Development questionnaire (NoMAD) explores the four core concepts (Coherence, Cognitive Participation, Collective Action, Reflexive Monitoring) of the Normalization Process Theory. The Organizational Readiness for Implementing Change (ORIC) is based on the theory of Organizational Readiness for Change, measuring organization members' psychological and behavioral preparedness for implementing a change. We examined the measurement properties of the NoMAD and ORIC in a multi-national implementation effectiveness study. Method: Twelve mental health organizations in nine countries implemented Internet-based cognitive behavioral therapy (iCBT) for common mental disorders. Staff involved in iCBT service delivery (n = 318) participated in the study. Both measures were translated into eight languages using a standardized forward-backward translation procedure. Correlations between measures and subscales were estimated to examine convergent validity. The theoretical factor structures of the scales were tested using confirmatory factor analysis (CFA). Test-retest reliability was based on the correlation between scores at two time points 3 months apart. Internal consistency was assessed using Cronbach's alpha. Floor and ceiling effects were quantified using the proportion of zero and maximum scores. Results: NoMAD and ORIC measure related but distinct latent constructs. The CFA showed that the use of a total score for each measure is appropriate. The theoretical subscales of the NoMAD had adequate internal consistency. The total scale had high internal consistency. The total ORIC scale and subscales demonstrated high internal consistency. Test-retest reliability was suboptimal for both measures and floor and ceiling effects were absent. Conclusions: This study confirmed the psychometric properties of the NoMAD and ORIC in multi-national mental health care settings. While measuring on different but related aspects of implementation processes, the NoMAD and ORIC prove to be valid and reliable across different language settings.

Why was the study done?: Effective interventions need to be implemented successfully to achieve impact. Reliable measurement instruments are needed to determine if an implementation was successful or not. Two theory-based instruments exist for measuring the effectiveness of implementation strategies and monitor progress. The NoMAD measures aspects of normalization related to sense-making, willingness to implement, the work people do, and reflection. The Organizational Readiness for Implementing Change (ORIC) measures organization members' preparedness for implementing a change. What did we do?: This study examined whether the NoMAD and ORIC measure what they are supposed to measure. We translated the instruments from English to eight languages (Albanian, Danish, Dutch, French, German, Italian, and Spanish/Catalan) We applied various statistical methods to confirm the measurement properties, including correlations of scales, factor structures, test­retest reliability, consistency and floor and ceiling effects. 318 mental health professionals from nine countries participated in the study. What did we find?: For both instruments, total scores can be used as well as the subscale scores. Internal consistency for ORIC was high and for NoMAD adequate. Test­retest reliability was demonstrated, and floor and ceiling effects were rare. What does this mean?: NoMAD and ORIC are reliable instruments for measuring implementation processes and outcomes across mental health care settings in different countries and languages. They measure related but different aspects of implementation processes and outcomes. The measures are brief, and theory supported. However, more work is to be done on interpreting scores in relation to implementation success and regarding changes over time.

Real-time evaluation and adaptation to facilitate rapid recruitment in a large, prospective cohort study.

BACKGROUND: Recruiting large cohorts efficiently can speed the translation of findings into care across a range of scientific disciplines and medical specialties. Recruitment can be hampered by factors such as financial barriers, logistical concerns, and lack of resources for patients and clinicians. These and other challenges can lead to underrepresentation in groups such as rural residents and racial and ethnic minorities. Here we discuss the implementation of various recruitment strategies for enrolling participants into a large, prospective cohort study, assessing the need for adaptations and making them in real-time, while maintaining high adherence to the protocol and high participant satisfaction. METHODS: While conducting a large, prospective trial of a multi-cancer early detection blood test at Geisinger, an integrated health system in central Pennsylvania, we monitored recruitment progress, adherence to the protocol, and participants' satisfaction. Tracking mechanisms such as paper records, electronic health records, research databases, dashboards, and electronic files were utilized to measure each outcome. We then reviewed study procedures and timelines to list the implementation strategies that were used to address barriers to recruitment, protocol adherence and participant satisfaction. RESULTS: Adaptations to methods that contributed to achieving the enrollment goal included offering multiple recruitment options, adopting group consenting, improving visit convenience, increasing the use of electronic capture and the tracking of data and source documents, staffing optimization via leveraging resources external to the study team when appropriate, and integrating the disclosure of study results into routine clinical care without adding unfunded work for clinicians. We maintained high protocol adherence and positive participant experience as exhibited by a very low rate of protocol deviations and participant complaints. CONCLUSION: Recruiting rapidly for large studies - and thereby facilitating clinical translation - requires a nimble, creative approach that marshals available resources and changes course according to data. Planning a rigorous assessment of a study's implementation outcomes prior to study recruitment can further ground study adaptations and facilitate translation into practice. This can be accomplished by proactively and continuously assessing and revising implementation strategies.

Appropriate Prescribing for older adults with Multimorbidity (Pro-M): protocol for a feasibility study.

BACKGROUND: Potentially inappropriate prescribing is common among older adults with multimorbidity due to various reasons, from concurrent application of multiple single-disease clinical guidelines to fragmentation of care. Interventions such as medication review have been implemented worldwide to reduce inappropriate prescribing for older adults. However, the implementability of such interventions are underexplored in the outpatient clinics in Singapore's public hospitals. Hence, the Pro-M study aims to assess the feasibility of implementing a physician-pharmacist collaborative care intervention in geriatric medicine outpatient clinics to facilitate appropriate prescribing for older adults in Singapore. METHODS: This is a single-arm, non-randomised feasibility study using a pre-post evaluation design. This study consists of two parts: (1) implementation phase of the intervention (6 months) and an (2) evaluation phase (3 months). Eligible patients will be recruited from geriatric medicine outpatient clinics at two public hospitals in Singapore through convenience sampling. The main components of the Pro-M intervention are: (1) pharmacist-facilitated medication reviews with feedback on any medication issues and potential recommendations to physicians, and (2) physicians communicating changes to other relevant prescribers. The evaluation phase will involve surveying and interviewing physicians and pharmacists involved in the implementation of the intervention. A mixed-method approach will be employed for data collection and analysis. The quantitative and qualitative findings will be triangulated and reported using Proctor's implementation outcomes: appropriateness, penetration, acceptability, fidelity, feasibility, and sustainability. A basic cost analysis will be conducted alongside the study. DISCUSSION: This is a phase 2 study to test the feasibility of implementing an intervention that was co-created with stakeholders during phase 1 development of an intervention to optimise prescribing for older adults with multimorbidity. The implementation will be assessed using Proctor's implementation outcomes to provide insights on the process and the feasibility of implementing medication reviews for older adults with multimorbidity as a routine practice in outpatient clinics. Data collected from this study will inform a subsequent scale-up study. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT05756478. Registered on 06 March 2023.

Feasibility of implementing a screening tool for risk of opioid misuse in a trauma surgical population.

Background: As the opioid crisis continues to affect communities across the United States, new interventions for screening and prevention are needed to mitigate its impact. Mental health diagnoses have been identified as a risk factor for opioid misuse, and surgical populations and injury survivors are at high risk for prolonged opioid use and misuse. This study investigated the implementation of a novel opioid risk screening tool that incorporated putative risk factors from a recent study in four trauma units across Wisconsin. Method: The screening tool was implemented across a 6-month period at four sites. Data was collected via monthly meeting notes and "Plan, Do, Study, Act" (PDSA) forms. Following implementation, focus groups reflected on the facilitators and barriers to implementation. Meeting notes, PDSA forms, and focus group data were analyzed using the consolidated framework for implementation research, followed by thematic analyses, to generate themes surrounding the facilitators and barriers to implementing an opioid misuse screener. Results: Implementation facilitators included ensuring patient understanding of the screener, minimizing staff burden from screening, and educating staff to encourage engagement. Barriers included infrastructure limitations that prevented seamless administration of the screener within current workflows, overlap of the screener with existing measures, and lack of guidance surrounding treatment options corresponding to risk. Recommended solutions to address barriers include careful timing of screener administration, accommodating workflows, integration of the screening tool within the electronic health record, and evidence-based interventions guided by screener results. Conclusion: Four trauma centers across Wisconsin successfully implemented a pilot opioid misuse screening tool. Trauma providers and unit staff members believe that this tool would be a beneficial addition to their repertoire if their recommendations were adopted. Future research should refine opioid misuse risk factors and ensure screening items are well-validated with psychometric research supporting treatment responses to screener-indicated risk categories.

As the opioid crisis continues to affect communities across the United States, new interventions for early screening and prevention are needed to minimize the related harms. Prior research has identified risk factors associated with opioid misuse among a trauma surgical patient population, with the highest risk associated with distress-related posttraumatic stress disorder symptoms. A pilot screening tool was created based on this prior research, which was then administered at four trauma surgical units across the state of Wisconsin. Each of the four trauma units successfully implemented the pilot screening tool, and each identified a number of facilitators and barriers to the implementation process. Recommendations for improvement of the implementation process were also gathered. If their recommended changes were to be adopted, trauma providers and trauma unit staff members believed that such a screener for opioid misuse would be a beneficial addition to their current workflow among traumatic injury patients. Future research should refine opioid misuse risk factors and develop a psychometrically sound, validated screener to detect varying levels of risk and tailor treatment approaches based on a patient's risk score. Additionally, future research in the field of opioid misuse prevention should prioritize the recruitment of a more diverse population to support the translation of study findings across populations.

Implementation outcomes of the integrated district evidence to action (IDEAs) program to reduce neonatal mortality in central Mozambique: an application of the RE-AIM evaluation framework.

BACKGROUND: Scarce evidence exists on audit and feedback implementation processes in low-resource health systems. The Integrated District Evidence to Action (IDEAs) is a multi-component audit and feedback strategy designed to improve the implementation of maternal and child guidelines in Mozambique. We report IDEAs implementation outcomes. METHODS: IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces between 2016 and 2020 and evaluated using a quasi-experimental design guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. Reach is the proportion of pregnant women attending IDEAs facilities. Adoption is the proportion of facilities initiating audit and feedback meetings. Implementation is the fidelity to the strategy components, including readiness assessments, meetings (frequency, participation, action plan development), and targeted financial support and supervision. Maintenance is the sustainment at 12, 24, and 54 months. RESULTS: Across both provinces, 56% of facilities were exposed to IDEAs (target 57%). Sixty-nine and 73% of pregnant women attended those facilities' first and fourth antenatal consultations (target 70%). All facilities adopted the intervention. 99% of the expected meetings occurred with an average interval of 5.9 out of 6 months. Participation of maternal and child managers was high, with 3076 attending meetings, of which 64% were from the facility, 29% from the district, and 7% from the province level. 97% of expected action plans were created, and 41 specific problems were identified. "Weak diagnosis or management of obstetric complications" was identified as the main problem, and "actions to reinforce norms and protocols" was the dominant subcategory of micro-interventions selected. Fidelity to semiannual readiness assessments was low (52% of expected facilities), and in completing micro-interventions (17% were completed). Ninety-six and 95% of facilities sustained the intervention at 12 and 24 months, respectively, and 71% had completed nine cycles at 54 months. CONCLUSION: Maternal and child managers can lead audit and feedback processes in primary health care in Mozambique with high reach, adoption, and maintenance. The IDEAs strategy should be adapted to promote higher fidelity around implementing action plans and conducting readiness assessments. Adding effectiveness to these findings will help to inform strategy scale-up.

The Implementation Success of Technology-Based Counseling in Dementia Care: Scoping Review.

BACKGROUND: Implementing technology-based counseling as a complex intervention in dementia care poses challenges such as adaptation to stakeholders' needs and limited resources. While studies have examined the effectiveness of technology-based counseling, its successful implementation remains largely unexplored. OBJECTIVE: We aimed to review the knowledge about the implementation success of technology-based counseling interventions for people with dementia and their informal caregivers. METHODS: We conducted a scoping review and systematically searched CINAHL, the Cochrane Library including the Cochrane Central Register of Controlled Trials, MEDLINE, PsycINFO, and Web of Science Core Collection databases (April 2021) in combination with citation searching and web searching (November 2021). Studies reporting on technology-based counseling interventions for people with dementia or their informal caregivers were included, irrespective of the design. We used the conceptual framework for implementation outcomes to operationalize implementation success and applied the outcomes acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration, and sustainability as categories to inform data extraction. We identified dimensions within the categories and synthesized results narratively and graphically. RESULTS: We included 52 publications reporting on 27 technology-based counseling interventions. The studies were conducted in 9 countries and published between 1993 and 2021. As the design of the included studies varied, the number of participants and the type of data reported varied as well. The intervention programs were heterogeneous and ranged from single counseling interventions (such as helpline services) to counseling as part of a multicomponent program. Telephone, email, videoconferencing, social media (respectively chats), and web-based platforms were used for delivering counseling. We found data on appropriateness for all interventions and data on acceptability for most interventions, describing aspects such as consumer-perceived usefulness and helpfulness of services, as well as satisfaction. Information on the other categories of adoption, feasibility, fidelity, implementation cost, penetration, and sustainability was fragmented. CONCLUSIONS: The scope and depth of information on conceptual categories of the implementation success of technology-based counseling for people with dementia and informal caregivers varied. The data only partially covered the concept of implementation success, which highlights the need for a systematic evaluation accompanying the implementation. The application of theoretical approaches for implementation and adherence to the framework for developing and evaluating complex interventions are required to promote the implementation of complex interventions and to comprehensively assess implementation success. TRIAL REGISTRATION: PROSPERO CRD42021245473; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=245473.

Embedding implementation science in the research pipeline.

Clinical and health services researchers seek to discover effective programs, practices, and interventions to improve people's health. The current paradigm for evidence generation is incremental and misaligned to translate evidence-based discoveries into real-world settings. This persistent challenge are "valleys of death" that represent missed opportunities and preventable missteps to actually use scientific advancements in real-world clinical settings where they can improve health and well-being (De Geest S, Zúñiga F, Brunkert T et al. Powering Swiss health care for the future: implementation science to bridge "the valley of death". 2020;150:w20323). Only one in seven of evidence-based interventions is ever implemented. It is after an average of 17 years. We propose embedding the principles of implementation science throughout the research pipeline, from discovery to adoption, to efficiently translate discoveries into real-world contexts (Balas EA, Boren SA. Managing clinical knowledge for health care improvement. 2000;9:65-70). We outline implications for capacity building, including composition of the research team, study design, and competencies that could bolster the value proposition of implementation science. We describe a research paradigm that recognizes scientists' responsibility to ensure their discoveries be translated into real-world settings.

Most innovative research is not used in clinical care settings. When it is, it takes a very long time to get into the real world. This means that patients may not get the best care possible to improve their health. The research community has tools that can help design innovative research in ways that it could work in clinical care settings and tools to help that happen faster, so that clinical care teams and patients can use innovative research. This is called implementation science. We outline why it is important to use implementation science ideas and teams earlier and how we can support infrastructure to do so.

Factors influencing implementation of a care coordination intervention for cancer survivors with multiple comorbidities in a safety-net system: an application of the Implementation Research Logic Model.

BACKGROUND: Under- and uninsured cancer survivors have significant medical, social, and economic complexity. For these survivors, effective care coordination between oncology and primary care teams is critical for high-quality, comprehensive care. While evidence-based interventions exist to improve coordination between healthcare teams, testing implementation of these interventions for cancer survivors seen in real-world safety-net settings has been limited. This study aimed to (1) identify factors influencing implementation of a multicomponent care coordination intervention (nurse coordinator plus patient registry) focused on cancer survivors with multiple comorbidities in an integrated safety-net system and (2) identify mechanisms through which the factors impacted implementation outcomes. METHODS: We conducted semi-structured interviews (patients, providers, and system leaders), structured observations of primary care and oncology operations, and document analysis during intervention implementation between 2016 and 2020. The practice change model (PCM) guided data collection to identify barriers and facilitators of implementation; the PCM, Consolidated Framework for Implementation Research, and Implementation Research Logic Model guided four immersion/crystallization data analysis and synthesis cycles to identify mechanisms and assess outcomes. Implementation outcomes included appropriateness, acceptability, adoption, and penetration. RESULTS: The intervention was appropriate and acceptable to primary care and oncology teams based on reported patient needs and resources and the strength of the evidence supporting intervention components. Active and sustained partnership with system leaders facilitated these outcomes. There was limited adoption and penetration early in implementation because the study was narrowly focused on just breast and colorectal cancer patients. This created barriers to real-world practice where patients with all cancer types receive care. Over time, flexibility intentionally designed into intervention implementation facilitated adoption and penetration. Regular feedback from system partners and rapid cycles of implementation and evaluation led to real-time adaptations increasing adoption and penetration. DISCUSSION: Evidence-based interventions to coordinate care for underserved cancer survivors across oncology and primary care teams can be implemented successfully when system leaders are actively engaged and with flexibility in implementation embedded intentionally to continuously facilitate adoption and penetration across the health system.

RE-AIM implementation outcomes and service outcomes: what's the connection? results of a cross-sectional survey.

BACKGROUND: Implementation science and health services outcomes research each focus on many constructs that are likely interrelated. Both fields would be informed by increased understanding of these relationships. However, there has been little to no investigation of the relationships between implementation outcomes and service outcomes, despite general acknowledgement that both types of outcomes are important in the pathway to individual and population health outcomes. Given the lack of objective data about the links between implementation and service outcomes, an initial step in elucidating these relationships is to assess perceptions of these relationships among researchers and practitioners in relevant fields. The purpose of this paper is to assess perceived relationships between Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework outcomes and service outcomes, testing five a priori hypotheses about which perceived relationships may be strongest. METHODS: A cross-sectional online survey was administered to a convenience sample of implementation scientists, health services researchers, and public health and medical practitioners from a variety of settings. Respondents provided information on their discipline, training, practice and research settings, and levels of experience in health service outcomes research, implementation science, and the RE-AIM framework. Next, they rated perceived relationships between RE-AIM and service outcomes. Repeated measures analysis of variance were used to test a priori hypotheses. Exploratory analyses assessed potential differences in mean ratings across groups of respondents categorized by discipline, setting, and levels of implementation science, health services, and RE-AIM experience. RESULTS: Surveys were completed by 259 respondents, most of whom were employed in academic and medical settings. The majority were doctoral-level researchers and educators or physicians. Reported levels of experience with implementation research, health services research, and the RE-AIM framework varied. The strongest perceived relationships overall were between Implementation/Fidelity and Effectiveness (as a service outcome); Maintenance and Efficiency; Reach and Equity; Adoption and Equity; Implementation/Adaptation and Patient-Centeredness; Adoption and Patient-Centeredness; and Implementation/Fidelity and Safety. All but one of the a priori hypotheses were supported. No significant differences in ratings of perceived relationships were observed among subgroups of respondents. CONCLUSIONS: This study is an initial step in developing conceptual understanding of the links between implementation outcomes, health services outcomes, and health outcomes. Our findings on perceived relationships between RE-AIM and services outcomes suggest some areas of focus and identify several areas for future research to advance both implementation science and health services research toward common goals of improving health outcomes.

Evidence-based interventions to reduce maternal malnutrition in low and middle-income countries: a systematic review.

Introduction: Despite remarkable strides in global efforts to reduce maternal mortality, low-and middle-income countries (LMICs) continue to grapple with a disproportionate burden of maternal mortality, with malnutrition emerging as a significant contributing factor to this enduring challenge. Shockingly, malnourished women face a mortality risk that is twice as high as their well-nourished counterparts, and a staggering 95% of maternal deaths in 2020 occurred within LMICs. The critical importance of addressing maternal malnutrition in resource-constrained settings cannot be overstated, as compelling research studies have demonstrated that such efforts could potentially save thousands of lives. However, the landscape is marred by a scarcity of evidence-based interventions (EBIs) specifically tailored for pregnant individuals aimed at combatting maternal malnutrition and reducing mortality rates. It is against this backdrop that our study endeavors to dissect the feasibility, adoption, sustainability, and cost-effectiveness of EBIs designed to combat maternal malnutrition. Methods: Our comprehensive search encompassed eight prominent databases covering the period from 2003 to 2022 in LMICs. We began our study with a comprehensive search across multiple databases, yielding a total of 149 studies. From this initial pool, we eliminated duplicate entries and the remaining studies underwent a thorough screening process resulting in the identification of 63 full-text articles that aligned with our predefined inclusion criteria. Results: The meticulous full-text review left us with a core selection of six articles that shed light on interventions primarily centered around supplementation. They underscored a critical issue -the limited understanding of effective implementation in these countries, primarily attributed to inadequate monitoring and evaluation of interventions and insufficient training of healthcare professionals. Moreover, our findings emphasize the pivotal role of contextual factors, such as cultural nuances, public trust in healthcare, the prevalence of misinformation, and concerns regarding potential adverse effects of interventions, which profoundly influence the successful implementation of these programs. Discussion: While the EBIs have shown promise in reducing maternal malnutrition, their true potential for feasibility, adoption, cost-effectiveness, and sustainability hinges on their integration into comprehensive programs addressing broader issues like food insecurity and the prevention of both communicable and non-communicable diseases.

Implementation of interprofessional quality circles on deprescribing in Swiss nursing homes: an observational study.

BACKGROUND: Polypharmacy and potentially inappropriate medications (PIMs) are still frequent among older adults in nursing homes. Deprescribing is an intervention that has been shown to be effective in reducing their use. However, the implementation of deprescribing in clinical practice has not yet been widely evaluated. The Quality Circle Deprescribing Module (QC-DeMo) intervention has been trialled through an effectiveness-implementation hybrid type 2 design. The intervention consists of a quality circle workshop session between healthcare professionals HCPs (physicians, nurses, and pharmacists) within a nursing home, in which they define a consensus to deprescribe specific PIMs classes. The aim of this study was to evaluate the implementation of the QC-DeMo intervention in nursing homes. METHODS: This observational study focuses on the implementation part of the QC-DeMo trial. Implementation was based on the Framework for Implementation of Pharmacy Services (FISpH). Questionnaires at baseline and follow-up were used to evaluate reach, adoption, implementation effectiveness, fidelity, implementation, maintenance and the implementation strategies. Other data were collected from the QC-DeMo trial and routine data collected as part of the integrated pharmacy service where the QC-Demo trial was embedded. Implementation strategies included training of pharmacists, integration of the intervention into an existing quality circle dynamic and definition of tailored strategies to operationalise the consensus by each nursing home. RESULTS: The QC-DeMo intervention was successfully implemented in 26 nursing homes in terms of reach, fidelity, adoption, implementation and implementation effectiveness. However, the intervention was found to be implemented with low maintenance as none of the nursing homes repeated the intervention after the trial. Implementation strategies were well received by HCPs: training was adequate according to pharmacists. Pre-existing quality circle dynamic facilitated interprofessional collaboration as involvement and support of each HCP was rated as high. HCPs recognized a specific and important role for each HCP in the deprescribing process. The most relevant tailored strategies to implement the consensus defined by each nursing home were identification of the patients by the pharmacist and a systematic review of medication's patients. CONCLUSIONS: The implementation of a Quality Circle on Deprescribing is feasible but its maintenance in practice remains challenging. This study explores multiple implementation outcomes to better inform future implementation efforts of these types of interventions. TRIAL REGISTRATION: ClinicalTrials.gov ( NCT03688542 ), registered on 26.09.2018.