Aligning the planning, development, and implementation of complex interventions to local contexts with an equity focus: application of the PRISM/RE-AIM Framework.

For the fields of implementation science and health equity, understanding and being responsive to local contexts is of utmost importance to better inform the development, implementation, and evaluation of healthcare and public health interventions to increase their uptake and sustainment. Contexts are multi-level and include political, historical, economic, and social factors that influence health, as well as organizational characteristics, reflecting the richness of members' views, resources, values, and needs. Poor alignment between solutions and those contextual characteristics could have an impact on inequities. The PRISM (Practical Robust Implementation and Sustainability Model) is a context-based implementation science framework that incorporates RE-AIM outcomes (Reach, Effectiveness, Adoption, Implementation, Maintenance) and offers guidance to researchers, practitioners, and their patient and community partners on how to conceptualize, assess, and address contextual domains with a focus on health equity. Drawing from systems thinking, participatory engagement, and health equity principles, this commentary expands on previous work to 1) offer a novel perspective on how to align an intervention's core functions and forms with the PRISM's contextual domains, and 2) foster an ongoing and iterative engagement process with diverse partners throughout the research and practice process using a co-creation approach. We recommend intervention-to-context alignment through iterative cycles. To that end, we present the RE-AIM Framework's 'outcomes cascade' to illustrate touch points of opportunity and gaps within and across each of the five RE-AIM outcomes to illustrate 'where things go wrong'. We present a case study to illustrate and offer recommendations for research and practice efforts to increase contextual responsiveness, and enhance alignment with context before, during, and after implementation efforts and to ensure equity is being addressed. We strive to make a conceptual contribution to advance the field of pragmatic research and implementation of evidence-based practices through the application of the contextually-based PRISM framework with a focus on health equity.

An integrative review of parent education approaches in sport: Considerations for program planning and evaluation.

In recent years, there has been an increase in the delivery and evaluation of parent education programs within youth sport. Subsequently, some recent reviews of these programs have been conducted. However, one consistent issue across many of the programs and associated review papers is the lack of an appropriate evaluation framework to guide the planning or associated reporting of the outcomes of the interventions. This has limited understanding of the overall impact of sport parenting interventions. Thus, the purposes of the current study were as follows: (a) to identify commonalities in the reporting and evaluation of parent education programs; (b) to identify gaps in the reporting and evaluation of parent education programs; (c) to draw these insights together to provide suggestions regarding how the RE-AIM could be used to enhance planning and evaluation of evidence-based programs for parent education in sport. Specifically, utilizing the RE-AIM framework to provide insights into pertinent evaluation metrics, this integrative review aimed to identify commonalities and gaps in the reporting of parent education programs. The RE-AIM framework considers the essential elements to assess the external and internal validity of interventions through five dimensions: Reach, Effectiveness, Adoption, Implementation, and Maintenance (Am J Public Health. 1999;89(9):1322-1327). Subsequently, the review aimed to provide suggestions regarding strategies to enhance the planning and evaluation of evidence-based programs for parent education in sport. Overall, the analysis demonstrated that most studies presented some pertinent evaluation information related to the RE-AIM framework, such as the number of participants and contacts made, the measures used, and the program level. However, the studies also lacked information on participant exclusion criteria, the method used to select the delivery agent (e.g., parents engaged in the program), and cost measures. Overall, the current study identified various areas where programs could be enhanced, specifically related to reporting procedural elements (e.g., program design, target population, and costs) pertaining to the implementation of parent education programs.

Process evaluation of an mHealth-based school education program to reduce salt intake scaling up in China (EduSaltS): a mixed methods study using the RE-AIM framework.

BACKGROUND: An mHealth-based school health education platform (EduSaltS) was promoted in real-world China to reduce salt intake among children and their families. This progress evaluation explores its implementation process and influencing factors using mixed methods. METHODS: The mixed-methods process evaluation employed the RE-AIM framework. Quantitative data were collected from a management website monitoring 54,435 third-grade students across two cities. Questionnaire surveys (n = 27,542) assessed pre- and post-education effectiveness. Mixed-effects models were used to control cluster effects. Qualitative interviews (23 individuals and 8 focus groups) identified program performance, facilitators, and barriers. Findings were triangulated using the RE-AIM framework. RESULTS: The program achieved 100% participation among all the third-grade classes of the 208 invited primary schools, with a 97.7% registration rate among all the 54,435 families, indicating high "Reach." Qualitative interviews revealed positive engagement from children and parents through the "small hands leading big hands" strategy. The high completion rate of 84.9% for each health cloud lesson and the significant improvement in salt reduction knowledge and behaviors scores from 75.0 (95%CI: 74.7-75.3) to 80.9 (95%CI: 80.6-81.2) out of 100 demonstrated the "Effect" of EduSaltS. The program's "Adoption" and "Implementation" were supported by attractive materials, reduced workload via auto-delivered lessons/activities and performance evaluation, and high fidelity to recommended activities, with medians 3.0 (IQR: 2.0-8.0)/class and 9.0 (IQR: 5.0-14.0)/school. Stable course completion rates (79.4%-93.4%) over one year indicated promising "Maintenance." Apart from the facilitating features praised by the interviewees, government support was the basis for the scaling up of EduSaltS. Barriers included the lack of smartphone skills among some parents and competing priorities for schools. Unhealthy off-campus environments, such as excessive use of salt in pre-packaged and restaurant foods, also hindered salt reduction efforts. The program's scalability was evident through its integration into existing health education, engagement of local governments and adaptation across various mobile devices. CONCLUSIONS: The mHealth-based school health education program is scalable and effective for public salt reduction in China. Identified barriers and facilitators can inform future health program scale-ups. The program's successful implementation demonstrates its potential for broader application in public health initiatives aimed at reducing dietary salt intake.

Implementation of COVID-19 infection control best practices in nursing homes amid the pandemic.

BACKGROUND: The COVID-19 pandemic has claimed around 170,000 lives among nursing home residents and staff in the United States through April 2023. In a cluster randomized controlled trial (RCT) with 136 nursing homes, we delivered training to improve COVID-19 infection control best practices. We sought to assess the implementation of infection control practices in participating nursing homes. METHODS: Concurrent with the delivery of the RCT (January-November 2021), we surveyed nursing home administrators (NHAs, n = 38) at baseline and 6-month follow-up. Using validated items from the Centers for Disease Control and Prevention (CDC), the surveys inquired about 80 infection control best-practice activities (yes/no). The survey also asked seven scales corresponding to inner setting factors that may have impacted implementation. We assessed changes in infection control practices and inner setting factors between baseline and 6-month follow-up. RESULTS: Overall, the implementation of 11 best practices changed over time. NHAs reported an increase in the availability of informational materials for residents and families (84% vs. 100%, p = 0.031), the use of alcohol-based hand sanitizer over soap (76% vs. 97%, p = 0.008), and the development of contingency plans for increased postmortem care (53% vs. 82%, p = 0.013). The implementation of four best-practice visitation policies and three communal restrictions decreased between baseline and 6-month follow-up (all p < 0.05). Regarding inner setting factors, only culture stress (perceived strain, stress, and role overload) increased between surveys (mean scores: 3.14 vs. 3.58, p = 0.004). CONCLUSION: This study was among the first to report changes in implementing COVID-19 infection control best practices in nursing homes amid the pandemic. Culture stress was an important inner setting factor that may have impacted implementation activities. TRIAL REGISTRATION: NCT04499391 DATE OF REGISTRATION: August 3rd, 2020.

Evaluating implementation of a community-focused patient navigation intervention at an NCI-designated cancer center using RE-AIM.

BACKGROUND: Patient navigation is an evidence-based intervention that reduces cancer health disparities by directly addressing the barriers to care for underserved patients with cancer. Variability in design and integration of patient navigation programs within cancer care settings has limited this intervention's utility. The implementation science evaluation framework, RE-AIM, allows quantitative and qualitative examination of effective implementation of patient navigation programs into cancer care settings. METHODS: The Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework was used to evaluate implementation of a community-focused patient navigation intervention at an NCI-designated cancer center between June 2018 and October 2021. Using a 3-month longitudinal, non-comparative measurement period, univariate and bivariate analyses were conducted to examine associations between participant-level demographics and primary (i.e., barrier reduction) and secondary (i.e., patient-reported outcomes) effectiveness outcomes. Mixed methods analyses were used to examine adoption and delivery of the intervention into the cancer center setting. Process-level analyses were used to evaluate maintenance of the intervention. RESULTS: Participants (n = 311) represented a largely underserved population, as defined by the National Cancer Institute, with the majority identifying as Hispanic/Latino, having a household income of $35,000 or less, and being enrolled in Medicaid. Participants were diagnosed with a variety of cancer types and most had advanced staged cancers. Pre-post-intervention analyses indicated significant reduction from pre-intervention assessments in the average number of reported barriers, F(1, 207) = 117.62, p < .001, as well as significant increases in patient-reported physical health, t(205) = - 6.004, p < .001, mental health, t(205) = - 3.810, p < .001, self-efficacy, t(205) = - 5.321, p < .001, and satisfaction with medical team communication, t(206) = - 2.03, p = .029. Referral patterns and qualitative data supported increased adoption and integration of the intervention into the target setting, and consistent intervention delivery metrics suggested high fidelity to intervention delivery over time. Process-level data outlined a successful transition from a grant-funded community-focused patient navigation intervention to an institution-funded program. CONCLUSIONS: This study utilized the implementation science evaluation framework, RE-AIM, to evaluate implementation of a community-focused patient navigation program. Our analyses indicate successful implementation within a cancer care setting and provide a potential guide for other oncology settings who may be interested in implementing community-focused patient navigation programs.

Implementation outcomes of the integrated district evidence to action (IDEAs) program to reduce neonatal mortality in central Mozambique: an application of the RE-AIM evaluation framework.

BACKGROUND: Scarce evidence exists on audit and feedback implementation processes in low-resource health systems. The Integrated District Evidence to Action (IDEAs) is a multi-component audit and feedback strategy designed to improve the implementation of maternal and child guidelines in Mozambique. We report IDEAs implementation outcomes. METHODS: IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces between 2016 and 2020 and evaluated using a quasi-experimental design guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. Reach is the proportion of pregnant women attending IDEAs facilities. Adoption is the proportion of facilities initiating audit and feedback meetings. Implementation is the fidelity to the strategy components, including readiness assessments, meetings (frequency, participation, action plan development), and targeted financial support and supervision. Maintenance is the sustainment at 12, 24, and 54 months. RESULTS: Across both provinces, 56% of facilities were exposed to IDEAs (target 57%). Sixty-nine and 73% of pregnant women attended those facilities' first and fourth antenatal consultations (target 70%). All facilities adopted the intervention. 99% of the expected meetings occurred with an average interval of 5.9 out of 6 months. Participation of maternal and child managers was high, with 3076 attending meetings, of which 64% were from the facility, 29% from the district, and 7% from the province level. 97% of expected action plans were created, and 41 specific problems were identified. "Weak diagnosis or management of obstetric complications" was identified as the main problem, and "actions to reinforce norms and protocols" was the dominant subcategory of micro-interventions selected. Fidelity to semiannual readiness assessments was low (52% of expected facilities), and in completing micro-interventions (17% were completed). Ninety-six and 95% of facilities sustained the intervention at 12 and 24 months, respectively, and 71% had completed nine cycles at 54 months. CONCLUSION: Maternal and child managers can lead audit and feedback processes in primary health care in Mozambique with high reach, adoption, and maintenance. The IDEAs strategy should be adapted to promote higher fidelity around implementing action plans and conducting readiness assessments. Adding effectiveness to these findings will help to inform strategy scale-up.

Implementation of remote home care: assessment guided by the RE-AIM framework.

BACKGROUND: Welfare technology interventions have become increasingly important in home-based palliative care for facilitating safe, time-efficient, and cost-effective methods to support patients living independently. However, studies evaluating the implementation of welfare technology innovations are scarce, and the empirical evidence for sustainable models using technology in home-based palliative care remains low. This study aimed to report on the use of the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) framework to assess the implementation of remote home care (RHC) a technology-mediated service for home-living patients in the palliative phase of cancer. Furthermore, it aimed to explore areas of particular importance determining the sustainability of technologies for remote palliative home-based care. METHODS: A secondary analysis of data collected by semi-structured interviews with patients with cancer in the palliative phase, focus groups, and semi-structured interviews with healthcare professionals (HCPs) experienced with RHC was performed. A deductive reflexive thematic analysis using RE-AIM dimensions was conducted. RESULTS: Five themes illustrating the five RE-AIM dimensions were identified: (1) Reach: protective actions in recruitment - gatekeeping, (2) Effectiveness: potential to offer person-centered care, (3) Adoption: balancing high touch with high tech, (4) Implementation: moving towards a common understanding, and (5) Maintenance: adjusting to what really matters. The RE-AIM framework highlighted that RHC implementation for patients in the palliative phase of cancer was influenced by HCP gatekeeping behavior, concerns regarding abandoning palliative care as a high-touch specialty, and a lack of competence in palliative care. Although RHC facilitated improved routines in patients' daily lives, it was perceived as a static service unable to keep pace with disease progression. CONCLUSIONS: A person-centered approach that prioritizes individual needs and preferences is necessary for providing optimal care. Although technologies such as RHC are not a panacea, they can be integrated as support for increasingly strained health services.

"Still work?" Design and effect of interventions used to modify feeding problems in children with autism: A systematic review of studies employing group designs.

BACKGROUND: Feeding problems in children with autism jeopardize the well-being of both children with autism and their families. Mixed findings were reported from previous interventions, which were mostly evaluated by single subject research design (SSRD) studies. Moreover, feasibility assessment and social validity measurement were unaddressed by these SSRD studies. To fill this substantial knowledge gap, the present review systematically summarized and evaluated feeding interventions implemented in children with autism, which were assessed by studies employing group designs. METHOD: An extensive literature search in eight established online databases was conducted, and a total of 17 eligible studies published in 2009-2021 were included for further analysis. A descriptive account of the features of the investigations is provided, including assessment of study quality. RESULTS: A total of 449 children with autism and 203 parents/caregivers participated in the included studies. The multiple use of five strategic intervention components were highlighted in this review, including nutrition education/consultations, environmental modifications, sensory exposure, cognitive components, and behaviour interventions. The reviewed interventions showed a preliminarily positive effect for modifying feeding problems in children with autism. Furthermore, the evaluation based on the RE-AIM framework (reach, efficacy, adoption, implementation, and maintenance) demonstrated that an interdisciplinary multi-component intervention strategy may achieve high effectiveness and feasibility in improving feeding problems in a wide range of children with autism. CONCLUSIONS: This review found that interventions achieved and maintained a positive effect on modification of feeding problems in groups of children with autism. Information and gaps identified and summarized in the implementation process may assist both researchers and stakeholders to further support these vulnerable children.

Using RE-AIM Framework to Evaluate Recovery Opioid Overdose Team Plus: A Peer-Led Post-overdose Quick Response Team.

Peer recovery coaches utilize their lived experiences to support overdose survivors, a role gaining prominence across communities. A convergent mixed methods design, informed by the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, was used to evaluate the Recovery Opioid Overdose Team Plus (ROOT +), through an iterative evaluation using web-based surveys and qualitative interviews. Reach: Over 27 months, ROOT + responded to 83% of suspected overdose referrals (n = 607) and engaged with 41% of survivors (n = 217) and 7% of survivors' family/friends (n = 38). Effectiveness: Among those initially engaged with ROOT +, 36% of survivors remained engaged, entered treatment, or were in recovery at 90 days post-overdose (n = 77). Adoption: First responders completed 77% of ROOT + referrals (n = 468). Implementation: Barriers included lack of awareness of ROOT + , working phones, and access to treatment from community partner interviews (n = 15). Maintenance: Adaptations to ROOT + were made to facilitate implementation. Peer-led teams are promising models to engage with overdose survivors.

Breast Cancer Education and Empowerment in Ethiopia: Evaluating Community-Based Cancer Prevention Efforts Using the RE-AIM Framework.

Cancer prevention challenges in Ethiopia include limited community awareness and low uptake of screening, which are in part driven by a lack of culturally and linguistically relevant cancer education appropriate for the diverse indigenous communities of this never-colonized nation. In 2022, a comprehensive multi-media breast cancer (BC) awareness campaign was implemented, featuring local cancer experts and survivors, with community-based screening events in the towns of Adama and Mojo. The RE-AIM framework was used to evaluate and describe its reach, effectiveness, adoption, implementation, and maintenance. Educational pamphlets, videos, social media posts, and interviews were distributed in person and through local and national media networks, reaching tens of millions of people and resulting in 525 individuals screened, with one diagnosis of early-stage cancer. During the free screening events, an interview-administered survey of BC knowledge, attitudes, and screening practices was conducted to inform future cancer education for this population. Among 287 survey respondents, about half correctly identified swelling (46%) or changing nipples/discharge (48.4%) as signs of BC. Maintenance challenges include the lack of a national screening program. Educational resources and a mobile app, translated into the local language, encourage continued patient empowerment to perform breast self-exams. In the absence of established BC prevention programs, "pop-up" mobile screening events can be effective for mobilizing communities to get screened. The paper highlights challenges and lessons gleaned from this community-based BC awareness campaign and screening event to inform future cancer education initiatives in Ethiopia and similar resource-limited settings.

A scoping review of the role of policy in mitigating childhood obesity in underserved populations using the RE-AIM framework.

BACKGROUND: Childhood obesity is an escalating crisis in the United States. Health policy may impact this epidemic which disproportionally affects underserved populations. AIM: The aim was to use the reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) framework to assess health policy impact on preventing or treating school-aged children (5 > 18 years) with obesity in underserved populations. METHODS: A scoping review of 842 articles was conducted. Twenty-four articles met the inclusion criteria and underwent data extraction. RESULTS: Twelve studies included subgroup analysis, with four suggesting an impact of policy on at-risk groups. None of the 24 studies fully applied the RE-AIM framework. Policies positively impacted childhood obesity in 12 studies across the sample. LINKING EVIDENCE TO ACTION: Our review revealed inconsistent evidence for the effectiveness of policy on childhood obesity, perhaps due to the lack of focus on the social determinants of health. In addition, many studies did not evaluate the outcomes for underserved populations. Therefore, we propose more attention to social determinants in future legislation and evaluation of policy effectiveness on underserved populations. Findings identify an urgent need for the design, implementation, and evaluation of policies specifically directed to address the inequities of racism, social injustices, and social determinants of health that impact childhood obesity in the United States. Future work needs to identify who was reached by the policy, who benefitted from the policy, and how policies were implemented to address obesity-related health disparities. Nurses should advocate for the evaluation of childhood obesity policies, particularly in underserved populations, to determine effectiveness. Nurses, particularly those trained in population and community health and research, should advocate for policy research that considers inequities rather than controls for these variables. Multi-layered interventions can then be tailored to sub-populations and evaluated more effectively.

RE-AIM implementation outcomes and service outcomes: what's the connection? results of a cross-sectional survey.

BACKGROUND: Implementation science and health services outcomes research each focus on many constructs that are likely interrelated. Both fields would be informed by increased understanding of these relationships. However, there has been little to no investigation of the relationships between implementation outcomes and service outcomes, despite general acknowledgement that both types of outcomes are important in the pathway to individual and population health outcomes. Given the lack of objective data about the links between implementation and service outcomes, an initial step in elucidating these relationships is to assess perceptions of these relationships among researchers and practitioners in relevant fields. The purpose of this paper is to assess perceived relationships between Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework outcomes and service outcomes, testing five a priori hypotheses about which perceived relationships may be strongest. METHODS: A cross-sectional online survey was administered to a convenience sample of implementation scientists, health services researchers, and public health and medical practitioners from a variety of settings. Respondents provided information on their discipline, training, practice and research settings, and levels of experience in health service outcomes research, implementation science, and the RE-AIM framework. Next, they rated perceived relationships between RE-AIM and service outcomes. Repeated measures analysis of variance were used to test a priori hypotheses. Exploratory analyses assessed potential differences in mean ratings across groups of respondents categorized by discipline, setting, and levels of implementation science, health services, and RE-AIM experience. RESULTS: Surveys were completed by 259 respondents, most of whom were employed in academic and medical settings. The majority were doctoral-level researchers and educators or physicians. Reported levels of experience with implementation research, health services research, and the RE-AIM framework varied. The strongest perceived relationships overall were between Implementation/Fidelity and Effectiveness (as a service outcome); Maintenance and Efficiency; Reach and Equity; Adoption and Equity; Implementation/Adaptation and Patient-Centeredness; Adoption and Patient-Centeredness; and Implementation/Fidelity and Safety. All but one of the a priori hypotheses were supported. No significant differences in ratings of perceived relationships were observed among subgroups of respondents. CONCLUSIONS: This study is an initial step in developing conceptual understanding of the links between implementation outcomes, health services outcomes, and health outcomes. Our findings on perceived relationships between RE-AIM and services outcomes suggest some areas of focus and identify several areas for future research to advance both implementation science and health services research toward common goals of improving health outcomes.

Community-based Advocacy Communication Social Mobilization (ACSM) intervention by empowering key community leaders: Evaluation using the RE-AIM framework.

Background: Based on the theme of World Tuberculosis (TB) Day 2018-"Wanted Leaders for TB free world," various studies and country-level project have witnessed how training leaders on TB has helped enhance TB awareness in the community. This study was conducted to evaluate the effectiveness of Advocacy Communication and Social Mobilization (ACSM) intervention strategy through key community leaders, using Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework. Materials and Methods: This study was undertaken by the Department of Community Medicine, Sri Manakula Vinayagar Medical College and Hospital (SMVMCH), Puducherry, in the field practice area of Primary Health Centre (PHC), Thirubuvanai. The STOP TB, ENGAGE-TB, and National TB Elimination Program (NTEP) guidelines were used for interventions. Key community leaders (KCL) list (N = 117) was obtained from Mannadipet commune panchayat and PHC. The study was conducted in four phases: phase 1 (baseline): quantitative data: proportion of presumptive TB cases from notification register; phase 2 (intervention): training program for staff nurses, auxiliary nurse midwife (ANM), Accredited Social Health Activist (ASHA), and Anganwadi workers (group activity), participatory rural appraisal (PRA) activity for self-help group (SHG) leaders, and health education session for religious leaders and ex-panchayat leaders; phase 3: strengthening of ongoing activity: health education session and active case finding for TB; and phase 4: end line: outcome of the intervention, evaluated using the RE-AIM framework. Results: As an outcome of the intervention, there was a marginal increase (21 cases) in the proportion of presumptive TB cases when comparing before (2018) and after (2019) intervention. The proportion of presumptive TB cases identified and referred by KCL was 312. A total of 77 presumptive TB cases were identified through community-based active case finding (ACF). Two sputum samples (on the spot early morning) were collected and sent for Cartridge-based nucleic acid amplification testing (CBNAAT), of which three cases were positive. Conclusion: This study was community led and involved leaders from diverse backgrounds, optimizing the chance of success. For sustainability, we have initiated TB support group.

Implementing evidence-based practices in rural settings: a scoping review of theories, models, and frameworks.

Background: Rural healthcare has unique characteristics that affect the dissemination and implementation of evidence-based interventions. Numerous theories, models, and frameworks have been developed to guide implementation of healthcare interventions, though not specific to rural healthcare. The present scoping review sought to identify the theories, models, and frameworks most frequently applied to rural health and propose an approach to rural health research that harnesses selected constructs from these theories, models, and frameworks. This resulting synthesis can serve as a guide to researchers, policy makers, and clinicians seeking to employ commonly used theories, models, and frameworks to rural health. Methods: We used the Scopus abstract indexing service to identify peer-reviewed literature citing one or more of theories, models, or frameworks used in dissemination and implementation research and including the word "rural" in the Title, Abstract, or Keywords. We screened the remaining titles and abstracts to ensure articles met additional inclusion criteria. We conducted a full review of the resulting 172 articles to ensure they identified one or more discrete theory, model, or framework applied to research or quality improvement projects. We extracted the theories, models, and frameworks and categorized these as process models, determinant frameworks, classic theories, or evaluation frameworks. Results: We retained 61 articles of which 28 used RE-AIM, 11 used Community-Based Participatory Research (CBPR) framework, eight used the Consolidated Framework for Implementation Research (CFIR), and six used the integrated-Promoting Action on Research Implementation in Health Services (iPARIHS). Additional theories, models, and frameworks were cited in three or fewer reports in the literature. The 14 theories, models, and frameworks cited in the literature were categorized as seven process models, four determinant frameworks, one evaluation framework, and one classic theory. Conclusions: The RE-AIM framework was the most frequently cited framework in the rural health literature, followed by CBPR, CFIR, and iPARIHS. A notable advantage of RE-AIM in rural healthcare settings is the focus on reach as a specified outcome, given the challenges of engaging a geographically diffuse and often isolated population. We present a rationale for combining the strengths of these theories, models, and frameworks to guide a research agenda specific to rural healthcare research. Systematic Review Registration: https://osf.io/fn2cd/.

Interventions connecting young people living in Africa to healthcare; a systematic review using the RE-AIM framework.

Introduction: Africa's young people are among the least focused groups in healthcare linkage. The disproportionally high burden of youth-related health problems is a burden, especially in developing regions like Africa, which have a high population of young people. More information is needed about factors that impact linkages in healthcare and the sustainability of health interventions among young people in Africa. Methods: A systematic literature search was performed from October 2020 to May 2022 in PubMed, CINAHL, Scopus, Global Health, and the Web of Science. Studies included in the review were conducted among young people aged 10-24 living in Africa, written in English, and published between 2011 and 2021. Results were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses. Data was analyzed using narrative synthesis, synthesizing the details of the RE-AIM reporting component. Interventions were systematically compared using the Cochrane Collaboration risk-of-bias tool to evaluate the rigor of each intervention. Results: A total of 2,383 potentially relevant citations were obtained after an initial database search. Retained in the final group were seventeen articles from electronic data searches; among these articles, 16 interventions were identified. Out of the seventeen studies, nine (53%) were randomized controlled trials, three (18%) were quasi-experimental designs, and five (29%) were observational studies. At the same time, the included interventions were reported on 20 (76.92%) of the 26 components of the RE-AIM dimensions. In eastern Africa, twelve (80%) interventions were conducted, and all the interventions addressed linkage to care for young people in preventing and treating HIV. The least reported RE-AIM dimensions were implementing and maintaining interventions connecting young people to care. Discussion: Timely care remains critical to treating and preventing ailments. This review indicates that interventions created to link young people to care, especially HIV care, can help link them to health care and strengthen the programs. It is also clear that further research with more extended follow-up periods is needed to examine connections to care in all other aspects of health and to bridge the gap between research and practice in the care of young people in Africa. Systematic Review Registration: PROSPERO [CRD42022288227].

RE-AIM for rural health innovations: perceptions of (mis) alignment between the RE-AIM framework and evaluation reporting in the Department of Veterans Affairs Enterprise-Wide Initiatives program.

Background: The Department of Veterans Affairs (VA) Office of Rural Health (ORH) supports national VA program offices' efforts to expand health care to rural Veterans through its Enterprise-Wide Initiatives (EWIs) program. In 2017, ORH selected Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM), an implementation science framework, to structure the EWI evaluation and reporting process. As part of its mandate to improve EWI program evaluation, the Center for the Evaluation of Enterprise-Wide Initiatives conducted a qualitative evaluation to better understand EWI team' perceptions of, and barriers and facilitators to, the EWI evaluation process. Methods: We conducted 43 semi-structured interviews with 48 team members (e.g., evaluators, program office leads, and field-based leads) representing 21 EWIs from April-December 2020. Questions focused on participants' experiences using strategies targeting each RE-AIM dimension. Interviews were inductively analyzed in MAXQDA. We also systematically reviewed 51 FY19-FY20 EWI annual reports to identify trends in misapplications of RE-AIM. Results: Participants had differing levels of experience with RE-AIM. While participants understood ORH's rationale for selecting a common framework to structure evaluations, the perceived misalignment between RE-AIM and EWIs' work emerged as an important theme. Concerns centered around 3 sub-themes: (1) (Mis)Alignment with RE-AIM Dimensions, (2) (Mis)Alignment between RE-AIM and the EWI, and (3) (Mis)Alignment with RE-AIM vs. other Theories, Models, or Frameworks. Participants described challenges differentiating between and operationalizing dimensions in unique contexts. Participants also had misconceptions about RE-AIM and its relevance to their work, e.g., that it was meant for established programs and did not capture aspects of initiative planning, adaptations, or sustainability. Less commonly, participants shared alternative models or frameworks to RE-AIM. Despite criticisms, many participants found RE-AIM useful, cited training as important to understanding its application, and identified additional training as a future need. Discussion: The selection of a shared implementation science framework can be beneficial, but also challenging when applied to diverse initiatives or contexts. Our findings suggest that establishing a common understanding, operationalizing framework dimensions for specific programs, and assessing training needs may better equip partners to integrate a shared framework into their evaluations.

Multilevel perceptions of the virtual delivery of the University of California Diabetes Prevention Program on RE-AIM domains due to COVID-19 mandates.

Background: The University of California's Diabetes Prevention Program (UC DPP) Initiative was implemented across all 10 UC campuses in 2018. The COVID-19 pandemic and accompanying mandates required swift changes to program delivery, including pivoting from in-person to virtual delivery (i.e., Zoom). Our goal was to assess multilevel constituent perceptions of the use of a virtual platform to deliver UC DPP due to COVID-19 mandates. Methods: We conducted qualitative interviews with 68 UC DPP participants, coordinators, and leaders to examine the use of virtual platform delivery on the reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) of UC DPP. Transcripts were analyzed using rapid qualitative analysis and emergent themes were categorized using domains corresponding to RE-AIM framework. Results: Among UC DPP participants (n = 42), virtual delivery primarily impacted perceptions of UC DPP effectiveness and implementation. Some participants perceived program effectiveness to be negatively impacted, given their preference for in-person sessions, which they felt provided more engagement, peer support, and accountability. Implementation challenges included problems with virtual format (e.g., "Zoom fatigue"); however, several benefits were also noted (e.g., increased flexibility, maintenance of DPP connections during campus closures). UC DPP coordinators (n = 18) perceived virtual delivery as positively impacting UC DPP reach, since virtual platforms provided access for some who could not participate in-person, and negatively impacting effectiveness due to reduced engagement and lower peer support. UC leaders (n = 8) perceived that use of the virtual format had a positive impact on reach (e.g., increased availability, accessibility) and negatively impacted effectiveness (e.g., less intensive interactions on a virtual platform). Across constituent levels, the use of a virtual platform had little to no impact on perceptions of adoption and maintenance of UC DPP. Conclusion: Perceptions of the reach, effectiveness, and implementation of UC DPP using a virtual platform varied across constituents, although all groups noted a potential negative impact on overall program effectiveness. Unanticipated program adaptations, including virtual delivery, present potential benefits as well as perceived drawbacks, primarily across the effectiveness domain. Understanding differential constituent perceptions of the impact of virtual delivery can help maximize RE-AIM and inform future UC DPP delivery strategies.

Tribally-led mobile outreach: improving access to harm reduction services in one rural reservation community.

American Indian and Alaska Native populations in the United States face significant disparities related to opioid use disorder and opioid-related mortality. Inequitable access to medications and harm reduction strategies due to structural, societal, and geographical factors prevent Tribal communities from obtaining needed services, and further contribute to the opioid epidemic. One Tribal Healing Center in the Rocky Mountain region identified mobile outreach to build upon existing opioid prevention, treatment, and harm reduction efforts. The Healing Center purchased a mobile outreach vehicle and worked with a combination of clinical staff, peer recovery support specialists, and Tribal elders to reach identified high-risk areas on the reservation. As of December 2023, the mobile outreach vehicle has disseminated 150 Narcan kits, 150 Fentanyl testing strips, 20 self-care kits, and 500 brochures detailing Healing Center services. Preliminary results from this formative evaluation demonstrate the success of MOV efforts and the process required to purchase and launch an MOV campaign.

Evaluating the Perceived Health-Related Effectiveness of 'The Daily Mile' Initiative in Irish Primary Schools.

Many Irish primary school children do not meet recommended physical activity (PA) guidelines. The Daily Mile (TDM) is a primary school initiative designed to increase children's PA output. This study evaluates TDM's perceived effect on Irish primary school children's health-related metrics. A mixed-methods study, comprising two data collection phases, used the RE-AIM framework to evaluate TDM. Phase One involved teachers, principals and classroom assistants (n = 191) from TDM-registered schools completing a questionnaire. Two TDM-registered schools participated in Phase Two, where (i) interviews were conducted with each principal, (ii) a teacher sub-sample (n = 4) participated in a focus group, and (iii) a child sub-sample (n = 14) participated in separate focus groups. TDM was perceived to positively impact the markers of children's health, including their PA behaviour, physical fitness and social well-being. Inclement weather (66.5%) and a lack of time (56.5%) were reported as the top-ranked implementation barriers. Moreover, TDM's repetitive nature often left children feeling disinterested and resulted in some teachers modifying the initiative to maintain engagement levels. Maintaining the long-term implementation of TDM and its health benefits in primary schools may require bespoke amendments to the original format to preserve children's engagement.

Adopting the RE-AIM analytic framework for rural program evaluation: experiences from the Advance Care Planning via Group Visits (ACP-GV) national evaluation.

Introduction: To support rigorous evaluation across a national portfolio of grants, the United States Department of Veterans Affairs (VA) Office of Rural Health (ORH) adopted an analytic framework to guide their grantees' evaluation of initiatives that reach rural veterans and to standardize the reporting of outcomes and impacts. Advance Care Planning via Group Visits (ACP-GV), one of ORH's Enterprise-Wide Initiatives, also followed the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. ACP-GV is a national patient-centered intervention delivered in a large, veterans integrated healthcare system. This manuscript describes how RE-AIM was used to evaluate this national program and lessons learned from ORH's annual reporting feedback to ACP-GV on their use of the framework to describe evaluation impacts. Methods: We used patient, provider, and site-level administrative health care data from the VA Corporate Data Warehouse and national program management databases for federal fiscal years (FY) spanning October 1, 2018-September 30, 2023. Measures included cumulative and past FY metrics developed to assess program impacts. Results: RE-AIM constructs included the following cumulative and annual program evaluation results. ACP-GV reached 54,167 unique veterans, including 19,032 unique rural veterans between FY 2018 to FY 2023. During FY 2023, implementation adherence to the ACP-GV model was noted in 91.7% of program completers, with 55% of these completers reporting a knowledge increase and 14% reporting a substantial knowledge increase (effectiveness). As of FY 2023, 66 ACP-GV sites were active, and 1,556 VA staff were trained in the intervention (adoption). Of the 66 active sites in FY 2023, 27 were sites previously funded by ORH and continued to offer ACP-GV after the conclusion of three years of seed funding (maintenance). Discussion: Lessons learned developing RE-AIM metrics collaboratively with program developers, implementers, and evaluators allowed for a balance of clinical and scientific input in decision-making, while the ORH annual reporting feedback provided specificity and emphasis for including both cumulative, annual, and rural specific metrics. ACP-GV's use of RE-AIM metrics is a key step towards improving rural veteran health outcomes and describing real world program impacts.