Using formative process evaluation to improve program implementation and accessibility of competitive group-based physical activity in the TEAM-PA trial.

BACKGROUND: This study demonstrates how formative process evaluation was used to assess implementation and improve dose and fidelity in the Together Everyone Achieves More Physical Activity (TEAM-PA) randomized controlled trial. TEAM-PA uses a randomized group cohort design to evaluate the efficacy of a group-based intervention for increasing physical activity among African American women. METHODS: Intervention groups met for 10 weeks and were co-led by female African American facilitators, with intervention sessions consisting of group feedback, a health curriculum, group-based physical activity games, and group-based goal-setting. Drawing from a multi-theoretical framework, the intervention targeted social affiliation using collaborative and competitive group strategies, including essential elements focused on group-based behavioral skills, peer-to-peer positive communication, collectivism, optimal challenge, social facilitation, and peer to peer challenges. Formative process evaluation was used to monitor reach, dose, and fidelity, and implement feedback and solutions. RESULTS: Across two cohorts, four groups (n = 54) were randomized to the TEAM-PA intervention. On average 84.8% of participants attended each week, which exceeded the a priori criteria. Results from the systematic observations indicated that on average 93% of the dose items were completed in each session and adequate levels of fidelity were achieved at both the facilitator and group-levels. Participants were compliant with wearing the FitBits (6.73 ± 0.42 days/week) and most participants successfully contributed to meeting the group-based goals. The use of open-ended items also revealed the need for additional modifications to the group-based PA games, including allowing for individuals to take breaks, incorporating a broader range of exercises, minimizing activities that required bending/reaching down without assistance, and providing facilitators with additional training for implementing the games. Initial evidence suggests that these changes were successful in increasing participants' comprehension of the games from Cohort 1 (M = 1.83, SD = 0.71) to Cohort 2 (M = 3.33, SD = 0.69). CONCLUSION: Findings from this study demonstrated high levels of reach, dose, and fidelity, while also highlighting strategies for implementing competitive group-based PA games that are accessible across physical fitness levels. Formative process evaluation, including open-ended items and collaborative brainstorming, holds tremendous potential for improving future interventions. TRIAL REGISTRATION: This study was registered on Clinicaltrials.gov (# NCT05519696) on August 22, 2022 prior to the enrollment of the first participant on September 12, 2022 ( https://clinicaltrials.gov/study/NCT05519696?term=NCT05519696&rank=1 ).

National implementation trial of BeUpstanding™: an online initiative for workers to sit less and move more.

BACKGROUND: The online BeUpstanding™ program is an eight-week workplace-delivered intervention for desk-based workers to raise awareness of the benefits of sitting less and moving more and build a supportive culture for change. A workplace representative (the "champion") delivers the program, which includes a workshop where teams collectively choose their sit less/move more strategies. A toolkit provides the champion with a step-by-step guide and associated resources to support program uptake, delivery, and evaluation. Here we report on the main findings from the Australian national implementation trial of BeUpstanding. METHODS: Recruitment (12/06/2019 to 30/09/2021) was supported by five policy and practice partners, with desk-based work teams from across Australia targeted. Effectiveness was measured via a single arm, repeated-measures trial. Data were collected via online surveys, toolkit analytics, and telephone calls with champions. The RE-AIM framework guided evaluation, with adoption/reach (number and characteristics); effectiveness (primary: self-reported workplace sitting time); implementation (completion of core components; costs); and, maintenance intentions reported here. Linear mixed models, correcting for cluster, were used for effectiveness, with reach, adoption, implementation, and maintenance outcomes described. RESULTS: Of the 1640 website users who signed-up to BeUpstanding during the recruitment period, 233 were eligible, 198 (85%) provided preliminary consent, and 118 (50.6%) champions consented and started the trial, with 94% (n = 111 champions) completing. Trial participation was from across Australia and across industries, and reached 2,761 staff, with 2,248 participating in the staff survey(s): 65% female; 64% university educated; 17% from a non-English speaking background. The program effectively changed workplace sitting (-38.5 [95%CI -46.0 to -28.7] minutes/8-hour workday) and all outcomes targeted by BeUpstanding (behaviours and culture), with small-to-moderate statistically-significant effects observed. All participating teams (n = 94) completed at least 5/7 core steps; 72.4% completed all seven. Most champions spent $0 (72%) or >$0-$5 (10%) per team member; most (67/70 96%) intended to continue or repeat the program. CONCLUSIONS: BeUpstanding can be adopted and successfully implemented by a range of workplaces, reach a diversity of staff, and be effective at creating a supportive culture for teams of desk-based workers to sit less and move more. Learnings will inform optimisation of the program for longer-term sustainability. TRIAL REGISTRATION: ACTRN12617000682347.

Process evaluation findings from Strong Hearts, Healthy Communities 2.0: a cardiovascular disease prevention intervention for rural women.

BACKGROUND: Strong Hearts, Healthy Communities 2.0 (SHHC-2.0) was a 24-week cardiovascular disease prevention program that was effective in improving physical activity and nutrition behaviors and clinical outcomes among women in 11 rural New York, USA towns. This study evaluated the delivery of SHHC-2.0 to prepare the intervention for further dissemination. METHODS: This process evaluation was guided by the Medical Research Council recommendations and engaged program leaders and participants (i.e., women over age 40) using quantitative and qualitative methods. The quantitative evaluation included examination of enrollment and retention data, a participant survey, and a fidelity checklist completed after classes. Descriptive and comparative statistics were used to assess implementation measures: program reach, participant attendance, dose delivered, program length, perceived effectiveness, fidelity, and participant satisfaction. The qualitative evaluation included focus groups (n = 13) and interviews (n = 4) using semi-structured guides; audio was recorded and transcripts were deductively coded and analyzed using directed content analysis and iterative categorization approaches. Comparisons across towns and between intervention and waitlist control groups were explored. RESULTS: Average reach within towns was 7.5% of the eligible population (range 0.7-15.7%). Average attendance was 59.8% of sessions (range 42.0-77.4%). Average dose delivered by leaders was 86.4% of curriculum components (range 73.5-95.2%). Average session length was 51.8 ± 4.8 min across 48 sessions. Leaders' perceived effectiveness rating averaged 4.1 ± 0.3 out of 5. Fidelity to curricular components was 81.8% (range 67.4-93.2%). Participants reported being "more than satisfied" with the overall program (88.8%) and the health benefits they obtained (72.9%). Qualitative analysis revealed that participants: (1) gained new knowledge and enjoyable experiences; (2) perceived improvements in their physical activity, nutrition, and/or health; (3) continued to face some barriers to physical activity and healthy eating, with those relating to social support being reduced; and (4) rated leaders and the group structure highly, with mixed opinions on the research elements. CONCLUSIONS: SHHC-2.0 had broad reach, was largely delivered as intended, and participants expressed high levels of satisfaction with the program and its health benefits. Our findings expand on best practices for implementing cardiovascular disease prevention programs in rural communities. CLINICAL TRIALS REGISTRATION: www. CLINICALTRIALS: gov #NCT03059472.

An integrative review of parent education approaches in sport: Considerations for program planning and evaluation.

In recent years, there has been an increase in the delivery and evaluation of parent education programs within youth sport. Subsequently, some recent reviews of these programs have been conducted. However, one consistent issue across many of the programs and associated review papers is the lack of an appropriate evaluation framework to guide the planning or associated reporting of the outcomes of the interventions. This has limited understanding of the overall impact of sport parenting interventions. Thus, the purposes of the current study were as follows: (a) to identify commonalities in the reporting and evaluation of parent education programs; (b) to identify gaps in the reporting and evaluation of parent education programs; (c) to draw these insights together to provide suggestions regarding how the RE-AIM could be used to enhance planning and evaluation of evidence-based programs for parent education in sport. Specifically, utilizing the RE-AIM framework to provide insights into pertinent evaluation metrics, this integrative review aimed to identify commonalities and gaps in the reporting of parent education programs. The RE-AIM framework considers the essential elements to assess the external and internal validity of interventions through five dimensions: Reach, Effectiveness, Adoption, Implementation, and Maintenance (Am J Public Health. 1999;89(9):1322-1327). Subsequently, the review aimed to provide suggestions regarding strategies to enhance the planning and evaluation of evidence-based programs for parent education in sport. Overall, the analysis demonstrated that most studies presented some pertinent evaluation information related to the RE-AIM framework, such as the number of participants and contacts made, the measures used, and the program level. However, the studies also lacked information on participant exclusion criteria, the method used to select the delivery agent (e.g., parents engaged in the program), and cost measures. Overall, the current study identified various areas where programs could be enhanced, specifically related to reporting procedural elements (e.g., program design, target population, and costs) pertaining to the implementation of parent education programs.

Development of a program theory for osteoporosis patient education in Denmark: a qualitative study based on realist evaluation.

BACKGROUND: Osteoporosis patient education is offered in many countries worldwide. When evaluating complex interventions like these, it is important to understand how and why the intervention leads to effects. This study aimed to develop a program theory of osteoporosis patient education in Danish municipalities with a focus on examining the mechanisms of change i.e. what is about the programs that generate change. METHODS: The program theory was developed in an iterative process. The initial draft was based on a previous published systematic review, and subsequently the draft was continually refined based on findings from observations (10 h during osteoporosis patient education) and interviews (individual interviews with six employees in municipalities and three health professionals at hospitals, as well as four focus group interviews with participants in patient education (in total 27 informants)). The transcribed interviews were analyzed using thematic analysis and with inspiration from realist evaluation the mechanisms as well as the contextual factors and outcomes were examined. RESULTS: Based on this qualitative study we developed a program theory of osteoporosis patient education and identified four mechanisms: motivation, recognizability, reassurance, and peer reflection. For each mechanism we examined how contextual factors activated the mechanism as well as which outcomes were achieved. For instance, the participants' motivation is activated when they meet in groups, and thereafter outcomes such as more physical activity may be achieved. Recognizability is activated by the participants' course of disease, which may lead to better ergonomic habits. Reassurance may result in more physical activity, and this mechanism is activated in newly diagnosed participants without previous fractures. Peer reflection is activated when the participants meet in groups, and the outcome healthier diet may be achieved. CONCLUSIONS: We developed a program theory and examined how and why osteoporosis patient education is likely to be effective. Understanding these prerequisites is important for future implementation and evaluation of osteoporosis patient education.

Process evaluation of the Yéego! Program to increase healthy eating and gardening among American Indian elementary school children.

BACKGROUND: American Indian children are at increased risk for obesity and diabetes. School-based health promotion interventions are one approach to promoting healthy behaviors to reduce this risk, yet few studies have described their implementation and fidelity. We conducted a qualitative process evaluation of the Yéego! Healthy Eating and Gardening Program, a school-based intervention to promote healthy eating among Navajo elementary school children. The intervention included a yearlong integrated curriculum, as well as the construction and maintenance of a school-based garden. METHODS: Our process evaluation included fidelity checklists completed by program staff and qualitative interviews with program staff and classroom teachers after the intervention was implemented. We used content analysis to identify themes. RESULTS: We identified several themes related to evidence of delivery adherence, program satisfaction, and lessons learned about delivery. Intervention staff followed similar procedures to prepare for and deliver lessons, but timing, teaching styles, and school-level factors also impacted overall implementation fidelity. Teachers and students had positive perceptions of the program, especially lessons that were highly visual, experiential, and connected to Navajo culture and the surrounding community. Teachers and program staff identified ways to enhance the usability of the curriculum by narrowing the scope, relating content to student experiences, and aligning content with school curriculum standards. CONCLUSIONS: The program was implemented with moderately high fidelity across contexts. We identified areas where modifications could improve engagement, acceptability, efficacy, and sustainability of the program. Our results have implications for the evaluation and dissemination of school-based health interventions to promote healthy eating among children, especially in American Indian communities.

Reducing wait times and avoiding unnecessary use of high-cost mental health services through a Rapid Access and Stabilization Program: protocol for a program evaluation study.

BACKGROUND: Emergency psychiatric care, unplanned hospital admissions, and inpatient health care are the costliest forms of mental health care. According to Statistics Canada (2018), almost 18% (5.3 million) of Canadians reported needing mental health support. However, just above half of this figure (56.2%) have reported their needs were fully met. In light of this evidence there is a pressing need to provide accessible mental health services in flexible yet cost-effective ways. To further expand capacity and access to mental health care in the province, Nova Scotia Health has launched a novel mental health initiative for people in need of mental health care without requiring emergency department visits or hospitalization. This new service is referred to as the Rapid Access and Stabilization Program (RASP). This study evaluates the effectiveness and impact of the RASP on high-cost health services utilization (e.g. ED visits, mobile crisis visits, and inpatient treatments) and related costs. It also assesses healthcare partners' (e.g. healthcare providers, policymakers, community leaders) perceptions and patient experiences and satisfaction with the program and identifies sociodemographic characteristics, psychological conditions, recovery, well-being, and risk measures in the assisted population. METHOD: This is a hypothesis-driven program evaluation study that employs a mixed methods approach. A within-subject comparison (pre- and post-evaluation study) will examine health services utilization data from patients attending RASP, one year before and one year after their psychiatry assessment at the program. A controlled between-subject comparison (cohort study) will use historical data from a control population will examine whether possible changes in high-cost health services utilization are associated with the intervention (RASP). The primary analysis involves extracting secondary data from provincial information systems, electronic medical records, and regular self-reported clinical assessments. Additionally, a qualitative sub-study will examine patient experience and satisfaction, and health care partners' impressions. DISCUSSION: We expect that RASP evaluation findings will demonstrate a minimum 10% reduction in high-cost health services utilization and corresponding 10% cost savings, and also a reduction in the wait times for patient consultations with psychiatrists to less than 30 calendar days, in both within-subject and between-subject comparisons. In addition, we anticipate that patients, healthcare providers and healthcare partners would express high levels of satisfaction with the new service. CONCLUSION: This study will demonstrate the results of the Mental Health and Addictions Program (MHAP) efforts to provide stepped-care, particularly community-based support, to individuals with mental illnesses. Results will provide new insights into a novel community-based approach to mental health service delivery and contribute to knowledge on how to implement mental health programs across varying contexts.

The impact of a regionally based translational cancer research collaborative in Australia using the FAIT methodology.

BACKGROUND: Translating research, achieving impact, and assessing impact are important aspirations for all research collaboratives but can prove challenging. The Hunter Cancer Research Alliance (HCRA) was funded from 2014 to 2021 to enhance capacity and productivity in cancer research in a regional centre in Australia. This study aimed to assess the impact and benefit of the HCRA to help inform future research investments of this type. METHOD: The Framework to Assess the Impact from Translational health research (FAIT) was selected as the preferred methodology. FAIT incorporates three validated methodologies for assessing impact: 1) Modified Payback; 2) Economic Analysis; and 3) Narrative overview and case studies. All three FAIT methods are underpinned by a Program Logic Model. Data were collected from HCRA and the University of Newcastle administrative records, directly from HCRA members, and website searches. RESULTS: In addition to advancing knowledge and providing capacity building support to members via grants, fellowships, scholarships, training, events and targeted translation support, key impacts of HCRA-member research teams included: (i) the establishment of a regional biobank that has distributed over 13,600 samples and became largely self-sustaining; (ii) conservatively leveraging $43.8 M (s.a.$20.5 M - $160.5 M) in funding and support from the initial $9.7 M investment; (iii) contributing to clinical practice guidelines and securing a patent for identification of stem cells for endometrial cell regeneration; (iv) shifting the treatment paradigm for all tumour types that rely on nerve cell innervation, (v) development and implementation of the world's first real-time patient treatment verification system (Watchdog); (vi) inventing the effective 'EAT' psychological intervention to improve nutrition and outcomes in people experiencing radiotherapy for head and neck cancer; (vi) developing effective interventions to reduce smoking rates among priority groups, currently being rolled out to disadvantaged populations in NSW; and (vii) establishing a Consumer Advisory Panel and Consumer Engagement Committee to increase consumer involvement in research. CONCLUSION: Using FAIT methodology, we have demonstrated the significant impact and downstream benefits that can be achieved by the provision of infrastructure-type funding to regional and rural research collaboratives to help address inequities in research activity and health outcomes and demonstrates a positive return on investment.

Building a programme theory of a specialist paediatric palliative and hospice care programme: development process and methodological reflection.

BACKGROUND: Paediatric palliative and hospice care aims to improve the quality of life of children with life-limiting and life-threatening conditions and their families. The number of these patients has risen significantly in recent years, resulting in an increased need for palliative care for this population. Although the need for paediatric palliative and hospice care is growing, meaningful outcome evaluation to demonstrate its effectiveness as a complex healthcare intervention is in its early stages. For complex interventions (programmes), theory-based evaluations have grown in prominence in recent years. They seek to understand how and why an intervention works by uncovering its underlying mechanisms by means of programme theory. To support both outcome evaluation in paediatric palliative care and a reflective practice of programme theorizing, we aimed to describe the construction of a programme theory for a specialist paediatric palliative and hospice care programme in Austria and to offer a reflective account of its development process. METHODS: We drew on a combination of theory-based evaluation frameworks to construct a programme theory consisting of an action and a change component. Through multiple iterations, incorporating different stakeholders' perspectives and drawing on different sources of knowledge and theory, we theorized how and why the programme likely achieves its intended outcomes. RESULTS: The programme theory outlines the proposed chains of events, causal mechanisms and outcomes of a specialist paediatric palliative and hospice care programme for children and families in several areas corresponding to its main conceptual tenets. Through a range of activities and interventions, the programme triggers coping and adaptation mechanisms that ultimately contribute to family and child wellbeing in physical, psychological, social, and spiritual dimensions. Established trust and partnership between children/families and healthcare professionals as well as a person-centered and family-centered approach were identified as enabling factors. CONCLUSIONS: Our findings provide insights into how a specialized paediatric palliative and hospice care programme works to achieve its intended outcomes for children and families. This helps demonstrate its impact, contributing to meaningful outcome evaluation and service improvement.

Evaluation Resources for Asthma Programs and Beyond.

Evaluation can ensure the quality of public health programs. Systematic efforts to identify and fully engage everyone involved with or affected by a program can provide critical information about asthma programs and the broader environment in which they operate. To assist evaluators working at programs funded by the Centers for Disease Control and Prevention (CDC's) National Asthma Control Program (NACP), we developed a package of tools that build on the CDC's 1999 Framework for Program Evaluation in Public Health. The resulting suite of evaluation tools guides evaluators through a structured but flexible process, engaging a diverse array of interest holders and actively involving them in evaluation planning and implementation, all while strengthening their capacity to meaningfully contribute to the evaluation process. For our newest tool, our team reviewed the recent evaluation literature to create an enhanced version of the 1999 framework that describes important elements of professional evaluation practice. Although the original framework describes the steps to take in conducting an evaluation and the standards for a high-quality evaluation, our enhanced framework includes an explanation of how evaluators should approach their work: by incorporating critical reflection, interpersonal competence, situational awareness, and cultural responsiveness. In this article, we highlight many of the evaluation resources our team has created since the NACP's inception, culminating in a free e-text called Planting the Seeds of High-Quality Program Evaluation in Public Health. Public health professionals working in many types of programs - not just asthma - may find these resources useful.

Development and Implementation of a Hospitalist Faculty Development Program in a University- and Community-Based Multihospital System.

OBJECTIVES: Robust faculty development (FD) is an emerging area of focus within hospital medicine, a relatively new specialty with limited mentorship infrastructure to find and develop a professional niche. There are few descriptions in the literature of establishing and evaluating an FD program with strategies to evaluate success, invite collaboration, and achieve feasible, useful metrics. METHODS: We created our University Division of Hospital Medicine's FD Program to help community and academic hospitalist faculty fulfill professional goals in (and beyond) quality improvement, leadership, education, and clinical skills. We describe program development, initial implementation, and early evaluation results. We outline program roles and offerings such as professional development awards, lectures, and mentorship structures. RESULTS: Our program was successfully implemented, measured by engagement and participation via preliminary indicators suggesting programmatic effectiveness: faculty who applied for (and continued participation in) mentorship and faculty development awards and faculty who attended our lecture series. Since program implementation, faculty retention has increased, and percentages of faculty reporting they were likely to remain were stable, even during the coronavirus disease 2019 pandemic. Scholarly production increased and the number of division associate professors/professors grew from 2 in 2015 to 19 in 2024. CONCLUSIONS: Our experience can guide institutions seeking to support and encourage faculty professional development. Lessons learned include the importance of needs assessment and leadership commitment to meeting identified needs; how a steering committee can amplify the effectiveness and relevance of FD efforts; and the utility of multiple recognition strategies-quarterly newsletters, monthly clinical recognition, mentions on social media-to support and encourage faculty.

Facilitators and barriers to monitoring and evaluation at syringe service programs.

BACKGROUND: Syringe services programs (SSPs) provide harm reduction supplies and services to people who use drugs and are often required by funders or partners to collect data from program participants. SSPs can use these data during monitoring and evaluation (M&E) to inform programmatic decision making, however little is known about facilitators and barriers to collecting and using data at SSPs. METHODS: Using the Consolidated Framework for Implementation Research (CFIR), we conducted 12 key informant interviews with SSP staff to describe the overall landscape of data systems at SSPs, understand facilitators and barriers to data collection and use at SSPs, and generate recommendations for best practices for data collection at SSPs. We used 30 CFIR constructs to develop individual interview guides, guide data analysis, and interpret study findings. RESULTS: Four main themes emerged from our analysis: SSP M&E systems are primarily designed to be responsive to perceived SSP client needs and preferences; SSP staffing capacity influences the likelihood of modifying M&E systems; external funding frequently forces changes to M&E systems; and strong M&E systems are often a necessary precursor for accessing funding. CONCLUSIONS: Our findings highlight that SSPs are not resistant to data collection and M&E, but face substantial barriers to implementation, including lack of funding and disjointed data reporting requirements. There is a need to expand M&E-focused funding opportunities, harmonize quantitative indicators collected across funders, and minimize data collection to essential data points for SSPs.

MLA Research Training Institute (RTI) 2018 and 2019: participant research confidence and program effectiveness.

Objective: The article reports on an assessment of the effectiveness of the MLA Research Training Institute (RTI) for the years 2018 and 2019. The RTI is a year-long continuing education research methods training and support program for health sciences librarians. The study focuses on assessing RTI participants' research confidence after program completion and compares these results with their perceptions of workshop/program performance and learning outcomes. In addition, the authors discuss how the findings were applied to inform and improve the program. Methods: The study used a 26-item questionnaire, RTI Research Confidence Questionnaire, to gather information on participants' self-reported research confidence before the workshop, immediately after the workshop, and one year after the workshop to determine statistically significant differences. Differences in research confidence were identified by using three nonparametric statistical tests. Additional workshop and program surveys were used to corroborate the research confidence findings. Results: Post-workshop and one-year-after-workshop research confidence ratings were significantly higher than pre-workshop levels for years 1 and 2. A comparison of median ratings between years 1 and 2 showed significant increases in research confidence for nine items in year 2. Participants' positive perceptions of workshop/program effectiveness and learning outcomes corroborated these findings. Conclusion: Overall assessment findings indicated that RTI training helped participants understand, use, and apply research skills to conduct research. Findings also revealed that participants' heightened research confidence persisted at least 12 months postintervention. The RTI Research Confidence Questionnaire proved effective for rigorously assessing and improving the RTI program. This study enhances the currently limited evidence on evidence-based approaches for assessing and improving research instruction for librarians.

A community engagement program to improve awareness for credible online health information.

Background: The volume of online health information available makes it difficult to navigate and check its validity and reliability. A community-based MedlinePlus training program was developed to improve participants' ability to access credible online health information. Case Presentation: The program was a public-private partnership between a managed care organization and four local public libraries. A total of eight programs were held between October and November 2017. Each program had a 30-minute cooking demonstration followed by a 30-minute training on access to and navigation of the MedlinePlus website. Program participants were Medicaid beneficiaries, dually eligible for Medicare and Medicaid beneficiaries, and community members from a Pennsylvania county (n=39). A pre-and post-training questionnaire was administered to assess participants' knowledge and practice, and their ability to access health information on the MedlinePlus website. We conducted a retrospective analysis of the data collected during the MedlinePlus trainings. Results from the Wilcoxon Signed Rank test indicated no statistically significant change in participants' ability to access information (Z= -1.41, p=0.16) after attending the program. Conclusion: Although the median pre- to post-program responses improved from 'incorrect' to 'correct,' the number of programs held, and low attendance might be the reason for non-significant results. Participants reported that the program was informative, the website was comprehensive and user-friendly, and they were impressed by the healthy and inexpensive meal preparation from discount store-bought food. Holding MedlinePlus training programs in conjunction with a cooking program and collaborating with local public libraries might be a promising format that needs additional research.

Optimize and Thrive: An Electronic Health Record Optimization Program Case Study.

Although electronic health record optimization programs are common in healthcare organizations, a dearth of published evaluations of these programs exists. Little is known about the ability of optimization programs to handle flooding requests for change and achieve their objectives of cost savings, value, quality of care, and efficiency. This program evaluation reviewed one organization's electronic health record clinical optimization program. The evaluation examines the implementation of the insulin dosing calculator project at five hospitals within a large nonprofit healthcare organization using interviews, project documents, reported insulin dosing errors, and workflow observation to determine if the program provides sufficient structure and processes to successfully implement large optimization projects and achieve the project's desired outcomes. This evaluation finds that the optimization program processes support the implementation of large projects. The program can improve the planning of human resources to increase productivity and reduce waste. A clearer definition of meaningful project outcomes at the onset would allow the program to measure and communicate its accomplishments across the organization.

Evaluation of a Cardiovascular Disease/Diabetes Mellitus Expansion Program for Community Health Workers Employed by Rhode Island Community Health Teams.

CONTEXT: The integration of certified community health workers (CCHWs) with specialty chronic disease training into clinical care teams has demonstrated improvements in chronic disease quality of care, management, and outcomes. PROGRAM: Rhode Island Department of Health's Diabetes, Heart Disease, and Stroke Program expanded the roles of CCHWs employed by Community Health Teams for chronic disease with a focus on cardiovascular disease (CVD) and diabetes mellitus (DM) from 2020 to 2023. Rhode Island Department of Health's Diabetes, Heart Disease, and Stroke Program sought to determine whether patient health behaviors and clinical outcomes improved with specialty trained CCHW support. IMPLEMENTATION: Community Health Teams identified high-risk or rising-risk patients with hypertension, high cholesterol, and/or diabetes. During an infrastructure phase, patients were assigned a CCHW who had not received CVD/DM specialty training. During a performance phase, a separate cohort of patients was assigned a CVD/DM specialty-trained CCHW. In each phase, patients were seen by the CCHWs at least twice and completed baseline and follow-up health assessments. The trained CCHWs utilized the baseline assessment to offer health coaching specific to the patient's chronic disease-related needs. EVALUATION: Improvements in blood pressure readings and cholesterol were observed at an individual level for CVD patients. However, a significant difference was not observed for hypertension or high cholesterol when comparing phases. Individual-level results indicated improved HbA1c values for DM patients; however, the differences in clinical values were not significant. Although there were no significant differences for clinical values between the phases, the proportion of patients who reported confidence in managing their condition(s) increased from baseline to follow-up for both phases. DISCUSSION: It cannot be concluded that specialty-trained CCHWs have significant impact on patient behaviors and clinical outcomes. However, overall CCHW intervention did result in improved self-efficacy in patients to manage their chronic conditions. Further evaluation is needed to understand what factors led to improved patient confidence levels.

Process Evaluation of a Pilot Food Insecurity Resource Navigation Program Integrated Within Pediatric Primary Care: Utilizing RE-AIM to Inform Program Scale-up.

OBJECTIVE: The purpose of this study was to examine the implementation and effectiveness of a novel pediatric food navigation program through a structured, comprehensive evaluation using the RE-AIM framework. DESIGN AND PARTICIPANTS: Data were collected from October 2021 through August 2022 for 166 pediatric patients and their families who were screened as food insecure or high-risk for food insecurity and were referred to this pilot food resource navigation program (FRNP). A total of 88 patients' guardians consented to participate in this FRNP, receiving initial service connection. Participants were contacted via telephone by trained navigators within this health system to assess food security status across three time points (baseline, follow-up 1 [1- <3 months], and follow-up 2 [3-6 months]) and facilitate connection to appropriate community-based resources related to food assistance. RESULTS: In this sample, we had an overrepresentation of Hispanic patients and an underrepresentation of Non-Hispanic Black and White patients relative to the available clinic population. Patients participating in the navigation program showed incremental shifts toward food security from baseline to two follow-up points. Integration within primary care was supported by physician champions across participating clinics and alignment with systemwide, updated universal screening guidelines to support projected increases in families requiring connecting to assistance programs. Through this evaluation, a comprehensive list of community-based food resource programs related to food assistance was integrated into electronic documentation for navigators to alleviate navigator burden and sustain the effect of this FRNP's implementation. CONCLUSIONS: These findings may be used to inform expansion of current programming efforts within this FRNP and to clarify process evaluations of broader health system-based programming. Further research, building on the findings of this pilot study, is needed to examine the longitudinal, causal effect of FRNPs in pediatric food security and long-term health outcomes for replication across health systems nationwide.

Data to Care Pilot Program in Chicago: Experience, Outcomes, and Direction for the Future.

CONTEXT: Data to Care (D2C) involves sharing HIV surveillance data between health care facilities and health departments to improve continuity of care for people living with HIV (PLWH). The Chicago Department of Public Health (CDPH) initiated a D2C pilot program at the University of Chicago Medicine (UCM) from June 2016 to September 2019. OBJECTIVES: To describe the proportion of patients reported by UCM as not in care who were able to be matched to CDPH enhanced HIV/AIDS Reporting System (eHARS) and to report the individual-level factors associated with matching and viral suppression. DESIGN: Retrospective program evaluation. SETTING: UCM, an academic health care center that provides HIV care to adults via a Ryan White clinic on the south side of Chicago. PARTICIPANTS: Adult PLWH who had received care at UCM but did not have current documented HIV care visit(s). MAIN OUTCOME MEASURE: Proportion of matched patients; factors associated with matching and viral suppression. RESULTS: Overall, 72.4% (n = 813/1123) of patients reported by UCM were matched by CDPH to eHARS. Individuals aged 40 to 49 years (odds ratio [OR] = 1.99; 95% confidence interval [CI], 1.10-3.62), 50 to 59 years (OR = 2.47; 95% CI, 1.37-4.47), and 60 years or older (OR = 6.18; 95% CI, 3.18-12.32) were more likely to match in eHARS. People who lived outside of Chicago (OR = 0.09; 95% CI, 0.05-0.15) or with unknown zip codes (OR = 0.08; 95% CI, 0.05-0.12) were less likely to match. Men who have sex with men and persons older than 50 years were more likely to be virally suppressed. CONCLUSIONS: D2C is an evidence-based strategy for reengagement of PLWH; however, program implementation relies on successful data matching. We found that a large proportion of patients from UCM were not matched, particularly those who were younger or lived outside of Chicago. Additional research is needed to understand ways to improve data matching to facilitate reengagement in HIV care.

Child Care Center Staff Readiness to Change in an Early Childhood Obesity Prevention Program.

CONTEXT: The childcare center (CCC) setting has the potential to be a strong foundation that supports the introduction of sustainable healthy lifestyle behaviors to prevent childhood obesity. It is important to assess barriers and facilitators to healthy weight development initiatives via program evaluation, including measuring CCC staff readiness to change. OBJECTIVE: The overall goal of this study was to assess the readiness level over 1 school year among CCC staff who participated in "Healthy Caregivers-Healthy Children" (HC2), a cluster randomized controlled trial that evaluated the effectiveness of a childhood obesity prevention program from 2015 to 2018 in 24 low-income, racially/ethnically diverse centers. A secondary outcome was to assess how a CCC's stage of readiness to change was associated with CCC nutrition and physical activity environment, measured via the Environment and Policy Assessment and Observation (EPAO) tool. DESIGN: Mixed-models analysis with the CCC as the random effect assessed the impact of readiness to change over time on EPAO outcomes. PARTICIPANTS: Eighty-eight CCC teachers and support staff completed the HC2 readiness to change survey in August 2015 and 68 in August 2016. Only teachers and staff randomized to the treatment arm of the trial were included. MAIN OUTCOME: Readiness to change and the EPAO. RESULTS: Results showed the majority of CCC staff in advanced stages of readiness to change at both time points. For every increase in readiness to change stage over 1 year (eg, precontemplation to contemplation), there was a 0.28 increase in EPAO nutrition scores (95% confidence interval [CI], 0.04-0.53; P = .02) and a 0.52 increase in PA score (95% CI, 0.09-0.95; P = .02). CONCLUSIONS: This analysis highlights the importance between CCC staff readiness to change and the CCC environment to support healthy weight development. Future similar efforts can include consistent support for CCC staff who may not be ready for change to support successful outcomes.

Evaluating the Effectiveness of a Patient-Centered, Nonphysician Led Self-Monitoring Blood Pressure Program in a Rural Federally Qualified Health Center.

CONTEXT: Uncontrolled hypertension can lead to an increased risk of cardiovascular disease, myocardial infarction, stroke, or death. Self-monitoring blood pressure (SMBP) programs have been associated with blood pressure (BP) reduction, particularly among rural, minority, and low-income individuals. There is limited literature about nonphysician SMBP programs. OBJECTIVES: To evaluate the effectiveness of an SMBP program designed to engage nonphysician team members in hypertension management within a federally qualified health center (FQHC). DESIGN: Self-monitoring blood pressure program activities were implemented using a Plan, Do, Study, Act model. The University of Washington Health Promotion Research Center evaluated processes and patient-level outcomes in a mixed-methods design. Quantitative analysis examined clinical outcomes related to hypertension, and qualitative analysis relied on interviews with clinical staff examining program implementation, adoption, and sustainability. SETTING: Family Health Centers (FHCs), a FQHC located in rural Washington, serving medically underserved populations. PARTICIPANTS: Two hundred five active SMBP patients out of 2600 adult patients (over 18 years old) who had a diagnosis of hypertension within the last 12 months. INTERVENTION: Patients with uncontrolled hypertension were given a BP cuff to log their daily BP. Patients met with community health workers (CHWs) and medical staff to review logs and set self-management goals over 3 to 4 months. MAIN OUTCOME MEASURE: Controlled BP measurements and factors to implementation and sustainment. RESULTS: Facilitators to implementation included expanded telehealth reimbursement during the COVID-19 pandemic, integration of CHWs, and linguistically adapted resources. Barriers included a lack of reimbursement for nonphysician time and BP monitors. Quantitative results demonstrated an effort to reach minoritized populations but did not show an improvement in BP outcomes. CONCLUSIONS: Family Health Center implemented an SMBP program adapted to meet the linguistic and social needs of their patients. The successful integration of CHWs and the need for reimbursement policies to support SMBP programs were key factors for implementation and sustainability.