Public Health Learning Agenda for Systems Change Toolkit: National Pilot Evaluation Results.

CONTEXT: There have been multiple calls in the United States for public health workforce development approaches that expand practitioner skill sets to respond to profound inequities and improve population health more effectively. However, most workforce models address individual competencies that instead focus on collective approaches to systems change. PROGRAM: In response to this opportunity, the HRSA-funded Regional Public Health Training Centers (PHTCs) and the University of Illinois Chicago Policy, Practice, and Prevention Research Center (P3RC) released Creating a Learning Agenda for Systems Change: A Toolkit for Building an Adaptive Public Health Workforce (the Toolkit) in December 2020. We later supplemented the Toolkit with additional learning activities to launch the Learning Agenda Toolkit Pilot Test (Toolkit Pilot). IMPLEMENTATION: From June to August 2021, 24 diverse teams piloted the Toolkit. Teams completed a multistep process simulating the development of a learning agenda aimed at addressing community health issues and impacting systems change. EVALUATION: We conducted an evaluation process to assess the usability and impact of the Toolkit Pilot to inform its improvement and future implementation. An evaluation subcommittee analyzed worksheets completed by the Pilot Teams that are aligned to the Learning Agenda steps and conducted and analyzed 12 key informant interviews using concepts from the Toolkit Pilot Logic Model. FINDINGS AND DISCUSSION: Evaluation results suggest that most Pilot Teams found that the Toolkit Pilot offered a step-by-step process toward a clear vision that produced a concrete product on how to address community challenges through learning and systems change. Pilot Teams noted that the Toolkit Pilot provided exposure to and a unique focus on systems thinking; however, prior knowledge of systems thinking and systems change was important. Building readiness for systems change and having more time, resources, and technical assistance would be needed for future versions of the Learning Agenda Toolkit.

Training Public Health Professionals on Adaptive Challenges-An Innovative Approach Using Remote Learning Modalities.

CONTEXT: Remote learning opportunities increase access to public health training. Innovative approaches are needed to promote active engagement and learning when tackling more complex, adaptive challenges that are nuanced, lack quick and easy solutions, and require a transformation of values and beliefs. PROGRAM: The Rocky Mountain Public Health Training Center's (RM-PHTC's) training framework considers the complexity of the challenge (technical to adaptive) when selecting the learning modality. Remote learning opportunities on adaptive challenges are addressed using virtual workshops, online courses, ECHO (Extension for Community Healthcare Outcomes) series, and communities of practice that include a combination of multiple sessions, cohort-based learning, peer learning, practice-based application, and live, interactive sessions. The specific modality chosen depends on the audience and amount of content delivery. IMPLEMENTATION: Virtual workshops are single events that encourage peer learning using a blend of instruction and practice-based work. Online courses deliver content to learning cohorts through an online platform combined with multiple, facilitated "live learning sessions." ECHO series include a short delivery of content, combined with multiple, facilitated, face-to-face, case-based learning sessions with a cohort of peers. Communities of practice encourage a bidirectional peer exchange of resources, approaches, and challenges through online sharing platforms and virtual meetings. EVALUATION: Using the Kirkpatrick training evaluation model, learners of public health reported that their understanding of the subject matter improved and that they had identified actions that they would apply to their work. In qualitative feedback, learners shared feedback on elements that facilitated learning on adaptive challenges, including interactive breakout groups with peers and practice-based applications. DISCUSSION: Remote learning opportunities increase access for public health professionals in rural areas and encourage knowledge exchange region-wide. The RM-PHTC's training framework matches learning opportunities that address adaptive challenges with modalities that include elements that encourage the sharing of ideas and cocreation of solutions.