ABSTRACT
Background: In an era of global health security challenges such as the COVID-19 pandemic, there is greater need for strong leadership. Over the past decades, significant investments have been made in global health leadership development programs by governments and philanthropic organizations to address this need. Evaluating the societal impact of these programs remains challenging, despite consensus on the importance of public health leadership. Objective: This article identifies the gaps and highlights the critical role of monitoring and evaluation approaches in assessing the impact of global health leadership programs. Importantly, we also propose the theory of change (TOC) as a common framework and identify a set of tools and indicators that leadership programs can adapt and use. Methods: We carried out an informal review of major global health leadership programs, including a literature review on leadership program evaluation approaches. Current practices in assessing the short- to long-term outcomes of leadership training programs were explored and synthesized. We also examined use of program theory frameworks, such as theory of change to guide the evaluation strategy. We find the TOC approach can be enhanced by integrating evaluation-specific frameworks and establishing broad stakeholder buy-in. We highlight measurement challenges, proposed outcome indicators and evaluation methodologies, and outline the future direction for such efforts. Findings: Most evaluation of current leadership programs is focused on short-term individual-level outcomes, while reports on long-term societal impact were limited. Reciprocal impacts on and benefits for the "host" organizations were not included in evaluation metrics. Most programs had program logic or result chains, but with no well-articulated program theories. Conclusion: Key stakeholders involved in leadership training programs benefit from the evidence of rigorous program evaluations to inform decisions that address barriers in fostering global health leadership and improving population health outcomes. Insight into reciprocal change in host organizations is important. Evaluation of global health leadership training must go beyond the individual trainee and encompass organizational and community-level impacts. Documentation of long-lasting organizational and societal impacts is essential for donors to appreciate the return on their investment. Key Takeaways: Evaluation plays an important role in understanding how leadership development takes place and how it contributes to improving public health outcomes.Making the case for investments in leadership development programs requires robust evidence from monitoring and evaluation strategies that link investments beyond the individual-level to longer-term societal impacts.The first critical step towards a strategy for success is for leadership programs to clearly build, articulate, share, and use their program theories or theories of change.Theories of change help identify the pathways (and potential tensions) through which leadership development programs effect change at the individual, organizational and community levels.Evaluation methods that examine outcomes of leadership programs should be multi-method, multi-level, and where possible include counterfactual outcomes.Allocation of funds to evaluate on-going and long-lasting societal impact of leadership programs should be a routine practice.
Subject(s)
Global Health/education , Leadership , Organizational Innovation , Program Evaluation/methods , HumansABSTRACT
Introduction: The COVID-19 pandemic has forced a new look (or modernization) for both the obligations and approaches to achieve best-practices in global health learning. These best-practices have moved beyond traditional, face-to-face (F2F), classroom-based didactics to the use of innovative online, asynchronous and synchronous instructional design and the information and communication technology (ICT) tools to support it. But moving to this higher level of online in-service and pre-service training, key obligations (e.g., stopping neocolonialization, cultural humility, reversing brain drain, gender equity) must guide the modernization of instructional design and the supporting ICT. To positively impact global health training, educators must meet the needs of learners where they are. Purpose: We describe a set of multi-communication methods, e-Learning principles, strategies, and ICT approaches for educators to pivot content delivery from traditional, F2F classroom didactics into the modern era. These best-practices in both the obligations and approaches utilize thoughtful, modern strategies of instructional design and ICT. Approach: We harnessed our collective experiences in global health training to present thoughtful insights on the guiding principles, strategies, and ICT environment central to develop learning curricula that meet trainee needs and how they can be actualized. Specifically, we describe five strategies: 1. Individualized learning; 2. Provide experiential learning; 3. Mentor Mentor Mentor; 4. Reinforce learning through assessment; and 5. Information and communication technology and tools to support learning. Discussion: We offer a vision, set of guiding principles, and five strategies for successful curricula delivery in the modern era so that global health training can be made available to a wider audience more efficiently and effectively.