Columbia University Master of Public Health Core Curriculum: Implementation, Student Experience, and Learning Outcomes, 2013-2018.

OBJECTIVES: Public health education must respond to 21st-century public health challenges in an ever-evolving landscape. We describe implementation and educational outcomes of the Columbia University Master of Public Health (MPH) Core (hereinafter, Core) curriculum since its inception. METHODS: This retrospective evaluation combined 6 years (2013-2018) of student survey data collected from students (N = 1902) on the structure and delivery of the Core curriculum to quantify implementation, student experience, and learning outcomes, both during study (Core Evaluation Survey [CES]) and after graduation (Graduate Exit Survey [GES]). We used χ2 tests and analysis of variance to compare outcomes across years, and we used McNemar tests to compare differences in outcomes from the same students at different time points. RESULTS: Of 1902 respondents to the CES, 1795 (94.4%) completed the Core curriculum. During the study period, 81.7% of students were able to integrate concepts across Core curriculum modules with ease; postgraduation, a similar proportion of respondents were able to apply Core curriculum content to departmental and certificate coursework and applied field experiences. On-time graduation rates were high (range, 85%-93%). CONCLUSIONS: The high percentage of students who reported their ability to integrate concepts and who completed the Core during the study period likely reflected changes to teaching team structures, training, attention to inclusion and equity, and collaboration to implement active learning strategies. The Core curriculum meets its intended goals by providing critical learning abilities to support ongoing interdisciplinary work.

Defining Core Competencies for Epidemiologists in Academic Settings to Tackle Tomorrow's Health Research Challenges: A Structured, Multinational Effort.

Only a few efforts have been made to define core competencies for epidemiologists working in academic settings. Here we describe a multinational effort to define competencies for epidemiologists, who are increasingly facing emerging and potentially disruptive technological and societal health trends in academic research. During a 1.5-year period (2017-2019), we followed an iterative process that aimed to be inclusive and multinational to reflect the various perspectives of a diverse group of epidemiologists. Competencies were developed by a consortium in a consensus-oriented process that spanned 3 main activities: 2 in-person interactive meetings held in Amsterdam, the Netherlands, and Zurich, Switzerland, and an online survey. In total, 93 meeting participants from 16 countries and 173 respondents from 19 countries contributed to the development of 31 competencies. These 31 competencies included 14 on "developing a scientific question" and "study planning," 12 on "study conduct and analysis," 3 on "overarching competencies," and 2 on "communication and translation." The process described here provides a consensus-based framework for defining and adapting the field. It should initiate a continuous process of thinking about competencies and the implications for teaching epidemiology to ensure that epidemiologists working in academic settings are well prepared for today's and tomorrow's health research.

Term Limits in Academic Public Health Administration.

OBJECTIVES: Term limits might be appropriate for leadership positions in academic public health. This study assessed the appointment processes and terms for deans, directors, and chairs of schools and programs of public health and their views on term limits. METHODS: A 10-question survey was developed for the Association of Schools and Programs of Public Health and provided electronically to 127 deans and program directors in November and December 2019, of whom 58 (46%) responded. RESULTS: Of 54 respondents to the question on term limits, 45 deans and directors of schools and programs of public health served with no terms or limits and 9 served with terms of 3-5 years with no limits on the number of terms. Respondents largely agreed with most arguments for or against term limits. Of 51 respondents, most indicated completely or moderately valid support for 2 arguments for term limits: diversity (n = 40) and succession planning (n = 40). Of 51 respondents, most indicated completely or moderately valid support for 3 arguments against term limits: stable and continuous leadership (n = 40), time for leadership development (n = 37), and loss of institutional memory (n = 35). Twenty-seven of 53 responding deans and directors viewed the most appropriate terms and limits as being more restrictive than their current terms; the other 26 viewed the most appropriate terms as being the same as their current terms. No respondents preferred less restrictive limits than their current terms. CONCLUSION: Although term limits for deans, directors, and chairs are rare in schools and programs of public health, many deans and directors view term limits as appropriate. Schools and programs may reconsider their current policies for term limits.

Enhancing Access to Quality Online Training to Strengthen Public Health Preparedness and Response.

OBJECTIVES: To improve access to quality online training materials developed from 2010 to 2015 by 14 Preparedness and Emergency Response Learning Centers (PERLCs) by creating quality standards and enhancing searchability through a new Web-based public health training catalog. METHODS: The PERLC-developed training materials (n = 530) were evaluated for their capability to support development of preparedness competencies as established by 2 evidence-based competency frameworks. Inclusion/exclusion criteria and evaluation guidelines regarding training quality (design, technology, and instructional components) were systematically applied to PERLC products to create a training catalog. Twenty emergency preparedness professionals pilot tested content and provided feedback to improve catalog design and function. RESULTS: Seventy-eight percent of PERLC resources (n = 413) met our quality standards for inclusion in the catalog's searchable database: 358 self-paced courses, 55 informational briefs, and other materials. Twenty-one training bundles were curated. DISCUSSION: We established quality guidelines, identified strengths and weaknesses in PERLC resources, and improved accessibility to trainings. Guidelines established by this work can be generalized to trainings outside the preparedness domain. Enhancing access to quality training resources can serve as a valuable tool for increasing emergency preparedness competence.

A Public Health of Consequence: Shifting the Cultural Narrative From Churning Grants to a Scholarship of Consequence.

A confluence of challenges is impeding faculty members' ability to prioritize research with the goal of achieving a public health of consequence: research designed to improve conditions to produce a healthier society. Together, these challenges create a "churn" culture in which faculty focus on generating new business (i.e., grant funding and associated incentives) to replace lost revenue (i.e., expiring grants); this culture can relegate public health impact to a back seat.We share three strategies and related insights from our efforts to shift our department's cultural narrative from churn to a "scholarship of consequence": crafting research proposals of consequence, fostering thought leadership through collaborative writing, and mentoring faculty with a view to a scholarship of consequence.We describe each of the strategies and interim progress. Although they are a work in progress, we conclude that despite initial concerns, our evaluation metrics indicate improvement.

Applied Learning for Undergraduates: Integrating NCHEC Competencies and CEPH Public Health Domains in a Public Health Practice Course.

To meet Council on Education for Public Health (CEPH) accreditation standards for a standalone undergraduate public health program, faculty at the University of North Carolina Wilmington conducted a matrix exercise to assess curricular alignment with the CEPH Domains of Public Health (PHDs) and the National Commission for Health Education Credentialing (NCHEC) competencies. Addressing gaps in the undergraduate public health program identified by the matrix exercise drove development of a new course, Public Health Practice. The course was designed to use real world experience to provide students with the tools and skills needed for the practice of public health. Written assignments such as a needs assessment and a logic model were used to simultaneously expose and prepare students to address real-life public health challenges and to introduce students to selected CEPH PHDs and NCHEC competencies. This integration of competencies and domains into a course curriculum may be of benefit to undergraduate public health programs seeking to develop courses with applied learning aligned with CEPH and NCHEC requirements.

Injury prevention class exercise: three-pronged list making.

It is difficult to find classroom exercises that have been specifically designed for injury prevention students. The suggested list-making classroom exercise forces students to recognise and devise many policy and programmatic options over and above the ones that normally spring to mind. Most important, it helps give students a better understanding of what is meant by, and the potential usefulness of, the public health approach to injury prevention.

Gaps in Training in Interdisciplinary Social and Behavioral Sciences and Applications Among Undergraduate and Graduate Students in the 22 Top-Ranked Schools of Public Health in China.

The next generation of public health professionals requires rigorous training in behavioral health, in order to design effective behavioral interventions to respond effectively to the epidemiological transition in China. This study aimed to investigate issues in training in social and behavioral sciences in public health in China. A cross-sectional survey was conducted among 1285 and 835 last-year undergraduate and graduate public health students in 2013. The results showed that (1) majority of undergraduate students but a minority of graduate students had enrolled in psychology, social medicine, and health promotion courses; (2) very few had enrolled in other social and behavioral sciences courses; (3) high percentages of students perceived significance, needs, and interests related to social sciences courses; (4) very few were familiar with commonly used behavioral health theories and constructs, or had applied such theories/constructs to their thesis. The situation deviates from international accreditation requirement. A timely review and benchmarking are warranted.

Evidence-based selection process to the Master of Public Health program at Medical University.

BACKGROUND: Evaluation of the predictive validity of selected sociodemographic factors and admission criteria for Master's studies in Public Health at the Faculty of Health Sciences, Medical University of Warsaw (MUW). METHODS: For the evaluation purposes recruitment data and learning results of students enrolled between 2008 and 2012 were used (N = 605, average age 22.9 ± 3.01). The predictive analysis was performed using the multiple linear regression method. In the proposed regression model 12 predictors were selected, including: sex, age, professional degree (BA), the Bachelor's studies grade point average (GPA), total score of the preliminary examination broken down into five thematic areas. Depending on the tested model, one of two dependent variables was used: first-year GPA or cumulative GPA in the Master program. RESULTS: The regression model based on the result variable of Master's GPA program was better matched to data in comparison to the model based on the first year GPA (adjusted R2 0.413 versus 0.476 respectively). The Bachelor's studies GPA and each of the five subtests comprising the test entrance exam were significant predictors of success achieved by a student both after the first year and at the end of the course of studies. CONCLUSIONS: Criteria of admissions with total score of MCQs exam and Bachelor's studies GPA can be successfully used for selection of the candidates for Master's degree studies in Public Health. The high predictive validity of the recruitment system confirms the validity of the adopted admission policy at MUW.

Factors that influence full-time MPH Students' willingness in China: would You apply again for an MPH graduate degree if you had another opportunity?

BACKGROUND: Current and emerging challenges to public health in the 21st century are vastly different from those faced in previous centuries. And the shortage of health personnel and their low level of educational qualifications hindered the development of Chinese public health services. In order to fulfill this requirement, the Ministry of Education initiated a full-time, Master of Public Health (MPH) graduate programme in 2009. This study aimed to evaluate the level of graduate students' satisfaction with full-time Master of Public Health (MPH) education in China, and whether they would apply again for an MPH graduate degree if they had another opportunity to do so, as well as to identify the factors influencing their decision-making process. METHODS: An anonymous, web-based survey questionnaire containing 61 items was distributed to 702 MPH students in 35 universities or colleges. The questions covered the categories of student admission, training goals, lecture courses, practical training, research activities and mentorship. Levels of satisfaction were compared between MPH students who would choose MPH again as their graduate degree if they had another opportunity to do so and those who would not. Key influencing factors of training satisfaction were identified using logistic regression models. RESULTS: A total of 65.10% of the participants would apply again for MPH education if they had another opportunity to do so. The factors influencing students' willingness included their university type, the time since admission and their initial willingness. In addition, the four common factors (admissions & lecture courses, research activities & mentorship, practical training and training goals) emerging from factor analysis were all significantly positively correlated with student willingness (p < 0.001). CONCLUSIONS: Most MPH students surveyed were highly satisfied with their MPH education and, although they advocated for improvements and reforms in some aspects, they would still choose MPH as their graduate degree again if they had another opportunity to do so.

EpiAssist: Service-learning in public health education.

BACKGROUND: Although public health degree programs typically require practica and other field experiences, service-learning courses, with a focus on civic engagement and the application of classroom learning in real world settings, can go beyond these requirements and provide benefits to students and community-based practice partners. The goal of this paper is to assess potential benefits of service-learning programs for both graduate-level public health students and state and local public health agency partners. METHODS: EpiAssist is a new service-learning program developed at the School of Public Health of the Texas A and M University Health Science Center, USA, in January 2015. EpiAssist was integrated into a new course, Methods in Field Epidemiology. The integration of service-learning was guided by a partnership with the Texas A and M Center for Teaching Excellence. RESULTS: State, regional, and local public health partners requested EpiAssist via email or telephone. A listserv was used to recruit student volunteers to meet requests. 54 of 86 registered EpiAssist students (63%) participated in at least one of ten service-learning and three training activities between January and June, 2015. Service-learning activities included questionnaire development, in-person and telephone data collection, and data analysis. Training topics for students included the Epi Info™ software, community assessment and communicable disease reporting. Students and partner organizations provided generally positive assessments of this service learning program through an online evaluation. DISCUSSION: Service-learning provides students with enhanced classroom learning through applied public health experience in state, regional and local health departments. These experiences provide both needed surge capacity to public health departments and valuable hands-on field experience to students.

Strategic Planning in Population Health and Public Health Practice: A Call to Action for Higher Education.

POLICY POINTS: Scarce resources, especially in population health and public health practice, underlie the importance of strategic planning. Public health agencies' current planning and priority setting efforts are often narrow, at times opaque, and focused on single metrics such as cost-effectiveness. As demonstrated by SMART Vaccines, a decision support software system developed by the Institute of Medicine and the National Academy of Engineering, new approaches to strategic planning allow the formal incorporation of multiple stakeholder views and multicriteria decision making that surpass even those sophisticated cost-effectiveness analyses widely recommended and used for public health planning. Institutions of higher education can and should respond by building on modern strategic planning tools as they teach their students how to improve population health and public health practice. CONTEXT: Strategic planning in population health and public health practice often uses single indicators of success or, when using multiple indicators, provides no mechanism for coherently combining the assessments. Cost-effectiveness analysis, the most complex strategic planning tool commonly applied in public health, uses only a single metric to evaluate programmatic choices, even though other factors often influence actual decisions. METHODS: Our work employed a multicriteria systems analysis approach--specifically, multiattribute utility theory--to assist in strategic planning and priority setting in a particular area of health care (vaccines), thereby moving beyond the traditional cost-effectiveness analysis approach. FINDINGS: (1) Multicriteria systems analysis provides more flexibility, transparency, and clarity in decision support for public health issues compared with cost-effectiveness analysis. (2) More sophisticated systems-level analyses will become increasingly important to public health as disease burdens increase and the resources to deal with them become scarcer. CONCLUSIONS: The teaching of strategic planning in public health must be expanded in order to fill a void in the profession's planning capabilities. Public health training should actively incorporate model building, promote the interactive use of software tools, and explore planning approaches that transcend restrictive assumptions of cost-effectiveness analysis. The Strategic Multi-Attribute Ranking Tool for Vaccines (SMART Vaccines), which was recently developed by the Institute of Medicine and the National Academy of Engineering to help prioritize new vaccine development, is a working example of systems analysis as a basis for decision support.

Evaluation of recruitment and selection for specialty training in public health: interim results of a prospective cohort study to measure the predictive validity of the selection process.

BACKGROUND: The recruitment process for public health specialty training includes an assessment centre (AC) with three components, Rust Advanced Numerical Reasoning Appraisal (RANRA), Watson-Glaser Critical Thinking Appraisal (WGCT) and a Situation Judgement Test (SJT), which determines invitation to a selection centre (SC). The scores are combined into a total recruitment (TR) score that determines the offers of appointment. METHODS: A prospective cohort study using anonymous record linkage to investigate the association between applicant's scores in the recruitment process and registrar's progress through training measured by results of Membership Faculty Public Health (MFPH) examinations and outcomes of the Annual Review of Competence Progression (ARCP). RESULTS: Higher scores in RANRA, WGCT, AC, SC and TR were all significantly associated with higher adjusted odds of passing Part A MFPH exam at the first attempt. Higher scores in AC, SC and TR were significantly associated with passing Part B exam at the first attempt. Higher scores in SJT, AC and SC were significantly associated with satisfactory ARCP outcomes. CONCLUSIONS: The current UK national recruitment and selection process for public health specialty training has good predictive validity. The individual components of the process are testing different skills and abilities and together they are providing additive value.

A Logic Model for Evaluating the Academic Health Department.

Academic Health Departments (AHDs) are collaborative partnerships between academic programs and practice settings. While case studies have informed our understanding of the development and activities of AHDs, there has been no formal published evaluation of AHDs, either singularly or collectively. Developing a framework for evaluating AHDs has potential to further aid our understanding of how these relationships may matter. In this article, we present a general theory of change, in the form of a logic model, for how AHDs impact public health at the community level. We then present a specific example of how the logic model has been customized for a specific AHD. Finally, we end with potential research questions on the AHD based on these concepts. We conclude that logic models are valuable tools, which can be used to assess the value and ultimate impact of the AHD.

DEVELOPMENT AND IMPLEMENTATION OF A PRACTICAL PUBLIC HEALTH TRAINING SYSTEM IN CHINA.

Public health education is becoming an increasing priority among educators of medicine. In China, little attention has been paid to public health education reform. A new public health training system was introduced in China in 2007. We conducted this study during 2006-2012 to evaluate the graduate core competencies under the new system. Data were collected from 231 graduates and 49 public health agencies. The 144 graduates who enrolled in 2006 and were trained under the old system constituted the control group; the 87 graduates who enrolled in 2007 and were trained under the new system constituted the experimental group. Surveys of graduate core competencies found analyzing and solving problems in the laboratory, conducting on-site practice and learning new technologies were the top three abilities most expected by public health agencies. After 5-year practical ability training, the graduates in the experimental group had better performance; on-site practical ability and laboratory practical ability increased significantly by 24.5% and 20.0%, respectively. Three other important competencies also improved: designing epidemiologic surveys, collecting information from the literature and doing statistical analyses. However, preventing and controlling common diseases and dealing with emergencies remained weak. These results show the new training system should be continued, but revisions are needed to improve this training system, especially in the areas of preventing and controlling common diseases and dealing with emergencies.

A public health e-learning master's programme with a focus on health workforce development targeting francophone Africa: the University of Geneva experience.

BACKGROUND: Shortage of a competent public health workforce is as a worldwide problem. The situation is especially bad in sub-Saharan Africa. In 2008, the World Health Organization and the Global Health Workforce Alliance launched a call for proposals for a public health training programme with an emphasis on health workforce development specifically targeting Africa. Our article presents the development, implementation and evaluation of an e-learning Master of Advanced Studies in Public Health on Workforce Development. The project was developed in collaboration with academic partner institutions of 10 French-speaking African countries and local/regional/HQ WHO offices. METHODS: A five-step approach was adopted. First, a needs assessment study was done in the target countries, with identification of priority health issues. Second, student and tutor selection was done in collaboration with local WHO offices, health authorities and partner universities. Third, the e-platform was developed and a training workshop for tutors was organized. Fourth, the learning objectives were derived from the needs assessment study and an interactive educational approach was adopted. Fifth, the participation of students, their perception of the programme, their performance on assignments and community outcomes were monitored. RESULTS: The needs assessment allowed the identification of 12 priority health issues (trauma related to road accidents, maternal and child health, HIV/AIDS, mental heath, food and malnutrition, health resource management, infectious diseases, access to essential drugs, chronic diseases, health promotion, ageing and violence/conflicts) of which 10 were studied through the lens of the key public health disciplines (epidemiology, human resources, health project/service planning, health policy, communication, health economics/management, informatics and ethics/human rights), each validated through a certifying examination. Student participation, measured through connection hits (total: 58 256; mean: 168/student/module) and posted messages (total: 5994; mean: 18/student/module), was good, and global satisfaction was high (7.7/10). Twenty-nine students out of 37 obtained their master's degree from the University of Geneva. Outcomes reported include career development, strengthening of inter-country networks and common projects. CONCLUSIONS: Keys to the success of the programme were the enthusiasm and commitment of students, the availability of the coordination team, the simplicity of the electronic platform and the support of local/regional/WHO offices. Yet, the sustainability of the programme is not assured.

Developing core competencies for monitoring and evaluation tracks in South Asian MPH programs.

BACKGROUND: Monitoring and evaluation (M&E) provides vital information for decision-making and its structures, systems and processes are expected to be integrated throughout the life-cycle of public health programs. The acquisition of these skills should be developed in a structured manner and needs educational systems to identify core competencies in M&E teaching. This article presents our work on harmonizing M&E competencies for Masters level programs in the South Asian context and undertaking the global review of M&E track/ concentration offered in various Masters of Public Health (MPH) programs. METHODS: Through an online search and snow-balling, we mapped institutions offering M&E tracks/ concentrations in Masters of Public Health (MPH) programs globally. We obtained detailed information about their M&E curriculum from university websites and brochures. The data on curricular contents was extracted and compiled. We analyzed the curricular contents using the framework for core competencies developed by the Association of Schools of Public Health (ASPH); and the Miller's triangle. This data was then used to inform a consultative exercise aimed at identifying core competencies for an M&E track/ concentration in MPH programs in the South Asian context. RESULTS: Our curricular review of M&E content within MPH programs globally showed that different domains or broad topic areas relating to M&E are covered differently across the programs. The quantitative sciences (Biostatistics and Epidemiology) and Health Policy and Management are covered in much greater depth than the other two domains (Social & Behavioral Sciences and Environmental Health Sciences). The identification of core competencies for an M&E track/ concentration in the South Asian context was undertaken through a consultative group exercise involving representation from 11 institutions across Bangladesh, India, Nepal and Sri Lanka. During the consultation, the group engaged in a focused discussion to reach consensus on a set of 15 core competencies for an M&E track in South Asian MPH programs. CONCLUSION: This work presents an opportunity for institutions to identify and re-examine their M&E competencies as a part of their specialized tracks within MPH programs. Our curricular analysis approach has the potential for adaptation and further use in curriculum analysis across different academic specialties.