Long-Term Impact of Global Pediatrics Curriculum, Experience, and Mentorship in Pediatric Residency.

Global health education is offered increasingly during residency training. The University of Minnesota has offered a global pediatrics track to residents since 2005. This study aimed to understand the impacts of a global pediatrics track on graduates' career choices, skills, and current engagement in global health. An electronic survey was sent to 110 track graduates in February to April 2020. Data were analyzed with descriptive statistics and paired t-tests. Content analysis of written comments was conducted. The response rate was 62% overall, varying by question. Overall, 75% of responding graduates reported global pediatrics track participation affected their career choices. Eighty-four percent recalled plans to work in global health after graduation and 64% of respondents reported working in global health abroad or at home at the time of the survey. Incorporation of public health and global research represented the greatest percentage change in career plans from the time of enrollment to graduation (24% and 27%, respectively). Ninety-five percent of respondents reported that track participation improved their ability to elicit information about cultural beliefs and practices, and 86% reported improvement in cost-conscious care. An increase in global health knowledge and skills was the most common category of impact cited by respondents. Neonatal resuscitation, bubble continuous positive airway pressure, and homemade spacers for metered-dose inhalers were the most used global health-adapted skills. Our study found that graduates of the global pediatrics track perceive their participation affected their knowledge, skills, and attitudes positively, with the potential to improve clinical care and promote health equity locally and globally.

Interactive value-based curriculum: a pilot study.

BACKGROUND: Current health care costs are unsustainable, with a large percentage of waste attributed to doctor practices. Medical educators are developing curricula to address value-based care (VBC) in education. There is, however, a paucity of curricula and assessments addressing levels higher than 'knows' at the base of Miller's pyramid of assessment. Our objective was to: (1) teach residents the principles of VBC using active learning strategies; and (2) develop and pilot a tool to assess residents' ability to apply principles of VBC at the higher level of 'knows how' on Miller's pyramid. METHODS: Residents in medicine, medicine-paediatrics and medicine-dermatology participated in a 5-week VBC morning report curriculum using active learning techniques. Early sessions targeted knowledge and later sessions emphasised the application of VBC principles. Medical educators are developing curricula to address value-based care in education RESULTS: Thirty residents attended at least one session and completed both pre- and post-intervention tests, using a newly developed case-based assessment tool featuring a 'waste score' balanced with 'standard of care'. Residents, on average, reduced their waste score from pre-intervention to post-intervention [mean 8.8 (SD 6.3) versus mean 4.7 (SD 4.6), p = 0.001]. For those who reduced their waste score, most maintained or improved their standard of care. DISCUSSION: Our results suggest that residents may be able to decrease health care waste, with the majority maintaining or improving their management of care in a case-based assessment after participation in the curriculum. We are working to further incorporate VBC principles into more morning reports, and to develop further interventions and assessments to evaluate our residents at higher levels on Miller's pyramid of assessment.

The Collaborative Role of North American Departments of Pediatrics in Global Child Health.

Appeals for health equity call for departments of pediatrics to improve the health of all children including those from underserved communities in North America and around the world. Consequently, North American (NA) departments of pediatrics have a role in global child health (GCH) which focuses on providing health care to underserved children worldwide. In this review, we describe how NA departments of pediatrics can collaboratively engage in GCH education, clinical practice, research, and advocacy and summarize best practices, challenges, and next steps for engaging in GCH in each of these areas. For GCH in low- and middle-income countries (LMICs), best practices start with the establishment of ethical, equitable, and collaborative partnerships with LMIC communities, organizations, and institutions engaged in GCH who are responsible for the vast majority of work done in GCH. Other best practices include adequate preparation of trainees and clinicians for GCH experiences; alignment with local clinical and research priorities; contributions to local professional development and ongoing monitoring and evaluation. Challenges for departments include generating funding for GCH activities; recruitment and retention of GCH-focused faculty members; and challenges meeting best practices, particularly adequate preparation of trainees and clinicians and ensuring mutual benefit and reciprocity in NA-LMIC collaborations. We provide examples of how departments have overcome these challenges and suggest next steps for development of the role of NA departments of pediatrics in GCH. Collaborative implementation of best practices in GCH by LMIC-NA partnerships can contribute to reductions of child mortality and morbidity globally.

Describing Failure in a Clinical Clerkship: Implications for Identification, Assessment and Remediation for Struggling Learners.

BACKGROUND: In addition to training future members of the profession, medical schools perform the critical role of identifying students who are failing to meet minimum standards in core competencies. OBJECTIVE: To better understand reasons for failure in an internal medicine clerkship. DESIGN: A qualitative content analysis of letters describing reasons for students' failure. PARTICIPANTS: Forty-three students (31 men) who failed the internal medicine clerkship at the University of Minnesota Medical School, 2002-2013. APPROACH: We conducted a qualitative content analysis of the 43 letters describing reasons for students' failure. We coded critical deficiencies and mapped them to the Physician Competency Reference Set (PCRS) competency domains and classified them into two categories: conduct (unprofessional behaviors) and knowledge and skills specific to the practice of medicine. We then calculated the frequency of each critical deficiency. We statistically tested for relationships between gender and critical deficiencies in each of the competency domains. KEY RESULTS: We coded 50 critical deficiencies with all codes mapping to a PCRS competency domain. The most frequently cited deficiencies were "insufficient knowledge" (79 % of students) and "inadequate patient presentation skills" (74 %). Students exhibited critical deficiencies in all eight competency domains, with the highest concentrations in Knowledge for Practice (98 %) and Interpersonal and Communication Skills (91 %). All students demonstrated deficiencies in multiple competencies, with 98 % having deficiencies in three or more. All 43 students demonstrated deficits in the knowledge and skills category, and 81 % had concurrent conduct issues. There were no statistically significant relationships between gender and critical deficiencies in any competency domain. CONCLUSIONS: This study highlights both the diversity and commonality of reasons that students fail a clinical clerkship. Knowing the range of areas where students struggle, as well as the most likely areas of difficulty, may aid faculty in identifying students who are failing and in developing remediation strategies.

Teaching high-value care: a novel morning report.

BACKGROUND: Despite rising health care costs and calls for the incorporation of high-value care (HVC) into medical training, there are few described curricula to address this need. METHODS: We designed a single-group pre/post comparison to evaluate the impact of a 45-minute HVC morning report in one academic internal medicine programme on the trainees' self-reported knowledge of costs for common diagnostic tests, impact on future ordering practices and the educational value of the intervention. Medical trainees completed a diagnostic evaluation for a hypothetical case within the constraints of a budget during the morning report. Trainees completed a pre/post intervention survey regarding knowledge and attitudes towards HVC, and an evaluation of the intervention. The Wilcoxon signed rank test was used to determine differences between the pre/post intervention survey responses. There are few described curricula to address the need for the incorporation of high-value care into medical training RESULTS: Fifty-eight trainees participated in the educational activity: 57 completed the survey and 54 completed the evaluation. Our results indicate a significant increase following the morning report intervention in: the trainees' self-reported understanding of the cost for diagnostic tests (p < 0.001); the likelihood the cost of diagnostic tests would affect their future ordering practices (p < 0.001); and the likelihood that the cost of diagnostic tests would affect their timing of a diagnostic evaluation (p ≤ 0.001). The results also indicated a significant decrease in the likelihood that trainees would order extra diagnostic evaluations following the intervention (p = 0.015), and 96 per cent felt that the session was educationally valuable. DISCUSSION: A morning report incorporating cost of care can significantly increase trainees' perceived understanding of cost and affect self-reported ordering practices in an educationally valuable intervention.

An entrustable professional activity (EPA) for handoffs as a model for EPA assessment development.

Medical education is moving toward assessment of educational outcomes rather than educational processes. The American Board of Internal Medicine and American Board of Pediatrics milestones and the concept of entrustable professional activities (EPA)--skills essential to the practice of medicine that educators progressively entrust learners to perform--provide new approaches to assessing outcomes. Although some defined EPAs exist for internal medicine and pediatrics, the continued development and implementation of EPAs remains challenging. As residency programs are expected to begin reporting milestone-based performance, however, they will need examples of how to overcome these challenges. The authors describe a model for the development and implementation of an EPA using the resident handoff as an example. The model includes nine steps: selecting the EPA, determining where skills are practiced and assessed, addressing barriers to assessment, determining components of the EPA, determining needed assessment tools, developing new assessments if needed, determining criteria for advancement through entrustment levels, mapping milestones to the EPA, and faculty development. Following implementation, 78% of interns at the University of Minnesota Medical School were observed giving handoffs and provided feedback. The authors suggest that this model of EPA development--which includes engaging stakeholders, an iterative process to describing the behavioral characteristics of each domain at each level of entrustment, and the development of specific assessment tools that support both formative feedback and summative decisions about entrustment--can serve as a model for EPA development for other clinical skills and specialty areas.

Essential factors for the development of a residency global health track.

OBJECTIVE: There is increasing awareness of the importance of global health (GH) residency education but little guidance on what departmental, financial, and human resource support is required to develop a GH track. The authors aimed to identify essential factors and major obstacles to the development of a GH track. METHODS: A survey assessing curriculum, support, and factors considered essential to or obstacles to successful development of a GH track was sent to 24 GH education directors within pediatric residencies. RESULTS: In all, 19 programs (79%) completed the survey, and 6 factors were identified as essential for developing and sustaining a GH track by ≥ 95% of all GH education directors: supportive residency program director, resident commitment, supportive department chair, protected resident elective time, dedicated budget, and GH faculty with protected time. CONCLUSIONS: Residency programs aiming to start a GH track should start by assessing the availability and sustainability of these identified essential factors within their program.

Evidence within a portfolio-based assessment program: what do medical students select to document their performance?

BACKGROUND: Decisions about performance in programs of assessment that provide an array of assessment evidence require judgments about the quality of different pieces of assessment data to determine which combination of data points best represent a trainee's overall performance. AIM: In this article, we examine the nature of evidence selected by first-year medical students to include in a portfolio used to make promotion decisions. METHODS: We reviewed portfolios to examine the number, type, and source of assessments selected by students (n = 32) to document their performance in seven competencies. The quality of assessment data selected for each competency was rated by promotion committee members (n = 14). RESULTS: Findings indicate that students cited multiple types and sources of available assessments. The promotion committee rated evidence quality highest for competencies where the program provided sufficient evidence for students to cite a broad range of assessments. When assessments were not provided by the program, students cited self-generated evidence. CONCLUSION: We found that when student-constructed portfolios are part of an overall assessment system, students generally select evidence in proportion to the number and types of assessments available.

Automated assessment of medical training evaluation text.

Medical post-graduate residency training and medical student training increasingly utilize electronic systems to evaluate trainee performance based on defined training competencies with quantitative and qualitative data, the later of which typically consists of text comments. Medical education is concomitantly becoming a growing area of clinical research. While electronic systems have proliferated in number, little work has been done to help manage and analyze qualitative data from these evaluations. We explored the use of text-mining techniques to assist medical education researchers in sentiment analysis and topic analysis of residency evaluations with a sample of 812 evaluation statements. While comments were predominantly positive, sentiment analysis improved the ability to discriminate statements with 93% accuracy. Similar to other domains, Latent Dirichlet Analysis and Information Gain revealed groups of core subjects and appear to be useful for identifying topics from this data.