Keepers of the House: A documentary.

BACKGROUND: Our documentary, Keepers of the House, highlights ways that hospital housekeepers, typically unnoticed care team members, provide emotional support for patients and their families. This film addresses a gap in education by emphasizing the importance of valuing and reflecting on the unique lived experiences of others. APPROACH: We created this documentary to expose students to the experiences and perceptions of hospital housekeepers. A focus group with six hospital housekeepers informed an interview script for the film's creation. Nine additional housekeepers were then interviewed, which developed into a 15-min documentary. Healthcare students and educators from five disciplines viewed the documentary during their institution's Medical Education Day. EVALUATION: To expose students and educators to housekeepers' experiences, we designed our post-viewing survey to address whether the housekeepers' stories impacted their understanding of the role and value of these workers. Viewers were surprised by the depth and breadth of patient-housekeeper interactions, the trauma housekeepers experienced from patient loss and the pride housekeepers take in their work. The stories that touched the viewers varied but centred on connections between housekeepers and patients. Lessons learned focused on recognizing the contributions of unseen team members. IMPLICATIONS: This innovative documentary amplifies the perspectives of voices rarely heard in healthcare. We aim to use this film, alongside its associated learning session, in education and grand round settings to foster discussion around empathy, valuing underrecognised team members and applying these insights in practice. This work can be disseminated to other institutions, further amplifying underrepresented narratives in healthcare.

Spaced Repetition Flashcards for Teaching Medical Students Psychiatry.

OBJECTIVE: Retrieval practice, often using electronic flashcards, is increasingly utilized among medical students for self-study. In this study, the authors evaluated usage and satisfaction with electronic flashcards based on a medical school psychiatry curriculum. METHODS: First-year medical students at one institution consented to participate and received access to a set of pre-made flashcards. Surveys were distributed that collected demographic information along with measures of prior performance, test anxiety, and prior experience with electronic flashcards. The total number of flashcard reviews and time spent on the platform for each student were collected using statistics internally generated by the platform. Each student's final exam score was also collected. RESULTS: A total of 114 of 129 first year medical students (88%) consented to participate, and 101 students were included in the final analysis. Fifty-eight (56%) were flashcard users with a median of 660 flashcards studied over 2.95 h. A total of 87% of flashcard users found the flashcards to be helpful, and 83% of flashcard users would recommend the flashcards to someone else. Flashcard usage was not associated with final exam scores. CONCLUSIONS: This novel electronic study resource was well-received by first-year medical students for psychiatric instruction in medical school, though usage was not associated with higher exam scores.

Discontinuation of the USMLE Step 2 Clinical Skills Examination: Studying the Past to Define the Future.

The United States Medical Licensing Examination (USMLE) Step 2 Clinical Skills (CS) was discontinued in January 2021, marking a significant milestone in assessment of clinical skills. In this commentary, the authors trace the history of the Step 2 CS exam-beginning with its early roots in the 1960s up to its discontinuation in 2021. In this new era, the medical education community is replete with opportunities for advancing methodology and content associated with clinical skills assessment. The authors propose 3 main lessons gleaned from this rich history and modern evolution, which are aimed at defining a future that includes creative collaboration toward development of comprehensive, equitable, student-focused, and patient-centered clinical performance assessment. First, as it has done throughout history, the medical education community should continue to innovate, collaborate, and improve upon methods of clinical skills assessment. Second, medical educators should continue to shift to more complex and student-driven approaches of assessment, that is, assessments that provide an unstructured environment, are realistic with respect to the natural conditions, and do not limit students to lists of options or force them to take a certain path of reasoning. Third, medical educators should continue to rethink the role of assessment and ensure that all assessments, regardless of stakes or type, provide sufficient feedback for the student to identify areas of strength and weakness.

Grit protects medical students from burnout: a longitudinal study.

BACKGROUND: Burnout is a serious issue plaguing the medical profession with potential negative consequences on patient care. Burnout symptoms are observed as early as medical school. Based on a Job Demands-Resources model, this study aims to assess associations between specific job resources measured at the beginning of the first year of medical school with burnout symptoms occurring later in the first year. METHODS: The specific job resources of grit, tolerance for ambiguity, social support and gender were measured in Duke-NUS Medical School students at the start of Year 1. Students were then surveyed for burnout symptoms at approximately quarterly intervals throughout the year. Using high ratings of cynicism and exhaustion as the definition of burnout, we investigated the associations of the occurrence of burnout with student job resources using multivariable logistic regression analysis. RESULTS: Out of 59 students, 19 (32.2%) indicated evidence of burnout at some point across the first year of medical school. Stepwise multivariable logistic regression analysis identified grit as having a significant protective effect against experiencing burnout (Odds Ratio, 0.84; 95%CI 0.74 to 0.96). Using grit as a single predictor of burnout, area under the ROC curve was 0.76 (95%CI: 0.62 to 0.89). CONCLUSIONS: Grit was identified as a protective factor against later burnout, suggesting that less gritty students are more susceptible to burnout. The results indicate that grit is a robust character trait which can prognosticate burnout in medical students. These students would potentially benefit from enhanced efforts to develop grit as a personal job resource.

Evaluating the effectiveness of undergraduate clinical education programs.

Medical schools should use a variety of measures to evaluate the effectiveness of their clinical curricula. Both outcome measures and process measures should be included, and these can be organized according to the four-level training evaluation model developed by Donald Kirkpatrick. Managing evaluation data requires the institution to employ deliberate strategies to monitor signals in real-time and aggregate data so that informed decisions can be made. Future steps in program evaluation includes increased emphasis on patient outcomes and multi-source feedback, as well as better integration of existing data sources.

Communities of Practice in Peer Review: Outlining a Group Review Process.

Traditional peer review remains the gold standard for assessing the merit of scientific scholarship for publication. Challenges to this model include reliance on volunteer contributions of individuals with self-reported expertise; lack of sufficient mentoring and training of new reviewers; and the isolated, noncollaborative nature of individual reviewer processes.The authors participated in an Association of American Medical Colleges peer-review workshop in November 2015 and were intrigued by the process of group peer review. Subsequent discussions led to shared excitement about exploring this model further. The authors worked with the staff and editors of Academic Medicine to perform a group review of 4 submitted manuscripts, documenting their iterative process and analysis of outcomes, to define an optimal approach to performing group peer review.Individual recommendations for each manuscript changed as a result of the group review process. The group process led to more comprehensive reviews than each individual reviewer would have submitted independently. The time spent on group reviews decreased as the process became more refined. Recommendations aligned with journal editor findings. Shared operating principles were identified, as well as clear benefits of group peer review for reviewers, authors, and journal editors.The authors plan to continue to refine and codify an effective process for group peer review. They also aim to more formally evaluate the model, with inclusion of feedback from journal editors and authors, and to compare feedback from group peer reviews versus individual reviewer feedback. Finally, models for expansion of the group-peer-review process are proposed.

A Multi-Institution Collaboration to Define Core Content and Design Flexible Curricular Components for a Foundational Medical School Course: Implications for National Curriculum Reform.

Medical educators have not reached widespread agreement on core content for a U.S. medical school curriculum. As a first step toward addressing this, five U.S. medical schools formed the Robert Wood Johnson Foundation Reimagining Medical Education collaborative to define, create, implement, and freely share core content for a foundational medical school course on microbiology and immunology. This proof-of-concept project involved delivery of core content to preclinical medical students through online videos and class-time interactions between students and facilitators. A flexible, modular design allowed four of the medical schools to successfully implement the content modules in diverse curricular settings. Compared with the prior year, student satisfaction ratings after implementation were comparable or showed a statistically significant improvement. Students who took this course at a time point in their training similar to when the USMLE Step 1 reference group took Step 1 earned equivalent scores on National Board of Medical Examiners-Customized Assessment Services microbiology exam items. Exam scores for three schools ranged from 0.82 to 0.84, compared with 0.81 for the national reference group; exam scores were 0.70 at the fourth school, where students took the exam in their first quarter, two years earlier than the reference group. This project demonstrates that core content for a foundational medical school course can be defined, created, and used by multiple medical schools without compromising student satisfaction or knowledge. This project offers one approach to collaboratively defining core content and designing curricular resources for preclinical medical school education that can be shared.

Digital chalk-talk videos improve knowledge and satisfaction in renal physiology.

The authors began a curriculum reform project to improve the experience in a Renal Physiology course for first-year medical students. Taking into account both the variety of learning preferences among students and the benefits of student autonomy, the authors hypothesized that adding digital chalk-talk videos to lecture notes and live lectures would improve student knowledge, course satisfaction, and engagement. The authors measured performance on the renal physiology exam before (the traditional curriculum) and for 2 yr after implementation of the new curriculum. During the traditional and subsequent years, students took a Q-sort survey before and after the Renal Physiology course. Satisfaction was assessed based on ranked statements in the Q sort, as well as through qualitative analysis of student commentary. Compared with the traditional curriculum, mean scores on the renal physiology final exam were higher after implementation of the new curriculum: 65.3 vs. 74.4 ( P < 0.001) with year 1 and 65.3 vs. 79.4 ( P < 0.001) in the second year. After the new curriculum, students were more likely to agree with the statement, "I wish other courses were taught like this one." Qualitative analysis revealed how the video-based curriculum improved student engagement and satisfaction. Adding digital chalk-talk videos to a traditional Renal Physiology course that included active learning led to improved exam performance and high levels of student satisfaction. Other preclinical courses in medical school may benefit from such an intervention.

Is it a match? a novel method of evaluating medical school success.

BACKGROUND: Medical education program evaluation allows for curricular improvements to both Undergraduate (UME) and Graduate Medical Education (GME). UME programs are left with little more than match rates and self-report to evaluate success of graduates in The Match. OBJECTIVE: This manuscript shares a novel method of program evaluation through a systematic assessment of Match outcomes. DESIGN: Surveys were developed and distributed to Program Training Directors (PTDs) at our institution to classify residency programs into which our UME graduates matched using an ordinal response scale and open-ended responses. Outcomes-based measures for UME graduates were collected and analyzed. The relationship between PTD survey data and UME graduates' outcomes were explored. Open-ended response data were qualitatively analyzed using iterative cycles of coding and identifying themes. RESULTS: The PTD survey response rate was 100%. 71% of our graduates matched to programs ranked as 'elite' (36%) or 'top' (35%) tier. The mean total number of 'Honors' grades achieved by UME graduates was 2.6. Data showed that graduates entering elite and top GME programs did not consistently earn Honors in their associated clerkships. A positive correlation was identified between USMLE Step 1 score, number of honors, and residency program rankings for a majority of the programs. Qualitative analysis identified research, faculty, and clinical exposure as necessary characteristics of 'elite' programs:. Factors considered by PTDs in the rating of programs included reputation, faculty, research, national presence and quality of graduates. CONCLUSIONS: This study describes a novel outcomes-based method of evaluating the success of UME programs. Results provided useful feedback about the quality of our UME program and its ability to produce graduates who match in highly-regarded GME programs. The findings from this study can benefit Clerkship Directors, Student Affairs and Curriculam Deans, and residency PTDs as they help students determine their competitiveness forspecialties and specific residency programs.

CaPOW! Using Problem Sets in a Capstone Course to Improve Fourth-Year Medical Students' Confidence in Self-Directed Learning.

PROBLEM: Despite the importance of self-directed learning (SDL) in the field of medicine, individuals are rarely taught how to perform SDL or receive feedback on it. Trainee skill in SDL is limited by difficulties with self-assessment and goal setting. APPROACH: Ninety-two graduating fourth-year medical students from Duke University School of Medicine completed an individualized learning plan (ILP) for a transition-to-residency Capstone course in spring 2015 to help foster their skills in SDL. Students completed the ILP after receiving a personalized report from a designated faculty coach detailing strengths and weaknesses on specific topics (e.g., pulmonary medicine) and clinical skills (e.g., generating a differential diagnosis). These were determined by their performance on 12 Capstone Problem Sets of the Week (CaPOWs) compared with their peers. Students used transitional-year milestones to self-assess their confidence in SDL. OUTCOMES: SDL was successfully implemented in a Capstone course through the development of required clinically oriented problem sets. Coaches provided guided feedback on students' performance to help them identify knowledge deficits. Students' self-assessment of their confidence in SDL increased following course completion. However, students often chose Capstone didactic sessions according to factors other than their CaPOW performance, including perceived relevance to planned specialty and session timing. NEXT STEPS: Future Capstone curriculum changes may further enhance SDL skills of graduating students. Students will receive increased formative feedback on their CaPOW performance and be incentivized to attend sessions in areas of personal weakness.

Expanding Group Peer Review: A Proposal for Medical Education Scholarship.

After participating in a group peer-review exercise at a workshop presented by Academic Medicine and MedEdPORTAL editors at the 2015 Association of American Medical Colleges Medical Education Meeting, the authors realized that the way their work group reviewed a manuscript was very different from the way by which they each would have reviewed the paper as an individual. Further, the group peer-review process yielded more robust feedback for the manuscript's authors than did the traditional individual peer-review process. This realization motivated the authors to reconvene and collaborate to write this Commentary to share their experience and propose the expanded use of group peer review in medical education scholarship.The authors consider the benefits of a peer-review process for reviewers, including learning how to improve their own manuscripts. They suggest that the benefits of a team review model may be similar to those of teamwork and team-based learning in medicine and medical education. They call for research to investigate this, to provide evidence to support group review, and to determine whether specific paper types would benefit most from team review (e.g., particularly complex manuscripts, those receiving widely disparate initial individual reviews). In addition, the authors propose ways in which a team-based approach to peer review could be expanded by journals and institutions. They believe that exploring the use of group peer review potentially could create a new methodology for skill development in research and scholarly writing and could enhance the quality of medical education scholarship.

From the coliseum to the convention centre: a reflection on the current state of medical education conferences and conference-goers.

The advancement of knowledge and development of policy in the field of medical education require critical academic discourse among the most intelligent medical educators; and critical academic discourse requires coffee. In this essay, we reflect on the state of professional development conferences in the field of medical education and the rituals that surround their success. Having begun in ancient Greece, symposia were ripe with debauchery. Today, sedated by the light brown walls of hotel conference centres, symposia are more serious endeavours, engaging men and women in the sometimes turbulent waters of epistemological debate. The abstract submission process (summed up by: 'Yay! It was accepted for presentation' [Deep breath] 'Oh no…it was accepted for presentation'), the 'juggling act' of parent attendees, the acting prowess of abstract presenters and the unapologetic approach to buffet eating are all by-products of the collision of true intellects among medical education scholars. We hold these rituals in high regard and argue that they are required to advance the field of medical education. These rituals bind the walls supporting true progressive thought and innovative research, all fuelled by the glass of wine purchased with that one coveted drink ticket.

Mystery behind the match: an undergraduate medical education-graduate medical education collaborative approach to understanding match goals and outcomes.

BACKGROUND: There is a paucity of information regarding institutional targets for the number of undergraduate medical education (UME) graduates being matched to graduate medical education (GME) programs at their home institutions. At our institution, the Duke University, the number of UME graduates matched to GME programs declined dramatically in 2011. To better understand why this decline may have happened, we sought to identify perceived quality metrics for UME and GME learners, evaluate trends in match outcomes and educational program characteristics, and explore whether there is an ideal retention rate for UME graduates in their home institutions' GME programs. METHODS: We analyzed the number of Duke University UME graduates remaining at Duke for GME training over the past 5 years. We collected data to assess for changing characteristics of UME and GME, and performed descriptive analysis of trends over time to investigate the potential impact on match outcomes. RESULTS: A one-sample t-test analysis showed no statistically significant difference in the number of Duke UME graduates who stayed for GME training. For both UME and GME, no significant changes in the characteristics of either program were found. DISCUSSION: We created a process for monitoring data related to the characteristics or perceived quality of UME and GME programs and developed a shared understanding of what may impact match lists for both UME graduates and GME programs, leaving the Match somewhat less mysterious. While we understand the trend of graduates remaining at their home institutions for GME training, we are uncertain whether setting a goal for retention is reasonable, and so some mystery remains. We believe there is an invaluable opportunity for collaboration between UME and GME stakeholders to facilitate discussion about setting shared institutional goals.

A meaningful MESS (Medical Education Scholarship Support).

BACKGROUND: Graduate medical education faculty bear the responsibility of demonstrating active research and scholarship; however, faculty who choose education-focused careers may face unique obstacles related to the lack of promotion tracks, funding, career options, and research opportunities. Our objective was to address education research and scholarship barriers by providing a collaborative peer-mentoring environment and improve the production of research and scholarly outputs. METHODS: We describe a Medical Education Scholarship Support (MESS) group created in 2013. MESS is an interprofessional, multidisciplinary peer-mentoring education research community that now spans multiple institutions. This group meets monthly to address education research and scholarship challenges. Through this process, we develop new knowledge, research, and scholarly products, in addition to meaningful collaborations. RESULTS: MESS originated with eight founding members, all of whom still actively participate. MESS has proven to be a sustainable unfunded local community of practice, encouraging faculty to pursue health professions education (HPE) careers and fostering scholarship. We have met our original objectives that involved maintaining 100% participant retention; developing increased knowledge in at least seven content areas; and contributing to the development of 13 peer-reviewed publications, eight professional presentations, one Masters of Education project, and one educational curriculum. DISCUSSION: The number of individuals engaged in HPE research continues to rise. The MESS model could be adapted for use at other institutions, thereby reducing barriers HPE researchers face, providing an effective framework for trainees interested in education-focused careers, and having a broader impact on the education research landscape.

Teaching crucial skills: An electrocardiogram teaching module for medical students.

BACKGROUND: Medical student performance in electrocardiogram (ECG) interpretation at our institution could be improved. Varied resources exist to teach students this essential skill. METHODS: We created an ECG teaching module (ECGTM) of 75 cases representing 15 diagnoses to improve medical students' performance and confidence in ECG interpretation. Students underwent pre- and post-clerkship testing to assess ECG interpretation skills and confidence and also end-of-clinical-year testing in ECG and laboratory interpretation. Performance was compared for the years before and during ECGTM availability. RESULTS: Eighty-four percent of students (total n=101) reported using the ECGTM; 98% of those who used it reported it was useful. Students' performance and confidence were higher on the post-test. Students with access to the ECGTM (n=101) performed significantly better than students from the previous year (n=90) on the end-of-year ECG test. CONCLUSIONS: The continuous availability of an ECGTM was associated with improved confidence and ability in ECG interpretation. The ECGTM may be another available tool to help students as they learn to read ECGs.

How We Engage Graduating Professional Students in Interprofessional Patient Safety.

PROBLEM: Interprofessional curricula on patient safety do not acknowledge the culture and vulnerabilities of the student experience and often do not engage students. METHODS: We describe a patient safety collaboration between graduating nursing and medical students during their Capstone courses that fostered conversations about the similarities and differences in professional school experiences around patient safety. Students wrote reflections about an unanticipated patient outcome. Qualitative content analysis was used to characterize themes within student reflections, and to create audience response system questions to highlight differences in each profession's reflections and to facilitate discussion about those differences during the collaboration. FINDINGS: Medical students identified events in which perceived patient outcomes were worse than events identified by nursing students. Nursing students identified more near-miss events. Nursing students positively impacted the event and attributed action to the presence of a clinical instructor and personal responsibility for patient care. Medical students described themselves as "only a witness" and attributed inaction to hierarchy and concern about grades. CONCLUSIONS: Students felt the session would change their future attitudes and behaviors. Stevenson Chudgar Molloy Phillips Engle Clay.

Using Transitional Year Milestones to Assess Graduating Medical Students' Skills During a Capstone Course.

BACKGROUND: Undergraduate medical education (UME) follows the lead of graduate medical education (GME) in moving to competency-based assessment. The means for and the timing of competency-based assessments in UME are unclear. OBJECTIVE: We explored the feasibility of using the Accreditation Council for Graduate Medical Education Transitional Year (TY) Milestones to assess student performance during a mandatory, fourth-year capstone course. METHODS: Our single institution, observational study involved 99 medical students who completed the course in the spring of 2014. Students' skills were assessed by self, peer, and faculty assessment for 6 existing course activities using the TY Milestones. Evaluation completion rates and mean scores were calculated. RESULTS: Students' mean milestone levels ranged between 2.2 and 3.6 (on a 5-level scoring rubric). Level 3 is the performance expected at the completion of a TY. Students performed highest in breaking bad news and developing a quality improvement project, and lowest in developing a learning plan, working in interdisciplinary teams, and stabilizing acutely ill patients. Evaluation completion rates were low for some evaluations, and precluded use of the data for assessing student performance in the capstone course. Students were less likely to complete separate online evaluations. Faculty were less likely to complete evaluations when activities did not include dedicated time for evaluations. CONCLUSIONS: Assessment of student competence on 9 TY Milestones during a capstone course was useful, but achieving acceptable evaluation completion rates was challenging. Modifications are necessary if milestone scores from a capstone are intended to be used as a handoff between UME and GME.

The Impact of a Mandatory Immersion Curriculum in Integrative Medicine for Graduating Medical Students.

BACKGROUND: Although many Americans utilize complementary and alternative medicine (CAM) services and products, few medical school curricula consistently provide instruction in counseling patients on the use of CAM or strategies for identifying credible evidence on the safety and effectiveness of CAM therapies. METHODS: This is a mixed methods study. A sustainable, mandatory, half-day CAM immersion curriculum for graduating medical students is described. Student comfort talking with patients about CAM, their willingness to refer patients to a CAM provider, and adequacy of the CAM curriculum was assessed. RESULTS: Students who participated in this mandatory curriculum, rated the medical school curriculum in CAM as more adequate than students at other medical schools without a mandatory curriculum. Students' narrative comments indicate the curriculum impacts students knowledge about CAM, patient use of CAM, and personal practice with CAM in the future. CONCLUSIONS: The timing of the CAM curriculum near to graduation, students' personal exploration of several CAM modalities through immersion, and student interaction with community CAM providers are aspects of the curriculum that make the curriculum successful and memorable.

A comparison of the effectiveness of the team-based learning readiness assessments completed at home to those completed in class.

PURPOSE: The readiness assurance process (RAP) of team-based learning (TBL) is an important element that ensures that students come prepared to learn. However, the RAP can use a significant amount of class time which could otherwise be used for application exercises. The authors administered the TBL-associated RAP in class or individual readiness assurance tests (iRATs) at home to compare medical student performance and learning preference for physiology content. METHODS: Using cross-over study design, the first year medical student TBL teams were divided into two groups. One group was administered iRATs and group readiness assurance tests (gRATs) consisting of physiology questions during scheduled class time. The other group was administered the same iRAT questions at home, and did not complete a gRAT. To compare effectiveness of the two administration methods, both groups completed the same 12-question physiology assessment during dedicated class time. Four weeks later, the entire process was repeated, with each group administered the RAP using the opposite method. RESULTS: The performance on the physiology assessment after at-home administration of the iRAT was equivalent to performance after traditional in-class administration of the RAP. In addition, a majority of students preferred the at-home method of administration and reported that the at-home method was more effective in helping them learn course content. CONCLUSION: The at-home administration of the iRAT proved effective. The at-home administration method is a promising alternative to conventional iRATs and gRATs with the goal of preserving valuable in-class time for TBL application exercises.

The Primary Care Leadership Track at the Duke University School of Medicine: creating change agents to improve population health.

PROBLEM: Physicians need training in community engagement, leadership, and population health to prepare them to work with partners within the community and to adapt medical care to address population health needs. APPROACH: With an overall goal of training primary care practitioners to be change agents for improving population health, the Duke University School of Medicine launched the Primary Care Leadership Track (PCLT) in 2011. The four-year PCLT curriculum requires students to contribute to existing community health initiatives, perform community-engaged research, and participate in leadership training. The clinical curriculum incorporates a longitudinal approach to allow students to follow patient outcomes. In addition, students regularly interact with faculty to explore population health issues, review patient cases, and adjust individual learning opportunities as needed. OUTCOMES: The first cohort of PCLT students will graduate in 2015. Prospective comparisons with traditional track students are planned on performance on standardized tests and career choices. NEXT STEPS: The authors created the PCLT as a laboratory in which students can engage with the community and explore solutions to address the health of the public and the future delivery of health care. To meet the goal of training change agents, PCLT leaders need to expand opportunities for students to learn from providers and organizations that are successfully bridging the gap between medical care and public health.