Filling the Core EPA 10 assessment void: A framework for individual assessment of Core Entrustable professional activity 10 competencies in medical students.

Objectives: The goal of this study was to develop and evaluate a novel curriculum and assessment tool for Core Entrustable Professional Activity (EPA) 10 competencies and entrustment scoring in a cohort of medical students in their emergency medicine (EM) clerkship using a framework of individualized, ad hoc, formative assessment. Core EPA 10 is an observable workplace-based activity for graduating medical students to recognize a patient requiring urgent or emergent care and initiate evaluation and management. Methods: This is a prospective, pretest-posttest study of medical students during their EM clerkship. Using the Thomas and Kern framework, we created a curriculum of simulation cases about chest pain/cardiac arrest and respiratory distress, which included novel assessment checklists, and instructional videos about recognizing and managing emergencies. Students were individually pretested on EPA 10 competencies using the simulation cases. Two raters scored students using standardized checklists. Students then watched instructional videos, underwent a posttest with the simulation cases, and were scored again by the two raters using the checklists. Differences between pretest and posttest scores were analyzed using paired t-tests and Wilcoxon signed-rank tests. Results: Seventy-three out of 85 (86%) students completed the curriculum. Mean scores from pretest to final posttest in the chest pain/cardiac arrest and respiratory distress cases significantly improved from 14.8/19 (SD 1.91), to 17.1/19 (SD = 1.00), t(68) = 10.56, p < 0.001, and 8.5/13 (SD 1.79), to 11.1/13(SD 0.89), t(67) = 11.15, p < 0.001, respectively. The kappa coefficients were 0.909 (n = 2698, p < 0.001) and 0.931 (n = 1872, p < 0.001). Median modified Chen entrustment scores improved from 1b (i.e., "Watch me do this") to 2b (i.e., "I'll watch you") for the chest pain/cardiac arrest case (p < 0.001) and 1b/2a (i.e., "Watch me do this"/ "Let's do this together") to 3a (i.e. "You go ahead, and I'll double-check all of your findings") for the respiratory distress case (p < 0.001). Conclusion: A new directed curriculum of standardized simulation cases and asynchronous instructional videos improved medical student performance in EPA 10 competencies and entrustment scores. This study provides a curricular framework to support formative individualized assessments for EPA 10.

Simulation-Based Mastery Learning Improves the Performance of Donning and Doffing of Personal Protective Equipment by Medical Students.

INTRODUCTION: Medical students lack adequate training on how to correctly don and doff personal protective equipment (PPE). Simulation-based mastery learning (SBML) is an effective technique for procedural education. The aim of this study was to determine whether SBML improves proper PPE donning and doffing by medical students. METHODS: This was a prospective, pre-test/post-test study of 155 medical students on demonstration of correct PPE use before and after a SBML intervention. Subjects completed standard hospital training by viewing a US Centers for Disease Control and Prevention training video on proper PPE use prior to the intervention. They then participated in a SBML training session that included baseline testing, deliberate practice with expert feedback, and post-testing until mastery was achieved. Students were assessed using a previously developed 21-item checklist on donning and doffing PPE with a minimum passing standard (MPS) of 21/21 items. We analyzed differences between pre-test and post-test scores using paired t-tests. Students at preclinical and clinical levels of training were compared with an independent t-test. RESULTS: Two participants (1.3%) met the MPS on pre-test. Of the remaining 153 subjects who participated in the intervention, 151 (98.7%) reached mastery. Comparison of mean scores from pre-test to final post-test significantly improved from an average raw score of 12.55/21 (standard deviation [SD] = 2.86), to 21/21(SD = 0), t(150) = 36.3, P <0.001. There was no difference between pre-test scores of pre-clinical and clinical students. CONCLUSION: Simulation-based mastery learning improves medical student performance in PPE donning and doffing in a simulated environment. This approach standardizes PPE training for students in advance of clinical experiences.

Rapid Cycle Deliberate Practice in Virtual Reality: Teaching Transvenous Pacemaker Insertion to Emergency Medicine Residents.

Introduction Transvenous pacemaker insertion is a critical life-saving procedure that is infrequently performed. Traditional mannequin-based training paradigms are resource intensive and sometimes inadequate due to time constraints. Rapid Cycle Deliberate Practice (RCDP) is an effective teaching modality for highly scripted procedures. We propose using a simulation-based technique of RCDP in virtual reality (VR) to teach this procedure. Methods Sixteen emergency medicine residents were recruited. A pre-survey was administered at the start of the session, followed by a baseline task trainer checklist-based assessment. This checklist was created based on expert consensus. Participants then underwent the RCDP VR intervention with a subsequent repeat checklist-based assessment as well as a post-survey.  Results Post-test scores were found to be significantly higher than pre-test scores after residents completed VR deliberate practice simulation (19.5±3.5 vs 24.1±2.0; p<0.001). Subanalysis did not reveal any significant difference based on post-graduate year, previous performance of procedure on a live patient, or previous VR experience. The experience increased participant feelings of preparedness and comfort in performing the procedure (2-disagree vs 4-agree) based on a 5-point Likert scale.  Conclusions Virtual reality using RCDP to teach transvenous pacemaker insertion demonstrated an improvement in task trainer performance. Further investigation into whether this translates into better patient outcomes or can be generalized to other procedures needs to be considered.

Social Media Bridges the Training Gap Between Match Day and Internship With ACGME Milestone-based Clinical Case Curriculum.

OBJECTIVES: The objective was to bridge the relative educational gap for newly matched emergency medicine preinterns between Match Day and the start of internship by implementing an Accreditation Council for Graduate Medical Education Milestone (ACGME)-based virtual case curriculum over the social media platform Slack. METHODS: We designed a Milestone-based curriculum of 10 emergency department clinical cases and used Slack to implement it. An instructor was appointed for each participating institution to lead the discussion and encourage collaboration among preinterns. Pre- and postcurriculum surveys utilized 20 statements adapted from the eight applicable Milestones to measure the evolution of preintern self-reported perceived preparedness (PP) as well as actual clinical knowledge (CK) performance on a case-based examination. RESULTS: A total of 11 institutions collaborated and 151 preinterns were contacted, 127 of whom participated. After participating in the Slack intern curriculum (SIC), preinterns reported significant improvements in PP regarding multiple Milestone topics. They also showed improved CK regarding the airway management Milestone based on examination performance. CONCLUSIONS: Implementation of our SIC may ease the difficult transition between medical school and internship for emergency medicine preinterns. Residency leadership and medical school faculty will benefit from knowledge of preintern PP, specifically of their perceived strengths and weaknesses, because this information can guide curricular focus at the end of medical school and beginning of internship. Limitations of this study include variable participation and a high attrition rate. Further studies will address the utility of such a virtual curriculum for preinterns and for rotating medical students who have been displaced from clinical rotations during the novel coronavirus pandemic.

Redesigned geriatric emergency care may have helped reduce admissions of older adults to intensive care units.

Charged with transforming geriatric emergency care by applying palliative care principles, a process improvement team at New York City's Mount Sinai Medical Center developed the GEDI WISE (Geriatric Emergency Department Innovations in Care through Workforce, Informatics, and Structural Enhancements) model. The model introduced workforce enhancements for emergency department (ED) and adjunct staff, including role redefinition, retraining, and education in palliative care principles. Existing ED triage nurses screened patients ages sixty-five and older to identify those at high risk of ED revisit and hospital readmission. Once fully trained, these nurses screened all but 6 percent of ED visitors meeting the screening criteria. Newly hired ED nurse practitioners identified high-risk patients suitable for and desiring palliative and hospice care, then expedited referrals. Between January 2011 and May 2013 the percentage of geriatric ED admissions to the intensive care unit fell significantly, from 2.3 percent to 0.9 percent, generating an estimated savings of more than $3 million to Medicare. The decline in these admissions cannot be confidently attributed to the GEDI WISE program because other geriatric care innovations were implemented during the study period. GEDI WISE programs are now running at Mount Sinai and two partner sites, and their potential to affect the quality and value of geriatric emergency care continues to be examined.