Snapshot of Examination Usage in Emergency Medicine Clerkships.

Objective Emergency Medicine (EM) clerkships often use a written exam to assess the knowledge gained over the course of an EM rotation in medical school. Clerkship Directors (CDs) may choose the National Board of Medical Examiners (NBME) EM Advanced Clinical Science Subject Exam (ACE), the Society for Academic Emergency Medicine (SAEM) M4 exam, which has two versions, the SAEM M3 exam, or departmental exams. There are currently no published guidelines or consensus regarding their utility. This survey-based study was designed to collect data regarding current practices of EM clerkship exam usage to analyze trends and variability in what exams are used and how.  Methods The authors designed a cross-sectional observational survey to collect data from EM CDs on exam utilization in clerkships. The survey population consisted of clerkship directors, assistant clerkship directors, or faculty familiar assessments in their EM clerkship. Initial dissemination was by electronic distribution to subscribers of the Clerkship Directors in Emergency Medicine (CDEM) list-serve on the SAEM website. Subsequently, contact information of CD's from institutions that had not responded was obtained by manual search of the Emergency Medicine Residents' Association (EMRA) Match website and individual correspondence was sent at regular intervals. Data obtained include clerkship characteristics, exam used, weight of the exam relative to the overall grade, and alternatives if the preferred exam was previously taken. Results Eighty-seven programs (42% response rate) completed the survey between August 2019 and February 2021. Of the 87 responses, 71 (82%) were completed by a CD. Forty-six (53%) institutions required an EM rotation. Students were tested in 34 (74%) required EM clerkships and 48 (69%) out of 70 EM electives. In required rotations that used an exam, 20 (59%) used the NBME EM ACE, while 28 of 46 (61%) of EM electives that reported an exam used the SAEM M4 Exam. Five (15%) of the required clerkships used a departmental exam. Of clerkships requiring an exam, 46 (57%) weighed the score at 11-30% of the final grade. Data for extramural rotations mirrored that of EM electives. One-third of respondents indicated they do not inquire about previously taken exams. Conclusion This survey demonstrates significant variability in the type of exam, the weighting of the score, and alternatives if the preferred exam was previously taken. The lack of a consistent approach in how these exams are used in determining students' final EM grades diminishes the reliability of the EM clerkship grade as a factor used by residency directors in choosing future residents. Further research on optimal usage of these exams is needed.

Remote Learning and Its Impact on Newly Matriculated Medical Students.

Objective The coronavirus disease 2019 (COVID-19) pandemic has led to massive disruptions in medical education. In the fall of 2020, newly matriculated medical students around the country started medical school in a remote learning setting. The purpose of this study is to assess the impact of remote learning during the COVID-19 pandemic on academic performance and student satisfaction among first-year medical students. Methods The newest cohort of first-year medical students (class of 2024; n = 128) who completed their first basic science course, "Genes, Molecules & Cells (GMC)," using an adapted remote format was compared to the prior year's cohort (class of 2023; n = 122) of first-year medical students who were taught using traditional approaches. The items that were compared were numerical performance on exams and quizzes, study strategies, and course evaluation in GMC. Data were analyzed with a two-sided t-test and Pearson correlation coefficient. Students' perception of remote learning was also reported and results were obtained using a five-point Likert scale through anonymous surveys via E-value. Results No statistical difference was observed in students' performance on the midterm and final examinations between the two cohorts in both multiple-choice and written examinations. Mean multiple-choice question (MCQ) midterm students' performance in remote learning compared to traditional learning cohort was 75.9%, standard deviation (SD) 6.1 to 75.89%, SD 6.49, respectively. Mean MCQ final students' performance was 84%, SD 6.37 (class of 2024) to 85%, SD 8.78 (class of 2023). Students' satisfaction with their learning experience was similar among the two groups (class of 2024: mean = 4.61, SD 0.66; class of 2023: mean = 4.57, SD 0.68). Most students (70%) in the remote learning cohort had a positive opinion of remote learning. Of the students, 17% reported feeling disconnected, isolated, or not actively involved. Conclusions The results of this study demonstrate that not only is remote learning effective but that the students were also resilient in their adaptation to a new learning format. Our experience highlights the importance of including wellness solutions to mitigate the feeling of isolation and disconnection during remote learning.

Gender Differences in Language of Standardized Letter of Evaluation Narratives in Osteopathic Emergency Medicine Residency Applicants.

Background The standardized letter of evaluation (SLOE) is used by emergency medicine (EM) faculty during the interview and match process. Data has shown that female allopathic applicants score higher in communal characteristics and have a greater number of ability words in the narrative portion of the SLOE as compared to their male counterparts.  Objective To determine if there is a difference in the language used to describe male and female osteopathic applicants within the SLOE.  Methods All applicants to a three-year EM residency within a single application cycle were eligible for inclusion. Exclusion criteria included allopathic applicants, applicants without a SLOE, or applicants with a SLOE only from the interviewing program. Data collected included applicant demographics and SLOE narratives. The previously validated Linguistic Inquiry and Word Count (LIWC; Pennebaker Conglomerates, Inc., Austin, TX) product was used to analyze word counts from the narrative portion of each SLOE. Descriptive statistics and t-tests for continuous data were used.  Results Of the 577 applicants to the residency program, 318 met inclusion criteria and 33% were female. Females had a higher COMLEX-2 (590 vs 559; p=0.05) as compared to males but no difference was found for the remainder of the baseline demographics. No difference was found for the number of words in the narrative portion of the SLOE between males and females (males = 122 words; females = 127 words; p=0.53). Words within the social (p=0.006), achievement (p=0.007), and standout (p<0.001) categories were more frequent in osteopathic female applicants as compared to males. No statistical differences were detected for the other 13 categories analyzed.  Conclusion In this sample of osteopathic applicants, little linguistic difference was noted for the narrative portion of the SLOE. SLOE authors did, however, use more social, achievement, and standout words to describe females as compared to male applicants.

Utilization of a New Customizable Scoring Tool to Recruit and Select Pulmonary/Critical Care Fellows.

BACKGROUND: Finding the ideal candidate for a residency/fellowship program has always been difficult. Finding the "perfect" match has always been the ultimate goal. However, many factors affect obtaining that "perfect" match. In the past, we would have each attending physician review around 20 to 50 Electronic Residency Application Service (ERAS) applications and rank them into three categories: high, middle, or low. Depending on their ranking, the applicant would be invited for an interview. After the interview, the applicants' files (ERAS and interview) would be reviewed and ranked by the faculty as a group. This was time-consuming and fraught with too much subjectivity and minimal objectivity. We, therefore, sought to find a way to assess and rank applicants in a more objective and less time-consuming manner. By creating a customizable scoring tool, we were able to screen applicants to our pulmonary/critical care fellowship program in an efficient and a more objective manner. OBJECTIVES: A customizable scoring tool was developed weighting components in the ERAS and interview process, allowing residency/fellowship programs to create a final rank list consistent with the programs' desired applicants. METHODS: Two hundred and sixty pulmonary/critical care fellowship applications were reviewed from 2013 to 2018. In 2018, we used our new scoring rubric to create a rank list and rescore previous applicants. The traditional and new lists were compared to the final rank list submitted to the National Residency Matching Program (NRMP) for 2018. We wanted to ascertain which scoring method correlated best with the final rank list submitted to the NRMP. We obtained feedback from eight faculty members who had reviewed applicants with both scoring tools. RESULTS: The novel customizable scoring tool positively correlated with the final rank list submitted to the NRMP (r= 0.86). The novel tool showed a better correlation to the final rank list than the traditional method. Faculties (6/6, 100%) responded positively to the new tool. CONCLUSIONS:  Our new customizable tool has allowed us to create a final rank list that is efficient and more focused on our faculty's desired applicants. We hope to assess and compare the quality of applicants matched through this scoring system and the traditional method by using faculty evaluations, milestones, and test scores.

Remote Assessment of Video-Recorded Oral Presentations Centered on a Virtual Case-Based Module: A COVID-19 Feasibility Study.

Introduction The coronavirus disease 2019 (COVID-19) pandemic has resulted in the suspension of our pediatric clerkship, which may result in medical student skill erosion due to lack of patient contact. Our clerkship has developed and assessed the feasibility of implementing a video-recorded oral presentation assignment and formative assessment centered on virtual case-based modules. Methods This retrospective study examined the feasibility of providing a remote formative assessment of third-year medical student video-recorded oral presentation submissions centered on virtual case-based modules over a one-week time period after pediatric clerkship suspension (March 16th to 20th, 2020). Descriptive statistics were used to assess the video length and assessment scores of the oral presentations. Results Twelve subjects were included in this study. Overall median assessment score [median score, (25th, 75th percentile)] was 5 (4,6), described as "mostly on target" per the patient presentation rating tool. Conclusion Patient-related activities during the pediatric clerkship were halted during the COVID-19 pandemic. This study demonstrated the possibility of remotely assessing oral presentation skills centered on virtual case-based modules using a patient presentation tool intended for non-virtual patients. This may prepare students for their clinical experiences when COVID-19 restrictions are lifted. Future studies are needed to determine if suspended clerkships should consider this approach.