Analysis of Anonymous Student Narratives About Experiences with Emergency Medicine Residency Programs.

Background: Academic emergency medicine (EM) communities have viewed anonymous online communities (AOC) such as Reddit or specialty-specific "applicant spreadsheets" as poor advising resources. Despite this, robust EM AOCs exist, with large user bases and heavy readership. Insights about applicants' authentic experiences can be critical for applicants and program leadership decision-making. To date, there are no EM studies to qualitatively assess EM AOC narratives during the application cycle. Our goal was to perform a qualitative analysis of students' EM program experiences through a publicly available AOC. Methods: This was a qualitative analysis of a publicly available, time-stamped, user-locked AOC dataset: "Official 2020-2021 Emergency Medicine Applicant Spreadsheet." We extracted and then de-identified all data from selected sub-sheets entitled "Virtual Interview Impressions" and "Rotation Impressions." Four investigators used constant comparative method to analyze the data inductively, and they subsequently met to generate common themes discussed by students. Preliminary thematic analysis was conducted on a random sample of 37/183 (20%) independent narratives to create the initial codebook. This was used and updated iteratively to analyze the entire narrative set consisting of 841 discrete statements. Finally, two unique codes were created to distinguish whether the identified sub-themes, or program attributes, were likely "modifiable" or "non-modifiable." Results: We identified six major themes: living and working conditions; interpersonal relationships; learning experiences, postgraduate readiness, and online/virtual supplements. Common sub-themes included patient population (13%); resident personality (7%); program leadership personality (7%); relationship with faculty/leadership (6%); geography (4%); practice setting (4%); program reputation (4%), and postgraduate year-3 experiences (4%). Modifiable sub-themes outnumbered non-modifiable sub-themes, 60.7% to 39.3%. Conclusion: In this analysis of selected medical students' narratives in an AOC, the majority of identified themes represented topics that may serve as external feedback for EM residency programs and their clerkships. Selective use of AOCs may set a precedent for future program assessments by applicants and inform program leadership of important programmatic elements in the eyes of applicants. It elucidates important themes in their interactions or learning experiences with programs and creates opportunities for learner-centric program improvement.

Simulation Improves Emergency Medicine Residents' Clinical Performance of Aorta Point-of-Care Ultrasound.

Purpose: Using point-of-care ultrasound (POCUS) to diagnose abdominal aortic aneurysm (AAA) is an essential skill in emergency medicine (EM). While simulation-based POCUS education is commonly used, the translation to performance in the emergency department (ED) is unknown. We investigated whether adding case-based simulation to an EM residency curriculum was associated with changes in the quantity and quality of aorta POCUS performed by residents in the ED. Methods: A case-based simulation was introduced to resident didactics at our academic, Level I trauma center. A case of undifferentiated abdominal pain was presented, which required examination of an ultrasound phantom to diagnose an AAA, with a hands-on didactic. We compared the quantity, quality, and descriptive analyses of aorta POCUS performed in the ED during the four months before and after the simulation. Results: For participating residents (17/32), there was an 86% increase in total studies and an 80% increase in clinical studies. On an opportunity-adjusted, per-resident basis, there was no significant difference in median total scans per 100 shifts (4.4 [interquartile range (IQR) 0-15.8 vs 8.3 [IQR] 3.3-23.6, P = 0.21) or average total quality scores (3.2 ± 0.6 vs 3.2 ± 0.5, P = 0.92). The total number of limited or inadequate studies decreased (43% vs 19%, P = 0.02), and the proportion of scans submitted by interns increased (7% vs 54%, P = < .001). Conclusion: After simulation training, aorta POCUS was performed more frequently, and ED interns contributed a higher proportion of scans. While there was no improvement in quantity or quality scores on a per-resident basis, there were significantly fewer incomplete or limited scans.

Foundations of Emergency Medicine: Impact of a Standardized, Open-access, Core Content Curriculum on In-Training Exam Scores.

Introduction: Learners frequently benefit from modalities such as small-group, case-based teaching and interactive didactic experiences rather than passive learning methods. These contemporary techniques are features of Foundations of Emergency Medicine (FoEM) curricula, and particularly the Foundations I (F1) course, which targets first-year resident (PGY-1) learners. The American Board of Emergency Medicine administers the in-training exam (ITE) that provides an annual assessment of EM-specific medical knowledge. We sought to assess the effect of F1 implementation on ITE scores. Methods: We retrospectively analyzed data from interns at four EM residency programs accredited by the Accreditation Council for Graduate Medical Education. We collected data in 2021. Participating sites were geographically diverse and included three- and four-year training formats. We collected data from interns two years before (control group) and two years after (intervention group) implementation of F1 at each site. Year of F1 implementation ranged from 2015-2018 at participating sites. We abstracted data using a standard form including program, ITE raw score, year of ITE administration, US Medical Licensing Exam Step 1 score, Step 2 Clinical Knowledge (CK) score, and gender. We performed univariable and multivariable linear regression to explore differences between intervention and control groups. Results: We collected data for 180 PGY-1s. Step 1 and Step 2 CK scores were significant predictors of ITE in univariable analyses (both with P < 0.001). After accounting for Step 1 and Step 2 CK scores, we did not find F1 implementation to be a significant predictor of ITE score, P = 0.83. Conclusion: Implementation of F1 curricula did not show significant changes in performance on the ITE after controlling for important variables.

Integrating Hospice and Palliative Medicine Education Within the American Board of Emergency Medicine Model.

Background: Hospice and palliative medicine (HPM) is a board-certified subspecialty within emergency medicine (EM), but prior studies have shown that EM residents do not receive sufficient training in HPM. Experts in HPM-EM created a consensus list of competencies for HPM training in EM residency. We evaluated how the HPM competencies integrate within the American Board of Emergency Medicine Milestones, which include the Model of the Clinical Practice of Emergency Medicine (EM Model) and the knowledge, skills, and abilities (KSA) list. Methods: Three emergency physicians independently mapped the HPM-EM competencies onto the 2019 EM Model items and the 2021 KSAs. Discrepancies were resolved by a fourth independent reviewer, and the final mapping was reviewed by all team members. Results: The EM Model included 78% (18/23) of the HPM competencies as a direct match, and we identified recommended areas for incorporating the other five. The KSAs included 43% (10/23). Most HPM competencies included in the KSAs mapped onto at least one level B (minimal necessary for competency) KSA. Three HPM competencies were not clearly included in the EM Model or in the KSAs (treating end-of-life symptoms, caring for the imminently dying, and caring for patients under hospice care). Conclusion: The majority of HPM-EM competencies are included in the current EM Model and KSAs and correspond to knowledge needed to be competent in EM. Programs relying on the EM Milestones to plan their curriculums may miss training in symptom management and care for patients at the end of life or who are on hospice.

The Effect of a Simulation-based Intervention on Emergency Medicine Resident Management of Early Pregnancy Loss.

Background: The evaluation of patients with first-trimester vaginal bleeding and concern for early pregnancy loss (EPL) frequently occurs in the emergency department (ED), accounting for approximately 1.6% of all ED visits.1 Unfortunately, these patients consistently report negative experiences with ED care.2-8 In addition to environmental concerns, such as long wait times, patients often describe negative interactions with staff, including a perceived lack of empathy, the use of insensitive language, and inadequate counseling.2,3 These patients and their partners often view EPL as a traumatic loss of life and commonly experience prolonged grief reactions, including anxiety and depression.9-11 Poor satisfaction with care has been associated with worse mental health outcomes.12 These complaints represent an important opportunity for improvement in emergency medicine (EM) training.13 While no published literature to date describes the performance of EM residents in managing patients presenting with EPL, studies suggest that even obstetrics and gynecology (OB/GYN) residents find these interactions challenging.14,15 Simulation- and didactic-based training has been shown to be beneficial in improving OB/GYN resident EPL counseling and has been associated with improved patient outcomes.16 To our knowledge, this has yet to be replicated in EM residency training. Objectives: We aimed to develop and evaluate a simulation-based educational intervention to improve EM resident management of patients presenting with EPL.

Development and Validation of a Scoring Rubric for Editorial Evaluation of Peer-review Quality: A Pilot Study.

Introduction: Despite the importance of peer review to publications, there is no generally accepted approach for editorial evaluation of a peer review's value to a journal editor's decision-making. The graduate medical education editors of the Western Journal of Emergency Medicine Special Issue in Educational Research & Practice (Special Issue) developed and studied the holistic editor's scoring rubric (HESR) with the objective of assessing the quality of a review and an emphasis on the degree to which it informs a holistic appreciation for the submission under consideration. Methods: Using peer-review guidelines from several journals, the Special Issue's editors formulated the rubric as descriptions of peer reviews of varying degree of quality from the ideal to the unacceptable. Once a review was assessed by each editor using the rubric, the score was submitted to a third party for blinding purposes. We compared the performance of the new rubric to a previously used semantic differential scale instrument. Kane's validity framework guided the evaluation of the new scoring rubric around three basic assumptions: improved distribution of scores; relative consistency rather than absolute inter-rater reliability across editors; and statistical evidence that editors valued peer reviews that contributed most to their decision-making. Results: Ninety peer reviews were the subject of this study, all were assessed by two editors. Compared to the highly skewed distribution of the prior rating scale, the distribution of the new scoring rubric was bell shaped and demonstrated full use of the rubric scale. Absolute agreement between editors was low to moderate, while relative consistency between editor's rubric ratings was high. Finally, we showed that recommendations of higher rated peer reviews were more likely to concur with the editor's formal decision. Conclusion: Early evidence regarding the HESR supports the use of this instrument in determining the quality of peer reviews as well as its relative importance in informing editorial decision-making.

Pediatric disaster preparedness curriculum across emergency medicine residencies.

OBJECTIVE: To assess pediatric disaster medicine (PDM) instruction in emergency medicine (EM) residency programs and to identify barriers to integrating these skills into EM training. METHODS: National survey study of United States EM Residency Program Directors (PDs) and Assistant PDs during the 2021-2022 academic year. RESULTS: Of the 186 EM residency programs identified, a total of 24 responses were recorded with a response rate of 12.9 percent. Importance of training was rated 5.79 (standard deviation 2.51) using the Likert scale ranging from 1 to 10. Out of 24 programs, 17 (70.8 percent) do not have any PDM training as part of residency training. Live drill, simulation, and tabletop were identified as most effective methods to deliver PDM training with the Likert scale score of 4.78, 4.6, and 4.47, respectively. Senior trainees' level of -knowledge/skills with family reunification (Likert 2.09/5; chemical-biological-radiological-nuclear explosive 2.95/5) and mass casualty preparation of the emergency department (3.3/5) as assessed by the respondents. The main barrier to education included logistics, eg, space and costs (Likert 3.7/5), lack of didactic time (3.7/5), and limited faculty knowledge, skill, or experience (3.3/5). CONCLUSION: PDM training is lacking and requires standardization. This study highlights the opportunity for the creation of a model for EM resident education in PDM.

Handling the desire to die- evaluation of an elective course for medical students.

BACKGROUND: The desire to die can occur in palliative care patients with a prevalence of up to 22%. Not every desire to die is accompanied by a pressure to act, but usually by a burden that can arise from various factors. To address this burden appropriately, health care workers should be trained. Based on an evaluated course on handling the desire to die, an elective course for medical students was developed and evaluated. In order to identify the impact of the elective course's content, a comparison of attitudes towards assisted dying with two other participant groups was conducted. Therefore, three questions from the evaluation of the elective course were used. METHOD: Online evaluation of the elective and questions addressing attitude were assessed using a five-point Likert scale. The specific outcome-based assessment was determined using the Comparative Self-Assessment Gain. The main participant group (group 1) were students who took the elective. The additional survey on attitudes towards assisted dying included undergraduate medical students who had taken compulsory palliative care courses (group 2) and physicians who had taken an introductory course in intensive care or emergency medicine (group 3). RESULTS: Group 1 (n = 13, response rate rr = 86.7%) was very satisfied with the blended learning format (100%) and the course itself (100%). They were able to deepen their knowledge (81.0%) and train skills (71.2%) through the course. In the additional surveys, there were 37 students in group 2 (rr = 66.1%) and 258 physicians in group 3 (rr = 73.6%). Willingness to assist with or accompany the various options for assisted dying varied according to the type of assistance. Among the participants, it can be summarised that the highest willingness was shown by the students of group 2 followed by the physicians of group 3 and the students of group 1. CONCLUSIONS: A course on handling the desire to die of palliative patients can deepen knowledge and train communication skills and thus support self-confidence. Dealing with the background of the desire to die, knowledge about assisted dying, but also one's own attitudes and responsibilities can influence the attitude towards assisted dying.

Pediatric Intubations in a Semiurban Helicopter Emergency Medicine Service: A Retrospective Review.

OBJECTIVE: Although a small proportion of helicopter emergency medical service (HEMS) missions are for pediatric patients, it is recognized that children do present unique challenges. This case series aims to evaluate the intubation first-pass success rate in HEMS pediatric patients for both medical and trauma patients in a UK semiurban environment. METHODS: A retrospective review of the computerized records system was performed from January 1, 2015, to July 31, 2022, at 1 UK HEMS. Anonymous data relating to advanced airway interventions in patients < 16 years of age were extracted. Primary analysis related to the first-pass success rate was performed; secondary analysis relating to the initial Glasgow Coma Scale (GCS) of the pediatric patients requiring prehospital anesthesia (rapid sequence induction with drugs) and first-pass success rates by clinician group was also performed. RESULTS: Of the pediatric patients, 15.8% required intubation. The overall first-pass success rate for intubation (including in cardiac arrest) was 83.5%; for prehospital anesthesia (drugs administered), it was 98.4%. First-pass success rates were lowest for those under 2 years of age (45.2% without drugs and 87.5% with drugs). There was no difference between physician background in the first-pass success rate. The median GCS for pediatric prehospital anesthesia was 7 versus 5 for adults (P = .012). No children with an initial GCS of 15 had prehospital anesthesia. CONCLUSION: The overall intubation first-pass success rates for pediatric patients is high at 83.5% and higher still for prehospital anesthesia (98.4%). However, it remains a rare intervention for clinicians, and children under 2 years of age require special consideration.

Comparison of the problem-solving performance of ChatGPT-3.5, ChatGPT-4, Bing Chat, and Bard for the Korean emergency medicine board examination question bank.

Large language models (LLMs) have been deployed in diverse fields, and the potential for their application in medicine has been explored through numerous studies. This study aimed to evaluate and compare the performance of ChatGPT-3.5, ChatGPT-4, Bing Chat, and Bard for the Emergency Medicine Board Examination question bank in the Korean language. Of the 2353 questions in the question bank, 150 questions were randomly selected, and 27 containing figures were excluded. Questions that required abilities such as analysis, creative thinking, evaluation, and synthesis were classified as higher-order questions, and those that required only recall, memory, and factual information in response were classified as lower-order questions. The answers and explanations obtained by inputting the 123 questions into the LLMs were analyzed and compared. ChatGPT-4 (75.6%) and Bing Chat (70.7%) showed higher correct response rates than ChatGPT-3.5 (56.9%) and Bard (51.2%). ChatGPT-4 showed the highest correct response rate for the higher-order questions at 76.5%, and Bard and Bing Chat showed the highest rate for the lower-order questions at 71.4%. The appropriateness of the explanation for the answer was significantly higher for ChatGPT-4 and Bing Chat than for ChatGPT-3.5 and Bard (75.6%, 68.3%, 52.8%, and 50.4%, respectively). ChatGPT-4 and Bing Chat outperformed ChatGPT-3.5 and Bard in answering a random selection of Emergency Medicine Board Examination questions in the Korean language.

A national survey on current state and development needs of clinical and academic emergency medicine in China.

BACKGROUND: To characterize the current state of emergency medicine (EM) and the requirements for advancing EM clinical practice, education and research in China. METHODS: An anonymous electronic survey was conducted by Chinese Society of Emergency Medicine during September to October 2021. The survey contained 30 questions divided into 2 sections: the current state of EM development and the requirements for EM growth. RESULTS: 722 hospitals were included, of 487 were Level III and 235 were Level II hospitals. We found that after 40 years of development, EM had established a mature disciplinary system and refined sub-specialties including critical care, cardiopulmonary resuscitation, toxicology, disaster and emergency rescue. In Level III hospitals, 70.8% of EDs were standardized training centers for EM residents, but master's degree program, Doctor Degree program and post-doctoral degree program was approved in only 37.8%, 8.4% and 2.9% of EDs respectively and postgraduate curriculum was available in 1/4 of EDs. Only 8% have national or provincial key laboratories. In addition to advance clinical practice, there was also a high demand to improve teaching and research capacities, mainly focusing on literature review, research design and delivery, paper writing, residency training. CONCLUSIONS: EM has built a mature discipline system and refined sub-specialties in China. Teaching and research developed parallel with clinical practice. However, there was still a lack of EM master's and doctoral programs and research capacities need to be improved. More outstanding clinical and academic training should be provided to promote the rapid growth of EM in China.

Recomendaciones para la atención de las principales emergencias obstétricas

Esta edición de Recomendaciones para la atención de las principales emergencias obstétricas incluye la actualización de los capítulos Estados hipertensivos del embarazo, Hemorragia postparto, Reanimación cardiovascular en el embarazo, Sistema de alerta temprano y equipos de respuesta rápida en Obstetricia. Siguiendo el sistema GRADE para definir la calidad de la evidencia y la fortaleza de la recomendación se plantean recomendaciones para el abordaje del tromboembolismo pulmonar y embarazo, embolismo de líquido amniótico, Covid-19 y embarazo, influenza y embarazo y sepsis materna. Con esta publicación se busca apoyar los esfuerzos para lograr la concretización de la meta 3.1 de los ODS de reducir la tasa mundial de mortalidad materna a menos de 70 por cada 100.00 nacidos vivos hasta el 2030.

Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident Performance.

Introduction: The Accreditation Council for Graduate Medical Education (ACGME) requires emergency medicine (EM) residency training programs to monitor residents' progress using standardized milestones. The first assessment of PGY 1 resident milestones occurs midway through the first year and could miss initial deficiencies. Early assessment of PGY 1 EM resident milestones has potential to identify at-risk residents prior to standard midyear evaluations. We developed an orientation syllabus for PGY 1 residents followed by a milestone assessment. Assessment scores helped predict future milestone scores and American Board of Emergency Medicine (ABEM) In-Training Examination (ITE) scores for PGY 1 residents. Methods: From 2013 to 2020, we developed and implemented Milestone Evaluation Day (MED), a simulation-based day and written exam assessing PGY 1 EM residents during their first month on the 23 ACGME 1.0 milestones. MED stations included a history and physical with verbal presentation, patient simulation, vascular access, wound management, and airway management. MED, Clinical Competency Committee-generated (CCC-generated) milestone, and ABEM ITE scores were averaged and compared utilizing Pearson's correlation coefficient. Results: Of 112 PGY 1 EM residents, 110 (98%) were analyzed over an 8-year period. We observed a moderate positive correlation of MED and CCC-generated milestone scores (r = .34, p < .001). There was a nonstatistically significant weak positive correlation of MED and ABEM ITE scores (r = .13, p = .17). Discussion: An early assessment of EM milestones in the PGY 1 year can assist in the prediction of CCC-generated milestone scores for PGY 1 residents.

Development and psychometric evaluation of a 360-degree evaluation instrument to assess medical students' performance in clinical settings at the emergency medicine department in Iran: a methodological study.

BACKGROUND: In the Iranian context, no 360-degree evaluation tool has been developed to assess the performance of prehospital medical emergency students in clinical settings. This article describes the development of a 360-degree evaluation tool and presents its first psychometric evaluation. METHODS: There were 2 steps in this study: step 1 involved developing the instrument (i.e., generating the items) and step 2 constituted the psychometric evaluation of the instrument. We performed exploratory and confirmatory factor analyses and also evaluated the instrument's face, content, and convergent validity and reliability. RESULTS: The instrument contains 55 items across 6 domains, including leadership, management, and teamwork (19 items), consciousness and responsiveness (14 items), clinical and interpersonal communication skills (8 items), integrity (7 items), knowledge and accountability (4 items), and loyalty and transparency (3 items). The instrument was confirmed to be a valid measure, as the 6 domains had eigenvalues over Kaiser's criterion of 1 and in combination explained 60.1% of the variance (Bartlett's test of sphericity [1,485]=19,867.99, P<0.01). Furthermore, this study provided evidence for the instrument's convergent validity and internal consistency (α=0.98), suggesting its suitability for assessing student performance. CONCLUSION: We found good evidence for the validity and reliability of the instrument. Our instrument can be used to make future evaluations of student performance in the clinical setting more structured, transparent, informative, and comparable.

Design and testing of ultrasound probe adapters for a robotic imaging platform.

Medical imaging-based triage is a critical tool for emergency medicine in both civilian and military settings. Ultrasound imaging can be used to rapidly identify free fluid in abdominal and thoracic cavities which could necessitate immediate surgical intervention. However, proper ultrasound image capture requires a skilled ultrasonography technician who is likely unavailable at the point of injury where resources are limited. Instead, robotics and computer vision technology can simplify image acquisition. As a first step towards this larger goal, here, we focus on the development of prototypes for ultrasound probe securement using a robotics platform. The ability of four probe adapter technologies to precisely capture images at anatomical locations, repeatedly, and with different ultrasound transducer types were evaluated across more than five scoring criteria. Testing demonstrated two of the adapters outperformed the traditional robot gripper and manual image capture, with a compact, rotating design compatible with wireless imaging technology being most suitable for use at the point of injury. Next steps will integrate the robotic platform with computer vision and deep learning image interpretation models to automate image capture and diagnosis. This will lower the skill threshold needed for medical imaging-based triage, enabling this procedure to be available at or near the point of injury.

Comparison of in-person versus virtual ultrasound instruction for pediatric residents.

PURPOSE: Point-of-care ultrasound (POCUS) instruction is prevalent in medical schools but not in pediatric residency programs, even though the majority of pediatric residents desire POCUS instruction. Virtual ultrasound instruction with affordable handheld ultrasound devices may help remedy this deficiency by allowing qualified instructors to circumvent geographic and financial limitations to reach this population. This study sought to determine if virtual ultrasound instruction is an effective alternative to traditional in-person instruction in a cohort of pediatric residents for the extended Focused Assessment with Sonography in Trauma (eFAST) exam. METHODS: Pediatric residents were randomized to receive either in-person or virtual instruction to learn the eFAST exam using a Sonosite Edge (Sonosite, Inc., Bothell, WA) or Butterfly iQ (Butterfly Network, Inc., Guilford, CT), respectively. After the instructional session, the participants completed a timed assessment in which all required images for the eFAST exam were obtained on the same anatomic model. The content and quality of the images were then scored by expert faculty. RESULTS: There were no significant differences in assessment scores (65.8% and 61.8%, p = 0.349) and assessment duration (482.6 s and 432.6 s, p = 0.346) between pediatric residents who received in-person instruction and those who received virtual instruction. CONCLUSION: Virtual ultrasound instruction appears to be an effective alternative to traditional in-person instruction.