The Role of Large Language Models in Transforming Emergency Medicine: Scoping Review.

BACKGROUND: Artificial intelligence (AI), more specifically large language models (LLMs), holds significant potential in revolutionizing emergency care delivery by optimizing clinical workflows and enhancing the quality of decision-making. Although enthusiasm for integrating LLMs into emergency medicine (EM) is growing, the existing literature is characterized by a disparate collection of individual studies, conceptual analyses, and preliminary implementations. Given these complexities and gaps in understanding, a cohesive framework is needed to comprehend the existing body of knowledge on the application of LLMs in EM. OBJECTIVE: Given the absence of a comprehensive framework for exploring the roles of LLMs in EM, this scoping review aims to systematically map the existing literature on LLMs' potential applications within EM and identify directions for future research. Addressing this gap will allow for informed advancements in the field. METHODS: Using PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) criteria, we searched Ovid MEDLINE, Embase, Web of Science, and Google Scholar for papers published between January 2018 and August 2023 that discussed LLMs' use in EM. We excluded other forms of AI. A total of 1994 unique titles and abstracts were screened, and each full-text paper was independently reviewed by 2 authors. Data were abstracted independently, and 5 authors performed a collaborative quantitative and qualitative synthesis of the data. RESULTS: A total of 43 papers were included. Studies were predominantly from 2022 to 2023 and conducted in the United States and China. We uncovered four major themes: (1) clinical decision-making and support was highlighted as a pivotal area, with LLMs playing a substantial role in enhancing patient care, notably through their application in real-time triage, allowing early recognition of patient urgency; (2) efficiency, workflow, and information management demonstrated the capacity of LLMs to significantly boost operational efficiency, particularly through the automation of patient record synthesis, which could reduce administrative burden and enhance patient-centric care; (3) risks, ethics, and transparency were identified as areas of concern, especially regarding the reliability of LLMs' outputs, and specific studies highlighted the challenges of ensuring unbiased decision-making amidst potentially flawed training data sets, stressing the importance of thorough validation and ethical oversight; and (4) education and communication possibilities included LLMs' capacity to enrich medical training, such as through using simulated patient interactions that enhance communication skills. CONCLUSIONS: LLMs have the potential to fundamentally transform EM, enhancing clinical decision-making, optimizing workflows, and improving patient outcomes. This review sets the stage for future advancements by identifying key research areas: prospective validation of LLM applications, establishing standards for responsible use, understanding provider and patient perceptions, and improving physicians' AI literacy. Effective integration of LLMs into EM will require collaborative efforts and thorough evaluation to ensure these technologies can be safely and effectively applied.

19-Year-Old with Sudden Onset Left Testicular Pain.

CASE PRESENTATION: A previously healthy 19-year-old man presented to the emergency department with severe, sudden onset of left testicular pain. Physical exam revealed a left high-riding, horizontally oriented testicle without cremasteric reflex. Point-of-care ultrasound was used to confirm the diagnosis of testicular torsion, as well as to guide manual detorsion, verifying return of blood flow after reduction. DISCUSSION: Testicular torsion is a urologic emergency in which testicular viability is time dependent. Point-of-care ultrasound can be an important and helpful tool to not only confirm suspicion but help guide adequacy of blood flow return after manual detorsion in conjunction with comprehensive ultrasound.

A Distance-Learning Approach to Point-of-Care Ultrasound Training (ADAPT): A Multi-Institutional Educational Response During the COVID-19 Pandemic.

PROBLEM: The COVID-19 pandemic significantly disrupted point-of-care ultrasound (POCUS) education. Medical schools and residency programs placed restrictions on bedside teaching and clinical scanning as part of risk mitigation. In response, POCUS faculty from 15 institutions nationwide collaborated on an alternative model of ultrasound education, A Distance-learning Approach to POCUS Training (ADAPT). APPROACH: ADAPT was repeated monthly from April 1 through June 30, 2020. It accommodated 70 learners, who included 1- to 4-week rotators and asynchronous learners. The curriculum included assigned prework and learning objectives covering 20 core POCUS topics. A rotating group of 30 faculty and fellows delivered daily virtual teaching sessions that included gamification to increase learner engagement and hands-on instruction through teleguidance. After participation, faculty and learners completed anonymous surveys. OUTCOMES: Educators reported a significant decrease in preparatory time (6.2 vs 3.1 hours per week, P < .001) dedicated to ultrasound education after implementing ADAPT. The majority of 29 learners who completed surveys felt "somewhat confident" or "very confident" in their ability to acquire (n = 25, 86.2%) and interpret (n = 27, 93.1%) ultrasound images after the intervention; the majority of 22 educators completing surveys rated the program "somewhat effective" or "very effective" at contributing to learner's ability to acquire (n = 13, 59.1%) and interpret (n = 20, 90.9%) images. Most learners (n = 28, 96.6%) and all educators (n = 22, 100%) were "satisfied" or "very satisfied" with ADAPT as a whole, and the large majority of educators were "very likely" (n = 18, 81.8%) to recommend continued use of this program. NEXT STEPS: A virtual curriculum that pools the efforts of multiple institutions nationwide was implemented rapidly and effectively while satisfying educational expectations of both learners and faculty. This collaborative framework can be replicated and may be generalizable to other educational objectives.

Using a Simulated Model and Mastery Learning Approach to Teach the Ultrasound-guided Serratus Anterior Plane Block to Emergency Medicine Residents: A Pilot Study.

BACKGROUND: The serratus anterior plane block (SAPB) is a safe, single-injection alternative for pain control in patients with rib fractures. This pilot study aims to teach the ultrasound-guided SAPB to emergency medicine (EM) residents using a mastery learning approach. METHODS: A 19-item checklist was created and mastery was determined to be 17 of 19 items correct. This pass score was established using a Mastery Angoff standard-setting exercise with a group of EM experts. Learners participated in baseline testing on a simulated model and performance was assessed by two raters. Learners then watched an instructional video and participated in an individualized teaching session. Learners underwent deliberate practice followed by posttesting until mastery was achieved. Score differences in baseline testing and posttesting were analyzed using a paired t-test. Pre- and posttesting surveys were also completed by participants. RESULTS: Twenty-eight PGY-1 to -4 residents volunteered to participate in the study. The range of reported SAPBs seen previously was 0 to 5. The mean (±SD) number of items correct on the checklist for initial testing was 8.5 of 19 (±2.7), while the mean (±SD) final score was 18 of 19 (±0.6; p < 0.001). All participants met mastery standards after the curriculum intervention. Median self-reported procedural confidence was 2 out of 5 on a 5-point Likert scale before the session and 5 out of 5 after the session (Z = -4.681, p < 0.001). CONCLUSIONS: Using a mastery learning approach and simulated model, we were able to successfully train EM residents to perform the SAPB at a level of mastery and increase their overall confidence in executing this procedure.