Triage Performance Across Large Language Models, ChatGPT, and Untrained Doctors in Emergency Medicine: Comparative Study.

BACKGROUND: Large language models (LLMs) have demonstrated impressive performances in various medical domains, prompting an exploration of their potential utility within the high-demand setting of emergency department (ED) triage. This study evaluated the triage proficiency of different LLMs and ChatGPT, an LLM-based chatbot, compared to professionally trained ED staff and untrained personnel. We further explored whether LLM responses could guide untrained staff in effective triage. OBJECTIVE: This study aimed to assess the efficacy of LLMs and the associated product ChatGPT in ED triage compared to personnel of varying training status and to investigate if the models' responses can enhance the triage proficiency of untrained personnel. METHODS: A total of 124 anonymized case vignettes were triaged by untrained doctors; different versions of currently available LLMs; ChatGPT; and professionally trained raters, who subsequently agreed on a consensus set according to the Manchester Triage System (MTS). The prototypical vignettes were adapted from cases at a tertiary ED in Germany. The main outcome was the level of agreement between raters' MTS level assignments, measured via quadratic-weighted Cohen κ. The extent of over- and undertriage was also determined. Notably, instances of ChatGPT were prompted using zero-shot approaches without extensive background information on the MTS. The tested LLMs included raw GPT-4, Llama 3 70B, Gemini 1.5, and Mixtral 8x7b. RESULTS: GPT-4-based ChatGPT and untrained doctors showed substantial agreement with the consensus triage of professional raters (κ=mean 0.67, SD 0.037 and κ=mean 0.68, SD 0.056, respectively), significantly exceeding the performance of GPT-3.5-based ChatGPT (κ=mean 0.54, SD 0.024; P<.001). When untrained doctors used this LLM for second-opinion triage, there was a slight but statistically insignificant performance increase (κ=mean 0.70, SD 0.047; P=.97). Other tested LLMs performed similar to or worse than GPT-4-based ChatGPT or showed odd triaging behavior with the used parameters. LLMs and ChatGPT models tended toward overtriage, whereas untrained doctors undertriaged. CONCLUSIONS: While LLMs and the LLM-based product ChatGPT do not yet match professionally trained raters, their best models' triage proficiency equals that of untrained ED doctors. In its current form, LLMs or ChatGPT thus did not demonstrate gold-standard performance in ED triage and, in the setting of this study, failed to significantly improve untrained doctors' triage when used as decision support. Notable performance enhancements in newer LLM versions over older ones hint at future improvements with further technological development and specific training.

Antiviral treatment for SARS-CoV-2 infection in the current situation: a position paper of the Spanish Society of Emergency Medicine (SEMES). / Posicionamiento de la Sociedad Española de Medicina de Urgencias y Emergencias (SEMES) ante el tratamiento antiviral frente al SARS-CoV-2 en la situación epidemiológica actual.

SUMMARY: COVID-19 continues to pose a significant threat: mortality stands at nearly twice that of influenza, and the incidence rate is growing as the population's vaccination rate decreases, particularly in Spain and other areas of Europe. Given this situation, it is vitally important know whether medical protocols are consistent and appropriately implemented by health care staff in the interest of preventing possible inefficiency or inequity. Physicians from hospital emergency departments met to study their hospitals' usual clinical practices for managing SARS-CoV-2 infection and to determine their expert opinions on the use of antiviral agents. The participating physicians then reached consensus on evidencebased recommendations for strategies that would optimize emergency treatment.

RESUMEN: Actualmente, la COVID-19 sigue representando una amenaza significativa, con una mortalidad cercana al doble de la ocasionada por la gripe y con una incidencia variable debido a una disminución en la tasa de vacunación de la población, especialmente en el contexto europeo y español. Ante este panorama, es de vital importancia comprobar que los protocolos médicos están consolidados y son debidamente implementados por los profesionales sanitarios, con la finalidad de evitar posibles ineficiencias o inequidades. A través de reuniones con profesionales de urgencias se han observado las prácticas clínicas habituales en los servicios de urgencias hospitalarios para pacientes con infección por SARS-CoV-2, con la finalidad de comprender la perspectiva de estos profesionales acerca del uso de antivirales y, tras un consenso de expertos basados en la evidencia actual, se han generado estas de recomendaciones para poder enfocar estrategias que optimicen el tratamiento de los pacientes en estos servicios.

Recommendations for blood sampling in emergency departments from the European Society for Emergency Medicine (EUSEM), European Society for Emergency Nursing (EuSEN), and European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Working Group for the Preanalytical Phase. Executive summary.

AIM: Blood Sampling Guidelines have been developed to target European emergency medicine-related professionals involved in the blood sampling process (e.g. physicians, nurses, phlebotomists working in the ED), as well as laboratory physicians and other related professionals. The guidelines population focus on adult patients. The development of these blood sampling guidelines for the ED setting is based on the collaboration of three European scientific societies that have a role to play in the preanalytical phase process: EuSEN, EFLM, and EUSEM. The elaboration of the questions was done using the PICO procedure, literature search and appraisal was based on the GRADE methodology. The final recommendations were reviewed by an international multidisciplinary external review group. RESULTS: The document includes the elaborated recommendations for the selected sixteen questions. Three in pre-sampling, eight regarding sampling, three post-sampling, and two focus on quality assurance. In general, the quality of the evidence is very low, and the strength of the recommendation in all the questions has been rated as weak. The working group in four questions elaborate the recommendations, based mainly on group experience, rating as good practice. CONCLUSIONS: The multidisciplinary working group was considered one of the major contributors to this guideline. The lack of quality information highlights the need for research in this area of the patient care process. The peculiarities of the emergency medical areas need specific considerations to minimise the possibility of errors in the preanalytical phase.

Spanish Society of Anesthesiology, Reanimation and Pain Therapy (SEDAR), Spanish Society of Emergency and Emergency Medicine (SEMES) and Spanish Society of Otolaryngology, Head and Neck Surgery (SEORL-CCC) Guideline for difficult airway management. Part I.

The Airway Management section of the Spanish Society of Anesthesiology, Resuscitation, and Pain Therapy (SEDAR), the Spanish Society of Emergency Medicine (SEMES), and the Spanish Society of Otorhinolaryngology and Head and Neck Surgery (SEORL-CCC) present the Guide for the comprehensive management of difficult airway in adult patients. Its principles are focused on the human factors, cognitive processes for decision-making in critical situations, and optimization in the progression of strategies application to preserve adequate alveolar oxygenation in order to enhance safety and the quality of care. The document provides evidence-based recommendations, theoretical-educational tools, and implementation tools, mainly cognitive aids, applicable to airway management in the fields of anesthesiology, critical care, emergencies, and prehospital medicine. For this purpose, an extensive literature search was conducted following PRISMA-R guidelines and was analyzed using the GRADE methodology. Recommendations were formulated according to the GRADE methodology. Recommendations for sections with low-quality evidence were based on expert opinion through consensus reached via a Delphi questionnaire.

Spanish Society of Anesthesiology, Reanimation and Pain Therapy (SEDAR), Spanish Society of Emergency and Emergency Medicine (SEMES) and Spanish Society of Otolaryngology, Head and Neck Surgery (SEORL-CCC) Guideline for difficult airway management. Part II.

The Airway Management section of the Spanish Society of Anesthesiology, Resuscitation, and Pain Therapy (SEDAR), the Spanish Society of Emergency Medicine (SEMES), and the Spanish Society of Otorhinolaryngology and Head and Neck Surgery (SEORL-CCC) present the Guide for the comprehensive management of difficult airway in adult patients. Its principles are focused on the human factors, cognitive processes for decision-making in critical situations, and optimization in the progression of strategies application to preserve adequate alveolar oxygenation in order to enhance safety and the quality of care. The document provides evidence-based recommendations, theoretical-educational tools, and implementation tools, mainly cognitive aids, applicable to airway management in the fields of anesthesiology, critical care, emergencies, and prehospital medicine. For this purpose, an extensive literature search was conducted following PRISMA-R guidelines and was analyzed using the GRADE methodology. Recommendations were formulated according to the GRADE methodology. Recommendations for sections with low-quality evidence were based on expert opinion through consensus reached via a Delphi questionnaire.

Ethisch begründet entscheiden in der Intensivmedizin.

The process recommendations of the Ethics Section of the German Interdisciplinary Association for Intensive Care and Emergency Medicine (DIVI) for ethically based decision-making in intensive care medicine are intended to create the framework for a structured procedure for seriously ill patients in intensive care. The processes require appropriate structures, e.g., for effective communication within the treatment team, with patients and relatives, legal representatives, as well as the availability of palliative medical expertise, ethical advisory committees and integrated psychosocial and spiritual care services. If the necessary competences and structures are not available in a facility, they can be consulted externally or by telemedicine if necessary. The present recommendations are based on an expert consensus and are not the result of a systematic review or a meta-analysis.

Assessing the impact of the 2018 tetanus guidelines on knowledge and practices of emergency physicians in trauma patients: a national survey study.

Background: Tetanus remains a significant public health issue in China, with the approach of anti-tetanus prophylaxis in the emergency department resulting in both overuse, particularly of human tetanus immune globulin (TIG), and underuse with the tetanus vaccine. This is largely due to the absence of updated guidelines on tetanus prophylaxis before 2018. Our study aimed to evaluate the effects of the 2018 Chinese tetanus guidelines on the knowledge and practices of emergency physicians about tetanus prevention in trauma patients. Methods: From November 2019 to April 2020, we conducted a web-based survey involving 499 emergency physicians. The survey included a questionnaire covering knowledge, attitudes, and practices related to tetanus. We assessed the influence of the 2018 tetanus guidelines on the knowledge and practices of emergency physicians related to tetanus prevention for patients with trauma using multiple regression analysis. Results: The survey results showed that only 45.3% of the participants had received formal training on tetanus immunization, despite 53.3% reporting the availability of tetanus vaccines at their institutions. Physicians typically prescribed tetanus antitoxin or human TIG instead of tetanus toxoid (TT) to treat injuries, regardless of the patient's TT vaccination history. Among the respondents, those who were aware of the 2018 tetanus guidelines had higher mean scores on the general knowledge, risk knowledge, and treatment knowledge scales, with increases of 6%, 13%, and 9%, respectively, compared to those who were unaware of the guidelines. Awareness of the 2018 tetanus guidelines was associated with a high level of knowledge, as indicated by the general knowledge score, recommendation knowledge score, and total knowledge score, after adjusting for the effects of all variables on the knowledge, attitudes, and practices of the participants. A high level of education was also associated with a high level of knowledge indicated by the recommendation knowledge score and total knowledge score. Conclusions: Our study highlights a substantial gap in the attitudes, knowledge, and practices of emergency physicians in China regarding tetanus immunization. The results suggest an urgent need to promote the Chinese Expert Consensus Guidelines on tetanus to improve emergency physicians' knowledge and competence in tetanus prophylaxis. The findings underscore the importance of enhancing physicians' awareness of the latest guidelines to ensure appropriate and effective treatment for patients with tetanus-prone injuries.

Guidelines for the management of urgent obstetric situations in emergency medicine, 2022

To provide recommendations on the management of urgent obstetrical emergencies outside the maternity ward. A group of 24 experts from the French Society of Emergency Medicine (SFMU), the French Society of Anaesthesia and Intensive Care Medicine (SFAR) and the French College of Gynaecologists and Obstetricians (CNGOF) was convened. Potential conflicts of interest were formally declared at the outset of the guideline development process, which was conducted independently of industry funding. The authors followed the GRADE (Grading of Recommendations Assessment, Development and Evaluation) method to assess the level of evidence in the literature. The potential drawbacks of strong recommendations in the presence of low-level evidence were highlighted. Some recommendations with an insufficient level of evidence were not graded. Eight areas were defined: imminent delivery, postpartum haemorrhage (prevention and management), threat of premature delivery, hypertensive disorders in pregnancy, trauma, imaging, cardiopulmonary arrest, and emergency obstetric training. For each field, the expert panel formulated questions according to the PICO model (population, intervention, comparison, outcomes) and an extensive literature search was conducted. Analysis of the literature and formulation of recommendations were conducted according to the GRADE method. Fifteen recommendations on the management of obstetrical emergencies were issued by the SFMU/SFAR/CNGOF panel of experts, and 4 recommendations from formalised expert recommendations (RFE) established by the same societies were taken up to answer 4 PICO questions dealing with the pre-hospital context. After two rounds of voting and several amendments, strong agreement was reached for all the recommendations. For two questions (cardiopulmonary arrest and inter-hospital transfer), no recommendation could be made. There was significant agreement among the experts on strong recommendations to improve practice in the management of urgent obstetric complications in emergency medicine.

Pro-Con Debate: Viscoelastic Hemostatic Assays Should Replace Fixed Ratio Massive Transfusion Protocols in Trauma.

Major trauma patients at risk of traumatic coagulopathy are commonly treated with early clotting factor replacement to maintain hemostasis and prevent microvascular bleeding. In the United States, trauma transfusions are often dosed by empiric, low-ratio massive transfusion protocols, which pair plasma and platelets in some ratio relative to the red cells, such as the "1:1:1" combination of 1 units of red cells, 1 unit of plasma, and 1 donor's worth of pooled platelets. Empiric transfusion increases the rate of overtransfusion when unnecessary blood products are administered based on a formula and not on at patient's hemostatic profile. Viscoelastic hemostatic assays (VHAs) are point-of-care hemostatic assays that provided detailed information about abnormal clotting pathways. VHAs are used at many centers to better target hemostatic therapies in trauma. This Pro/Con section will address whether VHA guidance should replace empiric fixed ratio protocols in major trauma.

Knowledge and attitudes of emergency medicine physicians and nurses regarding emergency management of dentofacial trauma in pediatric patients.

OBJECTIVES: Considering that the first visit for dentofacial trauma is generally in emergency departments, the awareness and knowledge of the emergency medicine staff regarding the treatment of dentofacial injuries is very important for the prognosis. The aim of this study was to investigate the knowledge, education, and self-confidence levels of emergency medicine physicians and nurses concerning the diagnosis and treatment of dentofacial traumatic injuries in pediatric patients. METHODS: This questionnaire-based, cross-sectional study included emergency medicine physicians and emergency medicine nurses. The survey contained questions and three sections on participants' general data, attitudes, basic knowledge, and confidence levels in managing dentofacial trauma. RESULTS: A total of 407 participants (250 emergency medicine physicians and 157 emergency medicine nurses) were included in this study. There was a significant difference between the groups regarding the correct answers to the questions about trauma management and emergency management of crown fractures and avulsed permanent teeth (p <0.05). CONCLUSION: Our findings show that there is a lack of information on dentofacial trauma for emergency medicine physicians and nurses. In order to increase knowledge in this area and to improve the diagnosis and management of dentofacial trauma, interdisciplinary seminars, case discussions, and continuing education programs should be held for emergency medicine staff.

Documentation of Shared Decisionmaking in the Emergency Department.

STUDY OBJECTIVE: While patient-centered communication and shared decisionmaking are increasingly recognized as vital aspects of clinical practice, little is known about their characteristics in real-world emergency department (ED) settings. We constructed a natural language processing tool to identify patient-centered communication as documented in ED notes and to describe visit-level, site-level, and temporal patterns within a large health system. METHODS: This was a 2-part study involving (1) the development and validation of an natural language processing tool using regular expressions to identify shared decisionmaking and (2) a retrospective analysis using mixed effects logistic regression and trend analysis of shared decisionmaking and general patient discussion using the natural language processing tool to assess ED physician and advanced practice provider notes from 2013 to 2020. RESULTS: Compared to chart review of 600 ED notes, the accuracy rates of the natural language processing tool for identification of shared decisionmaking and general patient discussion were 96.7% (95% CI 94.9% to 97.9%) and 88.9% (95% confidence interval [CI] 86.1% to 91.3%), respectively. The natural language processing tool identified shared decisionmaking in 58,246 (2.2%) and general patient discussion in 590,933 (22%) notes. From 2013 to 2020, natural language processing-detected shared decisionmaking increased 300% and general patient discussion increased 50%. We observed higher odds of shared decisionmaking documentation among physicians versus advanced practice providers (odds ratio [OR] 1.14, 95% CI 1.07 to 1.23) and among female versus male patients (OR 1.13, 95% CI 1.11 to 1.15). Black patients had lower odds of shared decisionmaking (OR 0.8, 95% CI 0.84 to 0.88) compared with White patients. Shared decisionmaking and general patient discussion were also associated with higher levels of triage and commercial insurance status. CONCLUSION: In this study, we developed and validated an natural language processing tool using regular expressions to extract shared decisionmaking from ED notes and found multiple potential factors contributing to variation, including social, demographic, temporal, and presentation characteristics.

United States Best Practice Guidelines for Primary Palliative Care in the Emergency Department.

The growing palliative care needs of emergency department (ED) patients in the United States have motivated the development of ED primary palliative care principles. An expert panel convened to develop best practice guidelines for ED primary palliative care to help guide frontline ED clinicians based on available evidence and consensus opinion of the panel. Results include recommendations for screening and assessment of palliative care needs, ED management of palliative care needs, goals of care conversations, ED palliative care and hospice consults, and transitions of care.

The Influence of the Availability Heuristic on Physicians in the Emergency Department.

STUDY OBJECTIVE: Heuristics, or rules of thumb, are hypothesized to influence the care physicians deliver. One such heuristic is the availability heuristic, under which assessments of an event's likelihood are affected by how easily the event comes to mind. We examined whether the availability heuristic influences physician testing in a common, high-risk clinical scenario: assessing patients with shortness of breath for the risk of pulmonary embolism. METHODS: We performed an event study from 2011 to 2018 of emergency physicians caring for patients presenting with shortness of breath to 104 Veterans Affairs (VA) hospitals. Our measures were physician rates of pulmonary embolism testing (D-dimer and/or computed tomography scan) for subsequent patients after having a patient visit with a pulmonary embolism discharge diagnosis, hypothesizing that physician rates of pulmonary embolism testing would increase after having a recent patient visit with a pulmonary embolism diagnosis due to the availability heuristic. RESULTS: The sample included 7,370 emergency physicians who had 416,720 patient visits for shortness of breath. The mean rate of pulmonary embolism testing was 9.0%. For physicians who had a recent patient visit with a pulmonary embolism diagnosis, their rate of pulmonary embolism testing for subsequent patients increased by 1.4 percentage points (95% confidence interval 0.42 to 2.34) in the 10 days after, which is approximately 15% relative to the mean rate of pulmonary embolism testing. We failed to find statistically significant changes in rates of pulmonary embolism testing in the subsequent 50 days following these first 10 days. CONCLUSION: After having a recent patient visit with a pulmonary embolism diagnosis, physicians increase their rates of pulmonary embolism testing for subsequent patients, but this increase does not persist. These results provide large-scale evidence that the availability heuristic may play a role in complex testing decisions.

Treating Pediatric and Geriatric Patients at Risk of Suicide in General Emergency Departments: Perspectives From Emergency Department Clinical Leaders.

STUDY OBJECTIVE: We explored emergency department clinical leaders' views on providing emergency mental health services to pediatric and geriatric patients with suicidal ideation and suicide attempts. METHODS: We conducted semistructured interviews with a total of 34 nursing directors, medical directors, and behavioral health managers at 17 general hospital EDs across the United States, using purposive sampling to ensure variation among hospitals. Interviews were audio-recorded, transcribed verbatim, and coded and analyzed using Atlas.ti and a directed content analysis approach. RESULTS: Respondents from across a range of ED types expressed concerns regarding the capacity of their EDs to meet mental health needs of children and older adults. They experienced emotional distress over the increasing number of pediatric patients presenting to EDs with suicidal ideation/suicide attempt and described EDs as inappropriate environments for young patients with suicidal ideation/suicide attempt. Similarly, leaders expressed feeling ill-equipped to diagnose and treat geriatric patients with suicidal ideation/suicide attempt, who often had medical comorbidities that complicated treatment planning. Respondents noted that pediatric and geriatric patients frequently boarded in the ED. Some felt compelled to use creative solutions to provide safe spaces for pediatric and geriatric patients. Respondents voiced frustration over the lack of outpatient and inpatient mental health services for these patients. CONCLUSION: Clinical leaders in EDs across the nation expressed distress at feeling they were not adequately equipped to meet the needs of pediatric and geriatric patients with suicidal ideation/suicide attempt. Future innovations to provide ED care for children and older adults with suicidal ideation/suicide attempt might include training for ED teams, access to specialist mental health clinicians through telehealth, and adaptations of physical spaces.

Diagnostic Accuracy of Point-of-Care Ultrasound for Intussusception: A Multicenter, Noninferiority Study of Paired Diagnostic Tests.

STUDY OBJECTIVE: To determine the diagnostic accuracy of point-of-care ultrasound (POCUS) performed by experienced clinician sonologists compared to radiology-performed ultrasound (RADUS) for detection of clinically important intussusception, defined as intussusception requiring radiographic or surgical reduction. METHODS: We conducted a multicenter, noninferiority, observational study among a convenience sample of children aged 3 months to 6 years treated in tertiary care emergency departments across North and Central America, Europe, and Australia. The primary outcome was diagnostic accuracy of POCUS and RADUS with respect to clinically important intussusception. Sample size was determined using a 4-percentage-point noninferiority margin for the absolute difference in accuracy. Secondary outcomes included agreement between POCUS and RADUS for identification of secondary sonographic findings. RESULTS: The analysis included 256 children across 17 sites (35 sonologists). Of the 256 children, 58 (22.7%) had clinically important intussusception. POCUS identified 60 (23.4%) children with clinically important intussusception. The diagnostic accuracy of POCUS was 97.7% (95% confidence interval [CI] 94.9% to 99.0%), compared to 99.3% (95% CI 96.8% to 99.9%) for RADUS. The absolute difference between the accuracy of RADUS and that of POCUS was 1.5 percentage points (95% CI -0.6 to 3.6). Sensitivity for POCUS was 96.6% (95% CI 87.2% to 99.1%), and specificity was 98.0% (95% CI 94.7% to 99.2%). Agreement was high between POCUS and RADUS for identification of trapped free fluid (83.3%, n=40/48) and decreased color Doppler signal (95.7%, n=22/23). CONCLUSION: Our findings suggest that the diagnostic accuracy of POCUS performed by experienced clinician sonologists may be noninferior to that of RADUS for detection of clinically important intussusception. Given the limitations of convenience sampling and spectrum bias, a larger randomized controlled trial is warranted.