Accuracy and Reliability of Emergency Department Triage Using the Emergency Severity Index: An International Multicenter Assessment.

STUDY OBJECTIVE: We assess accuracy and variability of triage score assignment by emergency department (ED) nurses using the Emergency Severity Index (ESI) in 3 countries. In accordance with previous reports and clinical observation, we hypothesize low accuracy and high variability across all sites. METHODS: This cross-sectional multicenter study enrolled 87 ESI-trained nurses from EDs in Brazil, the United Arab Emirates, and the United States. Standardized triage scenarios published by the Agency for Healthcare Research and Quality (AHRQ) were used. Accuracy was defined by concordance with the AHRQ key and calculated as percentages. Accuracy comparisons were made with one-way ANOVA and paired t test. Interrater reliability was measured with Krippendorff's α. Subanalyses based on nursing experience and triage scenario type were also performed. RESULTS: Mean accuracy pooled across all sites and scenarios was 59.2% (95% confidence interval [CI] 56.4% to 62.0%) and interrater reliability was modest (α=.730; 95% CI .692 to .767). There was no difference in overall accuracy between sites or according to nurse experience. Medium-acuity scenarios were scored with greater accuracy (76.4%; 95% CI 72.6% to 80.3%) than high- or low-acuity cases (44.1%, 95% CI 39.3% to 49.0% and 54%, 95% CI 49.9% to 58.2%), and adult scenarios were scored with greater accuracy than pediatric ones (66.2%, 95% CI 62.9% to 69.7% versus 46.9%, 95% CI 43.4% to 50.3%). CONCLUSION: In this multinational study, concordance of nurse-assigned ESI score with reference standard was universally poor and variability was high. Although the ESI is the most popular ED triage tool in the United States and is increasingly used worldwide, our findings point to a need for more reliable ED triage tools.

Accuracy of emergency department triage using the Emergency Severity Index and independent predictors of under-triage and over-triage in Brazil: a retrospective cohort analysis.

BACKGROUND: Emergency department (ED) triage is performed to prioritize care for patients with critical and time-sensitive illness. Triage errors create opportunity for increased morbidity and mortality. Here, we sought to measure the frequency of under- and over-triage of patients by nurses using the Emergency Severity Index (ESI) in Brazil and to identify factors independently associated with each. METHODS: This was a single-center retrospective cohort study. The accuracy of initial ESI score assignment was determined by comparison with a score entered at the close of each ED encounter by treating physicians with full knowledge of actual resource utilization, disposition, and acute outcomes. Chi-square analysis was used to validate this surrogate gold standard, via comparison of associations with disposition and clinical outcomes. Independent predictors of under- and over-triage were identified by multivariate logistic regression. RESULTS: Initial ESI-determined triage score was classified as inaccurate for 16,426 of 96,071 patient encounters. Under-triage was associated with a significantly higher rate of admission and critical outcome, while over-triage was associated with a lower rate of both. A number of factors identifiable at time of presentation including advanced age, bradycardia, tachycardia, hypoxia, hyperthermia, and several specific chief complaints (i.e., neurologic complaints, chest pain, shortness of breath) were identified as independent predictors of under-triage, while other chief complaints (i.e., hypertension and allergic complaints) were independent predictors of over-triage. CONCLUSIONS: Despite rigorous and ongoing training of ESI users, a large number of patients in this cohort were under- or over-triaged. Advanced age, vital sign derangements, and specific chief complaints-all subject to limited guidance by the ESI algorithm-were particularly under-appreciated.