Correlation Between Paramedic Disaster Triage Accuracy in Screen-Based Simulations and Immersive Simulations.

Background: Disaster triage is an infrequent, high-stakes skill set used by emergency medical services (EMS) personnel. Screen-based simulation (SBS) provides easy access to asynchronous disaster triage education. However, it is unclear if the performance during a SBS correlates with immersive simulation performance. Methods: This was a nested cohort study within a randomized controlled trial (RCT). The RCT compared triage accuracy of paramedics and emergency medical technicians (EMTs) who completed an immersive simulation of a school shooting, interacted with an SBS for 13 weeks, and then completed the immersive simulation again. The participants were divided into two groups: those exposed vs. those not exposed to 60 Seconds to Survival© (60S), a disaster triage SBS. The aim of the study was to measure the correlation between SBS triage accuracy and immersive simulation triage accuracy. Improvements in triage accuracy were compared among participants in the nested study before and after interacting with 60S, and with improvements in triage accuracy in a previous study in which immersive simulations were used as an educational intervention. Results: Thirty-nine participants completed the SBS; 26 (67%) completed at least three game plays and were included in the evaluation of outcomes of interest. The mean number of plays was 8.5 (SD =7.4). Subjects correctly triaged 12.4% more patients in the immersive simulation at study completion (73.1% before, 85.8% after, P = 0.004). There was no correlation between the amount of improvement in overall SBS triage accuracy, instances of overtriage (P = 0.101), instances of undertriage (P = 0.523), and improvement in the second immersive simulation. A comparison of the pooled data from a previous immersive simulation study with the nested cohort data showed similar improvement in triage accuracy (P = 0.079). Conclusions: SBS education was associated with a significant increase in triage accuracy in an immersive simulation, although triage accuracy demonstrated in the SBS did not correlate with the performance in the immersive simulation. This improvement in accuracy was similar to the improvement seen when immersive simulation was used as the educational intervention in a previous study.

60 Seconds to Survival: A Multisite Study of a Screen-based Simulation to Improve Prehospital Providers Disaster Triage Skills.

OBJECTIVES: Paramedics and emergency medical technicians (EMTs) perform triage at disaster sites. There is a need for disaster triage training. Live simulation training is costly and difficult to deliver. Screen-based simulations may overcome these training barriers. We hypothesized that a screen-based simulation, 60 Seconds to Survival (60S), would be associated with in-game improvements in triage accuracy. METHODS: This was a prospective cohort study of a screen-based simulation intervention, 60S. Participants included emergency medical services (EMS) personnel from 21 EMS agencies across 12 states. Participants performed assessments (e.g., check for pulse) and actions (e.g., reposition the airway) for 12 patients in each scenario and assigned color-coded triage levels (red, yellow, green, or black) to each patient. Participants received on-screen feedback about triage performance immediately after each scenario. A scoring system was designed to encourage accurate and timely triage decisions. Participants who played 60S included practicing EMTs, paramedics, and nurses as well as students studying to assume these roles. Participants played the game at least three times over 13 weeks. RESULTS: In total, 2,234 participants began game play and 739 completed the study and were included in the analysis. Overall, the median number of plays of the game was just above the threshold inclusion criteria (three or more plays) with a median of four plays during the study period (interquartile range [IQR] = 3-7). There was a significant difference in triage accuracy from the first play of the game to the last play of the game. Median baseline triage accuracy in the game was 89.7% (IQR = 82.1%-94.9%), which then increased to a median of 100% at the last game play (IQR = 87.5%-100.0%; p < 0.001). There was some variability in median triage accuracy on fourth through 11th game plays, ranging from 95% to 100%, and on the 12th to 16th plays, the median accuracy was sustained at 100%. There was a significant decrease in the rate of undertriage: from 10.3% (IQR = 5.1%-18.0%) to 0 (IQR = 0%-12.5%; p < 0.001). CONCLUSION: 60 Seconds to Survival is associated with improved in-game triage accuracy. Further study of the correlation between in-game triage accuracy and improvements in live simulation or real-world triage decisions is warranted.

60 seconds to survival: A pilot study of a disaster triage video game for prehospital providers.

INTRODUCTION: Disaster triage training for emergency medical service (EMS) providers is not standardized. Simulation training is costly and time-consuming. In contrast, educational video games enable low-cost and more time-efficient standardized training. We hypothesized that players of the video game "60 Seconds to Survival" (60S) would have greater improvements in disaster triage accuracy compared to control subjects who did not play 60S. METHODS: Participants recorded their demographics and highest EMS training level and were randomized to play 60S (intervention) or serve as controls. At baseline, all participants completed a live school-shooting simulation in which manikins and standardized patients depicted 10 adult and pediatric victims. The intervention group then played 60S at least three times over the course of 13 weeks (time 2). Players triaged 12 patients in three scenarios (school shooting, house fire, tornado), and received in-game performance feedback. At time 2, the same live simulation was conducted for all participants. Controls had no disaster training during the study. The main outcome was improvement in triage accuracy in live simulations from baseline to time 2. Physicians and EMS providers predetermined expected triage level (RED/YELLOW/GREEN/BLACK) via modified Delphi method. RESULTS: There were 26 participants in the intervention group and 21 in the control group. There was no difference in gender, level of training, or years of EMS experience (median 5.5 years intervention, 3.5 years control, p = 0.49) between the groups. At baseline, both groups demonstrated median triage accuracy of 80 percent (IQR 70-90 percent, p = 0.457). At time 2, the intervention group had a significant improvement from baseline (median accuracy = 90 percent [IQR: 80-90 percent], p = 0.005), while the control group did not (median accuracy = 80 percent [IQR:80-95], p = 0.174). However, the mean improvement from baseline was not significant between the two groups (difference = 6.5, p = 0.335). CONCLUSION: The intervention demonstrated a significant improvement in accuracy from baseline to time 2 while the control did not. However, there was no significant difference in the improvement between the intervention and control groups. These results may be due to small sample size. Future directions include assessment of the game's effect on triage accuracy with a larger, multisite site cohort and iterative development to improve 60S.

Do you see what I see? Insights from using google glass for disaster telemedicine triage.

INTRODUCTION: Disasters are high-stakes, low-frequency events. Telemedicine may offer a useful adjunct for paramedics performing disaster triage. The objective of this study was to determine the feasibility of telemedicine in disaster triage, and to determine whether telemedicine has an effect on the accuracy of triage or the time needed to perform triage. METHODS: This is a feasibility study in which an intervention team of two paramedics used the mobile device Google Glass (Google Inc; Mountain View, California USA) to communicate with an off-site physician disaster expert. The paramedic team triaged simulated disaster victims at the triennial drill of a commercial airport. The simulated victims had preassigned expected triage levels. The physician had an audio-video interface with the paramedic team and was able to observe the victims remotely. A control team of two paramedics performed disaster triage in the usual fashion. Both teams used the SMART Triage System (TSG Associates LLP; Halifax, England), which assigns patients into Red, Yellow, Green, and Black triage categories. The paramedics were video recorded, and their time required to triage was logged. It was determined whether the intervention team and the control team varied regarding accuracy of triage. Finally, the amount of time the intervention team needed to triage patients when telemedicine was used was compared to when that team did not use telemedicine. RESULTS: The two teams triaged the same 20 patients. There was no significant difference between the two groups in overall triage accuracy (85.7% for the intervention group vs 75.9% for the control group; P = .39). Two patients were triaged with telemedicine. For the intervention group, there was a significant difference in time to triage patients with telemedicine versus those without telemedicine (35.5 seconds; 95% CI, 72.5-143.5 vs 18.5 seconds; 95% CI, 13.4-23.6; P = .041). CONCLUSION: There was no increase in triage accuracy when paramedics evaluating disaster victims used telemedicine, and telemedicine required more time than conventional triage. There are a number of obstacles to available technology that, if overcome, might improve the utility of telemedicine in disaster response.