The effect of adherence to ACLS protocols on survival of event in the setting of in-hospital cardiac arrest.

AIM: Advanced Cardiac Life Support (ACLS) algorithms are the default standard of care for in-hospital cardiac arrest (IHCA) management. However, adherence to published guidelines is relatively poor. The records of 149 patients who experienced IHCA were examined to begin to understand the association between overall adherence to ACLS protocols and successful return of spontaneous circulation (ROSC). METHODS: A retrospective chart review of medical records and code team worksheets was conducted for 75 patients who had ROSC after an IHCA event (SE group) and 74 who did not survive an IHCA event (DNS group). Protocol adherence was assessed using a detailed checklist based on the 2005 ACLS Update protocols. Several additional patient characteristics and circumstances were also examined as potential predictors of ROSC. RESULTS: In unadjusted analyses, the percentage of correct steps performed was positively correlated with ROSC from an IHCA (p<0.01), and the number of errors of commission and omission were both negatively correlated with ROSC from an IHCA (p<0.01). In multivariable models, the percentage of correct steps performed and the number of errors of commission and omission remained significantly predictive of ROSC (p<0.01 and p<0.0001, respectively) even after accounting for confounders such as the difference in age and location of the IHCAs. CONCLUSIONS: Our results show that adherence to ACLS protocols throughout an event is correlated with increased ROSC in the setting of cardiac arrest. Furthermore, the results suggest that, in addition to correct actions, both wrong actions and omissions of indicated actions lead to decreased ROSC after IHCA.

Use of an electronic decision support tool improves management of simulated in-hospital cardiac arrest.

INTRODUCTION: Adherence to advanced cardiac life support (ACLS) guidelines during in-hospital cardiac arrest (IHCA) is associated with improved outcomes, but current evidence shows that sub-optimal care is common. Successful execution of such protocols during IHCA requires rapid patient assessment and the performance of a number of ordered, time-sensitive interventions. Accordingly, we sought to determine whether the use of an electronic decision support tool (DST) improves performance during high-fidelity simulations of IHCA. METHODS: After IRB approval and written informed consent was obtained, 47 senior medical students were enrolled. All participants were ACLS certified and within one month of graduation. Each participant was issued an iPod Touch device with a DST installed that contained all ACLS management algorithms. Participants managed two scenarios of IHCA and were allowed to use the DST in one scenario and prohibited from using it in the other. All participants managed the same scenarios. Simulation sessions were video recorded and graded by trained raters according to previously validated checklists. RESULTS: Performance of correct protocol steps was significantly greater with the DST than without (84.7% v 73.8%, p<0.001) and participants committed significantly fewer additional errors when using the DST (2.5 errors vs. 3.8 errors, p<0.012). CONCLUSION: Use of an electronic DST provided a significant improvement in the management of simulated IHCA by senior medical students as measured by adherence to published guidelines.

Validation of a detailed scoring checklist for use during advanced cardiac life support certification.

INTRODUCTION: Defining valid, reliable, defensible, and generalizable standards for the evaluation of learner performance is a key issue in assessing both baseline competence and mastery in medical education. However, before setting these standards of performance, the reliability of the scores yielding from a grading tool must be assessed. Accordingly, the purpose of this study was to assess the reliability of scores generated from a set of grading checklists used by nonexpert raters during simulations of American Heart Association (AHA) Megacodes. METHODS: The reliability of scores generated from a detailed set of checklists, when used by 4 nonexpert raters, was tested by grading team leader performance in 8 Megacode scenarios. Videos of the scenarios were reviewed and rated by trained faculty facilitators and a group of nonexpert raters. The videos were reviewed "continuously" and "with pauses." The grading made by 2 content experts served as the reference standard, and 4 nonexpert raters were used to test the reliability of the checklists. RESULTS: Our results demonstrate that nonexpert raters are able to produce reliable grades when using the checklists under consideration, demonstrating excellent intrarater reliability and agreement with a reference standard. The results also demonstrate that nonexpert raters can be trained in the proper use of the checklist in a short amount of time, with no discernible learning curve thereafter. Finally, our results show that a single trained rater can achieve reliable scores of team leader performance during AHA Megacodes when using our checklist in a continuous mode because measures of agreement in total scoring were very strong [Lin's (Biometrics 1989;45:255-268) concordance correlation coefficient, 0.96; intraclass correlation coefficient, 0.97]. CONCLUSIONS: We have shown that our checklists can yield reliable scores, are appropriate for use by nonexpert raters, and are able to be used during continuous assessment of team leader performance during the review of a simulated Megacode. This checklist may be more appropriate for use by advanced cardiac life support instructors during Megacode assessments than the current tools provided by the AHA.