The effect of cognitive aid design on the perceived usability of critical event cognitive aids.

BACKGROUND: Critical events require that clinicians process information and make decisions quickly. To reduce mental workload during such events, cognitive aids have been developed. We have previously observed that designing such aids to facilitate discrete information transfer decreased time to information finding. However, whether clinicians perceive aids designed for discrete information transfer as more usable than step-by-step designs remains unclear. We hypothesized that experimental cognitive aids designed for discrete information transfer would be judged more usable than step-by-step Linear aids. METHODS: Volunteer clinicians were asked to use cognitive aids during low fidelity simulation scenarios. Experimental cognitive aids featuring color-coded, labeled, and consistently located content clusters were compared with aids formatted in a traditional step-by-step fashion. We then performed a quantitative assessment of perceived usability and conducted structured knowledge elicitation interviews. RESULTS: Clinicians rated the two experimental cognitive aids as more usable than the Linear aid. On a 0-100 scale the median (IQR) rating was 25(18,23) for the Linear aid and 89(80,95) and 81(65,90) for the two experimental designs, respectively, with a higher number indicating greater ease of use (P < .01 for each). Narrative responses suggested specific features that improved usability and a thematic analysis identified six major themes driving preference for cognitive aid use. CONCLUSION: During simulated critical events, cognitive aids designed for discrete information transfer were considered more usable than step by step Linear aids. Specific themes governing usability were identified during mixed methods analysis. Further work is needed to optimize cognitive aid use among anesthesia clinicians.

The timing of cognitive aid access during simulated pediatric intraoperative critical events.

BACKGROUND: Many cognitive aids are formatted in a step-by-step fashion with the intent that the aid will be accessed at the beginning of a critical event and that key behaviors will be performed in sequence. AIMS: We hypothesized that, during simulated pediatric intraoperative critical events, anesthesia clinicians may not use cognitive aids immediately after the onset of a critical event but instead access the aid only after first performing several key behaviors. MATERIALS AND METHODS: This manuscript is a re-analysis of previously published simulation data. The original study involved 89 clinicians participating in 143 pediatric intraoperative events divided into 6 types: arrhythmia, venous air embolus, hypoxemia, malignant hyperthermia, hypotension, and supraventricular tachycardia. For each trial involving cognitive aid use, we measured the time from event trigger to cognitive aid use, and the number and type of key behaviors performed by simulation participants prior to cognitive aid access. RESULTS: Cognitive aid use was sought in 66 of 93 trials where it was available. Sufficient data for this analysis were available in 65 trials. The average time from event trigger to first cognitive aid use was 258 seconds. In 62/65 trials (95%), the cognitive aid was accessed after at least one key behavior had already been performed. The time from event trigger to cognitive aid use varied by type of scenario (P = .03, df 5, adjusted H 12.78), with the shortest time for "supraventricular tachycardia" (90 [66,156] seconds (median [IQR]) and the longest time for "hypoxemia" (354 [192,492] seconds). CONCLUSION: In simulated critical events, anesthesia residents and student nurse anesthetists often consulted a cognitive aid only after first performing at least some key behaviors. Incorporating the possibility of delayed access into critical event cognitive aid design may facilitate the effectiveness of that aid.

Development and Usability Testing of the Society for Pediatric Anesthesia Pedi Crisis Mobile Application.

When life-threatening, critical events occur in the operating room, the fast-paced, high-distraction atmosphere often leaves little time to think or deliberate about management options. Success depends on applying a team approach to quickly implement well-rehearsed, systematic, evidence-based assessment and treatment protocols. Mobile devices offer resources for readily accessible, easily updatable information that can be invaluable during perioperative critical events. We developed a mobile device version of the Society for Pediatric Anesthesia 26 Pediatric Crisis paper checklists-the Pedi Crisis 2.0 application-as a resource to support clinician responses to pediatric perioperative life-threatening critical events. Human factors expertise and principles were applied to maximize usability, such as by clustering information into themes that clinicians utilize when accessing cognitive aids during critical events. The electronic environment allowed us to feature optional diagnostic support, optimized navigation, weight-based dosing, critical institution-specific phone numbers pertinent to emergency response, and accessibility for those who want larger font sizes. The design and functionality of the application were optimized for clinician use in real time during actual critical events, and it can also be used for self-study or review. Beta usability testing of the application was conducted with a convenience sample of clinicians at 9 institutions in 2 countries and showed that participants were able to find information quickly and as expected. In addition, clinicians rated the application as slightly above "excellent" overall on an established measure, the Systems Usability Scale, which is a 10-item, widely used and validated Likert scale created to assess usability for a variety of situations. The application can be downloaded, at no cost, for iOS devices from the Apple App Store and for Android devices from the Google Play Store. The processes and principles used in its development are readily applicable to the development of future mobile and electronic applications for the field of anesthesiology.

Matching design to use: a task analysis comparison of three cognitive aid designs used during simulated crisis management.

PURPOSE: Intraoperative critical events typically include vital sign instability that requires a specific and time-sensitive response. Although cognitive aids can improve clinical performance during critical events, their design may not be optimized for real-world use. For example, during a critical event, health practitioners may be familiar with the treatment pathway and only require specific information from an aid-a behaviour described as "sampling". We hypothesized that use of cognitive aids designed to facilitate sampling behaviour would reduce the time required to extract information during simulated critical events. METHODS: We designed two experimental cognitive aids, based on cognitive science research on human performance, to facilitate sampling behaviour. Design principles included content clusters that were specifically located, colour-coded and labelled, the elimination of distractors such as numbering, and a key features summary. In a simulated low-fidelity study, we compared the time required for anesthesia care providers to identify and extract specific information from these two experimental cognitive aids and from a traditional step-by-step "linear/control" aid. An eye-tracking device was used to assess how information was accessed from the cognitive aids. RESULTS: When all response times were pooled, participants identified and extracted information more quickly using either experimental aid (median [interquartile range] 6.3 [4.0-9.7] sec, P = 0.006 and 4.7 [3.3-6.3] sec, P < 0.001) than the "linear/control" cognitive aid (12.7 [9.3-14.7] sec). Eye-tracking data revealed that participants spent more time looking at the "linear/control" design cognitive aid [mean (standard deviation) 10.9 (7.1) sec] than at either experimental cognitive aid [6.7 (4.6) and 3.8 (2.5) sec, P = 0.020, P < 0.001], respectively. CONCLUSION: Cognitive aids designed to enhance sampling behaviour may facilitate rapid retrieval of specific information during crisis management.

Transfusion reactions and cognitive aids.

PURPOSE OF REVIEW: Although the overall safety of blood transfusion is high, adverse events do still occur. Much research on transfusion reactions was done in nonperioperative patients. Fortunately, important contributions to the perioperative literature have been made in the last several years, specifically in the areas of transfusion-associated circulatory overload and transfusion-related acute lung injury (TRALI). RECENT FINDINGS: An unfavorable reaction occurs in as many as 1% of transfusions overall, although the risk of death with each unit given is between 0.002 and 0.0005%. Specific, modifiable factors exist, however, of which the anesthesiologist should be aware. A 2017 article by Clifford et al. is the first to examine risk factors and outcomes for transfusion-associated circulatory overload in a high-risk noncardiac surgery population undergoing anesthesia and surgery. In recent years, limiting plasma donors to males only resulted in an approximately 50% decrease in TRALI. SUMMARY: The current article explores new research on the topics of transfusion-associated circulatory overload and transfusion-related lung injury.

More Than a Tick Box: Medical Checklist Development, Design, and Use.

Despite improving patient safety in some perioperative settings, some checklists are not living up to their potential and complaints of "checklist fatigue" and outright rejection of checklists are growing. Problems reported often concern human factors: poor design, inadequate introduction and training, duplication with other safety checks, poor integration with existing workflow, and cultural barriers. Each medical setting-such as an operating room or a critical care unit-and different clinical needs-such as a shift handover or critical event response-require a different checklist design. One size will not fit all, and checklists must be built around the structure of medical teams and the flow of their work in those settings. Useful guidance can be found in the literature; however, to date, no integrated and comprehensive framework exists to guide development and design of checklists to be effective and harmonious with the flow of medical and perioperative tasks. We propose such a framework organized around the 5 stages of the checklist life cycle: (1) conception, (2) determination of content and design, (3) testing and validation, (4) induction, training, and implementation, and (5) ongoing evaluation, revision, and possible retirement. We also illustrate one way in which the design of checklists can better match user needs in specific perioperative settings (in this case, the operating room during critical events). Medical checklists will only live up to their potential to improve the quality of patient care if their development is improved and their designs are tailored to the specific needs of the users and the environments in which they are used.

Pediatric trauma transfusion and cognitive aids.

PURPOSE OF REVIEW: Trauma is the most common cause of pediatric mortality. Much of the research that led to life-saving interventions in adults, however, has not been replicated in the pediatric population. Children have important physiologic and anatomic differences from adults, which impact hemostasis and transfusion. Hemorrhage is a leading cause of death in trauma, and children have important differences in their coagulation profiles. Transfusion strategies, including the massive transfusion protocol and use of antifibrinolytics, are still controversial. In addition to the blood that is lost from the injury itself, trauma leads to inflammation and to a dysfunction in hemostasis, causing coagulopathy. RECENT FINDINGS: In one study in which children suffered from mainly blast and penetrating injuries in a combat setting (PEDTRAX trial), the early administration of tranexamic acid was associated with decreased mortality. Some authors suggest that this result may not apply to blunt trauma, which is much more common in children in noncombat settings. Using thromboelastography to guide the administration of recombinant Factor VIIa has been done in selected cases and may represent a future avenue of research. SUMMARY: This article explores new research from the past year in pediatric trauma, starting with the physiologic differences in pediatric red blood cells and coagulation profiles. We also looked at the dramatic change in thinking over the past decade in the tolerable level of anemia in critically ill pediatric patients, as well as scales for determining the need for massive transfusion and exploring if the concepts of damage control resuscitation apply to children. Other strategies, such as avoiding hypothermia, and the selective administration of antifibriniolytics, are important in pediatric trauma as well. Future research that is pediatric focused is needed for the optimal care of our youngest patients.

The Development and Implementation of Cognitive Aids for Critical Events in Pediatric Anesthesia: The Society for Pediatric Anesthesia Critical Events Checklists.

Cognitive aids such as checklists are commonly used in modern operating rooms for routine processes, and the use of such aids may be even more important during critical events. The Quality and Safety Committee of the Society for Pediatric Anesthesia (SPA) has developed a set of critical-event checklists and cognitive aids designed for 3 purposes: (1) as a repository of the latest evidence-based and expert opinion-based information to guide response and management of critical events, (2) as a source of just-in-time information during critical events, and (3) as a method to facilitate a shared understanding of required actions among team members during a critical event. Committee members, who represented children's hospitals from across the nation, used the recent literature and established guidelines (where available) and incorporated the expertise of colleagues at their institutions to develop these checklists, which included relevant factors to consider and steps to take in response to critical events. Human factors principles were incorporated to enhance checklist usability, facilitate error-free accomplishment, and ensure a common approach to checklist layout, formatting, structure, and design.The checklists were made available in multiple formats: a PDF version for easy printing, a mobile application, and at some institutions, a Web-based application using the anesthesia information management system. After the checklists were created, training commenced, and plans for validation were begun. User training is essential for successful implementation and should ideally include explanation of the organization of the checklists; familiarization of users with the layout, structure, and formatting of the checklists; coaching in how to use the checklists in a team environment; reviewing of the items; and simulation of checklist use. Because of the rare and unpredictable nature of critical events, clinical trials that use crisis checklists are difficult to conduct; however, recent and future simulation studies with adult checklists provide a promising avenue for future validation of the SPA checklists. This article will review the developmental steps in producing the SPA crisis checklists, including creation of content, incorporation of human factors elements, and validation in simulation. Critical-events checklists have the potential to improve patient care during emergency events, and it is hoped that incorporating the elements presented in this article will aid in successful implementation of these essential cognitive aids.

Paper or plastic? Simulation based evaluation of two versions of a cognitive aid for managing pediatric peri-operative critical events by anesthesia trainees: evaluation of the society for pediatric anesthesia emergency checklist.

Cognitive aids (CA), including emergency manuals and checklists, are tools designed to assist users in prioritizing and performing complex tasks during time sensitive, high stress situations (Marshall in Anesth Analgesia 117(5):1162-1171, 2013; Marshall and Mehra in Anaesthesia 69(7):669-677, 2014). The society for pediatric anesthesia (SPA) has developed a series of emergency checklists tailored for use by pediatric perioperative teams that cover a wide range of intraoperative critical events (Shaffner et al. in Anesth Analgesia 117(4):960-979, 2013). In this study, we evaluated user preferences for a CA (SPA checklist) using two different presentation formats, paper and electronic, during management of simulated critical events. Anesthesia trainees managed the simulated critical events under one of three randomized conditions: (1) memory alone, (2) with a paper version of the CA, (3) with an electronic version of the CA. Following participation in the simulated critical events, participants were asked to complete a survey regarding their experience using the different versions of the CA. The percentage of favorable responses for each format of the CA was compared using a mixed effects proportional odds model. There were 143 simulated events managed by 89 anesthesia trainees. Approximately one out of three trainees (electronic 29 %, paper 30 %) assigned to use the CA chose not to use it and completed the scenario from memory alone. The survey was completed by 68 % of participants, 58 % of trainees preferred the paper version and 35 % preferred the electronic version. All survey responses that reached statistical significance favored the paper version. In this study, anesthesia trainees had a favorable opinion of the content and perceived clinical relevance of both versions of the CA. In both quantitative and qualitative analysis, the paper version of the CA was preferred over the electronic version by participants. Despite overall favorable responses to the CA, a sizeable number of participants chose not to use either version the CA during the crisis.

PERIPHERAL INTRAVENOUS CATHETER PROBLEMS IN INFANTS AND CHILDREN PRESENTING FOR ANESTHESIA AND SURGERY.

BACKGROUND: Anesthesia providers frequently rely upon in-situ peripheral intravenous catheters (IVs) during the perioperative care of pediatric patients. IV dysfunction can result in complications including inability to administer medications for resuscitation, extravasation of tissue-toxic medications, and incomplete induction of anesthesia. This study was performed to prospectively assess the frequency of IV dysfunction in children presenting for anesthesia care. METHODS: A survey of IV patency and integrity was completed in patients less than 18 years of age arriving at the preoperative holding area for anesthesia evaluation. Prior to the induction of anesthesia, an anesthesiologist examined the IV for patency and evidence of infiltration. Demographic information, catheter site and size, condition of skin, elapsed time since insertion, and hospital site of catheter insertion were recorded. RESULTS: Over a 14-month period, 108 IVs were evaluated in 106 patients. One or more problems were identified with 35% of the IVs. Problems included erythema or pain to palpation at insertion site (29%), difficulty with injection of saline (45%), pain on injection of saline (50%), infiltrate at insertion site (13%), no flow or poor flow to gravity (42%), and kinked catheter (11%). The frequency of IV dysfunction was higher in infants (50%), with 24 gauge catheters (59%), with lower extremity IVs (50%), and with IVs in place for more than 3 three days (75%). CONCLUSIONS: Approximately one-third of pre-existing IVs were dysfunctional in children presenting for anesthesia and surgery. Inspection for the integrity of the IV should occur prior to and during use, and a plan should be in place for readily replacing the IV in cases of dysfunction or for using an alternative route for the induction of anesthesia.

Pediatric neuroanesthesia.

PURPOSE OF REVIEW: A series of recent studies have changed the practice of pediatric neuroanesthesia, improving outcomes and making children's quality of life better. RECENT FINDINGS: Potential long-term neurologic effects in infants and young children undergoing surgery and anesthesia have been recognized for over a decade. Several recent, well performed studies suggest that hypotension may also be a major contributor to postoperative neurologic impairment in children. Craniosynostosis surgery has also been the subject of extensive study, both related to decreasing blood loss and to optimizing postoperative outcomes. SUMMARY: Although neurosurgical anesthesia research in the pediatric population can be ethically and logistically complex, resolving questions such as the optimal blood pressure during surgery and best management of infants undergoing repair of craniosynostosis will improve patient outcomes.

Anesthetic management of patients with placenta accreta and resuscitation strategies for associated massive hemorrhage.

PURPOSE OF REVIEW: Placenta accreta is one of the leading causes of peripartum hemorrhage. The goal of this article is to review anesthetic management of parturients with placenta accreta and to examine a modern approach to massive peripartum hemorrhage. RECENT FINDINGS: The incidence of placenta accreta is rising in parallel with the increased rate of cesarean delivery. If accreta is diagnosed or suspected preoperatively, anesthetic management can be optimized. Even with the best possible management, the blood loss associated with placenta accreta can resemble that of a major trauma. The use of Damage Control Resuscitation strategies to guide transfusion may improve morbidity and mortality. SUMMARY: Careful planning and close communication are essential between anesthesiology, obstetric, interventional radiology, gynecologic oncology, blood bank, and specialized surgical teams when taking care of a patient with placenta accreta.

Chest Compression Duration May Be Improved When Rescuers Breathe Supplemental Oxygen.

BACKGROUND: At sea level, performing chest compressions is a demanding physical exercise. On a commercial flight at cruise altitude, the barometric pressure in the cabin is approximately equal to an altitude of 2438 m. This results in a Po2 equivalent to breathing an FIo2 of 15% at sea level, a condition under which both the duration and quality of cardiopulmonary resuscitation (CPR) may deteriorate. We hypothesized that rescuers will be able to perform fewer rounds of high-quality CPR at an FIo2 of 15%.METHODS: In this crossover simulation trial, 16 healthy volunteers participated in 2 separate sessions and performed up to 14 2-min rounds of chest compressions at an FIo2 of either 0.15 or 0.21 in randomized order. Subjects were stopped if their Spo2 was below 80%, if chest compression rate or depth was not achieved for 2/3 of compressions, or if they felt fatigued or dyspneic.RESULTS: Fewer rounds of chest compressions were successfully completed in the hypoxic than in the normoxic condition, (median [IQR] 4.5 [3,8.5]) vs. 5 [4,14]). The decline in arterial Spo2 while performing chest compressions was greater in the hypoxic condition than in the normoxic condition [mean (SD), 6.19% (4.1) vs. 2% (1.66)].DISCUSSION: Our findings suggest that the ability of rescuers to perform chest compressions in a commercial airline cabin at cruising altitude may be limited due to hypoxia. One possible solution is supplemental oxygen for rescuers who perform chest compressions for in-flight cardiac arrest.Clebone A, Reis K, Tung A, OConnor M, Ruskin KJ. Chest compression duration may be improved when rescuers breathe supplemental oxygen. Aerosp Med Hum Perform. 2020; 91(12):918922.

A Time-Out Checklist for Pediatric Regional Anesthetics.

BACKGROUND AND OBJECTIVES: Although pediatric regional anesthesia has a demonstrated record of safety, adverse events, especially those related to block performance issues, still may occur. To reduce the frequency of those events, we developed a Regional Anesthesia Time-Out Checklist using expert opinion and the Delphi method. METHODS: A content development and review was performed by the authors and the Society for Pediatric Anesthesia Quality and Safety Committee. The expert panel was composed of 12 pediatric anesthesiologists, who achieved consensus after 2 rounds of a modified Delphi method. Finally, an author who is an expert in checklist design (B.B.) provided guidance on the formatting and layout of the checklist items to ensure clarity and ease of use. The resulting checklist was trialed in a small pilot study to solicit feedback in a real-life setting. RESULTS: Sixteen items were included in the checklist sent to the expert panel for the first round of Delphi. Items that had an average rating of 3 or more, with fewer than 3 negative comments, were retained (n = 15). Feedback led to combining several items and dividing the checklist into 2 sections based on the following temporal implementation criteria: "preoperatively" or "immediately before procedure." All remaining 12 checklist items received a positive response from more than 50% of expert panel members and therefore were retained after the second and final round of Delphi. No significant alterations were suggested in the pilot trial. CONCLUSIONS: The Delphi method and human factors principles enabled the creation of a Regional Anesthesia Time-Out Checklist based on published and experiential knowledge of adverse events. Usability of the checklist was supported through the results of a pilot study.

Mode of Information Delivery Does Not Effect Anesthesia Trainee Performance During Simulated Perioperative Pediatric Critical Events: A Trial of Paper Versus Electronic Cognitive Aids.

INTRODUCTION: Cognitive aids (CAs), including emergency manuals and checklists, have been recommended as a means to address the failure of healthcare providers to adhere to evidence-based standards of treatment during crisis situations. Unfortunately, users of CAs still commit errors, omit critical steps, fail to achieve perfect adherence to guidelines, and frequently choose to not use CA during both simulated and real crisis events. We sought to evaluate whether the mode in which a CA presents information (ie, paper vs. electronic) affects clinician performance during simulated critical events. METHODS: In a prospective, randomized, controlled trial, anesthesia trainees managed simulated events under 1 of the following 3 conditions: (1) from memory alone (control), (2) with a paper CA, or (3) with an electronic version of the same CA. Management of the events was assessed using scenario-specific checklists. Mixed-effect regression models were used for analysis of overall checklist score and for elapsed time. RESULTS: One hundred thirty-nine simulated events were observed and rated. Approximately, 1 of 3 trainees assigned to use a CA (electronic 29%, paper 36%) chose not to use it during the scenario. Compared with the control group (52%), the overall score was 6% higher in the paper CA group and 8% higher (95% confidence interval, 0.914.5; P = 0.03) in the electronic CA group. The difference between paper and electronic CA was not significant. There was a wide range in time to first use of the CA, but the time to task completion was not affected by CA use, nor did the time to CA use impact CA effectiveness as measured by performance. CONCLUSIONS: The format (paper or electronic) of the CA did not affect the impact of the CA on clinician performance in this study. Clinician compliance with the use of the CA was unaffected by format, suggesting that other factors may determine whether clinicians choose to use a CA or not. Time to use of the CA did not affect clinical performance, suggesting that it may not be when CAs are used but how they are used that determines their impact. The current study highlights the importance of not just familiarizing clinicians with the content of CA but also training clinicians in when and how to use an emergency CA.