Reliability of simulation-based assessment for practicing physicians: performance is context-specific.

INTRODUCTION: Even physicians who routinely work in complex, dynamic practices may be unprepared to optimally manage challenging critical events. High-fidelity simulation can realistically mimic critical clinically relevant events, however the reliability and validity of simulation-based assessment scores for practicing physicians has not been established. METHODS: Standardised complex simulation scenarios were developed and administered to board-certified, practicing anesthesiologists who volunteered to participate in an assessment study during formative maintenance of certification activities. A subset of the study population agreed to participate as the primary responder in a second scenario for this study. The physicians were assessed independently by trained raters on both teamwork/behavioural and technical performance measures. Analysis using Generalisability and Decision studies were completed for the two scenarios with two raters. RESULTS: The behavioural score was not more reliable than the technical score. With two raters > 20 scenarios would be required to achieve a reliability estimate of 0.7. Increasing the number of raters for a given scenario would have little effect on reliability. CONCLUSIONS: The performance of practicing physicians on simulated critical events may be highly context-specific. Realistic simulation-based assessment for practicing physicians is resource-intensive and may be best-suited for individualized formative feedback. More importantly, aggregate data from a population of participants may have an even higher impact if used to identify skill or knowledge gaps to be addressed by training programs and inform continuing education improvements across the profession.

Cardiac Arrest in the Operating Room: Part 2-Special Situations in the Perioperative Period.

As noted in part 1 of this series, periprocedural cardiac arrest (PPCA) can differ greatly in etiology and treatment from what is described by the American Heart Association advanced cardiac life support algorithms, which were largely developed for use in out-of-hospital cardiac arrest and in-hospital cardiac arrest outside of the perioperative space. Specifically, there are several life-threatening causes of PPCA of which the management should be within the skill set of all anesthesiologists. However, previous research has demonstrated that continued review and training in the management of these scenarios is greatly needed and is also associated with improved delivery of care and outcomes during PPCA. There is a growing body of literature describing the incidence, causes, treatment, and outcomes of common causes of PPCA (eg, malignant hyperthermia, massive trauma, and local anesthetic systemic toxicity) and the need for a better awareness of these topics within the anesthesiology community at large. As noted in part 1 of this series, these events are always witnessed by a member of the perioperative team, frequently anticipated, and involve rescuer-providers with knowledge of the patient and the procedure they are undergoing or have had. Formulation of an appropriate differential diagnosis and rapid application of targeted interventions are critical for good patient outcome. Resuscitation algorithms that include the evaluation and management of common causes leading to cardiac in the perioperative setting are presented. Practicing anesthesiologists need a working knowledge of these algorithms to maximize good outcomes.

Cardiac Arrest in the Operating Room: Resuscitation and Management for the Anesthesiologist: Part 1.

Cardiac arrest in the operating room and procedural areas has a different spectrum of causes (ie, hypovolemia, gas embolism, and hyperkalemia), and rapid and appropriate evaluation and management of these causes require modification of traditional cardiac arrest algorithms. There is a small but growing body of literature describing the incidence, causes, treatments, and outcomes of circulatory crisis and perioperative cardiac arrest. These events are almost always witnessed, frequently known, and involve rescuer providers with knowledge of the patient and their procedure. In this setting, there can be formulation of a differential diagnosis and a directed intervention that treats the likely underlying cause(s) of the crisis while concurrently managing the crisis itself. Management of cardiac arrest of the perioperative patient is predicated on expert opinion, physiologic rationale, and an understanding of the context in which these events occur. Resuscitation algorithms should consider the evaluation and management of these causes of crisis in the perioperative setting.

Simulation-based Assessment of the Management of Critical Events by Board-certified Anesthesiologists.

BACKGROUND: We sought to determine whether mannequin-based simulation can reliably characterize how board-certified anesthesiologists manage simulated medical emergencies. Our primary focus was to identify gaps in performance and to establish psychometric properties of the assessment methods. METHODS: A total of 263 consenting board-certified anesthesiologists participating in existing simulation-based maintenance of certification courses at one of eight simulation centers were video recorded performing simulated emergency scenarios. Each participated in two 20-min, standardized, high-fidelity simulated medical crisis scenarios, once each as primary anesthesiologist and first responder. Via a Delphi technique, an independent panel of expert anesthesiologists identified critical performance elements for each scenario. Trained, blinded anesthesiologists rated video recordings using standardized rating tools. Measures included the percentage of critical performance elements observed and holistic (one to nine ordinal scale) ratings of participant's technical and nontechnical performance. Raters also judged whether the performance was at a level expected of a board-certified anesthesiologist. RESULTS: Rater reliability for most measures was good. In 284 simulated emergencies, participants were rated as successfully completing 81% (interquartile range, 75 to 90%) of the critical performance elements. The median rating of both technical and nontechnical holistic performance was five, distributed across the nine-point scale. Approximately one-quarter of participants received low holistic ratings (i.e., three or less). Higher-rated performances were associated with younger age but not with previous simulation experience or other individual characteristics. Calling for help was associated with better individual and team performance. CONCLUSIONS: Standardized simulation-based assessment identified performance gaps informing opportunities for improvement. If a substantial proportion of experienced anesthesiologists struggle with managing medical emergencies, continuing medical education activities should be reevaluated.

A simulation-based curriculum to introduce key teamwork principles to entering medical students.

BACKGROUND: Failures of teamwork and interpersonal communication have been cited as a major patient safety issue. Although healthcare is increasingly being provided in interdisciplinary teams, medical school curricula have traditionally not explicitly included the specific knowledge, skills, attitudes, and behaviors required to function effectively as part of such teams. METHODS: As part of a new "Foundations" core course for beginning medical students that provided a two-week introduction to the most important themes in modern healthcare, a multidisciplinary team, in collaboration with the Center for Experiential Learning and Assessment, was asked to create an experiential introduction to teamwork and interpersonal communication. We designed and implemented a novel, all-day course to teach second-week medical students basic teamwork and interpersonal principles and skills using immersive simulation methods. Students' anonymous comprehensive course evaluations were collected at the end of the day. Through four years of iterative refinement based on students' course evaluations, faculty reflection, and debriefing, the course changed and matured. RESULTS: Four hundred twenty evaluations were collected. Course evaluations were positive with almost all questions having means and medians greater than 5 out of 7 across all 4 years. Sequential year comparisons were of greatest interest for examining the effects of year-to-year curricular improvements. Differences were not detected among any of the course evaluation questions between 2007 and 2008 except that more students in 2008 felt that the course further developed their "Decision Making Abilities" (OR 1.69, 95% CI 1.07-2.67). With extensive changes to the syllabus and debriefer selection/assignment, concomitant improvements were observed in these aspects between 2008 and 2009 (OR = 2.11, 95% CI: 1.28-3.50). Substantive improvements in specific exercises also yielded significant improvements in the evaluations of those exercises. CONCLUSIONS: This curriculum could be valuable to other medical schools seeking to inculcate teamwork foundations in their medical school's preclinical curricula. Moreover, this curriculum can be used to facilitate teamwork principles important to inter-disciplinary, as well as uni-disciplinary, collaboration.

A Multimodal Intervention Improves Postanesthesia Care Unit Handovers.

BACKGROUND: Failures of communication are a major contributor to perioperative adverse events. Transitions of care may be particularly vulnerable. We sought to improve postoperative handovers. METHODS: We introduced a multimodal intervention in an adult and a pediatric postanesthesia care unit (PACU) to improve postoperative handovers between anesthesia providers (APs) and PACU registered nurses (RNs). The intervention included a standardized electronic handover report form, a didactic webinar, mandatory simulation training focused on improving interprofessional communication, and post-training performance feedback. Trained, blinded nurse observers scored PACU handovers during 17 months using a structured tool consisting of 8 subscales and a global score (1-5 scale). Multivariate logistic regression assessed the effect of the intervention on the proportion of observed handovers receiving a global effectiveness rating of ≥3. RESULTS: Four hundred fifty-two clinicians received the simulation-based training, and 981 handovers were observed and rated. In the adult PACU, the estimated percentages of acceptable handovers (global ratings ≥3) among AP-RN pairs, where neither received simulation-based training (untrained dyads), was 3% (95% confidence interval, 1%-11%) at day 0, 10% (5%-19%) at training initiation (day 40), and 57% (33%-78%) at 1-year post-training initiation (day 405). For AP-RN pairs where at least one received the simulation-based training (trained dyads), these percentages were estimated to be 18% (11%-28%) and 68% (57%-76%) on days 40 and 405, respectively. The percentage of acceptable handovers was significantly greater on day 405 than it was on day 40 for both untrained (P < 0.001) and trained dyads (P < 0.001). Similar patterns were observed in the pediatric PACU. Three years later, the unadjusted estimate of the probability of an acceptable handover was 87% (72%-95%) in the adult PACU and 56% (40%-72%) in the pediatric PACU. CONCLUSIONS: A multimodal intervention substantially improved interprofessional PACU handovers, including those by clinicians who had not undergone formal simulation training. An effect appeared to be present >3 years later.

Systems of Care Delivery and Optimization in the Postoperative Care Wards.

A third of all patients are at risk for a serious adverse event, including death, in the first month after undergoing a major surgery. Most of these events will occur within 24 hours of the operation but are unlikely to occur in the operating room or postanesthesia care unit. Most opioid-induced respiratory depression events in the postoperative period resulted in death (55%) or anoxic brain injury (22%). A future state of mature artificial intelligence and machine learning will improve situational awareness of acute clinical deterioration, minimize alert fatigue, and facilitate early intervention to minimize poor outcomes.

Decision-Making During High-Risk Events: A Systematic Literature Review.

Effective decision-making in crisis events is challenging due to time pressure, uncertainty, and dynamic decisional environments. We conducted a systematic literature review in PubMed and PsycINFO, identifying 32 empiric research papers that examine how trained professionals make naturalistic decisions under pressure. We used structured qualitative analysis methods to extract key themes. The studies explored different aspects of decision-making across multiple domains. The majority (19) focused on healthcare; military, fire and rescue, oil installation, and aviation domains were also represented. We found appreciable variability in research focus, methodology, and decision-making descriptions. We identified five main themes: (1) decision-making strategy, (2) time pressure, (3) stress, (4) uncertainty, and (5) errors. Recognition-primed decision-making (RPD) strategies were reported in all studies that analyzed this aspect. Analytical strategies were also prominent, appearing more frequently in contexts with less time pressure and explicit training to generate multiple explanations. Practitioner experience, time pressure, stress, and uncertainty were major influencing factors. Professionals must adapt to the time available, types of uncertainty, and individual skills when making decisions in high-risk situations. Improved understanding of these decisional factors can inform evidence-based enhancements to training, technology, and process design.

Anesthesia for liver transplantation in US academic centers: institutional structure and perioperative care.

Investigators at a single institution have shown that the organization of the anesthesia team influences patient outcomes after liver transplant surgery. Little is known about how liver transplant anesthesiologists are organized to deliver care throughout the United States. Therefore, we collected quantitative survey data from adult liver transplant programs in good standing with national governing agencies so that we could describe team structure and duties. Information was collected from 2 surveys in a series of quantitative surveys conducted by the Liver Transplant Anesthesia Consortium. All data related to duties, criteria for team membership, interactions/communication with the multidisciplinary team, and service availability were collected and summarized. Thirty-four of 119 registered transplant centers were excluded (21 pediatric centers and 13 centers not certified by national governing agencies). Private practice sites (26) were later excluded because of a poor response rate. There were minimal changes in the compositions of the programs between the 2 surveys. All academic programs had distinct liver transplant anesthesia teams. Most had set criteria for membership and protocols outlining the preoperative evaluation, attended selection committees, and were always available for transplant surgery. Fewer were involved in postoperative care or were available for patients needing subsequent surgery. Most trends were associated with the center volume. In conclusion, some of the variance in team structure and responsibilities is probably related to resources available at the site of practice. However, similarities in specific duties across all teams suggest some degree of self-initiated specialization.

The complex interplay between delirium, sedation, and early mobility during critical illness: applications in the trauma unit.

PURPOSE OF REVIEW: Critically ill patients are prescribed sedatives and analgesics to decrease pain and anxiety, improve patient-ventilator dyssynchrony and ensure patient safety. These medications may themselves lead to delirium and ICU-acquired weakness, which are associated with worse clinical outcomes. This review will focus on the epidemiology of these two disease processes and discuss strategies aimed at reducing these devastating complications of critical illness. RECENT FINDINGS: Delirium and ICU-acquired weakness are associated with longer hospital stay, increased cost and decreased quality of life after discharge from the ICU. Delirium has also shown to be associated with increased mortality. Strategies aimed at reducing sedative exposure through protocols and coordination of daily sedation and ventilator cessation trials, avoiding benzodiazepines in favor of alternative sedative regimens and early mobilization of patients have all shown to significantly improve patient outcomes. SUMMARY: Delirium and ICU-acquired weakness are complications of critical illness associated with worse clinical outcomes and functional decline in survivors. An evidence-based approach based on the following tenets - minimization of sedative medication, particularly benzodiazepines, delirium monitoring and management and early mobilization may mitigate these complications.

The Preparing Residents for International Medical Experiences (PRIME) Simulation Workshop: Equipping Surgery and Anesthesia Trainees for International Rotations.

Introduction: Although global health training expands clinical and sociocultural expertise for graduate medical trainees and is increasingly in demand, evidence-based courses are limited. To improve self-assessed competence for clinical scenarios encountered during international rotations, we developed and assessed a simulation-based workshop called Preparing Residents for International Medical Experiences. Methods: High-fidelity simulation activities for anesthesiology, surgery, and OB/GYN trainees involved three scenarios. The first was a mass casualty in a low-resource setting requiring distribution of human and material resources. In the second, learners managed a septic operative patient and coordinated postoperative care without an ICU bed available. The final scenario had learners evaluate a non-English-speaking patient with pre-eclampsia. We paired simulation with small-group discussion to address sociobehavioral factors, stress, and teaching skills. Participants evaluated the quality of the teaching provided. In addition, we measured anesthesiology trainees' self-assessed competence before and after the workshop. Results: The workshop included 23 learners over two iterations. Fifteen trainees (65%) completed the course evaluation, 93% of whom strongly agreed that the training met the stated objectives. Thirteen out of 15 (87%) anesthesiology trainees completed the competence survey. After the training, more trainees indicated confidence in providing clinical care with indirect supervision or independently. Mean self-assessed competency scores on a scale of 1-5 increased for all areas, with a mean competency increase of 0.3 (95% CI, 0.2-0.5). Discussion: Including simulation in a pretravel workshop can improve trainees' self-assessed competence for a variety of scenarios involving clinical care in limited-resource settings.

Liberation and animation for ventilated ICU patients: the ABCDE bundle for the back-end of critical care.

Critically ill patients are frequently prescribed sedatives and analgesics to ensure patient safety, to relieve pain and anxiety, to reduce stress and oxygen consumption, and to prevent patient ventilator dysynchrony. Recent studies have revealed that these medications themselves contribute to worsening clinical outcomes. An evidence-based organizational approach referred to as the ABCDE bundle (Awakening and Breathing Coordination of daily sedation and ventilator removal trials; Choice of sedative or analgesic exposure; Delirium monitoring and management; and Early mobility and Exercise) is presented in this commentary.

Intraoperative risk factors for acute respiratory distress syndrome in critically ill patients.

BACKGROUND: Risk factors for the development of acute respiratory distress syndrome (ARDS) in the intensive care unit (ICU) include positive fluid balance, high tidal volumes (TVs), high airway pressures, and transfusion of blood products. However, research examining intraoperative factors such as fluid resuscitation, mechanical ventilation strategies, and blood administration on the postoperative development of ARDS is lacking. METHODS: We assessed patients admitted to the ICU with postoperative hypoxemic respiratory failure requiring mechanical ventilation for the development of ARDS in the first 7 postoperative days using established clinical and radiological criteria. Data on risk factors for ARDS were obtained from the electronic anesthetic and medical records. Logistic regression was used to examine the independent association between fluid resuscitation, TV per ideal body weight, and number of blood products transfused during surgery and the postoperative development of ARDS, adjusting for important clinical covariates. RESULTS: Of the 89 patients with postoperative respiratory failure, 25 developed ARDS. Compared with those who received <10 mL/kg/h fluid resuscitation in the operating room, patients receiving >20 mL/kg/h fluid resuscitation had a 3.8 times higher adjusted odds of developing ARDS (P = 0.04), and those receiving 10 to 20 mL/kg/h had a 2.4 times higher adjusted odds of developing ARDS (P = 0.14). TV per ideal body weight and the number of blood units transfused were not associated with ARDS development in this study. CONCLUSIONS: This cohort study provides evidence to suggest a relationship between intraoperative fluid resuscitation and the development of ARDS. Larger prospective trials are required to confirm these findings.

Use of a Portable Functional Near-Infrared Spectroscopy (fNIRS) System to Examine Team Experience During Crisis Event Management in Clinical Simulations.

Objective: The aim of this study was to investigate the utilization of a portable functional near-infrared spectroscopy (fNIRS) system, the fNIRS PioneerTM, to examine team experience in high-fidelity simulation-based crisis event management (CEM) training for anesthesiologists in operating rooms. Background: Effective evaluation of team performance and experience in CEM simulations is essential for healthcare training and research. Neurophysiological measures with wearable devices can provide useful indicators of team experience to compliment traditional self-report, observer ratings, and behavioral performance measures. fNIRS measured brain blood oxygenation levels and neural synchrony can be used as indicators of workload and team engagement, which is vital for optimal team performance. Methods: Thirty-three anesthesiologists, who were attending CEM training in two-person teams, participated in this study. The participants varied in their expertise level and the simulation scenarios varied in difficulty level. The oxygenated and de-oxygenated hemoglobin (HbO and HbR) levels in the participants' prefrontal cortex were derived from data recorded by a portable one-channel fNIRS system worn by all participants throughout CEM training. Team neural synchrony was measured by HbO/HbR wavelet transformation coherence (WTC). Observer-rated workload and self-reported workload and mood were also collected. Results: At the individual level, the pattern of HbR level corresponded to changes of workload for the individuals in different roles during different phases of a scenario; but this was not the case for HbO level. Thus, HbR level may be a better indicator for individual workload in the studied setting. However, HbR level was insensitive to differences in scenario difficulty and did not correlate with observer-rated or self-reported workload. At the team level, high levels of HbO and HbR WTC were observed during active teamwork. Furthermore, HbO WTC was sensitive to levels of scenario difficulty. Conclusion: This study showed that it was feasible to use a portable fNIRS system to study workload and team engagement in high-fidelity clinical simulations. However, more work is needed to establish the sensitivity, reliability, and validity of fNIRS measures as indicators of team experience.