Defining entrustable professional activities for first year anesthesiology residents: A Delphi study.

INTRODUCTION: The use of entrustable professional activities (EPAs) as a basis for assessment may bridge the gap between the theory of competency-based education and clinical practice. The purpose of this study was to develop and validate EPAs for United States (US) first-year clinical anesthesia (CA-1) residents for anesthesiology residency programs to use as the basis for curriculum development and workplace assessment. METHODS: From a list of EPAs abstracted from the literature, an expert panel through a modified Delphi consensus process established EPAs for the CA1 curriculum. RESULTS: The final list of EPAs after group consensus had 28 EPAs, with 14 (50%) considered to be applicable to the CA-1 year. An 80% consensus rate was used to accept or reject the final list. CONCLUSION: This study applied a construct validity lens to EPA development providing assurance that the EPAs adopted are appropriate for use in workplace-based assessment and entrustment decision-making.

Multidisciplinary simulation of local anaesthetic systemic toxicity improves diagnostic and treatment skills and self-confidence for pain clinic procedural staff.

Local anaesthetic systemic toxicity (LAST) is a rare complication after outpatient interventional pain procedures, which can present as an emergent and life-threatening condition. Proficiency and confidence in managing this rare situation necessitates strategies to ensure team members can perform necessary tasks. The primary objective was to familiarse the pain clinic procedural staff-physicians, nurses, medical assistants, and radiation technologists-with concise and current instruction and an opportunity to practice in a controlled environment. A two-part series was designed and led by the pain physicians, with the assistance of the simulation centre and clinic staff. A 20 min didactic session was held to familiarise the providers with relevant details and information regarding LAST. Then, 2 weeks later, all team members participated in a simulation exercise intended to portray a LAST encounter, tasking participants to recognise and manage the condition in a team-based model. Before and after the didactic and simulation sessions, the staff was administered a questionnaire to assess knowledge of LAST signs, symptoms, management strategies, and priorities. Respondents were better able to identify signs and symptoms of toxicity and prioritise management steps, and felt more confident in recognising symptoms, starting treatment and coordinating care. Furthermore, participants emphasised the positive of debriefing, practicing a rare situation and learning strategies for effective communication, team dynamics and role clarity. FORMAT: Small group didactic session, simulation exercise in a clinical simulation lab. TARGET AUDIENCE: Attending, fellow, and resident physicians, medical students, registered nurses, certified medical assistants, and radiation technologists working in a pain clinic procedure suite. OBJECTIVES: To acquaint the pain clinic procedural staff with current training related to LAST and an opportunity to practice in a controlled environment.

A modern roadmap for the use of simulation in regional anesthesiology training.

PURPOSE OF REVIEW: A variety of educational modalities are used to teach regional anesthesia. Simulation is an educational tool that facilitates hands-on learning in a well tolerated, reproducible environment, eliminating potential harm to patients during the process of learning. Available literature and expert consensus statements support customizing simulation programs according to the level of training and experience of the learners. RECENT FINDINGS: Simulation is useful for learners of all levels of expertise, though the application and frequency of simulation must be adapted to meet the learners' objectives. SUMMARY: This review presents recommendations for the use of simulation for residents, fellows, practicing anesthesiologists without formal training in regional anesthesia, and practicing anesthesiologists with regional anesthesia expertise. Passports and portfolio programs that include simulation can be used to verify training. Virtual applications of simulation are growing, expanding the scope of regional anesthesia simulation and increasing access to lower resource areas.

Developing a Real-Time Electroencephalogram-Guided Anesthesia-Management Curriculum for Educating Residents: A Single-Center Randomized Controlled Trial.

BACKGROUND: Different anesthetic drugs and patient factors yield unique electroencephalogram (EEG) patterns. Yet, it is unclear how best to teach trainees to interpret EEG time series data and the corresponding spectral information for intraoperative anesthetic titration, or what effect this might have on outcomes. METHODS: We developed an electronic learning curriculum (ELC) that covered EEG spectrogram interpretation and its use in anesthetic titration. Anesthesiology residents at a single academic center were randomized to receive this ELC and given spectrogram monitors for intraoperative use versus standard residency curriculum alone without intraoperative spectrogram monitors. We hypothesized that this intervention would result in lower inhaled anesthetic administration (measured by age-adjusted total minimal alveolar concentration [MAC] fraction and age-adjusted minimal alveolar concentration [aaMAC]) to patients ≥60 old during the postintervention period (the primary study outcome). To study this effect and to determine whether the 2 groups were administering similar anesthetic doses pre- versus postintervention, we compared aaMAC between control versus intervention group residents both before and after the intervention. To measure efficacy in the postintervention period, we included only those cases in the intervention group when the monitor was actually used. Multivariable linear mixed-effects modeling was performed for aaMAC fraction and hospital length of stay (LOS; a non-prespecified secondary outcome), with a random effect for individual resident. A multivariable linear mixed-effects model was also used in a sensitivity analysis to determine if there was a group (intervention versus control group) by time period (post- versus preintervention) interaction for aaMAC. Resident EEG knowledge difference (a prespecified secondary outcome) was compared with a 2-sided 2-group paired t test. RESULTS: Postintervention, there was no significant aaMAC difference in patients cared for by the ELC group (n = 159 patients) versus control group (N = 325 patients; aaMAC difference = -0.03; 95% confidence interval [CI], -0.09 to 0.03; P =.32). In a multivariable mixed model, the interaction of time period (post- versus preintervention) and group (intervention versus control) led to a nonsignificant reduction of -0.05 aaMAC (95% CI, -0.11 to 0.01; P = .102). ELC group residents (N = 19) showed a greater increase in EEG knowledge test scores than control residents (N = 20) from before to after the ELC intervention (6-point increase; 95% CI, 3.50-8.88; P < .001). Patients cared for by the ELC group versus control group had a reduced hospital LOS (median, 2.48 vs 3.86 days, respectively; P = .024). CONCLUSIONS: Although there was no effect on mean aaMAC, these results demonstrate that this EEG-ELC intervention increased resident knowledge and raise the possibility that it may reduce hospital LOS.

Milestone Learning Trajectories of Residents at Five Anesthesiology Residency Programs.

Construct: Every six months, residency programs report their trainees' Milestones Level achievement to the Accreditation Council for Graduate Medical Education (ACGME). Milestones should enable the learner and training program to know an individual's competency development trajectory. Background: Milestone Level ratings for residents grouped by specialty (e.g., Internal Medicine and Emergency Medicine) show that, in aggregate, senior residents receive higher ratings than junior residents. Anesthesiology Milestones, as assessed by both residents and faculty, also have a positive linear relationship with postgraduate year. However, these studies have been cross-sectional rather than longitudinal cohort studies, and studies of how individual residents progress during the course of training are needed. Longitudinal data analysis of performance assessment trajectories addresses a relevant validity question for the Next Accreditation System. We explored the application of learning analytics to longitudinal Milestones data to: 1) measure the frequency of "straight-lining"; 2) assess the proportion of residents that reach "Level 4" (ready for unsupervised practice) by graduation for each subcompetency; 3) identify variability among programs and individual residents in their baseline Milestone Level and rates of improvement; and 4) determine how hypothetically constructed growth curve models fit to the Milestones data reported to ACGME. Approach: De-identified Milestone Level ratings in each of the 25 subcompetencies submitted semiannually to the ACGME from July 1, 2014 to June 30, 2017 were retrospectively analyzed for graduating residents (n = 67) from a convenience sample of five anesthesia residency programs. The data reflected longitudinal resident Milestone progression from the beginning of the first year to the end of the third and final year of clinical anesthesiology training. The frequency of straight-lining, defined as the resident receiving the same exact Milestone Level rating for all 25 subcompetencies on a given 6-month report, was calculated for each program. Every resident was evaluated six times during training with the possibility of six straight-lined ratings. Findings: The number of residents in each program ranged from 5-21 (Median 13, range 16). Mean Milestone Level ratings for subcompetencies were significantly different at each six-month assessment (p < 0.001). Frequency of straight-lining varied significantly by program from 9% - 57% (Median 22%). Depending on the program, 53%-100% (median 86%) of residents reached the graduation target Level 4 or higher in all 25 anesthesiology subcompetencies. Nine to 18% of residents did not achieve a Level 4 rating for at least one subcompetency at any time during their residency. Across programs, significant variability was found in first-year clinical anesthesia training Milestone Levels, as well in the rate of improvement for five of the six core competencies. Conclusions: Anesthesia residents' Milestone Level growth trajectories as reported to the ACGME vary significantly across individual residents as well as by program. The present study offers a case example that raises concerns regarding the validity of the Next Accreditation System as it is currently used by some residency programs.

A Pilot Project Using Eye-Tracking Technology to Design a Standardised Anaesthesia Workspace.

OBJECTIVE: Maximising safe handoff procedures ensures patient safety. Anaesthesiology practices have primarily focused on developing better communication tools. However, these tools tend to ignore the physical layout of the anaesthesia workspace itself. Standardising the anaesthesia workspace has the potential to improve patient safety. The design process should incorporate end user feedback and objective data. METHODS: This pilot project aims to design a standardised anaesthesia workspace using eye-tracking technology at a single university-affiliated Veterans Affairs hospital. Twelve practising anaesthesiologists observed a series of images representing five clinical scenarios. Each of these had a question prompting them to look for certain items commonly found in the anaesthesia workspace. Using eye-tracking technology, the gaze data of participants were recorded. These data were used to generate heat maps of the specific areas of interest in the workspace that received the most fixation counts. RESULTS: The laryngoscope and propofol had the highest percentages of gaze fixations on the left-hand side of the workstation, in closest proximity to the anaesthesiologist. Atropine, although the highest percentage of gaze fixations (33%) placed it on the right-hand side of the workstation, also had 25% of gaze fixations centred over the anaesthesia cart. CONCLUSION: Gaze fixation analyses showed that anaesthesiologists identified locations for the laryngoscope and propofol within easy reach and emergency medications further away. Because eye tracking can provide objective data to influence the design process, it may be useful when developing standardised anaesthesia workspace templates for individual practices.

Using eye tracking technology to compare the effectiveness of malignant hyperthermia cognitive aid design.

BACKGROUND: Malignant hyperthermia is a rare but potentially fatal complication of anesthesia, and several different cognitive aids designed to facilitate a timely and accurate response to this crisis currently exist. Eye tracking technology can measure voluntary and involuntary eye movements, gaze fixation within an area of interest, and speed of visual response and has been used to a limited extent in anesthesiology. METHODS: With eye tracking technology, we compared the accessibility of five malignant hyperthermia cognitive aids by collecting gaze data from twelve volunteer participants. Recordings were reviewed and annotated to measure the time required for participants to locate objects on the cognitive aid to provide an answer; cumulative time to answer was the primary outcome. RESULTS: For the primary outcome, there were differences detected between cumulative time to answer survival curves (P < 0.001). Participants demonstrated the shortest cumulative time to answer when viewing the Society for Pediatric Anesthesia (SPA) cognitive aid compared to four other publicly available cognitive aids for malignant hyperthermia, and this outcome was not influenced by the anesthesiologists' years of experience. CONCLUSIONS: This is the first study to utilize eye tracking technology in a comparative evaluation of cognitive aid design, and our experience suggests that there may be additional applications of eye tracking technology in healthcare and medical education. Potentially advantageous design features of the SPA cognitive aid include a single page, linear layout, and simple typescript with minimal use of single color blocking.

Preliminary Experience Using Eye-Tracking Technology to Differentiate Novice and Expert Image Interpretation for Ultrasound-Guided Regional Anesthesia.

OBJECTIVES: Objective measures are needed to guide the novice's pathway to expertise. Within and outside medicine, eye tracking has been used for both training and assessment. We designed this study to test the hypothesis that eye tracking may differentiate novices from experts in static image interpretation for ultrasound (US)-guided regional anesthesia. METHODS: We recruited novice anesthesiology residents and regional anesthesiology experts. Participants wore eye-tracking glasses, were shown 5 sonograms of US-guided regional anesthesia, and were asked a series of anatomy-based questions related to each image while their eye movements were recorded. The answer to each question was a location on the sonogram, defined as the area of interest (AOI). The primary outcome was the total gaze time in the AOI (seconds). Secondary outcomes were the total gaze time outside the AOI (seconds), total time to answer (seconds), and time to first fixation on the AOI (seconds). RESULTS: Five novices and 5 experts completed the study. Although the gaze time (mean ± SD) in the AOI was not different between groups (7 ± 4 seconds for novices and 7 ± 3 seconds for experts; P = .150), the gaze time outside the AOI was greater for novices (75 ± 18 versus 44 ± 4 seconds for experts; P = .005). The total time to answer and total time to first fixation in the AOI were both shorter for experts. CONCLUSIONS: Experts in US-guided regional anesthesia take less time to identify sonoanatomy and spend less unfocused time away from a target compared to novices. Eye tracking is a potentially useful tool to differentiate novices from experts in the domain of US image interpretation.

Upgrading a Social Media Strategy to Increase Twitter Engagement During the Spring Annual Meeting of the American Society of Regional Anesthesia and Pain Medicine.

Microblogs known as "tweets" are a rapid, effective method of information dissemination in health care. Although several medical specialties have described their Twitter conference experiences, Twitter-related data in the fields of anesthesiology and pain medicine are sparse. We therefore analyzed the Twitter content of 2 consecutive spring meetings of the American Society of Regional Anesthesia and Pain Medicine using publicly available online transcripts. We also examined the potential contribution of a targeted social media campaign on Twitter engagement during the conferences. The original Twitter meeting content was largely scientific in nature and created by meeting attendees, the majority of whom were nontrainee physicians. Physician trainees, however, represent an important and increasing minority of Twitter contributors. Physicians not in attendance predominantly contributed via retweeting original content, particularly picture-containing tweets, and thus increased reach to nonattendees. A social media campaign prior to meetings may help increase the reach of conference-related Twitter discussion.

Sepsis in the Operating Room: A Simulation Case for Perioperative Providers.

INTRODUCTION: Sepsis should be included in the differential of any patient with unexplained organ dysfunction, whether or not an obvious infection is initially detected. Perioperative providers frequently care for patients with sepsis. This simulation case challenges participants to recognize and manage a presentation of postoperative sepsis, providing an opportunity to discuss the rationale behind sepsis management during debriefing. METHODS: Assuming the role of an anesthesia provider, the participant takes over the care of a 62-year-old female who has just undergone cystoscopy and is extubated in the operating room (OR). The participant receives a brief handoff from the outgoing anesthesiologist while the patient awaits a postanesthesia care unit slot. The case has been uneventful, aside from intermittent hypotension responsive to IV fluids and boluses of phenylephrine. Within minutes of the handoff, the patient becomes somnolent and hypotensive. Efforts to treat hypotension eventually precipitate hypoxemia. Trainees must recognize and manage this cardiopulmonary decompensation. The scenario benefits from an OR simulation environment containing an anesthetic ventilator, anesthesia drugs and equipment, and a mannequin on an OR table. RESULTS: Twelve residents completed the simulation scenario. Formal feedback was collected via email questionnaire from faculty instructors within 30 days of teaching each session. DISCUSSION: Sepsis presents a diagnostic dilemma in part because no single diagnostic test rules the syndrome in or out. Multiple operational definitions of sepsis in the academic literature add to the confusion for clinicians. Our case simulation challenges perioperative providers to make a timely diagnosis and initiate appropriate treatment of sepsis.

Comparative-Effectiveness of Simulation-Based Deliberate Practice Versus Self-Guided Practice on Resident Anesthesiologists' Acquisition of Ultrasound-Guided Regional Anesthesia Skills.

BACKGROUND AND OBJECTIVES: Simulation-based education strategies to teach regional anesthesia have been described, but their efficacy largely has been assumed. We designed this study to determine whether residents trained using the simulation-based strategy of deliberate practice show greater improvement of ultrasound-guided regional anesthesia (UGRA) skills than residents trained using self-guided practice in simulation. METHODS: Anesthesiology residents new to UGRA were randomized to participate in either simulation-based deliberate practice (intervention) or self-guided practice (control). Participants were recorded and assessed while performing simulated peripheral nerve blocks at baseline, immediately after the experimental condition, and 3 months after enrollment. Subject performance was scored from video by 2 blinded reviewers using a composite tool. The amount of time each participant spent in deliberate or self-guided practice was recorded. RESULTS: Twenty-eight participants completed the study. Both groups showed within-group improvement from baseline scores immediately after the curriculum and 3 months following study enrollment. There was no difference between groups in changed composite scores immediately after the curriculum (P = 0.461) and 3 months following study enrollment (P = 0.927) from baseline. The average time in minutes that subjects spent in simulation practice was 6.8 minutes for the control group compared with 48.5 minutes for the intervention group (P < 0.001). CONCLUSIONS: In this comparative effectiveness study, there was no difference in acquisition and retention of skills in UGRA for novice residents taught by either simulation-based deliberate practice or self-guided practice. Both methods increased skill from baseline; however, self-guided practice required less time and faculty resources.