Competencies for proficiency in basic point-of-care ultrasound in anesthesiology: national expert recommendations using Delphi methodology.

PURPOSE: Point-of-care ultrasound (POCUS) allows for rapid bedside assessment and guidance of patient care. Recently, POCUS was included as a mandatory component of Canadian anesthesiology training; however, there is no national consensus regarding the competencies to guide curriculum development. We therefore aimed to define national residency competencies for basic perioperative POCUS proficiency. METHODS: We adopted a Delphi process to delineate relevant POCUS competencies whereby we circulated an online survey to academic anesthesiologists identified as POCUS leads/experts (n = 25) at all 17 Canadian anesthesiology residency programs. After reviewing a list of competencies derived from the Royal College of Physicians and Surgeons of Canada's National Curriculum, we asked participants to accept, refine, delete, or add competencies. Three rounds were completed between 2022 and 2023. We discarded items with < 50% agreement, revised those with 50-79% agreement based upon feedback provided, and maintained unrevised those items with ≥ 80% agreement. RESULTS: We initially identified and circulated (Round 1) 74 competencies across 19 clinical domains (e.g., basics of ultrasound [equipment, nomenclature, clinical governance, physics]; cardiac [left ventricle, right ventricle, valve assessment, pericardial effusion, intravascular volume status] and lung ultrasound anatomy, image acquisition, and image interpretation; and clinical applications [monitoring and serial assessments, persistent hypotension, respiratory distress, cardiac arrest]). After three Delphi rounds (and 100% response rate maintained), panellists ultimately agreed upon 75 competencies. CONCLUSION: Through national expert consensus, this study identified POCUS competencies suitable for curriculum development and assessment in perioperative anesthesiology. Next steps include designing and piloting a POCUS curriculum and assessment tool(s) based upon these nationally defined competencies.

RéSUMé: OBJECTIF: L'échographie ciblée (POCUS) permet une évaluation rapide au chevet des patient·es et l'orientation des soins aux patient·es. Récemment, l'échographie ciblée a été incluse en tant que composante obligatoire de la formation en anesthésiologie au Canada; cependant, il n'y a pas de consensus national sur les compétences qui guideront l'élaboration des programmes d'études. Nous avons donc cherché à définir les compétences à inclure dans les programmes de résidence nationaux pour acquérir des compétences de base en échographie ciblée périopératoire. MéTHODE: Nous avons adopté un processus Delphi pour délimiter les compétences pertinentes en échographie ciblée, processus dans le cadre duquel nous avons fait circuler un sondage en ligne auprès d'anesthésiologistes universitaires identifié·es comme des responsables/expert·es en échographie ciblée (n = 25) dans les 17 programmes canadiens de résidence en anesthésiologie. Après avoir examiné une liste de compétences tirées du programme d'études national du Collège royal des médecins et chirurgiens du Canada, nous avons demandé aux participant·es d'accepter, de peaufiner, de supprimer ou d'ajouter des compétences. Trois rondes ont été complétées entre 2022 et 2023. Nous avons écarté les éléments ayant < 50 % d'accord, révisé ceux avec 50 à 79 % d'accord en fonction des commentaires fournis, et maintenu sans révision les éléments obtenant ≥ 80 % d'accord. RéSULTATS: Nous avons d'abord identifié et diffusé (ronde 1) 74 compétences dans 19 domaines cliniques (p. ex., les bases de l'échographie [équipement, nomenclature, gouvernance clinique, physique]; anatomie échographique cardiaque [ventricule gauche, ventricule droit, évaluation valvulaire, épanchement péricardique, état du volume intravasculaire] et pulmonaire [acquisition et interprétation d'images]; et applications cliniques [surveillance et évaluations en série, hypotension persistante, détresse respiratoire, arrêt cardiaque]). Après trois rondes Delphi (et un taux de réponse de 100 % maintenu), les panélistes se sont finalement mis·es d'accord sur 75 compétences. CONCLUSION: Grâce à un consensus d'expert·es au pays, cette étude a permis d'identifier les compétences en échographie ciblée adaptées à l'élaboration et à l'évaluation de programmes d'études en anesthésiologie périopératoire. Les prochaines étapes comprennent la conception et la mise à l'essai d'un programme d'études et d'outils d'évaluation en échographie ciblée basés sur ces compétences définies à l'échelle nationale.

Identifying intraoperative events in a simulated laparotomy video: a multinational study of inattentional blindness among anesthesiologists.

PURPOSE: Medical errors may be occasionally explained by inattentional blindness (IB), i.e., failing to notice an event/object that is in plain sight. We aimed to determine whether age/experience, restfulness/fatigue, and previous exposure to simulation education may affect IB in the anesthetic/surgical setting. METHODS: In this multicentre/multinational study, a convenience sample of 280 anesthesiologists watched an attention-demanding video of a simulated trauma patient undergoing laparotomy and (independently/anonymously) recorded the abnormalities they noticed. The video contained four expected/common abnormalities (hypotension, tachycardia, hypoxia, hypothermia) and two prominently displayed unexpected/rare events (patient's head movement, leaky central venous line). We analyzed the participants' ability to notice the expected/unexpected events (primary outcome) and the proportion of expected/unexpected events according to age group and prior exposure to simulation education (secondary outcomes). RESULTS: Anesthesiologists across all ages noticed fewer unexpected/rare events than expected/common ones. Overall, younger anesthesiologists missed fewer common events than older participants did (P = 0.02). There was no consistent association between age and perception of unexpected/rare events (P = 0.28), although the youngest cohort (< 30 yr) outperformed the other age groups. Prior simulation education did not affect the proportion of misses for the unexpected/rare events but was associated with fewer misses for the expected/common events. Self-perceived restfulness did not impact perception of events. CONCLUSION: Anesthesiologists noticed fewer unexpected/rare clinical events than expected/common ones in an attention-demanding video of a simulated trauma patient, in keeping with IB. Prior simulation training was associated with an improved ability to notice anticipated/expected events, but did not reduce IB. Our findings may have implications for understanding medical mishaps, and efforts to improve situational awareness, especially in acute perioperative and critical care settings.

RéSUMé: OBJECTIF: Les erreurs médicales peuvent parfois s'expliquer par la cécité d'inattention, soit le fait de ne pas remarquer un événement/objet qui est à la vue de tous et toutes. Notre objectif était de déterminer si l'âge/l'expérience, le repos/la fatigue et l'exposition antérieure à l'enseignement par simulation pouvaient affecter la cécité d'inattention dans le cadre de l'anesthésie/chirurgie. MéTHODE: Dans cette étude multicentrique/multinationale, un échantillon de convenance de 280 anesthésiologistes ont visionné une vidéo exigeant l'attention portant sur un patient de trauma simulé bénéficiant d'une laparotomie et ont enregistré (de manière indépendante/anonyme) les anomalies qu'ils et elles ont remarquées. La vidéo contenait quatre anomalies attendues/courantes (hypotension, tachycardie, hypoxie, hypothermie) et deux événements inattendus/rares bien en vue (mouvement de la tête du patient, fuite du cathéter veineux central). Nous avons analysé la capacité des participant·es à remarquer les événements attendus/inattendus (critère d'évaluation principal) et la proportion d'événements attendus/inattendus selon le groupe d'âge et l'exposition antérieure à l'enseignement par simulation (critères d'évaluation secondaires). RéSULTATS: Les anesthésiologistes de tous âges ont remarqué moins d'événements inattendus/rares que d'événements attendus/courants. Globalement, les anesthésiologistes plus jeunes ont manqué moins d'événements courants que leurs congénères plus âgé·es (P = 0,02). Il n'y avait pas d'association constante entre l'âge et la perception d'événements inattendus ou rares (P = 0,28), bien que la cohorte la plus jeune (< 30 ans) ait surpassé les autres groupes d'âge. La formation antérieure par simulation n'a pas eu d'incidence sur la proportion d'inobservation des événements inattendus ou rares, mais a été associée à moins de cécité d'inattention envers les événements attendus ou courants. Le repos perçu n'a pas eu d'impact sur la perception des événements. CONCLUSION: Les anesthésiologistes ont remarqué moins d'événements cliniques inattendus/rares que d'événements attendus/courants dans une vidéo exigeant l'attention portant sur la simulation d'un patient traumatisé, ce qui s'inscrit dans la cécité d'inattention. La formation préalable par simulation était associée à une meilleure capacité à remarquer les événements anticipés/attendus, mais ne réduisait pas la cécité d'inattention. Nos résultats peuvent avoir des implications pour la compréhension des accidents médicaux et les efforts visant à améliorer la conscience situationnelle, en particulier dans les contextes de soins périopératoires aigus et de soins intensifs.

Competency based medical education implementation at the institutional level: A cross-discipline comparative program evaluation.

INTRODUCTION: As an early adopter of competency-based medical education (CBME) our postgraduate institution was uniquely positioned to analyze implementation experience data across programs, while keeping institutional factors constant. We described participants' experiences related to CBME implementation across programs derived from early program evaluation efforts within our setting. METHODS: This evaluation focused on eight residency programs at a medium-sized academic institution in Canada. Participants (n = 175) included program leaders, faculty, and residents. The study consisted of 3 phases: (1) describing intended implementation; (2) documenting enacted implementation; and (3) comparing intended with enacted implementation to inform adaptations. Each program's findings were summarized in technical reports which were then analyzed thematically. Cross program data were organized by themes. RESULTS: Six themes were identified. All groups emphasized the need for ongoing refinement of CBME resulting from shared tensions such as increased assessment burden. However, there were some disparate CBME-related experiences between programs such as the experience with entrustable professional activities, the interpretation of retrospective entrustment anchors, and quality of feedback. CONCLUSION: We detected several cross-program successes and important challenges related to CBME. Our experience can inform other programs engaging in implementation and evaluation of CBME.

Exploring the use of rating scales with entrustment anchors in workplace-based assessment.

PURPOSE: Competency-based medical education (CBME) has prompted widespread implementation of workplace-based assessment (WBA) tools using entrustment anchors. This study aimed to identify factors that influence faculty's rating choices immediately following assessment and explore their experiences using WBAs with entrustment anchors, specifically the Ottawa Surgical Competency Operating Room Evaluation scale. METHOD: A convenience sample of 50 semi-structured interviews with Emergency Medicine (EM) physicians from a single Canadian hospital were conducted between July and August 2019. All interviews occurred within two hours of faculty completing a WBA of a trainee. Faculty were asked what they considered when rating the trainee's performance and whether they considered an alternate rating. Two team members independently analysed interview transcripts using conventional content analysis with line-by-line coding to identify themes. RESULTS: Interviews captured interactions between 70% (26/37) of full-time EM faculty and 86% (19/22) of EM trainees. Faculty most commonly identified the amount of guidance the trainee required as influencing their rating. Other variables such as clinical context, trainee experience, past experiences with the trainee, perceived competence and confidence were also identified. While most faculty did not struggle to assign ratings, some had difficulty interpreting the language of entrustment anchors, being unsure whether their assessment should be retrospective or prospective in nature, and if/how the assessment should change whether they were 'in the room' or not. CONCLUSIONS: By going to the frontline during WBA encounters, this study captured authentic and honest reflections from physicians immediately engaged in assessment using entrustment anchors. While many of the factors identified are consistent with previous retrospective work, we highlight how some faculty consider factors outside the prescribed approach and struggle with the language of entrustment anchors. These results further our understanding of 'in-the-moment' assessments using entrustment anchors and may facilitate effective faculty development regarding WBA in CBME.

The medical pause: Importance, processes and training.

Research has shown that taking 'timeouts' in medical practice improves performance and patient safety. However, the benefits of taking timeouts, or pausing, are not sufficiently acknowledged in workplaces and training programmes. To promote this acknowledgement, we suggest a systematic conceptualisation of the medical pause, focusing on its importance, processes and implementation in training programmes. By employing insights from educational and cognitive psychology, we first identified pausing as an important skill to interrupt negative momentum and bolster learning. Subsequently, we categorised constituent cognitive processes for pausing skills into two phases: the decision-making phase (determining when and how to take pauses) and the executive phase (applying relaxation or reflection during pauses). We present a model that describes how relaxation and reflection during pauses can optimise cognitive load in performance. Several strategies to implement pause training in medical curricula are proposed: intertwining pause training with training of primary skills, providing second-order scaffolding through shared control and employing auxiliary tools such as computer-based simulations with a pause function.

The Development of Visual Expertise in ECG Interpretation: An Eye-Tracking Augmented Re Situ Interview Approach.

Phenomenon: Visual expertise in medicine involves a complex interplay between expert visual behavior patterns and higher-level cognitive processes. Previous studies of visual expertise in medicine have centered around traditionally visually intensive disciplines such as radiology and pathology. However, there is limited study of visual expertise in electrocardiogram (ECG) interpretation, a common clinical task that is associated with high error rates. This qualitatively driven multi-methods study aimed to describe differences in cognitive approaches to ECG interpretation between medical students, emergency medicine (EM) residents, and EM attending physicians. Approach: Ten medical students, 10 EM residents, and 10 EM attending physicians were recruited from one tertiary academic center to participate in this study. Participants interpreted 10 ECGs with a screen-based eye-tracking device, then underwent a subjective re situ interview augmented by playback of the participants' own gaze scan-paths via eye-tracking. Interviews were transcribed verbatim and an emergent thematic analysis was performed across participant groups. Diagnostic speed, accuracy, and heat maps of fixation distribution were collected to supplement the qualitative findings. Findings: Qualitative analysis demonstrated differences among the cohorts in three major themes: dual-process reasoning, ability to prioritize, and clinical implications. These qualitative findings were aligned with differences in visual behavior demonstrated by heat maps of fixation distribution across each ECG. More experienced participants completed ECG interpretation significantly faster and more accurately than less experienced participants. Insights: The cognitive processes related to ECG interpretation differed between novices and more experienced providers in EM. Understanding the differences in cognitive approaches to ECG interpretation between these groups may help inform best practices in teaching this ubiquitous diagnostic skill.

Starting to Think Like an Expert: An Analysis of Resident Cognitive Processes During Simulation-Based Resuscitation Examinations.

STUDY OBJECTIVE: Simulation is commonly used to teach crisis resource management skills and assess them in emergency medicine residents. However, our understanding of the cognitive processes underlying crisis resource management skills is limited because these processes are difficult to assess and describe. The objective of this study is to uncover and characterize the cognitive processes underlying crisis resource management skills and to describe how these processes vary between residents according to performance in a simulation-based examination. METHODS: Twenty-two of 24 eligible emergency medicine trainees from 1 tertiary academic center completed 1 or 2 resuscitation-based examinations in the simulation laboratory. Resident performance was assessed by a blinded expert using an entrustment-based scoring tool. Participants wore eye-tracking glasses that generated first-person video that was used to augment subsequent interviews led by an emergency medicine faculty member. Interviews were audio recorded and then transcribed. An emergent thematic analysis was completed with a codebook that was developed by 4 research assistants, with subsequent analyses conducted by the lead research assistant with input from emergency medicine faculty. Themes from high- and low-performing residents were subsequently qualitatively compared. RESULTS: Higher-performing residents were better able to anticipate, selectively attend to relevant information, and manage cognitive demands, and took a concurrent (as opposed to linear) approach to managing the simulated patient. CONCLUSION: The results provide new insights into residents' cognitive processes while managing simulated patients in an examination environment and how these processes vary with performance. More work is needed to determine how best to apply these findings to improve crisis resource management education.

Toward Dynamically Adaptive Simulation: Multimodal Classification of User Expertise Using Wearable Devices.

Simulation-based training has been proven to be a highly effective pedagogical strategy. However, misalignment between the participant's level of expertise and the difficulty of the simulation has been shown to have significant negative impact on learning outcomes. To ensure that learning outcomes are achieved, we propose a novel framework for adaptive simulation with the goal of identifying the level of expertise of the learner, and dynamically modulating the simulation complexity to match the learner's capability. To facilitate the development of this framework, we investigate the classification of expertise using biological signals monitored through wearable sensors. Trauma simulations were developed in which electrocardiogram (ECG) and galvanic skin response (GSR) signals of both novice and expert trauma responders were collected. These signals were then utilized to classify the responders' expertise, successive to feature extraction and selection, using a number of machine learning methods. The results show the feasibility of utilizing these bio-signals for multimodal expertise classification to be used in adaptive simulation applications.

Getting Inside the Expert's Head: An Analysis of Physician Cognitive Processes During Trauma Resuscitations.

STUDY OBJECTIVE: Crisis resource management skills are integral to leading the resuscitation of a critically ill patient. Despite their importance, crisis resource management skills (and their associated cognitive processes) have traditionally been difficult to study in the real world. The objective of this study was to derive key cognitive processes underpinning expert performance in resuscitation medicine, using a new eye-tracking-based video capture method during clinical cases. METHODS: During an 18-month period, a sample of 10 trauma resuscitations led by 4 expert trauma team leaders was analyzed. The physician team leaders were outfitted with mobile eye-tracking glasses for each case. After each resuscitation, participants were debriefed with a modified cognitive task analysis, based on a cued-recall protocol, augmented by viewing their own first-person perspective eye-tracking video from the clinical encounter. RESULTS: Eye-tracking technology was successfully applied as a tool to aid in the qualitative analysis of expert performance in a clinical setting. All participants stated that using these methods helped uncover previously unconscious aspects of their cognition. Overall, 5 major themes were derived from the interviews: logistic awareness, managing uncertainty, visual fixation behaviors, selective attendance to information, and anticipatory behaviors. CONCLUSION: The novel approach of cognitive task analysis augmented by eye tracking allowed the derivation of 5 unique cognitive processes underpinning expert performance in leading a resuscitation. An understanding of these cognitive processes has the potential to enhance educational methods and to create new assessment modalities of these previously tacit aspects of expertise in this field.

The challenges of studying visual expertise in medical image diagnosis.

CONTEXT: Visual expertise is the superior visual skill shown when executing domain-specific visual tasks. Understanding visual expertise is important in order to understand how the interpretation of medical images may be best learned and taught. In the context of this article, we focus on the visual skill of medical image diagnosis and, more specifically, on the methodological set-ups routinely used in visual expertise research. METHODS: We offer a critique of commonly used methods and propose three challenges for future research to open up new avenues for studying characteristics of visual expertise in medical image diagnosis. The first challenge addresses theory development. Novel prospects in modelling visual expertise can emerge when we reflect on cognitive and socio-cultural epistemologies in visual expertise research, when we engage in statistical validations of existing theoretical assumptions and when we include social and socio-cultural processes in expertise development. The second challenge addresses the recording and analysis of longitudinal data. If we assume that the development of expertise is a long-term phenomenon, then it follows that future research can engage in advanced statistical modelling of longitudinal expertise data that extends the routine use of cross-sectional material through, for example, animations and dynamic visualisations of developmental data. The third challenge addresses the combination of methods. Alternatives to current practices can integrate qualitative and quantitative approaches in mixed-method designs, embrace relevant yet underused data sources and understand the need for multidisciplinary research teams. CONCLUSION: Embracing alternative epistemological and methodological approaches for studying visual expertise can lead to a more balanced and robust future for understanding superior visual skills in medical image diagnosis as well as other medical fields.

Measuring physician cognitive load: validity evidence for a physiologic and a psychometric tool.

In general, researchers attempt to quantify cognitive load using physiologic and psychometric measures. Although the construct measured by both of these metrics is thought to represent overall cognitive load, there is a paucity of studies that compares these techniques to one another. The authors compared data obtained from one physiologic tool (pupillometry) to one psychometric tool (Paas scale) to explore whether they actually measured the construct of cognitive load as purported. Thirty-two participants with a range of resuscitation medicine experience and expertise completed resuscitation-medicine based multiple-choice-questions as well as arithmetic questions. Cognitive load, as measured by both tools, was found to be higher for the more difficult questions as well as for questions that were answered incorrectly (p < 0.001). The group with the least medical experience had higher cognitive load than both the intermediate and experienced groups when answering domain-specific questions (p = 0.023 and p = 0.003 respectively for the physiologic tool; p = 0.006 and p < 0.001 respectively for the psychometric tool). There was a strong positive correlation (Spearman's ρ = 0.827, p < 0.001 for arithmetic questions; Spearman's ρ = 0.606, p < 0.001 for medical questions) between the two cognitive load measurement tools. These findings support the validity argument that both physiologic and psychometric metrics measure the construct of cognitive load.

How we developed a comprehensive resuscitation-based simulation curriculum in emergency medicine.

Over the past decade, simulation-based education has emerged as a new and exciting adjunct to traditional bedside teaching and learning. Simulation-based education seems particularly relevant to emergency medicine training where residents have to master a very broad skill set, and may not have sufficient real clinical opportunities to achieve competence in each and every skill. In 2006, the Emergency Medicine program at Queen's University set out to enhance our core curriculum by developing and implementing a series of simulation-based teaching sessions with a focus on resuscitative care. The sessions were developed in such as way as to satisfy the four conditions associated with optimum learning and improvement of performance; appropriate difficulty of skill, repetitive practice, motivation, and immediate feedback. The content of the sessions was determined with consideration of the national training requirements set out by the Royal College of Physicians & Surgeons of Canada. Sessions were introduced in a stepwise fashion, starting with a cardiac resuscitation series based on the AHA ACLS guidelines, and leading up to a more advanced resuscitation series as staff became more adept at teaching with simulation, and as residents became more comfortable with this style of learning. The result is a longitudinal resuscitation curriculum that begins with fundamental skills of resuscitation and crisis resource management (CRM) in the first 2 years of residency and progresses through increasingly complex resuscitation cases where senior residents are expected to play a leadership role. This paper documents how we developed, implemented, and evaluated this resuscitation-based simulation curriculum for Emergency Medicine postgraduate trainees, with discussion of some of the challenges encountered.

Combining first-person video and gaze-tracking in medical simulation: a technical feasibility study.

Crisis decision-making is an important responsibility of the resuscitation team leader but a difficult process to study. The purpose of this pilot study was to explore the potential of gaze-tracking technology to study decision-making and leadership behaviours in simulated medical emergencies. We studied five physicians with a broad range of experience in a simulated medical emergency using gaze-tracking glasses. Subjects were interviewed immediately after the scenario while viewing a first-person recording of their performance with a superimposed gaze indicator. The recordings were then studied independently by two reviewers, and rated for quality and their observations collated. Portable gaze-tracking devices were found to be useful and effective tools for studying information gathering and decision-making behaviours in simulated medical emergencies. The data obtained in this study provided information about the discrepancy between what each participant looked at compared to what each participant consciously noted. Analysis of the data also identified a number of recurrent gaze patterns performed by team leaders that could be used as end-points in future research. Gaze-tracking in resuscitation medicine is a new and promising field of study. The potential to study crisis decision-making behaviours, and cognitive load, as well as differences between novice and expert team leaders is substantial.

Cognitive load theory in action: e-learning modules improve performance in simulation-based education. A pilot study.

PURPOSE: Learners participating in simulation-based education may experience cognitive overload with potential detrimental effects to learning and performance. Multiple strategies have been proposed to mitigate this detrimental response. However, these strategies have not fully considered the potential benefits of using online platforms, such as accessibility, cost-effectiveness, efficiency, and scalability. Addressing this gap in the literature, preparatory online modules were developed by applying concepts from cognitive load theory and simulation-based education. This study assessed whether using preparatory online modules to deliver weekly pre-briefing content could impact cognitive load and performance. The participants were first-year postgraduate medical trainees participating in a simulation-based resuscitation curriculum. METHODS: Fifty-three trainees were allocated to receive preparatory online modules (online modules group, n = 27) or not (control group, n = 26) during the course component of a simulation-based resuscitation curriculum. Then, these trainees participated in a simulation-based objective structured clinical examination (OSCE). Sources of cognitive load (intrinsic, extraneous, and germane) were measured using a modified cognitive load questionnaire. Performance was assessed using the Ottawa Surgical Competency Operating Room Evaluation. Data were analyzed with descriptive statistics, and principal component analysis. RESULTS: During the course component, the online modules group was found to have higher intrinsic and germane cognitive load, and lower extraneous cognitive load compared to the control group. During the OSCE, the online modules group scored significantly higher in performance scores (p = 0.0077, d = 0.39, 95% confidence interval = 0.10;0.68) compared to the control group. Principal component analysis supported the results obtained with the modified cognitive load questionnaire. CONCLUSION: Trainees using preparatory online modules during the course component of a simulation-based resuscitation curriculum experienced cognitive load changes consistent with cognitive optimization. This may have contributed to their superior performance in the subsequent OSCE. Future research should explore the long-term impacts of online preparatory training and consider potential barriers to implementation in diverse healthcare environments.

RéSUMé: OBJECTIF: Les personnes apprenantes qui participent à un enseignement basé sur la simulation peuvent éprouver une surcharge cognitive pouvant avoir des effets néfastes sur l'apprentissage et le rendement. Plusieurs stratégies ont été proposées pour atténuer cette réaction préjudiciable. Toutefois, ces stratégies n'ont pas pleinement tenu compte des avantages potentiels de l'utilisation de plateformes en ligne, comme l'accessibilité, la rentabilité, l'efficience et l'évolutivité. Pour combler cette lacune dans la littérature, des modules préparatoires en ligne ont été développés en appliquant les concepts de la théorie de la charge cognitive et de l'éducation basée sur la simulation. Cette étude a évalué si l'utilisation de modules en ligne préparatoires pour fournir un contenu de pré-briefing hebdomadaire pourrait avoir un impact sur la charge cognitive et la performance. Les participants étaient des étudiants en médecine de troisième cycle de première année participant à un programme de réanimation par simulation. MéTHODES: Cinquante-trois stagiaires ont reçu des modules préparatoires en ligne (groupe de modules en ligne, n = 27) ou non (groupe témoin, n = 26) au cours de la composante de cours d'un programme de réanimation par simulation. Ces stagiaires ont ensuite participé à un examen clinique objectif structuré basé sur la simulation (OSCE). Les sources de charge cognitive (intrinsèque, étrangère et pertinente) ont été mesurées à l'aide d'un questionnaire sur la charge cognitive modifiée. Le rendement a été évalué à l'aide de l'évaluation de la salle d'opération des compétences en chirurgie d'Ottawa. Les données ont été analysées à l'aide de statistiques descriptives et d'une analyse en composantes principales. RéSULTATS: Au cours de la composante de cours, le groupe des modules en ligne s'est avéré avoir une charge cognitive intrinsèque plus élevée et une charge cognitive étrangère plus faible par rapport au groupe témoin. Au cours de l'OSCE, le groupe des modules en ligne a obtenu des scores de performance significativement plus élevés (p = 0,0077, d = 0,39, intervalle de confiance à 95 % = 0,10;0,68) que le groupe témoin. L'analyse en composantes principales a appuyé les résultats obtenus avec le questionnaire sur la charge cognitive modifiée. CONCLUSION: Les stagiaires utilisant des modules préparatoires en ligne pendant la composante de cours d'un programme de réanimation basé sur la simulation ont subi des changements de charge cognitive compatibles avec l'optimisation cognitive. Cela peut avoir contribué à leur performance supérieure dans l'OSCE ultérieure. Les recherches futures devraient explorer les impacts à long terme de la formation préparatoire en ligne et examiner les obstacles potentiels à la mise en œuvre dans divers environnements de soins de santé.

The Assessment Burden in Competency-Based Medical Education: How Programs Are Adapting.

Residents and faculty have described a burden of assessment related to the implementation of competency-based medical education (CBME), which may undermine its benefits. Although this concerning signal has been identified, little has been done to identify adaptations to address this problem. Grounded in an analysis of an early Canadian pan-institutional CBME adopter's experience, this article describes postgraduate programs' adaptations related to the challenges of assessment in CBME. From June 2019-September 2022, 8 residency programs underwent a standardized Rapid Evaluation guided by the Core Components Framework (CCF). Sixty interviews and 18 focus groups were held with invested partners. Transcripts were analyzed abductively using CCF, and ideal implementation was compared with enacted implementation. These findings were then shared back with program leaders, adaptations were subsequently developed, and technical reports were generated for each program. Researchers reviewed the technical reports to identify themes related to the burden of assessment with a subsequent focus on identifying adaptations across programs. Three themes were identified: (1) disparate mental models of assessment processes in CBME, (2) challenges in workplace-based assessment processes, and (3) challenges in performance review and decision making. Theme 1 included entrustment interpretation and lack of shared mindset for performance standards. Adaptations included revising entrustment scales, faculty development, and formalizing resident membership. Theme 2 involved direct observation, timeliness of assessment completion, and feedback quality. Adaptations included alternative assessment strategies beyond entrustable professional activity forms and proactive assessment planning. Theme 3 related to resident data monitoring and competence committee decision making. Adaptations included adding resident representatives to the competence committee and assessment platform enhancements. These adaptations represent responses to the concerning signal of significant burden of assessment within CBME being experienced broadly. The authors hope other programs may learn from their institution's experience and navigate the CBME-related assessment burden their invested partners may be facing.

A scoping review of nontechnical skill assessment tools to evaluate trauma team performance.

BACKGROUND: The objective of this scoping review was to identify assessment tools of trauma team performance (outside of technical skills) and assess the validity and reliability of each tool in assessing trauma team performance. METHODS: We searched Embase, Cochrane Library, Web of Science, Ovid Medline, and Cumulative Index to Nursing and Allied Health Literature from inception to June 1, 2021. English studies that evaluated trauma team performance using nontechnical skill assessment tools in a simulation or real-world setting were included. Studies were assessed by two independent reviewers for meeting inclusion/exclusion criteria. Data regarding team assessment tools were extracted and synthesized into behavior domains. Each tool was then assessed for validity and reliability. RESULTS: The literature search returned 4,215 articles with 29 meeting inclusion criteria. Our search identified 12 trauma team performance assessment tools. Most studies were conducted in the United States (n = 20 [69%]). Twenty studies (69%) assessed trauma team performance in a simulation setting; Team Emergency Assessment Measure (TEAM) and Trauma Nontechnical Skills Scale (T-NOTECHS) were the only tools to be applied in a simulation and real-world setting. Most studies assessed trauma team performance using video review technology (n = 17 [59%]). Five overarching themes were designed to encompass behavioral domains captured across the 12 tools: (1) Leadership, (2) Communication, (3) Teamwork, (4) Assessment, and (5) Situation Awareness. The reliability and validity of T-NOTECHS were investigated by the greatest number of studies (n = 13); however, TEAM had the most robust evidence of reliability and validity. CONCLUSION: We identified 12 trauma team performance tools that assessed nontechnical skills to varying degrees. Trauma Nontechnical Skills Scale and TEAM tools had the most evidence to support their reliability and validity. Considering the limited research in the impact of trauma team performance on patient outcomes, future studies could use video review technology in authentic trauma cases to further study this important relationship. LEVEL OF EVIDENCE: Systematic reviews and meta-analyses, level IV.

Multi-source feedback following simulated resuscitation scenarios: a qualitative study.

Background: The direct observation and assessment of learners' resuscitation skills by an attending physician is challenging due to the unpredictable and time-sensitive nature of these events. Multisource feedback (MSF) may address this challenge and improve the quality of assessments provided to learners. We aimed to describe the similarities and differences in the assessment rationale of attending physicians, registered nurses, and resident peers in the context of a simulation-based resuscitation curriculum. Methods: We conducted a qualitative content analysis of narrative MSF of medical residents in their first postgraduate year of training who were participating in a simulation-based resuscitation course at two Canadian institutions. Assessments included an entrustment score and narrative comments from attending physicians, registered nurses, and resident peers in addition to self-assessment. Narrative comments were transcribed and analyzed thematically using a constant comparative method. Results: All 87 residents (100%) participating in the 2017-2018 course provided consent. A total of 223 assessments were included in our analysis. Four themes emerged from the narrative data: 1) Communication, 2) Leadership, 3) Demeanor, and 4) Medical Expert. Relative to other assessor groups, feedback from nurses focused on patient-centred care and communication while attending physicians focused on the medical expert theme. Peer feedback was the most positive. Self-assessments included comments within each of the four themes. Conclusions: In the context of a simulation-based resuscitation curriculum, MSF provided learners with different perspectives in their narrative assessment rationale and may offer a more holistic assessment of resuscitation skills within a competency-based medical education (CBME) program of assessment.

Contexte: Le contexte imprévisible et contraignant au niveau du temps lors de l'observation directe et de la rétroaction associée sur les compétences en réanimation des apprenants constituent un défi pour un médecin superviseur. La rétroaction multisources (RMS) peut être un moyen de relever ce défi et d'améliorer la qualité des rétroactions fournies aux apprenants. Nous visons à décrire les similitudes et les différences quant à la démarche évaluative auprès de médecins traitants, d'infirmières cliniciennes et de pairs résidents dans le cadre d'un cours de réanimation offert par simulation. Méthodes: Nous avons réalisé une analyse de contenu à partir des rétroactions narratives offertes aux résidents en première année de formation postdoctorale dans deux universités canadiennes dans le cadre d'un cours de réanimation offert par simulation. En plus de l'auto-évaluation, la rétroaction comportait un score de confiance et des commentaires narratifs de la part de médecins superviseurs, d'infirmières cliniciennes et des pairs. Les commentaires ont été transcrits et analysés par thèmes en appliquant la méthode générale de comparaison constante. Résultats: Un consentement pour participer à l'étude a été obtenu auprès des 87 résidents (100 %) qui ont suivi le cours en 2017-2018. Nous avons analysé un total de 223 rétroactions. Quatre thèmes ont émergé à partir des données narratives soit : 1) la communication, 2) le leadership, 3) le comportement, et 4) l'expertise médicale. Alors que les infirmières ont ciblé leurs commentaires sur les soins centrés sur le patient et la communication, les médecins superviseurs ont les ont ciblés sur l'expertise médicale. Les commentaires des pairs étaient les plus positifs. Les auto-évaluations comportaient des commentaires sur chacun des quatre thèmes. Conclusions: Dans le contexte d'un cours de réanimation offert par simulation, la RMS a permis aux apprenants d'obtenir des évaluations narratives selon différentes perspectives. Permettant ainsi une approche plus holistique de rétroaction sur les habiletés en réanimation dans le cadre d'un programme d'évaluation axé sur les compétences .

Cognitive load and processes during chest radiograph interpretation in the emergency department across the spectrum of expertise.

BACKGROUND: In the emergency department (ED), chest radiographs (CXRs) provide essential information for clinical diagnostic reasoning. Errors in interpretation by emergency physicians can lead to negative patient outcomes. To aid in teaching this important skill, an understanding of cognitive processes and cognitive load (CL) in CXR interpretation in emergency medicine (EM) personnel is warranted. METHODS: This study adopted a concurrent mixed-methods research design. Participant groups included medical students (M), junior (J) and senior (S) EM residents, and attending emergency physicians (P) in the ED at an academic hospital. To elucidate cognitive processes, a real-time cognitive task analysis during CXR interpretation was performed. Interviews were audio recorded, transcribed verbatim, and analyzed thematically. The interview was followed by a questionnaire, where participants rated their CL, stress, and confidence level. RESULTS: Levels of CL (M vs. S and M vs. P, p = 0.002; J vs. S, p = 0.004; J vs. P, p = 0.005) and stress (J vs. P, p = 0.002) decreased, while confidence levels increased (M vs. S, p = 0.006; J vs. S, p ≤ 0.001; J vs. P, p = 0.003) as experience level increased. Qualitative analysis of interviews revealed four themes: checking behavior, information reduction, pattern recognition versus systematic viewing, and recognizing scope of practice. Experts commonly utilized checking behavior (e.g., comparison to prior radiographs) and deprioritized task irrelevant data. Experts used a general overview technique as their initial approach as opposed to a systematic viewing approach, and they more readily recognized an EM physicians' scope of practice in this task. CONCLUSION: This study characterized differences in cognition that led to increased CL, stress, and lower level of confidence in EM learners during CXR interpretation and provided insight into expertise development in this important skill.

From Theory to Practice: The Application of Cognitive Load Theory to the Practice of Medicine.

Cognitive load theory has become a leading model in educational psychology and has started to gain traction in the medical education community over the last decade. The theory is rooted in our current understanding of human cognitive architecture in which an individual's limited working memory and unlimited long-term memory interact during the process of learning. Though initially described as primarily a theory of learning, parallels between cognitive load theory and broader aspects of medical education as well as clinical practice are now becoming clear. These parallels are particularly relevant and evident in complex clinical environments, like resuscitation medicine. The authors have built on these connections to develop a recontextualized version of cognitive load theory that applies to complex professional domains and in which the connections between the theory and clinical practice are made explicit, with resuscitation medicine as a case study. Implications of the new model for medical education are also presented along with suggested applications.

Shaken and stirred: emotional state, cognitive load, and performance of junior residents in simulated resuscitation.

BACKGROUND: Patient resuscitation can be overwhelming for junior postgraduate medical residents due to its inherent complexity and high-stakes environment. Emotional states of unpleasant hyperarousal burden cognitive resources, contributing to cognitive overload and performance decline. Our objective is to characterize the associations between pre-scenario emotional state and junior residents' cognitive load and performance in a simulated-resuscitation, to provide evidence for informed curricular development. METHODS: PGY-1 residents self-rated their emotional state before four simulated-resuscitation scenarios, and their cognitive load after. Faculty assessed performance with entrustment scores. Factor analysis identified the principal components of emotional state data. Linear regression models examined the relationship between pre-scenario emotional components, cognitive load, and performance scores. RESULTS: 47/47 medical and surgical residents (100%) participated and completed Emotional State (99.5%) and Cognitive Load (98.9%) surveys. Positive invigoration and negative tranquility were the principal components. Pre-scenario tranquility was negatively associated with cognitive load (b= -0.23, p < 0.0001), and cognitive load was negatively associated with performance scores (b= -0.27, p < 0.0001). Pre-scenario invigoration was negatively associated with cognitive load (b=-0.18, p = 0.0001), and positively associated with performance scores (b= 0.08, p = 0.0193). CONCLUSION: Amongst junior residents participating in simulated resuscitation scenarios, pre-scenario agitation (negative tranquility) is associated with increased cognitive load, which itself is associated with lower performance scores. These findings suggest residency programs should consider developing curriculum aimed at modulating residents' emotional agitation and reducing residents' cognitive burden to improve resuscitation performance.

CONTEXTE: La réanimation de patients peut être éprouvante pour les stagiaires postdoctoraux juniors en raison de la complexité qui y est inhérente et de la gravité de l'enjeu. Les états émotionnels désagréables d'hyperexcitation épuisent les ressources cognitives, contribuant ainsi à la surcharge cognitive et à la baisse de la performance. Notre objectif était de mettre en évidence le rapport entre l'état émotionnel des résidents juniors avant une simulation de réanimation d'un côté et leur charge cognitive et leur performance lors de celle-ci de l'autre, pour produire des données probantes pouvant servir à la conception éclairée de programmes d'enseignement. MÉTHODES: Des résidents de première année ont autoévalué leur état émotionnel avant chacun des quatre scénarios de réanimation simulée, ainsi que leur charge cognitive après les simulations. Des membres du corps professoral ont évalué leur performance par l'attribution de scores de confiance. Les principales composantes des données sur l'état émotionnel ont été déterminées par le biais d'une analyse factorielle. On s'est servi de modèles de régression linéaire pour établir la relation entre les composantes émotionnelles avant la simulation, la charge cognitive et les scores de performance. RÉSULTATS: Les 47 résidents en médecine et en chirurgie qui ont participé à l'étude (100 %) ont rempli les questionnaires sur l'état émotionnel (99,5 %) et la charge cognitive (98,9 %). La stimulation positive et la tranquillité négative sont les principales composantes dégagées. La tranquillité avant la simulation était négativement corrélée avec la charge cognitive (b= -0,23, p<0,0001), et la charge cognitive était négativement liée aux scores de performance (b= -0,27, p<0,0001). La stimulation avant la simulation était négativement corrélée avec la charge cognitive (b=-0.18, p=0.0001), et positivement corrélée avec les scores de performance (b= 0.08, p=0.0193). CONCLUSION: Chez les résidents juniors qui ont participé à des scénarios de réanimation simulée, l'agitation précédant cette dernière (tranquillité négative) était liée à une charge cognitive accrue, qui elle-même a donné lieu à des scores de performance plus faibles. Ces résultats montrent la pertinence de concevoir des programmes qui visent à réduire l'agitation émotionnelle et la charge cognitive des résidents afin d'améliorer leurs performances en réanimation.