Creating and running an escape room for healthcare curricula: AMEE Guide No. 168.

In this guide we provide instructions and recommendations about creating and running escape rooms for healthcare education. In recent years there has been a growing interest in adopting escape rooms as an educational tool to be included in healthcare curricula, and we attempt to explain why and how these tools are fit for the particularities of this type of education. We first describe the steps that a design team will have to follow to create an educational escape room from scratch, from core characteristics like target audience and learning goals to actual puzzle design and testing. We then continue by providing recommendations to operators and lecturers about how to run such escape room as part of an overall teaching session that also includes a lecture, briefing, debriefing and evaluation. We finalise this guide by listing a set of tools for validating and evaluating these types of escape rooms.

An interview study about how nurses and physicians talk about the same concepts differently.

BACKGROUND: How healthcare professionals understand and use concepts of social and cognitive capabilities will influence their behaviour and their understanding of others' behaviour. Differing understandings of concepts might lead to healthcare professionals not acting in accordance with other healthcare professionals' expectations. Therefore, part of the problem concerning errors and adverse incidents concerning social and cognitive capabilities might be due to varying understandings of concepts among different healthcare professionals. This study aimed to examine the variations in how educators at the Copenhagen Academy for Medical Education and Simulation talk about social and cognitive capabilities. METHODS: The study was conducted using semi-structured interviews and directed content analysis. The codes for the analysis process were derived from existing non-technical skills models and used to show variations in how the participants talk about the same concepts. RESULTS: Educators with a background as nurses and physicians, talked differently about leadership and decision-making, with the nurses paying greater attention to group dynamics and external factors when describing both leadership and decision-making, whereas physicians focus on their individual efforts. CONCLUSION: We found patterned differences in how the participants described leadership and decision-making that may be related to participants' professional training/background. As it can create misunderstandings and unsafe situations if nurses and physicians disagree on the meaning of leadership and decision-making (without necessarily recognising this difference), it could be beneficial to educate healthcare professionals to be aware of the specificity of their own concepts, and to communicate what exactly they mean by using a particular concept, e.g. "I want you to coordinate tasks" instead of "I want better leadership".

Perceptions of medical students on narrow learning objectives and structured debriefing in medical escape rooms: a qualitative study.

BACKGROUND: Escape rooms are increasingly used in medical education as a complementary learning technique or even alternative to traditional educational approaches. Few studies focus on debriefing following medical escape rooms and how escape rooms can be used to achieve pre-defined learning objectives. Evaluating the use of narrow learning objectives may increase the depth of reflections and transform an engaging team event into an effective learning opportunity. This study aimed to explore participants' experiences and perceived learning outcomes of narrow learning objectives in a medical escape room with debriefing. METHODS: In this explorative, qualitative study, participants saw a video lecture, participated in an escape room experience, and in a following debriefing. Throughout this learning session, the learning objectives concerned "exchange of information" and are therefore relatively narrow. Participants then participated in a semi-structured focus group interview and completed a demographic questionnaire. Participants were volunteer final-year medical students. Focus group interview recordings were transcribed and analysed using systematic text condensation. RESULTS: Thirty-two students in eight groups completed the study. Five themes were described in the analysis of the focus group interviews: Experience with the narrow learning objectives, topics discussed in the debriefing, learning mechanisms, learning outcomes concerning exchange of information and influences of the learning approach. CONCLUSIONS: Narrow learning objectives and structured debriefing seem to increase perceived learning depth of medical escape room sessions. Using semi-structured debriefing still allows for discussions of other elements relevant to the students. CLINICAL TRIALS: Clinical.trials ID NCT04783259.

Non-technical skills of Norwegian medical students at different training sites: a comparative, observational cohort study.

PURPOSE: Mastering non-technical skills (NTS) is a fundamental part of the training of new physicians to perform effectively and safely in the medical practice environment. Ideally, they learn these skills during medical school. Decentralized medical education is being implemented increasingly worldwide. Two of the three training sites studied, Bodø (a regional hospital) and Finnmark (a rural local hospital), implemented decentralized medical education. The third training site was the main campus in Tromsø, located at an urban university hospital. The training in Finnmark emphasised training in non-technical skills using simulation to a larger extent than the two other university campuses. This study aimed to compare the NTS performance of medical students in their last year of education at three different training sites of the same university. METHODS: This blinded cohort study included students from the three training sites who participated in identical multi-professional simulations over a six-year period. Eight raters evaluated the video recordings of eight students from each training site using the Norwegian Medical Students Non-Technical Skills (NorMS-NTS) tool. The NorMS-NTS tool, which comprises four categories and 13 elements, assesses the NTS of Norwegian medical students and assigns an overall global score. Pairwise significant differences in the NTS performance levels between the training sites studied were assessed using Tukey's test. RESULTS: The overall NTS performance levels of the medical students from Finnmark (mean 4.5) were significantly higher than those of the students from Tromsø (mean 3.8) and Bodø (mean 3.5). Similarly, the NTS performance levels at category-level of the students in Finnmark were significantly higher than those of the students from Bodø and Tromsø. Except for one category, no significant differences were observed between the students from Bodø and Tromsø in terms of the overall or category-level NTS performance. CONCLUSION: The NTS performance levels of the medical students from Finnmark, which implements rural, decentralized medical education, were significantly higher than those of the students from Tromsø and Bodø.

The development of a tool to assess medical students' non-technical skills - The Norwegian medical students' non-technical skills (NorMS-NTS).

PURPOSE: New physicians need to master non-technical skills (NTS), as high levels of NTS have been shown to increase patient safety. It has also been shown that NTS can be improved through training. This study aimed to establish the necessary NTS for Norwegian medical students to create a tool for formative and summative assessments. METHODS: Focus group interviews were conducted with colleagues and patients of newly graduated physicians. Interviews were then analyzed using card sort methods, and the identified NTS were used to establish a framework. Focus groups commented on a prototype of an NTS assessment tool. Finally, we conducted a search of existing tools and literature. The final tool was developed based on the combined inputs. RESULTS: We created Norwegian medical students' non-technical skills (NorMS-NTS) assessment tool containing four main categories; together comprising 13 elements and a rating scale for the NTS of the person observed. CONCLUSIONS: The NorMS-NTS represents a purpose-made tool for assessing newly graduated physicians' NTS. It is similar to existing assessment tools but based on domain-specific user perspectives obtained through focus group interviews and feedback, integrated with results from a literature search, and with consideration of existing NTS tools.

Evaluation of the simulation based training quality assurance tool (SBT-QA10) as a measure of learners' perceptions during the action phase of simulation.

BACKGROUND: In an earlier interview-based study the authors identified that learners experience one or more of eight explicit perceptual responses during the active phase of simulation-based training (SBT) comprising a sense: of belonging to instructor and group, of being under surveillance, of having autonomy and responsibility for patient management, of realism, of an understanding of the scenario in context, of conscious mental effort, of control of attention, and of engagement with task. These were adapted into a ten-item questionnaire: the Simulation Based Training Quality Assurance Tool (SBT-QA10) to allow monitoring of modifiable factors that may impact upon learners' experiences. This study assessed the construct validity evidence of the interpretation of the results when using SBT-QAT10. MATERIALS AND METHODS: Recently graduated doctors and nurses participating in a SBT course on the topic of the deteriorating patient completed the SBT-QAT10 immediately following their participation in the scenarios. The primary outcome measure was internal consistency of the questionnaire items and their correlation to learners' satisfaction scores. A secondary outcome measure compared the impact of allocation to active versus observer role. RESULTS: A total of 349 questionnaires were returned by 96 course learners. The median of the total score for the ten perception items (TPS) was 39 (out of 50), with no significant difference between the scenarios. We identified fair and positive correlations between nine of the 10 items and the SBT-QA10-TPS, the exception being "mental effort". Compared to observers, active learners reported significantly more positive perceptions related to belonging to the team and interaction with the instructor, their sense of acting independently, and being focused. The questionnaire items were poorly correlated with the two measures of global satisfaction. CONCLUSION: Except for the item for mental effort, the QA10-TPS measures learners' experiences during the active phase of simulation scenarios that are associated with a positive learning experience. The tool may have utility to learners, instructors, and course providers by informing subsequent debriefing and reflection upon practice for learners and faculty. The relationship between these perceptions and commonly used measures of satisfaction remains poorly understood raising questions about the value of the latter.

Collecting evidence of validity for an assessment tool for Norwegian medical students' non-technical skills (NorMS-NTS): usability and reliability when used by novice raters.

BACKGROUND: The NorMS-NTS tool is an assessment tool for assessing Norwegian medical students' non-technical skills (NTS). The NorMS-NTS was designed to provide student feedback, training evaluations, and skill-level comparisons among students at different study sites. Rather than requiring extensive rater training, the tool should capably suit the needs of busy doctors as near-peer educators. The aim of this study was to examine the usability and preliminary assess validity of the NorMS-NTS tool when used by novice raters. METHODS: This study focused on the usability of the assessment tool and its internal structure. Three raters used the NorMS-NTS tool to individually rate the team leader, a medical student, in 20 video-recorded multi-professional simulation-based team trainings. Based on these ratings, we examined the tools' internal structure by calculating the intraclass correlation coefficient (ICC) (version 3.1) interrater reliability, internal consistency, and observability. After the rating process was completed, the raters answered a questionnaire about the tool's usability. RESULTS: The ICC agreement and the sum of the overall global scores for all raters were fair: ICC (3,1) = 0.53. The correlation coefficients for the pooled raters were in the range of 0.77-0.91. Cronbach's alpha for elements, categories and global score were mostly above 0.90. The observability was high (95%-100%). All the raters found the tool easy to use, none of the elements were redundant, and the written instructions were helpful. The raters also found the tool easier to use once they had acclimated to it. All the raters stated that they could use the tool for both training and teaching. CONCLUSIONS: The observed ICC agreement was 0.08 below the suggested ICC level for formative assessment (above 0.60). However, we know that the suggestion is based on the average ICC, which is always higher than a single-measure ICC. There are currently no suggested levels for single-measure ICC, but other validated NTS tools have single-measure ICC in the same range. We consider NorMS-NTS as a usable tool for formative assessment of Norwegian medical students' non-technical skills during multi-professional team training by raters who are new to the tool. It is necessary to further examine validity and the consequences of the tool to fully validate it for formative assessments.

Medical students' experiences, perceptions, and management of second victim: an interview study.

BACKGROUND: The term second victim describes a healthcare professional who has been involved in an adverse event and feels wounded by the event. The effects of this experience differ. It can present as second victim syndrome, describing a wide range and degree of emotional and behavioural responses. Studies show that medical students can also experience second victim. The aim of this study was to elucidate medical students' experiences, perceptions, and management of second victim and second victim syndrome and to describe possible learning needs around these issues. METHODS: Thirteen medical students and two recent medical graduates participated in semi-structured focus group interviews. The interviews lasted 1.5-2 h and were audiotaped, transcribed, and analysed using Braun and Clarke's six-step approach for thematic analysis. RESULTS: Four main themes were identified: contributing factors; current coping strategies; perception of own requirements and learning needs; wishes for the future healthcare system. Students' behavioural and emotional response to dilemmas were affected by stakeholders and practices embedded in the healthcare system. Students described patient-injury and unexpected events as triggers for second victim, but also harmful interactions with individuals and feelings of self-blame. Students' coping centred around their network, formal offers, and separation of personal- and work-life. Students sought a clear definition of second victim and a desire for role-models. Students' wished to learn how to handle feeling like a burden to others, managing waiting time after patient complaints, and learning how to help second victims recover. Students emphasized the importance of the healthcare organisation understanding students' needs and providing them relevant support. CONCLUSION: Students experience second victim as described in the literature. Students' emotional responses were caused by classical second victim triggers, but also other triggers in the educational environment: harmful interactions and self-blame. Although some triggers differ from the second victim definition, these different triggers should be considered equally serious and acknowledged. We must aim to prepare students for future adverse events and emotional responses. The health organisation and healthcare professionals must support students' mental well-being and contribute to ideal conditions for students' professional development and management of second victim as future physicians.

How theories of complexity and resilience affect interprofessional simulation-based education: a qualitative analysis of facilitators' perspectives.

BACKGROUND: Quality of care and patient safety rely on the ability of interprofessional teams to collaborate effectively. This can be trained through interprofessional simulation-based education (IPSE). Patient safety also relies on the ability to adapt to the complexity of such situations, an ability termed resilience. Since these needs are not explicitly addressed in IPSE, the aim of this study was to explore how central concepts from complexity-theory and resilience affect IPSE, from facilitators' perspective, when applied in debriefings. METHODS: A set of central concepts in complexity-theory and resilience were introduced to facilitators on an IPSE course for nursing and medical students. In five iterations of focus groups interviews the facilitators discussed their application of these concepts by reviewing video recordings of their own debriefings. Video recordings of the interviews were subjected to coding and thematic analysis. RESULTS: Three themes were identified. The first, Concepts of complexity and resilience are relevant for IPSE, points to the applicability of these concepts and to the fact that students often need to deviate from prescribed guidelines/algorithms in order to solve cases. The second theme, Exploring complexity, shows how uncertainty could be used as a cue to explore complexity. Further, that individual performance needs to account for the context of actions and how this may lead to certain outcomes. Moreover, it was suggested that several ways to approach a challenge can contribute to important insight in the conditions for teamwork. The third theme, Unpacking how solutions are achieved, turns to needs for handling the aforementioned complexity. It illustrates the importance of addressing self-criticism by highlighting how students were often able to overcome challenges and find solutions. Finally, this theme highlights how pre-defined guidelines and algorithms still work as important resources to help students in transforming perceived messiness into clarity. CONCLUSIONS: This study suggests that IPSE provides the possibility to explore complexity and highlight resilience so that such capability can be trained and improved. Further studies are needed to develop more concrete ways of using IPSE to account for complexity and developing resilience capacity and to evaluate to what extent IPSE can provide such an effect.

[Simulation in medical education in Iceland].

BACKGROUND: Skills labs and simulation centers have become an integrated part of teaching methods in many medical schools. This study aims to describe the status of simulation in medical education in Iceland by examining student and faculty experience, facilitating and barring factors for its use in teaching and how the concept appears in the Course Catalog. MATERIALS AND METHODS: The study was threefold. In parts one and two, electronic surveys were sent to students and faculty members at the Faculty of Medicine, University of Iceland. Part three was a key word search in the University´s course catalogue relating to simulation. RESULTS: Response rate for both student and faculty surveys was 65%. Simulation as a teaching method was reported for 10% of faculty according to students but approximately a third of faculty, according to faculty. Attitudes of students and faculty were positive. Faculty, previously exposed to simulation, were more likely to use simulation, as were those who had received training in educational methods. Main barriers identified were lack of facilities, equipment, funds, and training. Key words related to simulation appeared rarely in the University Course Catalogue. CONCLUSION: Student and faculty experience with simulation is limited, less than third of faculty claim to have used simulation when teaching medical students. Barring factors in Iceland are similar to what has been reported elsewhere. Lack of words describing simulation in the Course Catalog may raise questions about emphasis on teaching methods or lack thereof. Potential ways to increase the use of simulation could be to improve infrastructure and offer training in diverse educational methods, including simulation, to selected faculty.

Effects of shared mental models in teams performing video-assisted thoracoscopic surgery lobectomy.

BACKGROUND: Important non-technical skills enable operating teams to establish shared mental models (SMMs). The importance of SMMs in regards to surgical performance and peri-operative outcomes remains to be investigated. The aim of this study was to explore whether shared mental models (SMMs) of team resources and the current situation, respectively, were predictive of technical skills, duration of surgery, and amount of intra-operative bleeding in video-assisted thoracoscopic surgery (VATS). METHODS: A prospective multi-center observational study was conducted at four tertiary academic hospitals during VATS lobectomy procedures. Data included pre-operative and post-operative questionnaires answered by each of the six team members to measure the SMMs; thoracoscopic video recordings assessed using the previously validated VATS lobectomy Assessment Tool (VATSAT); surgery-related time stamps; and amount (volume) of intra-operative bleeding. Linear regression analyses were conducted to adjust for confounders. RESULTS: Fifty-eight lobectomy procedures were included. Median (interquartile range) VATSAT score was 33.3 (scale 8-40) duration of surgery 101 min (88-123), and amount of intra-operative bleeding 100 ml (20-150). The mean (± SD) of teams' SMMs of the current situation was 20 (± 5). They were not predictive of the surgeons' technical skills, but every one point increase in SMM score significantly predicted a 1 min 52 s decrease in duration of surgery and an 11% decrease in amount of bleeding. The SMMs of team resources were not predictive of any outcomes. CONCLUSION: VATS teams' superior SMMs of the current situation related to significantly shorter duration of surgery and decreased intra-operative bleeding, indicating an effect on team performance and patient care. TRIAL REGISTRATION: NCT02999113 at http://www. CLINICALTRIALS: gov .

Psychological safety during the test of new work processes in an emergency department.

BACKGROUND: Emergency medicine is a complex setting for healthcare delivery which relies on communication, negotiation, teamwork, trust, and shared dialog. The nature of the work comprises dealing with emotionally challenging situations and acting under uncertainty. For healthcare staff this poses the need to be adaptive and open to change. Psychological safety is an important component of productive teamwork and learning in such contexts. Edmondson's model of team psychological safety highlights factors which contribute to the development of psychological safety for staff groups and the mediating role this has for team performance. AIM: The aim of the study was explore the link between psychological safety and improvement work. The research question was: Do the aspects covered in the Edmondson model fully describe healthcare workers' perceptions of psychological safety and are all aspects in the model needed to describe these perceptions during testing of new work procedures in an emergency department?" METHODS: Using a mixed-method approach we investigated a change programme with interviews, a questionnaire and a workshop in an emergency department of a hospital in the Capital Region of Denmark. Thematic analysis of qualitative data and descriptive statistics of questionnaire data were undertaken. RESULTS: Data indicate the Edmondson model is useful to help understand and identify important antecedent and outcome factors during a period of testing new work-flow processes. The model could not capture all aspects in this study's data material, and was updated as a result. The main modifications were explicitly integrating the physical aspects of the work setting into the considerations of psychological safety, the inclusion of an additional antecedent factor relating to perceptions of care quality and adopting bi-directional links between the antecedent and consequence elements in the model. CONCLUSIONS: Although limited in scale, the study supports Edmondson's model of psychological safety as appropriate in describing many of the dynamics experienced by staff engaged in testing new work process. However, additional factors, not included in Edmondson's model and potential adaptations to the model are proposed.

Exploring health service preparation for the COVID-19 crisis utilizing simulation-based activities in a Norwegian hospital: a qualitative case study.

INTRODUCTION: The first wave of the COVID-19 pandemic caused stress in healthcare organizations worldwide. Hospitals and healthcare institutions had to reorganize their services to meet the demands of the crisis. In this case study, we focus on the role of simulation as part of the pandemic preparations in a large hospital in Norway. The aim of this study is to explore hospital leaders' and simulation facilitators' expectations of, and experiences of utilizing simulation-based activities in the preparations for the COVID-19 pandemic. METHODS: This is a qualitative case study utilizing semi-structured in-depth interviews with hospital leaders and simulation facilitators in one large hospital in Norway. The data were sorted under three predefined research topics and further analyzed by inductive, thematic analysis according to Braun and Clarke within these pre-defined topics. RESULTS: Eleven members of the hospital leadership and simulation facilitators were included in the study. We identified four themes explaining why COVID-19 related simulation-based activities were initiated, and perceived consequences of the activities; 1) a multifaceted method like simulation fitted a multifaceted crisis, 2) a well-established culture for simulation in the hospital was crucial for scaling up simulation-based activities during the crisis, 3) potential risks were outweighed by the advantages of utilizing simulation-based activities, and finally 4) hospital leaders and simulation facilitators retrospectively assessed the use of simulation-based activities as appropriate to prepare for a pandemic crisis. CONCLUSIONS: The hospital leadership's decision to utilize simulation-based activities in preparing for the COVID-19 crisis may be explained by many factors. First, it seems that many years of experience with systematic use of simulation-based activities within the hospital can explain the trust in simulation as a valuable tool that were easy to reach. Second, both hospital leaders and simulation facilitators saw simulation as a unique tool for the optimization of the COVID-19 response due to the wide applicability of the method. According to hospital leaders and simulation facilitators, simulation-based activities revealed critical gaps in training and competence levels, treatment protocols, patient logistics, and environmental shortcomings that were acted upon, suggesting that institutional learning took place.

Social ties influence teamwork when managing clinical emergencies.

BACKGROUND: Our current understanding of medical team competence is traditionally influenced by an individualistic perspective focusing on individual team members' knowledge, skills as well as on effective communication within the team. However, team dynamics may influence team performance more than previously anticipated. In particular, recent studies in other academic disciplines suggest that social ties between team members may impact team dynamics but this has not been explored for medical teams. We aimed to explore intensive care staff's perceptions about teamwork and performance in clinical emergencies focusing particularly on the teams' social ties. METHODS: Semi-structured interviews were conducted with a purposive sample of intensive care staff. We used a thematic analysis approach to data interpretation. RESULTS: Thematic saturation was achieved after three group interviews and eight individual interviews. Findings demonstrated that social ties influenced teamwork by affecting the teams' ability to co-construct knowledge, coordinate tasks, the need for hierarchy, the degree to which they relied on explicit or implicit communication, as well as their ability to promote adaptive behavior. CONCLUSIONS: Social ties may be an important factor to consider and acknowledge in the design of future team training, as well as for work planning and scheduling of team activities during clinical practice. More research is needed into the causal effect of social ties on team performance and outcome.

Priming healthcare students on the importance of non-technical skills in healthcare: How to set up a medical escape room game experience.

Background: Non-technical skills (NTS) are essential for healthcare professionals. Earlier the students are made aware of this, the more time they have to acquire these skills. Escape rooms have been introduced in the medical literature but a detailed published manual on setting up and running such a learning modality is lacking. The purpose of this paper is to describe the use of an escape room to create learning opportunities, including detailed instructions, as well as an evaluation from two settings. Methods: A medical escape room focusing on NTS was developed and run in two different settings: a university summer school - EMSS17, and an international healthcare congress - EMS2018. Questionnaire data investigating entertainment value, self-evaluated use of NTS and ideas for further use of the escape room concept was obtained. Further, video analyses were conducted to triangulate self-rated analyses. Results: Majority of the participants found the escape room psychologically safe and enjoyable and would recommend the concept to other students and healthcare professionals. Video analyses showed the same tendencies regarding the use of NTS as reported by participants. Conclusions: This paper presents a fully applicable escape room manual, ready to implement, adapt, and modify. Evaluation data support the proof of concept.

Design of simulation-based medical education and advantages and disadvantages of in situ simulation versus off-site simulation.

BACKGROUND: Simulation-based medical education (SBME) has traditionally been conducted as off-site simulation in simulation centres. Some hospital departments also provide off-site simulation using in-house training room(s) set up for simulation away from the clinical setting, and these activities are called in-house training. In-house training facilities can be part of hospital departments and resemble to some extent simulation centres but often have less technical equipment. In situ simulation, introduced over the past decade, mainly comprises of team-based activities and occurs in patient care units with healthcare professionals in their own working environment. Thus, this intentional blend of simulation and real working environments means that in situ simulation brings simulation to the real working environment and provides training where people work. In situ simulation can be either announced or unannounced, the latter also known as a drill. This article presents and discusses the design of SBME and the advantage and disadvantage of the different simulation settings, such as training in simulation-centres, in-house simulations in hospital departments, announced or unannounced in situ simulations. DISCUSSION: Non-randomised studies argue that in situ simulation is more effective for educational purposes than other types of simulation settings. Conversely, the few comparison studies that exist, either randomised or retrospective, show that choice of setting does not seem to influence individual or team learning. However, hospital department-based simulations, such as in-house simulation and in situ simulation, lead to a gain in organisational learning. To our knowledge no studies have compared announced and unannounced in situ simulation. The literature suggests some improved organisational learning from unannounced in situ simulation; however, unannounced in situ simulation was also found to be challenging to plan and conduct, and more stressful among participants. The importance of setting, context and fidelity are discussed. Based on the current limited research we suggest that choice of setting for simulations does not seem to influence individual and team learning. Department-based local simulation, such as simulation in-house and especially in situ simulation, leads to gains in organisational learning. The overall objectives of simulation-based education and factors such as feasibility can help determine choice of simulation setting.

Using a Structured Assessment Tool to Evaluate Nontechnical Skills of Nurse Anesthetists.

Nontechnical skills are critical for good anesthetic practice but are seldom addressed explicitly in clinical training. The purposes of this study were (1) to evaluate the reliability and validity of the observation-based assessment tool Nurse Anaesthetists' Non-Technical Skills system (N-ANTS) and (2) to evaluate the effect of training nurse anesthetist supervisors in the use of N-ANTS. This system comprises a global rating score, 4 categories, and 15 elements to rate nurse anesthetists' nontechnical skills. A 1-day workshop was conducted for 22 nurse anesthetist supervisors to rate nurse anesthetists' nontechnical skills in 9 scripted video scenarios. Data were gathered from 2 rating sessions separated by a 2-hour training session. The interrater reliability was high before and after the training. It remained stable for the global rating score in N-ANTS and its category ratings, but improved at the elements level. When the raters' ratings were compared with ratings by an expert reference group, there was no statistically significant effect on training. We conclude that Danish nurse anesthetist supervisors without further rater training besides their work experience can use N-ANTS to assess nontechnical skills of nurse anesthetists.

Investigating novice doctors' reflections in debriefings after simulation scenarios.

BACKGROUND: Debriefing is pivotal to the simulation learning process, and the reflection that it aims to foster is fundamental in experiential learning. Despite its importance, essential aspects of debriefing remain unclear. STUDY OBJECTIVE: To investigate reflection in debriefings by assessing participants' reflection levels in discussions of leader/follower-ship or role distribution and compare occurrences of high reflection with those of lower reflection. METHODS: The data consisted of videos from 38 debriefings with 10 debriefers from the Danish Institute of Medical Simulation. An adapted framework of reflection levels was used for the analysis. A comparison was made between debriefers' utterances across occurrences of higher and lower reflection. RESULTS: Participants reached only lower reflection levels. Of five reflection levels, the second was reached the most frequently and the third was the highest reached. No salient differences were found in debriefers' utterances across occurrences of higher and lower reflection. CONCLUSION: Participants' reflection levels were low in this cohort of novice doctors training leadership skills in acute situations. However, the desired reflection should be appropriated to the given context. The rating of reflection levels is a promising approach to analyze reflection in conversation in experience-based learning situations.

Moving towards deep equity, diversity, inclusivity and accessibility in simulation: a call to explore the promises and perils.

Principles and issues of equity, diversity, inclusivity, and accessibility (EDIA) are being explored currently in simulation designs and trainings but with limited depth, often raising more questions than answers. This editorial invites the broader healthcare simulation community to move beyond the superficial to explore more expansively and deeply these issues of EDIA within simulation. Simulation is the very environment and context from which we may confront how existing (power) structures can be dismantled and re-envisioned for more optimal redistribution of participation, power, and benefits. We can use simulation to experiment with variations of these realities, and start exploring consequences of such alternatives to benefit our broader health systems and societies. Simulation uniquely combines opportunities for experience, reflection, application and active experimentation, enabling a ripe ground for this study. In fact, it is the responsibility of simulation educators to take up this challenge, and to engage in meaningful scholarship to understand more about the impact of simulation in exploring EDIA topics. This editorial invites contributions of empirical and theoretical works that advance our collective understanding of EDIA, while also cautioning against complacency. The simulation community is urged to look inwards and also examine its own practices critically, in spite of the uncertainty, vulnerability and risks that this presents.

Social and Cognitive Skills (SCOPE)-a generic model for multi-professional work and education in healthcare.

In this article, we present a generic model for social and cognitive skills that can be used in work and (simulation-based) education in healthcare. We combined existing non-technical skills tools into a tool that we call SCOPE. SCOPE is a model that comprises the three social categories of "teamwork", "leading", and "task management" as well as the two cognitive categories of "situation awareness" and "decision making". Each category comprises between three and six elements. We formulated guiding questions for each category in an attempt to emphasize its core meaning. We developed a dynamic graphical representation of the categories that emphasize the constant changes in the relative importance of the categories over the course of a clinical or educational situation. Anecdotal evidence supports the value of the model for aligning language around social and cognitive skills across specialties and professions.