Improving quality through simulation; developing guidance to design simulation interventions following key events in healthcare.

Simulation educators are often requested to provide multidisciplinary and/or interprofessional simulation training in response to critical incidents. Current perspectives on patient safety focus on learning from failure, success and everyday variation. An international collaboration has led to the development of an accessible and practical framework to guide the implementation of appropriate simulation-based responses to clinical events, integrating quality improvement, simulation and patient safety methodologies to design appropriate and impactful responses. In this article, we describe a novel five-step approach to planning simulation-based interventions after any events that might prompt simulation-based learning in healthcare environments. This approach guides teams to identify pertinent events in healthcare, involve relevant stakeholders, agree on appropriate change interventions, elicit how simulation can contribute to them and share the learning without aggravating the second victim phenomenon. The framework is underpinned by Deming's System of Profound Knowledge, the Model for Improvement and translational simulation. It aligns with contemporary socio-technical models in healthcare, by emphasising the role of clinical teams in designing adaptation and change for improvement, as well as encouraging collaborations to enhance patient safety in healthcare. For teams to achieve this adaptive capacity that realises organisational goals of continuous learning and improvement requires the breaking down of historical silos through the creation of an infrastructure that formalises relationships between service delivery, safety management, quality improvement and education. This creates opportunities to learn by design, rather than chance, whilst striving to close gaps between work as imagined and work as done.

Analyzing emergency call volume, call durations, and unanswered calls during the first two waves of the COVID-19 pandemic compared to 2019: An observational study of routine data from seven bavarian dispatch centres.

Background: The spread of the COVID-19 pandemic and the corresponding implementation of measures such as stay-at-home orders and curfews had a major impact on health systems, including emergency medical services. This study examined the effect of the pandemic on call volumes, duration of calls and unanswered calls to the emergency number 112. Method: For this retrospective, descriptive study, 986,650 calls to seven emergency dispatch centres in Bavaria between January 01, 2019 and May 31, 2021 were analysed. The absolute number of calls and calls per 100,000 inhabitants as well as the number of unanswered calls are reported. The Mann‒Whitney U test was used to compare mean call durations between 2019 and 2020/2021 during several periods. Results: Call volume declined during the pandemic, especially during periods with strict lockdown restrictions. The largest decline (-12.9 %) occurred during the first lockdown. The largest reduction in the number of emergency calls overall (-25.3 %) occurred on weekends during the second lockdown. Emergency call duration increased, with the largest increase (+13 s) occurring during the "light" lockdown. The number of unanswered calls remained at a similar level as before the pandemic. Conclusion: This study showed that the studied Bavarian dispatch centres experienced lower call volumes and longer call durations during the first two waves of the COVID-19 pandemic (up to May 2021). Longer call durations could be the result of additional questions to identify potentially infectious patients. The fact that the number of unanswered calls hardly changed may indicate that the dispatch centres were not overwhelmed during the study period.

Integration of simulation-based education in anaesthesiology specialist training: Synthesis of results from an Utstein Meeting.

BACKGROUND: Despite its importance in education and patient safety, simulation-based education and training (SBET) is only partially or poorly implemented in many countries, including most European countries. The provision of a roadmap may contribute to the development of SBET for the training of anaesthesiologists. OBJECTIVE: To develop a global agenda for the integration of simulation into anaesthesiology specialist training; identify the learning domains and objectives that are best achieved through SBET; and to provide examples of simulation modalities and evaluation methods for these learning objectives. DESIGN: Utstein-style meeting where an expert consensus was reached after a series of short plenary presentations followed by small group workshops, underpinned by Kern's six-step theoretical approach to curriculum development. SETTING: Utstein-style collaborative meeting. PARTICIPANTS: Twenty-five participants from 22 countries, including 23 international experts in simulation and two anaesthesia trainees. RESULTS: We identified the following ten domains of expertise for which SBET should be used to achieve the desired training outcomes: boot camp/initial training, airway management, regional anaesthesia, point of care ultrasound, obstetrics anaesthesia, paediatric anaesthesia, trauma, intensive care, critical events in our specialty, and professionalism and difficult conversations. For each domain, we developed a course template that defines the learning objectives, instructional strategies (including simulation modalities and simulator types), and assessment methods. Aspects related to the practical implementation, barriers and facilitators of this program were also identified and discussed. CONCLUSIONS: We successfully developed a comprehensive agenda to facilitate the integration of SBET into anaesthesiology specialist training. The combination of the six-step approach with the Utstein-style process proved to be extremely valuable in supporting content validity and representativeness. These results may facilitate the implementation and use of SBET in several countries. TRIAL REGISTRATION: Not applicable.

Ambulance deployment without transport: a retrospective difference analysis for the description of emergency interventions without patient transport in Bavaria.

BACKGROUND: Not all patients who call the ambulance service are subsequently transported to hospital. In 2018, a quarter of deployments of an emergency ambulance in Bavaria were not followed by patient transport. This study describes factors that influence patient transport rates. METHOD: This is a retrospective cross-sectional study based on data from all Integrated Dispatch Centres of the Free State of Bavaria in 2018. Included were ambulance deployments without emergency physician involvement, which were subdivided into ambulance deployments without transport and ambulance deployments with transport. The proportion of transported patients were determined for the primary reasons for deployment and for the different community types. On-scene time was compared for calls with and without patient transport. Differences were tested for statistical significance using Chi2 tests and the odds ratio was calculated to determine differences between groups. RESULTS: Of 510,145 deployments, 147,621 (28.9%) could be classified as ambulance deployments without transport and 362,524 (71.1%) as ambulance deployments with transport.The lowest proportion of patients transported was found for activations where the fire brigade was involved ("fire alarm system" 0.6%, "fire with emergency medical services" 5.4%) and "personal emergency response system active alarm" (18.6%). The highest transport rates were observed for emergencies involving "childbirth/delivery" (96.9%) and "trauma" (83.2%). A lower proportion of patients is transported in large cities as compared to smaller cities or rural communities; in large cities, the odds ratio for emergencies without transport is 2.02 [95% confidence interval 1.98-2.06] referenced to rural communites. The median on-scene time for emergencies without transport was 20.8 min (n = 141,052) as compared to 16.5 min for emergencies with transport (n = 362,524). The shortest on-scene times for emergencies without transport were identified for activations related to "fire alarm system" (9.0 min) and "personal emergency response system active alarm" (10.6 min). CONCLUSION: This study indicates that the proportion of patients transported depends on the reason for deployment and whether the emergency location is urban or rural. Particularly low transport rates are found if an ambulance was dispatched in connection with a fire department operation or a personal emergency medical alert button was activated. The on-scene-time of the rescue vehicle is increased for deployments without transport. The study could not provide a rationale for this and further research is needed. Trial registration This paper is part of the study "Rettungswageneinsatz ohne Transport" ["Ambulance deployment without transport"] (RoT), which was registered in the German Register of Clinical Studies under the number DRKS00017758.

Computer-assisted simulated workplace-based assessment in surgery: application of the universal framework of intraoperative performance within a mixed-reality simulation.

Objectives: Workplace-based assessment (WBA) is a key requirement of competency-based medical education in postgraduate surgical education. Although simulated workplace-based assessment (SWBA) has been proposed to complement WBA, it is insufficiently adopted in surgical education. In particular, approaches to criterion-referenced and automated assessment of intraoperative surgical competency in contextualized SWBA settings are missing.Main objectives were (1) application of the universal framework of intraoperative performance and exemplary adaptation to spine surgery (vertebroplasty); (2) development of computer-assisted assessment based on criterion-referenced metrics; and (3) implementation in contextualized, team-based operating room (OR) simulation, and evaluation of validity. Design: Multistage development and assessment study: (1) expert-based definition of performance indicators based on framework's performance domains; (2) development of respective assessment metrics based on preoperative planning and intraoperative performance data; (3) implementation in mixed-reality OR simulation and assessment of surgeons operating in a confederate team. Statistical analyses included internal consistency and interdomain associations, correlations with experience, and technical and non-technical performances. Setting: Surgical simulation center. Full surgical team set-up within mixed-reality OR simulation. Participants: Eleven surgeons were recruited from two teaching hospitals. Eligibility criteria included surgical specialists in orthopedic, trauma, or neurosurgery with prior VP or kyphoplasty experience. Main outcome measures: Computer-assisted assessment of surgeons' intraoperative performance. Results: Performance scores were associated with surgeons' experience, observational assessment (Objective Structured Assessment of Technical Skill) scores and overall pass/fail ratings. Results provide strong evidence for validity of our computer-assisted SWBA approach. Diverse indicators of surgeons' technical and non-technical performances could be quantified and captured. Conclusions: This study is the first to investigate computer-assisted assessment based on a competency framework in authentic, contextualized team-based OR simulation. Our approach discriminates surgical competency across the domains of intraoperative performance. It advances previous automated assessment based on the use of current surgical simulators in decontextualized settings. Our findings inform future use of computer-assisted multidomain competency assessments of surgeons using SWBA approaches.

Safety management in times of crisis: Lessons learned from a nationwide status-analysis on German intensive care units during the COVID-19 pandemic.

Background: The status of Safety Management is highly relevant to evaluate an organization's ability to deal with unexpected events or errors, especially in times of crisis. However, it remains unclear to what extent Safety Management was developed and sufficiently implemented within the healthcare system during the COVID-19 pandemic. Providing insights of potential for improvement is expected to be directional for ongoing Safety Management efforts, in times of crisis and beyond. Method: A nationwide survey study was conducted among healthcare professionals and auxiliary staff on German Intensive Care Units (ICUs) evaluating their experiences during the first wave of the COVID-19 pandemic. Error Management and Patient Safety Culture (PSC) measures served to operationalize Safety Management. Data were analyzed descriptively and by using quantitative content analysis (QCA). Results: Results for n = 588 participants from 53 hospitals show that there is a gap between errors occurred, reported, documented, and addressed. QCA revealed that low quality of safety culture (27.8%) was the most mentioned reason for errors not being addressed. Overall, ratings of PSC ranged from 26.7 to 57.9% positive response with Staffing being the worst and Teamwork Within Units being the best rated dimension. While assessments showed a similar pattern, medical staff rated PSC on ICUs more positively in comparison to nursing staff. Conclusion: The status-analysis of Safety Management in times of crisis revealed relevant potential for improvement. Human Factor plays a crucial role in the occurrence and the way errors are dealt with on ICUs, but systemic factors should not be underestimated. Further intensified efforts specifically in the fields of staffing and error reporting, documentation and communication are needed to improve Safety Management on ICUs. These findings might also be applicable across nations and sectors beyond the medical field.

[Differences between emergency medical services operations with and without patient transport : A retrospective analysis of dispatch center data in a territorial state]. / Unterschiede zwischen Rettungsdiensteinsätzen mit und ohne Patiententransport : Eine retrospektive Analyse der Leitstellendaten in einem Flächenstaat.

BACKGROUND: The use of the emergency medical services (EMS) in Bavaria has been increasing for years. We hypothesized that emergency response without patient transport (RoT) is often an expression of inadequate alert planning. The aim of the study was to describe the differences between the integrated dispatch centers (ILSs) for such operations with regard to the characteristics of transport quotas and ranges according to the reason for deployment as well as times and days of the week. METHOD: Retrospective cross-sectional study of data from all 26 ILSs in the Free State of Bavaria in 2018. Transport quotas for emergency operations for essential reasons without emergency physician involvement were analyzed comparatively in relation to dispatch center area, time of day, and day of the week. Deployments were categorized as RoT or ambulance deployment with transport (TP). RESULTS: Of 510,145 call-outs, 147,621 (28.9%) were RoT and 362,524 (71.1%) were TP. There were significant regional differences in the transport quotas for all deployment reasons investigated. The highest range among the ILSs was found for the deployment reasons "fire alarm system" (16.8 percentage points), "personal emergency response system" (16.1%), and "heart/circulation" (14.6%). In the morning hours, the number of calls decreases with increasing TP. The fewest RoT took place between 8 and 10 am. The days of the week analysis revealed small differences in the frequency of RoT on Mondays as well as on weekends without planning relevance. CONCLUSION: We found significant differences in the ranges. This could indicate locally different alert planning specifications or dispatching decisions by the ILS. The control centers probably have considerable potential for controlling and improving resource allocation.

Duplicated Reality for Co-located Augmented Reality Collaboration.

When two or more users attempt to collaborate in the same space with Augmented Reality, they often encounter conflicting intentions regarding the occupation of the same working area and self-positioning around such without mutual interference. Augmented Reality is a powerful tool for communicating ideas and intentions during a co-assisting task that requires multi-disciplinary expertise. To relax the constraint of physical co-location, we propose the concept of Duplicated Reality, where a digital copy of a 3D region of interest of the users' environment is reconstructed in real-time and visualized in-situ through an Augmented Reality user interface. This enables users to remotely annotate the region of interest while being co-located with others in Augmented Reality. We perform a user study to gain an in-depth understanding of the proposed method compared to an in-situ augmentation, including collaboration, effort, awareness, usability, and the quality of the task. The result indicates almost identical objective and subjective results, except a decrease in the consulting user's awareness of co-located users when using our method. The added benefit from duplicating the working area into a designated consulting area opens up new interaction paradigms to be further investigated for future co-located Augmented Reality collaboration systems.

SimUniversity at a distance: a descriptive account of a team-based remote simulation competition for health professions students.

BACKGROUND: SimUniversity competition is an innovative Society in Europe for Simulation Applied to Medicine (SESAM) initiative which has existed since 2014, with the aim of creating opportunities for undergraduate healthcare students to take part in a formative educational experience on an international platform. The main educational focus is on promoting non-technical skills such as leadership, situation awareness, decision making, communication, and assertiveness, but also clinical reasoning within a team. In preparation for the 2021 virtual conference, the team designed a new methodology to meet the same mission, and yet be offered remotely. MAIN TEXT: In this article, we describe the way in which we transformed the SimUniversity competition activity from face to face to a remote simulation. We relied on Zoom as the main communication technology to enable the distance component and followed the key elements of pre-briefing, simulation, and debriefing with the students being onsite together in one location and the faculty and simulator technologists in distant locations. Thirty-eight medical and nursing students formed 8 teams from 7 different countries. Two participating teams were based in Germany and one in Italy, Belgium, the Netherlands, Romania, Portugal, and Syria. Each team consisted of between 4 and 5 members and was self-selected to consist of either medical students alone or medical and nursing students together. The SimUniversity faculty team was composed of 5 physician educators, one nurse educator, one paramedic simulation technologist, and one industry simulation technologist. The faculty members facilitated each simulation synchronously in Zoom, while being based in different geographical locations within Europe (Germany, Switzerland, and the Netherlands) and the Middle East (Qatar and Lebanon). CONCLUSION: We conclude that assuming there is access to adequate internet connectivity and minimal technical setup, conducting a remote simulation with virtual debriefing is achievable in supporting team-based learning, particularly when learners and/or faculty members are in distant locations. While the authors do not recommend this method to be superior to a face-to-face experience, we propose this model to be an alternative method to consider when educators are faced with imposed restrictions such as what we faced during the COVID-19 pandemic. We discuss lessons learned and highlight other potential benefits that this method may provide, to consider even when the restrictions are lifted.

Intraoperative dynamics of workflow disruptions and surgeons' technical performance failures: insights from a simulated operating room.

INTRODUCTION: Flow disruptions (FD) in the operating room (OR) have been found to adversely affect the levels of stress and cognitive workload of the surgical team. It has been concluded that frequent disruptions also lead to impaired technical performance and subsequently pose a risk to patient safety. However, respective studies are scarce. We therefore aimed to determine if surgical performance failures increase after disruptive events during a complete surgical intervention. METHODS: We set up a mixed-reality-based OR simulation study within a full-team scenario. Eleven orthopaedic surgeons performed a vertebroplasty procedure from incision to closure. Simulations were audio- and videotaped and key surgical instrument movements were automatically tracked to determine performance failures, i.e. injury of critical tissue. Flow disruptions were identified through retrospective video observation and evaluated according to duration, severity, source, and initiation. We applied a multilevel binary logistic regression model to determine the relationship between FDs and technical performance failures. For this purpose, we compared FDs in one-minute intervals before performance failures with intervals without subsequent performance failures. RESULTS: Average simulation duration was 30:02 min (SD = 10:48 min). In 11 simulated cases, 114 flow disruption events were observed with a mean hourly rate of 20.4 (SD = 5.6) and substantial variation across FD sources. Overall, 53 performance failures were recorded. We observed no relationship between FDs and likelihood of immediate performance failures: Adjusted odds ratio = 1.03 (95% CI 0.46-2.30). Likewise, no evidence could be found for different source types of FDs. CONCLUSION: Our study advances previous methodological approaches through the utilisation of a mixed-reality simulation environment, automated surgical performance assessments, and expert-rated observations of FD events. Our data do not support the common assumption that FDs adversely affect technical performance. Yet, future studies should focus on the determining factors, mechanisms, and dynamics underlying our findings.

COVID-19 Critical Care Simulations: An International Cross-Sectional Survey.

Objective: To describe the utility and patterns of COVID-19 simulation scenarios across different international healthcare centers. Methods: This is a cross-sectional, international survey for multiple simulation centers team members, including team-leaders and healthcare workers (HCWs), based on each center's debriefing reports from 30 countries in all WHO regions. The main outcome measures were the COVID-19 simulations characteristics, facilitators, obstacles, and challenges encountered during the simulation sessions. Results: Invitation was sent to 343 simulation team leaders and multidisciplinary HCWs who responded; 121 completed the survey. The frequency of simulation sessions was monthly (27.1%), weekly (24.8%), twice weekly (19.8%), or daily (21.5%). Regarding the themes of the simulation sessions, they were COVID-19 patient arrival to ER (69.4%), COVID-19 patient intubation due to respiratory failure (66.1%), COVID-19 patient requiring CPR (53.7%), COVID-19 transport inside the hospital (53.7%), COVID-19 elective intubation in OR (37.2%), or Delivery of COVID-19 mother and neonatal care (19%). Among participants, 55.6% reported the team's full engagement in the simulation sessions. The average session length was 30-60 min. The debriefing process was conducted by the ICU facilitator in (51%) of the sessions followed by simulation staff in 41% of the sessions. A total of 80% reported significant improvement in clinical preparedness after simulation sessions, and 70% were satisfied with the COVID-19 sessions. Most perceived issues reported were related to infection control measures, followed by team dynamics, logistics, and patient transport issues. Conclusion: Simulation centers team leaders and HCWs reported positive feedback on COVID-19 simulation sessions with multidisciplinary personnel involvement. These drills are a valuable tool for rehearsing safe dynamics on the frontline of COVID-19. More research on COVID-19 simulation outcomes is warranted; to explore variable factors for each country and healthcare system.

Three-dimensional-Printed Computed Tomography-Based Bone Models for Spine Surgery Simulation.

INTRODUCTION: We present a novel 3-dimensional (3D) printing method for low-cost and widely available reproduction of computed tomography (CT)-based synthetic bone models for spine surgery simulation, optimized to reproduce realistic haptic properties. The method allows reproduction of either normal or abnormal patient anatomy. The models are fluoroscopy compatible and contain deformities and fractures present in the underlying CT data. METHODS: Spine models created from CT data were printed on a 3D printer using 2 different materials for cortical and cancellous bone. Printing parameters were iteratively optimized with surgical experts and 3 candidate spine models were evaluated in a study regarding haptic properties. X-ray images of a spine section printed with final printing parameters were evaluated by surgical experts regarding fluoroscopic properties. RESULTS: Eleven surgical experts performed a trocar insertion, a typical workflow step in spine surgery procedures, on the models. We observed agreement that cortical structures and strong agreement that cancellous structures of the final model are haptically comparable with human vertebral bone. Ten surgical experts evaluated x-ray images of the model. They expressed strong agreement on the similarity with x-ray images of the human spine and confirmed the presence of a fracture. Material cost of a typical spine model is around US $11. CONCLUSIONS: Models created using the novel methodology realistically reproduce the haptic properties during a trocar placement into the vertebral body. The models are compatible with conventional x-ray imaging. Because the models correspond to real patient CT data, those can alternatively be used in simulation environments that simulate fluoroscopy or CT image guidance to produce highly realistic, radiation-free imaging output.

Technical and Nontechnical Skills in Surgery: A Simulated Operating Room Environment Study.

STUDY DESIGN: Observational simulation study. OBJECTIVE: The goal of this study was to investigate the relationship between technical and nontechnical skills (NTS) in a simulated surgical procedure. SUMMARY OF BACKGROUND DATA: Although surgeons' technical and NTS during surgery are crucial determinants for clinical outcomes, little literature is available in spine surgery. Moreover, evidence regarding how surgeons' technical and NTS are related is limited. METHODS: A mixed-reality and full-scale simulated operating room environment was employed for the surgical team. Eleven surgeons performed the vertebroplasty procedure (VP). Technical skills (TS) were assessed using Objective Structured Assessment of Technical Skill scores and senior expert-evaluated VP outcome assessment. NTS were assessed with the Observational Teamwork Assessment for Surgery. Kendall-Tau-b tests were performed for correlations. We further controlled the influence of surgeons' experience (based on professional tenure and number of previous VPs performed). RESULT: Surgeons' NTS correlated significantly with their technical performance (τ = 0.63; P = 0.006) and surgical outcome scores (τ = 0.60; P = 0.007). This association was attenuated when controlling for surgeons' experience. CONCLUSION: Our results suggest that spine surgeons with higher levels of TS also apply better communication, leadership, and coordination behaviors during the procedure. Yet, the role of surgeons' experience needs further investigation for improving surgeons' intraoperative performance during spine surgery. LEVEL OF EVIDENCE: 3.

Say, What Is on Your Mind? Surgeons' Evaluations of Realism and Usability of a Virtual Reality Vertebroplasty Simulator.

BACKGROUND: Virtual reality (VR)-based simulations offer rich opportunities for surgical skill training and assessment of surgical novices and experts. A structured evaluation and validation process of such training and assessment tools is necessary for effective surgical learning environments. OBJECTIVE: To develop and apply a classification system of surgeon-reported experience during operation of a VR vertebroplasty simulator. METHODS: A group of orthopedic, trauma surgeons and neurosurgeons (n = 13) with various levels of expertise performed on a VR vertebroplasty simulator. We established a mixed-methods design using think-aloud protocols, senior surgical expert evaluations, performance metrics, and a post-simulation questionnaire. Verbal content was systematically analyzed using structured qualitative content analysis. We established a category system for classification of surgeons' verbal evaluations during the simulation. Furthermore, we evaluated intraoperative performance metrics and explored potential associations with surgeons' characteristics and simulator evaluation. RESULTS: Overall, 244 comments on realism and usability of the vertebroplasty simulator were collected. This included positive and negative remarks, questions, and specific suggestions for improvement. Further findings included surgeons' approval of the realism and usability of the simulator and the observation that the haptic feedback of the VR patient's anatomy requires further improvement. Surgeon-reported evaluations were not associated with performance decrements. DISCUSSION: This study is the first to apply think-aloud protocols for evaluation of a surgical VR-based simulator. A novel classification approach is introduced that can be used to classify surgeons' verbalized experiences during simulator use. Our lessons learned may be valuable for future research with similar methodological approach.

Improving Clinical Performance of an Interprofessional Emergency Medical Team Through a One-day Crisis Resource Management Training.

INTRODUCTION: Errors are frequent in health care and Emergency Departments are one of the riskiest areas due to frequent changes of team composition, complexity and variety of the cases and difficulties encountered in managing multiple patients. As the majority of clinical errors are the results of human factors and not technical in nature or due to the lack of knowledge, a training focused on these factors appears to be necessary. Crisis resource management (CRM), a tool that was developed initially by the aviation industry and then adopted by different medical specialties as anesthesia and emergency medicine, has been associated with decreased error rates. THE AIM OF THE STUDY: To assess whether a single day CRM training, combining didactic and simulation sessions, improves the clinical performance of an interprofessional emergency medical team. MATERIAL AND METHODS: Seventy health professionals with different qualifications, working in an emergency department, were enrolled in the study. Twenty individual interprofessional teams were created. Each team was assessed before and after the training, through two in situ simulated exercises. The exercises were videotaped and were evaluated by two assessors who were blinded as to whether it was the initial or the final exercise. Objective measurement of clinical team performance was performed using a checklist that was designed for each scenario and included essential assessment items for the diagnosis and treatment of a critical patient, with the focus on key actions and decisions. The intervention consisted of a one-day training, combining didactic and simulation sessions, followed by instructor facilitated debriefing. All participants went through this training after the initial assessment exercises. RESULTS: An improvement was seen in most of the measured clinical parameters. CONCLUSION: Our study supports the use of combined CRM training for improving the clinical performance of an interprofessional emergency team. Empirically this may improve the patient outcome.

Stepwise development of a simulation environment for operating room teams: the example of vertebroplasty.

BACKGROUND: Despite the growing importance of medical simulation in education, there is limited guidance available on how to develop medical simulation environments, particularly with regard to technical and non-technical skills as well as to multidisciplinary operating room (OR) team training. We introduce a cognitive task analysis (CTA) approach consisting of interviews, structured observations, and expert consensus to systematically elicit information for medical simulator development. Specifically, our objective was to introduce a guideline for development and application of a modified CTA to obtain task demands of surgical procedures for all three OR professions with comprehensive definitions of OR teams' technical and non-technical skills. METHODS: To demonstrate our methodological approach, we applied it in vertebroplasty, a minimally invasive spine procedure. We used a CTA consisting of document reviews, in situ OR observations, expert interviews, and an expert consensus panel. Interviews included five surgeons, four OR nurses, and four anesthetists. Ten procedures were observed. Data collection was carried out in five OR theaters in Germany. RESULTS: After compiling data from interviews and observations, we identified 6 procedural steps with 21 sub-steps for surgeons, 20 sub-steps for nurses, and 22 sub-steps for anesthetists. Additionally, we obtained information on 16 predefined categories of intra-operative skills and requirements for all three OR professions. Finally, simulation requirements for intra-operative demands were derived and specified in the expert panel. CONCLUSIONS: Our CTA approach is a feasible and effective way to elicit information on intra-operative demands and to define requirements of medical team simulation. Our approach contributes as a guideline to future endeavors developing simulation training of technical and non-technical skills for multidisciplinary OR teams.

Improving nontechnical skills of an interprofessional emergency medical team through a one day crisis resource management training.

Errors are frequent in healthcare, but Emergency Departments are among the highest risk areas due to frequent changes in team composition, complexity and variety of cases, and difficulties encountered in managing multiple patients simultaneously.Crisis resource management (CRM) training has been associated with decreased error rates in the aviation industry as well as in certain areas of acute medical care, such as anesthesia and emergency medicine. In this study, we assessed whether a single day CRM training, combining didactic and simulation sessions, improves nontechnical skills (NTS) of interprofessional emergency medical teams.Seventy health professionals with different qualifications, working in an emergency department, were enrolled in the study. Twenty individual interprofessional teams were created. Each team was assessed before and after the training, through 2 in situ simulated exercises. The exercises were videotaped and were evaluated by 2 assessors who were blinded as to whether it was the initial or the final exercise. They used a new tool designed specifically for the assessment of emergency physicians' NTS. The intervention consisted of one-day training, combining didactic and simulation sessions, followed by an instructor facilitated debriefing. All participants went through this training after the initial assessment exercises.A significant improvement (P < 0.05) was shown for all the NTS assessed, in all professional categories involved, regardless of the duration of prior work experience in the Emergency Department.This study shows that even a short intervention, such as a single day CRM training, can have a significant impact in improving NTS, and can potentially improve patient safety.

A radiation-free mixed-reality training environment and assessment concept for C-arm-based surgery.

PURPOSE: The discrepancy of continuously decreasing opportunities for clinical training and assessment and the increasing complexity of interventions in surgery has led to the development of different training and assessment options like anatomical models, computer-based simulators or cadaver trainings. However, trainees, following training, assessment and ultimately performing patient treatment, still face a steep learning curve. METHODS: To address this problem for C-arm-based surgery, we introduce a realistic radiation-free simulation system that combines patient-based 3D printed anatomy and simulated X-ray imaging using a physical C-arm. To explore the fidelity and usefulness of the proposed mixed-reality system for training and assessment, we conducted a user study with six surgical experts performing a facet joint injection on the simulator. RESULTS: In a technical evaluation, we show that our system simulates X-ray images accurately with an RMSE of 1.85 mm compared to real X-ray imaging. The participants expressed agreement with the overall realism of the simulation, the usefulness of the system for assessment and strong agreement with the usefulness of such a mixed-reality system for training of novices and experts. In a quantitative analysis, we furthermore evaluated the suitability of the system for the assessment of surgical skills and gather preliminary evidence for validity. CONCLUSION: The proposed mixed-reality simulation system facilitates a transition to C-arm-based surgery and has the potential to complement or even replace large parts of cadaver training, to provide a safe assessment environment and to reduce the risk for errors when proceeding to patient treatment. We propose an assessment concept and outline the steps necessary to expand the system into a test instrument that provides reliable and justified assessments scores indicative of surgical proficiency with sufficient evidence for validity.

Virtual reality-based simulators for spine surgery: a systematic review.

BACKGROUND CONTEXT: Virtual reality (VR)-based simulators offer numerous benefits and are very useful in assessing and training surgical skills. Virtual reality-based simulators are standard in some surgical subspecialties, but their actual use in spinal surgery remains unclear. Currently, only technical reviews of VR-based simulators are available for spinal surgery. PURPOSE: Thus, we performed a systematic review that examined the existing research on VR-based simulators in spinal procedures. We also assessed the quality of current studies evaluating VR-based training in spinal surgery. Moreover, we wanted to provide a guide for future studies evaluating VR-based simulators in this field. STUDY DESIGN AND SETTING: This is a systematic review of the current scientific literature regarding VR-based simulation in spinal surgery. METHODS: Five data sources were systematically searched to identify relevant peer-reviewed articles regarding virtual, mixed, or augmented reality-based simulators in spinal surgery. A qualitative data synthesis was performed with particular attention to evaluation approaches and outcomes. Additionally, all included studies were appraised for their quality using the Medical Education Research Study Quality Instrument (MERSQI) tool. RESULTS: The initial review identified 476 abstracts and 63 full texts were then assessed by two reviewers. Finally, 19 studies that examined simulators for the following procedures were selected: pedicle screw placement, vertebroplasty, posterior cervical laminectomy and foraminotomy, lumbar puncture, facet joint injection, and spinal needle insertion and placement. These studies had a low-to-medium methodological quality with a MERSQI mean score of 11.47 out of 18 (standard deviation=1.81). CONCLUSIONS: This review described the current state and applications of VR-based simulator training and assessment approaches in spinal procedures. Limitations, strengths, and future advancements of VR-based simulators for training and assessment in spinal surgery were explored. Higher-quality studies with patient-related outcome measures are needed. To establish further adaptation of VR-based simulators in spinal surgery, future evaluations need to improve the study quality, apply long-term study designs, and examine non-technical skills, as well as multidisciplinary team training.

Evaluation of simparteam - a needs-orientated team training format for obstetrics and neonatology.

INTRODUCTION: A standardized team-training program for healthcare professionals in obstetric units was developed based on an analysis of common causes for adverse events found in claims registries. The interdisciplinary and inter-professional training concept included both technical and non-technical skill training. Evaluation of the program was carried out in hospitals with respect to the immediate personal learning of participants and also regarding changes in safety culture. METHODS: Trainings in n=7 hospitals including n=270 participants was evaluated using questionnaires. These were administered at four points in time to staff from participating obstetric units: (1) 10 days ahead of the training (n=308), (2) on training day before (n=239), (3) right after training (n=248), and (4) 6 months after (n=188) the intervention. Questionnaires included several questions for technical and non-technical skills and the Hospital Survey on Patient Safety (HSOPS). RESULTS: Strong effects were found in the participants' perception of their own competence regarding technical skills and handling of emergencies. Small effects could be observed in the scales of the HSOPS questionnaire. Most effects differed depending on professional groups and hospitals. CONCLUSIONS: Integrated technical and team management training can raise employees' confidence with complex emergency management skills and processes. Some indications for improvements on the patient safety culture level were detected. Furthermore, differences between professional groups and hospitals were found, indicating the need for more research on contributing factors for patient safety and for the success of crew resource management (CRM) trainings.