Validación de un cuestionario para evaluar la satisfacción de la población usuaria de un centro de simulación clínica / Validation of a questionnaire to assess the user population satisfaction of a clinical simulation center

Introduction: User satisfaction is a very important aspect in any management; it is defined as the concordance between expectations and the final perception regarding the factors that intervene in the provision of services; its evaluation is an indicator of continuous improvement, but expectations differ depending on the context and services; finally, it is necessary to evaluate not only user satisfaction about the educational activity, but also the academic environment. Objective: To design and validate a questionnaire to assess the satisfaction of users of a clinical simulation center in Yucatan, Mexico. Methodology: The design of the questionnaire was based on the SERVQUAL model. A committee of 7 experts evaluated it. For the pilot test, 256 users were selected by random probabilistic sample. At the end of the educational experience, their participation and informed consent were requested to answer the final version of the questionnaire. The reliability analysis was with Cronbach's alpha. Results: The questionnaire was structured with 15 items in 3 dimensions: suitability of the facilities, teaching effectiveness and overall satisfaction. The degree of agreement was evaluated by the content validity coefficient (CVC). Of the 256 users, 70% (179) were women and 30% (77) men, between 18 and 55 years of age. An overall Cronbach's alpha reliability of 0.997 was obtained. Conclusions: The questionnaire is a reliable and useful tool to assess user satisfaction after an educational experience, as well as to identify various factors inherent to the provision of the service.

Introducción: la satisfacción de los usuarios es un aspecto muy importante en cualquier gestión; se define como la concordancia entre las expectativas y la percepción final respecto a los factores que intervienen en la prestación de servicios; su evaluación es indicador de mejora continua, pero las expectativas difieren según el contexto y servicios; por ende, es necesario evaluar no solo la satisfacción del usuario acerca de la actividad educativa, sino también el ambiente académico. Objetivo: diseñar y validar un cuestionario para evaluar la satisfacción de los usuarios de un centro de simulación clínica en Yucatán, México. Metodología: el diseño del cuestionario se basó en el modelo SERVQUAL. Un comité de 7 expertos lo evaluó. Para la prueba piloto se seleccionaron 256 usuarios, por muestreo probabilístico aleatorio. Al terminar la experiencia educativa se les solicitó su participación y consentimiento informado para responder la versión final del cuestionario. El análisis de confiabilidad fue con alfa de Cronbach. Resultados: el cuestionario se estructuró con 15 reactivos en 3 dimensiones: idoneidad de las instalaciones, eficacia docente y satisfacción global. El grado de acuerdo fue evaluado por coeficiente de validez de contenido (CVC). De los 256 usuarios, 70% (179) fueron mujeres y 30% (77) hombres, entre 18 y 55 años de edad. Se obtuvo una fiabilidad alfa de Cronbach global de 0.997. Conclusiones: el cuestionario es una herramienta confiable y de utilidad para evaluar la satisfacción del usuario posterior a una experiencia educativa, así como para identificar diversos factores inherentes a la prestación del servicio.

How Clean Are You Really? A Simulation Study of Droplet Splash Using an Acrylic Box During Cardiopulmonary Resuscitation.

SUMMARY STATEMENT: In light of the COVID-19 pandemic, protocols to reduce risk of exposure to healthcare teams have been implemented. The use of an acrylic box during intubation and cardiopulmonary resuscitation has been adopted worldwide. A study was conducted to assess the effectiveness of an acrylic box in limiting contamination. The findings indicate that healthcare workers are still vulnerable to exposure despite the use of personal protective equipment (PPE) and an acrylic box. The causes of contamination were related to improper PPE donning and doffing and incomplete coverage by the acrylic box. Institutions should focus on ensuring proper donning and doffing of PPE and incorporating high-fidelity simulation training to prepare teams to resuscitate COVID-19 patients.

Multi-Disciplinary Trauma Evaluation and Management Simulation (MD-TEAMS) training for emergency medicine and general surgery residents.

BACKGROUND: Successful trauma resuscitation relies on multi-disciplinary collaboration. In most academic programs, general surgery (GS) and emergency medicine (EM) residents rarely train together before functioning as a team. METHODS: In our Multi-Disciplinary Trauma Evaluation and Management Simulation (MD-TEAMS), EM and GS residents completed manikin-based trauma scenarios and were evaluated on resuscitation and communication skills. Residents were surveyed on confidence surrounding training objectives. RESULTS: Residents showed improved confidence running trauma scenarios in multi-disciplinary teams. Residents received lower communication scores from same-discipline vs cross-discipline faculty. EM residents scored higher in evaluation and planning domains; GS residents scored higher in action processes; groups scored equally in team management. Strong correlation existed between team leader communication and resuscitative skill completion. CONCLUSION: MD-TEAMS demonstrated correlation between communication and resuscitation checklist item completion and communication differences by resident specialty. In the future, we plan to evaluate training-related resident behavior changes and specialty-specific communication differences by residents.

Breaking the COVID-19 Barriers to Health Professional Team Training With Online Simulation.

SUMMARY STATEMENT: The COVID-19 pandemic led to disruption of most interprofessional simulation workshops in our center, including the obstetric and neonatal emergency simulation or ONE-Sim workshops for medical, nursing, midwifery students, and health professional staff in Australia and overseas.We devised online versions of the workshop for students and staff. In this report, we describe the details of these innovative online workshops. This has enabled us to continue this vital simulation-based education during the pandemic, when strict lockdowns, physical distance requirements, and travel restrictions precluded the usual conduct of these workshops.The online workshops were well received by students and staff in Australia and overseas. Some important lessons that were learned from the preliminary experience of these workshops are detailed in this report.

Simulation-Based Up-Training in Response to the COVID-19 Pandemic.

STATEMENT: The dramatic outbreak of COVID-19 placed unprecedented strain on the critical care workforce of New York City. The enhanced precautions required to safely care for COVID-19 patients impacted the performance of even routine critical care procedures. Meanwhile, staff were stretched to care for exponentially rising case volume as COVID intensive care units (ICUs) expanded. Simulation was used to bridge these gaps-first to familiarize personnel within the Division of Pulmonary and Critical Care with revised COVID-19 care procedures, then to orient noncritical care clinicians volunteering from other specialties for COVID ICU deployment to general critical care and COVID-19 care principles. Using mannequin-based simulation scenarios followed by comprehensive debriefing sessions, simulation participants received high-intensity, high-fidelity training in respiratory failure, circulatory failure, bedside ultrasound, bedside ICU procedures, and elements of COVID-19-specific care. More than 200 physicians and advanced practice practitioners completed simulation training in preparation for deployment, supplementing and enhancing the ICU workforce at a decisive time during the outbreak.

Assessment of Alternative Personal Protective Equipment by Emergency Department Personnel During the SARS-CoV-2 Pandemic: A Simulation-Based Pilot Study.

STATEMENT: Shortage of personal protective equipment (PPE) for frontline healthcare workers managing the current severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic is a major, global challenge. In this pilot study, we describe a simulation-based method for evaluating the suitability and acceptability of an alternative biological isolation garment (BIG, a gown or a suit) for clinical use by emergency department (ED) personnel. Using a high-fidelity simulator, participants provided airway management according to the SARS-CoV-2 protocol. A nonvisible fluorescent marker was used as a surrogate marker of contamination. We assessed ultraviolet light visualization of the fluorescent marker after doffing and satisfaction with donning, use during simulation, and doffing. We found that after doffing, markers were not visualized on any of the participants and that the median satisfaction scores of the alternative and standard BIG (sBIG) were 4 [interquartile range (IQR) = 1-5] and 4 (IQR = 2-4), respectively. The results suggest the suitability and acceptability of the alternative BIG (aBIG) for use by ED personnel.

Indicadores para medir fidelidad en escenarios simulados / Indicators for measuring fidelity in simulated scenarios

INTRODUCCIÓN: La fidelidad es un elemento crucial, pero difuso, en los programas de simulación clínica. Es común que se la defina en base a preguntas de satisfacción, con enfoques subjetivos y pequeños tamaños de muestra. Se necesitan instrumentos de medición validados para una consideración más objetiva de fidelidad en escenas con participantes simulados o con maniquíes y en entornos sofisticados o no. SUJETOS Y MÉTODOS: Los indicadores se definieron mediante búsqueda bibliográfica de temas afines en artículos publicados en revistas indizadas, con las palabras clave 'fidelidad', 'realismo', 'verosimilitud' y 'alta, media y baja fidelidad', cruzadas con 'simulación clínica', en castellano e inglés. Esta es la primera fase, conceptual, de una investigación que validará formularios universales para medir la fidelidad. RESULTADOS: Se conceptualizaron tres dimensiones generales donde medir la fidelidad. A cada dimensión se le asignaron unidades específicas que se desglosaron en indicadores agrupados en tres variables de uso sistémico. La unidad mínima de medición fue el indicador. Se designaron tasadores múltiples y diferentes para cada dimensión. CONCLUSIONES: Los indicadores permiten aclarar los términos fidelidad/realismo para su uso estandarizado, definen y hacen medibles las diferentes expresiones de realismo, permiten prever y obtener el verdadero coste/beneficio de la inversión en la reproducción fiel de los entornos por parte de las instituciones, permiten describir la trazabilidad de la fidelidad ingeniera en los productos biotecnológicos y posibilitan que los activos y productos de la simulación sean validados por expertos clínicos con fundamento científico, reduciendo los sesgos por desconocimiento o indefinición

INTRODUCTION: Fidelity is a crucial, but diffuse, element in clinical simulation programs. It is commonly defined based on satisfaction questions, with subjective approaches and small sample sizes. Validated measuring instruments are needed for more objective consideration of fidelity in scenes with simulated participants and/or mannequins and in sophisticated or non-sophisticated environments. SUBJECTS AND METHODS: The indicators were defined by a bibliographic search of related topics in articles published in indexed journals with the keywords 'fidelity', 'realism', and 'high, medium and low fidelity' crossed with 'healthcare simulation', in Spanish and English. This is the first phase, conceptual, of a deeper research that will validate universal forms to measure fidelity. RESULTS: Three general dimensions were conceptualized to measure fidelity. Each dimension was assigned specific units that were broken down into indicators grouped into three systemic use variables. The minimum unit of measurement was the indicator. Multiple and different appraisers were designated for each dimension. CONCLUSIONS: The indicators make possible to clarify the terms fidelity/realism for their standardized use. They define and make measurable the different expressions of realism. They make it possible to foresee and obtain the true cost/benefit of the investment in the faithful reproduction of the environments by the institutions. They make it possible to describe the traceability of the engineering fidelity in biotechnology products. They also make possible that the assets and products of the simulation are validated by clinical experts with a scientific basis, reducing the biases due to lack of knowledge or lack of definition

[High fidelity simulation training for medical oncology announcement consultation]. / Simulation haute-fidélité à la consultation d'annonce en oncologie médicale.

INTRODUCTION: Medical oncology bad news consultation is a particularly stressful situation for both the patient and the physician. High-fidelity simulation is a learning option that has never been evaluated in France in this field. MATERIALS AND METHODS: This is a feedback from simulated announcement consultations carried out from January 2018 to May 2019. Residents from the medical oncology and radiotherapy departments performed high-fidelity simulations at the announcement consultation with an announcement nurse, a psychologist, a certified coach and an oncologist. A competency assessment was completed in pre-test, immediate post-test and after 5 months. RESULTS: Fourteen of the 16 eligible interns participated. The pre-test competency assessment showed that interns over 5 semesters reported being more comfortable at the consultation (P=0.04) and thought they were clearly explaining the disease (P=0.03). However, all residents, regardless of the semester, felt stressed before a consultation. The evolution of parameters skills after the simulation was positive for all criteria, particularly for adaptation to patient reactions, use of appropriate vocabulary and reduction of stress (P<0.05). This evolution was independent of the gender, curriculum, semester, or previous completion of a medical oncology internship. More than 80% of the students were ready to repeat this type of training. CONCLUSION: This training demonstrates the value of simulation training for medical oncology advertising consultation.

Innovation in sedation and analgesia training.

PURPOSE OF REVIEW: We reviewed evidence of recent innovations in sedation education and discuss experiences with sedation training in Taiwan. RECENT FINDINGS: Current Status of Sedation Training: Didactic training and supervised clinical mentoring are common methods of sedation training. Although training course designed by professional societies to meet individual hospital credentialing requirements, the course content and training expectations vary and are likely inadequate to non-anesthesiologist sedation practitioners. Less Common Forms of Sedation Training: These include screen-based simulation, high-fidelity manikin-based simulation. Screen-based simulation sedation training is popular, convenient, and relatively inexpensive. Although there are numerous courses available, course content has not been standardized. High-fidelity simulation has been accepted to improve knowledge, self-confidence, awareness of emergency, crisis resource management, and teamwork, but it is costly, time intensive, and requires expertise in using simulation equipment. Although screen-based training is attractive and convenient, there is no evidence to suggest that it can replace high-fidelity simulation. Another recently developed education modality is virtual reality simulation. It has gained recent popularity as an immersive approach to medical training, but minimal content has been developed for sedation training. Beyond training, several other potential innovations may improve sedation effectiveness and patient safety. These include adherence to practice guidelines established by professional organizations, utilization of a pre-procedure sedation checklist, interpreting capnography, and implementation of real-time bedside drug displays that provide predictions of concentrations and their associated effects. SUMMARY: Effective sedation education and training, especially for nonanesthesiologists, is essential to improve patient safety for procedural sedation. Several innovative approaches have been proposed and are relatively early in their development and implementation. Further studies designed to assess the impact of these new training modalities on patient safety and outcomes are warranted.

Quality with quantity? Evaluating interprofessional faculty prebriefs and debriefs for simulation training using video.

BACKGROUND: High-fidelity simulation-based training is used increasingly for prelicensure student teams. Such sessions rely on faculty who are able to provide quality prebriefing and debriefing to foster learning among participants. We investigated how well faculty conducted prebriefing and debriefing as part of high-fidelity simulation-based training for interprofessional education. METHODS: Two trained observers independently rated 38 video-recorded sessions of combinations of 4 faculty conducting prebriefings and debriefings of prelicensure student teams after high-fidelity simulation-based training. Assessment was undertaken using the Objective Structured Assessment of Debriefing, an 8-item tool using a 5-point Likert scale (1 as minimum and 5 as maximum). Mean scores for each item were calculated. Inter-rater agreement was determined using Cohen's kappa. A one-way between-subjects analysis of variance with post-hoc Tukey's studentized range procedure was conducted to compare the effect of team facilitator grouping on the quality of team performance of each Objective Structured Assessment of Debriefing element during a prebriefing or a debriefing. Trend analyses of teams with 4 or more observations were performed using Kendall's Tau coefficient test and linear regression analyses to identify whether teams showed improvement through time. Statistical significance was set at P < .05. RESULTS: A total of 7 combinations of faculty conducted between 1 to 14 prebriefings or debriefings. In general, faculty combinations performed better during debriefings compared with prebriefings, with only 1 team having 1 mean item score <3.50. Statistically significant differences between faculty combinations in mean item scores was more pronounced during the prebriefings (2 of 3 Objective Structured Assessment of Debriefing items rated) than during debriefings (1 of 8 Objective Structured Assessment of Debriefing items rated). Effect sizes were strong for all differences. Linear regression analysis revealed a statistically significant change through time for the 3 rated prebriefing items and for 7 of the 8 rated debriefing items. CONCLUSION: Interprofessional faculty combinations in this study tended to have good quality prebriefings and debriefings. The quality of the prebriefings and debriefings can, however, be influenced by the composition of the facilitator teams, most prominently for prebriefings, and team performance does appear to change through time, especially during the debriefing. Future work will focus on whether the quality of prebriefings and debriefings influences learning by trainees.

Implementing simulation in oncology emergencies education: A quasi- experimental design.

BACKGROUND: High-fidelity simulation (HFS) as a teaching-learning method has increased, especially in medical programs. OBJECTIVE: This study was conducted to assess the effectiveness of using HFS on the satisfaction, self-confidence, self-efficacy, and knowledge of undergraduate students in oncology care. METHODS: A pre-test post-test quasi-experimental design was utilized. Random sampling technique was used to recruit the participants. The scenarios including septic shock and infusion reaction were implemented. The training program including lectures and the simulation was run in a high fidelity simulation lab. RESULTS: There was a significant difference (t=-5.95, p= 0.001) between the experimental group (M= 13.95, S⁢D= 3.35) and the control group (M= 6.25, S⁢D= 2.65) regarding knowledge, confidence (t=-22.75, p= 0.001) between the experimental group (M= 61.25, S⁢D= 12.10) and the control group (M= 38.50, S⁢D= 6.20), satisfaction level t=-18.25, p= 0.001; experimental group - M= 42.25, S⁢D= 4.25; and control group - M= 28.50, S⁢D= 3.15), and there was a significant difference between the experimental group (M= 35.50, S⁢D= 3.25) and control group (M= 24.25, S⁢D= 2.85) regarding self-efficacy (t=-13.25, p= 0.001). CONCLUSIONS: High-fidelity simulation in nursing increased student knowledge, self-confidence, satisfaction, and self-efficacy in managing septic shock and infusion reaction as common oncology emergencies.

Preparing the Next Generation of Code Blue Leaders Through Simulation: What's Missing?

INTRODUCTION: Despite the increasing reliance on simulation to train residents as code blue leaders, the perceived role and effectiveness of code blue simulations from the learners' perspective have not been explored. A code blue Simulation Program (CBSP), developed based on evidence-based simulation principles, was implemented at our institution. We explored the role of simulation in code blue training and the differences between real and simulated code blues from the learner perspective. METHODS: Using a thematic analysis approach and a purposeful sampling strategy, residents who participated in the CBSP were invited to participate in one of the three focus groups. Data were collected through small group discussions guided by semistructured interviews. The interviews were audio-recorded and transcribed. Interview transcripts were coded to assess underlying themes. RESULTS: Thematic analysis revealed that participants believed that the CBSP enhanced preparedness by capturing aspects of real codes (eg, inclusion of precode scenarios with awake patients, lack of readily available information) and facilitating automatization of code blue processes. Despite efforts to develop a high-fidelity simulation, participants noted that they experienced more anxiety, observed more chaos in the environment, and encountered different communication challenges in real codes. CONCLUSIONS: The CBSP enhanced resident preparedness to serve as code blue leaders. Learners highlighted that they valued the CBSP; however, differences remain between simulated and real codes that could be addressed to enhance the fidelity of future simulations.

Becoming Parent and Nurse: High-Fidelity Simulation in Teaching Ambulatory Central Line Infection Prevention to Parents of Children with Cancer.

BACKGROUND: Ambulatory central-line infections in children with cancer are life-threatening. Infections are two to three times more frequent in outpatients than inpatients, for whom evidence-based bundles have decreased morbidity. Most cancer care now takes place at home, where parents perform many of the same tasks as nurses. However, parents often feel stressed and unprepared. To address this, high-fidelity simulation, which has been effective for teaching novice nurses, was evaluated for parent central-line education. METHODS: In a feasibility study using a pretest/posttest design, after completion of usual central-line education, parents participated in a high-fidelity simulation practice session. Parents were assessed in three domains: (1) knowledge of infection prevention; (2) psychomotor skill competence; and (3) ability to recognize health care provider nonadherence to best practices. Parents also completed a 5-point Likert simulation experience survey. RESULTS: A convenience sample of 17 parents participated between December 2015 and March 2016. Knowledge median scores increased from pre- to posttest from 10 to 15 of 16 points possible (p ≤ 0.001; Wilcoxon signed rank test). Median skills scores increased from pre- to posttest from 8 to 12 points of 12 possible (p ≤ 0.001). Following simulation, median recognition scores increased from 3 to 6 with 6 points possible (p ≤ 0.001). For the parent experience survey, 100% of participants strongly agreed or agreed that simulation was meaningful for learning central-line care. CONCLUSIONS: As an adjunct to usual care central-line education, translation of high-fidelity simulation to parent education is a novel approach that shows promise for improving central-line care at home in children with cancer.

Discovering eHealth Technology: An Innovative Interprofessional Graduate Student Learning Experience.

The use of eHealth has grown in recent years and is projected to continue to increase exponentially. In order to empower and prepare advanced practice providers to integrate eHealth into their clinical practice, curricular changes need to occur. The iTEAM grant provides a unique opportunity to prepare advanced practice disciplines to provide collaborative care using eHealth. Through the integration of a simulated telehealth using a standardized patient, Doctor of Pharmacy and Advanced Practice Registered Nursing students learned how to apply health information technology and coordinate care in an interprofessional manner. Opportunities and challenges to guide future efforts to integrate eHealth-learning experiences into the curriculum are identified.

Design of a Hospital Simulation Software for Nursing Education.

This work aims to describe the inception and design for a hospital simulator based on data and cases provided by teachers and other randomized data. The main goal is to develop a computer software tool that simulates a hospital as a tool for nursing student. The system is based on a multi-agent model and multi threaded parallel processing. Other parts includes the interfaces for teacher and student, reports and fixed constraints like Laws and other rules. This is a work in progress project and will be released as open source software after the final validation.