Development and validation of an assessment tool for adult simulated ultrasound-guided fascia iliaca block: a prospective monocentric study.

BACKGROUND: Fascia iliaca block (FIB) is an effective technique for analgesia. While FIB using ultrasound is preferred, there is no current standardised training technique or assessment scale. We aimed to create a valid and reliable tool to assess ultrasound-guided FIB. METHOD: This prospective observational study was conducted in the ABS-Lab simulation centre, University of Poitiers, France between 26-29 October and 14-17 December 2021. Psychometric testing included validity analysis and reliability between two independent observers. Content validity was established using the Delphi method. Three rounds of feedback were required to reach consensus. To validate the scale, 26 residents and 24 emergency physicians performed a simulated FIB on SIMLIFE, a simulator using a pulsated, revascularised and reventilated cadaver. Validity was tested using Cronbach's α coefficient for internal consistency. Comparative and Spearman's correlation analysis was performed to determine whether the scale discriminated by learner experience with FIB and professional status. Reliability was analysed using the intraclass correlation (ICC) coefficient and a correlation score using linear regression (R2). RESULTS: The final 30-item scale had 8 parts scoring 30 points: patient positioning, preparation of aseptic and tools, anatomical and ultrasound identification, local anaesthesia, needle insertion, injection, final ultrasound control and signs of local anaesthetic systemic toxicity. Psychometric characteristics were as follows: Cronbach's α was 0.83, ICC was 0.96 and R2 was 0.91. The performance score was significantly higher for learners with FIB experience compared with those without experience: 26.5 (22.0; 29.0) vs 22.5 (16.0; 26.0), respectively (p=0.02). There was a significant difference between emergency residents' and emergency physicians' scores: 20.5 (17.0; 25.0) vs 27.0 (26.0; 29.0), respectively (p=0.0001). The performance was correlated with clinical experience (Rho=0.858, p<0.0001). CONCLUSION: This assessment scale was found to be valid, reliable and able to identify different levels of experience with ultrasound-guided FIB.

Creation of a rating scale to teach Less Invasive Surfactant Administration (LISA) in simulation.

BACKGROUND: Simulation-based training is gaining increasing prominence in neonatology training. The Less Invasive Surfactant Administration (LISA) method is starting to be taught in simulation. The aim of this educational study was to develop and validate a rating scale for teaching the LISA method in simulation. METHODS: The Downing framework was used to create this performance-rating scale. A first version of the scale was submitted to 12 French and Belgian experts to obtain their opinions. Consensus was reached using a modified Delphi method. The performance of 40 pediatricians was then evaluated with this scale on a preterm neonate manikin simulating a neonatal respiratory distress syndrome. Each run was evaluated using the scale by two independent observers based on video recordings. RESULTS: The Cronbach alpha score of the rating scale was 0.72. The intraclass correlation coefficient (ICC) was 0.91 and the scores between raters were not significantly different. Finally, this rating scale correctly distinguished the experienced from the inexperienced learners (p < 0.01). CONCLUSIONS: This rating scale is one of the first rating scales for the evaluation and teaching of the LISA method in simulation. This tool has ample potential for use in clinical practice to evaluate the performance of surfactant administration in preterm neonates.

SimLife®: A New Dynamic Model for Head and Neck Surgical Oncology Simulation.

The SimLife® model consists in a human cadaver dynamized by pulsatile vascularization. The objective was to evaluate the face, contents, and constructs validity of the SimLife® model in head and neck surgical oncology simulation. Head and neck surgical oncology simulation sessions on SimLife® models were organized with lateral neck dissection and total laryngectomy. Face and contents validity were addressed by questionnaires. Constructs validity was assessed by objective structured assessment of technical skills (OSATS) score. High realism was demonstrated for consistency of tissues (7.1 ± 1.4), color of arteries and veins (7.3 ± 1.9, 8.5 ± 1.1, respectively), and vein consistency (8.5 ± 1.2). The mean OSATS score was 19.7 ± 5.4 for residents and 32.7 ± 1.9 for senior surgeon (P = .0022). SimLife® is a hyperrealistic model for head and neck surgical oncology simulation and it might become a core component of the surgical resident curriculum.

Development and validation of a performance assessment checklist for insertion of an intra-uterine device (IUD).

OBJECTIVES: The World Health Organization (WHO) supports increasing the availability and acceptability of long-acting reversible contraception including intra-uterine device (IUD), but its insertion includes certain risks (uterine perforation). The objective was to develop and validate an IUD insertion performance assessment checklist. MATERIAL AND METHODS: This prospective study took place in hospitals and simulation center of the Poitou-Charentes region, France. The checklist content reached consensus among 10 experts solicited by a Delphi method. A modified gynecologic mannequin Zoe (Gaumard®) was used for simulations. Psychometric testing included 30 multi-professional participants for internal consistency and reliability between two independent observers, and 27 residents for assessment of score evolution over time and reliability. Cronbach alpha (CA) and intraclass coefficient (ICC) were used. Progression of performance was carried out using ANOVA for repeated measures. The data collected were used to plot receiver operating characteristic (ROC) curves for the score values and the area under the curve (AUC) was determined. RESULTS: The checklist included 27 items (2 sections, total score = 27). Psychometric testing showed CA = 0.79, ICC = 0.99, and good clinical relevance. The checklist is discriminative, showing a significant increase in performance scores when the simulations were repeated (F = 77.6, p < 0.0001). ROC curve [AUC: 0.792 (95% CI: 0.71-0.89); p < 0.0001] revealed the best score cutoff predictive of 100% sensitivity, i.e., true positive rate or success rate. Performance score was highly correlated to success rate. The cut-off score guaranteeing successful IUD insertion was 22/27. CONCLUSIONS: This coherent and reproducible checklist for IUD insertion provide an objective assessment of the procedure during SBT, with the aim of obtaining a score ≥ 22/27.

Development and Testing of a Hybrid Simulator for Emergent Umbilical Vein Catheter Insertion Simulation Training.

INTRODUCTION: Emergent umbilical venous catheter (eUVC) insertion is the recommended vascular access in neonatal resuscitation. Although the theoretical knowledge can be taught, existing models are either unrealistic (plastic) or train only the steps of the task. This study aimed to develop and test a hybrid simulator for eUVC insertion training that would be realistic, reproducible, easy to build, and inexpensive, thereby facilitating detailed learning of the procedure. METHODS: Development took place in the Poitiers simulation laboratory using a neonatal mannequin into which a real umbilical cord was integrated. In the first phase, pediatric and emergency physicians and residents tested the model. In the second phase, another group of participants tested the hybrid simulator and the same neonatal mannequin associated with an artificial umbilical cord. Participants completed a satisfaction survey. RESULTS: A real umbilical cord connected to an intra-abdominal reservoir containing artificial blood was added to the mannequin, allowing insertion of the eUVC, drawback of blood, and infusion of fluids using the real anatomical structures. The model was easily reproduced and assembled in less than 30 minutes; the cost of construction and use was evaluated at €115. One hundred two participants tested the model, 60 in the first phase and 42 in the second. The success rate was higher in fully trained compared with untrained participants. All were satisfied, 97% found the model realistic, and 78.6% strongly recommended the use of this model. The participants believed that the hybrid simulator allowed better learning and a gain in performance and self-confidence in comparison with the same mannequin with an artificial umbilical cord. CONCLUSIONS: A hybrid simulator was developed for eUVC insertion. Participants were satisfied with this model, which was realistic, reproducible, easy to use, inexpensive, and facilitated an understanding of the anatomy and performance of all steps for successful eUVC insertion.

Effect of real-time feedback device compared to use or non-use of a checklist performance aid on post-training performance and retention of infant cardiopulmonary resuscitation: A randomized simulation-based trial.

INTRODUCTION: This study aims to determine the best method for achieving optimal performance of pediatric cardiopulmonary resuscitation (CPR) during simulation-based training, whether with or without a performance aid. METHODS: In this randomized controlled study, 46 participants performed simulated CPR in pairs on a Resusci Baby QCPR™ mannequin, repeated after four weeks. All participants performed the first simulation without performance aids. For the second simulation, they were randomly assigned to one of three groups with stratification based on status: throughout CPR, Group A (n = 16) was the control group and did not use a performance aid; Group B (n = 16) used the CPR checklist; Group C (n = 14) used real-time visualization of their CPR activity on a feedback device. Overall performance was assessed using the QCPR™. RESULTS: All groups demonstrated improved performance on the second simulation (p < 0.01). Use of the feedback device resulted in better CPR performance than use of the CPR checklist (p = 0.02) or no performance aid (p = 0.04). Additionally, participants thought that the QCPR™ could effectively improve their technical competences. CONCLUSIONS: Performance aid based on continuous feedback is helpful in the learning process. The use of the QCPR™, a real-time feedback device, improved the quality of resuscitation during infant CPR simulation-based training.

Simulation-based summative assessment in healthcare: an overview of key principles for practice.

BACKGROUND: Healthcare curricula need summative assessments relevant to and representative of clinical situations to best select and train learners. Simulation provides multiple benefits with a growing literature base proving its utility for training in a formative context. Advancing to the next step, "the use of simulation for summative assessment" requires rigorous and evidence-based development because any summative assessment is high stakes for participants, trainers, and programs. The first step of this process is to identify the baseline from which we can start. METHODS: First, using a modified nominal group technique, a task force of 34 panelists defined topics to clarify the why, how, what, when, and who for using simulation-based summative assessment (SBSA). Second, each topic was explored by a group of panelists based on state-of-the-art literature reviews technique with a snowball method to identify further references. Our goal was to identify current knowledge and potential recommendations for future directions. Results were cross-checked among groups and reviewed by an independent expert committee. RESULTS: Seven topics were selected by the task force: "What can be assessed in simulation?", "Assessment tools for SBSA", "Consequences of undergoing the SBSA process", "Scenarios for SBSA", "Debriefing, video, and research for SBSA", "Trainers for SBSA", and "Implementation of SBSA in healthcare". Together, these seven explorations provide an overview of what is known and can be done with relative certainty, and what is unknown and probably needs further investigation. Based on this work, we highlighted the trustworthiness of different summative assessment-related conclusions, the remaining important problems and questions, and their consequences for participants and institutions of how SBSA is conducted. CONCLUSION: Our results identified among the seven topics one area with robust evidence in the literature ("What can be assessed in simulation?"), three areas with evidence that require guidance by expert opinion ("Assessment tools for SBSA", "Scenarios for SBSA", "Implementation of SBSA in healthcare"), and three areas with weak or emerging evidence ("Consequences of undergoing the SBSA process", "Debriefing for SBSA", "Trainers for SBSA"). Using SBSA holds much promise, with increasing demand for this application. Due to the important stakes involved, it must be rigorously conducted and supervised. Guidelines for good practice should be formalized to help with conduct and implementation. We believe this baseline can direct future investigation and the development of guidelines.

Impact of a Multidisciplinary Simulation-Based Training Program on the Multiple Techniques of Intraosseous Access: A Prospective Multicentric Study.

OBJECTIVES: The aim of this study was to assess intraosseous (IO) access placement performance during a multidisciplinary simulation-based training (SBT) program according to the professional status, experience of caregivers, and the setting of the course. METHOD: This prospective, multicentric study included emergency physicians, residents, certified registered nurse anesthetists, registered nurses, and students. It was carried out between April 6, 2020 and April 30, 2021 in emergency medical services, an emergency department, and a simulation center. Trainee performance was evaluated by 2 independent observers using a validated scale, before and after SBT. Self-assessment of satisfaction was carried out. Interobserver reproducibility was analyzed by intraclass correlation coefficient. The continuous variables were compared using a Student t test or a nonparametric Mann-Whitney U test. Comparative analysis between the different groups used analysis of variance. Correlation analysis was performed by a nonparametric Spearman test. A P value of 0.05 was considered significant. RESULTS: Ninety-eight participants were included. Intraclass correlation coefficient between the 2 observers was 0.96. Performance significantly increased after training, regardless of the site or device used (for the semiautomatic device, P = 0.004 in tibia and P = 0.001 in humeral; for the manual device, P < 0.001). Simulation-based training significantly reduced time for IO access (P = 0.02). After SBT, no difference was found according to professional status and the setting of the course. Performance was not correlated with professional experience. All trainees were satisfied with the training. CONCLUSIONS: Simulation-based training improved the IO access using a semiautomatic or a manual device, regardless of the experience or status of the trainees. Simulation-based training would work for many disciplines regardless of locations (simulation or clinical facilities).

Confinés en confinement au temps du Covid : la situation des communautés religieuses cloîtrées en France.

INTRODUCTION: The COVID-19 pandemic is affecting the elderly and/or people with risk factors most severely.EHPADs have been heavily affected but the situation in cloistered religious communities with an elderly population is unknown.The primary objective was to assess the number of members of religious orders who had COVID-19 in cloistered monasteries during the first confinement in France. Secondary objectives concerned the preventive measures used inside the monastery. METHOD: A questionnaire was sent to cloistered monasteries in three French regions between 25/07 and 25/08/2020 seeking to know: the number of infected/deceased religious order members; the prevention measures taken: in community life, for order members leaving and then returning to the monastery, and for welcoming people. RESULTS: Out of 724 religious order members distributed in 34 monasteries, few have been contaminated: 25 from the same region (i.e. 3.5%). In comparison to 30/07/2020, this rate was equivalent in EHPAD and EMS but it concerned only 2 monasteries. The rate of deaths was lower in the monasteries: 3 of them or 0.4% compared to 1.4%. On the other hand, the preventive measures were well respected by all the religious order members within the community, during outings and returns and during the reception. CONCLUSION: Contrary to what has been observed in the EHPAD, very few religious order members died from COVID-19 during the first confinement. The prevention measures were well respected in the monasteries studied.

Development and validation of the first performance assessment scale for interdisciplinary chest tube insertion: a prospective multicenter study.

PURPOSE: Chest tube insertion requires interdisciplinary teamwork including an emergency surgeon or physician in conjunction with a nurse. The purpose of the study was to validate an interdisciplinary performance assessment scale for chest tube insertion developed from literature analysis. METHODS: This prospective study took place in the simulation center of the University of Paris. The participants included untrained emergency/intensivist residents and trained novice emergency/intensivist physicians with less than 2 years of clinical experience and 6 months following training in thoracostomy, and nursing students. Each interdisciplinary pair participated in a high-fidelity simulation session. Two independent observers (O1 and O2) evaluated 61 items. Internal coherence using the Cronbach's α coefficient, intraclass correlation coefficient (ICC), and correlation of scores by regression analysis (R2) were analyzed. Comparison between O1 and O2 mean scores used a t test and F test for SDs. p Value < 0.05 was significant. RESULTS: From an initial selection of 11,277 articles, 19 were selected to create the initial scale. The final scale comprises 61 items scored out of 80, including 24 items for nursing items, 24 items for medical competence, and 13 mixed items for the competence of both. 40 simulations including 80 participants were evaluated. Cronbach's α = 0.76, ICC = 0.92, R2 = 0.88. There was no difference between the observers' assessments of means (p = 0.82) and SDs (p = 0.92). Score was 51.6 ± 5.9 in the group of untrained residents and nursing student, and 57.2 ± 2.8 in the trained group of novice physicians and nursing students (p = 0.0003). CONCLUSIONS: This first performance assessment scale for interdisciplinary chest tube insertion is valid and reliable.

Simulation-based education: deceiving learners with good intent.

The level of performance of every clinician and of the overall multiprofessional team relies on the skills and expertise they have individually and collectively acquired through education, training, self-directed learning, and reflection. Simulation-based education (SBE) is playing an increasingly important role in that respect, and it is sometimes said that it is an art to facilitate. Many explanations can justify this assertion. Although there is generally an emphasis on making everything as realistic or "high-fidelity" as possible, it is often futile and this is where the art of simulation comes into play with an element of modulation of realism linked to the intended learning objectives. The atmosphere created by the educators; how the learners are made to engage and interact; how physical, technical, and contextual elements are simulated or represented; and what type of technology is used need to be appropriately adapted to contribute to the immersiveness of any SBE activity. Although it inevitably carries a negative connotation, some form of "deception" is more commonly used than one may think for the benefit of learners during SBE. High levels of realism are sometimes achieved by making learners believe something works or reacts as would be expected in real life, whereas it is achieved in a totally different manner. Learners do not need to know, see, or understand these "tricks of the trade", shortcuts, or artistic or technological aspects, and this can be considered a form of benevolent deception. Similarly, information may be withheld to recreate a realistic situation and push learners to demonstrate specific learning outcomes, but it needs to be practised with caution and be justifiable. These forms of "positive" deception are part of most SBE activities and are used to help learners bridge the reality gap so they can suspend disbelief more easily, exercise critical thinking, and treat the simulation more realistically without damaging the trust they place in their educators. This article will discuss how aspects of SBE activities are often manipulated, modified, or hidden from learners to facilitate the learning experience and present a simulation fidelity model encompassing the environmental, patient, semantical, and phenomenal dimensions.

Benefit of Simulation-Based Training in Medical Adverse Events Disclosure in Pediatrics.

INTRODUCTION: Adverse events (AEs) in health care are a public health issue. Although mandatory, error disclosure is experienced by health providers as a difficult task. METHODS: In this prospective study, the primary objective was to assess performance in disclosing AEs to simulated parents using a validated scale before and after training among a pediatric residents' population. Secondary objectives were to assess correlation with year of residency, sex, and previous experience and to analyze gain in knowledge (theoretical pretest/posttest scores) and satisfaction. Two evaluation simulations (simulation [SIM] 1 and SIM 2) were scheduled at 3-week interval. In the intervention group, mastery learning was offered after SIM 1 including a didactic approach and a training session using role-playing games. For the control group, the course was carried out after SIM 2. Assessments were performed by 2 independent observers and simulated parents. RESULTS: Forty-nine pediatric residents performed 2 scenarios of AE disclosure in front of simulated parents. In the intervention group, performance scores on SIM 2 (72.36 ± 5.40) were higher than on SIM 1 (65.08 ± 9.89, P = 0.02). In the control group, there was no difference between SIM 1 and SIM 2 (P = 0.62). The subjective scores from simulated parents showed the same increase on SIM 2 (P < 0.01). There was no correlation with the residents' previous experience or their residency year. There was an increase in self-confidence (P = 0.04) for SIM 2. There was also an increase in posttest theoretical scores (P = 0.02), and residents were satisfied with the training. CONCLUSIONS: This study showed the benefits of simulation-based training associated with mastery learning in AE disclosure among pediatric residents. It is important to train residents for these situations to avoid traumatic disclosure generating a loss of confidence of the family regarding physicians and possible lawsuits.

Development of a Performance Assessment Scale for Simulated Dispatcher-Assisted Cardiopulmonary Resuscitation (Telephone-CPR): A Multi-Center Randomized Simulation-Based Clinical Trial.

INTRODUCTION: Dispatchers should be trained to interrogate bystanders with strict protocols to elicit information focused on recognizing cardiac arrest and should provide telephone cardiopulmonary resuscitation (CPR) instructions in all cases of suspected cardiac arrest. While an objective assessment of training outcomes is needed, there is no performance assessment scale for simulated dispatcher-assisted CPR. STUDY OBJECTIVE: The aim of the study was to create a valid and reliable performance assessment scale for simulated dispatcher-assisted CPR. METHODS: In this prospective, randomized, controlled, multi-centric simulation-based trial (registration number TCTR20210130002), the scale was developed according to the European Resuscitation Council (ERC) and American Heart Association (AHA) Guidelines 2015 and revised by experts. The performance of 48 dispatchers' telephone-CPR and of 48 bystanders carrying out CPR on a manikin was assessed by two independent evaluators using the scale and using a SkillReporter (PC) software to provide CPR objective performance. Continuous variables were described as mean (SD) and categorical variables as numbers and percentage (%). Comparative analysis between two groups used a Student t-test or a non-parametric test of Mann-Whitney. The internal structure of the scale was evaluated, including internal consistency using α Cronbach coefficient, and reproducibility using intraclass correlation coefficient (ICC) and linear correlation coefficient (R2) calculation. RESULTS: The scale included three different parts: two sections for dispatchers' (32 items) and bystanders' CPR performance (15 items) assessment, and a third part recording times. There was excellent internal consistency (α Cronbach coefficient = 0.77) and reproducibility (ICC = 0.93; R² = 0.86). For dispatchers' performance assessment, α Cronbach coefficient = 0.76; ICC = 0.91; R2 = 0.84. For bystanders' performance assessment, α Cronbach coefficient = 0.75; ICC = 0.93; R2 = 0.87. Reproducibility was excellent for nine items, good for 19 items, and moderate for 19 items. No item had poor reproducibility. There was no significant difference between dispatch doctors' and medical dispatch assistants' performances (33.0 [SD = 4.7] versus 32.3 [SD = 3.2] out of 52, respectively; P = .70) or between trained and untrained bystanders to follow the instructions (14.3 [SD = 2.0] versus 13.9 [SD = 1.8], respectively; P = .64). Objective performance (%) was significantly higher for trained bystanders than for untrained bystanders (67.4 [SD = 14.5] versus 50.6 [SD = 19.3], respectively; P = .03). CONCLUSION: The scale was valid and reliable to assess performance for simulated dispatcher-assisted CPR. To the authors' knowledge, no other valid performance tool currently exists. It could be used in simulated telephone-CPR training programs to improve performance.

Stress: A Factor Explaining the Gap Between Simulated and Clinical Procedure Success.

BACKGROUND: Stress may impair the success of procedures in emergency medicine. The aims were to assess residents' stress during simulated and clinical lumbar punctures (LPs) and to explore the correlation of stress and performance. METHODS: A prospective study (2013-2016) was carried out in a pediatric emergency department. A mastery training and subsequently a just-in-time training were conducted immediately preceding each clinical LP. Stress was self-assessed by the Stress-O-Meter scale (0-10). Performance (checklist 0-6 points) and success rate (cerebrospinal fluid with <1000 red blood cells/mm3) were recorded by a trained supervisor. A survey explored self-confidence and potential causes of stress. RESULTS: Thirty-three residents performed 35 LPs. There was no stress during simulation procedure. Stress levels significantly increased for clinical procedure (P < 0.0001). Performance was similar in simulation and in clinic (respectively, 5.50 ± 0.93 vs 5.42 ± 0.83; P = 0.75). Success significantly decreased during clinical LP (P < 0.0001). The 2 most reported stress-related factors were fear of technical errors and personal fatigue. CONCLUSIONS: Performance scores and success rates in simulation are insufficient to predict success in clinical situations. Stress level and stress-related factors (fear of technical errors and personal fatigue) might be different in simulated or real conditions and consequently impact success of a technical procedure even if a high-performance score is recorded.

Evaluation of Learning Effectiveness After a Simulation-Based Training Pediatric Course for Emergency Physicians.

INTRODUCTION: For emergency physicians, pediatric emergencies represent rare and challenging situations. Simulation-based training (SBT) is increasingly used in medical education and recommended for implementation in the curriculum and postgraduate training. OBJECTIVES: The objective of this study was to explore the self-assessment of emergency physicians' and residents' clinical practice in pediatric emergency care after SBT. METHODS: We surveyed emergency physicians and residents who successfully took a course of Pediatric Emergency Procedures (University of Poitiers, France) between 2010 and 2015. The course included didactics 50% of the time, and simulation the other 50%. According to Kirkpatrick model, 3 levels were approached: satisfaction, learning (knowledge, skills, and attitudes), and changes in clinical practice. The main results are expressed in numbers (percentages). RESULTS: One hundred percent of the 46 included emergency physicians and residents were satisfied with the course. Sixty-nine percent agreed with the realism of low-fidelity simulation, whereas 22% disagreed. Ninety-six percent agreed with high-fidelity simulator realism. One hundred percent of responders perceived a gain in knowledge, 98% in practical skill, and 83% in improved self-confidence. Among the clinical practice changes, 91% involved anticipation, 81% procedural skills, 92% algorithms, and 79% communication and teamwork. One hundred percent expressed the wish to repeat simulation sessions at a rate of 2 ± 1 sessions per year. CONCLUSIONS: Self-assessment of the Pediatric Emergency Procedures university course was very positive. According to the participants, this type of SBT on very specific pediatric emergency cares should be integrated to the emergency resident's curriculum. As regards pediatric emergency care, particularly dealing with low-volume, high-stake procedures, the participants were favorable to further, more regular simulation training.

Nursery Assistants' Performance and Knowledge on Cardiopulmonary Resuscitation: Impact of Simulation-Based Training.

Background: Child cardiac arrest is rare, but more frequent among infants, requiring immediate cardiopulmonary resuscitation (CPR). Many studies have reported that simulation-based training (SBT) increased CPR performance of healthcare providers. However, the CPR performance of laypeople using basic life support remains poorly known. The aim of this study was to assess nursery assistants' (non-healthcare providers) CPR performance and knowledge, before and after SBT. Methods: The study was carried out from January to June 2018 in the city of Poitiers, France. Two teaching sessions (T1 and T2) and two evaluation sessions (E1 and E2) were performed. Performance in infant CPR on a manikin at E1 and E2 were videotaped and assessed automatically with Resusci Baby QCPR® and a SimPad PLUS SkillReporter (QCPR Global Score and skills) and by an observer using an original CPR performance checklist (MCPR Global-Score and skills). Nursery assistant's CPR knowledge was assessed by a questionnaire at the beginning and the end of the session T1, E1, and E2. Results: Twenty-Seven nursery assistants over 30 contacted were included. There was an improvement between E1 and E2 in QCPR Global-Score (E1: 42.4 ± 23.6 vs. E2: 55.1 ± 23.7%, p = 0.032), MCPR Global-Score (E1: 50.0+11.9 vs. E2: 72.3+8.5%; p < 0.001) and theoretical knowledge with score (over 45) of 16.9+5.4 before T1 and 35.2+2.7 after E2, respectively (p < 0.001). The improvement mainly concerned QCPR and MCPR compression steps scores. MCPR Global-Score was strongly correlated to QCPR Global-Score (r = 0.61; p < 0.01) and predictive to CPR quality determined by QCPR Global-Score (AUC = 0.77; p < 0.01) with a high sensitivity and negative predictive values. Moreover, these improvements were maintained 2 months after training with no difference between scores obtained by the three groups 15, 30, or 60 days after simulation-based training session T2. Conclusion: SBT could significantly improve knowledge and skills in infant CPR management by nursery assistants especially for chest compression. CPR performance checklist appeared as an interesting tool to assess CPR performance quality.

El efecto de las simulaciones inmersivas repetidas cada 6 semanas en la evolución del rendimiento de un equipo multidisciplinar durante un año: un ensayo controlado aleatorizado en situaciones pediátricas de riesgo vital / Immersive simulation training at 6-week intervals for 1 year and multidisciplinary team performance scores: a randomized controlled trial of simulation training for life-threatening pediatric emergencies

Objetivos. Demostrar el efecto de simulaciones inmersivas repetidas cada 6 semanas, en comparación con su repetición cada 6 meses, sobre la evolución del rendimiento de un equipo multidisciplinar en situaciones pediátricas de riesgo vital durante un año. Método. Ensayo controlado aleatorizado unicéntrico que incluyó 12 equipos multidisciplinares (EMD) del servicio de emergencias médicas (SEM) de Francia compuesto por 4 miembros (médico/residente/enfermera/conductor de ambulancia). En el grupo experimental, 6 EMD se enfrentaron a 9 escenarios diferentes de shock pediátrico en simulaciones de alta fidelidad durante un año. En el grupo de control, 6 EMD tuvieron 3 escenarios comunes a los del grupo experimental (inicial, intermedio -después de seis meses- y final -después de un año-). Se evaluó el rendimiento técnico, mediante la Team Average Performance Assessment Scale (TAPAS) y la escala de rendimiento de acceso intraóseo (IO), y el no técnico, mediante la Clinical Teamwork Scale (CTS) y la Behavioral Assessment Tool (BAT) para los líderes. Se analizó la evolución en el tiempo y se compararon los dos grupos durante los simulacros comunes. Resultados. Las puntuaciones del rendimiento se incrementaron significativamente a lo largo del tiempo en el grupo experimental (p = 0,01 para TAPAS, p = 0,008 para IO, p = 0,03 para CTS y p = 0,02 para BAT) en comparación con el grupo control (p = 0,46 para TAPAS, p = 0,55 para IO, p = 0,62 para CTS y p = 0,58 para BAT). Todas las puntuaciones fueron más altas en el grupo experimental que en el grupo control durante la última sesión (55,8 ± 6,3 vs 31,2 ± 10,3, p = 0,01 para TAPAS; 91,7 ± 8,0 vs 62,9 ± 16,2, p = 0,01 para IO, 63,2 ± 9,3 vs 47,2 ± 13,1, p = 0,03 para CTS; y 72,8 ± 5,1 vs 51,2 ± 14,3, p = 0,01 para BAT). Se observó una diferencia significativa en las dos escalas de puntuación de rendimiento técnico (p = 0,02 para TAPAS y p = 0,03 para IO) a favor del grupo experimental durante la sesión intermedia. También hubo una estrecha relación entre los rendimientos del líder y del equipo, tanto para el rendimiento no técnico (rho > 0,9) como el técnico (rho > 0,7). Conclusiones. La formación basada en la simulación debería repetirse más de tres veces al año. Nuestros resultados favorecen la repetición de una situación poco común de alto riesgo cada seis semanas para mejorar todas las escalas de puntuación de rendimiento y garantizar puntuaciones aceptables de rendimiento técnico y no técnico durante un año

Objective. To demonstrate an effect of 1 year of training using immersive simulations repeated every 6 weeks versus every 6 months to improve the performance of multidisciplinary teams (MDTs) working with children in lifethreatening situations. Methods. Randomized controlled trial in 12 MDTs of emergency responders in France. Each MDT consisted of 4 persons: a physician, a resident, a nurse, and the ambulance driver. Six MDTs participated in 9 different high-fidelity simulations of pediatric shock over the course of a year. Six control MDTs were presented with 3 of the experimental group’s simulations at 3 time points (starting point, 6 months, and 1 year). Technical performance was assessed with the Team Average Performance Assessment Scale (TAPAS) and an intraosseous (IO) access performance scale. Nontechnical performance assessment instruments were the Clinical Teamwork Scale (CTS) and, for leadership, the Behavioral Assessment Tool (BAT). Progress over time was analyzed by comparing the 2 groups during the 3 simulations they experienced in common. Results. Performance scores rose significantly over the study period in the experimental group (P=.01 for the TAPAS score, P=.008 for IO access, P=.03 for the CTS score, and P=.02 for the BAT score) but did not change in the control group (P=.46 for TAPAS, P=.55 for IO access, P=.62 for CTS, and P=.58 for BAT). All mean (SD) scores were higher in the experimental group than in the control group in the last session: TAPAS, 55.8 ± 6.3 vs 31.2 ± 10.3, P=.01; IO access, 91.7 ± 8.0 vs 62.9 ± 16.2, P=.01; CTS, 63.2 ± 9.3 vs 47.2 ± 13.1, P=.03; and BAT, 72.8 ± 5.1 vs 51.2 ± 14.3, P=.01). The 6-month assessment showed significant between-group differences on 2 technical performance measures (P=.02 for TAPAS and P=.03 for IO access); the experimental group’s scores were higher. We also observed close correlations between the performance of the leader and the group on both nontechnical (rho > 0.9) and technical (rho􀀃> 0.7) assessments. Conclusions. Simulation-based training should be repeated more than 3 times per year. Our findings suggest the advisability of repeating simulations of infrequent, high-risk scenarios every 6 weeks to improve all performance scores and guarantee acceptable technical and nontechnical performance throughout the year

Immersive simulation training at 6-week intervals for 1 year and multidisciplinary team performance scores: a randomized controlled trial of simulation training for life-threatening pediatric emergencies. / El efecto de las simulaciones inmersivas repetidas cada 6 semanas en la evolución del rendimiento de un equipo multidisciplinar durante un año: un ensayo controlado aleatorizado en situaciones pediátricas de riesgo vital.

OBJECTIVES: To demonstrate an effect of 1 year of training using immersive simulations repeated every 6 weeks versus every 6 months to improve the performance of multidisciplinary teams (MDTs) working with children in lifethreatening situations. MATERIAL AND METHODS: Randomized controlled trial in 12 MDTs of emergency responders in France. Each MDT consisted of 4 persons: a physician, a resident, a nurse, and the ambulance driver. Six MDTs participated in 9 different high-fidelity simulations of pediatric shock over the course of a year. Six control MDTs were presented with 3 of the experimental group's simulations at 3 time points (starting point, 6 months, and 1 year). Technical performance was assessed with the Team Average Performance Assessment Scale (TAPAS) and an intraosseous (IO) access performance scale. Nontechnical performance assessment instruments were the Clinical Teamwork Scale (CTS) and, for leadership, the Behavioral Assessment Tool (BAT). Progress over time was analyzed by comparing the 2 groups during the 3 simulations they experienced in common. RESULTS: Performance scores rose significantly over the study period in the experimental group (P=.01 for the TAPAS score, P=.008 for IO access, P=.03 for the CTS score, and P=.02 for the BAT score) but did not change in the control group (P=.46 for TAPAS, P=.55 for IO access, P=.62 for CTS, and P=.58 for BAT). All mean (SD) scores were higher in the experimental group than in the control group in the last session: TAPAS, 55.8 ± 6.3 vs 31.2 ± 10.3, P=.01; IO access, 91.7 ± 8.0 vs 62.9 ± 16.2, P=.01; CTS, 63.2 ± 9.3 vs 47.2 ± 13.1, P=.03; and BAT, 72.8 ± 5.1 vs 51.2 ± 14.3, P=.01). The 6-month assessment showed significant between-group differences on 2 technical performance measures (P=.02 for TAPAS and P=.03 for IO access); the experimental group's scores were higher. We also observed close correlations between the performance of the leader and the group on both nontechnical (rho > 0.9) and technical (rho > 0.7) assessments. CONCLUSION: Simulation-based training should be repeated more than 3 times per year. Our findings suggest the advisability of repeating simulations of infrequent, high-risk scenarios every 6 weeks to improve all performance scores and guarantee acceptable technical and nontechnical performance throughout the year.

OBJETIVO: Demostrar el efecto de simulaciones inmersivas repetidas cada 6 semanas, en comparación con su repetición cada 6 meses, sobre la evolución del rendimiento de un equipo multidisciplinar en situaciones pediátricas de riesgo vital durante un año. METODO: Ensayo controlado aleatorizado unicéntrico que incluyó 12 equipos multidisciplinares (EMD) del servicio de emergencias médicas (SEM) de Francia compuesto por 4 miembros (médico/residente/enfermera/conductor de ambulancia). En el grupo experimental, 6 EMD se enfrentaron a 9 escenarios diferentes de shock pediátrico en simulaciones de alta fidelidad durante un año. En el grupo de control, 6 EMD tuvieron 3 escenarios comunes a los del grupo experimental (inicial, intermedio ­después de seis meses­ y final ­después de un año­). Se evaluó el rendimiento técnico, mediante la Team Average Performance Assessment Scale (TAPAS) y la escala de rendimiento de acceso intraóseo (IO), y el no técnico, mediante la Clinical Teamwork Scale (CTS) y la Behavioral Assessment Tool (BAT) para los líderes. Se analizó la evolución en el tiempo y se compararon los dos grupos durante los simulacros comunes. RESULTADOS: Las puntuaciones del rendimiento se incrementaron significativamente a lo largo del tiempo en el grupo experimental (p = 0,01 para TAPAS, p = 0,008 para IO, p = 0,03 para CTS y p = 0,02 para BAT) en comparación con el grupo control (p = 0,46 para TAPAS, p = 0,55 para IO, p = 0,62 para CTS y p = 0,58 para BAT). Todas las puntuaciones fueron más altas en el grupo experimental que en el grupo control durante la última sesión (55,8 ± 6,3 vs 31,2 ± 10,3, p = 0,01 para TAPAS; 91,7 ± 8,0 vs 62,9 ± 16,2, p = 0,01 para IO, 63,2 ± 9,3 vs 47,2 ± 13,1, p = 0,03 para CTS; y 72,8 ± 5,1 vs 51,2 ± 14,3, p = 0,01 para BAT). Se observó una diferencia significativa en las dos escalas de puntuación de rendimiento técnico (p = 0,02 para TAPAS y p = 0,03 para IO) a favor del grupo experimental durante la sesión intermedia. También hubo una estrecha relación entre los rendimientos del líder y del equipo, tanto para el rendimiento no técnico (rho > 0,9) como el técnico (rho > 0,7). CONCLUSIONES: La formación basada en la simulación debería repetirse más de tres veces al año. Nuestros resultados favorecen la repetición de una situación poco común de alto riesgo cada seis semanas para mejorar todas las escalas de puntuación de rendimiento y garantizar puntuaciones aceptables de rendimiento técnico y no técnico durante un año.

Long-term retention assessment after simulation-based-training of pediatric procedural skills among adult emergency physicians: a multicenter observational study.

BACKGROUND: One of the primary goals of simulation-based education is to enable long-term retention of training gains. However, medical literature has poorly contributed to understanding the best timing for repetition of simulation sessions. There is heterogeneity in re-training recommendations. OBJECTIVES: This study assessed, through simulation-based training in different groups, the long-term retention of rare pediatric technical procedures. METHODS: This multicenter observational study included 107 emergency physicians and residents. Eighty-eight were divided into four groups that were specifically trained for pediatric emergency procedures at different points in time between 2010 and 2015 (< 0.5 year prior for G1, between 0.5 and 2 years prior for G2, between 2 and 4 years prior for G3, and ≥ 4 years prior for G4). An untrained control group (C) included 19 emergency physicians. Participants were asked to manage an unconscious infant using a low-fidelity mannequin. Assessment was based on the performance at 6 specific tasks corresponding to airway (A) and ventilation (B) skills. The performance (scored on 100) was evaluated by the TAPAS scale (Team Average Performance Assessment Scale). Correlation between performance and clinical level of experience was studied. RESULTS: There was a significant difference in performance between groups (p < 0.0001). For G1, 89% of the expected tasks were completed but resulted in longer delays before initiating actions than for the other groups. There was no difference between G4 and C with less than half of the tasks performed (47 and 43% respectively, p = 0.57). There was no correlation between clinical level of experience and performance (p = 0.39). CONCLUSION: Performance decreased at 6 months after specific training for pediatric emergency skills, with total loss at 4 years after training, irrespective of experience. Repetition of simulation sessions should be implemented frequently after training to improve long-term retention and the optimal rate of refresher courses requires further research.