Development and validation of an assessment tool for adult simulated ultrasound-guided fascia iliaca block: a prospective monocentric study.

BACKGROUND: Fascia iliaca block (FIB) is an effective technique for analgesia. While FIB using ultrasound is preferred, there is no current standardised training technique or assessment scale. We aimed to create a valid and reliable tool to assess ultrasound-guided FIB. METHOD: This prospective observational study was conducted in the ABS-Lab simulation centre, University of Poitiers, France between 26-29 October and 14-17 December 2021. Psychometric testing included validity analysis and reliability between two independent observers. Content validity was established using the Delphi method. Three rounds of feedback were required to reach consensus. To validate the scale, 26 residents and 24 emergency physicians performed a simulated FIB on SIMLIFE, a simulator using a pulsated, revascularised and reventilated cadaver. Validity was tested using Cronbach's α coefficient for internal consistency. Comparative and Spearman's correlation analysis was performed to determine whether the scale discriminated by learner experience with FIB and professional status. Reliability was analysed using the intraclass correlation (ICC) coefficient and a correlation score using linear regression (R2). RESULTS: The final 30-item scale had 8 parts scoring 30 points: patient positioning, preparation of aseptic and tools, anatomical and ultrasound identification, local anaesthesia, needle insertion, injection, final ultrasound control and signs of local anaesthetic systemic toxicity. Psychometric characteristics were as follows: Cronbach's α was 0.83, ICC was 0.96 and R2 was 0.91. The performance score was significantly higher for learners with FIB experience compared with those without experience: 26.5 (22.0; 29.0) vs 22.5 (16.0; 26.0), respectively (p=0.02). There was a significant difference between emergency residents' and emergency physicians' scores: 20.5 (17.0; 25.0) vs 27.0 (26.0; 29.0), respectively (p=0.0001). The performance was correlated with clinical experience (Rho=0.858, p<0.0001). CONCLUSION: This assessment scale was found to be valid, reliable and able to identify different levels of experience with ultrasound-guided FIB.

Development and validation of the first performance assessment scale for interdisciplinary chest tube insertion: a prospective multicenter study.

PURPOSE: Chest tube insertion requires interdisciplinary teamwork including an emergency surgeon or physician in conjunction with a nurse. The purpose of the study was to validate an interdisciplinary performance assessment scale for chest tube insertion developed from literature analysis. METHODS: This prospective study took place in the simulation center of the University of Paris. The participants included untrained emergency/intensivist residents and trained novice emergency/intensivist physicians with less than 2 years of clinical experience and 6 months following training in thoracostomy, and nursing students. Each interdisciplinary pair participated in a high-fidelity simulation session. Two independent observers (O1 and O2) evaluated 61 items. Internal coherence using the Cronbach's α coefficient, intraclass correlation coefficient (ICC), and correlation of scores by regression analysis (R2) were analyzed. Comparison between O1 and O2 mean scores used a t test and F test for SDs. p Value < 0.05 was significant. RESULTS: From an initial selection of 11,277 articles, 19 were selected to create the initial scale. The final scale comprises 61 items scored out of 80, including 24 items for nursing items, 24 items for medical competence, and 13 mixed items for the competence of both. 40 simulations including 80 participants were evaluated. Cronbach's α = 0.76, ICC = 0.92, R2 = 0.88. There was no difference between the observers' assessments of means (p = 0.82) and SDs (p = 0.92). Score was 51.6 ± 5.9 in the group of untrained residents and nursing student, and 57.2 ± 2.8 in the trained group of novice physicians and nursing students (p = 0.0003). CONCLUSIONS: This first performance assessment scale for interdisciplinary chest tube insertion is valid and reliable.

Assessment of HIV-postexposure prophylaxis prescription quality after a training programme and assistance in decisions provided by a computer-based decision program: a cross-over study.

BACKGROUND: Among the tools for preventing HIV transmission, post-exposureprophylaxis (PEP) is an effective means after potential HIV exposure. OBJECTIVES: To evaluate aPEP training program and acomputer-baseddecision program (CBDP) using simulated patients in emergency department (ED) on the quality of PEP prescription. METHODS: This cross-overstudy, carried out from 7January2019 to 28June2019, included 20 ED physicians from 10 tertiary referral hospitals. Intervention consisted of two parts: Period Aassessed physicians' compliance with PEP prescription guidelines before and after atraining program, using 400 post-exposuremedical records (200 occupational and 200 non-occupational). Period Bconsisted of arandomized crossover study involving 40 simulated patients, with physicians using or not using aCBDP. Sensitivity, specificity, and accuracy of PEP prescription in accordance with the guidelines were assessed. RESULTS: In period A, alpha Cronbach was less than 0.7 whereas it increased after the training to be >0.7. Sensitivity increased, especially for occupational patients ranging from 51.8%-66.6% to 70.4%-90.1%, whereas specificity increased for non-occupationalpatients ranging from 15.5%-51.9% to 52.1%-75.3%. In period B, sensitivity, specificity, and rate of complete assessments significantly increased (p < 0.0001) after the initiation of CBDP. Rate of PEP prescription significantly decreased (p < 0.001) for all subcategories. CONCLUSION: Significant recommendations-discordantprescriptions, mainly overprescription, occurred for patients visiting ED for PEP. Training improved quality of PEP prescription but the reduction was modest. The availability of CBDP improved quality of PEP prescription and allowed for better data collection and reduction of PEP prescription.

Development of a Performance Assessment Scale for Simulated Dispatcher-Assisted Cardiopulmonary Resuscitation (Telephone-CPR): A Multi-Center Randomized Simulation-Based Clinical Trial.

INTRODUCTION: Dispatchers should be trained to interrogate bystanders with strict protocols to elicit information focused on recognizing cardiac arrest and should provide telephone cardiopulmonary resuscitation (CPR) instructions in all cases of suspected cardiac arrest. While an objective assessment of training outcomes is needed, there is no performance assessment scale for simulated dispatcher-assisted CPR. STUDY OBJECTIVE: The aim of the study was to create a valid and reliable performance assessment scale for simulated dispatcher-assisted CPR. METHODS: In this prospective, randomized, controlled, multi-centric simulation-based trial (registration number TCTR20210130002), the scale was developed according to the European Resuscitation Council (ERC) and American Heart Association (AHA) Guidelines 2015 and revised by experts. The performance of 48 dispatchers' telephone-CPR and of 48 bystanders carrying out CPR on a manikin was assessed by two independent evaluators using the scale and using a SkillReporter (PC) software to provide CPR objective performance. Continuous variables were described as mean (SD) and categorical variables as numbers and percentage (%). Comparative analysis between two groups used a Student t-test or a non-parametric test of Mann-Whitney. The internal structure of the scale was evaluated, including internal consistency using α Cronbach coefficient, and reproducibility using intraclass correlation coefficient (ICC) and linear correlation coefficient (R2) calculation. RESULTS: The scale included three different parts: two sections for dispatchers' (32 items) and bystanders' CPR performance (15 items) assessment, and a third part recording times. There was excellent internal consistency (α Cronbach coefficient = 0.77) and reproducibility (ICC = 0.93; R² = 0.86). For dispatchers' performance assessment, α Cronbach coefficient = 0.76; ICC = 0.91; R2 = 0.84. For bystanders' performance assessment, α Cronbach coefficient = 0.75; ICC = 0.93; R2 = 0.87. Reproducibility was excellent for nine items, good for 19 items, and moderate for 19 items. No item had poor reproducibility. There was no significant difference between dispatch doctors' and medical dispatch assistants' performances (33.0 [SD = 4.7] versus 32.3 [SD = 3.2] out of 52, respectively; P = .70) or between trained and untrained bystanders to follow the instructions (14.3 [SD = 2.0] versus 13.9 [SD = 1.8], respectively; P = .64). Objective performance (%) was significantly higher for trained bystanders than for untrained bystanders (67.4 [SD = 14.5] versus 50.6 [SD = 19.3], respectively; P = .03). CONCLUSION: The scale was valid and reliable to assess performance for simulated dispatcher-assisted CPR. To the authors' knowledge, no other valid performance tool currently exists. It could be used in simulated telephone-CPR training programs to improve performance.

Professional practice assessment for minor head injury management in emergency department and clinical impact of a simulation-based training: Interventional study (before/after).

BACKGROUND: Minor head injury is a frequent reason for consultation in the emergency department. The use of computed tomography (CT) has increased dramatically in patients' care. Good time management implementation and interpretation are required. To study the level of agreement with recommendations for a minor head injury in emergency department management and the impacts of simulation-based training (SBT) on professional practice changes. METHODS: Evaluation of professional practice for patient care in an emergency department according to the recommendations of the French Emergency Medicine Society (SFMU) established in 2012 before and after an SBT, including theoretical and simulation courses. It was based on the analysis of time to carry out a CT scan. It was also based on analysis of adherence to brain and spine scan indications and to hospitalization criteria. RESULTS: The SBT carried out in the evaluation of the professional practices makes it possible to acquire the notion of urgency to obtain the CT Scan within one hour when the criteria are met (p=0.007). Rater reliability for agreement with the hospitalization recommendations was better after SBT (p=0.03, increased Kappa from 0.73 to 0.93). On the other hand, there appeared to be a lack of essential information in the medical file, such as time of onset of head trauma. CONCLUSION: Management of this type of patient appeared to be satisfactory. It can be improved by SBT on the basis of the SFMU 2012 consensus conference. There is a need to improve the software used by the emergency departments, which should include the time of trauma and recommendations. The association of the clinic and the biomarkers could help to limit the indications of the CT scan, and thus to have it organized more rapidly.

Long-term retention assessment after simulation-based-training of pediatric procedural skills among adult emergency physicians: a multicenter observational study.

BACKGROUND: One of the primary goals of simulation-based education is to enable long-term retention of training gains. However, medical literature has poorly contributed to understanding the best timing for repetition of simulation sessions. There is heterogeneity in re-training recommendations. OBJECTIVES: This study assessed, through simulation-based training in different groups, the long-term retention of rare pediatric technical procedures. METHODS: This multicenter observational study included 107 emergency physicians and residents. Eighty-eight were divided into four groups that were specifically trained for pediatric emergency procedures at different points in time between 2010 and 2015 (< 0.5 year prior for G1, between 0.5 and 2 years prior for G2, between 2 and 4 years prior for G3, and ≥ 4 years prior for G4). An untrained control group (C) included 19 emergency physicians. Participants were asked to manage an unconscious infant using a low-fidelity mannequin. Assessment was based on the performance at 6 specific tasks corresponding to airway (A) and ventilation (B) skills. The performance (scored on 100) was evaluated by the TAPAS scale (Team Average Performance Assessment Scale). Correlation between performance and clinical level of experience was studied. RESULTS: There was a significant difference in performance between groups (p < 0.0001). For G1, 89% of the expected tasks were completed but resulted in longer delays before initiating actions than for the other groups. There was no difference between G4 and C with less than half of the tasks performed (47 and 43% respectively, p = 0.57). There was no correlation between clinical level of experience and performance (p = 0.39). CONCLUSION: Performance decreased at 6 months after specific training for pediatric emergency skills, with total loss at 4 years after training, irrespective of experience. Repetition of simulation sessions should be implemented frequently after training to improve long-term retention and the optimal rate of refresher courses requires further research.

A multicenter randomized control trial evaluating professional practice assessment of patient pain management after simulation training course: Study protocol.

AIMS: Pain is underestimated and insufficiently treated in Emergency Departments (ED). The primary objective of this multicenter, prospective, observational, and interventional study is to analyze the clinical impact of a simulation-based training for Emergency Nurses on pain assessment and management. Secondary objectives are to measure instructed staff's satisfaction with the simulation training and to evaluate the progress of participants as well as studying the clinical impact of this course: level of correlation between accuracy of analgesia and level of pain, assessment of patient and caregiver satisfaction. DESIGN: this study will be undertaken in EDs at two university hospitals (Paris, France: Bichat and Beaujon) with randomly selected experimental and control groups. METHODS: During the first phase, inventories in the EDs of current professional practice will be realized. Then, the control group will have theoretical classes and the experimental group will have both the theoretical class and simulation courses for all the nurses (with simulated patients in trauma pain scenarios). Post course assessment will be established of triage nurses' and other nurses' practice changes concerning trauma pain management in EDs. Moreover, this study will include an assessment of the impact on patient and caregiver satisfaction. All patients over 18 years old who are admitted to the ED for a non-vital trauma are included. Exclusion criteria are patients who are admitted by an EMS ambulance. CLINICAL IMPLICATION: this study seeks to demonstrate that the implementation of a theoretical course combined with a simulation session will improve pain management in EDs by Emergency Nurses.

Design and validation of an anatomically based assessment scale for handwashing with alcohol-based hand rub.

An anatomically based assessment scale of handwashing quality with alcohol-based hand rub was designed. Contents of the scale divided each hand into 40 zones. Psychometric measurements were studied in 30 participants (120 hand sides). The scale was both valid (Cronbach α: 0·83 dorsal side and 0·73 palmar side) and reproducible (linear regression R2, 0·91; intraclass correlation coefficient, 0·99).