Interrater agreement between student and teacher assessments of endotracheal intubation skills in a self-directed simulation learning environment.

BACKGROUND: Practical skill assessment is an important part of the learning process to confirm competencies in acquired medical knowledge. OBJECTIVE: This study aimed to compare the assessments of endotracheal intubation skills using the HybridLab® methodology between students and teacher in terms of interobserver reliability. METHODS: Reliability analysis was performed with observational data (data are reported according to STROBE guidelines). The study was conducted in two countries, the Lithuanian University of Health Science (LUHS) and Pennsylvania State University (PSU) in the US, between 1 January and 30 June 2020. A total of 92 students (60 from LUHS and 32 from PSU) were trained in endotracheal intubation using an algorithm-driven hybrid learning method. At the end of the training session, the participants had to complete the evaluation scenario, which was assessed by one of the students and evaluated remotely by a single teacher. The student assessment of the endotracheal intubation procedure was compared with the teacher's assessment using correlation and estimation of the intraclass correlation coefficient. RESULTS: Overall, the medians of the student and teacher assessments were both 100% (0%). Spearman's correlation coefficient between the student and teacher assessments was 0.879 (p = 0.001). The intraclass correlation coefficient used for interobserver variations between the students and teacher was 0.883 (95% confidence interval from 0.824 to 0.923). CONCLUSIONS: The algorithm-driven hybrid learning method allows students to reliably assess endotracheal intubation skills to a level comparable with that of the teacher's evaluation. This learning method has the potential to be a cost-effective and efficient way to provide high-quality education while also saving human resources.

A novel algorithm-driven hybrid simulation learning method to improve acquisition of endotracheal intubation skills: a randomized controlled study.

BACKGROUND: Simulation-based training is a clinical skill learning method that can replicate real-life situations in an interactive manner. In our study, we compared a novel hybrid learning method with conventional simulation learning in the teaching of endotracheal intubation. METHODS: One hundred medical students and residents were randomly divided into two groups and were taught endotracheal intubation. The first group of subjects (control group) studied in the conventional way via lectures and classic simulation-based training sessions. The second group (experimental group) used the hybrid learning method where the teaching process consisted of distance learning and small group peer-to-peer simulation training sessions with remote supervision by the instructors. After the teaching process, endotracheal intubation (ETI) procedures were performed on real patients under the supervision of an anesthesiologist in an operating theater. Each step of the procedure was evaluated by a standardized assessment form (checklist) for both groups. RESULTS: Thirty-four subjects constituted the control group and 43 were in the experimental group. The hybrid group (88%) showed significantly better ETI performance in the operating theater compared with the control group (52%). Further, all hybrid group subjects (100%) followed the correct sequence of actions, while in the control group only 32% followed proper sequencing. CONCLUSIONS: We conclude that our novel algorithm-driven hybrid simulation learning method improves acquisition of endotracheal intubation with a high degree of acceptability and satisfaction by the learners' as compared with classic simulation-based training.

Development of an Innovative Nonanimal Training Model for Infant Pleural Effusion Drainage via Pigtail Catheter Placement.

BACKGROUND: Chest tube placement is an important skill for providers and bedside nurses caring for critically ill infants, allowing for the evacuation of pleural fluid and pneumothoraces. No realistic simulation models are commercially available for trainees to practice and learn this skill on infants. PURPOSE: Our objective was to develop an inexpensive and reproducible model for percutaneous pleural pigtail placement for pleural fluid removal via the Seldinger technique. METHODS: The model was developed using hardware material and a discarded infant resuscitation manikin. The rib cage was constructed using electrical cable wires. Discarded and expired 250-mL bags of intravenous fluids were placed inside the chest cavity to simulate pleural fluid. Shelf liner was wrapped around the chest and abdomen of the infant model to simulate the skin layer. Pediatric critical care faculty performed the procedure on the final model and scored it for realism and utility for teaching. Without including the discarded manikin and fluid bags, the cost of the materials for the model was less than $20. RESULTS: Eight pediatric critical care faculty tested the pleural pigtail placement model. All faculty agreed the model provides a realistic simulated reproduction of placing a pleural pigtail, felt the model was simple to use, and indicated they would use it as a teaching tool in the future. IMPLICATIONS FOR PRACTICE: An effective model for pleural pigtail placement can be inexpensively constructed using discarded bags of intravenous fluid and easy-to-find hardware materials. IMPLICATIONS FOR RESEARCH: Future studies are needed to assess whether this model helps providers and nurses develop and maintain the clinical skills for successful percutaneous pleural pigtail catheter placement.Video Abstract available at https://journals.lww.com/advancesinneonatalcare/Pages/videogallery.aspx?videoId=35&autoPlay=true.

The impact of simulation-based medical education on resident management of emergencies in pediatric anesthesiology.

BACKGROUND: Resident education in pediatric anesthesiology is challenging. Traditional curricula for anesthesiology residency programs have included a combination of didactic lectures and mentored clinical service, which can be variable. Limited pediatric medical knowledge, technical inexperience, and heightened resident anxiety further challenge patient care. We developed a pediatric anesthesia simulation-based curriculum to address crises related to hypoxemia and dysrhythmia management in the operating room as an adjunct to traditional didactic and clinical experiences. AIMS: The primary objective of this trial was to evaluate the impact of a simulation curriculum designed for anesthesiology residents on their performance during the management of crises in the pediatric operating room. A secondary objective was to compare the retention of learned knowledge by assessment at the eight-week time point during the rotation. METHODS: In this prospective, observational trial 30 residents were randomized to receive simulation-based education on four perioperative crises (Laryngospasm, Bronchospasm, Supraventricular Tachycardia (SVT), and Bradycardia) during the first week (Group A) or fifth week (Group B) of an eight-week rotation. Assessment sessions that included two scenarios (Laryngospasm, SVT) were performed in the first week, fifth week, and the eighth week of their rotation for all residents. The residents were assessed in real time and by video review using a 7-point checklist generated by a modified Delphi technique of senior pediatric anesthesiology faculty. RESULTS: Residents in Group A showed improvement between the first week and fifth week assessment as well as between first week and eighth week assessments without decrement between the fifth week and eighth week assessments for both the laryngospasm and SVT scenarios. Residents in Group B showed improvement between the first week and eighth week assessments for both scenarios and between the fifth week and eighth week assessment for the SVT scenario. CONCLUSION: This adjunctive simulation-based curriculum enhanced the learner's management of laryngospasm and SVT management and is a reasonable addition to didactic and clinical curricula for anesthesiology residents.

Pediatric anesthesiology fellow education: is a simulation-based boot camp feasible and valuable?

BACKGROUND: Pediatric anesthesiologists must manage crises in neonates and children with timely responses and limited margin for error. Teaching the range of relevant skills during a 12-month fellowship is challenging. An experiential simulation-based curriculum can augment acquisition of knowledge and skills. OBJECTIVES: To develop a simulation-based boot camp (BC) for novice pediatric anesthesiology fellows and assess learner perceptions of BC activities. We hypothesize that BC is feasible, not too basic, and well received by fellows. METHODS: Skills stations, team-based in situ simulations, and group discussions of complex cases were designed. Stations were evaluated by anonymous survey; fellows rated usefulness in improving knowledge, self-confidence, technical skill, and clinical performance using a Likert scale (1 strongly disagree to 5 strongly agree). They were also asked if stations were too basic or too short. Median and interquartile range (IQR) data were calculated and noted as median (IQR). RESULTS: Fellows reported the difficult airway station and simulated scenarios improved knowledge, self-confidence, technical skill, and clinical performance. They disagreed that stations were too basic or too short with exception of the difficult airway session, which was too short [4 (4-3)]. Fellows believed the central line station improved knowledge [4 (4-3)], technical skills [4 (4-4)], self-confidence [4 (4-3)], and clinical performance [4 (4-3)]; scores trended toward neutral likely because the station was perceived as too basic [3.5 (4-3)]. An interactive session on epinephrine and intraosseous lines was valued. Complicated case discussion was of educational value [4 (5-4)], the varied opinions of faculty were helpful [4 (5-4)], and the session was neither too basic [2 (2-2)] nor too short [2 (2-2)]. CONCLUSION: A simulation-based BC for pediatric anesthesiology fellows was feasible, perceived to improve confidence, knowledge, technical skills, and clinical performance, and was not too basic.

Using Bibliometric Analysis to Map the Impact of a Simulation Program's Published Scholarly Works.

SUMMARY STATEMENT: Bibliometrics quantitatively evaluates the targeted literature sources and can help define research and scholarly publications' impact and demonstrate connections for authors, departments, or universities. This article presents a methodology for simulation programs to evaluate their influence in terms of both impact and scope of their published simulation-based healthcare scholarly output. Using the authors' home university and healthcare system as an example, the article outlines a methodology to map research and scholarly works networks within the systems, identify and map connections outside the system, and quantifiably score the overall impact of the simulation program's scholarly output using a common scoring metric, the h-index. This generates an objective measure of impact, rather than a subjective opinion of an organization's research and scholarly impact. The combination of an institutional h-index with mapping of simulation-based healthcare scholarly output provides a full, objective description of the institution's output and provides a benchmark for other simulation programs for comparison.

Mapping the Terrain of Faculty Development for Simulation: A Scoping Review.

ABSTRACT: Understanding what interventions and approaches are currently being used to improve the knowledge, skills, and effectiveness of instructors in simulation-based education is an integral step for carving out the future of simulation. The current study is a scoping review on the topic, to uncover what is known about faculty development for simulation-based education.We screened 3259 abstracts and included 35 studies in this scoping review. Our findings reveal a clear image that the landscape of faculty development in simulation is widely diverse, revealing an array of foundations, terrains, and peaks even within the same zone of focus. As the field of faculty development in simulation continues to mature, we would hope that greater continuity and cohesiveness across the literature would continue to grow as well. Recommendations provided here may help provide the pathway toward that aim.

Artificial Intelligence and the Simulationists.

SUMMARY STATEMENT: The recent introduction of ChatGPT, an advanced, easy-to-use, and freely available artificial intelligence (AI) program, created new possibilities across many industries and professions including healthcare simulation. ChatGPT has the potential to streamline healthcare simulation-based education while also providing insights for the scenario development process that conventional case development may miss. However, there are issues related to accuracy, relevance, and structure of the products produced by the ChatGPT AI program. This article examines 2 AI-generated simulation case examples highlighting strengths and weaknesses while providing guidance on the use of ChatGPT as a simulation resource.

Evolution of the Pediatric Advanced Life Support course: enhanced learning with a new debriefing tool and Web-based module for Pediatric Advanced Life Support instructors.

OBJECTIVE: To describe the history of the Pediatric Advanced Life Support course and outline the new developments in instructor training that will impact the way debriefing is conducted during Pediatric Advanced Life Support courses. OUTLINE: The Pediatric Advanced Life Support course, first released by the American Heart Association in 1988, has seen substantial growth and change over the past few decades. Over that time, Pediatric Advanced Life Support has become the standard for resuscitation training for pediatric healthcare providers in North America. The incorporation of high-fidelity simulation-based learning into the most recent version of Pediatric Advanced Life Support has helped to enhance the realism of scenarios and cases, but has also placed more emphasis on the importance of post scenario debriefing. We developed two new resources: an online debriefing module designed to introduce a new model of debriefing and a debriefing tool for real-time use during Pediatric Advanced Life Support courses, to enhance and standardize the quality of debriefing by Pediatric Advanced Life Support instructors. In this article, we review the history of Pediatric Advanced Life Support and Pediatric Advanced Life Support instructor training and discuss the development and implementation of the new debriefing module and debriefing tool for Pediatric Advanced Life Support instructors. CONCLUSION: The incorporation of the debriefing module and debriefing tool into the 2011 Pediatric Advanced Life Support instructor materials will help both new and existing Pediatric Advanced Life Support instructors develop and enhance their debriefing skills with the intention of improving the acquisition of knowledge and skills for Pediatric Advanced Life Support students.

Part 16: education, implementation, and teams: 2010 American Heart Association Guidelines for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care.

Optimizing the links in the Chain of Survival improves outcomes and saves lives. The use of evidence-based education and implementation strategies will allow organizations and communities to strengthen these links in the most effective and efficient manner.

A novel approach to life support training using "action-linked phrases".

BACKGROUND: Observations of cardiopulmonary arrests (CPAs) reveal concerning patterns when clinicians identify a problem, (e.g. loss of pulse) but do not immediately initiate appropriate therapy (e.g. compressions) resulting in delays in life saving therapy. METHODS: We hypothesized that when individuals utilized specific, short, easy-to-state action phrases stating an observation followed by an associated intervention, there would be a higher likelihood that appropriate action would immediately occur. Phase I: A retrospective analysis of residents in simulated CPAs measured what proportion verbalized "There's no pulse", statements and/or actions that followed and whether "Action-Linked Phrases" were associated with faster initiation of compressions. Phase II: Two prospective, quasi-experimental studies evaluated if teaching three Action-Linked Phrases for Basic Life Support (BLS) courses or six Action-Linked Phrases for Advanced Cardiovascular Life Support (ACLS) courses was associated with increased use of these phrases. RESULTS: Phase I: 62% (42/68) of residents verbalized "there's no pulse" during initial assessment of a pulseless patient, and only 16/42 (38%) followed that by stating "start compressions". Residents verbalizing this Action-Linked Phrase started compressions sooner than others: (30s [IQR:19-42] vs. 150 [IQR:51-242], p < 0.001). Phase II: In BLS courses, the three Action-Linked Phrases were used more frequently in the intervention group: (226/270 [84%] vs. 14/195 [7%]; p < 0.001). In ACLS courses, the six Action-Linked Phrases were uttered more often in the intervention group: (43% [157/368] vs. 23% [46/201], p < 0.001). CONCLUSIONS: Action-Linked Phrases innately used by residents in simulated CPAs were associated with faster initiation of compressions. Action-Linked Phrases were verbalized more frequently if taught as part of a regular BLS or ACLS course. This simple, easy to teach, and easy to implement technique holds promise for impacting cardiac arrest teams' performance of key actions.

Impact of levels of simulation fidelity on training of interns in ACLS.

AIM: Identifying the modality and fidelity of simulation that offers the greatest benefit to the learner is critical to Advanced Cardiac Life Support (ACLS) training. Our hypothesis is that participants who receive ACLS training on high-fidelity mannequins will perform better than those trained on low-fidelity mannequins. METHODS: The study was performed in the context of an ACLS Initial Provider course for new postgraduate year 1 residents and involved 3 training arms: (1) low-fidelity, (2) mid-fidelity, and (3) high-fidelity. Educational outcomes were evaluated by written scores, student evaluations of the course, and expert rater reviews of megacode performance. RESULTS: A convenience sample of 54 subjects was randomized to 1 of the 3 training arms. All 3 groups significantly improved based on written posttest scores (P < 0.0001); however, pretest to posttest improvement among the 3 training arms was not significantly different: low-fidelity = 42.3 (95% CI, 35.7-48.9); mid-fidelity = 41.3 (95% CI, 34.7-47.9); high-fidelity = 40.8 (95% CI, 34.3-47.5; P = 0.95). All participants felt the simulator environment was realistic regardless of level of fidelity. Participants in the high-fidelity group were less likely to feel comfortable in the simulator environment (P = 0.0045). Clinical performance as assessed by expert raters' megacode scores was better for high-fidelity (66.3) than mid-fidelity (60.1) (P = 0.04). CONCLUSION: Overall, there was no difference among the 3 groups in test scores or perceived instructor or course quality; however, subjects trained on high-fidelity mannequins performed better than those trained on mid-fidelity with respect to megacode performance.

A qualitative analysis of faculty motivation to participate in otolaryngology simulation boot camps.

OBJECTIVES/HYPOTHESIS: To characterize factors that motivate faculty to participate in Simulation-Based Boot Camps (SBBC); to assess whether prior exposure to Simulation-Based Medical Education (SBME) or duration (years) of faculty practice affects this motivation. STUDY DESIGN: Qualitative content analysis of semi-structured interviews of faculty. METHODS: Interviews of 35 (56%) of 62 eligible faculty including demographic questions, and scripted, open-ended questions addressing motivation. Interviews were recorded, transcribed, de-identified, coded and analyzed using qualitative analysis software. Demographic characteristics were described. Emerging response categories were organized into themes contributing to both satisfaction and dissatisfaction. RESULTS: Three major themes of faculty motivation emerged: enjoyment of teaching and camaraderie; benefits to residents, patients and themselves; and opportunities to learn or improve their own patient care and teaching techniques. Expense, and time away from work and family, were identified as challenges. Faculty with many versus few years in practice revealed a greater interest in diversity of teaching experiences and techniques. Comparison of faculty with extensive versus limited simulation experience yielded similar motivations. CONCLUSION: Enjoyment of teaching; benefits to all participants; and opportunities for self-improvement emerged as themes of faculty motivation to participate in SBBC. SBBC have unique characteristics which provide an opportunity to facilitate teaching experiences that motivate faculty.

Systematic review of quality of life and other patient-centred outcomes after cardiac arrest survival.

OBJECTIVES: In cardiac arrest patients (in hospital and pre hospital) does resuscitation produce a good Quality of Life (QoL) for survivors after discharge from the hospital? METHODS: Embase, Medline, The Cochrane Database of Systematic Reviews, Academic Search Premier, the Central Database of Controlled Trials and the American Heart Association (AHA) Resuscitation Endnote Library were searched using the terms ('Cardiac Arrest' (Mesh) OR 'Cardiopulmonary Resuscitation' (Mesh) OR 'Heart Arrest' (Mesh)) AND ('Outcomes' OR 'Quality of Life' OR 'Depression' OR 'Post-traumatic Stress Disorder' OR 'Anxiety OR 'Cognitive Function' OR 'Participation' OR 'Social Function' OR 'Health Utilities Index' OR 'SF-36' OR 'EQ-5D' as text term. RESULTS: There were 9 inception (prospective) cohort studies (LOE P1), 3 follow up of untreated control groups in randomised control trials (LOE P2), 11 retrospective cohort studies (LOE P3) and 47 case series (LOE P4). 46 of the studies were supportive with respect to the search question, 17 neutral and 7 negative. DISCUSSION: The majority of studies concluded that QoL after cardiac arrest is good. This review demonstrated a remarkable heterogeneity of methodology amongst studies assessing QoL in cardiac arrest survivors. There is a requirement for consensus development with regard to quality of life and patient centred outcome assessment in this population.

Written evaluation is not a predictor for skills performance in an Advanced Cardiovascular Life Support course.

OBJECTIVE: Both a written cognitive knowledge evaluation and a practical evaluation that tests psychomotor skills, cognitive knowledge, and affective behaviors such as leadership and team skills are required for successful completion of American Heart Association (AHA) Advanced Cardiovascular Life Support (ACLS) course. The 2005 International Liaison Committee on Resuscitation (ILCOR) Consensus on Science and Treatment Recommendations noted that in Basic Life Support (BLS) there is little to no correlation between written and practical skills. The current study was conducted to determine if there is a correlation between written and practical evaluations in an ACLS course. METHODS: 34 senior nursing students from four nursing programs participated in two separate ACLS classes, completing both the written and practical evaluations. Immediately following the courses, all participants served as team leader for a video recorded simulated cardiac arrest event. A panel of expert ACLS instructors who did not participate as instructors in the courses reviewed each video and independently scored team leaders' performances. RESULTS: Spearman's rho correlation coefficient between the written test scores and practical skills performance was 0.194 (2-tailed significance=0.272). CONCLUSION: The ACLS written evaluation was not a predictor of participant skills in managing a simulated cardiac arrest event immediately following an ACLS course. The single case simulations used in ACLS skills evaluation test a narrow portion of ACLS content while written evaluation tests can more practically test a broader spectrum of content. Both work in concert to define participant knowledge and neither should be used exclusively to determine participant competence.

The effect of high-fidelity simulation on educational outcomes in an advanced cardiovascular life support course.

INTRODUCTION: The use of high-fidelity simulation has been studied in many healthcare education areas. However, the use of this instructional technology in the American Heart Association (AHA) Advanced Cardiovascular Life Support (ACLS) course has not been extensively reported, despite this program being one of the most widely taught standardized medical courses in the United States. METHODS: This study examined high-fidelity versus low-fidelity simulation in the context of an AHA ACLS course to determine subjects' educational outcomes as judged by expert raters reviewing videos of subjects performing a simulated cardiac arrest event immediately after the conclusion of the course. A purposeful sample of 34 subjects was enrolled in one of two ACLS classes. One class used high-fidelity simulation (n = 16), whereas the other used low-fidelity simulation (n = 18). RESULTS: The high-fidelity simulation group had a higher overall mean rank score on expert rater video review (M = 59.55 versus M = 44.34). This difference reached a level of statistical significance (P = 0.010, z = -2.592). On item level analysis of the instrument, 9 of 14 items reached levels of significance (P < 0.05). CONCLUSIONS: Expert raters judged students in a high-fidelity simulation-based AHA ACLS course as more competent than students in a low-fidelity course. On item level analysis, items focused on manual tasks or actions in the first 1 to 2 minutes of the cardiac arrest event were more likely to be nonsignificant. As the scenario grew longer and more complex, expert rater scores of the high-fidelity trained team leaders' confidence, knowledge, and treatment decisions were higher than the low-fidelity team leaders' score at a statistically significant level.