Society for Simulation in Healthcare Guidelines for Simulation Training.

BACKGROUND: Simulation has become a staple in the training of healthcare professionals with accumulating evidence on its effectiveness. However, guidelines for optimal methods of simulation training do not currently exist. METHODS: Systematic reviews of the literature on 16 identified key questions were conducted and expert panel consensus recommendations determined using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology. OBJECTIVE: These evidence-based guidelines from the Society for Simulation in Healthcare intend to support healthcare professionals in decisions on the most effective methods for simulation training in healthcare. RESULTS: Twenty recommendations on 16 questions were determined using GRADE. Four expert recommendations were also provided. CONCLUSIONS: The first evidence-based guidelines for simulation training are provided to guide instructors and learners on the most effective use of simulation in healthcare.

Understanding the Effects of Health Care Distance Simulation: A Systematic Review.

ABSTRACT: The use of distance simulation has rapidly expanded in recent years with the physical distance requirements of the COVID-19 pandemic. With this development, there has been a concurrent increase in research activities and publications on distance simulation. The authors conducted a systematic review of the peer-reviewed distance health care simulation literature. Data extraction and a risk-of-bias assessment were performed on selected articles. Review of the databases and gray literature reference lists identified 10,588 titles for review. Of those, 570 full-text articles were assessed, with 54 articles included in the final analysis. Most of these were published during the COVID-19 pandemic (2020-2022). None of the included studies examined an outcome higher than a Kirkpatrick level of 2. Most studies only examined low-level outcomes such as satisfaction with the simulation session. There was, however, a distinction in studies that were conducted in a learning environment where all participants were in different locations ("distance only") as compared with where some of the participants shared the same location ("mixed distance"). This review exclusively considered studies that focused solely on distance. More comparative studies exploring higher level outcomes are required to move the field forward.

Health Care Simulation in Person and at a Distance: A Systematic Review.

ABSTRACT: Distance simulation is a method of health care training in which the learners and facilitators are in different physical locations. Although methods of distance simulation have existed in health care for decades, this approach to education became much more prevalent during the COVID-19 pandemic. This systematic review studies a subset of distance simulation that includes combined in-person and distance simulation elements, identified here as "mixed- distance simulation." A review of the distance simulation literature identified 10,929 articles. Screened by inclusion and exclusion criteria, 34 articles were ultimately included in this review. The findings of this review present positive and negative aspects of mixed-distance simulation formats, a description of the most frequent configurations related to delivery, terminology challenges, as well as future directions including the need for faculty development, methodological rigor, and reporting details.

Debriefing Methods for Simulation in Healthcare: A Systematic Review.

ABSTRACT: Debriefing is a critical component in most simulation experiences. With the growing number of debriefing concepts, approaches, and tools, we need to understand how to debrief most effectively because there is little empiric evidence to guide us in their use. This systematic review explores the current literature on debriefing in healthcare simulation education to understand the evidence behind practice and clarify gaps in the literature. The PICO question for this review was defined as "In healthcare providers [P], does the use of one debriefing or feedback intervention [I], compared to a different debriefing or feedback intervention [C], improve educational and clinical outcomes [O] in simulation-based education?" We included 70 studies in our final review and found that our current debriefing strategies, frameworks, and techniques are not based on robust empirical evidence. Based on this, we highlight future research needs.

Development of Distance Simulation Educator Guidelines in Healthcare: A Delphi Method Application.

INTRODUCTION: The abrupt disruption of in-person instruction in health care during the COVID-19 pandemic resulted in the rapid adoption of distance simulation as an immediate alternative to providing in-person simulation-based education. This massive instructional shift, combined with the lack of educator training in this domain, led to challenges for both learners and educators. This study aimed to disseminate the first set of competencies required of and unique to effective distance simulation educators. METHODS: This was a multiphasic and iterative modified Delphi study validating the content of carefully and rigorously synthesized literature. Experts were invited from around the globe to participate in this study with mandatory attendance at an annual health care simulation conference to openly discuss the guidelines presented as competencies in this document. We divided each competency into "Basic" and "Advanced" levels, and agreement was sought for these levels individually. The experts provided their opinion by choosing the options of "Keep, Modify, or Delete." A free-marginal kappa of 0.60 was chosen a priori. RESULTS: At the conclusion of the Delphi process, the number of competencies changed from 66 to 59, basic subcompetencies from 216 to 196, and advanced subcompetencies from 179 to 182. CONCLUSIONS: This article provides the first set of consensus guidelines to distance simulation educators in health care, and paved the way for further research in distance simulation as a modality.

Distance simulation in the health professions: a scoping review.

BACKGROUND: Distance simulation is defined as simulation experiences in which participants and/or facilitators are separated from each other by geographic distance and/or time. The use of distance simulation as an education technique expanded rapidly with the recent COVID-19 pandemic, with a concomitant increase in scholarly work. METHODS: A scoping review was performed to review and characterize the distance simulation literature. With the assistance of an informationist, the literature was systematically searched. Each abstract was reviewed by two researchers and disagreements were addressed by consensus. Risk of bias of the included studies was evaluated using the Risk of Bias 2 (RoB 2) and Risk of Bias in Non-randomized Studies of Interventions (ROBINS-I) tools. RESULTS: Six thousand nine hundred sixty-nine abstracts were screened, ultimately leading to 124 papers in the final dataset for extraction. A variety of simulation modalities, contexts, and distance simulation technologies were identified, with activities covering a range of content areas. Only 72 papers presented outcomes and sufficient detail to be analyzed for risk of bias. Most studies had moderate to high risk of bias, most commonly related to confounding factors, intervention classification, or measurement of outcomes. CONCLUSIONS: Most of the papers reviewed during the more than 20-year time period captured in this study presented early work or low-level outcomes. More standardization around reporting is needed to facilitate a clear and shared understanding of future distance simulation research. As the broader simulation community gains more experience with distance simulation, more studies are needed to inform when and how it should be used.

Factors Associated With Improved Pediatric Resuscitative Care in General Emergency Departments.

OBJECTIVES: To describe the quality of pediatric resuscitative care in general emergency departments (GEDs) and to determine hospital-level factors associated with higher quality. METHODS: Prospective observational study of resuscitative care provided to 3 in situ simulated patients (infant seizure, infant sepsis, and child cardiac arrest) by interprofessional GED teams. A composite quality score (CQS) was measured and the association of this score with modifiable and nonmodifiable hospital-level factors was explored. RESULTS: A median CQS of 62.8 of 100 (interquartile range 50.5-71.1) was noted for 287 resuscitation teams from 175 emergency departments. In the unadjusted analyses, a higher score was associated with the modifiable factor of an affiliation with a pediatric academic medical center (PAMC) and the nonmodifiable factors of higher pediatric volume and location in the Northeast and Midwest. In the adjusted analyses, a higher CQS was associated with modifiable factors of an affiliation with a PAMC and the designation of both a nurse and physician pediatric emergency care coordinator, and nonmodifiable factors of higher pediatric volume and location in the Northeast and Midwest. A weak correlation was noted between quality and pediatric readiness scores. CONCLUSIONS: A low quality of pediatric resuscitative care, measured using simulation, was noted across a cohort of GEDs. Hospital factors associated with higher quality included: an affiliation with a PAMC, designation of a pediatric emergency care coordinator, higher pediatric volume, and geographic location. A weak correlation was noted between quality and pediatric readiness scores.

Setting an Agenda: Results of a Consensus Process on Research Directions in Distance Simulation.

BACKGROUND: The COVID-19 pandemic forced rapid implementation and refinement of distance simulation methodologies in which participants and/or facilitators are not physically colocated. A review of the distance simulation literature showed that heterogeneity in many areas (including nomenclature, methodology, and outcomes) limited the ability to identify best practice. In April 2020, the Healthcare Distance Simulation Collaboration was formed with the goal of addressing these issues. The aim of this study was to identify future research priorities in the field of distance simulation using data derived from this summit. METHODS: This study analyzed textual data gathered during the consensus process conducted at the inaugural Healthcare Distance Simulation Summit to explore participant perceptions of the most pressing research questions regarding distance simulation. Participants discussed education and patient safety standards, simulation facilitators and barriers, and research priorities. Data were qualitatively analyzed using an explicitly constructivist thematic analysis approach, resulting in the creation of a theoretical framework. RESULTS: Our sample included 302 participants who represented 29 countries. We identified 42 codes clustered within 4 themes concerning key areas in which further research into distance simulation is needed: (1) safety and acceptability, (2) educational/foundational considerations, (3) impact, and (4) areas of ongoing exploration. Within each theme, pertinent research questions were identified and categorized. CONCLUSIONS: Distance simulation presents several challenges and opportunities. Research around best practices, including educational foundation and psychological safety, are especially important as is the need to determine outcomes and long-term effects of this emerging field.

Characterizing preferred terms for geographically distant simulations: distance, remote and telesimulation.

Background: Simulationists lack standard terms to describe new practices accommodating pandemic restrictions. A standard language around these new simulation practices allows ease of communication among simulationists in various settings. Methods: We explored consensus terminology for simulation accommodating geographic separation of participants, facilitators or equipment. We used an iterative process with participants of two simulation conferences, with small groups and survey ranking. Results: Small groups (n = 121) and survey ranking (n = 54) were used with distance, remote, and telesimulation as leading terms. Each was favored by a third of the participants without consensus. Conclusion: This research has deepened our understanding of how simulationists interpret this terminology, including the derived themes: (1) physical distance/separation, (2) overarching nature of the term and (3) implications from existing terms. We further deepen the conceptual discussion on healthcare simulation aligned with the search of the terminologies. We propose there are nuances that prevent an early consensus recommendation. A taxonomy of descriptors specifying the conduct of distance, remote and telesimulation is preferred.

Formative Assessments Promote Procedural Learning and Engagement for Senior Pediatric Residents on Rotation in the Pediatric Emergency Department.

Introduction: Procedural training is a universal concern amongst pediatric residents and their teachers. We developed and implemented formative assessments to generate direct and indirect procedural feedback. We analyzed changes in residents' perceived procedural knowledge, skills, confidence, and entrustment. Methods: Senior pediatric residents rotating in the pediatric emergency department participated in video-recorded formative assessments of informed consent OSCEs and simulated toddler forehead laceration repair and infant lumbar puncture. Residents reflected on their perceived procedural knowledge, skills, confidence, and entrustment through Likert and entrustment scales. Secondary outcomes of formative assessment completion rates and proportions of procedures performed by pediatric residents tracked feasibility and potential clinical impact, respectively. Results: Including the pilot period, 89% of residents (31 out of 35) received direct and indirect procedural feedback. Perceived composite competency and entrustment improved for laceration repair (competency: from 3.1 to 3.9, p < .001; entrustment: from 4.0 to 5.1, p < .001) and lumbar puncture (competency: from 3.5 to 4.0, p < .001; entrustment: from 4.6 to 5.6, p = .001). We observed an increase in the proportion of clinical laceration repairs (11% [97 out of 885] vs. 23% [218 out of 946], p < .001) and lumbar punctures (23% [12 out of 54] vs. 41% [21 out of 52], p = .05) performed by pediatric residents. Discussion: Integrating feasible procedural formative assessments into the pediatric emergency department rotation had a positive impact on senior pediatric residents' perceptions of their procedural knowledge, skills, confidence, and entrustment and was associated with increased procedural engagement.

Visual attention during pediatric resuscitation with feedback devices: a randomized simulation study.

BACKGROUND: The aim of this study was to investigate the effect of feedback devices on visual attention and the quality of pediatric resuscitation. METHODS: This was a randomized cross-over simulation study at the Medical University of Vienna. Participants were students and neonatal providers performing four resuscitation scenarios with the support of feedback devices randomized. The primary outcome was the quality of resuscitation. Secondary outcomes were total dwell time (=total duration of visit time) on areas of interest and the workload of participants. RESULTS: Forty participants were analyzed. Overall, chest compression (P < 0.001) and ventilation quality were significantly better (P = 0.002) when using a feedback device. Dwell time on the feedback device was 40.1% in the ventilation feedback condition and 48.7% in the chest compression feedback condition. In both conditions, participants significantly reduced attention from the infant's chest and mask (72.9 vs. 32.6% and 21.9 vs. 12.7%). Participants' subjective workload increased by 3.5% (P = 0.018) and 8% (P < 0.001) when provided with feedback during a 3-min chest compression and ventilation scenario, respectively. CONCLUSIONS: The quality of pediatric resuscitation significantly improved when using real-time feedback. However, attention shifted from the manikin and other equipment to the feedback device and subjective workload increased, respectively. IMPACT: Cardiopulmonary resuscitation with feedback devices results in a higher quality of resuscitation and has the potential to lead to a better outcome for patients. Feedback devices consume attention from resuscitation providers. Feedback devices were associated with a shift of visual attention to the feedback devices and an increased workload of participants. Increased workload for providers and benefits for resuscitation quality need to be balanced for the best effect.

From Concept to Publication: Effectiveness of the International Network for Simulation-Based Pediatric Innovation, Research, and Education Project Development Process at Generating Simulation Scholarship.

BACKGROUND: As simulation matures, it is critical to develop pathways for researchers. A recent analysis, however, demonstrates a low conversion rate between abstract and peer-reviewed journal publication in our field. The International Network for Simulation-based Pediatric Innovation, Research, and Education has used the ALERT Presentation process for the past decade as a means of accelerating research. In this study, we analyze the scholarly products attributable to ALERT Presentations. METHODS: Surveys were distributed to all International Network for Simulation-based Pediatric Innovation, Research, and Education Advanced Look Exploratory Research Template (ALERT) Presentation first authors from January 2011 through January 2020. Presenters were asked to provide information on abstracts, grants, journal publications, and book chapters related to their ALERT Presentation, as well as basic demographic information. A structured literature search was conducted for those ALERT Presentations whose authors did not return a survey. The resulting database was descriptively analyzed, and statistical correlations between demographic variables and scholarship were examined. RESULTS: One hundred sixty-five new ALERT presentations were presented over 10 years. We identified 361 associated scholarly works (170 conference abstracts, 125 peer-reviewed journal publications, 65 grants, and 1 book chapter). Sixty-one percent (101 of 165) of ALERT Presentations produced at least 1 item of scholarship, and 59% (34 of 58) of ALERT Presentations that resulted in at least 1 abstract also led to at least 1 peer-reviewed journal article. Presenter gender was associated with likelihood of journal publication. CONCLUSIONS: The ALERT Presentation process is an effective approach for facilitating the development of projects that result in disseminated scholarship. Wider adoption may benefit other simulation and education research networks.

Pediatric Emergency Medicine ECHO (Extension for Community Health Care Outcomes): Cultivating Connections to Improve Pediatric Emergency Care.

BACKGROUND: An Extension for Community Health Care Outcomes (ECHO) provides the opportunity for specialists at academic medical centers (AMCs) and frontline community generalists to engage in bidirectional learning. Specialists provide generalists with the current best evidence, and generalists share the local challenges applying this evidence to their practice. All ECHO participants strategize how to navigate these challenges together. Pediatric emergency medicine (PEM) may benefit from this knowledge translation strategy because most children seek emergency care from generalists in community emergency departments (CEDs) where variations in care between the AMC and the CED have been reported. METHODS: Our objective was to use ECHO to cultivate a PEM community of practice that facilitated knowledge translation and generated future CED pediatric improvement initiatives. As such, we developed, implemented, and evaluated a PEM ECHO. We conducted general and targeted needs assessments to inform our curriculum and formatted the sessions to generate bidirectional learning. A postparticipation evaluation collected self-reported perceptions about knowledge translation, planned provider practice changes, and perceptions of the formation of a community of practice. Additionally, we solicited information on the implementation of any pediatric improvement activities attributed to the PEM ECHO. RESULTS: Thirteen 1-hour sessions covered the chosen PEM topics. Participants represented diverse CEDs, with varied experience and roles in caring for children. All respondents (13/13) appreciated the ECHO learning format, reported improved PEM knowledge, and perceived the cultivation of a community of practice. Nine (85%) individuals attributed implementation of new pediatric improvement activities to the PEM ECHO. CONCLUSIONS: Our PEM ECHO was associated with improved perceptions of PEM knowledge, cultivated a community of practice, and facilitated the implementation of CED pediatric improvement activities. The PEM ECHO's bidirectional learning format generated new initiatives and partnerships aiming to improve the emergency care of children.

Closing the gap: a call for a common blueprint for remote distance telesimulation.

The physical requirements mandated by the COVID-19 pandemic have presented a challenge and an opportunity for simulation educators. Although there were already examples of simulation being delivered at a distance, the pandemic forced this technique into the mainstream. With any new discipline, it is important for the community to agree on vocabulary, methods and reporting guidelines. This editorial is a call to action for the simulation community to start this process so that we can best describe and use this technique.

Improving Pediatric Administrative Disaster Preparedness Through Simulated Disaster Huddles.

Members of an emergency department (ED) staff need to be prepared for mass casualty incidents (MCIs) at all times. Didactic sessions, drills, and functional exercises have shown to be effective, but it is challenging to find time and resources for appropriate training. We conducted brief, task-specific drills (deemed "disaster huddles") in a pediatric ED (PED) to examine if such an approach could be an alternative or supplement to traditional MCI training paradigms. Over the course of the study, we observed an improving trend in the overall score for administrative disaster preparedness. Disaster huddles may be an effective way to improve administrative disaster preparedness in the PED. Low-effort, low-time commitment education could be an attractive way for further disaster preparedness efforts. Further studies are indicated to show a potential impact on lasting behavior and patient outcomes.

Closing the Loop: Program Description and Qualitative Analysis of a Pediatric Posttransfer Follow-up and Feedback Program.

OBJECTIVES: Follow-up and feedback foster improvement. General emergency medicine providers working in community hospitals desire follow-up and feedback on pediatric patients transferred to children's hospitals. We implemented a novel program to provide these data to our colleagues. The objective of this study was to explore stakeholder perspectives of our program. METHODS: We provided secure, electronic reports on transfers from 7 general emergency departments (GEDs). Patient follow-up and feedback data were delivered to the GED's pediatric emergency care coordinator. Seven pediatric emergency care coordinators and 2 children's hospital liaisons participated in semistructured interviews. Five researchers coded and analyzed transcribed data using the constant comparative method of grounded theory. Codes were refined and clustered to develop themes. RESULTS: Perceived values of the program included GED appreciation of closing the loop on transferred patients, providing education, and informing quality improvement. Participants valued the concise and timely nature of the reports and their empathetic delivery. Facilitators of program implementation included established professional relationships between the GED and the children's hospital liaisons and a GED's culture of self-inquiry. Barriers to program implementation included potential medicolegal exposure and the time burden for report generation and processing. Suggested programmatic improvements included focusing on generalizable, evidence-based learning points and analyzing care trends. CONCLUSIONS: Stakeholders of our pediatric posttransfer follow-up and feedback program reported many benefits and provided key suggestions that may promote successful dissemination of similar programs nationwide. Examining data trends in transferred children may focus efforts to improve the care of children across all emergency care settings.

Readiness for and Response to Coronavirus Disease 2019 Among Pediatric Healthcare Providers: The Role of Simulation for Pandemics and Other Disasters.

OBJECTIVES: Early preparation for the training and education of healthcare providers, as well as the continuation or modification of routine medical education programs, is of great importance in times of the coronavirus disease 2019 pandemic or other public health emergencies. The goal of this study was to characterize these self-reported efforts by the pediatric simulation community. DESIGN: This was a global, multicenter survey developed via a Delphi process. SETTING: International survey study. SUBJECTS: The survey was sent to 555 individual members of the three largest international pediatric simulation societies (The International Pediatric Simulation Society, International Network for Simulation-based Pediatric Innovation, Research & Education, and Netzwerk Kindersimulation e.V.) between April 27, 2020, and May 18, 2020. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Description of coronavirus disease 2019 pandemic simulation-based preparation activities of pediatric acute and critical care healthcare providers. The Delphi process included 20 content experts and required three rounds to reach consensus. The survey was completed by 234 participants (42.2%) from 19 countries. Preparation differed significantly between the geographic regions, with 79.3% of Anglo-American/Anglo-Saxon, 82.6% of Indian, and 47.1% of European participants initiating specifically coronavirus disease 2019-related simulation activities. Frequent modifications to existing simulation programs included the use of telesimulation and virtual reality training. Forty-nine percent of institutions discontinued noncoronavirus disease 2019-related simulation training. CONCLUSIONS: The swift incorporation of disease-specific sessions and the transition of standard education to virtual or hybrid simulation training modes occurred frequently. The approach used, however, depended heavily on local requirements, limitations, and circumstances. In particular, the use of telesimulation allowed education to continue while maintaining social distancing requirements.

Pediatric Readiness in the Emergency Department and Its Association With Patient Outcomes in Critical Care: A Prospective Cohort Study.

OBJECTIVES: Pediatric mortality in Latvia remains one of the highest among Europe. The purpose of this study was to assess the quality of pediatric acute care and pediatric readiness and determine their association with patient outcomes using a patient registry. DESIGN: This was a prospective cohort study. Pediatric readiness was measured using the weighted pediatric readiness score based on a 100-point scale. The processes of care were measured using in situ simulations to generate a composite quality score. Clinical outcome data-including PICU and hospital length of stay as well as 6-month mortality-were collected from the Pediatric Intensive Care Audit Network registry. The associations between composite quality score and weighted pediatric readiness score on patient outcomes were explored with mixed-effects regressions. SETTING: This study was conducted in all Latvian Emergency Departments and in the national PICU. PATIENTS: All patients who were transferred into the national PICU were included. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: All (16/16) Latvian Emergency Departments participated with a mean composite quality score of 35.3 of 100 and a median weighted pediatric readiness score of 31 of 100. A total of 254 patients were included in the study and followed up for a mean of 436 days, of which nine died (3.5%). Higher weighted pediatric readiness score was associated significantly with lower length of stay in both the PICU and hospital (adjusted ß, -0.06; p = 0.021 and -0.36; p = 0.011, respectively) and lower 6-month mortality (adjusted odds ratio, 0.93; 95% CI, 0.88-0.98). CONCLUSIONS: These data provide a national assessment of pediatric emergency care in a European country. Pediatric readiness in the emergency department was associated with patient outcomes in this population of pediatric patients transferred to the national PICU.

Stress as tool or toxin: physiologic markers and subjective report in neonatal simulation.

BACKGROUND: Cognitive appraisal of stress can influence performance. Increased awareness could facilitate titration to optimal stress levels. This study's primary aim was to investigate whether physiologic variables change with increasingly stressful simulations. Secondary aims include effect of stress on procedural competency and whether individuals recognize their experienced stress. METHODS: This was a single-center, mixed-method, simulation-based study. Participants completed three scenarios requiring resuscitation under increasingly stressful conditions. Wearable biometric devices recorded physiologic parameters. Subjects completed surveys assessing knowledge and perceived stress. Intubation success or failure was noted. Heart rate variability (HRV) analysis was used as a proxy for stress. RESULTS: Twelve participants completed the study. Survey analysis revealed progressive amplification of endorsement of affective states associated with stress. Median low frequency (LF)/high frequency (HF) ratio from scenario 1 (median = 2.29, IQR = 1.97, 3.91) was significantly lower than scenario 2 (median = 4.7, IQR = 2.32, 8.35, p = 0.04) and scenario 3 (median = 4.63, IQR = 2.2, 7.43, p = 0.04). Changes in HRV were noted during all scenarios irrespective of subjective self-assessment of stress. Procedural proficiency suffered during more stressful scenarios. CONCLUSIONS: This study demonstrates alterations in subjective assessment and objective physiologic data in simulations with increasing stress. HRV is useful as a proxy for stress response and does not always correlate with perception.

Comparison of Two Telemedicine Delivery Modes for Neonatal Resuscitation Support: A Simulation-Based Randomized Trial.

INTRODUCTION: Previous research has described technical aspects of telemedicine and the clinical impact of provider-to-patient telemedicine; however, little is known about provider-to-provider telemedical interventions. OBJECTIVE: The primary aim of this study was to compare two telemedicine delivery modes on the quality of a simulated neonatal resuscitation. Our secondary aim was to evaluate the providers' task load. METHODS: This was a prospective, single-center, randomized, simulation-based trial comparing a remote neonatal team leader ("teleleader") versus a remote consultant ("teleconsultant"). Participants resuscitated a simulated, apneic, and bradycardic neonate. Performance was assessed by video review and task load was measured by the self-reported NASA task load index (NASA-TLX) tool. In the teleleader group, one remote neonatal specialist assumed the role of team leader in the resuscitation. In the teleconsultant group, the same remote specialist assumed the role of teleconsultant. RESULTS: Twenty-two participants were included in the analyses. The teleleader group was associated with a higher overall checklist score compared to teleconsultants (median score 68%, interquartile range [IQR]: 66-69 vs. 58%, IQR: 42-62; p = 0.016). No significant difference was seen in overall subjective workload as measured by the NASA-TLX tool. However, mental demand and frustration were significantly greater with teleconsultants compared to teleleaders (mean mental demand: 14.1 vs. 17.0 out of 21; frustration: 7.9 vs. 14.7 out of 21). CONCLUSIONS: Simulated neonates randomized to teams with teleleaders received significantly better resuscitative care compared to those randomized to teams with teleconsultants. Mental demand and frustration were higher for providers in the teleconsultant compared to teleleader teams.