SQUIRE-SIM (Standards for Quality Improvement Reporting Excellence for SIMulation): Publication Guidelines for Simulation-Based Quality Improvement Projects.

INTRODUCTION: With increased incorporation of simulation-based methodologies into quality improvement activities, standards for reporting on simulation-specific elements in healthcare improvement research are needed. METHODS: We followed established consensus process methodology to iteratively create simulation-based extensions for SQUIRE 2.0 reporting guidelines. Initial steps involved forming a steering committee, defining the scope, and conducting premeeting activities with an expert panel of simulation and quality improvement researchers. Recommendations from the expert panel were brought to a consensus meeting where existing guidelines were reviewed and recommendations made. Steering Committee members reviewed all recommendations, reconciled differences, and made final recommendations, which were piloted by experienced simulation and quality improvement researchers. RESULTS: Fifteen Steering Committee members, 59 experts in simulation and quality improvement research, and 86 consensus meeting attendees reviewed SQUIRE 2.0 reporting guidelines and ultimately recommended simulation-based reporting guidelines for 22 of the 41 (54%) SQUIRE 2.0 guidelines. Those items for which simulation-based extensions were identified were: Notes to Authors, 1 (Title), 2a (Abstract), 2b (Abstract), 4 (Introduction: Available knowledge), 5 (Introduction: Rationale), 7 and 8a & b (Methods: Context and intervention), 9a (Methods - Study of the intervention), 9b (Methods - Study of the intervention), 10a (Methods - Measures), 10b (Methods-Measures), 10c (Methods-Measures), 11b (Methods- Analysis), 12 (Methods - Ethical considerations), 13a (Results), 13e (Results), 14b (Discussion - Summary), 15a-e (Discussion - Interpretation), 16a (Discussion - Limitations), 16b (Discussion - Limitations), 17c (Discussion - Conclusions), and 17d (Discussion - Conclusions). CONCLUSIONS: We created simulation-based extensions to SQUIRE 2.0 reporting guidelines to improve the quality and standardization of reporting on simulation-specific elements of healthcare improvement research.

Development and Validation of a Trauma-Informed Care Communication Skills Assessment Tool.

BACKGROUND: Trauma-informed care (TIC) is growing in medical education as health care systems recognize trauma's impact on health outcomes. TIC acknowledges and responds to the effects of trauma on physical, psychological, and emotional health. As TIC trainings are developed and delivered to health care professionals across the learner continuum, curricula need evaluation beyond learner satisfaction and knowledge to better assess changes in skills. We developed the Gap Kalamazoo Communication Skills Assessment Form for Trauma-Informed Care (GKCSAF-TIC) to evaluate pediatric trainees' communication skills in TIC. We describe the development and validity evidence of the GKCSAF-TIC in assessing pediatric residents' TIC skills during standardized patient encounters. METHODS: We developed and implemented the TIC communication skills assessment tool in a one-year prospective cohort study involving pediatric residents. We conducted simulated patient encounters conducted before and after TIC training, with two pediatric faculty attendings assessing each encounter. We gathered validity evidence using Messick's framework, focusing on content, response process, internal structure, and relationship with other variables. RESULTS: We analyzed 57 standardized patient encounters with 33 pediatric interns, including 23 pre-post matched pairs. The development process and rater training supported content and response process validity. Internal consistency, measured by Cronbach's alpha, ranged from 0.93 to 0.96, while inter-rater reliability, measured by intraclass correlations, ranged from 0.80 to 0.83. There was a significant improvement in scores from pre-training to post-training (3.7/5 to 4.05/5; P < 0.05). CONCLUSION: The GKCSAF-TIC demonstrated strong preliminary validity and offers educators a valuable means to assess and provide formative feedback to pediatric trainees about TIC.

Developing a generalizable pediatric ECMO emergency checklist for clinical specialist: Progress and challenges.

INTRODUCTION: Extracorporeal membrane oxygenation (ECMO) emergencies require skilled clinical specialist (CS) who manage ECMO circuits. While tools for assessing CS skills have been published, there is significant variation in protocols and circuit design. This study aims to further develop these checklists to produce a generalizable ECMO skill assessment with adequate validity evidence to support its use as a summative evaluation tool. METHODS: An initial survey determined variation in ECMO circuit components and configurations, and the original checklists and simulations were altered through a modified Delphi process. The finalized checklist and simulation were then assessed for validity and reliability. Three trained raters assessed ten simulations from five subjects at two different institutions using two circuit designs. Data analysis was conducted using a fully crossed subject x rater x circuit generalizability (G) and decision (D) study. RESULTS: The G-study coefficient was 0 with 0% variance across subject and circuit. The greatest variance was among raters (28.7%). Significant variance was also associated with the subject and pump type relationship (27%). CONCLUSION: Despite the rigorous process used to modify the assessment, generalizability was poor. Lack of familiarity with center-specific circuit design played a key role. Future endeavors in ECMO skill assessment should focus either on developing and validating site-specific tools or standardizing circuit designs.

Society for Simulation in Healthcare Guidelines for Simulation Training.

BACKGROUND: Simulation has become a staple in the training of healthcare professionals with accumulating evidence on its effectiveness. However, guidelines for optimal methods of simulation training do not currently exist. METHODS: Systematic reviews of the literature on 16 identified key questions were conducted and expert panel consensus recommendations determined using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology. OBJECTIVE: These evidence-based guidelines from the Society for Simulation in Healthcare intend to support healthcare professionals in decisions on the most effective methods for simulation training in healthcare. RESULTS: Twenty recommendations on 16 questions were determined using GRADE. Four expert recommendations were also provided. CONCLUSIONS: The first evidence-based guidelines for simulation training are provided to guide instructors and learners on the most effective use of simulation in healthcare.

Educational and Patient Care Impacts of In Situ Simulation in Healthcare: A Systematic Review.

ABSTRACT: This systematic review was performed to assess the effectiveness of in situ simulation education. We searched databases including MEDLINE and Embase for studies comparing in situ simulation with other educational approaches. Two reviewers screened articles and extracted information. Sixty-two articles met inclusion criteria, of which 24 were synthesized quantitatively using random effects meta-analysis. When compared with current educational practices alone, the addition of in situ simulation to these practices was associated with small improvements in clinical outcomes, including mortality [odds ratio, 0.66; 95% confidence interval (CI), 0.55 to 0.78], care metrics (standardized mean difference, -0.34; 95% CI, -0.45 to -0.21), and nontechnical skills (standardized mean difference, -0.52; 95% CI, -0.99 to -0.05). Comparisons between in situ and traditional simulation showed mixed learner preference and knowledge improvement between groups, while technical skills showed improvement attributable to in situ simulation. In summary, available evidence suggests that adding in situ simulation to current educational practices may improve patient mortality and morbidity.