Retention Curves for Pediatric and Neonatal Intubation Skills After Simulation-Based Training.

OBJECTIVES: We evaluated the retention of pediatric and neonatal intubation performance abilities of clinicians trained on a simulated or live tissue model at 3 intervals after initial training to assess competency degradation related to either training modality or retention interval. METHODS: We implemented a quasi-experimental design with purposive sampling to assess performance differences between 171 subjects randomly assigned to 1 of 3 intervals after initial training: 6 weeks, 18 weeks, or 52 weeks. Training followed the American Heart Association Pediatric Advanced Life Support and Neonatal Resuscitation Program protocols with hands-on practice using 1 of 2 models (live feline or simulated feline). Assessment data were captured using validated instruments and analyzed using analysis of variance with repeated measures (statistical significance set at P < 0.05). RESULTS: Cognitive retention scores decreased significantly (P = 0.000) from posttraining cognitive scores. There were no significant differences between posttraining and retention scores for pediatric and neonatal performances. Both affect and self-efficacy retention scores decreased significantly (P = 0.000) from posttraining scores at 18 and 52 weeks, but remained constant at 6 weeks. Retention scores for all dimensions showed a significant difference between subjects with varying amounts of experience performing pediatric and neonatal intubation, such that those with more experience scored higher those with less (P < 0.003). CONCLUSIONS: Retention performance outcomes decreased sufficiently from posttraining scores to suggest that training refreshment could serve to maintain posttraining competency in the ability to perform pediatric and neonatal intubation. Retraining intervals may be best aligned with provider experience levels. Future research focusing on the effect of variable interval refresher training on retention in pediatric and neonatal intubation is merited.

Performance-based comparison of neonatal intubation training outcomes: simulator and live animal.

The purpose of this article was to establish psychometric validity evidence for competency assessment instruments and to evaluate the impact of 2 forms of training on the abilities of clinicians to perform neonatal intubation. To inform the development of assessment instruments, we conducted comprehensive task analyses including each performance domain associated with neonatal intubation. Expert review confirmed content validity. Construct validity was established using the instruments to differentiate between the intubation performance abilities of practitioners (N = 294) with variable experience (novice through expert). Training outcomes were evaluated using a quasi-experimental design to evaluate performance differences between 294 subjects randomly assigned to 1 of 2 training groups. The training intervention followed American Heart Association Pediatric Advanced Life Support and Neonatal Resuscitation Program protocols with hands-on practice using either (1) live feline or (2) simulated feline models. Performance assessment data were captured before and directly following the training. All data were analyzed using analysis of variance with repeated measures and statistical significance set at P < .05. Content validity, reliability, and consistency evidence were established for each assessment instrument. Construct validity for each assessment instrument was supported by significantly higher scores for subjects with greater levels of experience, as compared with those with less experience (P = .000). Overall, subjects performed significantly better in each assessment domain, following the training intervention (P = .000). After controlling for experience level, there were no significant differences among the cognitive, performance, and self-efficacy outcomes between clinicians trained with live animal model or simulator model. Analysis of retention scores showed that simulator trained subjects had significantly higher performance scores after 18 weeks (P = .01) and 52 weeks (P = .001) and cognitive scores after 52 weeks (P = .001). The results of this study demonstrate the feasibility of using valid, reliable assessment instruments to assess clinician competency and self-efficacy in the performance of neonatal intubation. We demonstrated the relative equivalency of live animal and simulation-based models as tools to support acquisition of neonatal intubation skills. Retention of performance abilities was greater for subjects trained using the simulator, likely because it afforded greater opportunity for repeated practice. Outcomes in each assessment area were influenced by the previous intubation experience of participants. This suggests that neonatal intubation training programs could be tailored to the level of provider experience to make efficient use of time and educational resources. Future research focusing on the uses of assessment in the applied clinical environment, as well as identification of optimal training cycles for performance retention, is merited.

A WINning Technique: The Wire-in-Needle Feasibility Study.

BACKGROUND: Dynamic ultrasound guidance reduces complications associated with central venous catheter placement. However, successful central venous cannulation often remains challenging, particularly in hypotensive patients. The new wire-in-needle (WIN) technique can further increase periprocedural safety. Here, a needle is "preloaded" with a guidewire that is then advanced toward the tip of needle. The vein is then cannulated using long-axis ultrasound guidance. OBJECTIVE: To evaluate the feasibility and safety profile of the WIN technique. METHODS: Medical students, and resident and attending physicians participated in this study. After a brief lecture and practice session on the WIN technique, they underwent a skills assessment evaluating different aspects of both techniques. Participants then completed a survey assessing their prior experience regarding procedural ultrasound, and their assessment of the WIN technique. RESULTS: Sixty clinicians participated. The assessment of both techniques revealed no significant differences in the number of needle redirections, cannulation attempts, number of arterial punctures, or overall dexterity with the procedure. The WIN technique was faster (45.9 vs. 61.5 s, p = 0.0005) than the traditional technique. More participants confirmed the accurate position of the guidewire in the vein (75% vs. 95%, p = 0.002). More than 90% of study participants met the predefined safety aspects of the WIN technique. Almost all participants reported that they plan on using the WIN technique in their clinical practice. CONCLUSION: This study demonstrates that the WIN technique can be learned quickly and easily by clinicians with various levels of training. In this study, using manikins, it was as successful and safe as the traditional short-axis approach.

Reporting Achievement of Medical Student Milestones to Residency Program Directors: An Educational Handover.

PROBLEM: Competency-based education, including assessment of specialty-specific milestones, has become the dominant medical education paradigm; however, how to determine baseline competency of entering interns is unclear-as is to whom this responsibility falls. Medical schools should take responsibility for providing residency programs with accurate, competency-based assessments of their graduates. APPROACH: A University of Michigan ad hoc committee developed (spring 2013) a post-Match, milestone-based medical student performance evaluation for seven students matched into emergency medicine (EM) residencies. The committee determined EM milestone levels for each student based on assessments from the EM clerkship, end-of-third-year multistation standardized patient exam, EM boot camp elective, and other medical school data. OUTCOMES: In this feasibility study, the committee assessed nearly all 23 EM milestones for all seven graduates, shared these performance evaluations with the program director (PD) where each student matched, and subsequently surveyed the PDs regarding this pilot. Of the five responding PDs, none reported using the traditional medical student performance evaluation to customize training, four (80%) indicated that the proposed assessment provided novel information, and 100% answered that the assessment would be useful for all incoming trainees. NEXT STEPS: An EM milestone-based, post-Match assessment that uses existing assessment data is feasible and may be effective for communicating competency-based information about medical school graduates to receiving residency programs. Next steps include further aligning assessments with competencies, determining the benefit of such an assessment for other specialties, and articulating the national need for an effective educational handover tool between undergraduate and graduate medical education institutions.

Pediatric and neonatal intubation training gap analysis: instruction, assessment, and technology.

Summary statement: Intubating adult patients presents numerous challenges for clinicians. Procedural complexities associated with performing pediatric and neonatal intubation, along with a lower frequency of a need for intubating pediatric and neonatal patients, further amplifies the difficulties associated with acquiring and maintaining relevant clinical skills. Clinicians must develop and maintain competency through training and continuing medical education. A systematic review was conducted through June 2012 to examine current instructional methods, assessment tools, and training models in pediatric and neonatal intubation training. Variability among the included literature on instruction, assessment, and models used to support training makes direct comparison problematic. The results of this review emphasize the need for improvement of current instructional methods to promote competency acquisition; development of valid, reliable assessment tools to evaluate clinician competency; and identification of a superior training model to promote acquisition and maintenance of skills associated with intubation of pediatric patients.

Establishing an emergency medicine education research network.

This project was developed from the research network track at the 2012 Academic Emergency Medicine consensus conference on education research in emergency medicine (EM). Using a combination of consensus techniques, the modified Delphi method, and qualitative research methods, the authors describe multiple aspects of developing, implementing, managing, and growing an EM education research network. A total of 175 conference attendees and 24 small-group participants contributed to discussions regarding an education research network; participants were experts in research networks, education, and education research. This article summarizes relevant conference discussions and expert opinion for recommendations on the structure of an education research network, basic operational framework, site selection, leadership, subcommittees, guidelines for authorship, logistics, and measuring success while growing and maintaining the network.