Retention Curves for Pediatric and Neonatal Intubation Skills After Simulation-Based Training.

OBJECTIVES: We evaluated the retention of pediatric and neonatal intubation performance abilities of clinicians trained on a simulated or live tissue model at 3 intervals after initial training to assess competency degradation related to either training modality or retention interval. METHODS: We implemented a quasi-experimental design with purposive sampling to assess performance differences between 171 subjects randomly assigned to 1 of 3 intervals after initial training: 6 weeks, 18 weeks, or 52 weeks. Training followed the American Heart Association Pediatric Advanced Life Support and Neonatal Resuscitation Program protocols with hands-on practice using 1 of 2 models (live feline or simulated feline). Assessment data were captured using validated instruments and analyzed using analysis of variance with repeated measures (statistical significance set at P < 0.05). RESULTS: Cognitive retention scores decreased significantly (P = 0.000) from posttraining cognitive scores. There were no significant differences between posttraining and retention scores for pediatric and neonatal performances. Both affect and self-efficacy retention scores decreased significantly (P = 0.000) from posttraining scores at 18 and 52 weeks, but remained constant at 6 weeks. Retention scores for all dimensions showed a significant difference between subjects with varying amounts of experience performing pediatric and neonatal intubation, such that those with more experience scored higher those with less (P < 0.003). CONCLUSIONS: Retention performance outcomes decreased sufficiently from posttraining scores to suggest that training refreshment could serve to maintain posttraining competency in the ability to perform pediatric and neonatal intubation. Retraining intervals may be best aligned with provider experience levels. Future research focusing on the effect of variable interval refresher training on retention in pediatric and neonatal intubation is merited.

Performance-based comparison of neonatal intubation training outcomes: simulator and live animal.

The purpose of this article was to establish psychometric validity evidence for competency assessment instruments and to evaluate the impact of 2 forms of training on the abilities of clinicians to perform neonatal intubation. To inform the development of assessment instruments, we conducted comprehensive task analyses including each performance domain associated with neonatal intubation. Expert review confirmed content validity. Construct validity was established using the instruments to differentiate between the intubation performance abilities of practitioners (N = 294) with variable experience (novice through expert). Training outcomes were evaluated using a quasi-experimental design to evaluate performance differences between 294 subjects randomly assigned to 1 of 2 training groups. The training intervention followed American Heart Association Pediatric Advanced Life Support and Neonatal Resuscitation Program protocols with hands-on practice using either (1) live feline or (2) simulated feline models. Performance assessment data were captured before and directly following the training. All data were analyzed using analysis of variance with repeated measures and statistical significance set at P < .05. Content validity, reliability, and consistency evidence were established for each assessment instrument. Construct validity for each assessment instrument was supported by significantly higher scores for subjects with greater levels of experience, as compared with those with less experience (P = .000). Overall, subjects performed significantly better in each assessment domain, following the training intervention (P = .000). After controlling for experience level, there were no significant differences among the cognitive, performance, and self-efficacy outcomes between clinicians trained with live animal model or simulator model. Analysis of retention scores showed that simulator trained subjects had significantly higher performance scores after 18 weeks (P = .01) and 52 weeks (P = .001) and cognitive scores after 52 weeks (P = .001). The results of this study demonstrate the feasibility of using valid, reliable assessment instruments to assess clinician competency and self-efficacy in the performance of neonatal intubation. We demonstrated the relative equivalency of live animal and simulation-based models as tools to support acquisition of neonatal intubation skills. Retention of performance abilities was greater for subjects trained using the simulator, likely because it afforded greater opportunity for repeated practice. Outcomes in each assessment area were influenced by the previous intubation experience of participants. This suggests that neonatal intubation training programs could be tailored to the level of provider experience to make efficient use of time and educational resources. Future research focusing on the uses of assessment in the applied clinical environment, as well as identification of optimal training cycles for performance retention, is merited.

Outcomes from two forms of training for first-responder competency in cholinergic crisis management.

Military and civilian first responders must be able to recognize and effectively manage mass disaster casualties. Clinical management of injuries resulting from nerve agents provides different challenges for first responders than those of conventional weapons. We evaluated the impact of a mixed-methods training program on competency acquisition in cholinergic crisis clinical management using multimedia with either live animal or patient actor examples, and hands-on practice using SimMan3G mannequin simulators. A purposively selected sample of 204 civilian and military first responders who had not previously completed nerve agent training were assessed pre- and post-training for knowledge, performance, self-efficacy, and affective state. We conducted analysis of variance with repeated measures; statistical significance p < 0.05. Both groups had significant performance improvement across all assessment dimensions: knowledge > 20%, performance > 50%, self-efficacy > 34%, and affective state > 15%. There were no significant differences between the live animal and patient actor groups. These findings could aid in the specification of training for first-responder personnel in military and civilian service. Although less comprehensive than U.S. Army Medical Research Institute of Chemical Defense courses, the training outcomes associated with this easily distributed program demonstrate its value in increasing the competency of first responders in recognizing and managing a mass casualty cholinergic event.

Pediatric and neonatal intubation training gap analysis: instruction, assessment, and technology.

Summary statement: Intubating adult patients presents numerous challenges for clinicians. Procedural complexities associated with performing pediatric and neonatal intubation, along with a lower frequency of a need for intubating pediatric and neonatal patients, further amplifies the difficulties associated with acquiring and maintaining relevant clinical skills. Clinicians must develop and maintain competency through training and continuing medical education. A systematic review was conducted through June 2012 to examine current instructional methods, assessment tools, and training models in pediatric and neonatal intubation training. Variability among the included literature on instruction, assessment, and models used to support training makes direct comparison problematic. The results of this review emphasize the need for improvement of current instructional methods to promote competency acquisition; development of valid, reliable assessment tools to evaluate clinician competency; and identification of a superior training model to promote acquisition and maintenance of skills associated with intubation of pediatric patients.

Low-hanging fruit: a clementine as a simulation model for advanced laparoscopy.

INTRODUCTION: Low-cost, high-fidelity models for training in advanced laparoscopic surgery techniques are not currently available. The objective of this study was to evaluate a model and assessment protocol for developing associated fine, precise laparoscopic dissection skills with accompanying surgical decision making. METHODS: Novice to expert laparoscopists (n = 41) were asked to remove the peel of a clementine in as few pieces as possible, separate and remove all albedo from and between all fruit segments, and return the clementine to as close to its natural state as possible with completely closed skin (sutured). Clinical decision making included deciding when unacceptable segment damage would result by removing difficult-to-extract albedo, analogous to treating lesions or metastases through other methods, rather than risking damage to vital anatomic structures. Faculty assessed deidentified video-recorded performances. Data analyses included analysis of variance with Bonferroni post hoc. RESULTS: A single-performance construct (operative ability) with 2 scoring dimensions (surgical skills and clinical judgment) was confirmed through factor analysis. There were significant performance differences between all experience levels (F2,41 = 59.175, P < 0.000). There were no statistical time differences between the groups. CONCLUSIONS: Validation of this low-cost, easily facilitated model for developing advanced laparoscopic surgical skills may support the preparation of residents and fellows and provide a platform for skill acquisition, assessment, and basic critical thinking for performing laparoscopic tasks.