Professional Assessment Tool for Team Improvement: An assessment tool for paediatric intensive care unit nurses' technical and nontechnical skills.

BACKGROUND: Cardiorespiratory arrests are rare in paediatric intensive care units, yet intensive care nurses must be able to initiate resuscitation before medical assistance is available. For resuscitation to be successful, instant decision-making, team communication, and the coordinating role of the first responsible nurse are crucial. In-house resuscitation training for nurses includes technical and nontechnical skills. OBJECTIVES: The aim of this study was to develop a valid, reliable, and feasible assessment instrument, called the Professional Assessment Tool for Team Improvement, for the first responsible nurse's technical and nontechnical skills. METHODS: Instrument development followed the COnsensus-based Standards for the selection of health Measurement Instruments guidelines and professionals' expertise. To establish content validity, experts reached consensus via group discussions about the content and the operationalisation of this team role. The instrument was tested using two resuscitation assessment scenarios. Inter-rater reliability was established by assessing 71 nurses in live scenario sessions and videotaped sessions, using intraclass correlation coefficients and Cohen's kappa. Internal consistency for the total instrument was established using Cronbach's alpha. Construct validity was assessed by examining the associations between raters' assessments and nurses' self-assessment scores. RESULTS: The final instrument included 12 items, divided into four categories: Team role, Teamwork and communication, Technical skills, and Reporting. Intraclass correlation coefficients were good in both live and videotaped sessions (0.78-0.87). Cronbach's alpha was stable around 0.84. Feasibility was approved (assessment time reduced by >30%). CONCLUSIONS: The Professional Assessment Tool for Team Improvement appears to be a promising valid and reliable instrument to assess both technical and nontechnical skills of the first responsible paediatric intensive care unit nurse. The ability of the instrument to detect change over time (i.e., improvement of skills after training) needs to be established.

Effectiveness of Simulation Training and Assessment of PICU Nurses' Resuscitation Skills: A Mixed Methods Study from the Netherlands.

PURPOSE: The quality of resuscitation and effective leadership are decisive for the outcome of a resuscitation. Nurses are usually the first responders upon cardiac arrest. Therefore, we started the "proficiency check" project, which aims to improve nurses' resuscitation and teamwork skills. This article describes the effectiveness of the proficiency check and nurses' experiences with it. DESIGN AND METHODS: This study was done among intensive care nurses working on a pediatric ICU (PICU) in the Netherlands. It was designed as a mixed-methods study combining a quantitative and a qualitative approach. Quantitative data were obtained through a pre-posttest comparison of nurses' resuscitation and teamwork skills, in a simulation setting. Qualitative data on nurses' experiences were collected through semi-structured individual interviews. RESULTS: Both resuscitation and teamwork skills improved significantly. In 39 nurses (32%), the improvement of both resuscitation and teamwork skills after the intervention was large (effect size >0.8). The experiences of nurses regarding the proficiency check were diverse: on the positive side, increased knowledge and confidence were reported, whereas negative experiences related, among other things, to stress and anxiety. CONCLUSIONS: Resuscitation and teamwork skills of PICU nurses can be enhanced by the 'proficiency check' studied here. This simulation-based training can be further improved by incorporating the nurses' experiences. PRACTICE IMPLICATIONS: A simulation-based assessment for resuscitation may play an important role in a PICU, and possibly for other skills and in other settings as well. Particular attention should be paid to the stress that many nurses experience due to skills assessment.