RESUMO
OBJECTIVES: Assessment of competence in technical skills, including point-of-care ultrasound (POCUS), is required before a novice can safely perform the skill independently. Ongoing assessment of competence is also required because technical skills degrade over time, especially when they are infrequently performed or complex. Hand-motion analysis (HMA) is an objective assessment tool that has been used to evaluate competency in many technical skills. The purpose of this study was to demonstrate the feasibility and validity of HMA as an assessment tool for competence in both simple and complex technical skills as well as skill degradation over time. METHODS: This prospective cohort study included 36 paramedics with no POCUS experience and six physicians who were fellowship trained in POCUS. The novices completed a 4-hour didactic and hands-on training program for cardiac and lung POCUS. HMA measurements, objective structured clinical examinations (OSCE), and written examinations were collected for novices immediately before and after training as well as 2 and 4 months after training. Expert HMA metrics were also recorded. RESULTS: Expert HMA metrics for cardiac and lung POCUS were significantly better than those of novices. After completion of the training program, the novices improved significantly in all HMA metrics, knowledge test scores, and OSCE scores. Novices showed skill degradation in cardiac POCUS based on HMA metrics and OSCE scores while lung POCUS image acquisition skills were preserved. Novices deemed competent by OSCE score performed significantly better in HMA metrics than those not deemed competent. CONCLUSION: We have demonstrated that HMA is a feasible and valid tool for assessment of competence in technical skills and can also evaluate skill degradation over time. Skill degradation appears more apparent in complex skills, such as cardiac POCUS. HMA may provide a more efficient and reliable assessment of technical skills, including POCUS, when compared to traditional assessment tools.
RESUMO
INTRODUCTION: Objective measures such as hand motion analysis are needed to assess competency in technical skills, including ultrasound-guided procedures. Ultrasound-guided peripheral intravenous catheter placement has many potential benefits and is a viable skill for nurses to learn. The objective of this study was to demonstrate the feasibility and validity of hand motion analysis for assessment of nursing competence in ultrasound-guided peripheral intravenous placement. METHODS: We conducted a prospective cohort study at a tertiary children's hospital. Participants included a convenience sample of nurses with no ultrasound-guided peripheral intravenous experience and experts in ultrasound-guided peripheral intravenous placement. Nurses completed hand motion analysis before and after participating in a simulation-based ultrasound-guided peripheral intravenous placement training program. Experts also completed hand motion analysis to provide benchmark measurements. After training, nurses performed ultrasound-guided peripheral intravenous placement in clinical practice and self-reported details of attempts. RESULTS: A total of 21 nurses and 6 experts participated. Prior to the hands-on training session, experts performed significantly better in all hand motion analysis metrics and procedure time. After completion of the hands-on training session, the nurses showed significant improvement in all hand motion analysis metrics and procedure time. Few nurses achieved hand motion analysis metrics within the expert benchmark after completing the hands-on training session with the exception of angiocatheter motion smoothness. In total, 12 nurses self-reported 38 ultrasound-guided peripheral intravenous placement attempts in clinical practice with a success rate of 60.5%. DISCUSSION: We demonstrated the feasibility and construct validity of hand motion analysis as an objective assessment of nurse competence in ultrasound-guided peripheral intravenous placement. Nurses demonstrated rapid skill acquisition but did not achieve expert-level proficiency.
