[Assessment tool's validation study for a simulation-based skin suturing skill]. / Étude de validation d'une grille d'évaluation d'un exercice de suture cutanée en simulation.

ABSTRACT

CONTEXT Health simulation is a recognized educational method for teaching and validating surgical procedural skills. The latter requires the development of adapted assessment tools, reaching different validity criteria. The aim of this study was to validate a multimodal assessment tool for a complex skin suturing exercise, combining a manual knot, an intradermal linear suturing and a needle holder tied knot. METHODOLOGY: The suturing exercise was realized on a synthetic skin model by voluntary participants after having obtained their written consent, including 9 postgraduate medical students, 40 surgical residents of different levels of experience, and a group of 9 senior surgeons. The multimodal assessment tool (MAT) combined a checklist, a speed score and a global rating scale. Each exercise was scored by two evaluators. Medical students' performances were filmed anonymously so that they could be scored iteratively. Content validity was tested through a satisfaction questionnaire randomly completed by participants. RESULTS: The MAT was considered relevant or very relevant by 98% of the participants, with a better appreciation for the checklist than for the global rating scale. Internal consistency was strong with a Cronbach α coefficient at 0.78, and a good correlation between the results of the checklist and the global rating scale (r=0.79, P<0.0001). The MAT showed continuous improvement in mean scores from 34.4±3.6 for novices to 47.4±2.5/50 points for experts, passing through three intermediate levels groups, and allowed for significant discrimination between groups. The MAT was reliable, with a coefficient of correlation set at 0.88 for intra-observer reliability, and 0.72 for inter-observer reliability. On sub score analysis, the global rating scale and the speed score better discriminated between groups than the checklist, the latter moreover showing slightly lower reliability than the global rating scale. CONCLUSION: Despite its banality in any surgeon's practice and the fact that it is taught from the 2nd cycle of medical studies, suturing and its technical components have rarely been the subject of publications dedicated to the validation of specific assessment tools. Hence, this work on the MAT and its sub scores made it possible to validate them on many validity and reliability criteria. They can therefore be proposed to surgical teachers for evaluating a complex suturing exercise, with a checklist that is easier to use even for novices and a global rating scale showing better discrimination capacity.