Collecting Validity Evidence for Simulation-Based Assessment of Point-of-Care Ultrasound Skills.
J Ultrasound Med
; 36(12): 2475-2483, 2017 Dec.
Article
en En
| MEDLINE
| ID: mdl-28646627
ABSTRACT
OBJECTIVES:
The aim of this study was to examine the validity of a simulator test designed to evaluate focused assessment with sonography for trauma (FAST) skills.METHODS:
Participants included a group of ultrasound novices (n = 25) and ultrasound experts (n = 10). All participants had their FAST skills assessed using a virtual reality ultrasound simulator. Procedural performance on the 4 FAST windows was assessed by automated simulator metrics, which received a passing or failing score. The validity evidence for these simulator metrics was examined by a stepwise approach according to the Standards for Educational and Psychological Testing. Metrics with validity evidence were included in a simulator test, and the reliability of test scores was determined. Finally, a pass/fail level for procedural performance was established.RESULTS:
Of the initial 55 metrics, 34 (61.8%) had validity evidence (P < .01). A simulator test was constructed based on the 34 metrics with established validity evidence, and test scores were calculated as percentages of the maximum score. The median simulator test scores were 14.7% (range, 0%-47.1%) and 94.1% (range, 94.1%-100%) for novices and experts, respectively (P < .001). The pass/fail level was determined to be 79.7%.CONCLUSIONS:
The performance of FAST examinations can be assessed in a simulated setting using defensible performance standards, which have both good reliability and validity.Palabras clave
Texto completo:
1
Banco de datos:
MEDLINE
Asunto principal:
Ultrasonografía
/
Competencia Clínica
/
Sistemas de Atención de Punto
Tipo de estudio:
Diagnostic_studies
/
Prognostic_studies
Límite:
Adult
/
Female
/
Humans
/
Male
/
Middle aged
Idioma:
En
Año:
2017
Tipo del documento:
Article