Scoring the computer-based case simulation component of USMLE Step 3: a comparison of preoperational and operational data.
Acad Med
; 79(10 Suppl): S62-4, 2004 Oct.
Article
en En
| MEDLINE
| ID: mdl-15383392
ABSTRACT
PURPOSE:
Operational USMLE(TM) computer-based case simulation results were examined to determine the extent to which rater reliability and regression model performance met expectations based on preoperational data.METHOD:
Operational data resulted from Step 3 examinations given between 1999 and 2004. Plots were produced using reliability and multiple correlation coefficients.RESULTS:
Operational testing reliabilities increased over the four years but were lower than the preoperational reliability. Multiple correlation coefficient results are somewhat superior to the results reported during the preoperational period and suggest that the operational scoring algorithms have been relatively consistent.CONCLUSIONS:
Changes in the rater population, changes in the rating task, and enhancements to the training procedures are several factors that can explain the identified differences between preoperational and operational results. The present findings have important implications for test development and test validity.
Buscar en Google
Colección:
01-internacional
Base de datos:
MEDLINE
Asunto principal:
Simulación por Computador
/
Competencia Clínica
/
Educación Médica
/
Evaluación Educacional
/
Licencia Médica
Tipo de estudio:
Diagnostic_studies
/
Prognostic_studies
Límite:
Humans
Idioma:
En
Revista:
Acad Med
Asunto de la revista:
EDUCACAO
Año:
2004
Tipo del documento:
Article
País de afiliación:
Estados Unidos