Predictors of educational outcome: factors impacting performance on a standardized clinical evaluation.

ABSTRACT

BACKGROUND: To improve student skills specific to the evaluation of radiology studies during a required clerkship in surgery for 4th-year medical students, we initiated a self-study CD-ROM educational module midway through 2000-2001. We hypothesized that student performance would improve after implementation of this module and identified factors that predicted student performance. MATERIALS AND METHODS: Students (n = 98) chose one of two hospital sites for a clerkship that focuses on the care of acutely ill surgical patients. A standardized clinical final evaluation (Objective Structured Clinical Evaluation) contained two components radiology (R score) and ICU clinical "flow sheet" interpretation (C score). We evaluated the effect of the CD-ROM educational module and other factors on student exam performance using univariate and multivariate analysis. RESULTS: The site of the clerkship and use of the CD-ROM educational module were significant factors affecting the C score identified by ANOVA; P < 0.05. With the R scores from both sites combined, performance improved by 22% from a mean of 29.2 +/- 1.1 to 35.7 +/- 1.1 with use of the module. A stepwise multiple regression analysis testing the effect of site, time of year, educational module, and a prior radiology clerkship on the R score identified that the site and CD-ROM educational module modeled performance; R(2) = 0.30, P < 0.01. The C score was affected by site (A 72.5 +/- 1.6 vs B 67.3 +/- 1.9, P < 0.05 by ANOVA). Regression analysis identified that time of year (later associated with increased score) and prior performance on the 3rd-year standardized exams (OSCE and NBME) modeled 4th-year C score; R(2) = 0.20, P < 0.01. CONCLUSIONS: In a clerkship that already emphasized faculty-facilitated case-based learning, including evaluation of radiological studies, the addition of a self-study CD-ROM radiology module significantly improved test score. This study supports the efficacy of directed self-study to improve student skills.