Evaluating the effectiveness of undergraduate clinical education programs.

Medical schools should use a variety of measures to evaluate the effectiveness of their clinical curricula. Both outcome measures and process measures should be included, and these can be organized according to the four-level training evaluation model developed by Donald Kirkpatrick. Managing evaluation data requires the institution to employ deliberate strategies to monitor signals in real-time and aggregate data so that informed decisions can be made. Future steps in program evaluation includes increased emphasis on patient outcomes and multi-source feedback, as well as better integration of existing data sources.

Do Voluntary Lab-Based Active Learning Sessions Impact Medical Student Knowledge Retention?

BACKGROUND: Despite recent evidence demonstrating the benefits of case-based and active learning strategies in medical education, many medical schools have reduced or entirely eliminated teaching laboratories in medical microbiology courses. The objective of our investigation was to analyze the impact of a voluntary hands-on microbiology laboratory session on students' knowledge retention and ability to apply the underlying principles to exam questions in our Introduction to Infectious Diseases (IID) course. METHODS: We compared the performance of students participating in the wet labs with those who did not, analyzing scores on exam questions directly related to the concepts presented in the laboratory session and their overall scores on the IID module exam. The voluntary nature of our microbiology lab session provided a unique opportunity to assess its impact on knowledge retention independent of other factors, such as lecture and exam content, etc. Data were collected for 7 academic years and analyzed in aggregate. RESULTS: Students who attended voluntary lab sessions scored higher on exam questions related to lab exercises than students who did not attend (Mann-Whitney, p = 0.0074). These results support the benefit of reexamining material originally presented during classroom sessions in an active, collaborative learning environment. Course evaluation responses indicted that students valued the opportunity to visually reinforce concepts they had previously read in a textbook or heard in lectures. CONCLUSIONS: At a time when many medical schools are reducing or eliminating hands-on lab sessions in microbiology and other basic sciences, our results highlight the benefits of this teaching strategy. The laboratory session provided an opportunity for students to revisit concepts initially presented in the traditional classroom setting and to actively engage in applying these concepts to case-based scenarios. The improved educational outcomes will benefit students in future standardized exams as well as in their professional practice.

Impact of Hurricane Katrina on medical student academic performance: the Tulane experience.

BACKGROUND: Hurricane Katrina forced the temporary closure of Tulane University School of Medicine requiring relocation to the Texas Medical Center in Houston, Texas. This required curricular restructuring, and resulted in faculty/student challenges. The effect of these stresses on student performance was studied. METHODS: A pre-Katrina and post-Katrina comparative analysis of all Tulane medical students' performance on standardized exams, internal examination and United States Medical Licensing Examination (USMLE) step exams was performed. A one-way analysis of variance was used to determine if mean examination scores differed from pre-Katrina to post-Katrina. RESULTS: Internal examination scores did not differ significantly. National standardized examination grades significantly decreased pre-Katrina to post-Katrina in Biochemistry, Pharmacology, Pathology, Medicine, Pediatrics and Psychiatry (P < 0.05). There was no statistical change in USMLE scores. CONCLUSIONS: Tulane students had a statistically significant decline in performance on many course and clerkship examinations, though overall performance on licensing examinations was unchanged. Many stresses may have affected students' ability to perform.