Assessing the Transition of Training in Health Systems Science From Undergraduate to Graduate Medical Education.

BACKGROUND: The American Medical Association Accelerating Change in Medical Education (AMA-ACE) consortium proposes that medical schools include a new 3-pillar model incorporating health systems science (HSS) and basic and clinical sciences. One of the goals of AMA-ACE was to support HSS curricular innovation to improve residency preparation. OBJECTIVE: This study evaluates the effectiveness of HSS curricula by using a large dataset to link medical school graduates to internship Milestones through collaboration with the Accreditation Council for Graduate Medical Education (ACGME). METHODS: ACGME subcompetencies related to the schools' HSS curricula were identified for internal medicine, emergency medicine, family medicine, obstetrics and gynecology (OB/GYN), pediatrics, and surgery. Analysis compared Milestone ratings of ACE school graduates to non-ACE graduates at 6 and 12 months using generalized estimating equation models. RESULTS: At 6 months both groups demonstrated similar HSS-related levels of Milestone performance on the selected ACGME competencies. At 1 year, ACE graduates in OB/GYN scored minimally higher on 2 systems-based practice (SBP) subcompetencies compared to non-ACE school graduates: SBP01 (1.96 vs 1.82, 95% CI 0.03-0.24) and SBP02 (1.87 vs 1.79, 95% CI 0.01-0.16). In internal medicine, ACE graduates scored minimally higher on 3 HSS-related subcompetencies: SBP01 (2.19 vs 2.05, 95% CI 0.04-0.26), PBLI01 (2.13 vs 2.01; 95% CI 0.01-0.24), and PBLI04 (2.05 vs 1.93; 95% CI 0.03-0.21). For the other specialties examined, there were no significant differences between groups. CONCLUSIONS: Graduates from schools with training in HSS had similar Milestone ratings for most subcompetencies and very small differences in Milestone ratings for only 5 subcompetencies across 6 specialties at 1 year, compared to graduates from non-ACE schools. These differences are likely not educationally meaningful.

Objective assessment of videoconferenced lectures in a surgical clerkship.

BACKGROUND: A challenge to the practice of third-year clerkship rotations at remote locations is the maintenance of equivalent didactic lectures, especially in subspecialty components. There has been little objective assessment of the results of videoconference lectures on medical student clerkship education. METHODS: Third-year surgical clerkship students, randomly assigned to a 4-week rotation 75 miles from the medical school, received subspecialty lectures by interactive teleconference via an ISDN line at 128 kb/s. Weekly quiz results (% correct) of students who received videoconference lectures were compared with students receiving conventional lectures, and were analyzed by 2-tailed t tests for equality of means. RESULTS: A mean of 12 students were tested per quiz (range, 5-21 students) after videoconference lectures, and 98 students were tested after conventional lectures (range, 41-146 students). The mean quiz score of students receiving video lectures was 70.5% (range, 65.4% to 73.6%); and after conventional lectures the mean quiz score was 71.4% (range, 69.5% to 76.8%). There were no significant differences in the mean scores of the individual quizzes (P = .16-.92) or between the totals (P = .65). CONCLUSIONS: Telemedicine, using interactive videoconferencing, is an effective method for didactic lectures in a surgical clerkship. This technology allows students to receive interactive lectures at distant clinical sites and limit their travel.