RESUMEN
BACKGROUND: Traditionally, quizzes have been applied as a tool for summative assessment, though literature suggests their use as a formative assessment can improve motivation and content retention. With this premise, we implemented a series of intermittent, online quizzes known as the Board Examination Simulation Exercise (BESE). We sought to demonstrate an association between BESE participation and scores and performance on the American Board of Pediatrics (ABP) Certifying Examination (CE). METHODS: Residents were assigned online quizzes on a single topic at 2 week intervals that consisted of 20 multiple choice questions written by the study authors. This analysis includes graduates of 3 Pediatric and Internal Medicine-Pediatrics residency programs. RESULTS: Data were available for 329 residents. The overall BESE score weakly correlated with ABP CE score (n = 287; r = 0.39, p < 0.0001). ABP CE pass rates increased from 2009 to 2016 at all programs combined (p = 0.0001). A composite BESE score ≤ 11 had sensitivity of 54% and specificity of 80% for predicting ABP CE failure on the first attempt. There was no difference in ABP CE failure rates or scores by number of completed quizzes. CONCLUSION: Intermittent online quizzes implemented at three pediatric residency programs were associated with overall increasing ABP CE pass rates. BESE increased program emphasis on board preparation. Residents with lower BESE scores more often failed ABP CE. Though additional data are needed, BESE is a promising tool for pediatric resident learning and board preparation. It may also aid in earlier identification of residents at higher risk of failing the ABP CE and facilitate targeted interventions.
Asunto(s)
Certificación , Competencia Clínica/normas , Instrucción por Computador , Internado y Residencia/métodos , Pediatría/educación , Evaluación Educacional , Humanos , Pediatría/normas , Evaluación de Programas y Proyectos de Salud , Consejos de Especialidades , Estados UnidosRESUMEN
BACKGROUND: The Pediatric Nutrition Series (PNS) consists of ten online, interactive modules and supplementary educational materials that have utilized web-based multimedia technologies to offer nutrition education for pediatric trainees and practicing physicians. The purpose of the study was to evaluate pediatric trainees' engagement, knowledge acquisition, and satisfaction with nutrition modules delivered online in interactive and non-interactive formats. METHODS: From December 2010 through August 2011, pediatric trainees from seventy-three (73) different U.S. programs completed online nutrition modules designed to develop residents' knowledge of counseling around and management of nutritional issues in children. Data were analyzed using SPSS version 19. Both descriptive and inferential statistics were used in comparing interactive versus non-interactive modules. Pretest/posttest and module evaluations measured knowledge acquisition and satisfaction. RESULTS: Three hundred and twenty-two (322) pediatric trainees completed one or more of six modules for a total of four hundred and forty-two (442) accessions. All trainees who completed at least one module were included in the study. Two-way analyses of variance (ANOVA) with repeated measures (pre/posttest by interactive/non-interactive format) indicated significant knowledge gains from pretest to posttest (p < 0.002 for all six modules). Comparisons between interactive and non-interactive formats for Module 1 (N = 85 interactive, N = 95 non-interactive) and Module 5 (N = 5 interactive, N = 16 non-interactive) indicated a parallel improvement from the pretest to posttest, with the interactive format significantly higher than the non-interactive modules (p < .05). Both qualitative and quantitative data from module evaluations demonstrated that satisfaction with modules was high. However, there were lower ratings for whether learning objectives were met with Module 6 (p < 0.03) and lecturer rating (p < 0.004) compared to Module 1. Qualitative data also showed that completion of the interactive modules resulted in higher resident satisfaction. CONCLUSIONS: This initial assessment of the PNS modules shows that technology-mediated delivery of a nutrition curriculum in residency programs has great potential for providing rich learning environments for trainees while maintaining a high level of participant satisfaction.
Asunto(s)
Ciencias de la Nutrición del Niño/educación , Pediatría/educación , Niño , Instrucción por Computador/métodos , Curriculum , Evaluación Educacional , Humanos , Estudiantes de Medicina , Estados UnidosRESUMEN
With the commitment on the part of the American Osteopathic Association, the American Association of Colleges of Osteopathic Medicine, and the Accreditation Council for Graduate Medical Education to transition to a single graduate medical education accreditation system by 2020, a legitimate concern exists about the future of pediatric residency training that maintains an osteopathic focus. The authors describe a dually accredited pediatric residency program at one of the nation's largest children's hospitals, which may serve as a potential model of how to integrate a robust osteopathic-based education into a general pediatric residency program.