RESUMO
BACKGROUND: The graduate medical education community uses results from the United States Medical Licensing Examination (USMLE) to inform decisions about individuals' readiness for postgraduate training. OBJECTIVE: We sought to determine the relationship between performance on the USMLE and the American Board of Anesthesiology (ABA) Part 1 Certification Examination using a national sample of examinees, and we considered the relationship in the context of undergraduate medical education location and examination content. METHODS: Approximately 7800 individuals met inclusion criteria. The relationships between USMLE scores and ABA Part 1 pass rates were examined, and predictions for the strength of the relationship between USMLE content areas and ABA performance were compared with observed relationships. RESULTS: Pearson correlations between ABA Part 1 scores and USMLE Steps 1, 2 (clinical knowledge), and 3 scores for first-taker US/Canadian graduates were .59, .56, and .53, respectively. A clear relationship was demonstrated between USMLE scores and pass rates on ABA Part 1, and content experts were able to successfully predict the USMLE content categories that would least or most likely relate to ABA Part 1 scores. CONCLUSIONS: The analysis provided evidence on a national scale that results from the USMLE and the ABA Part 1 were correlated and that success on the latter examination was associated with level of USMLE performance. Both testing programs have been successful in conceptualizing many of the knowledge areas of interest and in developing test content to reflect those areas.
RESUMO
BACKGROUND: Currently, residency programs lack objective predictors for passing the sequenced American Board of Anesthesiology (ABA) certification examinations on the first attempt. Our hypothesis was that performance on the ABA/American Society of Anesthesiologists In-Training Examination (ITE) and other variables can predict combined success on the ABA Part 1 and Part 2 examinations. METHOD: The authors studied 2,458 subjects who took the ITE immediately after completing the first year of clinical anesthesia training and took the ABA Part 1 examination for primary certification immediately after completing residency training 2 yr later. ITE scores and other variables were used to predict which residents would complete the certification process (passing the ABA Part 1 and Part 2 examinations) in the shortest possible time after graduation. RESULTS: ITE scores alone accounted for most of the explained variation in the desired outcome of certification in the shortest possible time. In addition, almost half of the observed variation and most of the explained variance in ABA Part 1 scores was accounted for by ITE scores. A combined model using ITE scores, residency program accreditation cycle length, country of medical school, and gender best predicted which residents would complete the certification examinations in the shortest possible time. CONCLUSIONS: The principal implication of this study is that higher ABA/ American Society of Anesthesiologists ITE scores taken at the end of the first clinical anesthesia year serve as a significant and moderately strong predictor of high performance on the ABA Part 1 (written) examination, and a significant predictor of success in completing both the Part 1 and Part 2 examinations within the calendar year after the year of graduation from residency. Future studies may identify other predictors, and it would be helpful to identify factors that predict clinical performance as well.