Levels of Evidence for Hand Questions on the Orthopaedic In-Training Examination.

Background: Although analyses of the Orthopaedic In-Training Examination (OITE) subspecialty content domains have been performed, few studies have analyzed the levels of evidence (LoEs) for journal articles used as references to create OITE questions. We present an analysis of reference characteristics and question taxonomy for the hand surgery content domain on the OITE. We aim to determine whether level of evidence (LoE) for hand surgery questions have increased over a 15-year period. Methods: All questions and references in the hand surgery content domain on the OITE from 1995-1997 and 2010-2012 were reviewed. The taxonomic classification was determined for each question. Publication characteristics were defined for each reference, and each primary journal article was assigned a LoE. Results: A total of 129 questions containing 222 references met inclusion criteria: 76 questions from 1995-1997 and 53 from 2010-2012. The Journal of Hand Surgery American and European Volumes, Journal of Bone and Joint Surgery American and British Volumes, and the Journal of the American Academy of Orthopaedic Surgeons were the most frequently cited journals overall. Recent examinations were more likely to have Buckwalter T3 complex clinical management questions. There was a statically significant increase in the LoE used to create hand questions on the 2010-2012 compared with the 1995-1997 OITE. Conclusions: Primary journal articles cited on the hand surgery content domain of the OITE frequently included recent publications from both general and subspecialty journals. More recent examination questions appear to test clinical management scenarios. LoE for hand questions has increased over a 15-year period. Our results can be used as a guide to help prepare orthopedic residents for the OITE.

Levels of evidence have increased for musculoskeletal trauma questions on the orthopaedic in-training examination.

OBJECTIVE: The purpose of this study was to determine if the levels of evidence for primary journal articles used as references for musculoskeletal trauma questions on the Orthopaedic In-Training Examination (OITE) have increased over a 15-year period. DESIGN: Basic science article. SETTING: Geisinger Medical Center (Danville, PA), tertiary referral center. PARTICIPANTS: All 329 questions in the musculoskeletal trauma content domain on the OITE from 1995 to 1997 and 2010 to 2012 were reviewed. Baseline characteristics for each question and each reference were recorded. References were categorized as a textbook, a journal review article, an instructional course lecture, or a primary journal article. For each primary journal article, the level of evidence for the article was determined in accordance with the American Academy of Orthopaedic Surgeons Levels of Evidence Guidelines. RESULTS: The level of evidence used for primary journal articles demonstrated a statistically significant increase from 1995 to 1997 to 2010 to 2012. Overall, 27% of primary journal articles cited on the 1995 to 1997 OITEs were level I, II, or III studies, increasing to 43% during the 2010 to 2012 period (p = 0.04). The Buckwalter classification for the OITE questions changed significantly between the 2 periods, with questions from 2010 to 2012 including more T1 questions (25% vs 39%) and fewer T3 questions (46% vs 39%, p = 0.016). The Journal of Bone and Joint Surgery and the Journal of Orthopaedic Trauma were the most frequently cited journals overall. CONCLUSIONS: The levels of evidence for primary journal articles cited on the OITE for questions within the musculoskeletal trauma content domain have increased between 1995 and 2012. Our analysis can be used as a guide to help examinees prepare for musculoskeletal trauma questions on the OITE and as an aid in core curriculum development.