An updated analysis of shoulder and elbow questions on the Orthopedic In-Training Examination.

BACKGROUND: The Orthopedic In-Training Examination (OITE) is an annual examination for orthopedic surgery residents used to assess orthopedic knowledge across a national standard. Having an updated understanding of currently tested topics and resources is useful to help residents guide their education. PURPOSE: The purpose of this study is to analyze the shoulder and elbow domain of the OITE in an effort to provide current trends and commonly tested topics. METHODS: All OITE questions related to shoulder and elbow topics over the years 2009-2013 and 2017-2020 were analyzed. Subcategories, the number and types of references used, publication lag time, imaging modalities, taxonomic classification, and resident performance were recorded. RESULTS: Shoulder and elbow topics comprised 8.61% of all OITE questions from 2009-2013 and 2017-2020. The most commonly tested shoulder topics were rotator cuff arthropathy and reverse total shoulder arthroplasty (13.6%), followed by hemiarthroplasty and total shoulder arthroplasty (12.9%), rotator cuff-related pathology (12.9%), anterior shoulder instability and/or dislocation (10.2%), and general anatomy (10.2%). The most commonly tested elbow topics were trauma (21%), ulnar collateral ligament injuries (12.12%), general anatomy (10%), and arthroplasty (10%). Decisions regarding management or appropriate next steps (taxonomy T3) comprised 39% of all question types. The incorporation of imaging modalities continues to be an important component of the OITE questions. The Journal of Shoulder and Elbow Surgery (JSES), the Journal of the American Academy of Orthopedic Surgeons (JAAOS), the Journal of Bone and Joint Surgery (JBJS), and the American Journal of Sports Medicine (AJSM) comprised 65% of articles referenced in all questions over our analysis period. CONCLUSION: This study provides an updated analysis of trends within the shoulder and elbow domain of the OITE. Application of these data can aid residents in their preparation for the examination.

Analysis of Hip and Knee Reconstruction Questions on the Orthopedic In-Training Examination.

BACKGROUND: It is vital for orthopedic residents and residency programs to have a current understanding of the materials and resources utilized on the Orthopedic In-Training Examination (OITE) to tailor resident educational curricula accordingly. This study presents an updated analysis of the hip and knee section of the OITE. METHODS: All OITE questions related to hip and knee reconstruction over six examinations between 2014 and 2019 were analyzed for topic, subtopic, taxonomy, imaging modalities, resident performance, and references. RESULTS: There were 166 hip and knee reconstruction questions of 1600 OITE questions (10.4%) over a six-year period. The most commonly tested topics include mechanical properties of total knee and hip implants (10.8%), instability after THA (10.8%), periprosthetic fracture (10.2%), and prosthetic joint infection (10.2%). A total of 362 references were cited from 68 different sources. The most common sources were JOA, JBJS, JAAOS, and CORR, which were collectively responsible for 68% of all citations. There was an average publication lag of 7.1 years, with 75% of all citations falling within 10 years of the question date. Compared with a prior analysis from 2005 and 2009, there were significantly more complex multistep questions regarding treatment and fewer one-step knowledge recall questions (P = .003). Similarly, recent tests had significantly more questions involving interpretation of radiographs (55%, P < .001) and advanced imaging (9.6%, P < .001), compared with a decade ago. CONCLUSIONS: The OITE continues to evolve over time, incorporating recent literature and topics. The current analysis identifies high-yield topics and resources that can guide resident preparation for the OITE hip and knee section.

Updated Analysis of the Oncology Section of the OITE from 2007 to 2019.

The Orthopaedic In-Training Exam (OITE) is administered annually to orthopedic surgery residents to assess their medical knowledge. The authors provide a comprehensive review of the orthopedic oncology portion of the exam in order to aid residents in preparation for future in-training and licensing examinations as well as to help guide oncology residency education curriculum. All of the orthopedic oncology questions on the OITE from 2007 to 2019 were reviewed. Analysis included (1) the number of oncology questions each year, (2) question topic, (3) question taxonomy (knowledge versus interpretation), (4) the type of imaging modalities (radiological, histological), (5) most commonly cited references, and (6) level of evidence. Descriptive statistics were utilized to compare means between variables. From 2007 to 2019, there was a total of 292 tumor-related questions with a mean of 22.5 tumor-related questions (range 19-28) per year. Of the questions, 54.8% pertained to malignant tumors and 45.2% to benign tumors. Assessment of question taxonomy showed that 79.8% of questions required interpretation of imaging and analysis of the information provided versus 20.2% of questions being knowledge recall type. Of the questions, 76.7% required interpretation of radiological images, pathological images, or both. Orthopaedic Knowledge Update, Journal of the American Academy of Orthopaedic Surgeons, and Journal of Bone and Joint Surgery were the three most commonly cited question sources. Only 29 (9.84%) oncology questions over the past 13 years have been supported by level I or II sources of evidence. Better understanding of the OITE make-up, question distribution, and number and style of question, reference sources can improve an orthopedic residents' performance as well as better guide educational curriculum to prepare residents in their orthopedic oncology education.

Orthopedic Oncology Experience During Residency.

The objective of this study was to determine the characteristics and logistics of orthopedic oncology rotations at various residency programs across the USA and determine the effect of orthopedic oncology rotations on Orthopedic In-Training Examination (OITE) scores. An eight-question survey was sent to 162 orthopedic surgery residency programs obtained from the Accreditation Council for Graduate Medical Education public database. Pre-oncology rotation and post-oncology rotation OITE scores for 24 residents at a major academic medical center were collected and analyzed. The response rate was 43.8%. Survey results were as follows: 90.1% responded positively to having a dedicated orthopedic oncology rotation in their curriculum; 49.3% carried out their oncology rotation at a hospital outside of their home institution; 70.4% of programs had only one dedicated orthopedic oncology rotation throughout residency; 42.3% indicated that residents experience 6-10 weeks of dedicated orthopedic oncology training during the 5-year residency program; 42.2% indicated that residents experience oncology rotations during post-graduate year 4; and 80.3% of programs had orthopedic oncology trained surgeons on their faculty. The mean increase in OITE oncology scores after the rotation was 12.1% (p = 0.005). There are variations in orthopedic oncology curricula across residency programs, most notably in the number of weeks residents participate in a dedicated oncology rotation, the post-graduate year that residents rotate on an oncology service, and the location where residents obtain their orthopedic oncology training. Participating in a dedicated orthopedic oncology rotation resulted in significant improvement in scores on the oncology domain of the OITE.

Hand Surgery Questions on the Orthopaedic In-Training Examination: Analysis of Content and Reference.

PURPOSE: To provide an updated analysis of the hand surgery section of the Orthopaedic In-Training Examination (OITE) from 2009 to 2015. The goal was to contribute to the existing literature on the analysis of OITE questions, to aid both residents and residency programs in preparation for the OITE and board examination. METHODS: The authors analyzed all OITE questions pertaining to hand surgery between 2009 and 2015. Hand questions were analyzed for category and subcategory of content, cited reference, treatment intervention, and imaging modality used. RESULTS: Hand-related questions comprised 157 of the 1,872 OITE questions (8.4%). Nine general topic areas were identified, the most common of which were fracture-dislocation, tendon/ligament, nerve, congenital, and amputation. Trends existed in the recommended references; the 5 journals and 2 textbooks that were consistently cited included the Journal of Hand Surgery (American Volume), the Journal of the American Academy of Orthopaedic Surgeons, the Journal of Bone and Joint Surgery (American Volume), the Journal of Hand Surgery (European Volume), Hand Clinics, Orthopaedic Knowledge Update, and Green's Operative Hand Surgery, respectively. CONCLUSIONS: Knowledge regarding topics and resources used for OITE hand questions could be mutually beneficial to both residents and residency programs. This information would consolidate resident OITE and board examination study time. Furthermore, this analysis could help residency programs develop or improve educational conferences and journal clubs. CLINICAL RELEVANCE: An understanding of question content and sources should enable efficient learning and improved scores on this section of the examination.

Generative Artificial Intelligence Performs at a Second-Year Orthopedic Resident Level.

Introduction Artificial intelligence (AI) models using large language models (LLMs) and non-specific domains have gained attention for their innovative information processing. As AI advances, it's essential to regularly evaluate these tools' competency to maintain high standards, prevent errors or biases, and avoid flawed reasoning or misinformation that could harm patients or spread inaccuracies. Our study aimed to determine the performance of Chat Generative Pre-trained Transformer (ChatGPT) by OpenAI and Google BARD (BARD) in orthopedic surgery, assess performance based on question types, contrast performance between different AIs and compare AI performance to orthopedic residents. Methods We administered ChatGPT and BARD 757 Orthopedic In-Training Examination (OITE) questions. After excluding image-related questions, the AIs answered 390 multiple choice questions, all categorized within 10 sub-specialties (basic science, trauma, sports medicine, spine, hip and knee, pediatrics, oncology, shoulder and elbow, hand, and food and ankle) and three taxonomy classes (recall, interpretation, and application of knowledge). Statistical analysis was performed to analyze the number of questions answered correctly by each AI model, the performance returned by each AI model within the categorized question sub-specialty designation, and the performance of each AI model in comparison to the results returned by orthopedic residents classified by their respective post-graduate year (PGY) level. Results BARD answered more overall questions correctly (58% vs 54%, p<0.001). ChatGPT performed better in sports medicine and basic science and worse in hand surgery, while BARD performed better in basic science (p<0.05). The AIs performed better in recall questions compared to the application of knowledge (p<0.05). Based on previous data, it ranked in the 42nd-96th percentile for post-graduate year ones (PGY1s), 27th-58th for PGY2s, 3rd-29th for PGY3s, 1st-21st for PGY4s, and 1st-17th for PGY5s. Discussion ChatGPT excelled in sports medicine but fell short in hand surgery, while both AIs performed well in the basic science sub-specialty but performed poorly in the application of knowledge-based taxonomy questions. BARD performed better than ChatGPT overall. Although the AI reached the second-year PGY orthopedic resident level, it fell short of passing the American Board of Orthopedic Surgery (ABOS). Its strengths in recall-based inquiries highlight its potential as an orthopedic learning and educational tool.

Assessing ChatGPT's orthopedic in-service training exam performance and applicability in the field.

BACKGROUND: ChatGPT has gained widespread attention for its ability to understand and provide human-like responses to inputs. However, few works have focused on its use in Orthopedics. This study assessed ChatGPT's performance on the Orthopedic In-Service Training Exam (OITE) and evaluated its decision-making process to determine whether adoption as a resource in the field is practical. METHODS: ChatGPT's performance on three OITE exams was evaluated through inputting multiple choice questions. Questions were classified by their orthopedic subject area. Yearly, OITE technical reports were used to gauge scores against resident physicians. ChatGPT's rationales were compared with testmaker explanations using six different groups denoting answer accuracy and logic consistency. Variables were analyzed using contingency table construction and Chi-squared analyses. RESULTS: Of 635 questions, 360 were useable as inputs (56.7%). ChatGPT-3.5 scored 55.8%, 47.7%, and 54% for the years 2020, 2021, and 2022, respectively. Of 190 correct outputs, 179 provided a consistent logic (94.2%). Of 170 incorrect outputs, 133 provided an inconsistent logic (78.2%). Significant associations were found between test topic and correct answer (p = 0.011), and type of logic used and tested topic (p = < 0.001). Basic Science and Sports had adjusted residuals greater than 1.96. Basic Science and correct, no logic; Basic Science and incorrect, inconsistent logic; Sports and correct, no logic; and Sports and incorrect, inconsistent logic; had adjusted residuals greater than 1.96. CONCLUSIONS: Based on annual OITE technical reports for resident physicians, ChatGPT-3.5 performed around the PGY-1 level. When answering correctly, it displayed congruent reasoning with testmakers. When answering incorrectly, it exhibited some understanding of the correct answer. It outperformed in Basic Science and Sports, likely due to its ability to output rote facts. These findings suggest that it lacks the fundamental capabilities to be a comprehensive tool in Orthopedic Surgery in its current form. LEVEL OF EVIDENCE: II.

Allopathic and Osteopathic Residents Perform Similarly on the Orthopedic In-Training Examination (OITE).

INTRODUCTION: There is a bias in the medical community that allopathic training is superior to osteopathic training, despite the lack of substantiation. The orthopedic in-training examination (OITE) is a yearly exam evaluating educational advancement and orthopedic surgery resident's scope of knowledge. The purpose of this study was to compare OITE scores between doctor of osteopathic medicine (DO) and medical doctor (MD) orthopedic surgery residents to determine whether any appreciable differences exist in the achievement levels between the 2 groups. METHODS: The American Academy of Orthopedic Surgeons 2019 OITE technical report, which reports the scores from the 2019 OITE for MDs and DOs, was evaluated to determine OITE scores for MD and DO residents. The progression of scores obtained during various postgraduate years (PGY) for both groups was also analyzed. MD and DO scores throughout PGY 1-5 were compared with independent t-tests. RESULTS: PGY-1 DO residents outperformed MD residents on the OITE (145.8 vs 138.8, p < 0.001). The mean scores achieved by DO and MD residents during PGY-2 (153.2 vs 153.2), 3 (176.2 vs 175.2), and 4 (182.0 vs 183.7) did not differ (p = 0.997, 0.440, and 0.149, respectively). However, for PGY-5, the mean scores for MD residents (188.6) were higher than those of DO residents (183.5, p < 0.001). Both groups had trends of improvement seen throughout PGY 1 to 5 years, with both groups showing an increase in average PGY scores when compared to each preceding PGY. CONCLUSION: This study provides evidence that DO and MD orthopedic surgery residents perform similarly on the OITE within PGY 2 to 4, thus displaying equivalencies in orthopedic knowledge within the majority of PGYs. Program directors at allopathic and osteopathic orthopedic residency programs should take this into account when considering applicants for residency.

Analysis of Hand Surgery Questions on Orthopedic In-training Examination From 2014 to 2019.

BACKGROUND: The orthopedic in-training examination (OITE) continues to evolve over time. It is important for orthopedic residents and residency programs to have an up-to-date understanding of the content and resources being used on the OITE to study and tailor curricula accordingly. This study presents an updated analysis of the OITE hand domain from 2014 to 2019. METHODS: All OITE questions related to hand surgery from 2014 to 2019 were analyzed for topic, subtopic, taxonomy, imaging modalities, and bibliometric factors related to cited references. RESULTS: Of the 1600 OITE questions, there were 113 hand surgery questions (7.1%) over a 6-year period. The most commonly tested topics were nerve (n = 22; 19%), fracture/dislocation (n = 21; 19%), and tendon/ligament (n = 19; 17%). Complex clinical management questions were the most common taxonomic category (n = 66; 58%). Two hundred fifty-two references were cited, the most common of which were from the Journal of Hand Surgery (American Volume) (n = 76; 30%), Journal of the American Academy of Orthopaedic Surgeons (n = 27; 11%), and Hand Clinics (n = 21; 8%). Publication lag decreased over the study period (P = .009). Twenty-five questions (22%) used imaging modalities, and 21 (19%) used clinical photos. Compared with a prior analysis from 2002 to 2006, there were more questions related to nerves (19.5% vs 9.8%, P = .041). CONCLUSIONS: Residents and residency programs can benefit from an updated understanding of OITE hand surgery content and resources. The current analysis identifies high-yield topics and resources that can guide resident preparation for the OITE.

Cross-Sectional Analysis of Foot and Ankle Questions on the Orthopaedic In-Training Examination: A Guide for Resident Preparation.

Background: The Orthopaedic In-Training Examination (OITE) is a standardized examination administered annually to orthopaedic surgery residents. The examination is designed to evaluate resident knowledge and academic performance of residency programs. Methods: All OITE foot and ankle questions from 2009 through 2012 and 2017 through 2020 were analyzed. Subtopics, taxonomy, references, and use of imaging modalities were recorded. Results: There were a total of 167 foot and ankle (F&A)-related questions across 8 years of OITE examinations. Trauma remained the most commonly tested subtopic of F&A across both subsets, followed by rehabilitation, tendon disorders, and arthritis. We found an increase in questions related to arthritis (P = .05) and a decrease of questions related to the diabetic foot (P = .02). Taxonomy 3 questions constituted 49.5% of F&A questions from 2009 through 2012 compared with 44.7% of questions from 2017 to 2020 (P = .54). Radiography was the most commonly used imaging modality in both subsets. From 2009 to 2012, 63.6% of questions included a radiograph compared with 76.5% in 2017 through 2020 (P = .13). FAI (Foot & Ankle International), JAAOS (Journal of the American Academy of Orthopaedic Surgeons), and JBJS (The Journal of Bone and Joint Surgery) were the most commonly cited journals, making up more than 50% of total citations. Citations per question increased from 2.20 to 2.42 from 2009-2012 to 2017-2020 (P = .01). The average lag time in the early subset was 8.2 years and 8.9 years in the later subset. Conclusion: This study provides a detailed analysis of the F&A section of the OITE. Use of this analysis can provide residents with a guide on how to better prepare for the OITE examination. Level of Evidence: Level IV, cross-sectional review of Orthopaedic In-Training Examination questions.

The number of shoulder and elbow questions on the orthopedic in-training examination is increasing with greater emphasis on critical thinking over recall.

Background: It is critical for orthopedic surgery residents and residency programs to have a current understanding of the content and resources utilized by the Orthopedic In-Training Examination (OITE) to continuously guide study and educational efforts. This study presents an updated analysis of the shoulder and elbow section of the OITE. Methods: All OITE questions, answers, and references from 2013 to 2019 were reviewed. The number of shoulder and elbow questions per year was recorded, and questions were analyzed for topic, imaging modalities, cognitive taxonomy, and references. We compared our data to the results of a previous study that analyzed shoulder and elbow OITE questions from 2002 to 2007 to examine trends and changes in this domain overtime. Results: There were 177 shoulder and elbow questions (126 shoulder, 71.2%; 51 elbow, 28.8%) of 1863 OITE questions (9.5%) over a 7-year period. The most commonly tested topics included degenerative joint disease/stiffness/arthroplasty (31.6%), anatomy/biomechanics (16.9%), instability/athletic injury (15.3%), trauma (14.7%), and rotator cuff (13.6%). Half of all questions involved clinical management decisions (49.7%). A total of 417 references were cited from 56 different sources, the most common of which were the Journal of Shoulder and Elbow Surgery (23.3%), Journal of the American Academy of Orthopaedic Surgeons (20.4%), and Journal of Bone and Joint Surgery (American Volume) (16%). The average time lag from article publication to OITE reference was 7.7 years. Compared with a prior analysis from 2002 to 2007, there was a significant increase in the number of shoulder and elbow questions on the OITE (5.5% to 9.5%; P < .001). Recent exams incorporated more complex multistep treatment questions (4.4% vs. 49.7%; P < .001) and fewer recall questions (42.2% vs. 22%; P < .001). There was a significant increase in the use of imaging modalities (53.3% vs. 79.1%; P < .001). No significant differences in the distribution of question topics were found. Conclusions: The percentage of shoulder and elbow questions on the OITE has nearly doubled over the past decade with greater emphasis on critical thinking (eg, clinical management decisions) over recall of facts. These findings should prompt educators to direct didactic efforts (eg, morning conferences and journal club) toward case-based learning to foster critical thinking and clinical reasoning skills.

Orthopaedic In-training Exam Preparation among Orthopaedic Surgery Residency Programs.

OBJECTIVE: The Orthopaedic In-Training Examination (OITE) is given annually to residents to assess their knowledge of clinical orthopaedics and orthopaedic basic science. This study sought to determine what resources orthopaedic residency programs recommend and/or require for residents as preparative tools for the OITE and to understand which resources are most beneficial. DESIGN: An anonymous electronic survey was distributed to program directors of orthopaedic surgery residency programs. It included questions about resources that program directors recommended or required residents to use when preparing for the OITE. SETTING: The survey was prepared and the results analyzed at two academic medical institutions in Louisiana. The survey was available to respondents in December 2019 and January 2020. PARTICIPANTS: The survey was delivered to program directors of 148 ACGME accredited orthopaedic surgery residency programs in the United States. RESULTS: 148 orthopaedic surgery residency program directors received the survey and 44 responded (response rate: 29.7%). Twenty-nine programs (73.2%) reported that practice tests/review of old OITE exams positively correlated with better scores. The most recommended resources for OITE preparation were Orthobullets (35 programs; 85%) and Res Study (AAOS) (27 programs; 67.5%). Programs having formal/required preparation programs had lower mean overall scores on the OITE than programs that did not. Those without a formal/required program scored in the 60th percentile, while those with a formal/required program scored in the 53.3rd percentile, a difference of 6.7 percentile points (p = 0.049). The mean overall percentiles were significantly higher for programs that reported having a threshold/goal OITE score for residents compared to those that didn't. Programs with a threshold/goal score scored in the 60.6th percentile on average, while those without a threshold/goal score scored in the 51.7th percentile on average, a difference of 8.9 percentile points (p = 0.0095). CONCLUSIONS: There is substantial variability in the resources that are utilized in preparation for the OITE, with the most commonly recommended resource being Orthobullets. The study method most cited as having a positive impact on scores was practice tests/review of old OITE exams. Having a formal/required program resulted in programs having lower OITE scores. Setting a goal/threshold score correlates positively with an increase in OITE score. Encouraging residents to use practice questions/old OITE tests, setting a goal/threshold score and avoiding formal/required preparation programs may improve resident performance on the OITE.

Analysis of the OITE Oncology Section: An Updated Review of Years 2013 to 2019.

OBJECTIVES: The importance of the Orthopaedic In-Training Examination (OITE) is well documented. The purpose of this study is to provide an updated analysis of the oncology section compared to the review by Frassica et al. from 2002 to 2006, as a means to provide insight into more focused resident study. DESIGN: This study is a retrospective database review using published OITE exams from years 2013 to 2019. Methods were based off a previous review by Frassica et al. where oncology-related questions were analyzed for underlying diagnosis, benign versus malignant condition, imaging and histology provided, and genes/translocations tested. Questions were classified by category and taxonomy. RESULTS: Oncology-related questions per exam ranged from 19 (7%) to 23 (8.4%) of total questions, which is fewer than years 2002 to 2006. Twenty malignant and 27 benign entities were tested with malignant conditions tested at a higher rate of 1.3:1 versus benign. Eighteen combinations of imaging modalities were provided for analysis versus 11 from 2002 to 2006. With regard to taxonomy, the average number of questions per classification ranged from 2.4 to 5.4. The least common classification tested was treatment modality and the most commonly tested classification was treatment from diagnosis (taxonomy 3). Previously, tumor knowledge (taxonomy 1) was most tested with an average of 8.8 questions per exam. 12 questions were directly related to genes and translocations across all years. CONCLUSIONS: Oncology questions made up a smaller percentage of the OITE exam than previous years, although more conditions were tested using more imaging combinations, necessitating a wider range of knowledge. However, malignant conditions continue to be tested more commonly. There has been a shift toward Taxonomy 3 level questions, indicating a higher level of thought processing required from residents as opposed to recall. Additionally, genes and translocations became more commonly tested throughout the most recent analysis, indicating a focus for future years of study.

Residents and Program Director Perspectives Often Differ on Optimal Preparation Strategies and the Value of the Orthopedic In-Training Examination.

OBJECTIVES: The purpose of this work was to compare resident and program director (PD) perspectives on the value of the Orthopaedic In-Training Examination (OITE), resident study habits, and best resources for optimal performance. DESIGN: A national survey of orthopedic surgery residents and PDs. SETTING: Mayo Clinic, Rochester, MN PARTICIPANTS: The survey was completed by 445 (41.5%) eligible orthopedic surgery residents and 37 (77.1%) PDs. RESULTS: Although residents and PDs agreed on when (p = 0.896) and how much (p = 0.171) residents currently study, residents felt that the OITE was not as valuable of an assessment of their knowledge, and also felt their individual scores were less likely to remain confidential compared to PDs (p < 0.001). The mean OITE score below which residents were concerned about their ability to pass American Board of Orthopaedic Surgeons Part 1 was 9.7 percentile points higher than PDs threshold (42.3% vs. 32.6%, respectively, p = 0.003). Both groups agreed that it is important to dedicate focused study time to the OITE (p = 0.680) and to perform well (p = 0.099). Regarding the best resources and preparation strategies, both residents and PDs tended to agree on the value of most (6 of 10) study methods. Residents ranked practice question websites (mean ranking of 2.6 vs. 3.8 of 10, respectively; p < 0.001) and formal rotations in a subspecialty (6.0 vs. 7.7 respectively, p < 0.001) higher than PDs. In contrast, PDs tended to value their program's formal OITE prep program (4.1. vs. 5.3, respectively, p = 0.012) and reading primary literature (5.6 vs. 6.6, respectively, p = 0.012) more than residents. CONCLUSION: Residents and PDs agreed on many critical components of this process; however, a number of key differences in perspectives exist.

Orthopaedic Surgery Residency Rotations and Correlation With Orthopaedic In-Training Examination Performance.

OBJECTIVE: The Orthopaedic In-Training Examination (OITE) is administered annually and is used to assess medical knowledge of orthopedic surgery residents. Beginning in the 2013 to 2014 academic year, the ACGME expanded the postgraduate year (PGY)-1 curriculum from 3 to 6 months of orthopedic surgery rotations. The purpose of this study is to evaluate the effect of increased PGY-1 orthopedic surgery exposure on medical knowledge as measured by the OITE. DESIGN: From 2011 to 2013, 24 PGY-2 residents completed 3 months of PGY-1 orthopedic training (Group 1). From 2014 to 2016, 24 PGY-2 residents completed 6 months of PGY-1 orthopedic training (Group 2). The effect of an initial PGY-2 pediatrics rotation (Sub-group A), compared to a trauma rotation (Sub-group B) was also analyzed. The hypothesis of this study is that Group 2 scores higher on the OITE than Group 1. Raw percentage and overall percentile scores for all PGY-2 residents from 2011 to 2016 for the pediatrics subsection, the trauma subsection, and for the overall OITE test in our program were recorded. Group 1 versus Group 2, and Sub-group A versus Sub-group B were compared (Student's t-test). SETTING: University of Minnesota (Institutional, Tertiary); Gillette Children's Hospital (Institutional, Tertiary); Regions Hospital (Institutional, Tertiary). PARTICIPANTS: 48 PGY-2 residents from 2011 to 2016 were included in the study. RESULTS: Group 2 achieved higher raw and percentile scores on the OITE during their PGY-2 year than Group 1. Sub-group B scored higher than Sub-group A on all OITE subsections and overall. CONCLUSIONS: This study suggests that raw percentage and percentile OITE scores improve with an additional 3 months of orthopedic training in the PGY-1 year. Clinical exposure, specifically in orthopedic trauma, correlates with higher OITE performance in our residency program.

Orthopedic In-Training Examination: A Performance Review Based on Program- and Resident-Specific Characteristics.

OBJECTIVES: The orthopedic in-training examination (OITE) is the most common and objective method used to assess resident knowledge in the United States. As such, residents and programs use a number of strategies to maximize OITE performance. The purpose of this work was to better understand what strategies were being implemented and to determine which program-specific and resident-specific characteristics best correlate with improved scores. DESIGN: A national survey of orthopedic residents and program directors (PDs) was performed to better understand OITE performance and correlate scores with various test preparation strategies. SETTING: Mayo Clinic, Rochester, MN. PARTICIPANTS: The survey was completed by 33 of 48 (68.8%) PDs and 341 of 878 (38.8%) eligible residents. RESULTS: The most commonly used program-wide strategies were as follows: negative consequences for poor performance (72.7%), formal OITE prep program (54.5%), and purchase of OITE test prep material for residents (51.5%). The program-specific characteristics that had the strongest correlation with increased scores were negative consequences for poor performance (p < 0.001), high value placed on the OITE by PD and residents (p < 0.001), excusing residents from clinical duties the evening prior (p < 0.001), having residents take the examination on different days (p = 0.012), and allowing residents to lead a review course (p = 0.047). The resident-specific characteristics that correlated most with score were increased study time leading up to the test (p = 0.031) and attendance at their program's OITE prep program (p = 0.062). CONCLUSIONS: Although programs and residents looking to improve knowledge acquisition and OITE scores use a number of techniques, a few distinct strategies correlate with the greatest increases in OITE performance. These may be appropriate methods to consider for those looking to improve their performance in coming years.

Levels of Evidence for Hand Questions on the Orthopaedic In-Training Examination.

Background: Although analyses of the Orthopaedic In-Training Examination (OITE) subspecialty content domains have been performed, few studies have analyzed the levels of evidence (LoEs) for journal articles used as references to create OITE questions. We present an analysis of reference characteristics and question taxonomy for the hand surgery content domain on the OITE. We aim to determine whether level of evidence (LoE) for hand surgery questions have increased over a 15-year period. Methods: All questions and references in the hand surgery content domain on the OITE from 1995-1997 and 2010-2012 were reviewed. The taxonomic classification was determined for each question. Publication characteristics were defined for each reference, and each primary journal article was assigned a LoE. Results: A total of 129 questions containing 222 references met inclusion criteria: 76 questions from 1995-1997 and 53 from 2010-2012. The Journal of Hand Surgery American and European Volumes, Journal of Bone and Joint Surgery American and British Volumes, and the Journal of the American Academy of Orthopaedic Surgeons were the most frequently cited journals overall. Recent examinations were more likely to have Buckwalter T3 complex clinical management questions. There was a statically significant increase in the LoE used to create hand questions on the 2010-2012 compared with the 1995-1997 OITE. Conclusions: Primary journal articles cited on the hand surgery content domain of the OITE frequently included recent publications from both general and subspecialty journals. More recent examination questions appear to test clinical management scenarios. LoE for hand questions has increased over a 15-year period. Our results can be used as a guide to help prepare orthopedic residents for the OITE.

Levels of Evidence for Foot and Ankle Questions on the Orthopaedic In-Training Examination: 15-Year Trends.

BACKGROUND: The foot and ankle (FA) content domain is a component of the orthopaedic in-training examination (OITE). Levels of evidence (LoE) have been infrequently studied on the OITE. The purpose of this study is to determine if LoE for primary journal articles referenced for FA questions increased over a 15-year period. We also aim to determine if reference characteristics and question taxonomy have changed during this period. METHODS: All 132 questions and 261 references in the FA content domain from 1995 to 1997 and from 2010 to 2012 were included. We defined the characteristics of each reference and taxonomy of each question. Every primary journal article was assigned a LoE based on American Academy of Orthopaedic Surgeons (AAOS) guidelines. RESULTS: Foot & Ankle International (FAI) was the most frequently cited journal. The change in the distribution of the Buckwalter classifications was statistically significant (p = 0.0286) with an increase in the number of clinical management questions. There were more level I studies on the 2010 to 2012 OITE (p = 0.0478) 6/54 (11%) of questions on the 2010 to 2012 OITE cited level I or II evidence compared with 3/78 (4%) on the 1995 to 1997 examinations (p = 0.1035). CONCLUSIONS: There is a trend toward improved LoE for journal articles within the FA content domain on the OITE over a 15-year period, particularly when analyzing the increase in level I studies. FAI is the most frequently cited journal and questions increasingly test clinical management concepts. CLINICAL RELEVANCE: Our results can be used to help improve resident self-study and suggest that reviewing recent FAI articles may aid OITE preparation. LEVEL OF EVIDENCE: Basic Science.

Levels of evidence have increased for musculoskeletal trauma questions on the orthopaedic in-training examination.

OBJECTIVE: The purpose of this study was to determine if the levels of evidence for primary journal articles used as references for musculoskeletal trauma questions on the Orthopaedic In-Training Examination (OITE) have increased over a 15-year period. DESIGN: Basic science article. SETTING: Geisinger Medical Center (Danville, PA), tertiary referral center. PARTICIPANTS: All 329 questions in the musculoskeletal trauma content domain on the OITE from 1995 to 1997 and 2010 to 2012 were reviewed. Baseline characteristics for each question and each reference were recorded. References were categorized as a textbook, a journal review article, an instructional course lecture, or a primary journal article. For each primary journal article, the level of evidence for the article was determined in accordance with the American Academy of Orthopaedic Surgeons Levels of Evidence Guidelines. RESULTS: The level of evidence used for primary journal articles demonstrated a statistically significant increase from 1995 to 1997 to 2010 to 2012. Overall, 27% of primary journal articles cited on the 1995 to 1997 OITEs were level I, II, or III studies, increasing to 43% during the 2010 to 2012 period (p = 0.04). The Buckwalter classification for the OITE questions changed significantly between the 2 periods, with questions from 2010 to 2012 including more T1 questions (25% vs 39%) and fewer T3 questions (46% vs 39%, p = 0.016). The Journal of Bone and Joint Surgery and the Journal of Orthopaedic Trauma were the most frequently cited journals overall. CONCLUSIONS: The levels of evidence for primary journal articles cited on the OITE for questions within the musculoskeletal trauma content domain have increased between 1995 and 2012. Our analysis can be used as a guide to help examinees prepare for musculoskeletal trauma questions on the OITE and as an aid in core curriculum development.