Educating residents in spine surgery: A study of Entrustable professional activities in neurosurgery and orthopedic surgery.

BACKGROUND: Surgery for spinal disorders represents some of the commonest surgical procedures performed in many countries worldwide, carried out by neurosurgeons and orthopedic surgeons. Residency training is shifting to competency-based medical education, which requires setting standards for graduating residents and their assessments. However, gaps exist in the literature regarding the parameters used for assessment and the mastery levels expected of graduating residents in the performance of common spinal procedures as defined in Entrustable Professional Activities (EPAs). The objectives of the study were to describe the assessment parameters used for residents, identify the standard of performance expected of graduating residents of EPAs of spinal procedures, and identify factors predicting the expected standard of competent performance of graduating residents. METHODS: The survey was sent to neurosurgery and orthopedic surgery Faculty requesting their recommendations on parameters of assessment and the expected standard competence performance for EPAs related to spinal procedures using our entrustment scale (A-E). RESULTS: Based on total responses, the recommended number of assessments and assessors for each EPA was 5 and 2, respectively. Regarding each specialty, there was no significant difference in the recommended number of assessments for each EPA. However, neurosurgery Faculty recommended higher number of assessors(n = 3) than orthopedic surgery Faculty(n = 2) for both posterior spinal decompression EPA(PSD) (p = 0.01) and spinal instrumentation EPA(SI) (p = 0.04). Based on total responses, 83% felt PSD was appropriate to the general practice, 86.8% considered it not too broad, and 62.3% expected entrustment level E as a graduation target. The proportions of these ratings were slightly lower for SI at 58.5%, 71.7% and 56.6%, respectively. Both specialties indicated that the EPAs were not too broad. In contrast, neurosurgery Faculty were more likely to consider these EPAs appropriate for general practice than orthopedic surgery Faculty for both PSD (94.7% vs 53.3%, p = 0.0003) and SI (68.4% vs 33.3%, p = 0.02). Moreover, neurosurgery Faculty had a higher expected standard of performance as a graduation target for both PSD (Level E 76.3% vs 26.7%, p = 0.001) and SI (Level E 65.8% vs 33.3%, p = 0.03) than orthopedic surgery Faculty. Expectations of entrustment level E for PSD was associated with the belief that the current EPA was appropriate for the general practice of their specialty with an odds ratio of 8.35 (p = 0.01, 95%CI 1.53-45.67). CONCLUSIONS: A difference exists in parameters of assessment and expected standard competence performance of spine procedures among spinal surgery specialties. In our opinion, there should be efforts to develop consensus between specialties for the sake of uniform delivery of high-quality care for patients regardless of the specialty of their surgeon. Our results will be particularly valuable to certification bodies in the assessment of spinal milestones. This study has important implications for the design of residency and fellowship education in spinal surgery internationally.

Optimizing modern surgical simulation through instructor feedback - insights from a retrospective observational study in a tertiary hospital.

BACKGROUND: Laparoscopic surgery is associated with a prolonged learning curve for emerging surgeons, and simulation-based training (SBT) has become increasingly prominent in this context due to stringent working time regulations and heightened concerns regarding patient safety. While SBT offers a safe and ethical learning environment, the accuracy of simulators in the context of evaluating surgical skills remains uncertain. This study aims to assess the precision of a laparoscopic simulator with regard to evaluating surgical performance and to identify the instructor's role in SBT. MATERIALS AND METHODS: This retrospective study focused on surgical residents in their 1st through 5th years at the Department of Surgery of Linkou Chang Gung Memorial Hospital. The residents participated in a specially designed SBT program using the LapSim laparoscopic simulator. Following the training session, each resident was required to perform a laparoscopic procedure and received individualized feedback from an instructor. Both simulator and instructor evaluated trainees' performance on the LapSim, focusing on identifying correlations between the simulator's metrics and traditional assessments. RESULTS: Senior residents (n = 15), who employed more complex laparoscopic procedures, exhibited more significant improvements after receiving instructor feedback than did junior residents (n = 17). Notably, a stronger correlation between the simulator and instructor assessments was observed in the junior group (junior Global Operative Assessment of Laparoscopic Skills (GOALS) adjusted R2 = 0.285, p = 0.016), while no such correlations were observed among the senior group. CONCLUSION: A well-designed, step-by-step SBT can be a valuable tool in laparoscopic surgical training. LapSim simulator has demonstrated its potential in assessing surgical performances during the early stages of surgical training. However, instructors must provide intuitive feedback to ensure appropriate learning in later stages.

Emergency Medicine Milestones Final Ratings Are Often Subpar.

Background: The emergency medicine (EM) milestones are objective behaviors that are categorized into thematic domains called "subcompetencies" (eg, emergency stabilization). The scale for rating milestones is predicated on the assumption that a rating (level) of 1.0 corresponds to an incoming EM-1 resident and a rating of 4.0 is the "target rating" (albeit not an expectation) for a graduating resident. Our aim in this study was to determine the frequency with which graduating residents received the target milestone ratings. Methods: This retrospective, cross-sectional study was a secondary analysis of a dataset used in a prior study but was not reported previously. We analyzed milestone subcompetency ratings from April 25-June 24, 2022 for categorical EM residents in their final year of training. Ratings were dichotomized as meeting the expected level at the time of program completion (ratings of ≥3.5) and not meeting the expected level at the time of program completion (ratings of ≤3.0). We calculated the number of residents who did not achieve target ratings for each of the subcompetencies. Results: In Spring 2022, of the 2,637 residents in the spring of their last year of training, 1,613 (61.2%) achieved a rating of ≥3.5 on every subcompetency and 1,024 (38.8%) failed to achieve that rating on at least one subcompetency. There were 250 residents (9.5%) who failed to achieve half of their expected subcompetency ratings and 105 (4.0%) who failed to achieve the expected rating (ie, rating was ≤3.0) on every subcompetency. Conclusion: When using an EM milestone rating threshold of 3.5, only 61.2% of physicians achieved the target ratings for program graduation; 4.0% of physicians failed to achieve target ratings for any milestone subcompetency; and 9.5% of physicians failed to achieve the target ratings for graduating residents in half of the subcompetencies.

Educational research on medical residency programs in Chile: a scoping review and analysis of the impact of the new accreditation policy.

BACKGROUND: Accrediting medical specialties programs are expected to influence and standardize training program quality, align curriculum with population needs, and improve learning environments. Despite global agreement on its necessity, methods vary widely. In the Chilean context, a recent new accreditation criteria includes research productivity in relation to educational research on resident programs, so we aimed to define it. What is the profile of publications in educational research produced by Chilean medical specialty residency programs in the last five years? Based on these results, we intend to analyze the potential impact of the new accreditation policy on medical specialty programs in Chile. METHODS: We performed a preliminary bibliometric search to identify the use of the term "resident" in literature. After that, we conducted a literature search, using a six-step approach to scoping reviews, including the appraisal of the methodological quality of the articles. RESULTS: Between 2019 and 2023, an average of 6.2 articles were published yearly (19%). The bibliometric analysis revealed that the dominant thematic area of the journals was clinical, accounting for 78.1%. Most articles focused on residents (84.38%), with only two articles including graduates as participants. One university was responsible for 62.50% of the articles and participated in all multicenter studies (9.38%). Surgical specialties produced 15 research articles focused on procedural training using simulation. Psychiatry was the second most productive specialty, with 5 articles (15.63%) covering standardized patients, well-being, and mental health assessment. The most frequent research focus within residency programs over the five-year period was teaching and learning methodologies, with 19 articles representing almost 60% of the total analyzed. CONCLUSIONS: Research on medical education in Chile's postgraduate residency programs is limited, with most studies concentrated in a few universities. The new accreditation criteria emphasize educational research, posing challenges for many institutions to meet higher standards. Understanding unexplored areas in educational research and learning from successful programs can enhance research productivity and align efforts with accreditation expectations. Continuous evaluation and new research on residents' satisfaction, skills acquisition, and well-being are needed to ensure training quality and accountability.

Evaluating Performance of ChatGPT on MKSAP Cardiology Board Review Questions.

Chat Generative Pretrained Transformer (ChatGPT) is a natural language processing tool created by OpenAI. Much of the discussion regarding artificial intelligence (AI) in medicine is the ability of the language to enhance medical practice, improve efficiency and decrease errors. The objective of this study was to analyze the ability of ChatGPT to answer board-style cardiovascular medicine questions by using the Medical Knowledge Self-Assessment Program (MKSAP).The study evaluated the performance of ChatGPT (versions 3.5 and 4), alongside internal medicine residents and internal medicine and cardiology attendings, in answering 98 multiple-choice questions (MCQs) from the Cardiovascular Medicine Chapter of MKSAP. ChatGPT-4 demonstrated an accuracy of 74.5 %, comparable to internal medicine (IM) intern (63.3 %), senior resident (63.3 %), internal medicine attending physician (62.2 %), and ChatGPT-3.5 (64.3 %) but significantly lower than cardiology attending physician (85.7 %). Subcategory analysis revealed no statistical difference between ChatGPT and physicians, except in valvular heart disease where cardiology attending outperformed ChatGPT (p = 0.031) for version 3.5, and for heart failure (p = 0.046) where ChatGPT-4 outperformed senior resident. While ChatGPT shows promise in certain subcategories, in order to establish AI as a reliable educational tool for medical professionals, performance of ChatGPT will likely need to surpass the accuracy of instructors, ideally achieving the near-perfect score on posed questions.

Anatomical Benchmarks in the Training of Gastroenterologists.

Anatomy is one of the oldest medical disciplines and offered over the centuries the morphological explanation for the structure, function and pathology of the body. Learning anatomy was one of the first steps in the accumulation of medical knowledge. Practicing gastroenterology means the approach of pathology presenting with morphological changes. Diagnosis and therapeutical interventions require also precise anatomical knowledge. This is a review of the most important anatomical benchmarks necessary to trainees in gastroenterology. Two teachers of anatomy and one resident of gastroenterology performed a literature survey. They checked the curricula of gastroenterology of continental and national societies of gastroenterology and hepatology. They also checked on Pubmed and Google Scholar pertinent journal papers. They selected and analyzed papers presenting important anatomical benchmarks considered very important for the appropriation of practical skills. A list of recommendations was the outcome of this initiative. These are largely overlapping on the available curricula. The relevant anatomical benchmarks should be used in the training programs of residents in gastroenterology. Good anatomy training enables practitioners to diagnose correctly digestive pathology, to interpret the results of the imaging or endoscopic investigations, to recommend or undertake therapeutic interventions. Although ancient, anatomy is very useful in the training of future gastroenterologists. The trainees should emphasis the learning of the most important anatomical benchmarks.

The Relationship between Pediatric Medical Training and Neonatal Care in the Delivery Room and Beyond.

The modern neonate differs greatly from newborns cared for a half-century ago, when the neonatal-perinatal medicine certification examination was first offered by the American Board of Pediatrics. Delivery room resuscitation and neonatal care are constantly evolving, as is the neonatal workforce. Similarly, the Accreditation Council for Graduate Medical Education review committees revise the requirements for graduate medical education programs every 10 years, and the modern pediatric medical trainee is also constantly evolving. Delivery room resuscitation, neonatal care, and pediatric residency training are codependent; changes in one affect the other and subsequently influence neonatal outcomes. In this educational perspective, we explore this relationship and outline strategies to mitigate the impact of decreased residency training in neonatal-perinatal medicine.

Simulation-based echocardiography learning contribution on training of medical residents.

INTRODUCTION: Echocardiography is a pivotal exam in critically ill patients, a specific training is crucial. Medical residents often lack echocardiography practice. AIM: This study aims to evaluate the impact of simulation-based training on medical residents' echocardiography mastery. METHODS: This interventional study was conducted among medical residents at the Simulation Center of the Faculty of Medicine in Monastir (CeSim) in January 2022. The intervention consisted of a theoretical training and a simulator-based practical training concerning echocardiography. Residents underwent evaluation before and after training through a "Pre-Test" and a "Post-Test," respectively, using a French-language questionnaire. Participation was entirely voluntary. RESULTS: A total of 28 medical residents participated in our study, with the majority being female (57.1%). The median age was 29 years (interquartile range: 28-31.75). Following training, the proportion of participants who reported having the necessary skills for echocardiography interpretation significantly increased (p<0.05). Respondents demonstrated significant improvements in their scores on theoretical tests and practical skills assessments. Concerning echocardiographic views, the percentage of participants who correctly identified the title of the parasternal small axis section increased from 53.6% before training to 100% after training (p <10-3). Significant enhancements were observed in all parameters evaluating the practice of echocardiographic sections by respondents on a mannequin after training, encompassing time to obtain the view, view quality, image quality, visualization of structures, interpretability, and image stability (p<10-3). There was a significant improvement in average response rates for echocardiographic clinical syndroms among medical residents before and after training. All participants emphasized the indispensability of ultrasound education in the training of physicians specializing in managing cardiopulmonary emergencies. CONCLUSIONS: This study reports the beneficial role of simulation-based training in enhancing the mastery of medical residents in echocardiography. Incorporating such training methods into their learning curricula is advisable.

Acceptability and feasibility of an evaluation table to assess the competency of general medicine interns during ambulatory rotations in Brest.

BACKGROUND: General practitioner interns need to acquire the expected clinical, communication, personal and professional competencies. Internship evaluations use qualitative evaluation tables to assess competency acquisition. However, there is no standardised evaluation table used in France. Some faculties use the exhaustive, precise, and manageable Exceler evaluation tool. We aim to evaluate opinions of General practice interns in Brest about the acceptability and feasibility of using the Exceler evaluation tool to monitor competency acquisition during internships. METHODS: This qualitative study used intern focus groups. Six-open ended questions with optional follow-up questions were asked. Cards from the Dixit® game were used to guide and facilitate discussion. Open, axial, then integrative analysis of the verbatim was performed. RESULTS: This is the first study to evaluate intern opinions about GP internship evaluations using focus groups. Participants felt that the quality of existing evaluations was insufficient, and it was difficult to monitor their progress. Adapting evaluations to individual profiles and backgrounds seemed necessary. Exceler appeared to be a possible solution due to its content validity, flexibility of use and accessibility. However, there were comments about possible modifications. CONCLUSIONS: Analysing opinions of tutors, supervisors and other practice centers could help identify potential barriers and reveal solutions to facilitate its implementation and use. TRIAL REGISTRATION: Not applicable.

Translation, cultural adaptation and linguistic validation of the postgraduate hospital educational environment measure into Arabic.

BACKGROUND: Assessment of the clinical learning environment (CLE) is an essential step that teaching hospitals routinely undertake to ensure the environment is conducive, learning-oriented and supportive of junior doctors' education. The Postgraduate Hospital Educational Environment Measure (PHEEM) is an internationally recognized tool for assessing the CLE with evidence of high reliability and validity. Translation of PHEEM into other languages such as Spanish, Japanese and Persian enabled wider adoption of the instrument in the world. However, in Syria and other Arabic countries, a validated Arabic translation of PHEEM is still not available, making it difficult to adopt it and use it in Arabic contexts. This study aims to translate and culturally adapt the PHEEM from English into Arabic. METHODS: This study followed the structured translation and validation process guideline proposed by Sousa & Rojjanasrirat 2010. First, the PHEEM went through forward translation by three translators, then reconciled with the aid of a fourth translator. Afterwards, two professional bicultural and bilingual translators conducted back translation into English and compared it with the original version. This formed the Pre-final Version (PFV) which was then pretested for clarity on a sample of medical residents in Damascus, Syria. Following appropriate modifications, the PFV was sent to a panel of experts for a comprehensive review of language clarity and to assess content validity. RESULTS: A total of thirty-five medical residents were recruited. Ten items with language clarity issues were identified and modified according to the elicited suggestions. Thereafter, the modified PFV was presented to ten subject experts who identified three items in need of revision. The item-content Validity Index (CVI) was over 0.78 for all of the 40 items; the calculated scale-CVI was 0.945. DISCUSSION: This study provided the first linguistically valid Arabic translation of the widely used PHEEM inventory. The next step is to conduct a full psychometric analysis of the Arabic PHEEM to provide further evidence of validity and reliability.

Associations of Internal Medicine Residency Milestone Ratings and Certification Examination Scores With Patient Outcomes.

Importance: Despite its importance to medical education and competency assessment for internal medicine trainees, evidence about the relationship between physicians' milestone residency ratings or the American Board of Internal Medicine's initial certification examination and their hospitalized patients' outcomes is sparse. Objective: To examine the association between physicians' milestone ratings and certification examination scores and hospital outcomes for their patients. Design, Setting, and Participants: Retrospective cohort analyses of 6898 hospitalists completing training in 2016 to 2018 and caring for Medicare fee-for-service beneficiaries during hospitalizations in 2017 to 2019 at US hospitals. Main Outcomes and Measures: Primary outcome measures included 7-day mortality and readmission rates. Thirty-day mortality and readmission rates, length of stay, and subspecialist consultation frequency were also assessed. Analyses accounted for hospital fixed effects and adjusted for patient characteristics, physician years of experience, and year. Exposures: Certification examination score quartile and milestone ratings, including an overall core competency rating measure equaling the mean of the end of residency milestone subcompetency ratings categorized as low, medium, or high, and a knowledge core competency measure categorized similarly. Results: Among 455 120 hospitalizations, median patient age was 79 years (IQR, 73-86 years), 56.5% of patients were female, 1.9% were Asian, 9.8% were Black, 4.6% were Hispanic, and 81.9% were White. The 7-day mortality and readmission rates were 3.5% (95% CI, 3.4%-3.6%) and 5.6% (95% CI, 5.5%-5.6%), respectively, and were 8.8% (95% CI, 8.7%-8.9%) and 16.6% (95% CI, 16.5%-16.7%) for mortality and readmission at 30 days. Mean length of stay and number of specialty consultations were 3.6 days (95% CI, 3.6-3.6 days) and 1.01 (95% CI, 1.00-1.03), respectively. A high vs low overall or knowledge milestone core competency rating was associated with none of the outcome measures assessed. For example, a high vs low overall core competency rating was associated with a nonsignificant 2.7% increase in 7-day mortality rates (95% CI, -5.2% to 10.6%; P = .51). In contrast, top vs bottom examination score quartile was associated with a significant 8.0% reduction in 7-day mortality rates (95% CI, -13.0% to -3.1%; P = .002) and a 9.3% reduction in 7-day readmission rates (95% CI, -13.0% to -5.7%; P < .001). For 30-day mortality, this association was -3.5% (95% CI, -6.7% to -0.4%; P = .03). Top vs bottom examination score quartile was associated with 2.4% more consultations (95% CI, 0.8%-3.9%; P < .003) but was not associated with length of stay or 30-day readmission rates. Conclusions and Relevance: Among newly trained hospitalists, certification examination score, but not residency milestone ratings, was associated with improved outcomes among hospitalized Medicare beneficiaries.