Vascular Surgery Curriculum for Medical Students: A National Targeted Needs Assessment.

BACKGROUND: At present, neither the American College of Surgeons (ACS) nor the Society for Vascular Surgery (SVS) provides curriculum recommendations for medical students rotating on a vascular surgery service. We sent a targeted needs assessment to vascular surgeons across the country in order to investigate the need for a structured curriculum for medical students participating in a vascular surgery rotation during their clinical clerkships. METHODS: The survey was developed with input from medical students, vascular surgeons, and medical educators. Respondents were identified from the Fellowship and Residency Electronic Interactive Database (FREIDA). The needs assessment was sent to program directors of vascular residencies and fellowships and to other vascular surgery educators. The survey collected data regarding the existing vascular surgery curriculum at the respondent's institution, the need for a standardized curriculum, desired experiences for medical students, and important vascular topics for medical students to cover while on rotation. RESULTS: Responses were obtained from 50 of the 146 surveyed individuals (response rate = 34.2%). 48 respondents (96%) worked in an academic hospital or academic affiliated hospital. With regard to the existing vascular surgery curriculum, only 28 respondents (61%) indicated that they had a curriculum approved by the surgery clerkship director. 37 respondents (77.1%) said there were at least goals and objectives for students on the vascular surgery service, and 29 respondents (60.4%) indicated that there was dedicated time for didactic sessions. Only 17 respondents (35.4%) indicated students gave a case presentation on the service. 29 respondents (63%) agreed or strongly agreed that there should be a standardized vascular curriculum for medical students. When asked to rank 9 topics from most important to least important for students to learn, respondents ranked peripheral arterial disease, aortic disease, and carotid disease highest. Simulation experience was most frequently indicated as a desired addition to the curriculum, and only 16 respondents (33.3%) reported opportunities for vascular surgery specific simulation experiences. CONCLUSIONS: This study identified the lack of an existing structured curriculum for medical students, the desire for a standardized curriculum, and key topics and experiences that are felt to be important for students to cover.  With this information in hand, vascular educators have the potential to enhance the learning experience of medical students rotating through the service by developing a standardized curriculum.

The impact of longitudinal integrated clerkships on patient care: a qualitative systematic review.

BACKGROUND: Longitudinal Integrated Clerkships (LIC) are a relatively novel type of clinical placement model within medical education, particularly within the UK. The research on LICs primarily focuses on the impact of the model on students, tutors, communities, and organisations. The impact of LICs on patients has not yet been adequately synthesised. This systematic review aims to fill this gap by examining empirical evidence regarding the impact of LICs on patient care using quality-of-care measures, namely, health process measures and outcome measures. METHODS: A systematic search was conducted in MEDLINE, PsycINFO, Academic Search Premier, Education Research Complete, CINAHL Complete, ERIC, Web of Science, and Scopus. Two reviewers independently conducted the screening process for study selection. Results across studies were analysed and summarised by thematic analysis. RESULTS: The reviewers screened 1632 records. Seven studies met the inclusion criteria following a full-text review, from which four themes were created. Three themes describe health process measures, including: 1) Advocacy within healthcare system, 2) Provision of supplementary and personalised care, and 3) Providing companionship with care. One theme described a health outcome measure: Therapeutic Alliance. CONCLUSION: Current evidence demonstrates an overall beneficial impact of LICs on patient health processes and outcome measures. However, the available evidence is weak and limited. Further research is required to illuminate the true impact of LICs on patient health.

Surgical clerkship: Do examination scores correlate with clinical performance?

BACKGROUND: This study aims to determine if there are correlations between clinical performance and objective grading parameters for medical students in the third-year surgery clerkship. METHODS: Clerkship grades were compiled from 2016 to 2020. Performance on clinical rotations, NBME shelf exam, oral exam, and weekly quizzes were reviewed. Students were divided into quartiles (Q1-Q4) based on clinical performance. Standard statistical analysis was performed. RESULTS: There were 625 students included in the study. Students in Q1+Q2 were more likely than those in Q3+Q4 to score in the top quartile on the shelf exam (29% vs. 19%, p = 0.002), oral exam (24% vs. 17%, p = 0.032), and quizzes (22% vs. 15%, p = 0.024). However, there was negligible correlation between clinical performance and performance on objective measures: shelf exam (R2 = 0.027, p < 0.001), oral exam (R2 = 0.021, p < 0.001), and weekly quizzes (R2 = 0.053, p = 0.092). CONCLUSIONS: Clinical performance does not correlate with objective grading parameters for medical students in the third-year surgery clerkship.

Does surgical observed structured clinical exam (OSCE) predict clerkship grade, shelf exam scores, and preceptor clinical evaluation?

BACKGROUND: Clinical evaluation of medical student performance has been criticized as variable and subjective. The aim of this study was to assess the correlation of a summative surgical OSCE exam to clinical faculty evaluations as well as surgery shelf exam score and final grades. METHODS: The performance of 392 students who completed the surgical clerkship between 2017 and 2019 was assessed via Pearson Coefficients comparing OSCE grades, clinical evaluations of Medical Knowledge and Patient Care, Communication and Professionalism, the National Board of Medical Examiners (NBME) shelf surgical subject exam, and final clerkship grade. RESULTS: Results demonstrate a statistically significant positive relationship between the OSCE, Shelf score and grade, final clerkship grade, and all clinical evaluations except Communication skills. The greatest correlation occurred between OSCE and shelf scores and grades. Although significant, the degree of correlation with clinical observation was significantly less. CONCLUSION: This study demonstrates that a surgical OSCE has a small positive correlation with clinical knowledge as measured by the NBME shelf exam. There is also an equal correlation with medical knowledge standards, with the OSCE better predicting NBME shelf outcome. This lower correlation to clinical assessment suggests that either the clinical grades contain elements not detected on an OSCE exam but could also support the hypothesis that variability in clinical grades do contain a significant degree of subjectivity.

Quantity and Quality of Physical Medicine and Rehabilitation Clerkships in US Medical Schools.

OBJECTIVE: The purpose of this study was to address two underreported issues in undergraduate physical medicine and rehabilitation medical education: quantity and quality of physical medicine and rehabilitation clerkships in US medical schools. DESIGN: A multimethod sequential design was used to evaluate the curricula of US medical schools. Quantity (N = 154) of physical medicine and rehabilitation clerkships was assessed by counting the number of required, selective, and elective clerkships in each medical school. Quality (n = 13) was assessed by conducting a thematic analysis on physical medicine and rehabilitation clerkship curricula to identify learning objectives. These objectives were then compared with learning objectives in a model standard. RESULTS: Whereas few medical schools required a physical medicine and rehabilitation clerkship, most offered elective rotations in physical medicine and rehabilitation. Most medical schools only included 6 of the 12 model standard learning objectives. Medical schools also included 29 learning objectives not present in the model standard. CONCLUSIONS: Physical medicine and rehabilitation clerkships are not underrepresented but are underemphasized, in undergraduate medical schools. Furthermore, these clerkships use inconsistent learning objectives. Thus, findings suggest the need to draw attention to physical medicine and rehabilitation clerkships by offering them as selectives and to develop a list of standardized learning objectives. This exploratory study developed such a groundbreaking list and invites the physical medicine and rehabilitation community to test it.

Clerkship Grading and the U.S. Economy: What Medical Education Can Learn From America's Economic History.

Clerkship grades (like money) are a social construct that function as the currency through which value exchanges in medical education are negotiated between the system's various stakeholders. They provide a widely recognizable and efficient medium through which learner development can be assessed, tracked, compared, and demonstrated and are commonly used to make decisions regarding progression, distinction, and selection for residency. However, substantial literature has demonstrated how grades imprecisely and unreliably reflect the value of learners. In this article, the authors suggest that challenges with clerkship grades are fundamentally tied to their role as currency in the medical education system. Associations are drawn between clerkship grades and the history of the U.S. economy; 2 major concepts are highlighted: regulation and stock prices. The authors describe the history of these economic concepts and how they relate to challenges in clerkship grading. Using lessons learned from the history of the U.S. economy, the authors then propose a 2-step solution to improve upon grading for future generations of medical students: (1) transition from grades to a federally regulated competency-based assessment model and (2) development of a departmental competency letter that incorporates competency-based assessments rather than letter grades and meets the needs of program directors.

Validating an Obstetrics and Gynaecology Longitudinal Integrated Clerkship Curriculum at the University of Toronto: A Four-Year Review.

The University of Toronto launched a longitudinal integrated clerkship (LIC) pilot project in 2014. Our aim was to evaluate LIC student outcomes in obstetrics and gynaecology compared with those of traditional block students. LIC and block students underwent identical evaluations, including written and oral exams, as well as clinical assessments from the ward. LIC student scores in each domain were compared with those of the traditional block students over 4 years. There were no differences in overall pass/fail status between LIC and block students. Thus, our LIC design could be appropriately modeled at other teaching institutions contemplating introducing an LIC stream.

"There Is a Lot of Change Afoot": A Qualitative Study of Faculty Adaptation to Elimination of Tiered Grades With Increased Emphasis on Feedback in Core Clerkships.

PURPOSE: Medical schools responding to challenges with fairness, equity, learning environments, and student wellness have reconsidered clerkship grades. This study used the Concerns-Based Adoption Model (CBAM) to explore how faculty responded to a change in the approach to assessment from focus on grades toward focus on feedback. METHOD: This qualitative study used an inductive approach to analyze data from semistructured interviews with teaching faculty and education leaders at University of California, San Francisco, School of Medicine 6 months following the elimination of traditional tiered clerkship grades. Participants were recruited in 2019 using purposive sampling. Interview questions addressed participants' perceptions of the new approach to assessment and grading that emphasizes assessment for learning, including advantages and concerns. The authors analyzed data using thematic analysis informed by sensitizing concepts from CBAM. RESULTS: Nineteen faculty participated (11 medicine, 8 surgery). Faculty expressed optimism about the impact of the change on their clinical educator roles and sought faculty development to enhance feedback and assessment skills. Perceived benefits to students addressed learning and wellness, with concern for students' motivation and professional development. Faculty shared uncertainty about their roles and larger systemic consequences involving the residency match and institutional reputation. Participants acknowledged that traditional grading is imperfect, yet felt a departure from this system represented significant culture change. CONCLUSIONS: Faculty perceptions of the assessment and grade change in 2 large departments demonstrated tensions around grading. Their descriptions of change as an ongoing process aligned with CBAM and required them to consider new approaches and perspectives. While discourse about assessment and grading frequently focuses on learners, these findings support institutional consideration of the impact of changes in assessment on teaching faculty.

Implementation of Changes to Medical Student Documentation at Duke University Health System: Balancing Education With Service.

PURPOSE: When the Centers for Medicare and Medicaid Services (CMS) changed policies about medical student documentation, students with proper supervision may now document their history, physical exam, and medical decision making in the electronic health record (EHR) for billable encounters. Since documentation is a core entrustable professional activity for medical students, the authors sought to evaluate student opportunities for documentation and feedback across and between clerkships. METHOD: In February 2018, a multidisciplinary workgroup was formed to implement student documentation at Duke University Health System, including educating trainees and supervisors, tracking EHR usage, and enforcing CMS compliance. From August 2018 to August 2019, locations and types of student-involved services (student-faculty or student-resident-faculty) were tracked using billing data from attestation statements. Student end-of-clerkship evaluations included opportunity for documentation and receipt of feedback. Since documentation was not allowed before August 2018, it was not possible to compare with prior student experiences. RESULTS: In the first half of the academic year, 6,972 patient encounters were billed as student-involved services, 52% (n = 3,612) in the inpatient setting and 47% (n = 3,257) in the outpatient setting. Most (74%) of the inpatient encounters also involved residents, and most (92%) of outpatient encounters were student-teaching physician only.Approximately 90% of students indicated having had opportunity to document in the EHR across clerkships, except for procedure-based clerkships such as surgery and obstetrics. Receipt of feedback was present along with opportunity for documentation more than 85% of the time on services using evaluation and management coding. Most students (> 90%) viewed their documentation as having a moderate or high impact on patient care. CONCLUSIONS: Changes to student documentation were successfully implemented and adopted; changes met both compliance and education needs within the health system without resulting in potential abuses of student work for service.

Gathering Validity Evidence on an Internal Medicine Clerkship Multistep Exam to Assess Medical Student Analytic Ability.

Construct: The definition of clinical reasoning may vary among health profession educators. However, for the purpose of this paper, clinical reasoning is defined as the cognitive processes that are involved in the steps of information gathering, problem representation, generating a differential diagnosis, providing a diagnostic justification to arrive at a leading diagnosis, and formulating diagnostic and management plans. Background: Expert performance in clinical reasoning is essential for success as a physician, and has been difficult for clerkship directors to observe and quantify in a way that fosters the instruction and assessment of clinical reasoning. The purpose of this study was to gather validity evidence for the Multistep exam (MSX) format used by our medicine clerkship to assess analytical clinical reasoning abilities; we did this by examining the relationship between scores on the MSX and other external measures of clinical reasoning abilities. This analysis used dual process theory as the main theoretical framework of clinical reasoning, as well as aspects of Kane's validity framework to guide the selection of validity evidence for the investigation. We hypothesized that there would be an association between the MSX (a three-step clinical reasoning tool developed locally), and the USMLE Step 2 CS, as they share similar concepts in assessing the clinical reasoning of students. We examined the relationship between overall scores on the MSX and the Step 2 CS Integrated Clinical Encounter (ICE) score, in which the student articulates their reasoning for simulated patient cases, while controlling for examinee's internal medicine clerkship performance measures such as the NBME subject exam score and the Medicine clerkship OSCE score. Approach: A total 477 of 487 (97.9%) medical students, representing the graduating classes of 2015, 2016, 2017, who took the MSX at the end of each medicine clerkship (2012-2016), and Step 2 CS (2013-2017) were included in this study. Correlation analysis and multiple linear regression analysis were used to examine the impact of the primary explanatory variables of interest (MSX) onto the outcome variable (ICE score) when controlling for baseline variables (Medicine OSCE and NBME Medicine subject exam). Findings: The overall MSX score had a significant, positive correlation with the Step 2 CS ICE score (r = .26, P < .01). The overall MSX score was a significant predictor of Step 2 CS ICE score (ß = .19, P < .001), explaining an additional 4% of the variance of ICE beyond the NBME Medicine subject score and the Medicine OSCE score (Adjusted R2 = 13%). Conclusion: The stepwise format of the MSX provides a tool to observe clinical reasoning performance, which can be used in an assessment system to provide feedback to students on their analytical clinical reasoning. Future studies should focus on gaining additional validity evidence across different learners and multiple medical schools.

Optimizing Medical Student Clerkship Schedules Using a Novel Application of the Hungarian Algorithm.

PROBLEM: Medical students often have preferences regarding the order of their clinical rotations, but assigning rotations fairly and efficiently can be challenging. To achieve a solution that optimizes assignments (i.e., maximizes student satisfaction), the authors present a novel application of the Hungarian algorithm, designed at the University of Texas Southwestern Medical Center (UTSW), to assign student schedules. APPROACH: Possible schedules were divided into distinct pathway options with k total number of seats. Each of n students submitted a ranked list of their top 5 pathway choices. An n × k matrix was formed, where the location (i, j) represented the cost associated with student i being placed in seat j. Progressively higher costs were assigned to students receiving less desired pathways. The Hungarian algorithm was then used to find the assignments that minimize total cost. The authors compared the performance of the Hungarian algorithm against 2 alternative algorithms (i.e., the rank and lottery algorithms). To evaluate the 3 algorithms, 4 simulations were conducted with different popularity weights for different pathways and were run across 1,000 trials. The algorithms were also compared using 3 years of UTSW student preference data for the classes of 2019, 2020, and 2021. OUTCOMES: In all 4 computer simulations, the Hungarian algorithm resulted in more students receiving 1 of their top 3 choices and fewer students receiving none of their preferences. Similarly, for UTSW student preference data, the Hungarian algorithm resulted in more students receiving 1 of their top 3 preferences and fewer students receiving none of their ranked preferences. NEXT STEPS: This approach may be broadly applied to scheduling challenges in undergraduate and graduate medical education. Furthermore, by manipulating cost values, additional constraints can be enforced (e.g., requiring certain seats to be filled, attempting to avoid schedules that begin with a student's desired specialty).

Dyskalemia: a management problem for students.

BACKGROUND: Although dyskalemia is common, its management can be problematic for students and general practitioners, especially when it occurs in patients with heart and renal failure. The basic academic knowledge of general medicine students, who have often not yet encountered clinical situations of dyskalemia, remains unclear in this regard. OBJECTIVES: The purpose of this study was to evaluate the knowledge and reflexive practices of general medicine students in regard to dyskalemia. METHODS: A cross-sectional survey, based on a self-questionnaire, of all of the students enrolled in general medicine studies at the Faculty of Medicine at the University of Nancy (France) at the end of their degree. The students were asked questions pertaining to specific clinical situations. The answers were compared to the information provided in the medical curriculum as well as to the relevant European guidelines. RESULTS: We collected 290 of the questionnaires (participation rate: 81.2%). The hyper- and hypokalemia thresholds considered pathological (3.5-5.0 mmol/L) were known by 78% and 67% of the students, respectively. The perception of danger in case of severe hypokalemia was underestimated by 62.7% of them. In most cases, the proposed management of hyperkalemia in heart and renal failure did not comply with the relevant guidelines. The students tended to favor permanent discontinuation of the administration of converting enzyme inhibitors (ACE) and/or mineralocorticoid receptor antagonists (MRA) without considering the need for their reintroduction (51.6%). Sodium polystyrene sulfate was frequently seen as an appropriate first-line treatment for hyperkalemia (45%). CONCLUSIONS: The knowledge and competence of general medicine students appear to be lacking for hyperkalemia in heart and renal failure, and they are long way from full compliance with the relevant European guidelines. Exposure to complex clinical situations as part of the medical curriculum, therefore, seems essential to improve the way dyskalemia is managed in France.

Washington University School of Medicine in St. Louis Case Study: A Process for Understanding and Addressing Bias in Clerkship Grading.

In 2018, in response to a news story featuring the Icahn School of Medicine's decision to eliminate its chapter of Alpha Omega Alpha (AOA) due to perceived racial inequities, students at Washington University School of Medicine in St. Louis (WUSM) brought similar concerns to leadership. WUSM leadership evaluated whether students' race, ethnicity, and gender were associated with their receipt of honors in the 6 core clerkships, key determinants of AOA selection. In preliminary analysis of the school's data, statistically significant racial and ethnic disparities were associated with receipt of honors in each clerkship. Leaders shared these findings with the WUSM community along with a clear message that such discrepancies are unacceptable to the school. An effort to further analyze what lay behind the findings as well as to identify steps to resolve the problem was launched. Using a quality improvement framework, data from focus groups and student surveys were analyzed and 2 overarching themes emerged. Students perceived that both assessment and the learning environment impacted racial/ethnic disparities in clerkship grades. In multivariable logistic regression models, shelf exam scores (a part of student assessment) were found to be associated with receipt of honors in each clerkship; in some (but not all) clerkships, shelf exam scores attenuated the effect of race/ethnicity on receipt of honors, so that when the shelf scores were added to the model, the race/ethnicity effect was no longer significant. This case study describes WUSM's process to understand and address bias in clerkship grading and AOA nomination so that other medical schools might benefit from what has been learned.

Predicting Performance on Clerkship Examinations and USMLE Step 1: What Is the Value of Open-Ended Question Examination?

PURPOSE: Despite advances in learning sciences that highlight the efficacy of elaborative interrogation, in which students explain and elaborate on concepts in their own words, assessment techniques in medical education have commonly employed multiple-choice questions (MCQs). Educators' reluctance to consider alternatives such as open-ended questions (OEQs) stems from practical advantages of MCQs and the lack of empirical data on the predictability of OEQs for performance on other high-stakes assessments. In this study, the authors compared the predictive value of preclerkship assessments using OEQs for the outcomes of clerkship examinations and United States Medical Licensing Examination (USMLE) Step 1. METHOD: The authors compared outcomes of 2 assessment formats using multiyear performance data (2015 and 2016 cohorts) on preclerkship MCQ versus OEQ examinations for predicting students' subsequent performance on 6 clerkship examinations and USMLE Step 1. The authors conducted a regression analysis to compare the predictability of MCQs and OEQs by using clerkship exam scores and Step 1 scores as dependent variables and performance on MCQs and OEQs as predictors in the models. RESULTS: Regression models with OEQs were consistently higher for predicting clerkship exam (NBME shelf-exam) scores, except for one clerkship, compared with models using MCQs. For Step 1, R-square using MCQs was higher with 59% of the variance explained compared with 46% with OEQs, but the OEQ cohort scored significantly higher on Step 1. CONCLUSIONS: OEQ examinations predict performance on subsequent high-stakes MCQ examinations. Given the predictive value and closer alignment with scientific principles of effective learning, OEQ examinations are an examination format worthy of consideration in preclerkship medical education programs.

Evaluating the effectiveness of undergraduate clinical education programs.

Medical schools should use a variety of measures to evaluate the effectiveness of their clinical curricula. Both outcome measures and process measures should be included, and these can be organized according to the four-level training evaluation model developed by Donald Kirkpatrick. Managing evaluation data requires the institution to employ deliberate strategies to monitor signals in real-time and aggregate data so that informed decisions can be made. Future steps in program evaluation includes increased emphasis on patient outcomes and multi-source feedback, as well as better integration of existing data sources.