Surgical clerkship: Do examination scores correlate with clinical performance?

BACKGROUND: This study aims to determine if there are correlations between clinical performance and objective grading parameters for medical students in the third-year surgery clerkship. METHODS: Clerkship grades were compiled from 2016 to 2020. Performance on clinical rotations, NBME shelf exam, oral exam, and weekly quizzes were reviewed. Students were divided into quartiles (Q1-Q4) based on clinical performance. Standard statistical analysis was performed. RESULTS: There were 625 students included in the study. Students in Q1+Q2 were more likely than those in Q3+Q4 to score in the top quartile on the shelf exam (29% vs. 19%, p = 0.002), oral exam (24% vs. 17%, p = 0.032), and quizzes (22% vs. 15%, p = 0.024). However, there was negligible correlation between clinical performance and performance on objective measures: shelf exam (R2 = 0.027, p < 0.001), oral exam (R2 = 0.021, p < 0.001), and weekly quizzes (R2 = 0.053, p = 0.092). CONCLUSIONS: Clinical performance does not correlate with objective grading parameters for medical students in the third-year surgery clerkship.

Does a learner-centered approach using teleconference improve medical students' psychological safety and self-explanation in clinical reasoning conferences? a crossover study.

During clinical reasoning case conferences, a learner-centered approach using teleconferencing can create a psychologically safe environment and help learners speak up. This study aims to measure the psychological safety of students who are supposed to self-explain their clinical reasoning to conference participants. This crossover study compared the effects of two clinical reasoning case conference methods on medical students' psychological safety. The study population comprised 4th-5th year medical students participating in a two-week general medicine clinical clerkship rotation, from September 2019 to February 2020. They participated in both a learner-centered approach teleconference and a traditional, live-style conference. Teleconferences were conducted in a separate room, with only a group of students and one facilitator. Participants in group 1 received a learner-centered teleconference in the first week and a traditional, live-style conference in the second week. Participants assigned to group 2 received a traditional, live-style conference in the first week and a learner-centered approach teleconference in the second week. After each conference, Edmondson's Psychological Safety Scale was used to assess the students' psychological safety. We also counted the number of students who self-explained their clinical reasoning processes during each conference. Of the 38 students, 34 completed the study. Six out of the seven psychological safety items were significantly higher in the learner-centered approach teleconferences (p<0.01). Twenty-nine (85.3%) students performed self-explanation in the teleconference compared to ten (29.4%) in the live conference (p<0.01). A learner-centered approach teleconference could improve psychological safety in novice learners and increase the frequency of their self-explanation, helping educators better assess their understanding. Based on these results, a learner-centered teleconference approach has the potential to be a method for teaching clinical reasoning to medical students.

Gender Disparity in Evaluation of Internal Medicine Clerkship Performance.

Importance: Women studying medicine currently equal men in number, but evidence suggests that men and women might not be evaluated equally throughout their education. Objective: To examine whether there are differences associated with gender in either objective or subjective evaluations of medical students in an internal medicine clerkship. Design, Setting, and Participants: This single-center retrospective cohort study evaluated data from 277 third-year medical students completing internal medicine clerkships in the 2017 to 2018 academic year at an academic hospital and its affiliates in Pennsylvania. Data were analyzed from September to November 2020. Exposure: Gender, presumed based on pronouns used in evaluations. Main Outcomes and Measures: Likert scale evaluations of clinical skills, standardized examination scores, and written evaluations were analyzed. Univariate and multivariate linear regression were used to observe trends in measures. Word embeddings were analyzed for narrative evaluations. Results: Analyses of 277 third-year medical students completing an internal medicine clerkship (140 women [51%] with a mean [SD] age of 25.5 [2.3] years and 137 [49%] presumed men with a mean [SD] age of 25.9 [2.7] years) detected no difference in final grade distribution. However, women outperformed men in 5 of 8 domains of clinical performance, including patient interaction (difference, 0.07 [95% CI, 0.04-0.13]), growth mindset (difference, 0.08 [95% CI, 0.01-0.11]), communication (difference, 0.05 [95% CI, 0-0.12]), compassion (difference, 0.125 [95% CI, 0.03-0.11]), and professionalism (difference, 0.07 [95% CI, 0-0.11]). With no difference in examination scores or subjective knowledge evaluation, there was a positive correlation between these variables for both genders (women: r = 0.35; men: r = 0.26) but different elevations for the line of best fit (P < .001). Multivariate regression analyses revealed associations between final grade and patient interaction (women: coefficient, 6.64 [95% CI, 2.16-11.12]; P = .004; men: coefficient, 7.11 [95% CI, 2.94-11.28]; P < .001), subjective knowledge evaluation (women: coefficient, 6.66 [95% CI, 3.87-9.45]; P < .001; men: coefficient, 5.45 [95% CI, 2.43-8.43]; P < .001), reported time spent with the student (women: coefficient, 5.35 [95% CI, 2.62-8.08]; P < .001; men: coefficient, 3.65 [95% CI, 0.83-6.47]; P = .01), and communication (women: coefficient, 6.32 [95% CI, 3.12-9.51]; P < .001; men: coefficient, 4.21 [95% CI, 0.92-7.49]; P = .01). The model based on the men's data also included growth mindset as a significant variable (coefficient, 4.09 [95% CI, 0.67-7.50]; P = .02). For narrative evaluations, words in context with "he or him" and "she or her" differed, with agentic terms used in descriptions of men and personality descriptors used more often for women. Conclusions and Relevance: Despite no difference in final grade, women scored higher than men on various domains of clinical performance, and performance in these domains was associated with evaluators' suggested final grade. The content of narrative evaluations significantly differed by student gender. This work supports the hypothesis that how students are evaluated in clinical clerkships is associated with gender.

A Nationwide Survey Study on Medical Student Experience in Acute Care Surgery.

BACKGROUND: There is little known about medical student education in acute care surgery (ACS)-how much and what type of exposure students receive in the specialty. The aim of this study was to investigate the current status of ACS education provided to students in U.S. medical schools. MATERIALS AND METHODS: We created an online survey tool covering the surgical clerkship and ACS curriculum and distributed this survey to the official email list of the Association for Surgical Education Committee on Clerkship Directors. RESULTS: A total of 57 of 294 (19.4%) responses were received. All respondents reported that at least some of their major teaching hospitals are affiliated with an ACS service and have a level 1 or 2 trauma center. Although almost two-thirds (61.8%) of respondents believe that medical students should have formal ACS education in the form of a clinical rotation, an ACS rotation is mandatory at only 16.4% of programs and is optional at 69.1% of programs as part of the surgical clerkship curriculum. The duration of ACS rotations ranges from 1 to 6 wk, and half of programs require students to take overnight call (most often 1-2 nights/wk). The most common pathologies that students see on ACS include appendicitis, biliary disease and cholecystitis, intestinal obstruction, and trauma. CONCLUSIONS: Medical students across the nation have varying exposure to ACS during their clinical training. With the continued growth of the ACS specialty, further study is warranted to examine the impact of undergraduate ACS education on student career planning.

Clerkship Grading and the U.S. Economy: What Medical Education Can Learn From America's Economic History.

Clerkship grades (like money) are a social construct that function as the currency through which value exchanges in medical education are negotiated between the system's various stakeholders. They provide a widely recognizable and efficient medium through which learner development can be assessed, tracked, compared, and demonstrated and are commonly used to make decisions regarding progression, distinction, and selection for residency. However, substantial literature has demonstrated how grades imprecisely and unreliably reflect the value of learners. In this article, the authors suggest that challenges with clerkship grades are fundamentally tied to their role as currency in the medical education system. Associations are drawn between clerkship grades and the history of the U.S. economy; 2 major concepts are highlighted: regulation and stock prices. The authors describe the history of these economic concepts and how they relate to challenges in clerkship grading. Using lessons learned from the history of the U.S. economy, the authors then propose a 2-step solution to improve upon grading for future generations of medical students: (1) transition from grades to a federally regulated competency-based assessment model and (2) development of a departmental competency letter that incorporates competency-based assessments rather than letter grades and meets the needs of program directors.

Are We Measuring What Matters? How Student and Clerkship Characteristics Influence Clinical Grading.

PURPOSE: Given the growing emphasis placed on clerkship performance for residency selection, clinical evaluation and its grading implications are critically important; therefore, the authors conducted this study to determine which evaluation components best predict a clinical honors recommendation across 3 core clerkships. METHOD: Student evaluation data were collected during academic years 2015-2017 from the third-year internal medicine (IM), pediatrics, and surgery clerkships at the University of Alabama at Birmingham School of Medicine. The authors used factor analysis to examine 12 evaluation components (12 items), and they applied multilevel logistic regression to correlate evaluation components with a clinical honors recommendation. RESULTS: Of 3,947 completed evaluations, 1,508 (38%) recommended clinical honors. The top item that predicted a clinical honors recommendation was clinical reasoning skills for IM (odds ratio [OR] 2.8; 95% confidence interval [CI], 1.9 to 4.2; P < .001), presentation skills for surgery (OR 2.6; 95% CI, 1.6 to 4.2; P < .001), and knowledge application for pediatrics (OR 4.8; 95% CI, 2.8 to 8.2; P < .001). Students who spent more time with their evaluators were more likely to receive clinical honors (P < .001), and residents were more likely than faculty to recommend clinical honors (P < .001). Of the top 5 evaluation items associated with clinical honors, 4 composed a single factor for all clerkships: clinical reasoning, knowledge application, record keeping, and presentation skills. CONCLUSIONS: The 4 characteristics that best predicted a clinical honors recommendation in all disciplines (clinical reasoning, knowledge application, record keeping, and presentation skills) correspond with traditional definitions of clinical competence. Structural components, such as contact time with evaluators, also correlated with a clinical honors recommendation. These findings provide empiric insight into the determination of clinical honors and the need for heightened attention to structural components of clerkships and increased scrutiny of evaluation rubrics.

A Required, Combined Neurology-Physical Medicine and Rehabilitation Clerkship Addresses Clinical and Health Systems Knowledge Gaps for Fourth-Year Medical Students.

ABSTRACT: This study evaluated the impact of a 4-wk mandatory neurology-physical medicine and rehabilitation advanced-core clerkship for fourth-year medical students. The combined clerkship encouraged an interdisciplinary and function-based approach to the management of common neurologic, musculoskeletal, and pain complaints. Seventy-three fourth-year medical students participated in the rotation over 1 yr. A survey assessing knowledge and skill set topics was conducted before and after the clerkship. Qualitative feedback regarding the rotation was provided by the students and analyzed. Significant gaps in knowledge and skill sets were identified before the clerkship and successfully addressed by combined teaching modalities. These data demonstrate that an integrated neurology-physical medicine and rehabilitation clerkship can improve students' confidence in multiple domains. Integrating physical medicine and rehabilitation into core clerkships at other medical schools may provide an avenue to address curriculum gaps.

Evaluating Core Clerkships: Lessons Learned From Implementing a Student-Driven Feedback System for Clinical Curricula.

PROBLEM: Medical schools have implemented various ways to engage students in improving medical curricula. These systems, however, usually focus on the preclerkship curriculum, perhaps because medical students move through this phase of medical education synchronously, making it easier to collect student input. In contrast, clerkship and postclerkship curricula often lack similar levels of student engagement in program evaluation. APPROACH: To increase communication among students, faculty, and administration during the clinical years of medical education, the Student Curricular Board (SCB) at the University of Illinois College of Medicine's Chicago campus (UICOM-Chicago) developed a student-driven feedback model in 2016 that aimed to parallel the system previously implemented in the preclerkship years. Interested fourth-year students were selected by their peers to represent individual core clerkships, and they communicated regularly with clerkship directors about concerns from current clerkship students. Third-year students applied and were selected to represent their cohort of peers moving through clerkship tracks. Proposed changes and improvements were tracked via novel, student-driven SOAP-Education (SOAP-Ed) progress notes written throughout the academic year. OUTCOMES: In response to a program evaluation survey conducted after implementation of this pilot, third-year students said they felt that their feedback was taken seriously by faculty and administration. Furthermore, student feedback led to meaningful changes in core clerkship curricula and in the system used to gather clerkship feedback. Clerkship directors expressed appreciation for this partnership, and students said they gained valuable leadership experience and knowledge of curricular development. NEXT STEPS: Current SCB members and curricular leadership plan to assess student and faculty perceptions of this system and its efficacy and work toward expansion to all UICOM campuses. Lessons learned from this student-driven model of feedback in third-year core clerkships will likely add to the conversation on how to better engage medical students as active stakeholders in their own education.

Determining Grades in the Internal Medicine Clerkship: Results of a National Survey of Clerkship Directors.

PURPOSE: Trust in and comparability of assessments are essential in clerkships in undergraduate medical education for many reasons, including ensuring competency in clinical skills and application of knowledge important for the transition to residency and throughout students' careers. The authors examined how assessments are used to determine internal medicine (IM) core clerkship grades across U.S. medical schools. METHODS: A multisection web-based survey of core IM clerkship directors at 134 U.S. medical schools with membership in the Clerkship Directors in Internal Medicine was conducted in October through November 2018. The survey included a section on assessment practices to characterize current grading scales used, who determines students' final clerkship grades, the nature/type of summative assessments, and how assessments are weighted. Respondents were asked about perceptions of the influence of the National Board of Medical Examiners (NBME) Medicine Subject Examination (MSE) on students' priorities during the clerkship. RESULTS: The response rate was 82.1% (110/134). There was considerable variability in the summative assessments and their weighting in determining final grades. The NBME MSE (91.8%), clinical performance (90.9%), professionalism (70.9%), and written notes (60.0%) were the most commonly used assessments. Clinical performance assessments and the NBME MSE accounted for the largest percentage of the total grade (on average 52.8% and 23.5%, respectively). Eighty-seven percent of respondents were concerned that students' focus on the NBME MSE performance detracted from patient care learning. CONCLUSIONS: There was considerable variability in what IM clerkships assessed and how those assessments were translated into grades. The NBME MSE was a major contributor to the final grade despite concerns about the impact on patient care learning. These findings underscore the difficulty in comparing learners across institutions and serve to advance discussions for how to improve accuracy and comparability of grading in the clinical environment.

The Influence of an Acting or Subintern on Third-Year Medical School Surgery Clerkship Students.

BACKGROUND: Previous reports demonstrated a positive relationship between the surgical clerkship and student likelihood of pursuing a surgical career, but no studies have examined the influence a peer has on comfort during a surgical clerkship. We hypothesized that a fourth-year acting intern (AI) would positively impact third-year medical students' experience during their surgical clerkship. METHODS: All third-year medical students at our institution who completed their surgical clerkship in 2019 were surveyed regarding the preclerkship and postclerkship perceptions. RESULTS: Of the 110 students surveyed, 52 responded (47.3% response rate), and 25 students (48.1%) reported having an AI during their clerkship rotation, and 27 did not (51.9%). Presence of an AI had no significant effect on the postclerkship perception of surgery, likelihood of pursuing general surgery, or comfort in the OR. Analysis of all responses demonstrated the surgery clerkship had no significant impact on students' perception of surgery or likelihood of pursuing general surgery but did statistically increase students' comfort in the OR. CONCLUSIONS: The results of this study suggest that AI presence did not significantly influence a student's clerkship experience or comfort in the OR. Further studies are needed to determine what, if any effect, an AI could have on third-year clerkship students.

"There Is a Lot of Change Afoot": A Qualitative Study of Faculty Adaptation to Elimination of Tiered Grades With Increased Emphasis on Feedback in Core Clerkships.

PURPOSE: Medical schools responding to challenges with fairness, equity, learning environments, and student wellness have reconsidered clerkship grades. This study used the Concerns-Based Adoption Model (CBAM) to explore how faculty responded to a change in the approach to assessment from focus on grades toward focus on feedback. METHOD: This qualitative study used an inductive approach to analyze data from semistructured interviews with teaching faculty and education leaders at University of California, San Francisco, School of Medicine 6 months following the elimination of traditional tiered clerkship grades. Participants were recruited in 2019 using purposive sampling. Interview questions addressed participants' perceptions of the new approach to assessment and grading that emphasizes assessment for learning, including advantages and concerns. The authors analyzed data using thematic analysis informed by sensitizing concepts from CBAM. RESULTS: Nineteen faculty participated (11 medicine, 8 surgery). Faculty expressed optimism about the impact of the change on their clinical educator roles and sought faculty development to enhance feedback and assessment skills. Perceived benefits to students addressed learning and wellness, with concern for students' motivation and professional development. Faculty shared uncertainty about their roles and larger systemic consequences involving the residency match and institutional reputation. Participants acknowledged that traditional grading is imperfect, yet felt a departure from this system represented significant culture change. CONCLUSIONS: Faculty perceptions of the assessment and grade change in 2 large departments demonstrated tensions around grading. Their descriptions of change as an ongoing process aligned with CBAM and required them to consider new approaches and perspectives. While discourse about assessment and grading frequently focuses on learners, these findings support institutional consideration of the impact of changes in assessment on teaching faculty.

Medical students' reflections on surgical educators' professionalism: Contextual nuances in the hidden curriculum.

INTRODUCTION: Surgical educators' professional behavior constitutes a hidden curriculum and impacts trainee's professional identity formation. This study explores the nuances of professional behaviors as observed in varying surgical settings. METHODS: 411 Transcripts originated from essays written by MS3 students during their surgical clerkship from 2010 to 2016 were collated. Employing a qualitative research methodology, we conducted a thematic analysis to uncover specific meaning emerging from medical student reflections' on surgical professionalism. RESULTS: In clinics, taking time and protecting patient privacy; in the OR, control over emotion during difficult situations and attention to learners; and in the inpatient setting, showing accountability above normal expected behavior were noted as professional. Similarly, unprofessional behaviors in these contexts paralleled lack of these attributes. CONCLUSIONS: Behaviors observed and the attributes of professionalism in the surgical learning environment have contextual nuances. These variations in professionalism can be utilized in deliberate development of professionalism in surgery.

Shortened pre-clerkship medical school curriculum associated with reduced student performance on surgery clerkship shelf exam.

BACKGROUND: Many U.S. medical schools are modifying their curricula with limited understanding of the impact on students' clinical knowledge. METHODS: The surgical rotations and Surgery Shelf Exam score reports of 1514 students at a single medical school over nine academic years (2010-2018), which included a four-year transition period to a condensed pre-clerkship curriculum. Subject-specific results were compared by rotation type using Mann-Whitney tests. Regression analysis was used to assess the relationship between scores and time. RESULTS: Data from 1514 students were included. Shelf scores decreased each year of the transition curriculum compared to the reference year (2014-2015). However, clinical exposure to specific rotations resulted in better scores in related shelf subjects. For example, students who rotated on Vascular Surgery achieved statistically better scores on the related subject than their colleagues (3.62 vs. 3.44; p = 0.0014). CONCLUSIONS: The transition curriculum was associated with a lower performance on the surgical shelf exam when compared to the traditional curriculum, regardless of when surgery was taken during their clerkship year.

Washington University School of Medicine in St. Louis Case Study: A Process for Understanding and Addressing Bias in Clerkship Grading.

In 2018, in response to a news story featuring the Icahn School of Medicine's decision to eliminate its chapter of Alpha Omega Alpha (AOA) due to perceived racial inequities, students at Washington University School of Medicine in St. Louis (WUSM) brought similar concerns to leadership. WUSM leadership evaluated whether students' race, ethnicity, and gender were associated with their receipt of honors in the 6 core clerkships, key determinants of AOA selection. In preliminary analysis of the school's data, statistically significant racial and ethnic disparities were associated with receipt of honors in each clerkship. Leaders shared these findings with the WUSM community along with a clear message that such discrepancies are unacceptable to the school. An effort to further analyze what lay behind the findings as well as to identify steps to resolve the problem was launched. Using a quality improvement framework, data from focus groups and student surveys were analyzed and 2 overarching themes emerged. Students perceived that both assessment and the learning environment impacted racial/ethnic disparities in clerkship grades. In multivariable logistic regression models, shelf exam scores (a part of student assessment) were found to be associated with receipt of honors in each clerkship; in some (but not all) clerkships, shelf exam scores attenuated the effect of race/ethnicity on receipt of honors, so that when the shelf scores were added to the model, the race/ethnicity effect was no longer significant. This case study describes WUSM's process to understand and address bias in clerkship grading and AOA nomination so that other medical schools might benefit from what has been learned.