Medical Error Disclosure: An Entrustable Professional Activity During an Objective Standardized Clinical Examination for Clerkship Students.

Introduction: Most health care providers will be involved in a medical error during their careers. It is critical that future physicians receive formal training on error disclosure. Methods: We designed a formative skills-based objective standardized clinical exam (OSCE) for fourth-year medical students to assess competence in disclosing an error during a required entrustable professional activity. Faculty observed the encounter and completed a checklist evaluating students' performance in communication skills and content knowledge. Students received immediate formative feedback. They then participated in a facilitated case-based experience, discussed the critical elements of disclosure, utilized role-play to reinforce skills, and reflected on self-care practices. Finally, students completed a survey evaluating their perception of the OSCE's impact on their disclosure knowledge, skills, and attitudes. Results: Ninety-two students participated in the OSCE. Of those, 67 (73%) completed a retrospective pre/post survey assessing their disclosure knowledge, skills, and attitudes. Forty-one (62%) did not identify the error. Students who identified the error (26, 39%) were more likely to use the two-patient identifier than students who did not identify the error, χ2(1) = 13.3, p < .001. Self-reported comfort and confidence in disclosure improved, as did self-care practices (ps ≤ .005). Discussion: Students agreed that health care providers should disclose an error and know how to do so. Student self-reported comfort in disclosure and knowledge of how to disclose and how to report an error all improved following the OSCE and structured debrief. The OSCE and case-based experience can be adapted for implementation in curricula about error disclosure.

What have we learned about constructed response short-answer questions from students and faculty? A multi-institutional study.

PURPOSE: The purpose of this study was to enrich understanding about the perceived benefits and drawbacks of constructed response short-answer questions (CR-SAQs) in preclerkship assessment using Norcini's criteria for good assessment as a framework. METHODS: This multi-institutional study surveyed students and faculty at three institutions. A survey using Likert scale and open-ended questions was developed to evaluate faculty and student perceptions of CR-SAQs using the criteria of good assessment to determine the benefits and drawbacks. Descriptive statistics and Chi-square analyses are presented, and open responses were analyzed using directed content analysis to describe benefits and drawbacks of CR-SAQs. RESULTS: A total of 260 students (19%) and 57 faculty (48%) completed the survey. Students and faculty report that the benefits of CR-SAQs are authenticity, deeper learning (educational effect), and receiving feedback (catalytic effect). Drawbacks included feasibility, construct validity, and scoring reproducibility. Students and faculty found CR-SAQs to be both acceptable (can show your reasoning, partial credit) and unacceptable (stressful, not USMLE format). CONCLUSIONS: CR-SAQs are a method of aligning innovative curricula with assessment and could enrich the assessment toolkit for medical educators.

Consolidation Carnival: A Case-Based Approach to Reviewing Musculoskeletal Anatomy in an Undergraduate Medical Curriculum.

Introduction: Recent changes in undergraduate medical curricula have resulted in time constraints that are particularly challenging, especially when students must learn large blocks of musculoskeletal anatomy content. Consequently, students have resorted to rote memorization to cope, which counteracts our established collaborative self-directed learning model. Methods: For a 6-week musculoskeletal anatomy course, two structured case-based review sessions are described, each following the completion of two five-hour lab sessions, two on the upper extremities and two on the lower extremities. These largely self-directed review sessions consisted of 6 students rotating through 7 to 8 stations every 10 minutes where clinical cases with follow-up questions were projected on large screens. The students were expected to work collaboratively to solve the cases utilizing the prosected specimens provided and discuss the accompanying answers at the end of each case. Results: Ninety-four per cent of the students who participated in this study agreed that the case-based review sessions provided a helpful overview of musculoskeletal anatomy content. Student performance on the open-ended, case-based musculoskeletal examination questions showed no significant difference in performance on shoulder, hand, hip, thigh, and leg questions. There was, however, a statistically significant decrease in the students' scores on a forearm question in 2021 compared to 2019. Conclusion: This paper describes our integrated, collaborative musculoskeletal course, including case-based review sessions, which was positively received by students as having value in reviewing the musculoskeletal content though it was not found to improve examination performance.

Strategies to support self-regulated learning in integrated, student-centered curricula.

PURPOSE: With undergraduate medical education shifting to an integrated, student-centered approach, self-regulated learning (SRL) skills are critical for student success. Educational research holds that learning strategy effectiveness is context dependent. Our study aims to explore what strategies medical students use to support SRL when engaged in the specific context of an integrated, student-centered curriculum. APPROACH: This study took place in two medical schools with integrated, student-centered curricula. Semi-structured interviews were conducted with first-year medical students from both schools, asking them to reflect on the learning strategies they used throughout their first year of medical school. Interview data was analyzed first deductively using the SRL framework and then inductively to understand the specific strategies being used. FINDINGS: Students engaged in strategies to support SRL in ways that were unique to the integrated, student-centered context. We found that medical students developed strategies to plan for integration and building connections across material during all three phases of self-regulated learning. INSIGHTS: By identifying specific tasks and behaviors students utilized during their first year of medical school, this study provides a roadmap that students and educators can use to help students become self-regulated learners.

Comparing the effectiveness of asynchronous e-modules and didactic lectures to teach electrocardiogram interpretation to first year US medical students.

BACKGROUND: Medical students are expected to be competent in interpreting electrocardiograms (ECGs) by the time they graduate, but many are unable to master this skill. Studies suggest that e-modules are an effective way to teach ECG interpretation, however they are typically evaluated for use during clinical clerkships. We sought to determine if an e-module could replace a didactic lecture to teach ECG interpretation during a preclinical cardiology course. METHODS: We developed an asynchronous, interactive e-module that consisted of narrated videos, pop-up questions and quizzes with feedback. Participants were first year medical students who were either taught ECG interpretation during a 2-hour didactic lecture (control group) or were given unlimited access to the e-module (e-module group). First-year internal medicine residents (PGY1 group) were included to benchmark where ECG interpretation skills should be at graduation. At three time-points (pre-course, post-course, and 1-year follow-up), participants were evaluated for ECG knowledge and confidence. A mixed-ANOVA was used to compare groups over time. Students were also asked to describe what additional resources they used to learn ECG interpretation throughout the study. RESULTS: Data was available for 73 (54%) students in the control group, 112 (81%) in the e-module group and 47 (71%) in the PGY1 group. Pre-course scores did not differ between the control and e-module groups (39% vs. 38%, respectively). However, the e-module group performed significantly better than the control group on the post-course test (78% vs. 66%). In a subsample with 1-year follow-up data, the e-module group's performance decreased, and the control group remained the same. The PGY1 groups' knowledge scores were stable over time. Confidence in both medical student groups increased by the end of the course, however only pre-course knowledge and confidence were significantly correlated. Most students relied on textbooks and course materials for learning ECG, however online resources were also utilized. CONCLUSIONS: An asynchronous, interactive e-module was more effective than a didactic lecture for teaching ECG interpretation, however continued practice is needed regardless of how students learn to interpret ECGs. Various ECG resources are available to students to support their self-regulated learning.

Utilization of Video Otoscopes for Otoscopy Skills Training of Third Year Medical Students.

Purpose: Effective teaching and assessment of otologic examinations are challenging. Current methods of teaching otoscopy using traditional otoscopes have significant limitations. We hypothesized that use of all-in-one video otoscopes provides students with an opportunity for real-time faculty feedback and re-practicing of skills, increasing self-reported confidence. Methods: An otoscopy microskills competency checklist was provided to third-year medical students during their pediatric clerkship to self-assess otoscopy technique during patient examinations, and to clinical preceptors to assess and provide feedback during exams. Over the course of two years, we collected data from students randomly assigned to train on a video otoscope or a traditional otoscope during the clerkship. Pre- and post-clerkship surveys measured confidence in performing otoscopy microskills, making a diagnosis and documentation of findings. For those students who trained on the video otoscope, we solicited post-clerkship feedback on the experience of using a video otoscope. Results: Pre-clerkship confidence did not differ between the groups, but the video otoscope trained group had significantly higher scores than the traditional otoscope trained group on all self-reported technical and diagnostic microskills confidence questions items post-clerkship. Students trained on video otoscopes had a significant increase in confidence with all microskills items (p-values<0.001), however confidence in the traditional otoscope trained group did not change over time (p-values>0.10). Qualitative feedback from the video otoscope trained group reflected positive experiences regarding "technique/positioning" and "feedback from preceptors.". Conclusion: Teaching otoscopy skills to pediatric clerkship medical students using a video otoscope significantly enhanced confidence compared to those training on a traditional otoscope by 1. enabling preceptors and students to simultaneously visualize otoscopy findings 2. allowing preceptors to provide real-time feedback and 3. providing opportunity for deliberate practice of microskills. We encourage the use of video otoscopes to augment student confidence and self-efficacy when training in otoscopy.

Comparison of the Multiple Mini-Interview and the Traditional Interview in Medical School Admissions: Lessons Learned Using a Hybrid Model at One Institution.

PURPOSE: Medical school admissions interviews are a critical form of assessment; however, the most effective interview strategy is debated. This study compares the traditional interview (TI) and multiple mini-interview (MMI) within a hybrid TI-MMI model at one medical school to determine whether the interview approaches reveal different information about applicants and whether a hybrid model results in a more diversified applicant pool. METHOD: Admissions data from 3 application cycles at the Donald and Barbara Zucker School of Medicine at Hofstra/Northwell were used. The TI was used in 2017-2018 and the hybrid TI-MMI model in 2018-2019 and 2019-2020. Applicants were scored on a 5-point scale and referred to a voting committee for acceptance consideration if interview scores met threshold criteria. Changes in the number of students referred to the committee using the TI vs the TI-MMI score criteria were analyzed. RESULTS: In 2017-2018 (TI only), 683 applicants were interviewed; in 2018-2019 (TI-MMI), 844 applicants were interviewed; and in 2019-2020 (TI-MMI), 805 applicants were interviewed. Medium correlations were found between total MMI and TI scores in 2018-2019 ( ρ = 0.37, P < .001) and 2019-2020 ( ρ = 0.33, P < .001). No differences were found in TI scores between 2017-2018 and 2018-2019 ( P = .30), but TI scores were significantly lower in 2019-2020 vs 2017-2018 ( P < .001) and 2018-2019 ( P = .002). Overall, a 10% to 18% increase was found in the number of applicants referred to the voting committee when using hybrid criteria, with a 19% to 27% increase in underrepresented in medicine applicants. CONCLUSIONS: The TI-MMI model may allow for a more holistic interview approach and an expanded pool of applicants, particularly underrepresented in medicine applicants, considered for acceptance.

Teaching Second-Year Medical Students How to Counsel Pediatric Patients With Unhealthy Body Mass Index.

Obesity affects the health and well-being of children globally. Despite recommendations to routinely screen children for obesity starting at age 6 years, physicians do not consistently address weight or provide effective weight-management counseling. We developed an interactive session for second-year medical students with foundational knowledge and practical communication skills around partnership and discussion of pediatric healthy weight management. Students were administered a pre-/post-Likert survey to self-assess knowledge, comfort, and confidence in counseling patients and caregivers about weight management. Students' related counseling skills were assessed during a standardized patient encounter of a teen with rapid weight gain. The session successfully increased students' self-assessed knowledge, comfort, and confidence, and resulted in successful application of weight management skills in a simulated patient encounter. Utilization of empathy skills requires continued coaching. We propose incorporation of similar sessions into medical school curricula to address the pediatric obesity epidemic.

A Multi-institutional Study of the Feasibility and Reliability of the Implementation of Constructed Response Exam Questions.

PROBLEM: Some medical schools have incorporated constructed response short answer questions (CR-SAQs) into their assessment toolkits. Although CR-SAQs carry benefits for medical students and educators, the faculty perception that the amount of time required to create and score CR-SAQs is not feasible and concerns about reliable scoring may impede the use of this assessment type in medical education. INTERVENTION: Three US medical schools collaborated to write and score CR-SAQs based on a single vignette. Study participants included faculty question writers (N = 5) and three groups of scorers: faculty content experts (N = 7), faculty non-content experts (N = 6), and fourth-year medical students (N = 7). Structured interviews were performed with question writers and an online survey was administered to scorers to gather information about their process for creating and scoring CR-SAQs. A content analysis was performed on the qualitative data using Bowen's model of feasibility as a framework. To examine inter-rater reliability between the content expert and other scorers, a random selection of fifty student responses from each site were scored by each site's faculty content experts, faculty non-content experts, and student scorers. A holistic rubric (6-point Likert scale) was used by two schools and an analytic rubric (3-4 point checklist) was used by one school. Cohen's weighted kappa (κw) was used to evaluate inter-rater reliability. CONTEXT: This research study was implemented at three US medical schools that are nationally dispersed and have been administering CR-SAQ summative exams as part of their programs of assessment for at least five years. The study exam question was included in an end-of-course summative exam during the first year of medical school. IMPACT: Five question writers (100%) participated in the interviews and twelve scorers (60% response rate) completed the survey. Qualitative comments revealed three aspects of feasibility: practicality (time, institutional culture, teamwork), implementation (steps in the question writing and scoring process), and adaptation (feedback, rubric adjustment, continuous quality improvement). The scorers' described their experience in terms of the need for outside resources, concern about lack of expertise, and value gained through scoring. Inter-rater reliability between the faculty content expert and student scorers was fair/moderate (κw=.34-.53, holistic rubrics) or substantial (κw=.67-.76, analytic rubric), but much lower between faculty content and non-content experts (κw=.18-.29, holistic rubrics; κw=.59-.66, analytic rubric). LESSONS LEARNED: Our findings show that from the faculty perspective it is feasible to include CR-SAQs in summative exams and we provide practical information for medical educators creating and scoring CR-SAQs. We also learned that CR-SAQs can be reliably scored by faculty without content expertise or senior medical students using an analytic rubric, or by senior medical students using a holistic rubric, which provides options to alleviate the faculty burden associated with grading CR-SAQs.

Exploring the impact of postponing core clerkships on future performance.

Despite the many clerkship models of medical education, all can be considered a form of experiential learning. Experiential learning is a complex pedagogical approach involving the development of cognitive skills in an environment with a unique culture with multiple stakeholders, which may impact learner motivation, confidence, and other noncognitive drivers of success. Students may delay the transition to the clerkship year for myriad reasons, and the intricate nature of experiential learning suggested this may impact student performance. This retrospective, observational study investigated the impact of clerkship postponement by measuring subsequent clerkship performance. Pre-clerkship and third-year clerkship performance were analyzed for three cohorts of students (classes of 2018, 2019, and 2020, N = 274) where students had the option to delay the start of their clerkship year. A mixed analysis of variance (ANOVA) and paired t-tests were conducted to compare academic performance over time among students who did and did not delay. Across three cohorts of students, 12% delayed the start of the clerkship year (N = 33). Regardless of prior academic performance, these students experienced a significant reduction in clerkship grades compared to their non-delaying peers. Delaying the start of the clerkship year may have negative durable effects on future academic performance. This information should be kept in mind for student advisement.

A Generalizable Approach to Predicting Performance on USMLE Step 2 CK.

Introduction: The elimination of the USMLE Step 1 three-digit score has created a deficit in standardized performance metrics for undergraduate medical educators and residency program directors. It is likely that there will be greater emphasis on USMLE Step 2 CK, an exam found to be associated with later clinical performance in residents and physicians. Because many previous models relied on Step 1 scores to predict student performance on Step 2 CK, we developed a model using other metrics. Materials and Methods: Assessment data for 228 students in three cohorts (classes of 2018, 2019, and 2020) were collected, including the Medical College Admission Test (MCAT), NBME Customized Assessment Service (CAS) exams and NBME Subject exams. A linear regression model was conducted to predict Step 2 CK scores at five time-points: at the end of years one and two and at three trimester intervals in year three. An additional cohort (class of 2021) was used to validate the model. Results: Significant models were found at 5 time-points in the curriculum and increased in predictability as students progressed: end of year 1 (adj R2 = 0.29), end of year 2 (adj R2 = 0.34), clerkship trimester 1 (adj R2 = 0.52), clerkship trimester 2 (adj R2 = 0.58), clerkship trimester 3 (adj R2 = 0.62). Including Step 1 scores did not significantly improve the final model. Using metrics from the class of 2021, the model predicted Step 2 CK performance within a mean square error (MSE) of 8.3 points (SD = 6.8) at the end of year 1 increasing predictability incrementally to within a mean of 5.4 points (SD = 4.1) by the end of year 3. Conclusion: This model is highly generalizable and enables medical educators to predict student performance on Step 2 CK in the absence of Step 1 quantitative data as early as the end of the first year of medical education with increasingly stronger predictions as students progressed through the clerkship year.

4Ms for Early Learners: A Skills-Based Geriatrics Curriculum for Second-Year Medical Students.

Introduction: Given the growing population of older adults, it is of utmost importance for all future physicians to be trained in the core skills of conducting geriatric assessment. Methods: We designed an interactive, skills-based session introducing core competencies for geriatric assessment for second-year medical students (MS2s). We organized our curriculum for early learners based on the 4Ms framework: mind/memory, medications, mobility, and matters most. The session consisted of brief didactics with integration of real-time skills-based practice. Students completed pre- and postsession surveys to assess their confidence in their knowledge and skills. All students completed a geriatric assessment during a clinical skills encounter as part of a multistation, end-of-course, summative clinical skills examination (CSE). The session was conducted virtually over 2 academic years, and the CSE was conducted virtually in 2020 and in person in 2021. Results: One hundred ninety-nine MS2s participated in the session (100 in 2020, 99 in 2021). All students surveyed (33%) reported improved confidence in geriatric knowledge and skills by the end of the session (ps < .001). Students were more likely to use a cognitive screening tool, ask about advance care planning, and assess medication adherence on the CSE in 2021 compared to 2020 (ps < .001). Discussion: We provide an interactive curriculum for MS2s to develop geriatric assessment skills. The curriculum and assessment tools are versatile, can be easily integrated into any medical school curriculum, and can be effectively delivered in person or on a virtual platform.

Analysis of a Near Peer Tutoring Program to Improve Medical Students' Note Writing Skills.

Problem: The ability to document a patient encounter is integral for any physician. Previous studies indicate that medical students' note writing skills are poor due to a lack of formal clinical documentation instruction. Barriers to formally teaching students how to write patient notes include the significant time burden and variability in faculty feedback. Implementing a near-peer teaching program to teach students how to write a patient note can overcome these barriers and fill this curricular gap. Intervention: Fourth year medical students who completed a Teaching in Medicine elective course were trained to provide individual feedback to 1st and 2nd year students on note writing as a part of their Introduction to Clinical Medicine course. In order to determine the effect of this two year, near-peer feedback program on note writing skills, we analyzed students' scores on the note writing portion of two Objective Structured Clinical Exams that took place at the end of the 2nd and 3rd years of medical school. Context: The near-peer feedback sessions were implemented in the Fall of 2013 during the preclinical years of the medical school curriculum. Data from students who received near-peer feedback (N = 112) were compared to a historical control group who did not receive near-peer feedback on their note writing (N = 110). Objective Structured Clinical Exam scores that were specific to note writing skills, including the history, physical exam, and differential diagnosis subscales were examined. Impact: The near-peer feedback had a positive impact on the quality of patient notes. On the end of the 2nd year Objective Structured Clinical Exam, the near-peer feedback intervention group outperformed the no feedback group on the history and physical exam subscale scores but not on the differential diagnosis subscale score. One year later, the near-peer feedback intervention group continued to outperform the no feedback group on the physical exam subscale score, but not the history or the differential diagnosis subscale scores. Lessons Learned: Near-peer teaching improves student documentation of the history and physical exam, however only the effects on the physical exam portion persist into the clinical years of training. Writing up a differential diagnosis is a skill that develops through the clerkship experience regardless of exposure to feedback in the preclinical years. Implementing near-peer teaching in the medical school setting is feasible and can provide students with valuable learning experiences without relying on clinical faculty.

Reading and Study Habits of Medical Students on Clerkships and Performance Outcomes: a Multi-institutional Study.

PURPOSE: To describe medical students' reading habits and resources used during clinical clerkships, and to assess whether these are associated with performance outcomes. METHOD: Authors administered a cross-sectional survey to medical students at 3 schools midway through the clerkship year. Closed and open-ended questions focused on resources used to read and learn during the most recent clerkship, time spent and purpose for using these resources, influencers on study habits, and barriers. A multiple regression model was used to predict performance outcomes. RESULTS: Overall response rate was 53% (158/293). Students spent most of their time studying for clerkship exams and rated question banks and board review books as most useful for exam preparation. Sixty-seven percent used textbooks (including pocket-size). For patient care, online databases and pocket-sized textbooks were rated most useful. The main barrier to reading was time. Eighty percent of students ranked classmates/senior students as most influential regarding recommended resources. Hours spent reading for exams was the only significant predictor of USMLE Step 2 scores related to study habits. The predominant advice offered to future students was to read. CONCLUSIONS: These findings can help inform students and educational leadership about resources students use, how they use them, and links to performance outcomes, in an effort to guide them on maximizing learning on busy clerkships. With peers being most influential, it is important not only to provide time to help students build strong reading and study habits early, but also to guide them towards reliable resources, so they will recommend useful information to others.

Impact of an Expansion of a Clinical Nutrition Curriculum on Pre-Clerkship Medical Students' Perception of Their Knowledge and Skills Related to Performing a Nutritional Assessment.

Learning how to provide nutritional counseling to patients should start early in undergraduate medical education to improve the knowledge, comfort, and confidence of physicians. Two nutrition workshops were developed for first-year medical students. The first workshop, co-led by physicians and registered dieticians, focused on obtaining nutrition assessments. The second workshop focused on the appropriate dietary counseling of patients with chronic kidney disease and cardiovascular risk. We surveyed students before workshop 1, after workshop 1, and after workshop 2 to assess their perceptions of the value of physician nutrition knowledge and counseling skills as well as their own comfort in the area of nutritional knowledge, assessment, and counseling. We found a significant improvement in their self-assessed level of knowledge regarding counseling patients, in their comfort in completing a nutritional assessment, and in their confidence in advising a patient about nutrition by the end of the first workshop. By the time of the second workshop five months later, students continued to report a high level of knowledge, comfort, and confidence. The implementation of clinical nutrition workshops with a focus on assessment, management, and counseling was found to be effective in increasing student's self-assessed level of knowledge as well as their confidence and comfort in advising patients on nutrition. Our findings further support the previous assertion that clinical nutrition education can be successfully integrated into the pre-clerkship medical school curriculum.

Student Perception of Case-based Teaching by Near-Peers and Faculty during the Internal Medicine Clerkship: A Noninferiority Study.

INTRODUCTION: Third-year medical students traditionally receive their didactic or small group teaching sessions from clinical faculty during clerkship rotations. Near-peer teaching is increasingly recognized as an acceptable method for teaching, however most near-peer teaching takes place during the pre-clinical curriculum. We sought to determine if fourth year medical students were noninferior to faculty in facilitating small group discussions during clerkship rotations. METHODS: Seventy-five third-year medical students participated in a small group session focused on rheumatologic diseases during their internal medicine clerkship rotation. Students were taught by fourth-year medical students who self-selected to participate as near-peer teachers at 1 clinical site (near-peers, N = 36) and by clinical faculty at another site (N = 39). At the end of the session, third-year medical students completed a survey evaluating teacher performance and effectiveness. RESULTS: There was no significant difference between the 2 groups on each of the 17 survey items assessing teacher performance, the total teaching performance score, and the teaching effectiveness rating (all P-values >.05). A mean between-group difference of 2% in favor of the near-peers indicated noninferiority of the near-peer teachers compared with faculty teachers on the total teaching performance score. An absolute difference of 14% in favor of the near-peers indicated noninferiority of the near-peer teachers compared with faculty teachers on the teaching effectiveness score. Near-peer teachers reported several benefits, including improving their own medical knowledge and skills as a future educator. DISCUSSION: Our data supports the noninferiority of the perceived performance and effectiveness of near-peer teachers compared to faculty teachers in the clerkship setting. Adding near-peer teachers to the clerkship setting is feasible and can be beneficial to all stakeholders.

Third year medical students impersonalize and hedge when providing negative upward feedback to clinical faculty.

Medical students provide clinical teaching faculty with feedback on their skills as educators through anonymous surveys at the end of their clerkship rotation. Because faculty are in a position of power, students are hesitant to provide candid feedback. Our objective was to determine if medical students were willing to provide negative upward feedback to clinical faculty and describe how they conveyed their feedback. A qualitative analysis of third year medical students' open-ended comments from evaluations of six clerkships was performed using politeness theory as a conceptual framework. Students were asked to describe how the clerkship enhanced their learning and how it could be improved. Midway through the academic year, instructions to provide full names of faculty/residents was added. Overall, there were significantly more comments on what worked well than suggestions for improvement regarding faculty/residents. Instructing students to name-names increased the rate of naming from 35% to 75% for what worked well and from 13% to 39% for suggestions for improvement. Hedging language was included in 61% of suggestions for improvement, but only 2% of what worked well. Students described the variability of their experience, used passive language and qualified negative experiences with positive ones. Medical students may use linguistic strategies, such as impersonalizing and hedging, to mitigate the impact of negative upward feedback. Working towards a culture that supports upward feedback would allow students to feel more comfortable providing candid comments about their experience.

Review of the Medical Student Performance Evaluation: analysis of the end-users' perspective across the specialties.

The Medical Student Performance Evaluation (MSPE) is an important tool of communication used by program directors to make decisions in the residency application process. To understand the perspective and usage of the MSPE across multiple medical specialties now and in anticipation of the planned changes in USMLE Step 1 score-reporting. A survey instrument including quantitative and qualitative measures was developed and piloted. The final survey was distributed to residency programs across 28 specialties in 2020 via the main contact on the ACGME listserv. Of the 28 specialties surveyed, at least one response was received from 26 (93%). Eight percent of all programs (364/4675) responded to the survey, with most respondents being program directors. Usage of the MSPE varied among specialties. Approximately 1/3 of end-users stated that the MSPE is very or extremely influential in their initial screening process. Slightly less than half agreed or strongly agreed that they trust the information to be an accurate representation of applicants, though slightly more than half agree that the MSPE will become more influential once USMLE Step 1 becomes pass/fail. Professionalism was rated as the most important component and noteworthy characteristics among the least important in the decision-making process. Performance in the internal medicine clerkship was rated as the most influential while neurology and psychiatry performances were rated as less influential. Overwhelmingly, respondents suggested that including comparative performance and/or class rank would make the MSPE more useful once USMLE Step 1 becomes pass/fail. MSPE end-users across a variety of specialties utilize this complex document in different ways and value it differentially in their decision-making processes. Despite this, continued mistrust of the MSPE persists. A better understanding of end-users' perceptions of the MSPE offers the UME community an opportunity to transform the MSPE into a highly valued, trusted document of communication.

Implementation of an Interprofessional Nutrition Workshop to Integrate Nutrition Education into a Preclinical Medical School Curriculum.

Objective: The patient-physician encounter provides an ideal opportunity to assess a patient's dietary history and its impact on total health. However, nutrition assessments and counseling in physician-patient encounters is often lacking. Insufficient nutrition education during medical school may lead to insecurity in assessing and counseling patients.Methods: Physicians and registered dietitians (RD) co-developed and co-facilitated a nutrition workshop for first-year medical students. Goals included increasing recognition of nutrition's impact on health and promoting student confidence and skills when attaining a nutrition history, assessing risk factors, and advising.Results: Seventy percent of students attested to having "sufficient" knowledge to counsel a patient on nutrition after the session compared to 38% before (Z= -4.46, p < 0.001). Sixty eight percent felt comfortable completing a nutritional assessment after the session compared to 35% before (Z= -4.30, p < 0.001). Sixty-three percent felt confident in advising patients about nutrition after the session compared to 32% before (Z= -4.20, p < 0.001). Students also significantly outperformed a control cohort on a nutrition-related component of an Objective Standardized Clinical Examination.Conclusions: Clinical nutrition education can be successfully integrated into the medical school curriculum as early as the first year. Interprofessional collaboration with RDs provided evidence-based content and authentic clinical experience in both the development of the workshop and in facilitating student discussion.