Evaluation of an Individualized Learning Plan Template for the Transition to Residency.

Background Specialty-specific individualized learning plans (ILPs) have been promoted to improve the undergraduate to graduate medical education transition, yet few pilots have been described. Objective To create and report on the feasibility and acceptability of a pilot internal medicine (IM) ILP template. Methods The ILP was created by a group of diverse IM expert stakeholders and contained questions to stimulate self-reflection and collect self-reported readiness data from incoming interns. US IM residency programs were invited to pilot the ILP with interns in spring 2022. Data was used at the programs' discretion. The pilot was evaluated by a post-pilot survey of programs to elicit perceptions of the impact and value of the ILP and analyze anonymous ILP data from 3 institutions. Results Fifty-two IM residency programs agreed to participate with a survey response rate of 87% (45 of 52). Of responding programs, 89% (40 of 45) collected ILPs, thus we report on data from these 40 programs. A total of 995 interns enrolled with 782 completing ILPs (79%). One hundred eleven ILPs were analyzed (14%). Most programs found the ILP valuable to understand incoming interns' competencies (26 of 40, 65%) and areas for improvement (24 of 40, 60%) and thought it should continue (29 of 40, 73%). Programs estimated the ILP took interns 29.2±14.9 minutes and 21.6±10.3 minutes for faculty mentors to complete. The most common barrier was faculty mentor participation. Conclusions An ILP based on interns' self-reported data was feasible and valuable to IM residency programs in understanding interns' competencies and areas for improvement.

Strategies for Advancing Equity in Frontline Clinical Assessment.

Educational equity in medicine cannot be achieved without addressing assessment bias. Assessment bias in health professions education is prevalent and has extensive implications for learners and, ultimately, the health care system. Medical schools and educators desire to minimize assessment bias, but there is no current consensus on effective approaches. Frontline teaching faculty have the opportunity to mitigate bias in clinical assessment in real time. Based on their experiences as educators, the authors created a case study about a student to illustrate ways bias affects learner assessment. In this paper, the authors use their case study to provide faculty with evidence-based approaches to mitigate bias and promote equity in clinical assessment. They focus on 3 components of equity in assessment: contextual equity, intrinsic equity, and instrumental equity. To address contextual equity, or the environment in which learners are assessed, the authors recommend building a learning environment that promotes equity and psychological safety, understanding the learners' contexts, and undertaking implicit bias training. Intrinsic equity, centered on the tools and practices used during assessment, can be promoted by using competency-based, structured assessment methods and employing frequent, direct observation to assess multiple domains. Instrumental equity, focused on communication and how assessments are used, includes specific, actionable feedback to support growth and use of competency-based narrative descriptors in assessments. Using these strategies, frontline clinical faculty members can actively promote equity in assessment and support the growth of a diverse health care workforce.

Reviewing Internal Medicine Clerkship Grading Through a Proequity Lens: Results of a National Survey.

PURPOSE: Equity in assessment and grading has become imperative across medical education. Although strategies to promote equity exist, there may be variable penetrance across institutions. The objectives of this study were to identify strategies internal medicine (IM) clerkship directors (CDs) use to reduce inequities in assessment and grading and explore IM CDs' perceptions of factors that impede or facilitate the implementation of these strategies. METHOD: From October to December 2021, the Clerkship Directors in Internal Medicine of the Alliance for Academic Internal Medicine conducted its annual survey of IM core CDs at 137 U.S. and U.S. territory-based medical schools. This study is based on 23 questions from the survey about equity in IM clerkship assessment and grading. RESULTS: The survey response rate was 73.0% (100 of 137 medical school CDs). Use of recommended evidence-based strategies to promote equity in clerkship assessment and grading varied among IM clerkships. Only 30 respondents (30.0%) reported that their clerkships had incorporated faculty development on implicit bias for clinical supervisors of students; 31 (31.0%) provided education to faculty on how to write narrative assessments that minimize bias. Forty respondents (40.0%) provided guidance to clerkship graders on how to minimize bias when writing final IM clerkship summaries, and 41 (41.0%) used grading committees to determine IM clerkship grades. Twenty-three CDs (23.0%) received formal education by their institution on how to generate clerkship grades and summaries in a way that minimized bias. CONCLUSIONS: This national survey found variability among medical schools in the application of evidence-based strategies to promote equity in assessment and grading within their IM clerkships. Opportunities exist to adopt and optimize proequity grading strategies, including development of programs that address bias in clerkship assessment and grading, reevaluation of the weight of standardized knowledge exam scores on grades, and implementation of grading committees.

Medical student advising during virtual residency recruitment: results of a national survey of internal medicine clerkship and sub-internship directors.

INTRODUCTION: The residency application process is a critical time for medical students. The COVID-19 pandemic prompted changes to the residency recruitment procedures with the conversion of interviews to a virtual format. For medical school advisors guiding students on an all-virtual residency application process brought uncertainty to their advising practices. Thus, this study aimed to identify advising practices during the 2021 virtual application cycle. METHODS: We administered an IRB-exempt national survey through the Clerkship Directors in Internal Medicine to 186 internal medicine core/co-/associate/assistant clerkship directors and sub-internship directors representing 140 Liaison Committee on Medical Education-accredited U.S./U.S.-territory-based medical schools in spring 2021. The 23-question survey was designed and pilot-tested by faculty-educators and leaders with expertise in undergraduate medical education. Data analysis included paired t- and z-tests and thematic analysis of open-ended questions. RESULTS: The institutional response rate was 67% (93/140) and individual rate 55% (103/186). Half of the respondents felt prepared/very prepared (40% and 13% respectively) for their advising roles. Compared to pre-pandemic cycles, respondents advised a typical student in the middle-third of their class at their institution to apply to more residency programs (mean 24 programs vs 20, p < 0.001) and accept more interviews (mean 14 interviews vs 12, p < 0.001). Sixty-three percent (64/101) of respondents spent more time on student advising; 51% (51/101) reported more students asked them for informal advice. Fifty-nine percent (60/101) of respondents reported their advisees were able to assess a residency program 'somewhat well;' 31% (31/101) expressed that residency recruitment should remain entirely virtual in the future. CONCLUSION: The transition to virtual residency recruitment due to COVID-19 prompted advising practices that may have contributed to application inflation and increased advising workload. Future studies should explore longitudinal outcomes of virtual interviews on student success to guide best practices in how to advise students during residency recruitment.

An Expanded Primary Care-Based Women's Health Clinic to Improve Resident Education and Patient Care in Resident Continuity Clinic.

BACKGROUND: Internal medicine (IM) residents are underprepared in women's health. Lack of properly trained faculty and clinic culture limits the ability to provide bedside teaching. AIM: Assess the impact of a primary care-based, women's clinic on residents' quality of care for females. SETTING: Large academic, urban primary care clinic with resident and faculty practices PARTICIPANTS: PGY-2 IM and Med-Peds (MP) residents PROGRAM DESCRIPTION: A weekly half-day, women's clinic to provide expanded women's healthcare to primary care group patients. Residents rotate through the clinic to receive bedside teaching. PROGRAM EVALUATION: Chart review was performed for a representative sample of reproductive-aged women seen in primary care before and after the establishment of the women's clinic. A total of 666 charts were reviewed (314 pre, 352 post). Improvement was seen in residents' rate of sexual histories (54% vs 75%, p< 0.01) with a significant decrease in women not asked about contraception (15% vs 3%, p<0.01). Overall there was a decrease in gynecology referrals (18 to 11%, p=0.02). DISCUSSION: After implementing the women's health clinic, more women were asked about sexual health needs, and fewer were referred to gynecology, suggesting increased women's healthcare provided by residents.

Innovation and Missed Opportunities in Internal Medicine Undergraduate Education During COVID-19: Results from a National Survey.

BACKGROUND: COVID-19 disrupted undergraduate clinical education when medical schools removed students from clinical rotations following AAMC recommendations. Clerkship directors (CDs) had to adapt rapidly and modify clerkship curricula. However, the scope and effects of these modifications are unknown. OBJECTIVE: To examine the effects of the initial phase of COVID-19 on the internal medicine (IM) undergraduate clinical education. DESIGN: A nationally representative web survey. PARTICIPANTS: IM CDs from 137 LCME-accredited US medical schools in 2020. MAIN MEASURES: Items (80) assessed clerkship structure and curriculum, assessment in clerkships, post-clerkship IM clinical experiences, and CD roles and support. The framework of Understanding Crisis Response (Royal Society for Encouragement of Arts, Manufactures, and Commerce) was used to determine whether curricular modifications were "amplified," "restarted," "let go," or "ended." KEY RESULTS: Response rate was 74%. In response to COVID-19, 32% (32/101) of clerkships suspended all clinical activities and 66% (67/101) only in-person. Prior to clinical disruption, students spent a median of 8.0 weeks (IQR: 2) on inpatient and 2.0 weeks (IQR: 4) on ambulatory rotations; during clinical re-entry, students were spending 5.0 (IQR: 3) and 1.0 (IQR: 2) weeks, respectively. Bedside teaching and physical exam instruction were "let go" during the early phase. Students were removed from direct patient care for a median of 85.5 days. The sub-internship curriculum remained largely unaffected. Before the pandemic, 11% of schools were using a pass/fail grading system; at clinical re-entry 47% and during the survey period 23% were using it. Due to the pandemic, 78.2% of CDs assumed new roles or had expanded responsibilities; 51% reported decreased scholarly productivity. CONCLUSIONS: Curricular adaptations occurred in IM clerkships across US medical schools as a result of COVID-19. More research is needed to explore the long-term implications of these changes on medical student education and clinical learning environments.

Impact of the Early Phase of the COVID-19 Pandemic on Medical Student Well-Being: a Multisite Survey.

BACKGROUND: The COVID-19 pandemic drastically impacted medical student experiences. Little is known about the impact of the pandemic on student well-being and protective factors for burnout. OBJECTIVE: Assess US medical student burnout, stress, and loneliness during the initial phase of the pandemic, compare results to pre-pandemic data, and identify risk factors for distress and protective factors to inform support interventions. DESIGN: Cross-sectional survey of medical students conducted between May and July 2020. PARTICIPANTS: 3826 students from 22 medical schools. MAIN MEASURES: Burnout (MBI-HSS), stress (PSS-10), loneliness (UCLA scale), and student experiences. Compared burnout and stress to pre-pandemic studies (2010-2020). KEY RESULTS: Of 12,389 students, 3826 responded (31%). Compared to pre-pandemic studies, burnout was lower (50% vs. 52%, P = 0.03) while mean stress was higher (18.9 vs. 16.0, P < 0.001). Half (1609/3247) reported high (≥ 6/9) loneliness scores. Significant differences were found in burnout and stress by class year (P = 0.002 and P < 0.001) and race (P = 0.004 and P < 0.001), with the highest levels in second- and third-year students and Black, Asian, or other racial minority students. Students experiencing financial strain or racism had higher burnout and stress (P < 0.001 for all). Respondents with COVID-19 diagnoses in themselves or family members had higher stress (P < 0.001). Nearly half (1756/3569) volunteered during the pandemic, with volunteers reporting lower burnout [48% (782/1639) vs. 52% (853/1656), P = 0.03]. CONCLUSIONS: While stress was higher compared to pre-pandemic data, burnout was significantly lower. Higher burnout and stress among Black, Asian, and other racial minority students and those who experienced financial strain, racism, or COVID-19 diagnoses likely reflect underlying racial and socioeconomic inequalities exacerbated by the pandemic and concurrent national racial injustice events. Volunteer engagement may be protective against burnout. Schools should proactively support vulnerable students during periods of stress.

The Impact of Internal Medicine Clerkship Characteristics and NBME Subject Exams on USMLE Step 2 Clinical Knowledge Exam Performance.

BACKGROUND: Residency program directors will likely emphasize the United States Medical Licensing Exam (USMLE) Step 2 clinical knowledge (CK) exam more during residency application given the recent USMLE Step 1 transition to pass/fail scoring. We examined how internal medicine clerkship characteristics and NBME subject exam scores affect USMLE Step 2 CK performance. DESIGN: The authors used univariable and multivariable generalized estimating equations to determine associations between Step 2 CK performance and internal medicine clerkship characteristics and NBME subject exams. The sample had 21,280 examinees' first Step 2 CK scores for analysis. RESULTS: On multivariable analysis, Step 1 performance (standardized ß = 0.45, p < .001) and NBME medicine subject exam performance (standardized ß = 0.40, p < .001) accounted for approximately 60% of the variance in Step 2 CK performance. Students who completed the internal medicine clerkship last in the academic year scored lower on Step 2 CK (Mdiff = -3.17 p < .001). Students who had a criterion score for passing the NBME medicine subject exam scored higher on Step 2 CK (Mdiff = 1.10, p = .03). There was no association between Step 2 CK performance and other internal medicine clerkship characteristics (all p > 0.05) nor with the total NBME subject exams completed (ß=0.05, p = .78). CONCLUSION: Despite similarities between NBME subject exams and Step 2 CK, the authors did not identify improved Step 2 CK performance for students who had more NBME subject exams. The lack of association of Step 2 CK performance with many internal medicine clerkship characteristics and more NBME subject exams has implications for future clerkship structure and summative assessment. The improved Step 2 CK performance in students that completed their internal medicine clerkship earlier warrants further study given the anticipated increase in emphasis on Step 2 CK.

Roles and Responsibilities of Medicine Subinternship Directors : Medicine Subinternship Director Roles.

BACKGROUND: The internal medicine (IM) subinternship (also referred to as acting internship) plays a crucial part in preparing medical students for residency. The roles, responsibilities, and support provided to subinternship directors have not been described. OBJECTIVE: We sought to describe the current role of IM subinternship directors with respect to their responsibilities, salary support, and reporting structure. DESIGN: Nationally representative, annually recurring thematic survey of IM core clerkship directors with membership in an academic professional association as of September 2017. PARTICIPANTS: A total of 129 core clinical medicine clerkship directors at Liaison Committee on Medical Education fully accredited U.S./U.S.-territory-based medical schools. MAIN MEASURES: Responsibilities, salary support, and reporting structure of subinternship directors. KEY RESULTS: The survey response rate was 83.0% (107/129 medical schools). Fifty-one percent (54/107) of respondents reported overseeing both core clerkship inpatient experiences and/or one or more subinternships. For oversight, 49.1% (28/53) of subinternship directors also reported that they were the clerkship director, 26.4% (14/53) that another faculty member directed all medicine subinternships, and 18.9% (10/53) that each subinternship had its own director. The most frequently reported responsibilities for the subinternship directors were administration, including scheduling, and logistics of student schedules (83.0%, 44/53), course evaluation (81.1%, 43/53), and setting grades 79.2% (42/53). The modal response for estimated FTE per course was 10-20% FTE, with 33.3% (16/48) reporting this level of support and 29.2% (14/54) reporting no FTE support. CONCLUSIONS: The role of the IM subinternship director has become increasingly complex. Since the IM subinternship is critical to preparing students for residency, IM subinternship directors require standard expectations and adequate support. Future studies are needed to determine the appropriate level of support for subinternship directors and to define essential roles and responsibilities.

Telehealth Attitudes, Training, and Preparedness Among First-Year Internal Medicine Residents in the COVID-19 Era.

Introduction: Telehealth, especially the use of real-time video and phone visits in ambulatory care, is increasingly important in the wake of the COVID-19 pandemic. The current state of internal medicine (IM) interns' telehealth training at the start of residency is unknown. Objective: To characterize the attitudes, training, and preparedness of IM interns regarding the use of telehealth video and phone visits in ambulatory care. Materials and Methods: We conducted a cross-sectional survey of IM interns at four IM residency programs in the United States in 2020. Results: One hundred fifty-six surveys were analyzed (response rate 82%). Seventy-five percent of interns rated training in the use of real-time video and phone visits for ambulatory care as important or very important. The vast majority received no training (74%) or clinical experience (90% no prior video visits, 81% no prior phone visits) during medical school. More interns believed that primary care may be effectively delivered via video visits compared with phone visits (77% vs. 35%). Most interns (69%) missed clinical time during medical school due to the COVID-19 pandemic; 41% felt that the pandemic negatively affected their ambulatory care preparation. Overall, the majority of interns (58%) felt prepared for primary care; only 12% felt prepared to deliver primary care using either video or phone visits. Conclusions: Although IM interns had favorable attitudes toward video and phone visits, few had training or clinical experience; most felt unprepared. Residency programs may need to close training gaps for current interns in conducting telehealth video and phone visits.