Leave of Absence and Medical Student Placement Into Graduate Medical Education by Race and Ethnicity.

This study examines the association between taking a leave of absence from medical school and placement into graduate medical education (GME) by race and ethnicity.

Socioeconomic Diversity in Admissions to MD-PhD Programs, 2014-2019.

This cohort study of applicants to US MD-PhD programs examines the association of application outcomes with family income.

Learner Assessment and Program Evaluation: Supporting Precision Education.

ABSTRACT: Precision education (PE) systematically leverages data and advanced analytics to inform educational interventions that, in turn, promote meaningful learner outcomes. PE does this by incorporating analytic results back into the education continuum through continuous feedback cycles. These data-informed sequences of planning, learning, assessing, and adjusting foster competence and adaptive expertise. PE cycles occur at individual (micro), program (meso), or system (macro) levels. This article focuses on program- and system-level PE.Data for PE come from a multitude of sources, including learner assessment and program evaluation. The authors describe the link between these data and the vital role evaluation plays in providing evidence of educational effectiveness. By including prior program evaluation research supporting this claim, the authors illustrate the link between training programs and patient outcomes. They also describe existing national reports providing feedback to programs and institutions, as well as 2 emerging, multiorganization program- and system-level PE efforts. The challenges encountered by those implementing PE and the continuing need to advance this work illuminate the necessity for increased cross-disciplinary collaborations and a national cross-organizational data-sharing effort.Finally, the authors propose practical approaches for funding a national initiative in PE as well as potential models for advancing the field of PE. Lessons learned from successes by others illustrate the promise of these recommendations.

Promising Practices in US Sponsoring Institutions to Advance Diversity, Equity, and Inclusion in Graduate Medical Education.

Background Best practices to improve diversity, equity, and inclusion (DEI) in the biomedical workforce remain poorly understood. The Accreditation Council for Graduate Medical Education launched the Barbara Ross-Lee, DO, Diversity, Equity, and Inclusion award for sponsoring institutions to celebrate efforts to improve DEI in graduate medical education (GME). Objective To identify themes in practices used by award applicants to improve DEI efforts at their institutions, using a qualitative design. Methods This qualitative study employed an exploratory, inductive approach and constant comparative method to analyze award applications from 2 submission cycles (2020, 2021). Data analysis involved the use of a preliminary codebook of 29 program applications used in a previous study, which was modified and expanded, to perform a subsequent analysis of 12 sponsoring institution applications. Seven adjudication sessions were conducted to ensure coding consistency and resolve disagreements, resulting in the identification of final themes. Results Institutions' approaches to advancing DEI resulted from work within 5 themes and 10 subthemes. The themes encompassed organizational commitment (policies that reflect DEI mission), data infrastructure (tracking recruitment, retention, and inclusion efforts), community connection (service-learning opportunities), diverse team engagement (coproduction with residents), and systematic strategies for DEI support throughout the educational continuum. Consistent across themes was the importance of collaboration, avoiding silos, and the need for a comprehensive longitudinal approach to DEI to achieve a diverse GME workforce. Conclusions This qualitative study identified 5 themes that can inform and guide sponsoring institutions in promoting DEI.

Transition to Residency: National Study of Factors Contributing to Variability in Learner Milestones Ratings in Emergency Medicine and Family Medicine.

PURPOSE: The developmental trajectory of learning during residency may be attributed to multiple factors, including variation in individual trainee performance, program-level factors, graduating medical school effects, and the learning environment. Understanding the relationship between medical school and learner performance during residency is important in prioritizing undergraduate curricular strategies and educational approaches for effective transition to residency and postgraduate training. This study explores factors contributing to longitudinal and developmental variability in resident Milestones ratings, focusing on variability due to graduating medical school, training program, and learners using national cohort data from emergency medicine (EM) and family medicine (FM). METHOD: Data from programs with residents entering training in July 2016 were used (EM: n=1,645 residents, 178 residency programs; FM: n=3,997 residents, 487 residency programs). Descriptive statistics were used to examine data trends. Cross-classified mixed-effects regression were used to decompose variance components in Milestones ratings. RESULTS: During postgraduate year (PGY)-1, graduating medical school accounted for 5% and 6% of the variability in Milestones ratings, decreasing to 2% and 5% by PGY-3 for EM and FM, respectively. Residency program accounted for substantial variability during PGY-1 (EM=70%, FM=53%) but decreased during PGY-3 (EM=62%, FM=44%), with greater variability across training period in patient care (PC), medical knowledge (MK), and systems-based practice (SBP). Learner variance increased significantly between PGY-1 (EM=23%, FM=34%) and PGY-3 (EM=34%, FM=44%), with greater variability in practice-based learning and improvement (PBLI), professionalism (PROF), and interpersonal communication skills (ICS). CONCLUSIONS: The greatest variance in Milestone ratings can be attributed to the residency program and to a lesser degree, learners, and medical school. The dynamic impact of program-level factors on learners shifts during the first year and across the duration of residency training, highlighting the influence of curricular, instructional, and programmatic factors on resident performance throughout residency.

Holistic Admissions at UC Davis-Journey Toward Equity.

This Viewpoint discusses what higher education institutions can learn from UC Davis when it comes to ensuring equity for their students now that the US Supreme Court has eliminated race-conscious college admissions.

Temporal Trends in Childhood Household Income Among Applicants and Matriculants to Medical School and the Likelihood of Acceptance by Income, 2014-2019.

This study examines trends in childhood household income among applicants and matriculants to medical school and the likelihood of acceptance by income.

Revolutionizing Health Professions Admissions to Achieve an Inclusive Workforce.

This article describes the "The Admissions Revolution: Bold Strategies for Diversifying the Healthcare Workforce" conference, which preceded the 2022 Beyond Flexner Alliance Conference and called for health professions institutions to boldly reimagine the admission process to diversify the health care workforce. Proposed strategies encompassed 4 key themes: admission metrics, aligning admission practices with institutional mission, community partnerships to fulfill social mission, and student support and retention. Transformation of the health professions admission process requires broad institutional and individual effort. Careful consideration and implementation of these practices will help institutions achieve greater workforce diversity and catalyze progress toward health equity.

The Current State of Antiracism Curricula in Undergraduate and Graduate Medical Education: A Qualitative Study of US Academic Health Centers.

PURPOSE: We undertook a study to evaluate the current state of pedagogy on antiracism, including barriers to implementation and strengths of existing curricula, in undergraduate medical education (UME) and graduate medical education (GME) programs in US academic health centers. METHODS: We conducted a cross-sectional study with an exploratory qualitative approach using semistructured interviews. Participants were leaders of UME and GME programs at 5 institutions participating in the Academic Units for Primary Care Training and Enhancement program and 6 affiliated sites from November 2021 to April 2022. RESULTS: A total of 29 program leaders from the 11 academic health centers participated in this study. Three participants from 2 institutions reported the implementation of robust, intentional, and longitudinal antiracism curricula. Nine participants from 7 institutions described race and antiracism-related topics integrated into health equity curricula. Only 9 participants reported having "adequately trained" faculty. Participants mentioned individual, systemic, and structural barriers to implementing antiracism-related training in medical education such as institutional inertia and insufficient resources. Fear related to introducing an antiracism curriculum and undervaluing of this curriculum relative to other content were identified. Through learners and faculty feedback, antiracism content was evaluated and included in UME and GME curricula. Most participants identified learners as a stronger voice for transformation than faculty; antiracism content was mainly included in health equity curricula. CONCLUSIONS: Inclusion of antiracism in medical education requires intentional training, focused institutional policies, enhanced foundational awareness of the impact of racism on patients and communities, and changes at the level of institutions and accreditation bodies.

Strategies and Best Practices to Improve Diversity, Equity, and Inclusion Among US Graduate Medical Education Programs.

Importance: Closing the diversity gap is critical to ensure equity in medical education and health care quality. Nevertheless, evidence-based strategies and best practices to improve diversity, equity, and inclusion (DEI) in the biomedical workforce remain poorly understood and underused. To improve the culture of DEI in graduate medical education (GME), in 2020 the Accreditation Council of Graduate Medical Education (ACGME) launched the Barbara Ross-Lee, DO, Diversity, Equity, and Inclusion Award to recognize exceptional DEI efforts in US residency programs. Objective: To identify strategies and best practices that exemplary US GME programs use to improve DEI. Design and Setting: This qualitative study performed an exploratory content analysis of award applications submitted to the ACGME over 2 cycles in 2020 and 2021, using the constant comparative method. The research team first acknowledged their own biases related to DEI, used caution to not overinterpret the data, and performed several cross-checks during data analysis to ensure confirmability of the results. A preliminary codebook was developed and used during regular adjudication sessions. Disagreements were discussed until agreements were reached. Main Outcomes and Measures: Foundational (ie, commonly cited, high-impact, and small-effort strategies considered achievable by all programs) and aspirational (ie, potential for high impact but requiring greater effort and investment) DEI strategies used by exemplary GME programs. Results: This qualitative study included 29 award applications submitted between August 17, 2020, and January 11, 2022. Strategies spanned the education continuum from premedical students through faculty. Foundational strategies included working with schools, community colleges, and 4-year college campuses; providing structured support for visiting students; mission-driven holistic review for admissions and selection; interviewer trainings on implicit bias mitigation and on how racism and discrimination impact admission processes and advancement; interview-day DEI strategies; inclusive selection and DEI committees; mission statements that include DEI; and retention efforts to improve faculty diversity. Aspirational strategies included development of longitudinal bidirectional collaborations (eg, articulation agreements, annual workshops, funded rotations and/or research) with organizations working with applicants who were historically excluded and underrepresented in medicine, blinding metrics in residency applications, longitudinal curricula on DEI and health equity, and faculty mentoring such as affinity groups, mentored research, and joint academic-community recruitments. Findings provide residency program leadership with a menu of options at various inflection points to foster DEI within their programs. Conclusions and Relevance: The findings of this qualitative study suggest that GME programs might adopt strategies of exemplary programs to improve DEI in residency, ensure compliance with accreditation standards, and improve health outcomes for all.

US Medical School Admissions Leaders' Experiences With Barriers to and Advancements in Diversity, Equity, and Inclusion.

Importance: Despite decades-long calls for increasing racial and ethnic diversity, the medical profession continues to exclude members of Black or African American, Hispanic or Latinx, and Indigenous groups. Objective: To describe US medical school admissions leaders' experiences with barriers to and advances in diversity, equity, and inclusion. Design, Setting, and Participants: This qualitative study involved key-informant interviews of 39 deans and directors of admission from 37 US allopathic medical schools across the range of student body racial and ethnic composition. Interviews were conducted in person and online from October 16, 2019, to March 27, 2020, and analyzed from October 2019 to March 2021. Main Outcomes and Measures: Participant experiences with barriers to and advances in diversity, equity, and inclusion. Results: Among 39 participants from 37 medical schools, admissions experience ranged from 1 to 40 years. Overall, 56.4% of participants identified as women, 10.3% as Asian American, 25.6% as Black or African American, 5.1% as Hispanic or Latinx, and 61.5% as White (participants could report >1 race and/or ethnicity). Participants characterized diversity broadly, with limited attention to racial injustice. Barriers to advancing racial and ethnic diversity included lack of leadership commitment; pressure from faculty and administrators to overemphasize academic scores and school rankings; and political and social influences, such as donors and alumni. Accreditation requirements, holistic review initiatives, and local policy motivated reforms but may also have inadvertently lowered expectations and accountability. Strategies to overcome challenges included narrative change and revision of school leadership structure, admissions goals, practices, and committee membership. Conclusions and Relevance: In this qualitative study, admissions leaders characterized the ways in which entrenched beliefs, practices, and power structures in medical schools may perpetuate institutional racism, with far-reaching implications for health equity. Participants offered insights on how to remove inequitable structures and implement process changes. Without such action, calls for racial justice will likely remain performative, and racism across health care institutions will continue.

National Institutes of Health Diversity Supplement Awards by Medical School.

BACKGROUND: Increasing medical school faculty diversity is an urgent priority. National Institutes of Health (NIH) diversity supplements, which provide funding and career development opportunities to individuals underrepresented in research, are an important mechanism to increase faculty diversity. OBJECTIVE: Analyze diversity supplement utilization by medical schools. DESIGN: Retrospective cohort study. PARTICIPANTS: All R01 grant-associated diversity supplements awarded to medical schools from 2005 to 2020. Diversity supplements were identified using the publicly available NIH RePORTER database. MAIN MEASURES: Main measures were the number of R01-associated diversity supplements awarded to medical schools each year by medical school NIH funding status and the number of R01-associated diversity supplements awarded to individual medical schools in the NIH top 40 by funding status. We also examined the percentage of R01 grants with an associated diversity supplement by NIH funding status and individual medical school in the NIH top 40. KEY RESULTS: From 2005 to 2020, US medical school faculty received 1389 R01-associated diversity supplements. The number of diversity supplements awarded grew from 2012 to 2020, from ten to 187 for top 40 schools, and from seven to 83 for non-top 40 schools. The annual growth rate for diversity supplement awards at NIH top 40 schools (44.2%) was not significantly different than the annual growth rate among non-top 40 schools (36.2%; p = 0.68). From 2005 to 2020, the highest number of diversity supplements that an individual medical school received was 56 and the lowest number was four (mean = 24.6, SD = 11.7). The highest percentage of R01 grants with an associated diversity supplement received by a school was 4.5% and the lowest percentage was 0.79% (mean = 2.3%, SD = 0.98). CONCLUSION: Medical schools may be missing an opportunity to address the continuing shortage of individuals historically underrepresented in biomedical science and should consider additional mechanisms to enhance diversity supplement utilization.

Racial and Ethnic Differences in Internal Medicine Residency Assessments.

Importance: Previous studies have demonstrated racial and ethnic inequities in medical student assessments, awards, and faculty promotions at academic medical centers. Few data exist about similar racial and ethnic disparities at the level of graduate medical education. Objective: To examine the association between race and ethnicity and performance assessments among a national cohort of internal medicine residents. Design, Setting, and Participants: This retrospective cohort study evaluated assessments of performance for 9026 internal medicine residents from the graduating classes of 2016 and 2017 at Accreditation Council of Graduate Medical Education (ACGME)-accredited internal medicine residency programs in the US. Analyses were conducted between July 1, 2020, and June 31, 2022. Main Outcomes and Measures: The primary outcome was midyear and year-end total ACGME Milestone scores for underrepresented in medicine (URiM [Hispanic only; non-Hispanic American Indian, Alaska Native, or Native Hawaiian/Pacific Islander only; or non-Hispanic Black/African American]) and Asian residents compared with White residents as determined by their Clinical Competency Committees and residency program directors. Differences in scores between Asian and URiM residents compared with White residents were also compared for each of the 6 competency domains as supportive outcomes. Results: The study cohort included 9026 residents from 305 internal medicine residency programs. Of these residents, 3994 (44.2%) were female, 3258 (36.1%) were Asian, 1216 (13.5%) were URiM, and 4552 (50.4%) were White. In the fully adjusted model, no difference was found in the initial midyear total Milestone scores between URiM and White residents, but there was a difference between Asian and White residents, which favored White residents (mean [SD] difference in scores for Asian residents: -1.27 [0.38]; P < .001). In the second year of training, White residents received increasingly higher scores relative to URiM and Asian residents. These racial disparities peaked in postgraduate year (PGY) 2 (mean [SD] difference in scores for URiM residents, -2.54 [0.38]; P < .001; mean [SD] difference in scores for Asian residents, -1.9 [0.27]; P < .001). By the final year 3 assessment, the gap between White and Asian and URiM residents' scores narrowed, and no racial or ethnic differences were found. Trends in racial and ethnic differences among the 6 competency domains mirrored total Milestone scores, with differences peaking in PGY2 and then decreasing in PGY3 such that parity in assessment was reached in all competency domains by the end of training. Conclusions and Relevance: In this cohort study, URiM and Asian internal medicine residents received lower ratings on performance assessments than their White peers during the first and second years of training, which may reflect racial bias in assessment. This disparity in assessment may limit opportunities for physicians from minoritized racial and ethnic groups and hinder physician workforce diversity.

Association of Marginalized Identities With Alpha Omega Alpha Honor Society and Gold Humanism Honor Society Membership Among Medical Students.

Importance: Disparities in medical student membership in Alpha Omega Alpha (AOA) are well documented. Less is known about Gold Humanism Honor Society (GHHS) membership and it remains unknown how the intersection of different identities is associated with membership in these honor societies. Objective: To examine the association between honor society membership and medical student race and ethnicity, sex, sexual orientation, socioeconomic status, and intersection of identities. Design, Setting, and Participants: This cross-sectional study analyzed data from Association of American Medical Colleges data collection instruments. The study included all students who graduated from Liaison Committee on Medical Education-accredited US medical schools from 2016 to 2019 and completed the Graduation Questionnaire. Data analysis was conducted from January 12 to July 12, 2022. Main Outcomes and Measures: Likelihood of AOA and GHHS membership by student race and ethnicity, sex, sexual orientation, childhood family income, and intersection of identities. Results: The sample of 50 384 individuals comprised 82 (0.2%) American Indian or Alaska Native, 10 601 (21.0%) Asian, 2464 (4.9%) Black, 3291 (6.5%) Hispanic, 25 (0.1%) Native Hawaiian or Pacific Islander, 30 610 (60.8%) White, 2476 (4.9%) multiracial students, and 834 (1.7%) students of other races or ethnicities. Sex and sexual orientation included 25 672 (51.0%) men and 3078 (6.1%) lesbian, gay, and bisexual (LGB). Childhood family income comprised 31 758 (60.0%) individuals with $75 000 per year or greater, 8160 (16.2%) with $50 000 to $74 999 per year, 6864 (13.6%) with $25 000 to $49 999 per year, and 3612 (7.2%) with less than $25 000 per year. The sample included 7303 (14.5%) AOA members only, 4925 (9.8%) GHHS members only, and 2384 (4.7%) members of both societies. In AOA, American Indian or Alaska Native (OR, 0.49; 95% CI, 0.25-0.96), Asian (OR, 0.49; 95% CI, 0.45-0.53), Black (OR, 0.25; 95% CI, 0.20-0.30), Hispanic (OR, 0.53; 95% CI, 0.47-0.59), multiracial (OR, 0.69; 95% CI, 0.62-0.77), and other race and ethnicity (OR, 0.73; 95% CI, 0.60-0.88) were underrepresented compared with White students; LGB students (OR, 0.75; 95% CI, 0.67-0.83) were underrepresented compared with heterosexual students; and childhood family income $50 000 to $74 999 (OR, 0.81; 95% CI, 0.75-0.86), $25 000 to $49 999 (OR, 0.68; 95% CI, 0.62-0.74), and less than $25 000 (OR, 0.60; 95% CI, 0.53-0.69) were underrepresented compared with greater than or equal to $75 000. In GHHS, Asian students (OR, 0.80; 95% CI, 0.73-0.87) were underrepresented compared with White students, female students (OR, 1.55; 95% CI, 1.45-1.65) were overrepresented compared with male students, LGB students (OR, 1.36; 95% CI, 1.23-1.51) were overrepresented compared with heterosexual students, and students with childhood family income $25 000 to $49 999 (OR, 0.85; 95% CI, 0.78-0.94) and less than $25 000 (OR, 0.75; 95% CI, 0.66-0.86) were underrepresented compared with those with greater than or equal to $75 000. Likelihood of AOA, but not GHHS, membership decreased as number of marginalized identities increased. Conclusions and Relevance: In this cross-sectional study of US medical students, membership disparities were noted in both AOA and GHHS. However, differences in GHHS existed across fewer identities, sometimes favored the marginalized group, and were not cumulative.

Association of Sociodemographic Characteristics With US Medical Student Attrition.

Importance: Diversity in the medical workforce is critical to improve health care access and achieve equity for resource-limited communities. Despite increased efforts to recruit diverse medical trainees, there remains a large chasm between the racial and ethnic and socioeconomic composition of the patient population and that of the physician workforce. Objective: To analyze student attrition from medical school by sociodemographic identities. Design, Setting, and Participants: This retrospective cohort study included allopathic doctor of medicine (MD)-only US medical school matriculants in academic years 2014-2015 and 2015-2016. The analysis was performed from July to September 2021. Main Outcomes and Measures: The main outcome was attrition, defined as withdrawal or dismissal from medical school for any reason. Attrition rate was explored across 3 self-reported marginalized identities: underrepresented in medicine (URiM) race and ethnicity, low income, and underresourced neighborhood status. Logistic regression was assessed for each marginalized identity and intersections across the 3 identities. Results: Among 33 389 allopathic MD-only medical school matriculants (51.8% male), 938 (2.8%) experienced attrition from medical school within 5 years. Compared with non-Hispanic White students (423 of 18 213 [2.3%]), those without low income (593 of 25 205 [2.3%]), and those who did not grow up in an underresourced neighborhood (661 of 27 487 [2.4%]), students who were URiM (Hispanic [110 of 2096 (5.2%); adjusted odds ratio (aOR), 1.41; 95% CI, 1.13-1.77], non-Hispanic American Indian/Alaska Native/Native Hawaiian/Pacific Islander [13 of 118 (11.0%); aOR, 3.20; 95% CI, 1.76-5.80], and non-Hispanic Black/African American [120 of 2104 (5.7%); aOR, 1.41; 95% CI, 1.13-1.77]), those who had low income (345 of 8184 [4.2%]; aOR, 1.33; 95% CI, 1.15-1.54), and those from an underresourced neighborhood (277 of 5902 [4.6%]; aOR, 1.35; 95% CI, 1.16-1.58) were more likely to experience attrition from medical school. The rate of attrition from medical school was greatest among students with all 3 marginalized identities (ie, URiM, low income, and from an underresourced neighborhood), with an attrition rate 3.7 times higher than that among students who were not URiM, did not have low income, and were not from an underresourced neighborhood (7.3% [79 of 1086] vs 1.9% [397 of 20 353]; P < .001). Conclusions and Relevance: This retrospective cohort study demonstrated a significant association of medical student attrition with individual (race and ethnicity and family income) and structural (growing up in an underresourced neighborhood) measures of marginalization. The findings highlight a need to retain students from marginalized groups in medical school.