Promising Practices in US Sponsoring Institutions to Advance Diversity, Equity, and Inclusion in Graduate Medical Education.

Background Best practices to improve diversity, equity, and inclusion (DEI) in the biomedical workforce remain poorly understood. The Accreditation Council for Graduate Medical Education launched the Barbara Ross-Lee, DO, Diversity, Equity, and Inclusion award for sponsoring institutions to celebrate efforts to improve DEI in graduate medical education (GME). Objective To identify themes in practices used by award applicants to improve DEI efforts at their institutions, using a qualitative design. Methods This qualitative study employed an exploratory, inductive approach and constant comparative method to analyze award applications from 2 submission cycles (2020, 2021). Data analysis involved the use of a preliminary codebook of 29 program applications used in a previous study, which was modified and expanded, to perform a subsequent analysis of 12 sponsoring institution applications. Seven adjudication sessions were conducted to ensure coding consistency and resolve disagreements, resulting in the identification of final themes. Results Institutions' approaches to advancing DEI resulted from work within 5 themes and 10 subthemes. The themes encompassed organizational commitment (policies that reflect DEI mission), data infrastructure (tracking recruitment, retention, and inclusion efforts), community connection (service-learning opportunities), diverse team engagement (coproduction with residents), and systematic strategies for DEI support throughout the educational continuum. Consistent across themes was the importance of collaboration, avoiding silos, and the need for a comprehensive longitudinal approach to DEI to achieve a diverse GME workforce. Conclusions This qualitative study identified 5 themes that can inform and guide sponsoring institutions in promoting DEI.

Intersectional Disparities in Emergency Medicine Residents' Performance Assessments by Race, Ethnicity, and Sex.

Importance: Previous studies have demonstrated sex-specific disparities in performance assessments among emergency medicine (EM) residents. However, less work has focused on intersectional disparities by ethnoracial identity and sex in resident performance assessments. Objective: To estimate intersectional sex-specific ethnoracial disparities in standardized EM resident assessments. Design, Setting, and Participants: This retrospective cohort study used data from the Association of American Medical Colleges and the Accreditation Council for Graduate Medical Education Milestones (Milestones) assessments to evaluate ratings for EM residents at 128 EM training programs in the US. Statistical analyses were conducted in June 2020 to January 2023. Exposure: Training and assessment environments in EM residency programs across comparison groups defined by ethnoracial identity (Asian, White, or groups underrepresented in medicine [URM], ie, African American/Black, American Indian/Alaska Native, Hispanic/Latine, and Native Hawaiian/Other Pacific Islander) and sex (female/male). Main Outcomes and Measures: Mean Milestone scores (scale, 0-9) across 6 core competency domains: interpersonal and communications skills, medical knowledge, patient care, practice-based learning and improvement, professionalism, and system-based practice. Overall assessment scores were calculated as the mean of the 6 competency scores. Results: The study sample comprised 128 ACGME-accredited programs and 16 634 assessments for 2708 EM residents of which 1913 (70.6%) were in 3-year and 795 (29.4%) in 4-year programs. Most of the residents were White (n = 2012; 74.3%), followed by Asian (n = 477; 17.6%), Hispanic or Latine (n = 213; 7.9%), African American or Black (n = 160; 5.9%), American Indian or Alaska Native (n = 24; 0.9%), and Native Hawaiian or Other Pacific Islander (n = 4; 0.1%). Approximately 14.3% (n = 386) and 34.6% (n = 936) were of URM groups and female, respectively. Compared with White male residents, URM female residents in 3-year programs were rated increasingly lower in the medical knowledge (URM female score, -0.47; 95% CI, -0.77 to -0.17), patient care (-0.18; 95% CI, -0.35 to -0.01), and practice-based learning and improvement (-0.37; 95% CI, -0.65 to -0.09) domains by postgraduate year 3 year-end assessment; URM female residents in 4-year programs were also rated lower in all 6 competencies over the assessment period. Conclusions and Relevance: This retrospective cohort study found that URM female residents were consistently rated lower than White male residents on Milestone assessments, findings that may reflect intersectional discrimination in physician competency evaluation. Eliminating sex-specific ethnoracial disparities in resident assessments may contribute to equitable health care by removing barriers to retention and promotion of underrepresented and minoritized trainees and facilitating diversity and representation among the emergency physician workforce.

Strategies and Best Practices to Improve Diversity, Equity, and Inclusion Among US Graduate Medical Education Programs.

Importance: Closing the diversity gap is critical to ensure equity in medical education and health care quality. Nevertheless, evidence-based strategies and best practices to improve diversity, equity, and inclusion (DEI) in the biomedical workforce remain poorly understood and underused. To improve the culture of DEI in graduate medical education (GME), in 2020 the Accreditation Council of Graduate Medical Education (ACGME) launched the Barbara Ross-Lee, DO, Diversity, Equity, and Inclusion Award to recognize exceptional DEI efforts in US residency programs. Objective: To identify strategies and best practices that exemplary US GME programs use to improve DEI. Design and Setting: This qualitative study performed an exploratory content analysis of award applications submitted to the ACGME over 2 cycles in 2020 and 2021, using the constant comparative method. The research team first acknowledged their own biases related to DEI, used caution to not overinterpret the data, and performed several cross-checks during data analysis to ensure confirmability of the results. A preliminary codebook was developed and used during regular adjudication sessions. Disagreements were discussed until agreements were reached. Main Outcomes and Measures: Foundational (ie, commonly cited, high-impact, and small-effort strategies considered achievable by all programs) and aspirational (ie, potential for high impact but requiring greater effort and investment) DEI strategies used by exemplary GME programs. Results: This qualitative study included 29 award applications submitted between August 17, 2020, and January 11, 2022. Strategies spanned the education continuum from premedical students through faculty. Foundational strategies included working with schools, community colleges, and 4-year college campuses; providing structured support for visiting students; mission-driven holistic review for admissions and selection; interviewer trainings on implicit bias mitigation and on how racism and discrimination impact admission processes and advancement; interview-day DEI strategies; inclusive selection and DEI committees; mission statements that include DEI; and retention efforts to improve faculty diversity. Aspirational strategies included development of longitudinal bidirectional collaborations (eg, articulation agreements, annual workshops, funded rotations and/or research) with organizations working with applicants who were historically excluded and underrepresented in medicine, blinding metrics in residency applications, longitudinal curricula on DEI and health equity, and faculty mentoring such as affinity groups, mentored research, and joint academic-community recruitments. Findings provide residency program leadership with a menu of options at various inflection points to foster DEI within their programs. Conclusions and Relevance: The findings of this qualitative study suggest that GME programs might adopt strategies of exemplary programs to improve DEI in residency, ensure compliance with accreditation standards, and improve health outcomes for all.

Racial and Ethnic Differences in Internal Medicine Residency Assessments.

Importance: Previous studies have demonstrated racial and ethnic inequities in medical student assessments, awards, and faculty promotions at academic medical centers. Few data exist about similar racial and ethnic disparities at the level of graduate medical education. Objective: To examine the association between race and ethnicity and performance assessments among a national cohort of internal medicine residents. Design, Setting, and Participants: This retrospective cohort study evaluated assessments of performance for 9026 internal medicine residents from the graduating classes of 2016 and 2017 at Accreditation Council of Graduate Medical Education (ACGME)-accredited internal medicine residency programs in the US. Analyses were conducted between July 1, 2020, and June 31, 2022. Main Outcomes and Measures: The primary outcome was midyear and year-end total ACGME Milestone scores for underrepresented in medicine (URiM [Hispanic only; non-Hispanic American Indian, Alaska Native, or Native Hawaiian/Pacific Islander only; or non-Hispanic Black/African American]) and Asian residents compared with White residents as determined by their Clinical Competency Committees and residency program directors. Differences in scores between Asian and URiM residents compared with White residents were also compared for each of the 6 competency domains as supportive outcomes. Results: The study cohort included 9026 residents from 305 internal medicine residency programs. Of these residents, 3994 (44.2%) were female, 3258 (36.1%) were Asian, 1216 (13.5%) were URiM, and 4552 (50.4%) were White. In the fully adjusted model, no difference was found in the initial midyear total Milestone scores between URiM and White residents, but there was a difference between Asian and White residents, which favored White residents (mean [SD] difference in scores for Asian residents: -1.27 [0.38]; P < .001). In the second year of training, White residents received increasingly higher scores relative to URiM and Asian residents. These racial disparities peaked in postgraduate year (PGY) 2 (mean [SD] difference in scores for URiM residents, -2.54 [0.38]; P < .001; mean [SD] difference in scores for Asian residents, -1.9 [0.27]; P < .001). By the final year 3 assessment, the gap between White and Asian and URiM residents' scores narrowed, and no racial or ethnic differences were found. Trends in racial and ethnic differences among the 6 competency domains mirrored total Milestone scores, with differences peaking in PGY2 and then decreasing in PGY3 such that parity in assessment was reached in all competency domains by the end of training. Conclusions and Relevance: In this cohort study, URiM and Asian internal medicine residents received lower ratings on performance assessments than their White peers during the first and second years of training, which may reflect racial bias in assessment. This disparity in assessment may limit opportunities for physicians from minoritized racial and ethnic groups and hinder physician workforce diversity.

Promoting Diversity, Equity, and Inclusion in the Selection of Obstetrician-Gynecologists.

In the setting of long-standing structural racism in health care, it is imperative to highlight inequities in the medical school-to-residency transition. In obstetrics and gynecology, the percentage of Black residents has decreased in the past decade. The etiology for this troubling decrease is unknown, but racial and ethnic biases inherent in key residency application metrics are finally being recognized, while the use of these metrics to filter applicants is increasing. Now is the time for action and for transformational change to rectify the factors that are detrimentally affecting the racial diversity of our residents. This will benefit our patients and learners with equitable health care and better outcomes.