Eye on the Prize: Patient Outcomes Research in Medical Education.

The overarching goal of medical education is to train clinicians who achieve and maintain competence in patient care. Although the field of medical education research has acknowledged the importance of education on clinical practices and outcomes, most research endeavors continue to focus on learner-centered outcomes, such as knowledge and attitudes. The absence of clinical and patient-centered outcomes in pulmonary and critical care medicine medical education research has been attributed to barriers at multiple levels, including financial, methodological, and practical considerations. This Perspective explores clinical outcomes relevant to pulmonary and critical care medicine educational research and offers strategies and solutions that educators can use to accomplish what many consider the "prize" of medical education research: an understanding of how our educational initiatives impact the health of patients.

Creation of a sustainable longitudinal women in Leadership Development (WILD) curriculum focused on graduate medical education trainees.

BACKGROUND: Although women comprise the majority of medical students, gender disparities emerge early and remain at the highest levels of academia. Most leadership courses focus on faculty or students rather than women graduate medical education (GME) trainees. AIM: To promote the leadership development of women GME trainees through empowerment, community building, networking and mentorship, and concrete leadership skills development. SETTING: University of California, San Francisco. PARTICIPANTS: 359 women residents and fellows from 41 specialties. PROGRAM DESCRIPTION: A longitudinal curriculum of monthly workshops designed to support leadership development for women trainees. Sessions and learning objectives were designed via needs assessments and literature review. PROGRAM EVALUATION: A mixed-methods evaluation was performed for 3 years of WILD programming. Quantitative surveys assessed participant satisfaction and fulfillment of learning objectives. Structured interview questions were asked in focus groups and analyzed qualitatively. DISCUSSION: 23% of invited participants attended at least one session from 2018 to 2021, despite challenging trainee schedules. Surveys demonstrated acceptability and satisfaction of all sessions, and learning objectives were met at 100% of matched sessions. Focus groups highlighted positive impact in domains of community-building, leadership skills, mentorship, and empowerment. This program has demonstrated WILD's longitudinal sustainability and impact for women trainees.

Changes in Gender and Racial/Ethnic Diversity in US Residency Program Applications From 2018 to 2022.

Background Residency application patterns by gender and race/ethnicity offer important insights about diversity in residency recruitment. It is unknown how the COVID-19 pandemic and virtual interviewing affected these patterns. Objective We hypothesized that the introduction of virtual interviews caused an increase in applications submitted per applicant and that there may be differences by gender and race/ethnicity. Methods We extracted publicly reported Electronic Residency Application Service application data from 2018 to 2022 for 14 residency specialties with 1000 or more applicants in 2022 by self-reported gender and underrepresented in medicine (UIM) status. We compared patterns before and after virtual interviews were introduced in 2021. Results Among 401 480 residency applicants, the average number of applications submitted per applicant increased for all specialties between 2018 and 2022 across gender and race/ethnicity. Across all years, women applied to more programs than men in 5 specialties (dermatology, neurology, obstetrics/gynecology, pediatrics, and surgery), whereas men applied to more programs than women in 3 (anesthesia, family medicine, and physical medicine and rehabilitation). Across all years, non-UIM applicants applied to more programs than UIM applicants in all 14 specialties. There were no clear changes in application patterns by gender and race/ethnicity during in-person versus virtual interview years. Conclusions The average number of applications submitted per applicant increased over time across gender and race/ethnicity. In some specialties, women applied to more programs than men, and in others vice-versa, whereas non-UIM applicants applied to more programs than UIM applicants in all specialties. Virtual interviews did not change these patterns.

Beyond the Procedure Log: Using Individualized Learning Plans to Set Learner-Specific Milestones for Procedural Skills Acquisition.

ABSTRACT: Procedural training for nonsurgical fields, such as internal medicine, is an important component of medical education. However, recent changes to accreditation guidelines have resulted in less formal guidance on procedural competency, not only leading to opportunities for individualizing training but also creating potential problems for trainees and training programs. In this article, the authors use internal medicine as an exemplar to review current strategies for procedural education in nonsurgical fields, including procedural simulation, dedicated procedural rotations, and advanced subspecialty training, and highlight an emerging need for learner-specific terminal milestones in procedural training. Individualized learning plans (ILPs), collections of trainee-specific objectives for learning, are arguably a useful strategy for organizing procedural training. The role of ILPs as a framework to support setting learner-specific terminal milestones, guide skill acquisition, and allocate procedural learning opportunities based on trainees' anticipated career plans is subsequently explored, and how an ILP-based approach might be implemented within the complex educational milieu of a clinical training program is examined. The limitations and pitfalls of an ILP-based approach, including the need for development of coaching programs, are considered. The authors conclude that, despite the limitations of ILPs, when combined with other current strategies for building trainees' procedural competence, these plans may help trainees maximize the educational benefits of their training period and can encourage effective, safer, and equitable allocation of procedural practice opportunities.

Policies to Support Lactation at Highly Ranked US Medical Schools.

This cross-sectional study analyzes lactation support policies at the top 50 US schools of medicine.

Gender Disparities in Critical Care Procedure Training of Internal Medicine Residents.

Background: Procedural training is a required competency in internal medicine (IM) residency, yet limited data exist on residents' experience of procedural training. Objectives: We sought to understand how gender impacts access to procedural training among IM residents. Methods: A mixed-methods, explanatory sequential study was performed. Procedure volume for IM residents between 2016 and 2020 was assessed at two large academic residencies (Program A and Program B: 399 residents and 4,020 procedures). Procedural rates and actual versus expected procedure volume by gender were compared, with separate analyses by clinical environment (intensive care unit [ICU] or structured procedural service). Semistructured gender-congruent focus groups were conducted. Topics included identity formation as a proceduralist and the resident procedural learning experience, including perceived gender bias in procedure allocation. Results: Compared with men, women residents performed disproportionately fewer ICU procedures per month at Program A (1.4 vs. 2.7; P < 0.05) but not at Program B (0.36 vs. 0.54; P = 0.23). At Program A, women performed only 47% of ICU procedures, significantly fewer than the 54% they were expected to perform on the basis of their time on ICU rotations (P < 0.001). For equal gender distribution of procedural volume at Program A, 11% of the procedures performed by men would have needed to have been performed by women instead. Gender was not associated with differences in the Program A structured procedural service (53% observed vs. 52% expected; P = 0.935), Program B structured procedural service (40% observed vs. 43% expected; P = 0.174), or in Program B ICUs (33% observed vs. 34% expected; P = 0.656). Focus group analysis identified that women from both residencies perceived that assertiveness was required for procedural training in unstructured learning environments. Residents felt that gender influenced access to procedural opportunities, ability to self-advocate for procedural experience, identity formation as a proceduralist, and confidence in acquiring procedural skills. Conclusion: Gender disparities in access to procedural training during ICU rotations were seen at one institution but not another. There were ubiquitous perceptions that assertiveness was important to access procedural opportunities. We hypothesize that structured allocation of procedures would mitigate disparities by allowing all residents to access procedural training regardless of self-advocacy. Residency programs should adopt structured procedural training programs to counteract inequities.

Scaling up a diagnostic pause at the ICU-to-ward transition: an exploration of barriers and facilitators to implementation of the ICU-PAUSE handoff tool.

OBJECTIVES: The transition from the intensive care unit (ICU) to the medical ward is a high-risk period due to medical complexity, reduced patient monitoring, and diagnostic uncertainty. Standardized handoff practices reduce errors associated with transitions of care, but little work has been done to standardize the ICU to ward handoff. Further, tools that exist do not focus on preventing diagnostic error. Using Human-Centered Design methods we previously created a novel EHR-based ICU-ward handoff tool (ICU-PAUSE) that embeds a diagnostic pause at the time of transfer. This study aims to explore barriers and facilitators to implementing a diagnostic pause at the ICU-to-ward transition. METHODS: This is a multi-center qualitative study of semi-structured interviews with intensivists from ten academic medical centers. Interviews were analyzed iteratively through a grounded theory approach. The Sittig-Singh sociotechnical model was used as a unifying conceptual framework. RESULTS: Across the eight domains of the model, we identified major benefits and barriers to implementation. The embedded pause to address diagnostic uncertainty was recognized as a key benefit. Participants agreed that standardization of verbal and written handoff would decrease variation in communication. The main barriers fell within the domains of workflow, institutional culture, people, and assessment. CONCLUSIONS: This study represents a novel application of the Sittig-Singh model in the assessment of a handoff tool. A unique feature of ICU-PAUSE is the explicit acknowledgement of diagnostic uncertainty, a practice that has been shown to reduce medical error and prevent premature closure. Results will be used to inform future multi-site implementation efforts.

Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool.

BACKGROUND: The intensive care unit (ICU)-ward transfer poses a particularly high-risk period for patients. The period after transfer has been associated with adverse events and additional work for care teams related to miscommunication or omission of information. Standardized handoff processes have been found to reduce communication errors and adverse patient events in other clinical environments but are understudied at the ICU-ward interface. We previously developed an electronic ICU-ward transfer tool, ICU-PAUSE, which embeds the key elements and diagnostic reasoning to facilitate a safe transfer of care at ICU discharge. OBJECTIVE: The aim of this study is to evaluate the implementation process of the ICU-PAUSE handoff tool across 10 academic medical centers, including the rate of adoption and acceptability, as perceived by clinical care teams. METHODS: ICU-PAUSE will be implemented in the medical ICU across 10 academic hospitals, with each site customizing the tool to their institution's needs. Our mixed methods study will include a combination of a chart review, quantitative surveys, and qualitative interviews. After a 90-day implementation period, we will conduct a retrospective chart review to evaluate the rate of uptake of ICU-PAUSE. We will also conduct postimplementation surveys of providers to assess perceptions of the tool and its impact on the frequency of communication errors and adverse events during ICU-ward transfers. Lastly, we will conduct semistructured interviews of faculty stakeholders with subsequent thematic analysis with the goal of identifying benefits and barriers in implementing and using ICU-PAUSE. RESULTS: ICU-PAUSE was piloted in the medical ICU at Barnes-Jewish Hospital, the teaching hospital of Washington University School of Medicine in St. Louis, in 2019. As of July 2022, implementation of ICU-PAUSE is ongoing at 6 of 10 participating sites. Our results will be published in 2023. CONCLUSIONS: Our process of ICU-PAUSE implementation embeds each step of template design, uptake, and customization in the needs of users and key stakeholders. Here, we introduce our approach to evaluate its acceptability, usability, and impact on communication errors according to the tenets of sociotechnical theory. We anticipate that ICU-PAUSE will offer an effective handoff tool for the ICU-ward transition that can be generalized to other institutions. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/40918.

Teaching the science of uncertainty.

As we increasingly acknowledge the ubiquitous nature of uncertainty in clinical practice (Meyer AN, Giardina TD, Khawaja L, Singh H. Patient and clinician experiences of uncertainty in the diagnostic process: current understanding and future directions. Patient Educ Counsel 2021;104:2606-15; Han PK, Klein WM, Arora NK. Varieties of uncertainty in health care: a conceptual taxonomy. Med Decis Making 2011;31:828-38) and strive to better define this entity (Lee C, Hall K, Anakin M, Pinnock R. Towards a new understanding of uncertainty in medical education. J Eval Clin Pract 2020; Bhise V, Rajan SS, Sittig DF, Morgan RO, Chaudhary P, Singh H. Defining and measuring diagnostic uncertainty in medicine: a systematic review. J Gen Intern Med 2018;33:103-15), as educators we should also design, implement, and evaluate curricula addressing clinical uncertainty. Although frequently encountered, uncertainty is often implicitly referred to rather than explicitly discussed (Gärtner J, Berberat PO, Kadmon M, Harendza S. Implicit expression of uncertainty - suggestion of an empirically derived framework. BMC Med Educ 2020;20:83). Increasing explicit discussion of - and comfort with -uncertainty has the potential to improve diagnostic reasoning and accuracy and improve patient care (Dunlop M, Schwartzstein RM. Reducing diagnostic error in the intensive care unit. Engaging. Uncertainty when teaching clinical reasoning. Scholar;1:364-71). Discussion of both diagnostic and prognostic uncertainty with patients is central to shared decision-making in many contexts as well, (Simpkin AL, Armstrong KA. Communicating uncertainty: a narrative review and framework for future research. J Gen Intern Med 2019;34:2586-91) from the outpatient setting to the inpatient setting, and from undergraduate medical education (UME) trainees to graduate medical education (GME) trainees. In this article, we will explore the current status of how the science of uncertainty is taught from the UME curriculum to the GME curriculum, and describe strategies how uncertainty can be explicitly discussed for all levels of trainees.

A National Leadership Incubator to Promote Equity in Diagnostic Excellence: The National Academy of Medicine DxEx Scholars.

This Viewpoint discusses the structure of the National Academy of Medicine's Scholars in Diagnostic Excellence program and the lessons learned from this national leadership incubator.