Responsiveness to societal needs in postgraduate medical education: the role of accreditation.

BACKGROUND: Social accountability in medical education has been defined as an obligation to direct education, research, and service activities toward the most important health concerns of communities, regions, and nations. Drawing from the results of a summit of international experts on postgraduate medical education and accreditation, we highlight the importance of local contexts in meeting societal aims and present different approaches to ensuring societal input into medical education systems around the globe. MAIN TEXT: We describe four priorities for social responsiveness that postgraduate medical education needs to address in local and regional contexts: (1) optimizing the size, specialty mix, and geographic distribution of the physician workforce; (2) ensuring graduates' competence in meeting societal goals for health care, population health, and sustainability; (3) promoting a diverse physician workforce and equitable access to graduate medical education; and (4) ensuring a safe and supportive learning environment that promotes the professional development of physicians along with safe and effective patient care in settings where trainees participate in care. We relate these priorities to the values proposed by the World Health Organization for social accountability: relevance, quality, cost-effectiveness, and equity; discuss accreditation as a lever for change; and describe existing and evolving efforts to make postgraduate medical education socially responsive. CONCLUSION: Achieving social responsiveness in a competency-based postgraduate medical education system requires accrediting organizations to ensure that learning emphasizes relevant competencies in postgraduate curricula and educational experiences, and that graduates possess desired attributes. At the same time, institutions sponsoring graduate medical education need to provide safe and effective patient care, along with a supportive learning and working environment.

Effective accreditation in postgraduate medical education: from process to outcomes and back.

BACKGROUND: The accreditation of medical educational programs is thought to be important in supporting program improvement, ensuring the quality of the education, and promoting diversity, equity, and population health. It has long been recognized that accreditation systems will need to shift their focus from processes to outcomes, particularly those related to the end goals of medical education: the creation of broadly competent, confident professionals and the improvement of health for individuals and populations. An international group of experts in accreditation convened in 2013 to discuss this shift. MAIN TEXT: Participants unequivocally supported the inclusion of more outcomes-based criteria in medical education accreditation, specifically those related to the societal accountability of the institutions in which the education occurs. Meaningful and feasible outcome metrics, however, are hard to identify. They are regionally variable, often temporally remote from the educational program, difficult to measure, and susceptible to confounding factors. The group identified the importance of health outcomes of the clinical milieu in which education takes place in influencing outcomes of its graduates. The ability to link clinical data with individual practice over time is becoming feasible with large repositories of assessment data linked to patient outcomes. This was seen as a key opportunity to provide more continuous oversight and monitoring of program impact. The discussants identified several risks that might arise should outcomes measures completely replace process issues. Some outcomes can be measured only by proxy process elements, and some learner experience issues may best be measured by such process elements: in brief, the "how" still matters. CONCLUSIONS: Accrediting bodies are beginning to view the use of practice outcome measures as an important step toward better continuous educational quality improvement. The use of outcomes will present challenges in data collection, aggregation, and interpretation. Large datasets that capture clinical outcomes, experience of care, and health system performance may enable the assessment of multiple dimensions of program quality, assure the public that the social contract is being upheld, and allow identification of exemplary programs such that all may improve. There remains a need to retain some focus on process, particularly those related to the learner experience.

Inclusion in the clinical learning environment: Building the conditions for diverse human flourishing.

Aim: While diversity, equity, and inclusion are much proclaimed aspirational goals in education programs, the clinical learning environment (CLE) frequently falls short of meaningful incorporation of these concepts in processes, policies, and local culture. In this paper, we explore how inclusion, diversity, and equity can and should be defined and operationalized within medical education. Methods: Three cases, organized around Hafferty's curricular framework (formal, informal, and hidden), we illustrate lapses and potential best practices in inclusion in the CLE. Results: The essential "best-practice" of programs inclusive of diverse individuals is the design of policies, processes, and behavioral norms co-creatively with all community members. Potential pitfalls to greater inclusion include nostalgic reference to "the past", a neutrality that is operationalized without the rudder of explicit values and not recognizing that ethical obligations between teachers, learners, and programs are at the heart of the discussion of how inclusive learning and work environments are built. Conclusion: Inclusive CLE's provide space for co-creation, understand the need to ensure the voices of the vulnerable (i.e. learners) are heard and valued and through this promote the flourishing of diverse human capital, in keeping with a model that views diversity as a key attribute or organizational excellence.

The education avenue of the clinical learning environment: A pragmatic approach.

Aim: This perspective is part of a series of articles that are outcomes of a consensus conference, that seek to offer a comprehensive examination of the clinical learning environment (CLE), using different academic disciplines and areas of focus termed "avenues." The education dimensions of the CLE are discussed in detail in this perspective, along with critical linkages to the other avenues. Methods: Using iterative presentations, discussion and small group work, in October 2018, the consensus conference participants explored the education, psychological, sociocultural, diversity and inclusion, digital and architectural aspects of the CLE. Results: The education avenue of the CLE includes elements of teaching and learning such as the curriculum, clinical experiences, the assessment system, educational program governance, trainee selection, faculty development, and program evaluation and improvement. Within the educational domain, we focus on organizational and personal/social aspects of the CLE, including (1) curriculum design and deployment, including placement of trainees in clinical settings, organizational culture, practices and policies, and accreditation and regulatory requirements from the organizational domain (2) the education system, including assessment, program evaluation and organization and governance; and (3) elements from the personal and social domains, including peer-to-peer, trainee-faculty, and trainee-patient relationships that influence how and what postgraduate trainees learn, trainee selection, informal and hidden curricula, and trainees' perceptions of their learning environment. Conclusions: We provide suggestions for further research and recommendations for addressing challenges and facilitating improvement in the educational aspects of the CLE, along with actionable practice points.

Learning and professional acculturation through work: Examining the clinical learning environment through the sociocultural lens.

Purpose: We examined studies of the clinical learning environment from the fields of sociology and organizational culture to (i) offer insight into how workplace culture has informed research on postgraduate trainee learning and professional development; (ii) highlight limitations of the literature; and (iii) suggest practical ways to apply sociocultural concepts to challenges in the learning environment. Materials and methods: Concepts were explored by participants at a consensus conference in October 2018. Results: We identified three enduring foci for research using a sociocultural lens: the hidden curriculum, exploration of medical errors, and the impact of time pressures on the relational nature of clinical education. Limitations included the lower value attributed to informal learning and a pejorative valuation of the hidden curriculum; and disconnect between practices in clinical settings and the priorities of the larger organization. Conclusions: Research on the learning environment using a sociocultural lens suggest workplace goals, norms and practices determined which learners engage in learning-relevant activities, to what extent, and the degree of guidance provided, with these factors creating "tacit" curricula that may support or compete with formal learning goals. We close with guidance on how sociocultural constructs could inform research to improve the learning environment.

The clinical learning environment.

Learning in a clinical context is foundational in the training of health professionals; there is simply no alternative. The subject of the clinical learning environment (CLE) is at the forefront of discussions. In this introduction to a themed issue on the CLE, we present an expanded conceptual model that approaches the CLE through six different lenses, termed "avenues:" architectural, digital, diversity and inclusion, education, psychological, and sociocultural, with each avenue represented by a paper. The aim is to facilitate dialog around the contributions of different academic disciplines to research on the CLE. Collectively the papers highlight the overlap between the various "avenues" in how they influence each other, and how they collectively have shaped the work to understand and improve the CLE. The expectation is that the various avenues can add to existing knowledge and create new ideas for interventions to improve the clinical learning environment across nations for learners and teachers with the ultimate aim of improving patient care. Research and efforts to improve the CLE are critical to learning, professional socialization and well-being for trainees as they learn and participate in patient care, and to the quality of care they will deliver over decades of practice after graduation.

Duty-hour limits and patient care and resident outcomes: can high-quality studies offer insight into complex relationships?

Long hours are an accepted component of resident education, yet data suggest they contribute to fatigue that may compromise patient safety. A systematic review confirms that limiting duty hours increases residents' hours of sleep and improves objective measures of alertness. Most studies of operative experience for surgical residents found no effect, and there is evidence of a limited positive effect on residents' mood. We find a mixed effect on patient safety, although problems with supervision, rather than the limits, may be responsible or contibute; evidence of reduced continuity of care and reduced continuity in residents' clinical education; and evidence that increased workload under the limits has a negative effect on patient and resident outcomes. We highlight specific areas for research and offer recommendations for national policy.

Resident perspectives on duty hour limits and attributes of their learning environment.

BACKGROUND: Residents are stakeholders in the debate surrounding duty hour restrictions, yet few studies have assessed their perspective on their programs' efforts to comply with them. OBJECTIVES: This paper explores learners' perceptions of the attributes of their programs in relation to duty hour compliance, and looks for evidence whether residents view duty hour limits as important to patient safety. METHODS: A grounded-theory framework was used to analyze learners' comments about programs' compliance with US duty hour limits. Data were collected by ACGME in 2011, using resident consensus lists of program strengths and opportunities for improvement generated prior to accreditation site visits. The data set for this analysis encompasses 112 core and 69 subspecialty programs where these lists mentioned duty hours. RESULTS: The analysis compared programs where residents viewed duty hour compliance as a strength, and programs where it was identified as an opportunity for improvement. Programs in the first group were characterized by clinical efficiency, responsiveness to problems, and a collegial environment that contributed to residents' ability to meet clinical and learning goals within the restrictions. These attributes were lacking in the second group, and residents also commented on onerous duty hour reporting. Learners did not associate duty hour compliance with patient safety, and the few comments in this area centred almost exclusively on the presence or absence of supervision when junior residents first assumed clinical duties. CONCLUSION: The findings have practical implications for programs that wish to enhance their learning and patient care environment, and suggest areas for future research.

Adapting standardized patient training to improve patients' understanding and preparedness for health care encounters.

OBJECTIVE: To examine the impact of standardized patient (SP) training on SPs' real-life healthcare encounters and explore whether SP training elements can be adapted to increase actual patients' understanding, communication and participation in a patient-centered care model. METHODS: Data were collected from surveys and focus groups with standardized patients and a survey of primary care physicians. Findings were used to create an educational video with pre- and post-viewing surveys of patients' understanding of engagement strategies and plans to use them in future encounters. RESULTS: SPs reported medical visits were more productive because of their ability to understand the visit's framework; crediting their SP training. Patients reported the video will help in planning future medical visits by providing information that increases their understanding of their role in the care process. CONCLUSIONS: SPs' understanding of the visit and its impact on knowledge, skills and affective domains can be transferred to patients in the form of specific strategies that enhance communication and patient participation during medical visits. PRACTICE IMPLICATIONS: A brief educational intervention for patients using SPs' understanding of the medical visit may contribute to enhanced patient participation in future health care encounters and could increase patient engagement in patient-centered models of care.

Evaluating governance in a clinical and translational research organization.

Institutional Development Awards for Clinical and Translational Research (IDeA-CTR) networks, funded by NIH/NIGMS, aim to advance CTR infrastructure to address historically unmet state and regional health needs. Success depends on the response to actionable feedback to IDeA-CTR leadership from network partners and governance groups through annual surveys, interviews, and governance body recommendations. The Great Plains IDeA-CTR applied internal formative meta-evaluation to evaluate dispositions of 172 governance recommendations from 2017 to 2021. Results provided insights to improve the classification and quality of recommendations, credibility of evaluation processes, responsiveness to recommendations, and communications and governance in a complex CTR network comprising multiple coalitions.

Interventions to Support Resident and Fellow Well-Being During the COVID-19 Pandemic: A Scoping Review.

Background The COVID-19 pandemic led to rapid and wide-scale changes in graduate medical education and impacted the well-being of frontline physicians, including residents and fellows. While institutions and programs implemented initiatives to support the unique needs of trainees during the pandemic, there remains a gap in the literature in examining the approaches used, the domains of well-being addressed, and the effectiveness of these efforts. Objective To review the literature on interventions designed to promote resident and fellow well-being during the COVID-19 pandemic. Methods The authors conducted a scoping review of the literature published between January 1, 2020, and November 30, 2023, in PubMed, Scopus, Embase, PsycINFO, CINAHL, and ERIC to identify interventions to promote the well-being of trainees during the COVID-19 pandemic. Results Eighteen articles met inclusion criteria, mainly studies conducted in the United States (14 of 18, 77.8%). Most interventions targeted psychological well-being (16 of 18, 88.9%), with only a few studies that included interventions in the physical or social domains. Interventions entailed redeployment, schedule modifications, communication strategies, and expanded mental health support. Most interventions were limited to a few weeks' duration in the first surge phase of the pandemic. Only 11 studies (61%) reported outcome measures, and only 2 (11%) used instruments with validity evidence. Most studies did not report sufficient data to evaluate study quality. Conclusions While longer-term outcome data were often lacking, studies described a range of interventions to support resident well-being. Future research should focus on the effectiveness of well-being interventions and include cohorts from more diverse clinical settings.

Review article: closing the research gap at the interface of learning and clinical practice.

PURPOSE: The dialogue at the interface of education and clinical practice highlights areas of critical importance to the development of new approaches for educating anesthesiologists. The purpose of this article is to examine the literature on education and acquisition of competence in three areas relevant to the interface of learning and clinical practice, with the aim to suggest a research agenda that adds to the evidence on preparing physicians for independent practice. The three areas are: 1) transitions across the continuum of education; 2) the effect of reductions in hours of clinical training on competence; and 3) efforts to incorporate the competencies and CanMEDS roles into teaching and evaluation. PRINCIPAL FINDINGS: Fifty-six articles relevant to one or more of the themes were identified in the review, including 21 studies of transitions (in, during, and after residency education), 19 studies on the effects of duty hour limits on residents' acquisition of competence, and 16 articles that assessed competency-based teaching and assessment in anesthesiology. Overall, the findings suggested a relative paucity of scientific evidence and a need for research and the development of new scientific theory. Studies generally treated one of the themes in isolation, while in actuality they interact to produce optimal as well as suboptimal learning situations, while medical education research often is limited by small samples, brief follow-up, and threats to validity. This suggests a "research gap" where editorials and commentaries have moved ahead of an evidence base for education. Promising areas for research include preparation for care deemed important by society, work to apply knowledge about the development of expertise in other disciplines to medicine, and ways to embed the competencies in teaching and evaluation more effectively. CONCLUSION: Closing the research gap in medical education will require clear direction for future work. The starting point, at an institution or nationally, is dialogue within the specialty to achieve consensus on some of the most pressing questions.

The International Literature on Teaching Faculty Development in English-Language Journals: A Scoping Review and Recommendations for Core Topics.

BACKGROUND: With increasing physician mobility, there is interest in how medical schools and postgraduate medical education institutions across the world develop and maintain the competence of medical teachers. Published reviews of faculty development (FD) have predominantly included studies from the United States and Canada. OBJECTIVE: We synthesized the international FD literature (beyond the US and Canada), focusing on FD type, intended audience, study format, effectiveness, differences among countries, and potential unique features. METHODS: We identified English-language publications that addressed FD for medical faculty for teaching and related activities, excluding US and Canadian publications. RESULTS: A search of 4 databases identified 149 publications, including 83 intervention studies. There was significant growth in international FD publications for the most recent decade, and a sizable number of studies were from developing economies and/or resulted from international collaborations. Focal areas echo those in earlier published reviews, suggesting the international FD literature addresses similar faculty needs and organizational concerns. CONCLUSIONS: The growth in publications in recent years and a higher proportion of reporting on participant reactions, coupled with less frequent reporting of results, transfer to practice, and impact on learners and the organization, suggest this is an evolving field. To enhance international FD, educators and researchers should focus on addressing common needs expressed by faculty, including curriculum design and evaluation, small group teaching, assessing professionalism and providing feedback. Future research should focus on approaches for developing comprehensive institutional FD programs that include communities of learning and practice and evaluating their impact.

Residents' Ratings of Their Clinical Supervision and Their Self-Reported Medical Errors: Analysis of Data From 2009.

BACKGROUND: Medical errors and patient safety are major concerns for the medical and medical education communities. Improving clinical supervision for residents is important in avoiding errors, yet little is known about how residents perceive the adequacy of their supervision and how this relates to medical errors and other education outcomes, such as learning and satisfaction. METHODS: We analyzed data from a 2009 survey of residents in 4 large specialties regarding the adequacy and quality of supervision they receive as well as associations with self-reported data on medical errors and residents' perceptions of their learning environment. RESULTS: Residents' reports of working without adequate supervision were lower than data from a 1999 survey for all 4 specialties, and residents were least likely to rate "lack of supervision" as a problem. While few residents reported that they received inadequate supervision, problems with supervision were negatively correlated with sufficient time for clinical activities, overall ratings of the residency experience, and attending physicians as a source of learning. Problems with supervision were positively correlated with resident reports that they had made a significant medical error, had been belittled or humiliated, or had observed others falsifying medical records. CONCLUSIONS: Although working without supervision was not a pervasive problem in 2009, when it happened, it appeared to have negative consequences. The association between inadequate supervision and medical errors is of particular concern.

Patient safety curriculum for surgical residency programs: results of a national consensus conference.

BACKGROUND: The American College of Surgeons (ACS) and the Accreditation Council for Graduate Medical Education (ACGME) are committed to promoting patient safety through education. In view of the critical role of residents in the delivery of safe patient care, the ACS and ACGME sponsored jointly a national consensus conference to initiate the development of a curriculum on patient safety that may be used across all surgical residency programs. CONCLUSIONS: National leaders in surgery with expertise in surgical care and surgical education, patient safety experts, medical educators, key stakeholders from national organizations, and surgical residents were invited to participate in the conference. Attendees considered patient safety issues within the context of the 6 core competencies defined by the ACGME and American Board of Medical Specialties (ABMS). Discussions resulted in the development of a curriculum matrix that includes listings of patient safety topics, teaching and learning strategies, and assessment methods. Guidelines for implementation and dissemination are also provided. The curriculum content underscores the need to create an organizational culture of safety and focuses on both individuals and systems. Individual residency programs may prioritize the curriculum content based on their specific needs. The ACS and ACGME will pursue development of educational modules to address the curriculum content, disseminate helpful information, and assist in implementation of new educational interventions. This effort has the potential to positively impact residency education in surgery, help surgical program directors address the core competencies, and enhance patient safety.

Causes of Death of Residents in ACGME-Accredited Programs 2000 Through 2014: Implications for the Learning Environment.

PURPOSE: To systematically study the number of U.S. resident deaths from all causes, including suicide. METHOD: The more than 9,900 programs accredited by the Accreditation Council for Graduate Medical Education (ACGME) annually report the status of residents. The authors aggregated ACGME data on 381,614 residents in training during years 2000 through 2014. Names of residents reported as deceased were submitted to the National Death Index to learn causes of death. Person-year calculations were used to establish resident death rates and compare them with those in the general population. RESULTS: Between 2000 and 2014, 324 individuals (220 men, 104 women) died while in residency. The leading cause of death was neoplastic disease, followed by suicide, accidents, and other diseases. For male residents the leading cause was suicide, and for female residents, malignancies. Resident death rates were lower than in the age- and gender-matched general population. Temporal patterns showed higher rates of death early in residency. Deaths by suicide were higher early in training, and during the first and third quarters of the academic year. There was no upward or downward trend in resident deaths over the 15 years of this study. CONCLUSIONS: Neoplastic disease and suicide were the leading causes of death in residents. Data for death by suicide suggest added risk early in residency and during certain months of the academic year. Providing trainees with a supportive environment and with medical and mental health services is integral to reducing preventable deaths and fostering a healthy physician workforce.

Improvement in Context: Exploring Aims, Improvement Priorities, and Environmental Considerations in a National Sample of Programs Using "Small Data".

BACKGROUND: In 2013, the Accreditation Council for Graduate Medical Education (ACGME) transitioned into a new accreditation system to reduce burden, focus on outcomes, and promote innovation and improvement. One component is a self-study that includes aims, an environmental assessment, and setting improvement priorities. The ACGME initiated voluntary site visits following the self-study. OBJECTIVE: We explored common themes in program aims and assessment of their environment. METHODS: Using grounded theory, inductive and deductive qualitative methods, and truth grounding, we analyzed data from voluntary site visits of 396 core and subspecialty programs between June 2015 and September 2017, with a focus on common themes. RESULTS: We report common themes for aims and the dimensions of the environmental assessment. Themes for strengths include a collegial, supportive learning environment; responsive leaders; and experiences that prepare residents for unsupervised practice. Improvement priorities encompass low learner engagement and "content mismatch" in didactic education, balancing education and service at a time of growing clinical volumes, and improving the utility of assessment systems. Common opportunities encompass collaborations that improve education, involving alumni and harnessing technology to enrich education, while threats include an unsustainable effort for many program leaders, clinical pressures on faculty, and loss of external sites important for education. Linked dimensions of the environmental assessment suggest benefit in a growing focus on learners, and approaches to ensure a humanistic learning environment that allows for growth, self-determination, and inclusion. CONCLUSIONS: The findings highlight actionable themes for the environmental assessment. We discuss implications for programs, institutions, and the ACGME.

What Is Known: Examining the Empirical Literature in Resident Work Hours Using 30 Influential Articles.

BACKGROUND: Examining influential, highly cited articles can show the advancement of knowledge about the effect of resident physicians' long work hours, as well as the benefits and drawbacks of work hour limits. OBJECTIVE: A narrative review of 30 articles, selected for their contribution to the literature, explored outcomes of interest in the research on work hours-including patient safety, learning, and resident well-being. METHODS: Articles were selected from a comprehensive review. Citation volume, quality, and contribution to the evolving thinking on work hours and to the Accreditation Council for Graduate Medical Education standards were assessed. RESULTS: Duty hour limits are supported by the scientific literature, particularly limits on weekly hours and reducing the frequency of overnight call. The literature shows declining hours and call frequency over 4 decades of study, although the impact on patient safety, learning, and resident well-being is not clear. The review highlighted limitations of the scientific literature on resident hours, including small samples and reduced generalizability for intervention studies, and the inability to rule out confounders in large studies using administrative data. Key areas remain underinvestigated, and accepted methodology is challenged when assessing the impact of interventions on the multiple outcomes of interest. CONCLUSIONS: The influential literature, while showing the beneficial effect of work hour limits, does not answer all questions of interest in determining optimal limits on resident hours. Future research should use methods that permit a broader, collective examination of the multiple, often competing attributes of the learning environment that collectively promote patient safety and resident learning and well-being.