International Medical Graduate Resident Wellness: Examining Qualitative Data From J-1 Visa Physician Recipients.

PURPOSE: International medical graduates (IMGs), approximately 25% of the U.S. physician workforce, have unique needs as they enter residency programs. This study identified wellness barriers and challenges that IMGs encounter as they transition to the United States. METHOD: The authors analyzed results from 3 open-ended questions in a 21-item survey. This survey was administered in December 2019 to 11,504 IMG resident physicians sponsored by the Educational Commission for Foreign Medical Graduates' J-1 visa program. These questions asked respondents to describe challenges to their wellness, how they maintain wellness, and resources that would have aided their transition. Data were analyzed using a mixed-methods approach, including both qualitative descriptions and category frequencies. RESULTS: Of the surveys administered, 7,817 responses (68% response rate) were received. Respondents identified challenges navigating cultural differences (1,314, 17%), health care system (1,108, 14%), distance from family and friends (890, 11%), bureaucratic barriers (724, 9%), and language/communication and finances (575, 7%; 565, 7%, respectively). They also specified that friendships/relationships (2,800, 36%) followed by exercise (2,318, 30%), family (1,822, 23%), socialization (1,001, 13%), and healthy eating (775, 10%) were factors important to their wellness. Respondents requested more information about socialization (741, 9%), bureaucratic support (456, 6%), IMG support networks (427, 5%), financial support (404, 5%), and greater online resources (240, 3%). CONCLUSIONS: IMGs have needs and concerns specific to their demographic group. Participants' responses suggested that they wanted additional support in the workplace and their personal lives. Answers also indicated that IMGs experienced a unique set of stressors such as fluctuating immigration laws that U.S. medical graduates do not face. Finally, this study supports a body of research that connects social and physical wellness. By identifying and describing these challenges, the authors seek to inform the development of specific programs and resources to improve IMG resident wellness.

Stages of Milestones Implementation: A Template Analysis of 16 Programs Across 4 Specialties.

BACKGROUND: Since 2013, US residency programs have used the competency-based framework of the Milestones to report resident progress and to provide feedback to residents. The implementation of Milestones-based assessments, clinical competency committee (CCC) meetings, and processes for providing feedback varies among programs and warrants systematic examination across specialties. OBJECTIVE: We sought to determine how varying assessment, CCC, and feedback implementation strategies result in different outcomes in resource expenditure and stakeholder engagement, and to explore the contextual forces that moderate these outcomes. METHODS: From 2017 to 2018, interviews were conducted of program directors, CCC chairs, and residents in emergency medicine (EM), internal medicine (IM), pediatrics, and family medicine (FM), querying their experiences with Milestone processes in their respective programs. Interview transcripts were coded using template analysis, with the initial template derived from previous research. The research team conducted iterative consensus meetings to ensure that the evolving template accurately represented phenomena described by interviewees. RESULTS: Forty-four individuals were interviewed across 16 programs (5 EM, 4 IM, 5 pediatrics, 3 FM). We identified 3 stages of Milestone-process implementation, including a resource-intensive early stage, an increasingly efficient transition stage, and a final stage for fine-tuning. CONCLUSIONS: Residency program leaders can use these findings to place their programs along an implementation continuum and gain an understanding of the strategies that have enabled their peers to progress to improved efficiency and increased resident and faculty engagement.

Residents' Ratings of Their Clinical Supervision and Their Self-Reported Medical Errors: Analysis of Data From 2009.

BACKGROUND: Medical errors and patient safety are major concerns for the medical and medical education communities. Improving clinical supervision for residents is important in avoiding errors, yet little is known about how residents perceive the adequacy of their supervision and how this relates to medical errors and other education outcomes, such as learning and satisfaction. METHODS: We analyzed data from a 2009 survey of residents in 4 large specialties regarding the adequacy and quality of supervision they receive as well as associations with self-reported data on medical errors and residents' perceptions of their learning environment. RESULTS: Residents' reports of working without adequate supervision were lower than data from a 1999 survey for all 4 specialties, and residents were least likely to rate "lack of supervision" as a problem. While few residents reported that they received inadequate supervision, problems with supervision were negatively correlated with sufficient time for clinical activities, overall ratings of the residency experience, and attending physicians as a source of learning. Problems with supervision were positively correlated with resident reports that they had made a significant medical error, had been belittled or humiliated, or had observed others falsifying medical records. CONCLUSIONS: Although working without supervision was not a pervasive problem in 2009, when it happened, it appeared to have negative consequences. The association between inadequate supervision and medical errors is of particular concern.

The Effect and Use of Milestones in the Assessment of Neurological Surgery Residents and Residency Programs.

OBJECTIVES: The purpose of this study was to determine the effect of the Accreditation Council for Graduate Medical Education Milestones on the assessment of neurological surgery residents. The authors sought to determine the feasibility, acceptability, and utility of this new framework in making judgments of progressive competence, its implementation within programs, and the influence on curricula. Residents were also surveyed to elicit the effect of Milestones on their educational experience and professional development. DESIGN, SETTING, AND PARTICIPANTS: In 2015, program leadership and residents from 21 neurological surgery residency programs participated in an online survey and telephone interview in which they reflected on their experiences with the Milestones. Survey data were analyzed using descriptive statistics. Interview transcripts were analyzed using grounded theory. RESULTS: Response themes were categorized into 2 groups: outcomes of the Milestones implementation process, and facilitators and barriers. Because of Milestones implementation, participants reported changes to the quality of the assessment process, including the ability to identify struggling residents earlier and design individualized improvement plans. Some programs revised their curricula based on training gaps identified using the Milestones. Barriers to implementation included limitations to the adoption of a developmental progression model in the context of rotation block schedules and misalignment between progression targets and clinical experience. The shift from time-based to competency-based evaluation presented an ongoing adjustment for many programs. Organized preparation before clinical competency committee meetings and diverse clinical competency committee composition led to more productive meetings and perceived improvement in promotion decisions. CONCLUSIONS: The results of this study can be used by program leadership to help guide further implementation of the Milestones and program improvement. These results also help to guide the evolution of Milestones language and their implementation across specialties.

Competency Crosswalk: A Multispecialty Review of the Accreditation Council for Graduate Medical Education Milestones Across Four Competency Domains.

PURPOSE: To identify common and overlapping themes among the interpersonal and communication skills (ICS), practice-based learning and improvement (PBLI), professionalism (PROF), and systems-based practice (SBP) milestones of the transitional year and 26 specialties. METHOD: In May 2017, milestones were accessed from the Accreditation Council for Graduate Medical Education specialties website. A thematic analysis of the ICS, PBLI, PROF, and SBP milestones was performed to determine unique and common themes across these competencies and across specialties. Keywords from the common program requirements were initially applied as codes to the milestones. Codes were then grouped into common themes. RESULTS: Twenty-two themes were identified: 15 (68%) were unique to a given competency (3 related to ICS, 4 related to PBLI, 5 related to PROF, and 3 related to SBP), and 7 (32%) appeared in the milestones of more than one core competency. Eleven themes (50%) were used by 20 or more specialties, and 6 themes (27%) by 10 or fewer specialties. No theme was present across all specialties. CONCLUSIONS: The ICS, PBLI, PROF, and SBP milestones contain multiple themes with areas of overlap among these four competencies and substantial variability across specialties. This variability may create differential expectations of residents across specialties, complicate faculty development, and make sharing assessment tools difficult. The thematic analysis provides important insights into how individual specialties interpret and operationalize the ICS, PBLI, PROF, and SBP competency domains and can inform future revisions of milestones to enable harmonization and shared understanding of these competencies across specialties where appropriate.

Causes of Death of Residents in ACGME-Accredited Programs 2000 Through 2014: Implications for the Learning Environment.

PURPOSE: To systematically study the number of U.S. resident deaths from all causes, including suicide. METHOD: The more than 9,900 programs accredited by the Accreditation Council for Graduate Medical Education (ACGME) annually report the status of residents. The authors aggregated ACGME data on 381,614 residents in training during years 2000 through 2014. Names of residents reported as deceased were submitted to the National Death Index to learn causes of death. Person-year calculations were used to establish resident death rates and compare them with those in the general population. RESULTS: Between 2000 and 2014, 324 individuals (220 men, 104 women) died while in residency. The leading cause of death was neoplastic disease, followed by suicide, accidents, and other diseases. For male residents the leading cause was suicide, and for female residents, malignancies. Resident death rates were lower than in the age- and gender-matched general population. Temporal patterns showed higher rates of death early in residency. Deaths by suicide were higher early in training, and during the first and third quarters of the academic year. There was no upward or downward trend in resident deaths over the 15 years of this study. CONCLUSIONS: Neoplastic disease and suicide were the leading causes of death in residents. Data for death by suicide suggest added risk early in residency and during certain months of the academic year. Providing trainees with a supportive environment and with medical and mental health services is integral to reducing preventable deaths and fostering a healthy physician workforce.

States Can Transform Their Health Care Workforce.

The United States faces the simultaneous challenges of improving health care access and balancing the specialty and geographic distribution of physicians. A 2014 Institute of Medicine report recommended significant changes in Medicare graduate medical education (GME) funding, to incentivize innovation and increase accountability for meeting national physician workforce needs. Annually, nearly $4 billion of Medicaid funds support GME, with limited accountability for outcomes. Directing these funds toward states' greatest health care workforce needs could address health care access and physician maldistribution issues and make the funding for resident education more accountable. Under the proposed approach, states would use Medicaid funds, in conjunction with Medicare GME funds, to expand existing GME programs and establish new primary care and specialty programs that focus on their population's unmet health care needs.

A checklist for ascertaining study cohorts in oncology health services research using secondary data: report of the ISPOR oncology good outcomes research practices working group.

OBJECTIVES: The ISPOR Oncology Special Interest Group formed a working group at the end of 2010 to develop standards for conducting oncology health services research using secondary data. The first mission of the group was to develop a checklist focused on issues specific to selection of a sample of oncology patients using a secondary data source. METHODS: A systematic review of the published literature from 2006 to 2010 was conducted to characterize the use of secondary data sources in oncology and inform the leadership of the working group prior to the construction of the checklist. A draft checklist was subsequently presented to the ISPOR membership in 2011 with subsequent feedback from the larger Oncology Special Interest Group also incorporated into the final checklist. RESULTS: The checklist includes six elements: identification of the cancer to be studied, selection of an appropriate data source, evaluation of the applicability of published algorithms, development of custom algorithms (if needed), validation of the custom algorithm, and reporting and discussions of the ascertainment criteria. The checklist was intended to be applicable to various types of secondary data sources, including cancer registries, claims databases, electronic medical records, and others. CONCLUSIONS: This checklist makes two important contributions to oncology health services research. First, it can assist decision makers and reviewers in evaluating the quality of studies using secondary data. Second, it highlights methodological issues to be considered when researchers are constructing a study cohort from a secondary data source.

What do residents do when not working or sleeping? A multispecialty survey of 36 residency programs.

PURPOSE: To determine how residents spend their time when not working or sleeping, and to examine correlates of these outside activities. METHOD: In 2009, the authors surveyed 36 internal medicine, surgery, pediatrics, and obstetrics-gynecology programs. Residents answered questions about their recently completed first and second residency years, including, "During your past year of residency, outside of working hours, about how often did you…," followed by 10 listed activities and a four-point rating scale (1 = "less than once a week"; 4 = "almost daily"). RESULTS: The most frequent activity reported across all 634 respondents was using the Internet, followed by watching television and doing household tasks. The lowest reported activity was moonlighting, followed by seeing a movie. K-cluster analyses divided residents into three clusters: (1) "Friend Focused," reporting higher means for time with friends, Internet use, physical exercise, and watching television, (2) "Family Focused," reporting higher means for time with family, Internet use, household tasks, and watching television, and (3) "Low Activity," reporting the lowest ratings for all activities. Comparisons among these three clusters showed the Low Activity residents to have significantly higher scores on validated depression, anxiety, and sleepiness scales; higher stress; more reported work hours and sleep deprivation; and lower ratings for satisfaction, time with attendings, and learning. Scores for Friend-Focused and Family-Focused clusters were similar to each other. CONCLUSIONS: These data provide new information about the residency experience and suggest that activities outside of work and sleep hours correlate highly with residents' mood, learning, and satisfaction.