A Systematic Review of Metrics Utilized in the Selection and Prediction of Future Performance of Residents in the United States.

Background Aligning resident and training program attributes is critical. Many programs screen and select residents using assessment tools not grounded in available evidence. This can introduce bias and inappropriate trainee recruitment. Prior reviews of this literature did not include the important lens of diversity, equity, and inclusion (DEI). Objective This study's objective is to summarize the evidence linking elements in the Electronic Residency Application Service (ERAS) application with selection and training outcomes, including DEI factors. Methods A systematic review was conducted on March 30, 2022, concordant with PRISMA guidelines, to identify the data supporting the use of elements contained in ERAS and interviews for residency training programs in the United States. Studies were coded into the topics of research, awards, United States Medical Licensing Examination (USMLE) scores, personal statement, letters of recommendation, medical school transcripts, work and volunteer experiences, medical school demographics, DEI, and presence of additional degrees, as well as the interview. Results The 2599 identified unique studies were reviewed by 2 authors with conflicts adjudicated by a third. Ultimately, 231 meeting inclusion criteria were included (kappa=0.53). Conclusions Based on the studies reviewed, low-quality research supports use of the interview, Medical Student Performance Evaluation, personal statement, research productivity, prior experience, and letters of recommendation in resident selection, while USMLE scores, grades, national ranking, attainment of additional degrees, and receipt of awards should have a limited role in this process.

An Innovative Assistant Nurse Manager Residency Program Focused on Participation, Satisfaction, Promotion, and Retention.

Assistant nurse managers (ANMs) were asked what they needed to be successful, fully engaged, and equipped to perform in their roles. The ANM Residency Program was created to support development of new ANMs through resources, education, and mentoring. Evaluations were used to guide curriculum enhancements and improve course facilitation. Participation, satisfaction, promotion, and retention were measured. Similar programs may be used to support development for all levels of nurse leaders.

Differentiated Instruction as a Viable Framework for Meeting the Needs of Diverse Adult Learners in Health Professions Education.

Health professions education (HPE) instructors are often challenged with simultaneously teaching adult learners of varying educational levels, needs, and backgrounds. With an increased focus on interprofessional education, instructors may be tasked with teaching extremely diverse audiences during a single educational session. While some aspects of differentiated instruction (DI) have been implemented within HPE contexts, the DI framework appears to be relatively unknown in many fields. Evidence from a range of educational fields outside of HPE supports the use of DI as a framework to enhance fairness, diversity and inclusion while meeting core instructional needs. In this Monograph, we explore DI and offer strategies for implementation amenable to many HPE settings.

Current trends in medical education affecting allergy and immunology physicians and learners.

OBJECTIVE: To review current and relevant trends in medical education, undergraduate medical education, graduate medical education, and continuing medical education for the allergy and clinical immunology (A/I) community. DATA SOURCES: English-only published literature from the past 5 years were obtained by means of a PubMed search and Google Scholar searches in addition to pertinent review articles and relevant textbooks as selected by the authors. STUDY SELECTIONS: A total of 62 articles were selected for their relevance to the article's objective. Older references regarding medical education trends were included when they were felt to be essential. RESULTS: Competency-based medical education is the contextual framework for curriculum, instruction, and assessment. Current trends influencing competency-based medical education are the following: e-learning; interprofessional education; simulation-based medical education; diversity, inclusion, and equity; and mentoring. This review clarifies terminology and offers examples of the potential impact of these trends within the A/I educational community. The development of knowledge and skills related to these topics can be achieved through formal faculty development, mentoring, and self-directed, asynchronous instruction. CONCLUSION: Medical education continues to evolve as health care adapts to meet the changing needs of the health care system and our patients. The A/I physicians should be aware of current trends because these trends impact their roles as instructors and lifelong learners.

Climate Change and Medical Education: An Integrative Model.

Medical schools face a challenge when trying to include new topics, such as climate change and health (CCH), in their curricula because of competing demands from more traditional biomedical content. At the same time, an understanding of CCH topics is crucial for physicians as they have clear implications for clinical practice and health care delivery. Although some medical schools have begun to incorporate CCH into curricula, the inclusion usually lacks a comprehensive framework for content and implementation. The authors propose a model for integrating CCH into medical school curricula using a practical, multistakeholder approach designed to mitigate competition for time with existing content by weaving meaningful CCH examples into current curricular activities. After the authors identified stakeholders to include in their curricular development working group, this working group determined the goals and desired outcomes of the curriculum; aligned those outcomes with the school's framework of educational objectives, competencies, and milestones; and strove to integrate CCH goals into as many existing curricular settings as possible. This article includes an illustration of the proposed model for one of the curricular goals (understanding the impacts of climate change on communities), with examples from the CCH curriculum integration that began in the fall of 2020 at the Cleveland Clinic Lerner College of Medicine of Case Western Reserve University. The authors have found that this approach does minimize competition for time with existing content and allows mapping of content to existing curricular competencies and milestones, while encouraging a broad understanding of CCH in the context of individual patients, populations, and communities. This model for curricular integration can be applied to other topics such as social determinants of health, health equity, disability studies, and structural racism.

An Examination of the Intersection of Climate Change, the Physician Specialty Workforce, and Graduate Medical Education in the U.S.

Issue: As U.S. healthcare systems plan for future physician workforce needs, the systemic impacts of climate change, a worldwide environmental and health crisis, have not been factored in. The current focus on increasing the number of trained physicians and optimizing efficiencies in healthcare delivery may be insufficient. Graduate medical education (GME) priorities and training should be considered in order to prepare a climate-educated physician workforce. Evidence: We used a holistic lens to explore the available literature regarding the intersection of future physician workforce needs, GME program priorities, and resident education within the larger context of climate change. Our interinstitutional, transdisciplinary team brought perspectives from their own fields, including climate science, climate and health research, and medical education to provide recommendations for building a climate-educated physician workforce. Implications: Acknowledging and preparing for the effects of climate change on the physician workforce will require identification of workforce gaps, changes to GME program priorities, and education of trainees on the health and societal impacts of climate change. Alignment of GME training with workforce considerations and climate action and adaptation initiatives will be critical in ensuring the U.S. has a climate-educated physician workforce capable of addressing health and healthcare system challenges. This article offers a number of recommendations for physician workforce priorities, resident education, and system-level changes to better prepare for the health and health system impacts of climate change.

An Examination of Resident Perspectives on Survey Participation and Methodology: Implications for Educational Practice and Research.

BACKGROUND: In medical education, self-administered questionnaires are used to gather information for needs assessments, innovation projects, program evaluations, and research studies. Despite the importance of survey methodology, response rates have declined for years, especially for physicians. OBJECTIVE: This study explored residents' experiences with survey participation and perceptions of survey design and implementation. METHODS: In 2019, residents at a large Midwestern academic medical center were recruited via email to participate in mixed specialty focus groups (FGs). Narrative comments were recorded, transcribed, and then analyzed via conventional content analysis, utilizing cognitive sociology as a conceptual framework. Themes and subthemes were generated iteratively. RESULTS: Postgraduate year 1-4 residents (n = 33) from internal medicine, surgery, and neurology participated in 7 FGs (3-7 participants/group) from April-May 2019. Eight themes were generated during content analysis: Negative emotions, professionalism, accuracy, impact, survey design/implementation, biases, survey fatigue, and anonymity. Residents questioned the accuracy of survey data, given the tendency for self-selection to drive survey participation. Residents wanted survey participation to be meaningful and reported non-participation for a variety of reasons, including doubts over impact. Satisficing and breakoffs were commonly reported. CONCLUSIONS: Though residency program cultures differ across institutions, the findings from this study, including potential barriers to survey participation, should be relevant to anyone in graduate medical education using survey methodology for programmatic data collection, accreditation, and research purposes.

Teaching residents how to break bad news: piloting a resident-led curriculum and feedback task force as a proof-of-concept study.

Background: Breaking bad news (BBN) is a critically important skill set for residents. Limited formal supervision and unpredictable timing of bad news delivery serve as barriers to the exchange of meaningful feedback. Purpose of study: The goal of this educational innovation was to improve internal medicine residents' communication skills during challenging BBN encounters. A formal BBN training programme and innovative on-demand task force were part of this two-phase project. Study design: Internal medicine residents at a large academic medical centre participated in an interactive workshop focused on BBN. Workshop survey results served as a needs assessment for the development of a novel resident-led BBN task force. The task force was created to provide observations at the bedside and feedback after BBN encounters. Training of task force members incorporated video triggers and a feedback checklist. Inter-rater reliability was analysed prior to field testing, which provided data on real-world implementation challenges. Results: 148 residents were trained during the 2-hour communications skills workshop. Based on survey results, 73% (108 of 148) of the residents indicated enhanced confidence in BBN after participation. Field testing of the task force on a hospital ward revealed potential workflow barriers for residents requesting observations and prompted troubleshooting. Solutions were implemented based on field testing results. Conclusions: A trainee-led BBN task force and communication skills workshop is offered as an innovative model for improving residents' interpersonal and communication skills in BBN. We believe the model is both sustainable and reproducible. Lessons learnt are offered to aid in implementation in other settings.

Higher Grit Scores Associated With Less Burnout in a Cohort of Internal Medicine Residents.

BACKGROUND: The association between grit, defined as perseverance and passion for long-term goals, and professional burnout has not been studied in internal medicine residents. Our objective was to examine whether internal medicine residents' scores on a grit scale were associated with various measures of burnout. METHODS: All residents from a single internal medicine program were invited to participate in a study of grit and burnout. Grit and burnout were measured using the Short Grit Scale and modified Maslach Burnout Inventory, respectively. In addition, demographics, last In-Training Examination (ITE) score, and interest in a subspecialty were captured. RESULTS: A total of 139 of 168 eligible residents (83%) participated. Emotional exhaustion and depersonalization (i.e., burn out) were identified in 63% and 42% of residents, respectively. Endorsement of emotional exhaustion was higher for residents living with family members, postgraduate year (PGY)1 and PGY2 compared with PGY3 residents, and residents scoring above the 50th percentile on the last ITE. Grit scores were higher for residents not reporting emotional exhaustion. As grit score increases, the odds of reporting emotional exhaustion significantly decreased, after adjustments for demographics, ITE scores, type of medical school, PGY level, and interest in a subspecialty (odds ratio = 0.36, 95% CI 0.15-0.84). CONCLUSIONS: Grit appeared to be an independent predictor of burnout in internal medicine residents in this sample, with lower grit scores associated with higher burnout scores. By measuring grit early in residency, programs can potentially identify residents at risk for symptoms of burnout, specifically emotional exhaustion, and implement targeted interventions.

Time to develop more clinician-educators in allergy and immunology.

Clinician-educators in the field of allergy and immunology (A/I) in the United States teach and assess trainees (medical students, residents, and fellows), provide professional development to primary care physicians and advance practice providers, and are essential in developing a pipeline of academic A/I specialists. According to data from Doximity and the Association of American Medical Colleges, the United States appears to be facing a shortage of clinician-educators and academic allergists in A/I. Without adequate numbers of A/I specialists focused on medical education, institutions will find it difficult to train fellows and introduce the field of A/I to medical students and residents. It is now imperative that the field focus on empowering more A/I specialists to become clinical teachers and clinician-educators. There are specific strategies that individuals, as active agents in their own development, can take in planning for this rewarding and fulfilling career. Individuals can pursue professional development opportunities, join medical education communities of practice, seek education mentors, and join in scholarship activities. It is also essential that systems-level support be provided for clinician-educators, given the increasing business pressures in medicine. Academic institutions, national organizations, and professional societies can provide resources, including structured programs in medical education, protected time, and grants. This article outlines strategies for individuals, institutions, and professional organizations that will promote the development of the next generation of A/I clinician-educators.

Best practice versus actual practice: an audit of survey pretesting practices reported in a sample of medical education journals.

Background: Despite recommendations from survey scientists, surveys appear to be utilized in medical education without the critical step of pretesting prior to survey launch. Pretesting helps ensure respondents understand questions as survey developers intended and that items and response options are relevant to respondents and adequately address constructs, topics, issues or problems. While psychometric testing is important in assessing aspects of question quality and item performance, it cannot discern how respondents, based upon their lived experiences, interpret the questions we pose.Aim: This audit study explored whether authors of medical education journal articles within audited journals reported pretesting survey instruments during survey development, as recommended by survey scientists and established guidelines/standards for survey instrument development.Methods: Five national and international medical education journals publishing survey articles from Jan. 2014 - Dec. 2015 were audited to determine whether authors reported pretesting during survey development. All abstracts within all issues of these journals were initially reviewed. Two hundred fifty-one articles met inclusion criteria using a protocol piloted and revised prior to use.Results: The number of survey articles published per journal ranged from 11 to 106. Of 251 audited articles, 181 (72.11%) described using a new instrument without pretesting, while 17 (6.77%) described using a new instrument where items were pretested. Fifty-three (21.12%) articles described using pre-existing instruments; of these, no articles (0%) reported pretesting existing survey instruments prior to use.Conclusions: Findings from this audit study indicate that reported survey pretesting appears to be lower than that reported in healthcare journals. This is concerning, as results of survey studies and evaluation projects are used to inform educational practices, guide future research, and influence policy and program development. Findings apply to both survey developers and faculty across a range of fields, including evaluation and medical education research.

A Pilot Assessment of Primary Care Providers' Knowledge of Adrenal Insufficiency Diagnosis and Management.

Background and Objectives: Adrenal insufficiency (AI) is one of the most challenging diagnoses in primary care, and misdiagnosis is costly. The aim of this educational needs assessment was to assess primary care physicians' (PCPs) knowledge of AI diagnosis and management as a preliminary step in developing a professional education module to address knowledge of practice gaps. Methods: We developed a 12-item needs assessment and pretested questionnaire items prior to use to gather validity evidence. The questionnaire contained 4 AI knowledge items, 4 needs assessment items, and 4 demographic items. It was administered to 100 PCPs across a single integrated health care system over a 6-month period. Results: Fifty-one of 100 questionnaires were returned. The majority of respondents believed their knowledge of AI diagnosis and management was "average" when compared with peers. Responses indicated that PCPs were fairly comfortable diagnosing, but not managing AI patients. There was no association between respondents' clinical knowledge of AI and respondents' roles as clinical instructors (ie, having trainees assigned to them). A total of 54% of respondents said they utilized online resources to enhance current knowledge of AI and 88% of respondents said they would use a new AI resource, if available. When asked to rank preferences for professional development modalities, 26/38 respondents ranked UpToDate, 21/38 respondents ranked traditional lecture, and 19/38 respondents ranked case discussion among their top 3 choices. Conclusion: Results of this needs assessment showed that PCPs within our health care system both needed and desired professional development targeting AI diagnosis and management. A faculty development session, which included a short lecture and case scenarios, was developed and delivered to PCPs at participating family health centers. Session materials are now available for use by other institutions to meet professional development needs on this important topic.

A Qualitative Study of Independent Home Visits by Hospice Fellows: Addressing Gaps in ACGME Milestones by Fostering Reflection and Self-Assessment.

BACKGROUND: With the rapid growth in the number of fellowship programs in Hospice and Palliative Medicine (HPM), many are in the process of developing ways to demonstrate that fellows are attaining educational milestones. Reflection and self-assessment are key components of 2 Accreditation Council for Graduate Medical Education (ACGME) competencies, practice-based learning and improvement, and systems-based practice, which have both been historically challenging to learn and assess. OBJECTIVE: This article describes results of a content analysis of narrative data collected from HPM fellows' self-assessments as they performed hospice home visits independently in a new clinical rotation. DESIGN: This was a prospective qualitative study. SETTINGS/PARTICIPANTS: Eight fellows completed 217 unsupervised hospice home visits from 2014 to 2016. MEASUREMENTS: Fellows completed weekly self-assessment forms, which captured both clinical visit information and practice data elicited from responses to open-ended reflection prompts. RESULTS: Analysis of 29 self-assessment forms generated 6 themes: patient- and family-centered care, self-efficacy, systems-based care, commitment to doing their best, catalyst for professional growth, and purpose and meaning in work. The fellows recognized numerous barriers distinct to providing care in homes. All fellows felt prepared to perform home visits throughout the rotation and after training. CONCLUSIONS: Narrative data collected during the independent home visit rotation provided evidence that HPM fellows detected gaps in their performance, planned for practice improvements in subsequent visits, and valued working within an interprofessional team. Built-in opportunities for fellows to reflect during training are critical in meeting ACGME milestones, and are integral to their professional development.

Frequency, Timing, and Types of Medication Ordering Errors Made by Residents in the Electronic Medical Records Era.

OBJECTIVES: To describe associations between resident level of training, timing of medication orders, and the types of inpatient medication ordering errors made by internal medicine residents. METHODS: This study reviewed all inpatient medication orders placed by internal medicine residents at a tertiary care academic medical center from July 2011 to June 2015. Medication order errors were measured by pharmacists' reporting of an error via the electronic medical record during real-time surveillance of orders. Multivariable regression models were constructed to assess associations between resident training level (postgraduate year [PGY]), medication order timing (time of day and month of year), and rates of medication ordering errors. RESULTS: Of 1,772,462 medication orders placed by 335 residents, 68,545 (3.9%) triggered a pharmacist intervention in the electronic medical record. Overall and for each PGY level, renal dose monitoring/adjustment was the most common order error (40%). Ordering errors were less frequent during the night and transition periods versus daytime (adjusted odds ratio [aOR] 0.93, 95% confidence interval [CI] 0.91-0.96, and aOR 0.93, 95% CI 0.90-0.95, respectively). Errors were more common in July and August compared with other months (aOR 1.05, 95% CI 1.01-1.09). Compared with PGY2 residents, both PGY1 (aOR 1.06, 95% CI 1.03-1.10), and PGY3 residents (aOR 1.07, 95% CI, 1.03-1.10) were more likely to make medication ordering errors. Throughout the course of the academic year, the odds of a medication ordering error decreased by 16% (aOR 0.84, 95% CI 0.80-0.89). CONCLUSIONS: Despite electronic medical records, medication ordering errors by trainees remain common. Additional supervision and resident education regarding medication orders may be necessary.

Using an Adaptive, Self-Directed Web-Based Learning Module to Enhance Residents' Medical Knowledge Prior to a New Clinical Rotation.

BACKGROUND: The effect of self-directed adaptive learning on internal medicine residents' knowledge prior to a new clinical rotation is not known. METHODS: We developed an adaptive, online, self-directed spaced repetition module and determined the effect on medical knowledge acquisition. We randomized postgraduate year 1 internal medicine residents into two groups. The intervention group (n = 27) received an electronic version of the clinical rotation curriculum as portable document format (PDF) files and participated in the online module, delivered via Moodle, a free, open-source learning management system. The non-intervention group (n = 27) only received the PDF files. All residents participated in a medical knowledge test at baseline and 3 months later. RESULTS: Both groups were similar at study baseline in terms of age, trainee type, years since graduation, results at United States Medical Licensing Examination (USMLE) Step 1, 2, In-Training Examination (ITE), and pre-intervention evaluation. There was a statistically significant improvement in scores on the post-intervention medical knowledge assessment for the intervention group when compared with the non-intervention group (24.2 ± 15.4% vs. 8.6 ± 9.9%, p < 0.001). CONCLUSION: An online, self-directed, adaptive spaced repetition-learning module can offer a simple and effective method to increase the medical knowledge present at the start of residents' clinical rotations.

Interprofessional educator development : Build it and they will come.

BACKGROUND: We describe an interprofessional educator development program, designed intentionally, that was implemented at an academic healthcare centre. In 2014, we purposefully adapted our pre-existing educator development program to be able to include all interprofessional educators at our institution. The program's goals were to enhance educator skills, a common need due to requirements of accreditation, and to create a local interprofessional community of teachers. The framework of the program was based upon adult learning principles, reflective practice, experiential learning and peer groups, all key characteristics of faculty development programs. It was also longitudinal and immersive. Kirkpatrick's program evaluation model was used for identifying results; participants' self-reported evaluation forms were collected and their narrative comments were analyzed. RESULTS: After we opened our educator program to all interprofessional staff, our number of program participants increased. The interprofessional participants included, but was not limited to, physicians, physician trainees, nurses, physician assistants, audiologists, perfusionists, and basic science researchers. Our number of program sessions and program faculty were expanded. Our interprofessional participants reported that they were able to learn essential knowledge, skills and attitudes for their growth and development as educators, in the context of an interprofessional community, while also appreciating the diversity of their peers. DISCUSSION: We share our insights with the redesign and implementation of an interprofessional educator program so that others can learn from our experiences. Key takeaways include using a conceptual framework for teaching effectiveness, involving interprofessional stakeholders and obtaining their perspectives, reviewing interprofessional literature and competencies, and highlighting best practices across the disciplines.

Fairness: the hidden challenge for competency-based postgraduate medical education programs.

Competency-based medical education systems allow institutions to individualize teaching practices to meet the needs of diverse learners. Yet, the focus on continuous improvement and individualization of curricula does not exempt programs from treating learners in a fair manner. When learners fail to meet key competencies and are placed on probation or dismissed from training programs, issues of fairness may form the basis of their legal claims. In a literature search, we found no in-depth examination of fairness. In this paper, we utilize a systems lens to examine fairness within postgraduate medical education contexts, focusing on educational opportunities, assessment practices, decision-making processes, fairness from a legal standpoint, and fairness in the context of the learning environment. While we provide examples of fairness issues within US training programs, concerns regarding fairness are relevant in any medical education system which utilizes a competency-based education framework.Assessment oversight committees and annual programmatic evaluations, while recommended, will not guarantee fairness within postgraduate medical education programs, but they can provide a window into 'hidden' threats to fairness, as everything from training experiences to assessment practices may be examined by these committees. One of the first steps programs can take is to recognize that threats to fairness may exist in any educational program, including their own, and begin conversations about how to address these issues.