Improved tracheostomy-dependent patient outcomes after implementation of the Pediatric Resident Education in Pulmonary (PREP) Boot Camp.

INTRODUCTION: Children with tracheostomies are high risk for morbidity and mortality. Pediatric resident physicians are not routinely taught skills to care for this vulnerable patient population. Few reports link educational interventions to improved patient outcomes. This study evaluates the impact of an intensive educational training program on pediatric residents' observed skills and tracheostomy-dependent patient outcomes. METHODS: Pediatric post-graduate year 2 (PGY2) resident physicians rotating through the inpatient pediatric pulmonology month at Children's Hospital Colorado July 2018-2019 participated in the Pediatric Resident Education in Pulmonary (PREP) Boot Camp, an intensive educational program with an interactive lecture and simulation experience on patients with tracheostomy-dependence. PGY2s who partook in PREP and PGY3s who rotated before PREP initiation were invited to be studied. Primary outcomes included: (1) resident skills assessed by direct observation during simulation encounters and (2) rates of intensive care unit (ICU) transfers in tracheostomy-dependent patients following acute events before and after introduction of PREP. We hypothesized that increased education would enhance resident skills and improve patient outcomes by decreasing the rate of ICU transfers. RESULTS: PGY2 residents retained skills learned during PREP up to 11 months following initial participation, and significantly outperformed their PGY3 counterparts. There was a significant decrease in ICU transfer rate in patients with tracheostomies admitted to the pulmonary team during the 19 months following initiation of PREP. CONCLUSIONS: Enhanced early education may improve resident physicians' ability to care for complex patients with tracheostomies and could improve outcomes in this high-risk population.

'Yourself in all your forms': A grounded theory exploration of identity safety in medical students.

INTRODUCTION: Identity threats, such as stereotype threat and microaggressions, impair learning and erode well-being. In contrast to identity threat, less is known about how learners experience feelings of safety regarding their identity. This exploratory study aims to develop a theory of identity safety in the clinical learning environment. METHODS: This multi-institutional, qualitative interview study was informed by constructivist grounded theory and critical pedagogy. Participants were clinical students at three public medical schools in the United States in 2022. Investigators purposively sampled participants for interviews based on their responses to an 11-item survey with an open-ended question soliciting students' personal identities and responses to both the racial/ethnic and gender Stereotype Vulnerability Scales. The investigators interviewed, coded, constantly compared and continued sampling until the codes could be developed into categories, then concepts and finally into a theory. The team engaged in critical reflexivity throughout the analytic process to enrich data interpretations. RESULTS: Sixteen diverse students were interviewed. We organised their identity-salient experiences into identity threat, threat mitigation and identity safety. Participants experienced identity threat through unwelcoming learning environments, feeling compelled to change their behaviour in inauthentic ways or sociopolitical threat. Threat mitigation occurred when a participant or supervisor intervened against an identity threat, dampening but not eliminating the threat impact. Participants characterised identity safety as the ability to exist as their authentic selves without feeling the need to monitor how others perceive their identities. Identity safety manifested when participants demonstrated agency to leverage their identities for patient care, when others upheld their personhood and saw them as unique individuals and when they felt they belonged in the learning environment. DISCUSSION: Attending to identity safety may lead to educational practices that sustain and leverage team members' diverse identities. Identity safety and threat mitigation may work together to combat identity threats in the learning environment.

A Narrative Review of Key Studies in Medical Education in 2022: Applying the Current Literature to Educational Practice and Scholarship.

The expectation of every academic pediatrician is to stay updated on current evidence in their field; this is especially true of pediatric clinician educators who are training the next generation of pediatricians. Since 2016, select members of the Academic Pediatric Association Education Committee have curated educational research articles in order to distill the increasing volume of research related to medical education. The purpose of this narrative review is to summarize 14 articles published in 2022 related to medical education that may impact the work of pediatric clinician educators and educational leadership. These articles are organized into 6 overarching domains: selection and recruitment, promoting learner growth and development, learning environment and wellness, curriculum development, assessment, and educator development.

ChatGPT for assessment writing.

What is the educational challenge?Medical schools invest significant resources into the creation of multiple-choice items for assessments. This process is costly and requires faculty training. Recently ChatGPT has been used in various areas to improve content creation efficiency, and it has otherwise been used to answer USMLE-style assessment items.What are the proposed solutions?We proposed the use of ChatGPT to create initial drafts of multiple-choice items.What are the potential benefits to a wider global audience?The use of ChatGPT to generate assessment items can decrease resources required, allowing for the creation of more items, and freeing-up faculty time to perform higher level assessment activities. ChatGPT is also able to consistently produce items using a standard format while adhering to item writing guidelines, which can be very challenging for faculty teams.What are the next steps?We plan to pilot ChatGPT drafted questions and compare item statistics for those written by ChatGPT with those written by our content experts. We also plan to further identify the types of questions that ChatGPT is most appropriate for, and incorporate media into assessment items (e.g. images, videos).

Preliminary Workforce Outcomes of an Urban Longitudinal Integrated Clerkship.

PURPOSE: The authors examined whether students participating in an urban longitudinal integrated clerkship (LIC) with a curriculum focused on care for underserved populations have a sustained commitment to urban underserved care through residency training and into practice. METHOD: This mixed-methods study collected data from medical student application essays to the Denver Health LIC (DH-LIC), end-of-course surveys, residency match outcomes, and postgraduation surveys annually for academic years 2014 to 2022. The authors analyzed students' responses to the surveys on interest in working with underserved patients, understanding the rewards and challenges of working in safety net institutions, working in the community to improve health, and working at DH. The authors qualitatively coded the 70 application essays of all selected students using summative content analysis. RESULTS: Seventy DH-LIC students were compared with 1,450 medical students between 2014 and 2022. Qualitative analysis of LIC application essays revealed 3 themes: interest in working with underserved populations, work experience with underserved populations, and personal experience with medical vulnerability. Fifty-seven DH-LIC participants (81.4%) expressed high levels of career interest in working with underserved populations, 45 (64.3%) had high levels of work experience with underserved populations, and 18 (25.7%) expressed high levels of personal experience. Graduates of the DH-LIC program demonstrated a high degree of continuing interest in practicing in urban underserved settings throughout medical school and postgraduate training. Ten graduates (71.4%) in practice work in urban underserved settings. Participants reported a high or very high level of interest and commitment to working with underserved populations (96.7%-100%), understanding the safety net health care system (91.7%-98.6%), and working in communities (95.0%-100%) at all time points studied. CONCLUSIONS: Early data indicate high rates of graduates working in urban underserved settings. These preliminary outcomes suggest the LIC may support the development of a committed workforce for urban underserved communities.

Designing a Shortened Preclinical Basic Science Curriculum: Expert-Derived Recommendations.

PURPOSE: To generate an expert-derived list of recommendations for how medical schools should approach decisions about the placement of basic science topics within shortened preclinical curricula, which allow for early clinical immersion. METHOD: A modified Delphi process was used to develop consensus on recommendations (March-November 2021). The authors performed semistructured interviews with national undergraduate medical education (UME) experts from institutions that previously underwent curricular reforms involving shortened preclinical curricula to elicit perspectives on how decisions were made at their institutions. The authors condensed the findings into a preliminary list of recommendations and distributed this list in 2 survey rounds to a larger group of national UME experts (from institutions that previously underwent curricular reforms or held positions of authority within national UME organizations) to gauge their level of agreement with each recommendation. Recommendations were revised based on participant comments, and those with at least 70% somewhat or strong agreement after the second survey were included in the final comprehensive list of recommendations. RESULTS: Interviews were conducted with 9 participants and resulted in 31 preliminary recommendations that were then sent via survey to the 40 recruited participants. Seventeen/40 (42.5%) participants completed the first survey, after which 3 recommendations were removed, 5 were added, and 5 were revised based on comments-resulting in 33 recommendations. Twenty-two/38 (57.9%) participants responded to the second survey, after which all 33 recommendations met inclusion criteria. The authors removed 3 recommendations that did not directly address the curriculum reform process and consolidated the final 30 recommendations into 5 succinct, actionable takeaways. CONCLUSIONS: This study generated 30 recommendations (summarized by the authors in 5 succinct takeaways) for medical schools designing a shortened preclinical basic science curriculum. These recommendations reinforce the importance of vertically integrating basic science instruction with explicit clinical relevance into all curricular phases.

A Narrative Review of Key Studies in Medical Education in 2021: Applying Current Literature to Educational Practice and Scholarship.

To remain at the forefront of clinical practice and pedagogy, pediatric medical educators must stay informed of the latest research. Yet familiarization with the growing body of literature in both pediatrics and medical education is a near-impossible task for the busy medical educator. The purpose of this annotated bibliography is to summarize key manuscripts in medical education published in 2021 that have the potential to significantly influence a pediatric medical educator's practice. Using a 2-staged iterative process, discrete author pairs reviewed 1599 abstracts from 16 medical education and specialty journals. In summary, 16 manuscripts were selected and grouped into the following 6 domains: assessment and feedback, USMLE Step 1 changes, communication, wellness, diversity and inclusion, and professional development. The authors provide abridged summaries and high-yield take-aways from these manuscripts that may impact educational practices in pediatrics. This year, we also provide a 6-year retrospective review of the journals that have had selected articles for this annotated bibliography since inception.

Enhancing Learner Engagement Through Experiential Learning With Learner-Generated Data.

Integrating self-generated learner data into hands-on curricula enhances learner engagement with material and self-assessed learning. Using learner self-generated data to enhance learner engagement can have widespread applicability and benefit for use in design of educational curricula.

An Annotated Bibliography of Key Studies in Medical Education in 2020: Applying the Current Literature to Educational Practice and Scholarship.

Pediatric medical educators, with their multitude of responsibilities, may have difficulty staying abreast with both medical education and specialty specific medical literature. The body of medical literature is growing at an exponential rate. This annotated bibliography serves as a summary of highlighted medical education literature in the year 2020. The purpose was to identify manuscripts which have the potential to significantly influence a pediatric medical educator's practice. The authors reviewed abstracts from 14 medical education and specialty journals using a two-staged review process. Each stage of review was completed by 2 different authors. A total of 1861 abstracts were reviewed and ultimately 15 key manuscripts were identified. The authors grouped the manuscripts into 6 core domains: diversity and inclusion, faculty development, feedback, learner development, mentorship, and teaching skills. Condensed summaries of each medical education manuscript likely to influence educational practice are provided by the authors in this annotated bibliography.

An Annotated Bibliography of Key Studies in Medical Education in 2019: Applying the Current Literature to Educational Practice and Scholarship.

Pediatric medical educators have the dual challenge of remaining up-to-date in the field of pediatrics and in the field of medical education. Due to the volume of information published in these 2 fields it can be nearly impossible to remain current in both fields of practice. To facilitate interpretation of the most recent medical education research, the authors conducted an annotated bibliography of medical education literature published in 2019. The purpose of this annotated bibliography was to identify manuscripts which had the potential to significantly influence a pediatric educator's practice. Using a 2-staged review process, the authors reviewed abstracts from 13 medical education and specialty journals. All reviews were independently completed by 2 different reviewers for each journal in both stages. A total of 4700 abstracts were reviewed and 17 key manuscripts were identified. The authors grouped the key manuscripts into 6 core themes: bedside teaching, learning climate, bias, learner autonomy, learner in trouble, and resident competency. This annotated bibliography provides the authors' condensed summary of the medical education manuscripts most likely to influence educational practices for the busy pediatric medical educator.

Pediatric Resident Education in Pulmonary (PREP): A Subspecialty Preparatory Boot Camp Curriculum for Pediatric Residents.

Introduction: Medical errors can occur any time resident physicians transition between rotations, especially to unfamiliar areas such as subspecialty pediatrics. To combat this, we created and implemented the pediatric resident education in pulmonary (PREP) boot camp using Kern's six-step approach to curriculum development. Methods: PREP was a 5-hour session with multiple high-yield components held on the first day of each new rotation, aimed to prepare residents to care for complex pulmonary inpatients, including those with tracheostomy and ventilator dependence, asthma, and cystic fibrosis. The curriculum was evaluated at multiple time points through surveys of residents and faculty and two formal resident focus group sessions. Results: PREP was successfully implemented in July 2018 with continued monthly sessions held. Thirty-five residents participated in the first year. Resident perceived preparedness and confidence in taking call duties increased significantly following PREP. All residents rated PREP as extremely helpful or very helpful, the highest ratings possible. Overall, residents preferred active learning strategies. All qualitative data revealed positive effects of PREP. Clinical faculty in the pulmonology division found PREP similarly helpful and felt that PREP better prepared residents to provide care to pulmonary inpatients than our previous model. Discussion: Our monthly preparatory boot camp on the first day of residents' inpatient pulmonary rotation has improved resident experience, preparedness, and ability to care for complex pulmonary patients. The curriculum was adjusted in response to feedback to increase hands-on time and interactive sessions. Protected time for residents and active learning strategies were key to success of PREP.

The COVID-19 Pandemic as an Imperative to Advance Medical Student Assessment: Three Areas for Change.

Conditions caused by the COVID-19 pandemic have disrupted clinical practice and all aspects of medical education. Yet the need to continue to train physicians to care for patients and communities is greater than ever. Medical educators are responding by adapting curricula in response to requirements for social distancing, changing availability of clinical learning opportunities, and limitations on testing center availability for examinations. These disruptions require a systems approach to ensure that learners achieve competence in preparation for advancement in training toward unsupervised practice. In this article, the authors assert that medical educators, obligated by current conditions to adapt educational experiences, should seize the opportunity presented by the pandemic to make needed changes in 3 areas aligned with competency-based medical education: focusing on outcomes, broadening the assessment toolbox, and improving the undergraduate medical education-to-graduate medical education (UME-to-GME) transition. Defined outcomes, as exemplified by entrustable professional activities, will enable curricular designers to shorten and adapt learning experiences by focusing on students' achievement of prespecified learning outcomes. Broadening the assessment toolbox entails capturing more and different assessment information about learners to provide a well-rounded view of their strengths and areas for growth in both traditional and novel settings, such as telehealth. Limitations on available data, such as licensing examination scores and clerkship grades, heighten the urgency to revise the system for the UME-to-GME transition by enhancing the quality and usability of information available to residency program directors. Educators should capitalize on the opportunity presented by altered conditions due to the COVID-19 pandemic to make these needed changes to the educational system, to prepare physicians to provide health care and lead the health care system into the future.

Describing Overarching Curricular Goals for Individualized Education.

Phenomenon: The phenomenon of individualized education, an essential component of competency-based medical education, addresses individual learner needs while working toward standardized learning outcomes. One challenge with broadly implementing individualized education is the lack of a pragmatic operational definition. To formalize expectations for individualized education, the Accreditation Council of Graduate Medical Education in 2013 began requiring six months of individualized curriculum (IC) during pediatric residency; however, there is not a national standard of formal curricular goals for the IC as an educational entity. Examining and describing the overarching curricular goals of IC could provide a framework for discourse about and further study of individualized education in medicine across disciplines and the continuum of medical education. Thus, we aimed to describe the phenomenon of individualized education through the lens of the goals of the IC in pediatric residency in the United States. Approach: In 2017, a purposeful sample of Pediatric Residency leaders were recruited to represent a diverse sample of program sizes, regions of the country, and importance of the IC to the program leadership. They completed an online survey with open-ended questions describing formal and implicit goals of their program's IC. The authors analyzed responses initially using conventional content analysis, then investigated whether the themes for program goals aligned with any existing educational theory. The concepts and language aligned with the principles of self-determination theory (SDT); therefore, the IC goals were subsequently grouped using the SDT domains of relatedness, autonomy, and competence. A focus group with a subset of survey respondents was conducted for member checking and elaboration of concepts. Findings: Program leaders from a diverse sample of 36 programs participated in the survey and a subset of 11 programs participated in the focus group. The common goals across all programs are listed in parentheses and organized by domains of SDT: 1)Relatedness goals (engage in mentorship, select a career) cultivate resident's professional identity based on their desired future career path; 2)autonomy goals (create a learning plan, practice accountability) help residents plan their path; and fulfillment of their plans lead to 3)competence goals (develop targeted clinical skills and knowledge, ensure comprehensive exposure, address learning gaps), ensuring they have a comprehensive skill set for their chosen identity. Insights: This study provides a framework to describe the phenomenon of individualized education through the lens of IC curricular goals in pediatric residency. The goals for IC that emerged from this study serve as a pragmatic framework for implementation of individualized education. They provide a common language and structure to promote more rigorous and collaborative study of individualized education across programs, disciplines, and settings in medicine. They may function as a roadmap for learners to navigate educational activities and for programs to help shape the experiences of their learners and examine outcomes of individualized education in their programs. The framework can also help individual pediatric residency programs structure improvements to their IC. Disciplines beyond pediatrics may also use this framework to better structure elective experiences to capitalize on the benefits of individual education.

"When in Doubt, Change It out": A Case-Based Simulation for Pediatric Residents Caring for Hospitalized Tracheostomy-Dependent Children.

Introduction: Caring for technology-dependent children, such as those with tracheostomy and ventilator dependence, can be new and frightening for pediatric residents. Education about emergencies in this patient population is important because these children are at risk for in-hospital complications. Safe care of the tracheostomy-dependent child requires the ability to recognize common complications, such as tracheostomy tube obstruction or decannulation, and intervene appropriately by suctioning and/or replacing the tracheostomy tube. This simulation-based curriculum teaches learners to identify and practice the management of these tracheostomy tube complications through low-fidelity simulation exercises. Methods: We created a simulation session with three cases reflecting in-hospital scenarios encountered by resident physicians caring for tracheostomy-dependent children in the inpatient setting. The simulation scenario, simulation environment preparation, materials list, and debriefing outline are provided for the instructor for each simulation case. Validity evidence for the assessment tool was obtained by calculating the interrater reliability of two different raters. Resident feedback was obtained through anonymous surveys. Results: Twelve pediatric senior residents completed the experience. It received overwhelmingly positive feedback on learner evaluation forms, with 90% finding the experience very or extremely helpful. The intraclass correlation coefficient of interrater reliability for our assessment tool was 0.93. Discussion: The simulation was well received by residents. The interrater reliability was acceptable. This low-fidelity simulation exercise can easily be executed with minimal materials or instructor training. High-yield, just-in-time training with postcase debriefing is key to the simulation's success.

They Don't See a Lot of People My Color: A Mixed Methods Study of Racial/Ethnic Stereotype Threat Among Medical Students on Core Clerkships.

PURPOSE: Stereotype threat is an important psychological phenomenon in which fear of fulfilling negative stereotypes about one's group impairs performance. The effects of stereotype threat in medical education are poorly characterized. This study examined the prevalence of racial/ethnic stereotype threat amongst fourth-year medical students and explored its impact on students' clinical experience. METHOD: This was an explanatory sequential mixed methods study at 2 institutions in 2019. First, the authors administered the quantitative Stereotype Vulnerability Scale (SVS) to fourth-year medical students. The authors then conducted semistructured interviews among a purposive sample of students with high SVS scores, using a qualitative phenomenographic approach to analyze experiences of stereotype threat. The research team considered reflexivity through group discussion and journaling. RESULTS: Overall, 52% (184/353) of students responded to the survey. Collectively, 28% of students had high vulnerability to stereotype threat: 82% of Black, 45% of Asian, 43% of Latinx, and 4% of White students. Eighteen students participated in interviews. Stereotype threat was a dynamic, 3-stage process triggered when students experienced the workplace through the colored lens of race/ethnicity by standing out, reliving past experiences, and witnessing microaggressions. Next, students engaged in internal dialogue to navigate racially charged events and workplace power dynamics. These efforts depleted cognitive resources and interfered with learning. Finally, students responded and coped to withstand threats. Immediate and deferred interventions from allies reduced stereotype threat. CONCLUSIONS: Stereotype threat is common, particularly among non-White students, and interferes with learning. Increased minority representation and developing evidence-based strategies for allyship around microaggressions could mitigate effects of stereotype threat.

Use of Individualized Learning Plans to Facilitate Feedback Among Medical Students.

THEORY: Self-regulated learning theory suggests that individualized learning plans can benefit medical trainees by providing a structured means of goal setting, self-monitoring, and self-evaluation. External feedback also plays an important role in affecting learner motivations, perceptions, and self-evaluations. Accordingly, having learners share individualized learning plans with preceptors might promote self-regulated learning by helping align the feedback they receive with their learning goals. Hypothesis: We hypothesized having medical students share individualized learning plans with attendings and residents would improve the quality of the feedback they received, increase the likelihood that feedback correlated to their learning goals, and improve their perceptions of feedback received. Method: In this multisite study, third-year medical students on their pediatric clerkship created individualized learning plans and shared them with residents and attendings by writing a learning goal on at least one of their required faculty feedback forms. The quality of feedback on forms with versus without a learning goal written on top was scored using a validated scoring tool and compared using a Wilcoxon signed-ranks test, and the frequency with which feedback directly correlated to a student learning goal on forms with versus without a learning goal written on top was compared using a chi-square test. Students completed a post-clerkship survey rating the quality of feedback and teaching they received, perceptions of the individualized learning plans, progress toward achieving learning goals, and whether or not they received teaching and/or feedback related to learning goals. Results: Thirty-six students completed a total of 108 learning goals and 181 feedback forms, of which 42 forms (23.2%) had a learning goal written on top. The mean (SD) feedback score between forms with [3.9 (0.9)] versus without [3.6 (0.6)] a learning goal written on top was not different (p = .113). Feedback on forms with a learning goal written on top was more likely to correlate to a student learning goal than feedback on forms without a learning goal (92.9% vs 23.0% respectively, p < .001). Student perceptions of the usefulness of learning goals did not differ between students who reported receiving teaching or feedback related to a learning goal and those who did not. Conclusions: Sharing individualized learning plans with preceptors helped align feedback with learning goals but did not affect the quality of feedback. Further research should examine the bidirectional relationship between individualized learning plans and feedback in light of other contextual and interpersonal factors.

In Pursuit of Honors: A Multi-Institutional Study of Students' Perceptions of Clerkship Evaluation and Grading.

PURPOSE: To examine medical students' perceptions of the fairness and accuracy of core clerkship assessment, the clerkship learning environment, and contributors to students' achievement. METHOD: Fourth-year medical students at 6 institutions completed a survey in 2018 assessing perceptions of the fairness and accuracy of clerkship evaluation and grading, the learning environment including clerkship goal structures (mastery- or performance-oriented), racial/ethnic stereotype threat, and student performance (honors earned). Factor analysis of 5-point Likert items (1 = strongly disagree, 5 = strongly agree) provided scale scores of perceptions. Using multivariable regression, investigators examined predictors of honors earned. Qualitative content analysis of responses to an open-ended question yielded students' recommendations to improve clerkship grading. RESULTS: Overall response rate was 71.1% (666/937). Students believed that being liked and particular supervisors most influenced final grades. Only 44.4% agreed that grading was fair. Students felt the clerkship learning environment promoted both mastery and performance avoidance behaviors (88.0% and 85.6%, respectively). Students from backgrounds underrepresented in medicine were more likely to experience stereotype threat vulnerability (55.7% vs 10.9%, P < .0005). Honors earned was positively associated with perceived accuracy of grading and interest in competitive specialties while negatively associated with stereotype threat. Students recommended strategies to improve clerkship grading: eliminating honors, training evaluators, and rewarding improvement on clerkships. CONCLUSIONS: Participants had concerns around the fairness and accuracy of clerkship evaluation and grading and potential bias. Students expressed a need to redefine the culture of assessment on core clerkships to create more favorable learning environments for all students.

Leadership Observation and Feedback Tool: A Novel Instrument for Assessment of Clinical Leadership Skills.

BACKGROUND: While leadership training is increasingly incorporated into residency education, existing assessment tools to provide feedback on leadership skills are only applicable in limited contexts. OBJECTIVE: We developed an instrument, the Leadership Observation and Feedback Tool (LOFT), for assessing clinical leadership. METHODS: We used an iterative process to develop the tool, beginning with adapting the Leadership Practices Inventory to create an open-ended survey for identification of clinical leadership behaviors. We presented these to leadership experts who defined essential behaviors through a modified Delphi approach. In May 2014 we tested the resulting 29-item tool among residents in the internal medicine and pediatrics departments at 2 academic medical centers. We analyzed instrument performance using Cronbach's alpha, interrater reliability using intraclass correlation coefficients (ICCs), and item performance using linear-by-linear test comparisons of responses by postgraduate year, site, and specialty. RESULTS: A total of 377 (of 526, 72%) team members completed the LOFT for 95 (of 519, 18%) residents. Overall ratings were high-only 14% scored at the novice level. Cronbach's alpha was 0.79, and the ICC ranged from 0.20 to 0.79. Linear-by-linear test comparisons revealed significant differences between postgraduate year groups for some items, but no significant differences by site or specialty. Acceptability and usefulness ratings by respondents were high. CONCLUSIONS: Despite a rigorous approach to instrument design, we were unable to collect convincing validity evidence for our instrument. The tool may still have some usefulness for providing formative feedback to residents on their clinical leadership skills.

Identification of foundational non-clinical attributes necessary for successful transition to residency: a modified Delphi study with experienced medical educators.

BACKGROUND: We aimed to identify foundational non-clinical attributes expected of medical school graduates to be successful in residency. METHODS: We conducted a three-round modified Delphi study with snowball sampling of experienced medical educators. In Round 1, respondents rated 28 attributes identified from a literature search. Additional attributes were proposed through invited comments. In Round 2, respondents expressed their agreement with advanced attribute definitions and examples. Consensus on final definitions and examples was obtained in Round 3. RESULTS: Sixty-four percent (105/163) of invited educators participated in Round 1. There was broad representation of educational focus (undergraduate, graduate, and continuing medical education) and field of practice (primary care, sub-specialty, medical, and surgical). Thirteen attributes were advanced to Round 2. Ninety-seven of 105 (92%) respondents participated in Round 2, with greater than 92% agreement for all attributes. Three pairs were consolidated. In Round 3, 88% (85/97) of educators expressed greater than 92% agreement about definitions and representative examples. The final 10 foundational attributes are: communication skills, critical thinking, emotional intelligence, ethical behavior, intellectual curiosity, organizational skills, resilience, self-improvement, teamwork, and vocational commitment. CONCLUSION: Through a consensus-building process of medical educators, we identified and defined 10 foundational non-clinical attributes for a medical student's successful transition to residency.