Impact of a Regional Grant Program Through the Lens of Social Cognitive Career Theory: A Mixed-Method Evaluation.

PURPOSE: Evaluations of educational grant programs have focused on research productivity, with few examining impacts on grantees or effective program characteristics. This evaluation examined the regional grant program sponsored by Group on Educational Affairs to examine if and how grantees' careers were affected by funding, and if these experiences aligned with program goals. METHOD: In this concurrent, mixed-methods theory-driven evaluation, quantitative and qualitative data were analyzed independently and then integrated to examine complementarity. Quantitative data examined differences among 4 geographic regions and included proposal and grantee characteristics abstracted from administrative records of 52 funded proposals from 2010-2015 grant cycles. Qualitative data from 23 interviews conducted from 2018 to 2019 explored the impact on grantees, with Social Cognitive Career Theory (SCCT) serving as a framework for deductive thematic analysis. To facilitate integration of findings, quantitative data were layered onto each interview to permit exploration of associations between the 2 data types. RESULTS: Although significant regional differences existed in project length and amount of funding, there were few regional differences in grantee experiences. Despite small funding amounts, grants were perceived as career launching pads. The SCCT framework accounted for grantee experiences, including researcher identity formation and subsequent research, but did not capture collaboration phenomena. Integration of the 2 data types identified experience patterns unique to different groups of grantees (e.g., more or less research experience). The diversity among grantees suggests that clarification of program goals and stronger alignment with criteria for funding may be warranted. CONCLUSIONS: This evaluation illuminates why small educational grant programs may or may not impact interest and productivity in research. Implications exist for funders, including clarifying program goals and providing support for less experienced grantees. Future research should explore grantee subsets (e.g., underrepresented in medicine) to further identify what fosters or inhibits careers of medical education scholars.

Innovation and Missed Opportunities in Internal Medicine Undergraduate Education During COVID-19: Results from a National Survey.

BACKGROUND: COVID-19 disrupted undergraduate clinical education when medical schools removed students from clinical rotations following AAMC recommendations. Clerkship directors (CDs) had to adapt rapidly and modify clerkship curricula. However, the scope and effects of these modifications are unknown. OBJECTIVE: To examine the effects of the initial phase of COVID-19 on the internal medicine (IM) undergraduate clinical education. DESIGN: A nationally representative web survey. PARTICIPANTS: IM CDs from 137 LCME-accredited US medical schools in 2020. MAIN MEASURES: Items (80) assessed clerkship structure and curriculum, assessment in clerkships, post-clerkship IM clinical experiences, and CD roles and support. The framework of Understanding Crisis Response (Royal Society for Encouragement of Arts, Manufactures, and Commerce) was used to determine whether curricular modifications were "amplified," "restarted," "let go," or "ended." KEY RESULTS: Response rate was 74%. In response to COVID-19, 32% (32/101) of clerkships suspended all clinical activities and 66% (67/101) only in-person. Prior to clinical disruption, students spent a median of 8.0 weeks (IQR: 2) on inpatient and 2.0 weeks (IQR: 4) on ambulatory rotations; during clinical re-entry, students were spending 5.0 (IQR: 3) and 1.0 (IQR: 2) weeks, respectively. Bedside teaching and physical exam instruction were "let go" during the early phase. Students were removed from direct patient care for a median of 85.5 days. The sub-internship curriculum remained largely unaffected. Before the pandemic, 11% of schools were using a pass/fail grading system; at clinical re-entry 47% and during the survey period 23% were using it. Due to the pandemic, 78.2% of CDs assumed new roles or had expanded responsibilities; 51% reported decreased scholarly productivity. CONCLUSIONS: Curricular adaptations occurred in IM clerkships across US medical schools as a result of COVID-19. More research is needed to explore the long-term implications of these changes on medical student education and clinical learning environments.

Roles and Responsibilities of Medicine Subinternship Directors : Medicine Subinternship Director Roles.

BACKGROUND: The internal medicine (IM) subinternship (also referred to as acting internship) plays a crucial part in preparing medical students for residency. The roles, responsibilities, and support provided to subinternship directors have not been described. OBJECTIVE: We sought to describe the current role of IM subinternship directors with respect to their responsibilities, salary support, and reporting structure. DESIGN: Nationally representative, annually recurring thematic survey of IM core clerkship directors with membership in an academic professional association as of September 2017. PARTICIPANTS: A total of 129 core clinical medicine clerkship directors at Liaison Committee on Medical Education fully accredited U.S./U.S.-territory-based medical schools. MAIN MEASURES: Responsibilities, salary support, and reporting structure of subinternship directors. KEY RESULTS: The survey response rate was 83.0% (107/129 medical schools). Fifty-one percent (54/107) of respondents reported overseeing both core clerkship inpatient experiences and/or one or more subinternships. For oversight, 49.1% (28/53) of subinternship directors also reported that they were the clerkship director, 26.4% (14/53) that another faculty member directed all medicine subinternships, and 18.9% (10/53) that each subinternship had its own director. The most frequently reported responsibilities for the subinternship directors were administration, including scheduling, and logistics of student schedules (83.0%, 44/53), course evaluation (81.1%, 43/53), and setting grades 79.2% (42/53). The modal response for estimated FTE per course was 10-20% FTE, with 33.3% (16/48) reporting this level of support and 29.2% (14/54) reporting no FTE support. CONCLUSIONS: The role of the IM subinternship director has become increasingly complex. Since the IM subinternship is critical to preparing students for residency, IM subinternship directors require standard expectations and adequate support. Future studies are needed to determine the appropriate level of support for subinternship directors and to define essential roles and responsibilities.

What Is an Innovation Article? A Systematic Overview of Innovation in Health Professions Education Journals.

PURPOSE: Innovation articles have their own submission category and guidelines in health professions education (HPE) journals, which suggests innovation might be a unique genre of scholarship. Yet, the requirements for innovation submissions vary among journals, suggesting ambiguity about the core content of this type of scholarship. To reduce this ambiguity, the researchers conducted a systematic overview to identify key features of innovation articles and evaluate their consistency in use across journals. Findings from this review may have implications for further development of innovation scholarship within HPE. METHOD: In this systematic overview, conducted in 2020, the researchers identified 13 HPE journals with innovation-type articles and used content analysis to identify key features from author guidelines and publications describing what editors look for in innovation articles. The researchers then audited a sample of 39 innovation articles (3/journal) published in 2019 to determine presence and consistency of 12 innovation features within and across HPE journals. Audit findings informed the researchers' evaluation of innovation as a genre in HPE. RESULTS: Findings show variability of innovation feature presence within and across journals. On average, articles included 7.8 of the 12 innovation features (SD 2.1, range 3-11). The most common features were description of: how the innovation was implemented (92%), a problem (90%), what was new or novel (79%), and data or outcomes (77%). On average, 5.5 (SD 1.5) out of 12 innovation features were consistently used in articles within each journal. CONCLUSIONS: The authors identified common features of innovation article types based on journal guidelines, but there was variability in presence and consistency of these features, suggesting HPE innovations are in an emerging state of genre development. The authors discuss potential reasons for variability within this article type and highlight the need for further discussion among authors, editors, and reviewers to improve clarity.

Farewell to the Step 2 Clinical Skills Exam: New Opportunities, Obligations, and Next Steps.

The unexpected discontinuation of the United States Medical Licensing Examination Step 2 Clinical Skills (CS) exam in January 2021 carries both risks and opportunities for medical education in the United States. Step 2 CS had far-reaching effects on medical school curricula and school-based clinical skills assessments. Absent the need to prepare students for this high-stakes exam, will the rigor of foundational clinical skills instruction and assessment remain a priority at medical schools? In this article, the authors consider the potential losses and gains from the elimination of Step 2 CS and explore opportunities to expand local summative assessments beyond the narrow bounds of Step 2 CS. The responsibility for implementing a rigorous and credible summative assessment of clinical skills that are critical for patient safety as medical students transition to residency now lies squarely with medical schools. Robust human simulation (standardized patient) programs, including regional and virtual simulation consortia, can provide infrastructure and expertise for innovative and creative local assessments to meet this need. Novel applications of human simulation and traditional formative assessment methods, such as workplace-based assessments and virtual patients, can contribute to defensible summative decisions about medical students' clinical skills. The need to establish validity evidence for decisions based on these novel assessment methods comprises a timely and relevant focus for medical education research.

Introducing Telepsychiatry to Medical Students with Simulated Patients: An Innovation by Necessity.

This article was migrated. The article was marked as recommended. Introduction: The abrupt discontinuation of medical student-patient contact due to the covid-19 pandemic resulted in a rapid change to virtual teaching. Student education was restructured to include online cases, small group discussions, synchronous and asynchronous lectures, and modified problem-based learning and team-based learning sessions. However, the key focus of the clerkship experience, contact with patients, was missing. Process: The Psychiatry Clerkship directors have previously provided complex simulated encounters to students using video-taped encounters of physician-simulated patient interactions to teach and assess student note writing skills. This concept was adapted to a live encounter for individual students on the psychiatry clerkship. Students reviewed the patient chart, performed the encounter, provided an oral patient presentation to faculty, and wrote a patient note. Individualized feedback was provided for each step of the process. Outcomes: The process was well received by students and faculty and provided an opportunity to directly observe student skills despite distancing from direct patient care. The simulated patients had a very positive experience and appreciated the opportunity to advance their own skills while contributing to student's education. Discussion: Removing students from clinical sites stimulated the rapid development of a process to observe learners involved in patient encounters. These educational sessions allowed direct observation of skills required in the initial evaluation of a patient presenting to psychiatry for care.

Teaching Safe Opioid Prescribing During the Opioid Epidemic: Results of the 2018 Clerkship Directors in Internal Medicine Survey.

BACKGROUND: Educating medical trainees across the continuum is essential to a multifaceted strategy for addressing the opioid epidemic. OBJECTIVE: To assess the current state of internal medicine clerkship content on safe opioid prescribing and opioid use disorder, and barriers to curriculum implementation. DESIGN: National Annual (2018) Clerkship Directors in Internal Medicine (CDIM) cross-sectional survey. PARTICIPANTS: One hundred thirty-four clerkship directors at all Liaison Committee of Medical Education accredited US medical schools with CDIM membership as of October 1, 2018. MAIN MEASURES: The survey section on safe opioid prescribing and opioid use disorder education in the internal medicine clerkship addressed assessment of current curricula, perceived importance of curricula, barriers to implementation, and plans to start or expand curricula. Descriptive statistics were used to summarize responses, and Pearson's chi-square and Fisher's exact tests for statistical comparisons. KEY RESULTS: The survey response rate was 82% (110/134). Overall 54.1% of responding institutions reported covering one or more topics related to safe opioid prescribing or opioid use disorder in the internal medicine clerkship. A preponderance of clerkship directors (range 51-86%) reported that various opioid-related topics were important to cover in the internal medicine clerkship. Safe opioid prescribing topics were covered more frequently than topics related specifically to opioid use disorder. The main barriers identified included time (80.9%) and lack of faculty expertise (65.5%). CONCLUSIONS: Clerkship directors agreed that incorporating safe opioid prescribing and opioid use disorder topics in the internal medicine clerkship is important, despite wide variation in current curricula. Addressing curricular time constraints and lack of faculty expertise in internal medicine clerkships will be key to successfully integrating content to address the opioid epidemic.

A National Survey of Undergraduate Clinical Education in Internal Medicine.

BACKGROUND: In the present milieu of rapid innovation in undergraduate medical education at US medical schools, the current structure and composition of clinical education in Internal Medicine (IM) is not clear. OBJECTIVE: To describe the current composition of undergraduate clinical education structure in IM. DESIGN: National annual Clerkship Directors in Internal Medicine (CDIM) cross-sectional survey. PARTICIPANTS: One hundred twenty-nine clerkship directors at all Liaison Committee on Medical Education accredited US medical schools with CDIM membership as of September 1, 2017. MAIN MEASURES: IM core clerkship and post-core clerkship structure descriptions, including duration, educational models, inpatient experiences, ambulatory experiences, and requirements. KEY RESULTS: The survey response rate was 83% (107/129). The majority of schools utilized one core IM clerkship model (67%) and continued to use a traditional block model for a majority of their students (84%). Overall 26% employed a Longitudinal Integrated Clerkship model and 14% employed a shared block model for some students. The mean inpatient duration was 7.0 ± 1.7 weeks (range 3-11 weeks) and 94% of clerkships stipulated that students spend some inpatient time on general medicine. IM-specific ambulatory experiences were not required for students in 65% of IM core clerkship models. Overall 75% of schools did not require an advanced IM clinical experience after the core clerkship; however, 66% of schools reported a high percentage of students (> 40%) electing to take an IM sub-internship. About half of schools (48%) did not require overnight call or night float during the clinical IM sub-internship. CONCLUSIONS: Although there are diverse core IM clerkship models, the majority of IM core clerkships are still traditional block models. The mean inpatient duration is 7 weeks and 65% of IM core clerkship models did not require IM-specific ambulatory education.

Student response to reports of unprofessional behavior: assessing risk of subsequent professional problems in medical school.

BACKGROUND: An early concern note (ECN) program is used by some medical schools to identify, counsel, and intervene when students exhibit unprofessional behavior. Student maturity, insight, propensity for reflection, and receptiveness to feedback have been suggested as predictors of future behavior. OBJECTIVE: We hypothesized that (a) classifying students with a first ECN based on their response to the report would identify students at risk of repeat ECNs better than the action that prompted it and (b) receipt of multiple ECNs would identify students at risk of adverse academic events. DESIGN: For this study, 459 ECNs were classified based on students' (1) recognition that their behavior was inappropriate and (2) acceptance of responsibility for the behavior. Student academic progress and receipt of subsequent ECNs were tracked. RESULTS: Students who recognized their behavior was inappropriate and accepted responsibility after an initial ECN received subsequent ECNs at lower rates (14-19%) than students who disagreed with the significance of their behavior or were resistant to accepting responsibility (36-59%). Students with limited insight and adaptability appeared to be at highest risk. Seventy-one percent of students with three or more ECNs encountered adverse academic events during enrollment. CONCLUSION: Student reactions to reports of unprofessional behavior may be useful as a tool to help assess risk of recurrent lapses. Students with diminished capacity to recognize behaviors as unprofessional or accept responsibility for them appear to be at highest risk for additional adverse academic and professionalism events while in medical school.

Clinical Reasoning Education at US Medical Schools: Results from a National Survey of Internal Medicine Clerkship Directors.

BACKGROUND: Recent reports, including the Institute of Medicine's Improving Diagnosis in Health Care, highlight the pervasiveness and underappreciated harm of diagnostic error, and recommend enhancing health care professional education in diagnostic reasoning. However, little is known about clinical reasoning curricula at US medical schools. OBJECTIVE: To describe clinical reasoning curricula at US medical schools and to determine the attitudes of internal medicine clerkship directors toward teaching of clinical reasoning. DESIGN: Cross-sectional multicenter study. PARTICIPANTS: US institutional members of the Clerkship Directors in Internal Medicine (CDIM). MAIN MEASURES: Examined responses to a survey that was emailed in May 2015 to CDIM institutional representatives, who reported on their medical school's clinical reasoning curriculum. KEY RESULTS: The response rate was 74% (91/123). Most respondents reported that a structured curriculum in clinical reasoning should be taught in all phases of medical education, including the preclinical years (64/85; 75%), clinical clerkships (76/87; 87%), and the fourth year (75/88; 85%), and that more curricular time should be devoted to the topic. Respondents indicated that most students enter the clerkship with only poor (25/85; 29%) to fair (47/85; 55%) knowledge of key clinical reasoning concepts. Most institutions (52/91; 57%) surveyed lacked sessions dedicated to these topics. Lack of curricular time (59/67, 88%) and faculty expertise in teaching these concepts (53/76, 69%) were identified as barriers. CONCLUSIONS: Internal medicine clerkship directors believe that clinical reasoning should be taught throughout the 4 years of medical school, with the greatest emphasis in the clinical years. However, only a minority reported having teaching sessions devoted to clinical reasoning, citing a lack of curricular time and faculty expertise as the largest barriers. Our findings suggest that additional institutional and national resources should be dedicated to developing clinical reasoning curricula to improve diagnostic accuracy and reduce diagnostic error.

How to write an educational research grant: AMEE Guide No. 101.

Writing an educational research grant in health profession education is challenging, not only for those doing it for the first time but also for more experienced scholars. The intensity of the competition, the peculiarities of the grant format, the risk of rejection, and the time required are among the many obstacles that can prevent educational researchers with interesting and important ideas from writing a grant, that could provide the funding needed to turn their scholarly ideas into reality. The aim of this AMEE Guide is to clarify the grant-writing process by (a) explaining the mechanics and structure of a typical educational research grant proposal, and (b) sharing tips and strategies for making the process more manageable.

A Methodological Review of the Assessment of Humanism in Medical Students.

BACKGROUND: Humanism is a complex construct that defies simplistic measurement. How educators measure humanism shapes understanding and implications for learners. This systematic review sought to address the following questions: How do medical educators assess humanism in medical students, and how does the measurement impact the understanding of humanism in undergraduate medical education (UME)? METHOD: Using the IECARES (integrity, excellence, compassion, altruism, respect, empathy, and service) Gold Foundation framework, a search of English literature databases from 2000 to 2013 on assessment of humanism in medical students revealed more than 900 articles, of which 155 met criteria for analysis. Using descriptive statistics, articles and assessments were analyzed for construct measured, study design, assessment method, instrument type, perspective/source of assessment, student level, validity evidence, and national context. RESULTS: Of 202 assessments reported in 155 articles, 162 (80%) used surveys; 164 (81%) used student self-reports. One hundred nine articles (70%) included only one humanism construct. Empathy was the most prevalent construct present in 96 (62%); 49 (51%) of those used a single instrument. One hundred fifteen (74%) used exclusively quantitative data; only 48 (31%) used a longitudinal design. Construct underrepresentation was identified as a threat to validity in half of the assessments. Articles included 34 countries; 87 (56%) were from North America. CONCLUSIONS: Assessment of humanism in UME incorporates a limited scope of a complex construct, often relying on single quantitative measures from self-reported survey instruments. This highlights the need for multiple methods, perspectives, and longitudinal designs to strengthen the validity of humanism assessments.

Professional identity formation in medical education: the convergence of multiple domains.

There has been increasing emphasis on professionalism in medical education over the past several decades, initially focusing on bioethical principles, communication skills, and behaviors of medical students and practitioners. Authors have begun to discuss professional identity formation (PIF), distinguishing it as the foundational process one experiences during the transformation from lay person to physician. This integrative developmental process involves the establishment of core values, moral principles, and self-awareness. The literature has approached PIF from various paradigms-professionalism, psychological ego development, social interactions, and various learning theories. Similarities have been identified between the formation process of clergy and that of physicians. PIF reflects a very complex process, or series of processes, best understood by applying aspects of overlapping domains: professionalism, psychosocial identity development, and formation. In this study, the authors review essential elements of these three domains, identify features relevant to medical PIF, and describe strategies reported in the medical education literature that may influence PIF.

Quality of standardised patient research reports in the medical education literature: review and recommendations.

CONTEXT: In order to assess or replicate the research findings of published reports, authors must provide adequate and transparent descriptions of their methods. We conducted 2 consecutive studies, the first to define reporting standards relating to the use of standardised patients (SPs) in research, and the second to evaluate the current literature according to these standards. METHODS: Standards for reporting SPs in research were established by representatives of the Grants and Research Committee of the Association of Standardized Patient Educators (ASPE). An extensive literature search yielded 177 relevant English-language articles published between 1993 and 2005. Search terms included: 'standardised patient(s)'; 'simulated patient(s)'; 'objective structured clinical examination (OSCE)', and 'clinical skills assessment'. Articles were limited to those reporting the use of SPs as an outcome measure and published in 1 of 5 prominent health sciences education journals. Data regarding the SP encounter, SP characteristics, training and behavioural measure(s) were gathered. RESULTS: A random selection of 121 articles was evaluated according to 29 standards. Reviewers judged that few authors provided sufficient details regarding the encounter (21%, n = 25), SPs (16%, n = 19), training (15%, n = 15), and behavioural measures (38%, n = 44). Authors rarely reported SP gender (27%, n = 33) and age range (22%, n = 26), whether training was provided for the SPs (39%, n = 47) or other raters (24%, n = 29), and psychometric evidence to support the behavioural measure (23%, n = 25). CONCLUSIONS: The findings suggest that there is a need for increased rigor in reporting research involving SPs. In order to support the validity of research findings, journal editors, reviewers and authors are encouraged to provide adequate detail when describing SP methodology.