Comparing Perceptions of Virtual and In-Person Interviews: Results From a National Survey of Internal Medicine Residents.

Background Since 2020, virtual interviews have become the typical way in which applicants assess residency programs. It is unknown whether the change from in-person to virtual interviews has been associated with changes in perceptions of the quality of information gathered by prospective applicants. Objective To ascertain perspectives on the satisfaction with, quality of, and accuracy of information gathered by internal medicine (IM) residency applicants from virtual and in-person interviews. Methods Twenty-nine thousand, seven hundred and seventy-six residents from US and Puerto Rico residency programs sitting for the 2022 American College of Physicians Internal Medicine In-Training Examination (IM-ITE) were surveyed. An optional, 5-question survey was administered at the end of the examination. Responses were analyzed based on interview format-virtual (postgraduate year [PGY]-1-2) or in-person (PGY-3)-and PGY. Results Of 29 776, 23 161 residents responded to the survey (77.8% response rate). Regardless of PGY, respondents reported a high degree of satisfaction with the quality of information gathered from their interview day, though there was a statistically significant difference between virtual and in-person [somewhat/very satisfied: In-person 5938 of 7410 (80.1%); 95% CI [79.2, 81.0] vs virtual 12 070 of 15 751 (76.6%); 95% CI [76.0, 77.3]:P<.001]. Residents in all PGYs reported sessions with residents and one-on-one interviews as the most important factors when creating their rank lists. Conclusions We found differences in satisfaction and perceptions of the quality of information gathered between IM residents who participated in virtual and in-person interviews. However, regardless of format, most respondents reported satisfaction with their interview experience.

Programmatic Assessment of Clinical Reasoning: New Opportunities to Meet an Ongoing Challenge.

Issue: Clinical reasoning is essential to physicians' competence, yet assessment of clinical reasoning remains a significant challenge. Clinical reasoning is a complex, evolving, non-linear, context-driven, and content-specific construct which arguably cannot be assessed at one point in time or with a single method. This has posed challenges for educators for many decades, despite significant development of individual assessment methods. Evidence: Programmatic assessment is a systematic assessment approach that is gaining momentum across health professions education. Programmatic assessment, and in particular assessment for learning, is well-suited to address the challenges with clinical reasoning assessment. Several key principles of programmatic assessment are particularly well-aligned with developing a system to assess clinical reasoning: longitudinality, triangulation, use of a mix of assessment methods, proportionality, implementation of intermediate evaluations/reviews with faculty coaches, use of assessment for feedback, and increase in learners' agency. Repeated exposure and measurement are critical to develop a clinical reasoning assessment narrative, thus the assessment approach should optimally be longitudinal, providing multiple opportunities for growth and development. Triangulation provides a lens to assess the multidimensionality and contextuality of clinical reasoning and that of its different, yet related components, using a mix of different assessment methods. Proportionality ensures the richness of information on which to draw conclusions is commensurate with the stakes of the decision. Coaching facilitates the development of a feedback culture and allows to assess growth over time, while enhancing learners' agency. Implications: A programmatic assessment model of clinical reasoning that is developmentally oriented, optimizes learning though feedback and coaching, uses multiple assessment methods, and provides opportunity for meaningful triangulation of data can help address some of the challenges of clinical reasoning assessment.

A university-wide seed grant program accelerates interprofessional education through faculty and staff engagement.

The University of Texas Health Science Center at San Antonio launched an annual university-wide seed grant program in 2019 to foster innovation in interprofessional education (IPE) and increase IPE opportunities for learners. Program objectives included leveraging hypothesis-driven research to identify sustainable IPE activities for integration into educational programs (i.e. mandated for at least one cohort of learners), increasing scholarly dissemination of IPE efforts, and using pilot data to secure extramural funding. Over the first four funding cycles (2019-2022), US$100,509.00 was awarded to support 22 IPE projects (10 curricular, 12 co-curricular) involving 80 faculty and staff collaborators and over 2,100 student participants. To date, funded projects have yielded nine sustained IPE activities (four of which have been integrated), produced 24 scholarly presentations and three peer-reviewed publications, and contributed to the success of one extramural grant. Barriers experienced are discussed in this report alongside lessons learned and unexpected positive outcomes, including identification of future IPE champions.

Clinical Interprofessional Education in Inpatient Pharmacy: Findings From a Secondary Analysis of a Scoping Review.

OBJECTIVES: Clinical interprofessional education (IPE) is defined as learning that occurs within clinical learning environments such as hospitals, primary care clinics, and long-term care facilities where learners collaborate to deliver care to real patients. The objective of this secondary analysis of a scoping review is to identify, characterize, and summarize evidence from the published literature regarding clinical IPE for pharmacy learners in the inpatient setting. FINDINGS: PubMed, CINAHL, and Scopus databases were searched for clinical IPE articles that met the following inclusion criteria: ≥ 2 health professions, ≥ 2 learner groups, and involvement of real patients/patient care. For this secondary analysis, 12 articles involving pharmacy learners in an inpatient setting were included. The most common interprofessional partner was medicine (66%), and the median number of student participants involved in the activity was 19 (range, 10-525). Five studies conducted clinical IPE in the context of advanced pharmacy practice experiences. Clinical IPE activities were described primarily as inpatient rounding with the medical team, but were often outside the normal clinical workflow (66%). Incorporation of Interprofessional Education Collaborative competencies was limited, as was the use of validated IPE assessment tools to measure outcomes. SUMMARY: Current literature is limited in reports of pharmacy learner involvement in inpatient clinical IPE. Expansion of pharmacy partnerships and alignment of team outcomes with the Interprofessional Education Collaborative competencies are needed to demonstrate the relationship between clinical IPE and patient care outcomes within established workflows.

Innovation in Collaborative Online Learning Yields Sustainable Model for University-wide Interprofessional Education.

BACKGROUND: Growing health professional accreditation mandates and expectations for interprofessional education (IPE) have led to heightened interest amongst health professions educators and administrators in the creation and development of effective and sustainable IPE programming. IPE ACTIVITY: At the University of Texas Health Science Center at San Antonio, an institution-wide initiative called Linking Interprofessional Networks for Collaboration (LINC) was initiated to strengthen IPE knowledge and skills, increase IPE offerings, and integrate IPE into curricula. In 2020, stakeholders developed, implemented, and evaluated a university-wide IPE activity called the LINC Common IPE Experience, which includes three collaborative online learning modules that students complete synchronously using a videoconference platform without direct faculty facilitation. Mini-lectures, interprofessional discussions, and authentic case studies using innovative media facilitated meaningful engagement of 977 students from 26 different educational programs. DISCUSSION: Quantitative and qualitative results from evaluations demonstrated significant student engagement, increased awareness and understanding of teamwork, progress towards interprofessional competency development, and benefits related to professional development. The LINC Common IPE Experience provides a valuable example of a robust, high-impact foundational IPE activity that can serve as a sustainable model for university-wide IPE.

Medical student advising during virtual residency recruitment: results of a national survey of internal medicine clerkship and sub-internship directors.

INTRODUCTION: The residency application process is a critical time for medical students. The COVID-19 pandemic prompted changes to the residency recruitment procedures with the conversion of interviews to a virtual format. For medical school advisors guiding students on an all-virtual residency application process brought uncertainty to their advising practices. Thus, this study aimed to identify advising practices during the 2021 virtual application cycle. METHODS: We administered an IRB-exempt national survey through the Clerkship Directors in Internal Medicine to 186 internal medicine core/co-/associate/assistant clerkship directors and sub-internship directors representing 140 Liaison Committee on Medical Education-accredited U.S./U.S.-territory-based medical schools in spring 2021. The 23-question survey was designed and pilot-tested by faculty-educators and leaders with expertise in undergraduate medical education. Data analysis included paired t- and z-tests and thematic analysis of open-ended questions. RESULTS: The institutional response rate was 67% (93/140) and individual rate 55% (103/186). Half of the respondents felt prepared/very prepared (40% and 13% respectively) for their advising roles. Compared to pre-pandemic cycles, respondents advised a typical student in the middle-third of their class at their institution to apply to more residency programs (mean 24 programs vs 20, p < 0.001) and accept more interviews (mean 14 interviews vs 12, p < 0.001). Sixty-three percent (64/101) of respondents spent more time on student advising; 51% (51/101) reported more students asked them for informal advice. Fifty-nine percent (60/101) of respondents reported their advisees were able to assess a residency program 'somewhat well;' 31% (31/101) expressed that residency recruitment should remain entirely virtual in the future. CONCLUSION: The transition to virtual residency recruitment due to COVID-19 prompted advising practices that may have contributed to application inflation and increased advising workload. Future studies should explore longitudinal outcomes of virtual interviews on student success to guide best practices in how to advise students during residency recruitment.

Innovation and Missed Opportunities in Internal Medicine Undergraduate Education During COVID-19: Results from a National Survey.

BACKGROUND: COVID-19 disrupted undergraduate clinical education when medical schools removed students from clinical rotations following AAMC recommendations. Clerkship directors (CDs) had to adapt rapidly and modify clerkship curricula. However, the scope and effects of these modifications are unknown. OBJECTIVE: To examine the effects of the initial phase of COVID-19 on the internal medicine (IM) undergraduate clinical education. DESIGN: A nationally representative web survey. PARTICIPANTS: IM CDs from 137 LCME-accredited US medical schools in 2020. MAIN MEASURES: Items (80) assessed clerkship structure and curriculum, assessment in clerkships, post-clerkship IM clinical experiences, and CD roles and support. The framework of Understanding Crisis Response (Royal Society for Encouragement of Arts, Manufactures, and Commerce) was used to determine whether curricular modifications were "amplified," "restarted," "let go," or "ended." KEY RESULTS: Response rate was 74%. In response to COVID-19, 32% (32/101) of clerkships suspended all clinical activities and 66% (67/101) only in-person. Prior to clinical disruption, students spent a median of 8.0 weeks (IQR: 2) on inpatient and 2.0 weeks (IQR: 4) on ambulatory rotations; during clinical re-entry, students were spending 5.0 (IQR: 3) and 1.0 (IQR: 2) weeks, respectively. Bedside teaching and physical exam instruction were "let go" during the early phase. Students were removed from direct patient care for a median of 85.5 days. The sub-internship curriculum remained largely unaffected. Before the pandemic, 11% of schools were using a pass/fail grading system; at clinical re-entry 47% and during the survey period 23% were using it. Due to the pandemic, 78.2% of CDs assumed new roles or had expanded responsibilities; 51% reported decreased scholarly productivity. CONCLUSIONS: Curricular adaptations occurred in IM clerkships across US medical schools as a result of COVID-19. More research is needed to explore the long-term implications of these changes on medical student education and clinical learning environments.

Clinical interprofessional education in the health professions: a scoping review protocol.

OBJECTIVE: The objective of this scoping review is to identify, characterize, and summarize evidence from the published literature on clinical interprofessional education. INTRODUCTION: Clinical interprofessional education refers to learning within clinical learning environments, such as hospitals, primary care clinics, and long-term care facilities. The learning involves direct interaction with real patients, where learners collaborate to deliver care and improve health outcomes. INCLUSION CRITERIA: This scoping review will consider clinical interprofessional education activities in the context of patient care. Criteria include two or more health professions, two or more learner groups, and involvement of real patients/patient care. METHODS: This review will be conducted in accordance with the JBI methodology for scoping reviews. Databases searched will include PubMed, CINAHL, and Scopus. Results will be limited to English language publications from 2015 to the present. Extracted data will include the different types of clinical learning environments, the professions involved, the targeted learning/competency outcomes, and the measurement tools used by the authors. Titles/abstracts and full texts of articles will be screened by two reviewers for potential inclusion, with discrepancies resolved by a third reviewer if necessary. Extracted data will be presented in diagrammatic or tabular format. A narrative summary will accompany the tabulated and/or charted results, describing how the results relate to the review objective and research questions, and how the results might inform future clinical interprofessional education in health professions education.

Roles and Responsibilities of Medicine Subinternship Directors : Medicine Subinternship Director Roles.

BACKGROUND: The internal medicine (IM) subinternship (also referred to as acting internship) plays a crucial part in preparing medical students for residency. The roles, responsibilities, and support provided to subinternship directors have not been described. OBJECTIVE: We sought to describe the current role of IM subinternship directors with respect to their responsibilities, salary support, and reporting structure. DESIGN: Nationally representative, annually recurring thematic survey of IM core clerkship directors with membership in an academic professional association as of September 2017. PARTICIPANTS: A total of 129 core clinical medicine clerkship directors at Liaison Committee on Medical Education fully accredited U.S./U.S.-territory-based medical schools. MAIN MEASURES: Responsibilities, salary support, and reporting structure of subinternship directors. KEY RESULTS: The survey response rate was 83.0% (107/129 medical schools). Fifty-one percent (54/107) of respondents reported overseeing both core clerkship inpatient experiences and/or one or more subinternships. For oversight, 49.1% (28/53) of subinternship directors also reported that they were the clerkship director, 26.4% (14/53) that another faculty member directed all medicine subinternships, and 18.9% (10/53) that each subinternship had its own director. The most frequently reported responsibilities for the subinternship directors were administration, including scheduling, and logistics of student schedules (83.0%, 44/53), course evaluation (81.1%, 43/53), and setting grades 79.2% (42/53). The modal response for estimated FTE per course was 10-20% FTE, with 33.3% (16/48) reporting this level of support and 29.2% (14/54) reporting no FTE support. CONCLUSIONS: The role of the IM subinternship director has become increasingly complex. Since the IM subinternship is critical to preparing students for residency, IM subinternship directors require standard expectations and adequate support. Future studies are needed to determine the appropriate level of support for subinternship directors and to define essential roles and responsibilities.

Examining the patterns of uncertainty across clinical reasoning tasks: effects of contextual factors on the clinical reasoning process.

Objectives Uncertainty is common in clinical reasoning given the dynamic processes required to come to a diagnosis. Though some uncertainty is expected during clinical encounters, it can have detrimental effects on clinical reasoning. Likewise, evidence has established the potentially detrimental effects of the presence of distracting contextual factors (i.e., factors other than case content needed to establish a diagnosis) in a clinical encounter on clinical reasoning. The purpose of this study was to examine how linguistic markers of uncertainty overlap with different clinical reasoning tasks and how distracting contextual factors might affect physicians' clinical reasoning process. Methods In this descriptive exploratory study, physicians participated in a live or video recorded simulated clinical encounter depicting a patient with unstable angina with and without contextual factors. Transcribed think-aloud reflections were coded using Goldszmidt's clinical reasoning task typology (26 tasks encompassing the domains of framing, diagnosis, management, and reflection) and then those coded categories were examined using linguistic markers of uncertainty (e.g., probably, possibly, etc.). Results Thirty physicians with varying levels of experience participated. Consistent with expectations, descriptive analysis revealed that physicians expressed more uncertainty in cases with distracting contextual factors compared to those without. Across the four domains of reasoning tasks, physicians expressed the most uncertainty in diagnosis and least in reflection. Conclusions These results highlight how linguistic markers of uncertainty can shed light on the role contextual factors might play in uncertainty which can lead to error and why it is essential to find ways of managing it.

Understanding context specificity: the effect of contextual factors on clinical reasoning.

Background Situated cognition theory argues that thinking is inextricably situated in a context. In clinical reasoning, this can lead to context specificity: a physician arriving at two different diagnoses for two patients with the same symptoms, findings, and diagnosis but different contextual factors (something beyond case content potentially influencing reasoning). This paper experimentally investigates the presence of and mechanisms behind context specificity by measuring differences in clinical reasoning performance in cases with and without contextual factors. Methods An experimental study was conducted in 2018-2019 with 39 resident and attending physicians in internal medicine. Participants viewed two outpatient clinic video cases (unstable angina and diabetes mellitus), one with distracting contextual factors and one without. After viewing each case, participants responded to six open-ended diagnostic items (e.g. problem list, leading diagnosis) and rated their cognitive load. Results Multivariate analysis of covariance (MANCOVA) results revealed significant differences in angina case performance with and without contextual factors [Pillai's trace = 0.72, F = 12.4, df =(6, 29), p < 0.001, η p 2 = 0.72 $\eta _{\rm p}^2 = 0.72$ ], with follow-up univariate analyses indicating that participants performed statistically significantly worse in cases with contextual factors on five of six items. There were no significant differences in diabetes cases between conditions. There was no statistically significant difference in cognitive load between conditions. Conclusions Using typical presentations of common diagnoses, and contextual factors typical for clinical practice, we provide ecologically valid evidence for the theoretically predicted negative effects of context specificity (i.e. for the angina case), with large effect sizes, offering insight into the persistence of diagnostic error.

Ready to collaborate?: medical learner experiences in interprofessional collaborative practice settings.

BACKGROUND: Interprofessional collaborative practice (IPCP) offers great potential to improve healthcare. Increases in IPCP will require educating learners in authentic IPCP settings and will generate opportunities and challenges. METHODS: In January 2015, we implemented an IPCP model called Collaborative Care (CC) for hospitalized adult medical patients. We explored learner perspectives regarding their educational experiences. We deductively coded transcripts from semi-structured interviews with medical learners. Data related to educational experiences were thematically analyzed. RESULTS: Twenty-four of 28 (85.7%) medical learners rotating on CC from January to May 2015 completed interviews. Subsequent inductive analysis of these interviews identified four themes: Loss of Educational Opportunities during Rounds, Feelings of Uncertainty during New Situations, Strategies for Adaptation, and Improved Communication with Patients and the Team. CONCLUSIONS: Increased implementation of IPCP will lead to a greater number of learners being exposed to authentic IPCP settings and will generate opportunities and challenges. Though learners perceived improved communication skills in an IPCP model, they also described loss of profession-specific learning opportunities and feelings of uncertainty. These findings corroborate the need for novel teaching methods aligned with IPCP clinical learning environments and educational assessment strategies that reflect attainment of both profession-specific and interprofessional competencies.

Mapping clinical reasoning literature across the health professions: a scoping review.

BACKGROUND: Clinical reasoning is at the core of health professionals' practice. A mapping of what constitutes clinical reasoning could support the teaching, development, and assessment of clinical reasoning across the health professions. METHODS: We conducted a scoping study to map the literature on clinical reasoning across health professions literature in the context of a larger Best Evidence Medical Education (BEME) review on clinical reasoning assessment. Seven databases were searched using subheadings and terms relating to clinical reasoning, assessment, and Health Professions. Data analysis focused on a comprehensive analysis of bibliometric characteristics and the use of varied terminology to refer to clinical reasoning. RESULTS: Literature identified: 625 papers spanning 47 years (1968-2014), in 155 journals, from 544 first authors, across eighteen Health Professions. Thirty-seven percent of papers used the term clinical reasoning; and 110 other terms referring to the concept of clinical reasoning were identified. Consensus on the categorization of terms was reached for 65 terms across six different categories: reasoning skills, reasoning performance, reasoning process, outcome of reasoning, context of reasoning, and purpose/goal of reasoning. Categories of terminology used differed across Health Professions and publication types. DISCUSSION: Many diverse terms were present and were used differently across literature contexts. These terms likely reflect different operationalisations, or conceptualizations, of clinical reasoning as well as the complex, multi-dimensional nature of this concept. We advise authors to make the intended meaning of 'clinical reasoning' and associated terms in their work explicit in order to facilitate teaching, assessment, and research communication.

Sequence matters: patterns in task-based clinical reasoning.

Background The cognitive pathways that lead to an accurate diagnosis and efficient management plan can touch on various clinical reasoning tasks (1). These tasks can be employed at any point during the clinical reasoning process and though the four distinct categories of framing, diagnosis, management, and reflection provide some insight into how these tasks map onto clinical reasoning, much is still unknown about the task-based clinical reasoning process. For example, when and how are these tasks typically used? And more importantly, do these clinical reasoning task processes evolve when patient encounters become complex and/or challenging (i.e. with contextual factors)? Methods We examine these questions through the lens of situated cognition, context specificity, and cognitive load theory. Sixty think-aloud transcripts from 30 physicians who participated in two separate cases - one with a contextual factor and one without - were coded for 26 clinical reasoning tasks (1). These tasks were organized temporally, i.e. when they emerged in their think-aloud process. Frequencies of each of the 26 tasks were aggregated, categorized, and visualized in order to analyze task category sequences. Results We found that (a) as expected, clinical tasks follow a general sequence, (b) contextual factors can distort this emerging sequence, and (c) the presence of contextual factors prompts more experienced physicians to clinically reason similar to that of less experienced physicians. Conclusions These findings add to the existing literature on context specificity in clinical reasoning and can be used to strengthen teaching and assessment of clinical reasoning.

It Totally Possibly Could Be: How a Group of Military Physicians Reflect on Their Clinical Reasoning in the Presence of Contextual Factors.

INTRODUCTION: Contextual factors (eg, diagnostic suggestion and burnout) can affect physician clinical reasoning performance, leading to diagnostic error. Yet, contextual factors have only recently been studied and none of that work focused on how physicians appraise (ie, evaluate) the clinical situation as they reason. The purpose of this qualitative study was to use appraisal to describe the effect of contextual factors on clinical reasoning. MATERIALS AND METHODS: Physicians (n = 25) either viewed two video cases or participated in two live scenarios, one with contextual factors and one without. Afterwards, they completed a "think-aloud" reflection while reviewing the cases. Transcribed think-alouds were coded for appraisal markers, comparing cases with and without contextual factors. RESULTS: When contextual factors were present, participants expressed more emotional evaluation and uncertainty about those emotions. Across all types of cases, participants expressed uncertainty about the case and assessed what "could" or "would" have gone differently. CONCLUSIONS: This study suggests that one major effect of contextual factors may be that they induce emotions, which may affect the process of clinical reasoning and diagnostic error. It also suggests that uncertainty may be common in clinical practice, and we should thus further explore its impact.

Clerkship Roles and Responsibilities in a Rapidly Changing Landscape: a National Survey of Internal Medicine Clerkship Directors.

BACKGROUND: In the rapidly changing landscape of undergraduate medical education (UME), the roles and responsibilities of clerkship directors (CDs) are not clear. OBJECTIVE: To describe the current roles and responsibilities of Internal Medicine CDs. DESIGN: National annual Clerkship Directors in Internal Medicine (CDIM) cross-sectional survey. PARTICIPANTS: One hundred twenty-nine clerkship directors at all Liaison Committee on Medical Education accredited US medical schools with CDIM membership as of September 1, 2017. MAIN MEASURES: Responsibilities of core CDs, including oversight of other faculty, and resources available to CDs including financial support and dedicated time. KEY RESULT: The survey response rate was 83% (107/129). Ninety-four percent of the respondents oversaw the core clerkship inpatient experience, while 47.7% (n = 51) and 5.6% (n = 6) oversaw the outpatient and longitudinal integrated clerkships respectively. In addition to oversight, CDs were responsible for curriculum development, evaluation and grades, remediation, scheduling, student mentoring, and faculty development. Less than one-third of CDs (n = 33) received the recommended 0.5 full-time equivalent (FTE) support for their roles, and 15% (n = 16) had less than 20% FTE support. An average 0.41 FTE (SD .2) was spent in clinical work and 0.20 FTE (SD .21) in administrative duties. Eighty-three percent worked with other faculty who assisted in the oversight of departmental UME experiences, with FTE support varying by role and institution. Thirty-five percent of CDs (n = 38) had a dedicated budget for managing their clerkship. CONCLUSIONS: The responsibilities of CDs have increased in both number and complexity since the dissemination of previous guidelines for expectations of and for CDs in 2003. However, resources available to them have not substantially changed.