Longitudinal Integrated Ambulatory, Didactic, and Evidenced-Based Medicine Curriculum in Internal Medicine.

INTRODUCTION: The Accreditation Council for Graduate Medical Education (ACGME) endorses evolving scholarly education regarding evidence-based medicine (EBM) and its clinical application in Internal Medicine (IM). The IM residents at Navy Medical Readiness and Training Center San Diego (NMRTC-SD) communicated the need for both increased ambulatory didactic sessions as well as a formal EBM curriculum. Prior to the academic year of 2021-2022, no formal ambulatory or EBM curriculum existed. In July 2021, an integrated EBM-ambulatory curriculum was implemented. METHODS:  A pre-curriculum needs assessment was performed and thereafter an eight-session integrated ambulatory-EBM curriculum was implemented in the 2021-2022 academic year. Faculty members facilitated small group discussions focused on a particular didactic topic and EBM principle and integrated the learning of both into one session. After each session, residents completed a feedback form. At the end of the year, a post-curriculum needs assessment was collected. KEY RESULTS: Thirty-four residents of all post-graduate years (PGY) levels participated from July 2021 to June 2022. Primary outcomes were satisfaction with the didactic portion of the curriculum, perception of receipt of adequate training in EBM principles, and perception of level of competency in practicing EBM principles. Overall, participants reported a substantial increase in satisfaction with didactic teaching and a large increase in the perceived competency in practicing EBM principles. CONCLUSION: This integrated didactic-EBM curriculum represents an effective method of incorporating didactic topics in IM with the teaching and application of EBM principles, which improved resident satisfaction with the curricula and self-perception of competency in critically appraising medical literature.

Using Self-Regulated Learning Microanalysis to Examine Regulatory Processes in Clerkship Students Engaged in Practice Questions.

Introduction: Self-regulated learning is a cyclical process of forethought, performance, and self-reflection that has been used as an assessment tool in medical education. No prior studies have evaluated SRL processes for answering multiple-choice questions (MCQs) and most evaluated one or two iterations of a non-MCQ task. SRL assessment during MCQs may elucidate reasons why learners are successful or not on these questions that are encountered repeatedly during medical education. Methods: Internal medicine clerkship students at three institutions participated in a SRL microanalytic protocol that targeted strategic planning, metacognitive monitoring, causal attributions, and adaptive inferences across seven MCQs. Responses were transcribed and coded according to previously published methods for microanalytic protocols. Results: Forty-four students participated. In the forethought phase, students commonly endorsed prioritizing relevant features as their diagnostic strategy (n = 20, 45%) but few mentioned higher-order diagnostic reasoning processes such as integrating clinical information (n = 5, 11%) or comparing/contrasting diagnoses (n = 0, 0%). However, in the performance phase, students' metacognitive processes included high frequencies of integration (n = 38, 86%) and comparing/contrasting (n = 24, 55%). In the self-reflection phase, 93% (n = 41) of students faulted their management reasoning and 84% (n = 37) made negative references to their abilities. Less than 10% (n = 4) of students indicated that they would adapt their diagnostic reasoning process for these questions. Discussion: This study describes in detail student self-regulatory processes during MCQs. We found that students engaged in higher-order diagnostic reasoning processes but were not explicit about it and seldom reflected critically on these processes after selecting an incorrect answer. Self-reflections focused almost exclusively on management reasoning and negative references to abilities which may decrease self-efficacy. Encouraging students to identify and evaluate diagnostic reasoning processes and make attributions to controllable factors may improve performance.

Relationship Between Gender and Academic and Military Achievement Among USU Medical School Graduates.

INTRODUCTION: Despite increases in the number of female matriculants in medical school, civilian data demonstrate that women still struggle to reach parity in attainment of leadership positions. In military medicine, we have seen a major increase in the number of women graduating from the USU. Yet, we still know little about the representation of female military physicians in leadership positions. The aim of this study is to examine the relationship between gender and academic and military achievement among USU School of Medicine graduates. METHODS: Utilizing the USU alumni survey sent to graduates from the classes of 1980 to 2017, items of interest, such as highest military rank, leadership positions held, academic rank, and time in service, were used to evaluate the relationship between gender and academic and military achievement. Contingency table statistical analysis was conducted to compare the gender distribution on the survey items of interest. RESULTS: Pairwise comparison demonstrated significant differences between gender in the O-4 (P = .003) and O-6 (P = .0002) groups, with females having a higher-than-expected number of O-4 officers and males having a higher-than-expected number of O-6 officers. These differences persisted in a subsample analysis that excluded those who separated from active duty prior to 20 years of service. There was a significant association between gender and holding the position of commanding officer (χ2(1) = 6.61, P < .05) with fewer females than expected. In addition, there was a significant association between gender and the highest academic rank achieved (χ2(3) = 9.48, P < 0.05) with lower-than-expected number of females reaching the level of full professor, in contrast to males who exceed the expected number. CONCLUSIONS: This study suggests that female graduates of USU School of Medicine have not achieved promotion to the highest levels of rank, military, or academic leadership at the projected rate. Efforts to explore what barriers may impact military medicine's desire to have more equal representation of women in higher ranks and positions should be undertaken with specific attention to what drives retention versus separation of medical officers and if systematic changes are needed to help promote equity for women in military medicine.

Career Accomplishments of Uniformed Services University of the Health Sciences Medical Graduates: Classes 1980-2017.

BACKGROUND: The current study reports career accomplishments of Uniformed Services University (USU) graduates in four areas: (1) positions held over the course of their entire career, (2) military awards, decorations, and rank, (3) first residency completed, and (4) academic achievements. METHOD: Utilizing the responses to the alumni survey sent to USU graduates in the Class 1980 to 2017, we extracted relevant data and reported descriptive statistics. RESULTS: 1,848 out of 4,469 responded to the survey (41%). 86% (n = 1,574) of respondents indicated having served as a full-time clinician (seeing patients at least 70% of the time during a typical week), while many of them serve in leadership such as educational, operational, or command leadership roles. 87% (n = 1,579) of respondents are ranked from O-4 to O-6, and 64% (n = 1,169) of the respondents received a military award or medal. Family medicine, internal medicine, and pediatrics were the most chosen medical specialties, which is similar to the national patterns reported by AAMC. 45% (n = 781) held an academic appointment. CONCLUSION: USU graduates continue to make significant contributions to military medicine. USU graduates' medical specialty preferences are similar to the past, which calls for further investigation to identify driving factors on such preference.

The Retention of USUHS Military Physicians: An Exploratory Study.

BACKGROUND: Previously, researchers investigated the career accomplishments of USU medical graduates using the data from a USU alumni survey. To better understand if such accomplishments are related to military retention, the current study investigates the relationship between accomplishments (such as military career milestones and academic achievement) and military retention. METHODS: Utilizing the responses to the alumni survey sent to USU graduates in the Classes of 1980 to 2017, the researchers investigated the relationship between a series of survey items (e.g., military rank, medical specialties, and operation experiences) and military retention. RESULTS: Among the respondents who had a deployment history in support of an operational mission, 206 (67.1%) stayed longer than their initial active duty service or planned on staying longer than their current active duty service commitment. Fellowship directors (n = 65, 72.3%) showed a higher retention rate than other positions. The PHS alumni had the highest retention rate (n = 39, 69%) of the military branches, whereas physicians in medical specialties with higher demand (e.g., otolaryngology and psychiatry) showed less promising retention. CONCLUSIONS: By conducting future research on underlying reasons as to why full-time clinicians, junior physicians, and physicians in medical specialties with higher demand showed less promising retention, stakeholders will be able to identify what needs to be addressed to retain highly skilled physicians in the military.

Commentary: A View From the Inside-A Perspective on How the American Board of Internal Medicine (ABIM) Is Innovating in Response to Feedback.

The American Board of Internal Medicine (ABIM) is implementing new methods for the development of examination content in response to feedback from the internal medicine community and in recognition that there is always room for improvement in the assessment of the skills and knowledge of practicing physicians. First, ABIM is exploring a new cognitive model-based approach to content development in efforts to improve exam relevancy. Second, ABIM has created a new Item-Writing Task Force in an effort to ensure a broad representation of internists from across the country who are engaged in all aspects of clinical practice. Through these mechanisms, the goal is the improved fairness and validity evidence of examinations that are relevant to how medicine is practiced today.

Examining the patterns of uncertainty across clinical reasoning tasks: effects of contextual factors on the clinical reasoning process.

Objectives Uncertainty is common in clinical reasoning given the dynamic processes required to come to a diagnosis. Though some uncertainty is expected during clinical encounters, it can have detrimental effects on clinical reasoning. Likewise, evidence has established the potentially detrimental effects of the presence of distracting contextual factors (i.e., factors other than case content needed to establish a diagnosis) in a clinical encounter on clinical reasoning. The purpose of this study was to examine how linguistic markers of uncertainty overlap with different clinical reasoning tasks and how distracting contextual factors might affect physicians' clinical reasoning process. Methods In this descriptive exploratory study, physicians participated in a live or video recorded simulated clinical encounter depicting a patient with unstable angina with and without contextual factors. Transcribed think-aloud reflections were coded using Goldszmidt's clinical reasoning task typology (26 tasks encompassing the domains of framing, diagnosis, management, and reflection) and then those coded categories were examined using linguistic markers of uncertainty (e.g., probably, possibly, etc.). Results Thirty physicians with varying levels of experience participated. Consistent with expectations, descriptive analysis revealed that physicians expressed more uncertainty in cases with distracting contextual factors compared to those without. Across the four domains of reasoning tasks, physicians expressed the most uncertainty in diagnosis and least in reflection. Conclusions These results highlight how linguistic markers of uncertainty can shed light on the role contextual factors might play in uncertainty which can lead to error and why it is essential to find ways of managing it.

Understanding context specificity: the effect of contextual factors on clinical reasoning.

Background Situated cognition theory argues that thinking is inextricably situated in a context. In clinical reasoning, this can lead to context specificity: a physician arriving at two different diagnoses for two patients with the same symptoms, findings, and diagnosis but different contextual factors (something beyond case content potentially influencing reasoning). This paper experimentally investigates the presence of and mechanisms behind context specificity by measuring differences in clinical reasoning performance in cases with and without contextual factors. Methods An experimental study was conducted in 2018-2019 with 39 resident and attending physicians in internal medicine. Participants viewed two outpatient clinic video cases (unstable angina and diabetes mellitus), one with distracting contextual factors and one without. After viewing each case, participants responded to six open-ended diagnostic items (e.g. problem list, leading diagnosis) and rated their cognitive load. Results Multivariate analysis of covariance (MANCOVA) results revealed significant differences in angina case performance with and without contextual factors [Pillai's trace = 0.72, F = 12.4, df =(6, 29), p < 0.001, η p 2 = 0.72 $\eta _{\rm p}^2 = 0.72$ ], with follow-up univariate analyses indicating that participants performed statistically significantly worse in cases with contextual factors on five of six items. There were no significant differences in diabetes cases between conditions. There was no statistically significant difference in cognitive load between conditions. Conclusions Using typical presentations of common diagnoses, and contextual factors typical for clinical practice, we provide ecologically valid evidence for the theoretically predicted negative effects of context specificity (i.e. for the angina case), with large effect sizes, offering insight into the persistence of diagnostic error.

Sequence matters: patterns in task-based clinical reasoning.

Background The cognitive pathways that lead to an accurate diagnosis and efficient management plan can touch on various clinical reasoning tasks (1). These tasks can be employed at any point during the clinical reasoning process and though the four distinct categories of framing, diagnosis, management, and reflection provide some insight into how these tasks map onto clinical reasoning, much is still unknown about the task-based clinical reasoning process. For example, when and how are these tasks typically used? And more importantly, do these clinical reasoning task processes evolve when patient encounters become complex and/or challenging (i.e. with contextual factors)? Methods We examine these questions through the lens of situated cognition, context specificity, and cognitive load theory. Sixty think-aloud transcripts from 30 physicians who participated in two separate cases - one with a contextual factor and one without - were coded for 26 clinical reasoning tasks (1). These tasks were organized temporally, i.e. when they emerged in their think-aloud process. Frequencies of each of the 26 tasks were aggregated, categorized, and visualized in order to analyze task category sequences. Results We found that (a) as expected, clinical tasks follow a general sequence, (b) contextual factors can distort this emerging sequence, and (c) the presence of contextual factors prompts more experienced physicians to clinically reason similar to that of less experienced physicians. Conclusions These findings add to the existing literature on context specificity in clinical reasoning and can be used to strengthen teaching and assessment of clinical reasoning.

It Totally Possibly Could Be: How a Group of Military Physicians Reflect on Their Clinical Reasoning in the Presence of Contextual Factors.

INTRODUCTION: Contextual factors (eg, diagnostic suggestion and burnout) can affect physician clinical reasoning performance, leading to diagnostic error. Yet, contextual factors have only recently been studied and none of that work focused on how physicians appraise (ie, evaluate) the clinical situation as they reason. The purpose of this qualitative study was to use appraisal to describe the effect of contextual factors on clinical reasoning. MATERIALS AND METHODS: Physicians (n = 25) either viewed two video cases or participated in two live scenarios, one with contextual factors and one without. Afterwards, they completed a "think-aloud" reflection while reviewing the cases. Transcribed think-alouds were coded for appraisal markers, comparing cases with and without contextual factors. RESULTS: When contextual factors were present, participants expressed more emotional evaluation and uncertainty about those emotions. Across all types of cases, participants expressed uncertainty about the case and assessed what "could" or "would" have gone differently. CONCLUSIONS: This study suggests that one major effect of contextual factors may be that they induce emotions, which may affect the process of clinical reasoning and diagnostic error. It also suggests that uncertainty may be common in clinical practice, and we should thus further explore its impact.

Heart Rate and Heart Rate Variability Correlate with Clinical Reasoning Performance and Self-Reported Measures of Cognitive Load.

Cognitive load is a key mediator of cognitive processing that may impact clinical reasoning performance. The purpose of this study was to gather biologic validity evidence for correlates of different types of self-reported cognitive load, and to explore the association of self-reported cognitive load and physiologic measures with clinical reasoning performance. We hypothesized that increased cognitive load would manifest evidence of elevated sympathetic tone and would be associated with lower clinical reasoning performance scores. Fifteen medical students wore Holter monitors and watched three videos depicting medical encounters before completing a post-encounter form and standard measures of cognitive load. Correlation analysis was used to investigate the relationship between cardiac measures (mean heart rate, heart rate variability and QT interval variability) and self-reported measures of cognitive load, and their association with clinical reasoning performance scores. Despite the low number of participants, strong positive correlations were found between measures of intrinsic cognitive load and heart rate variability. Performance was negatively correlated with mean heart rate, as well as single-item cognitive load measures. Our data signify a possible role for using physiologic monitoring for identifying individuals experiencing high cognitive load and those at risk for performing poorly during clinical reasoning tasks.

Use of clinical reasoning tasks by medical students.

Background A framework of clinical reasoning tasks used by physicians during clinical encounters was previously developed proposing that clinical reasoning is a complex process composed of 26 possible tasks. The aim of this paper was to analyze the verbalized clinical reasoning processes of medical students utilizing commonly encountered internal medicine cases. Methods In this mixed-methods study, participants viewed three video recorded clinical encounters. After each encounter, participants completed a think-aloud protocol. The qualitative data from the transcribed think-aloud transcripts were analyzed by two investigators using a constant comparative approach. The type, frequency, and pattern of codes used were analyzed. Results Seventeen third and fourth year medical students participated. They used 15 reasoning tasks across all cases. The average number of tasks used in cases 1, 2, and 3 was (respectively) 5.6 (range 3-8), 5.9 (range 4-8), and 5.3 (range 3-10). The order in which medical students verbalized reasoning tasks varied and appeared purposeful but non-sequential. Conclusions Consistent with prior research in residents, participants progressed through the encounter in a purposeful but non-sequential fashion. Reasoning tasks related to framing the encounter and diagnosis were not used in succession but interchangeably. This suggests that teaching successful clinical reasoning may involve encouraging or demonstrating multiple pathways through a problem. Further research exploring the association between use of clinical reasoning tasks and clinical reasoning accuracy could enhance the medical community's understanding of variance in clinical reasoning.

Context and clinical reasoning : Understanding the medical student perspective.

INTRODUCTION: Studies have shown that a physician's clinical reasoning performance can be influenced by contextual factors. We explored how the clinical reasoning performance of medical students was impacted by contextual factors in order to expand upon previous findings in resident and board certified physicians. Using situated cognition as the theoretical framework, our aim was to evaluate the verbalized clinical reasoning processes of medical students in order to describe what impact the presence of contextual factors has on their reasoning performance. METHODS: Seventeen medical student participants viewed three video recordings of clinical encounters portraying straightforward diagnostic cases in internal medicine with explicit contextual factors inserted. Participants completed a computerized post-encounter form as well as a think-aloud protocol. Three authors analyzed verbatim transcripts from the think-aloud protocols using a constant comparative approach. After iterative coding, utterances were analyzed and grouped into categories and themes. RESULTS: Six categories and ten associated themes emerged, which demonstrated overlap with findings from previous studies in resident and attending physicians. Four overlapping categories included emotional disturbances, behavioural inferences about the patient, doctor-patient relationship, and difficulty with closure. Two new categories emerged to include anchoring and misinterpretation of data. DISCUSSION: The presence of contextual factors appeared to impact clinical reasoning performance in medical students. The data suggest that a contextual factor can be innate to the clinical scenario, consistent with situated cognition theory. These findings build upon our understanding of clinical reasoning performance from both a theoretical and practical perspective.

Contextual factors and clinical reasoning: differences in diagnostic and therapeutic reasoning in board certified versus resident physicians.

BACKGROUND: The impact of context on the complex process of clinical reasoning is not well understood. Using situated cognition as the theoretical framework and videos to provide the same contextual "stimulus" to all participants, we examined the relationship between specific contextual factors on diagnostic and therapeutic reasoning accuracy in board certified internists versus resident physicians. METHODS: Each participant viewed three videotaped clinical encounters portraying common diagnoses in internal medicine. We explicitly modified the context to assess its impact on performance (patient and physician contextual factors). Patient contextual factors, including English as a second language and emotional volatility, were portrayed in the videos. Physician participant contextual factors were self-rated sleepiness and burnout.. The accuracy of diagnostic and therapeutic reasoning was compared with covariates using Fisher Exact, Mann-Whitney U tests and Spearman Rho's correlations as appropriate. RESULTS: Fifteen board certified internists and 10 resident physicians participated from 2013 to 2014. Accuracy of diagnostic and therapeutic reasoning did not differ between groups despite residents reporting significantly higher rates of sleepiness (mean rank 20.45 vs 8.03, U = 0.5, p < .001) and burnout (mean rank 20.50 vs 8.00, U = 0.0, p < .001). Accuracy of diagnosis and treatment were uncorrelated (r = 0.17, p = .65). In both groups, the proportion scoring correct responses for treatment was higher than the proportion scoring correct responses for diagnosis. CONCLUSIONS: This study underscores that specific contextual factors appear to impact clinical reasoning performance. Further, the processes of diagnostic and therapeutic reasoning, although related, may not be interchangeable. This raises important questions about the impact that contextual factors have on clinical reasoning and provides insight into how clinical reasoning processes in more authentic settings may be explained by situated cognition theory.

Clinical Reasoning Tasks and Resident Physicians: What Do They Reason About?

PURPOSE: A framework of clinical reasoning tasks thought to occur in a clinical encounter was recently developed. It proposes that diagnostic and therapeutic reasoning comprise 24 tasks. The authors of this current study used this framework to investigate what internal medicine residents reason about when they approach straightforward clinical cases. METHOD: Participants viewed three video-recorded clinical encounters portraying common diagnoses. After each video, participants completed a post encounter form and think-aloud protocol. Two authors analyzed transcripts from the think-aloud protocols using a constant comparative approach. They conducted iterative coding of the utterances, classifying each according to the framework of clinical reasoning tasks. They evaluated the type, number, and sequence of tasks the residents used. RESULTS: Ten residents participated in the study in 2013-2014. Across all three cases, the residents employed 14 clinical reasoning tasks. Nearly all coded tasks were associated with framing the encounter or diagnosis. The order in which residents used specific tasks varied. The average number of tasks used per case was as follows: Case 1, 4.4 (range 1-10); Case 2, 4.6 (range 1-6); and Case 3, 4.7 (range 1-7). The residents used some tasks repeatedly; the average number of task utterances was 11.6, 13.2, and 14.7 for, respectively, Case 1, 2, and 3. CONCLUSIONS: Results suggest that the use of clinical reasoning tasks occurs in a varied, not sequential, process. The authors provide suggestions for strengthening the framework to more fully encompass the spectrum of reasoning tasks that occur in residents' clinical encounters.

Consequences of contextual factors on clinical reasoning in resident physicians.

Context specificity and the impact that contextual factors have on the complex process of clinical reasoning is poorly understood. Using situated cognition as the theoretical framework, our aim was to evaluate the verbalized clinical reasoning processes of resident physicians in order to describe what impact the presence of contextual factors have on their clinical reasoning. Participants viewed three video recorded clinical encounters portraying straightforward diagnoses in internal medicine with select patient contextual factors modified. After watching each video recording, participants completed a think-aloud protocol. Transcripts from the think-aloud protocols were analyzed using a constant comparative approach. After iterative coding, utterances were analyzed for emergent themes with utterances grouped into categories, themes and subthemes. Ten residents participated in the study with saturation reached during analysis. Participants universally acknowledged the presence of contextual factors in the video recordings. Four categories emerged as a consequence of the contextual factors: (1) emotional reactions (2) behavioral inferences (3) optimizing the doctor patient relationship and (4) difficulty with closure of the clinical encounter. The presence of contextual factors may impact clinical reasoning performance in resident physicians. When confronted with the presence of contextual factors in a clinical scenario, residents experienced difficulty with closure of the encounter, exhibited as diagnostic uncertainty. This finding raises important questions about the relationship between contextual factors and clinical reasoning activities and how this relationship might influence the cost effectiveness of care. This study also provides insight into how the phenomena of context specificity may be explained using situated cognition theory.

Multi-disciplinary Care for the Elderly in Disasters: An Integrative Review.

INTRODUCTION: Older adults are disproportionately affected by disaster. Frail elders, individuals with chronic diseases, conditions, or disabilities, and those who live in long-term care facilities are especially vulnerable. Purpose The purpose of this integrative review of the literature was to describe the system-wide knowledge and skills that multi-disciplinary health care providers need to provide appropriate care for the elderly during domestic-humanitarian and disaster-relief efforts. Data sources A systematic search protocol was developed in conjunction with a research librarian. Searches of PubMed, CINAHL, and PsycINFO were conducted using terms such as Disaster, Geological Processes, Aged, Disaster Planning, and Vulnerable Populations. Forty-six articles met criteria for inclusion in the review. CONCLUSIONS: Policies and guidance regarding evacuating versus sheltering in place are lacking. Tenets of elderly-focused disaster planning/preparation and clarification of legal and ethical standards of care and liability issues are needed. Functional capacity, capabilities, or impairments, rather than age, should be considered in disaster preparation. Older adults should be included in disaster planning as population-specific experts. Implications for Practice A multifaceted approach to population-specific disaster planning and curriculum development should include consideration of the biophysical and psychosocial aspects of care, ethical and legal issues, logistics, and resources.

What aspects of letters of recommendation predict performance in medical school? Findings from one institution.

PURPOSE: To study medical students' letters of recommendation (LORs) from their applications to medical school to determine whether these predicted medical school performance, because many researchers have questioned LORs' predictive validity. METHOD: A retrospective cohort study of three consecutive graduating classes (2007-2009) at the Uniformed Services University of the Health Sciences was performed. In each class, the 27 students who had been elected into the Alpha Omega Alpha (AOA) Honor Medical Society were defined as top graduates, and the 27 students with the lowest cumulative grade point average (GPA) were designated as "bottom of the class" graduates. For each student, the first three LORs (if available) in the application packet were independently coded by two blinded investigators using a comprehensive list of 76 characteristics. Each characteristic was compared with graduation status (top or bottom of the class), and those with statistical significance related to graduation status were inserted into a logistic regression model, with undergraduate GPA and Medical College Admission Test score included as control variables. RESULTS: Four hundred thirty-seven LORs were included. Of 76 LOR characteristics, 7 were associated with graduation status (P ≤ .05), and 3 remained significant in the regression model. Being rated as "the best" among peers and having an employer or supervisor as the LOR author were associated with induction into AOA, whereas having nonpositive comments was associated with bottom of the class students. CONCLUSIONS: LORs have limited value to admission committees, as very few LOR characteristics predict how students perform during medical school.