Gathering Validity Evidence on an Internal Medicine Clerkship Multistep Exam to Assess Medical Student Analytic Ability.

Construct: The definition of clinical reasoning may vary among health profession educators. However, for the purpose of this paper, clinical reasoning is defined as the cognitive processes that are involved in the steps of information gathering, problem representation, generating a differential diagnosis, providing a diagnostic justification to arrive at a leading diagnosis, and formulating diagnostic and management plans. Background: Expert performance in clinical reasoning is essential for success as a physician, and has been difficult for clerkship directors to observe and quantify in a way that fosters the instruction and assessment of clinical reasoning. The purpose of this study was to gather validity evidence for the Multistep exam (MSX) format used by our medicine clerkship to assess analytical clinical reasoning abilities; we did this by examining the relationship between scores on the MSX and other external measures of clinical reasoning abilities. This analysis used dual process theory as the main theoretical framework of clinical reasoning, as well as aspects of Kane's validity framework to guide the selection of validity evidence for the investigation. We hypothesized that there would be an association between the MSX (a three-step clinical reasoning tool developed locally), and the USMLE Step 2 CS, as they share similar concepts in assessing the clinical reasoning of students. We examined the relationship between overall scores on the MSX and the Step 2 CS Integrated Clinical Encounter (ICE) score, in which the student articulates their reasoning for simulated patient cases, while controlling for examinee's internal medicine clerkship performance measures such as the NBME subject exam score and the Medicine clerkship OSCE score. Approach: A total 477 of 487 (97.9%) medical students, representing the graduating classes of 2015, 2016, 2017, who took the MSX at the end of each medicine clerkship (2012-2016), and Step 2 CS (2013-2017) were included in this study. Correlation analysis and multiple linear regression analysis were used to examine the impact of the primary explanatory variables of interest (MSX) onto the outcome variable (ICE score) when controlling for baseline variables (Medicine OSCE and NBME Medicine subject exam). Findings: The overall MSX score had a significant, positive correlation with the Step 2 CS ICE score (r = .26, P < .01). The overall MSX score was a significant predictor of Step 2 CS ICE score (ß = .19, P < .001), explaining an additional 4% of the variance of ICE beyond the NBME Medicine subject score and the Medicine OSCE score (Adjusted R2 = 13%). Conclusion: The stepwise format of the MSX provides a tool to observe clinical reasoning performance, which can be used in an assessment system to provide feedback to students on their analytical clinical reasoning. Future studies should focus on gaining additional validity evidence across different learners and multiple medical schools.

Regular Formal Evaluation Sessions are Effective as Frame-of-Reference Training for Faculty Evaluators of Clerkship Medical Students.

BACKGROUND: Face-to-face formal evaluation sessions between clerkship directors and faculty can facilitate the collection of trainee performance data and provide frame-of-reference training for faculty. OBJECTIVE: We hypothesized that ambulatory faculty who attended evaluation sessions at least once in an academic year (attendees) would use the Reporter-Interpreter-Manager/Educator (RIME) terminology more appropriately than faculty who did not attend evaluation sessions (non-attendees). DESIGN: Investigators conducted a retrospective cohort study using the narrative assessments of ambulatory internal medicine clerkship students during the 2008-2009 academic year. PARTICIPANTS: The study included assessments of 49 clerkship medical students, which comprised 293 individual teacher narratives. MAIN MEASURES: Single-teacher written and transcribed verbal comments about student performance were masked and reviewed by a panel of experts who, by consensus, (1) determined whether RIME was used, (2) counted the number of RIME utterances, and (3) assigned a grade based on the comments. Analysis included descriptive statistics and Pearson correlation coefficients. KEY RESULTS: The authors reviewed 293 individual teacher narratives regarding the performance of 49 students. Attendees explicitly used RIME more frequently than non-attendees (69.8 vs. 40.4 %; p < 0.0001). Grades recommended by attendees correlated more strongly with grades assigned by experts than grades recommended by non-attendees (r = 0.72; 95 % CI (0.65, 0.78) vs. 0.47; 95 % CI (0.26, 0.64); p = 0.005). Grade recommendations from individual attendees and non-attendees each correlated significantly with overall student clerkship clinical performance [r = 0.63; 95 % CI (0.54, 0.71) vs. 0.52 (0.36, 0.66), respectively], although the difference between the groups was not statistically significant (p = 0.21). CONCLUSIONS: On an ambulatory clerkship, teachers who attended evaluation sessions used RIME terminology more frequently and provided more accurate grade recommendations than teachers who did not attend. Formal evaluation sessions may provide frame-of-reference training for the RIME framework, a method that improves the validity and reliability of workplace assessment.

Online Virtual Patient Cases vs. Weekly Classroom Lectures in an Internal Medicine Clerkship: Effects on Military Learner Outcomes.

INTRODUCTION: Virtual patient cases (VPCs), a type of simulated, interactive electronic learning, are a potentially important tool for military health care providers in austere or pandemic settings to maintain skills but need more validation. Our military internal medicine clerkship is spread across military treatment facilities around the country and has 15 weekly live student lectures, but students randomly miss the first, second, or third 5 weeks due to their psychiatry clerkship. We hypothesized that VPCs would be an adequate replacement for lost lectures. MATERIALS AND METHODS: We compared live lectures to a web-based VPC and analyzed the academic outcomes of 734 students from 2015 to 2022. RESULTS: Using our end-of-clerkship Script Concordance Test (SCT) as the primary outcome, there was no significant difference in performance between the 2 learning methods (VPC, 63.9% correct; lectures 63.2%, P = .27). After controlling for gender, baseline knowledge, and the total number of VPCs completed, there was still not a statistically significant difference between teaching methods (F(1,728) = 0.52, P = .47). There was also no significant differences in all other clerkship outcomes including National Board of Medical Examiner and Objective Structured Clinical Examination scores. CONCLUSION: VPCs appear noninferior at teaching clinical reasoning as measured by SCT. VPCs might be substituted for traditional, live lectures in clerkships when time or other resources are limited, in austere environments such as military deployments, or during conditions limiting interpersonal contact such as pandemics but are not a complete substitution for in-person learning.

Using Self-Regulated Learning Microanalysis to Examine Regulatory Processes in Clerkship Students Engaged in Practice Questions.

Introduction: Self-regulated learning is a cyclical process of forethought, performance, and self-reflection that has been used as an assessment tool in medical education. No prior studies have evaluated SRL processes for answering multiple-choice questions (MCQs) and most evaluated one or two iterations of a non-MCQ task. SRL assessment during MCQs may elucidate reasons why learners are successful or not on these questions that are encountered repeatedly during medical education. Methods: Internal medicine clerkship students at three institutions participated in a SRL microanalytic protocol that targeted strategic planning, metacognitive monitoring, causal attributions, and adaptive inferences across seven MCQs. Responses were transcribed and coded according to previously published methods for microanalytic protocols. Results: Forty-four students participated. In the forethought phase, students commonly endorsed prioritizing relevant features as their diagnostic strategy (n = 20, 45%) but few mentioned higher-order diagnostic reasoning processes such as integrating clinical information (n = 5, 11%) or comparing/contrasting diagnoses (n = 0, 0%). However, in the performance phase, students' metacognitive processes included high frequencies of integration (n = 38, 86%) and comparing/contrasting (n = 24, 55%). In the self-reflection phase, 93% (n = 41) of students faulted their management reasoning and 84% (n = 37) made negative references to their abilities. Less than 10% (n = 4) of students indicated that they would adapt their diagnostic reasoning process for these questions. Discussion: This study describes in detail student self-regulatory processes during MCQs. We found that students engaged in higher-order diagnostic reasoning processes but were not explicit about it and seldom reflected critically on these processes after selecting an incorrect answer. Self-reflections focused almost exclusively on management reasoning and negative references to abilities which may decrease self-efficacy. Encouraging students to identify and evaluate diagnostic reasoning processes and make attributions to controllable factors may improve performance.

Reflective Essays During Clerkship Following a Pre-clerkship Leadership Curriculum.

Introduction: Leadership curricula in medical student education require assessment - to determine if leadership skills can be taught to medical students and applied during clinical and medical team interactions to aid in medical student leadership development. Objectives: To examine whether medical students applied principles of their pre-clerkship leadership curriculum (character, competence, context, and communication elements across four levels: personal, interpersonal, team, and organizational) during an internal medicine clerkship. Methods: Using art as a prompt, Uniformed Services University (USU) internal medicine clerkship students completed a structured reflection on a critical incident. Medical student essays written during a 10-week internal medicine clerkship at USU in 2019 were collected. 158 medical student submissions were de-identified and analyzed. Results: Sixty-four submissions (40.5%) focused on leadership or leadership and professionalism. Students identified as male (n = 34, 53%), female (21, 33%), or not reported (9, 14%). Most, 48 (75%), did not describe PITO explicitly in their essay. They instead focused on personal and interpersonal aspects (17, 27%) of leadership, the attending physicians they worked with (33, 52%), and effective leadership strategies (46, 72%). The most common themes written about were responsibility (30, 47%), teamwork (18, 28%), competence (17, 27%), and character/integrity (15, 23%). Conclusion: Although the students' explicit use of the PITO model was limited, student essays centered on themes that reflected leadership concepts taught in pre-clerkship years, such as character, competence, and responsibility. This study demonstrates that an internal medicine clerkship rotation can feasibly implement a leadership reflection.

Watch Where You Point That: Pneumomediastinum From Pneumatic Nail Gun Injury to the Hand.

Pneumatic nail guns are hand-held tools used in industrial and construction settings. Nail guns cause the most trauma with hospitalization among construction workers. To our knowledge, we report for the first time a case of pneumomediastinum from a nail gun injury to the hand. Our patient was a 40-year-old male construction worker who shot a nail gun into his hand. He became acutely dyspneic and was found to have a pneumomediastinum due to air insufflation. He later underwent tube thoracostomy and intubation. To our knowledge, this is the first report of pneumomediastinum from a nail gun injury to the hand.

Delivering a Novel Medical Education "Escape Room" at a National Scientific Conference: First Live, Then Pivoting to Remote Learning Because of COVID-19.

Escape Rooms are gaining prominence as education modalities; the use of principles of game design have been shown to augment knowledge acquisition in a fun, team-based learning experience ("edutainment"). In this report, we outline some of the medical literature and then provide our step-by-step approach and lessons learned when building what was, to our knowledge, the first continuing medical education Escape Room at a national scientific meeting. We then comment on how this innovative educational offering was reimagined the following year for remote (virtual) learning because of the COVID-19 pandemic.

Effects of a short course of eszopiclone on continuous positive airway pressure adherence: a randomized trial.

BACKGROUND: Adherence to short-term continuous positive airway pressure (CPAP) may predict long-term use. Unfortunately, initial CPAP intolerance may lead to poor adherence or abandonment of therapy. OBJECTIVE: To determine whether a short course of eszopiclone at the onset of therapy improves long-term CPAP adherence more than placebo in adults with obstructive sleep apnea. DESIGN: Parallel randomized, placebo-controlled trial from March 2007 to December 2008. Randomization, maintained and concealed centrally by pharmacy personnel, was computer-generated using fixed blocks of 10. Referring physicians, investigators, and patients were blinded to the treatment assignment until after the final data were collected. (ClinicalTrials.gov registration number: NCT00612157). SETTING: Academic sleep disorder center. PATIENTS: 160 adults (mean age, 45.7 years [SD, 7.3]; mean apnea-hypopnea index, 36.9 events/h [SD, 23]) with newly diagnosed obstructive sleep apnea initiating CPAP. INTERVENTION: Eszopiclone, 3 mg (n = 76), or matching placebo (n = 78) for the first 14 nights of CPAP. MEASUREMENTS: Use of CPAP was measured weekly for 24 weeks. Adherence to CPAP (primary outcome) and the rate of CPAP discontinuation and improvements in symptoms (secondary outcomes) were compared. Follow-up at 1, 3, and 6 months was completed by 150, 136, and 120 patients, respectively. RESULTS: Patients in the eszopiclone group used CPAP for 20.8% more nights (95% CI, 7.2% to 34.4%; P = 0.003), 1.3 more hours per night for all nights (CI, 0.4 to 2.2 hours; P = 0.005), and 1.1 more hours per night of CPAP use (CI, 0.2 to 2.1 hours; P = 0.019). The hazard ratio for discontinuation of CPAP was 1.90 (CI, 1.1 to 3.4; P = 0.033) times higher in the placebo group. Side effects were reported in 7.1% of patients and did not differ between groups. LIMITATIONS: Patients had severe obstructive sleep apnea treated at a specialized sleep center with frequent follow-up; results may not be generalizable to different settings. Patients' tolerance to CPAP and their reasons for discontinuation were not assessed. CONCLUSION: Compared with placebo, a short course of eszopiclone during the first 2 weeks of CPAP improved adherence and led to fewer patients discontinuing therapy.

CHEST: Home of the Clinician-Educator.

Many hands can build a house; it takes trust to make that house a home. Trust has two main components: credibility (worthiness based on preparation and past performance) and empathy (the ability to understand and share another person's values). CHEST has maintained its credibility and empathy as the global leader in clinical pulmonary, critical care, and sleep medical education. It follows that the leader in chest clinical education would also be the home of the clinician-educator. You are that educator.

Why Does This Learner Perform Poorly on Tests? Using Self-Regulated Learning Theory to Diagnose the Problem and Implement Solutions.

PROBLEM: Learners who underperform on standardized tests are common throughout all levels of medical education and require considerable faculty time and effort to remediate. Current methods for remediating test-taking difficulties are typically not grounded in educational theory or supported by high-quality evidence. APPROACH: A test-taking assessment was developed based on self-regulated learning (SRL) microanalytic assessment and training and used during academic year 2012-2013. This method assesses the SRL subprocesses of strategic planning, self-monitoring, causal attributions, and adaptive inferences during the educational task of answering test questions. The method was designed for one-on-one use by teacher and learner, and for learner self-assessment and practice. OUTCOMES: At one academic institution, this method was used to categorize learners into struggling test-taker subtypes which correspond to deficiencies in the SRL subprocesses outlined above. A learning plan based on the SRL deficiency was developed for each struggling test-taker subtype. In a small number of internal medicine residents with low in-training examination scores, use of this method yielded improvements in 2013 in-training examination score that doubled the expected improvement based on historical averages. NEXT STEPS: This method is a novel application of SRL theory to a commonly encountered problem in medical education: the learner who performs poorly on tests. Large-scale, multicenter studies of medical learners at a variety of training levels and program types are needed to determine the effectiveness and generalizability of this intervention.

Bilateral external laryngoceles following radioiodine ablation for Graves disease.

A 28-year-old trumpet player underwent multiple treatments with radioactive iodine for Graves disease associated with an unusually large goiter. Following his second treatment, the patient developed acute neck pain and swelling. Radiographic studies and a laryngoscopy demonstrated bilateral symptomatic external laryngoceles, a very rare entity, not previously known to be associated with radioiodine treatment or Graves disease. The patient's profession placed him at risk for the development of a laryngocele, but the temporal relationship to goiter regression following radioiodine therapy suggests that this occurred as a result of this treatment. The patient's disease was managed nonsurgically, and he has subsequently done well. This represents the first known association of symptomatic laryngocele with radioiodine treatment for Graves disease.

Cause-specific mortality in a population with diabetes: South Tees Diabetes Mortality Study.

OBJECTIVE: To describe the mortality of a population with diabetes compared with the local nondiabetic population, using age-, sex-, and cause-specific death rates and relative and absolute differences in death rates. RESEARCH DESIGN AND METHODS: A population-based cohort of 4,842 people with diabetes living within South Tees, U.K., was identified and followed from 1 January 1994 to 31 December 1999. Causes of death were obtained from death certificates, and mortality rates were compared with the nondiabetic population of the same area for the same time period. RESULTS: There were 1,205 deaths (24.9%) in the study population during the 6 years of study. For type 2 diabetes, mortality from cardiovascular causes was significantly increased in both sexes and at all ages. Relative death rates for the age band 40-59 years were 5.47 (95% CI 4.18-7.15) for men and 5.60 (3.44-9.14) for women. The relative death rates declined with age for both sexes, but absolute excess mortality increased with age. There were no consistent differences in noncardiovascular death rates, other than for renal disease. Similar outcomes were found for type 1 diabetes, although these results were limited by a much smaller population size. People with diabetes and renal impairment had significantly higher mortality than people with diabetes alone, with a rate ratio of 7.27 for people with type 2 diabetes aged 40-59 years. CONCLUSIONS: In an area of the U.K. with high cardiovascular death rates, people with diabetes had significantly higher cardiovascular death rates than people without diabetes. Interventions targeted at cardiovascular risk factors should be used to try and reduce this excess premature mortality, which is especially high in those with renal impairment.

The association of students requiring remediation in the internal medicine clerkship with poor performance during internship.

PURPOSE: To determine whether the Uniformed Services University (USU) system of workplace performance assessment for students in the internal medicine clerkship at the USU continues to be a sensitive predictor of subsequent poor performance during internship, when compared with assessments in other USU third year clerkships. METHOD: Utilizing Program Director survey results from 2007 through 2011 and U.S. Medical Licensing Examination (USMLE) Step 3 examination results as the outcomes of interest, we compared performance during internship for students who had less than passing performance in the internal medicine clerkship and required remediation, against students whose performance in the internal medicine clerkship was successful. We further analyzed internship ratings for students who received less than passing grades during the same time period on other third year clerkships such as general surgery, pediatrics, obstetrics and gynecology, family medicine, and psychiatry to evaluate whether poor performance on other individual clerkships were associated with future poor performance at the internship level. Results for this recent cohort of graduates were compared with previously published findings. RESULTS: The overall survey response rate for this 5 year cohort was 81% (689/853). Students who received a less than passing grade in the internal medicine clerkship and required further remediation were 4.5 times more likely to be given poor ratings in the domain of medical expertise and 18.7 times more likely to demonstrate poor professionalism during internship. Further, students requiring internal medicine remediation were 8.5 times more likely to fail USMLE Step 3. No other individual clerkship showed any statistically significant associations with performance at the intern level. On the other hand, 40% of students who successfully remediated and did graduate were not identified during internship as having poor performance. CONCLUSIONS: Unsuccessful clinical performance which requires remediation in the third year internal medicine clerkship at Uniformed Services University of the Health Sciences continues to be strongly associated with poor performance at the internship level. No significant associations existed between any of the other clerkships and poor performance during internship and Step 3 failure. The strength of this association with the internal medicine clerkship is most likely because of an increased level of sensitivity in detecting poor performance.

Referral for competency committee review for poor performance on the internal medicine clerkship is associated with poor performance in internship.

PURPOSE: To determine how students who are referred to a competency committee for concern over performance, and ultimately judged not to require remediation, perform during internship. METHODS: Uniformed Services University of the Health Sciences' students who graduated between 2007 and 2011 were included in this study. We compared the performance during internship of three groups: students who were referred to the internal medicine competency committee for review who met passing criterion, students who were reviewed by the internal medicine competency committee who were determined not to have passed the clerkship and were prescribed remediation, and students who were never reviewed by this competency committee. Program Director survey results and United States Medical Licensing Examination (USMLE) Step 3 examination results were used as the outcomes of interest. RESULTS: The overall survey response rate for this 5-year cohort was 81% (689/853). 102 students were referred to this competency committee for review. 63/102 students were reviewed by this competency committee, given passing grades in the internal medicine clerkship, and were not required to do additional remediation. 39/102 students were given less than passing grades by this competency committee and required to perform additional clinical work in the department of medicine to remediate their performance. 751 students were never presented to this competency committee. Compared to students who were never presented for review, the group of reviewed students who did not require remediation was 5.6 times more likely to receive low internship survey ratings in the realm of professionalism, 8.6 times more likely to receive low ratings in the domain of medical expertise, and had a higher rate of USMLE Step 3 failure (9.4% vs. 2.8%). When comparing the reviewed group to students who were reviewed and also required remediation, the only significant difference between groups regarding professionalism ratings with 50% of the group requiring remediation garnering low ratings compared to 18% of the reviewed group. CONCLUSIONS: Students who are referred to a committee for review following completion of their internal medicine clerkship are more likely to receive poor ratings in internship and fail USMLE Step 3 compared to students whose performance in the medicine clerkship does not trigger a committee review. These findings provide validity evidence for our competency committee review in that the students identified as requiring further clinical work had significantly higher rates of poor ratings in professionalism than students who were reviewed by the competency committee but not required to remediate. Additionally, students reviewed but not required to remediate were nonetheless at risk of low internship ratings, suggesting that these students might need some intervention prior to graduation.

Do specialists differ on do-not-resuscitate decisions?

STUDY OBJECTIVE: Opinions regarding do-not-resuscitate (DNR) decisions differ between individual physicians. We attempted to determine whether the strength of DNR recommendations varies with medical specialty and experience. DESIGN: Written survey. PARTICIPANTS: Physicians from the pulmonary/critical-care medicine (PCCM), cardiology, internal medicine, gastroenterology, hematology/oncology, and infectious disease services as well as the Department of Medicine house staff at our tertiary-care referral center participated in the study. INTERVENTIONS: Physicians were asked confidentially to quantify the strength of their opinions on discussing and recommending DNR orders for each of 20 vignettes made from the summaries of actual cases. Reasons for their opinions and demographic data also were recorded. MEASUREMENTS AND RESULTS: One hundred fifteen of 155 physicians (74%) responded. PCCM physicians (mean [+/- SD] DNR score, 157 +/- 22) more strongly recommended DNR orders than cardiologists (mean DNR score, 122 +/- 32; p = 0.006), house staff (mean DNR score, 132 +/- 24; p = 0.014), and general internists (mean DNR score, 129 +/- 30; p = 0.043). PCCM physicians also trended toward recommending DNR orders for more of the 20 patients described in the vignettes compared to cardiologists (mean DNR number, 16.5 +/- 3.0 vs 11.9 +/- 5.8, respectively; p = 0.066). There were no differences between PCCM physicians and hematology/oncology, infectious disease, and gastroenterology specialists. Among the house staff, the likelihood of recommending a DNR order correlated significantly with increasing years of experience (r = 0.45; p = 0.002). The opposite trend was present in the specialty staff groups. No significant differences in opinion by gender, religion, or personal experiences were found. CONCLUSIONS: The strength of DNR order recommendations varies with medicine specialty and years of training and experience. An awareness of these differences and the determination of the reasons behind them may help to target educational interventions and to ensure effective collaboration with colleagues and communication with patients.

Significance of early bronchoscopic airway abnormalities after lung transplantation.

Abnormal bronchoscopic allograft airway appearance with erythema, friability and sloughing-presumed to be ischemic-has been described early after lung transplantation, but its association with post-operative spirometry or other outcomes is largely unknown. We conducted a prospective cohort study to assess the impact of such airway changes in all lung transplant recipients from January 1997 to July 2000. Twenty-four (59%) of 41 patients were classified as having ischemic-appearing airways. Timing and value of peak pulmonary function tests, mortality, incidence of infection, rejection, anastomotic stricture and bronchiolitis obliterans syndrome were not significantly different when compared to patients with normal-appearing airways over a mean follow-up period of 761.2 +/- 412.4 days.