Using Self-Regulated Learning Microanalysis to Examine Regulatory Processes in Clerkship Students Engaged in Practice Questions.

Introduction: Self-regulated learning is a cyclical process of forethought, performance, and self-reflection that has been used as an assessment tool in medical education. No prior studies have evaluated SRL processes for answering multiple-choice questions (MCQs) and most evaluated one or two iterations of a non-MCQ task. SRL assessment during MCQs may elucidate reasons why learners are successful or not on these questions that are encountered repeatedly during medical education. Methods: Internal medicine clerkship students at three institutions participated in a SRL microanalytic protocol that targeted strategic planning, metacognitive monitoring, causal attributions, and adaptive inferences across seven MCQs. Responses were transcribed and coded according to previously published methods for microanalytic protocols. Results: Forty-four students participated. In the forethought phase, students commonly endorsed prioritizing relevant features as their diagnostic strategy (n = 20, 45%) but few mentioned higher-order diagnostic reasoning processes such as integrating clinical information (n = 5, 11%) or comparing/contrasting diagnoses (n = 0, 0%). However, in the performance phase, students' metacognitive processes included high frequencies of integration (n = 38, 86%) and comparing/contrasting (n = 24, 55%). In the self-reflection phase, 93% (n = 41) of students faulted their management reasoning and 84% (n = 37) made negative references to their abilities. Less than 10% (n = 4) of students indicated that they would adapt their diagnostic reasoning process for these questions. Discussion: This study describes in detail student self-regulatory processes during MCQs. We found that students engaged in higher-order diagnostic reasoning processes but were not explicit about it and seldom reflected critically on these processes after selecting an incorrect answer. Self-reflections focused almost exclusively on management reasoning and negative references to abilities which may decrease self-efficacy. Encouraging students to identify and evaluate diagnostic reasoning processes and make attributions to controllable factors may improve performance.

Determining Grades in the Internal Medicine Clerkship: Results of a National Survey of Clerkship Directors.

PURPOSE: Trust in and comparability of assessments are essential in clerkships in undergraduate medical education for many reasons, including ensuring competency in clinical skills and application of knowledge important for the transition to residency and throughout students' careers. The authors examined how assessments are used to determine internal medicine (IM) core clerkship grades across U.S. medical schools. METHODS: A multisection web-based survey of core IM clerkship directors at 134 U.S. medical schools with membership in the Clerkship Directors in Internal Medicine was conducted in October through November 2018. The survey included a section on assessment practices to characterize current grading scales used, who determines students' final clerkship grades, the nature/type of summative assessments, and how assessments are weighted. Respondents were asked about perceptions of the influence of the National Board of Medical Examiners (NBME) Medicine Subject Examination (MSE) on students' priorities during the clerkship. RESULTS: The response rate was 82.1% (110/134). There was considerable variability in the summative assessments and their weighting in determining final grades. The NBME MSE (91.8%), clinical performance (90.9%), professionalism (70.9%), and written notes (60.0%) were the most commonly used assessments. Clinical performance assessments and the NBME MSE accounted for the largest percentage of the total grade (on average 52.8% and 23.5%, respectively). Eighty-seven percent of respondents were concerned that students' focus on the NBME MSE performance detracted from patient care learning. CONCLUSIONS: There was considerable variability in what IM clerkships assessed and how those assessments were translated into grades. The NBME MSE was a major contributor to the final grade despite concerns about the impact on patient care learning. These findings underscore the difficulty in comparing learners across institutions and serve to advance discussions for how to improve accuracy and comparability of grading in the clinical environment.

SimLEARN Musculoskeletal Training for VHA Primary Care Providers and Health Professions Educators.

A simulation-based training curricula applied to the primary care evaluation and management of shoulder and knee pain resulted in improved access to care for veterans and cost savings for the health care system.

Toward a National Conversation on Health: Disruptive Intervention and the Transformation from Health Care to Health.

Over a century ago, Abraham Flexner's landmark report on medical education resulted in the most extensive reforms of medical training in history. They led to major advances in the diagnosis and treatment of disease and the relief of suffering. His prediction that "the physician's function is fast becoming social and preventive, rather than individual and curative," however, was never realized.Instead, with the rise of biomedical science, the scientific method and the American Medical Association, the health care system became increasingly distanced from a holistic approach to life that recognizes the critical role social determinants play in people's health. These developments created the beginning of the regulatory controls that have come to define and shape American health care - and our unhealthy obsession with illness, disease and curative medicine that has resulted in a system that has little to do with health.To realize Flexner's prediction, and to transform health care into a holistic system whose primary goals are focused on health outcomes, six disruptive interventions are proposed. First, health needs to be placed in the context of community. Second, the model of primary care needs to be revised. Third, big data need to be harnessed to provide personalized, consumable, and actionable health knowledge. Fourth, there needs to greater patient engagement, but with fewer face-to-face encounters.Fifth, we need revitalized, collaborative medical training for physicians. And finally, true transformation will require market-driven, not regulatory-constrained, innovation. The evolution from health care to health demands consumer-driven choices that only a deregulated, free market can provide.

Pre-clerkship clinical skills and clinical reasoning course performance: Explaining the variance in clerkship performance : Pre-clerkship predictors of clerkship variance.

INTRODUCTION: Evidence suggests that pre-clerkship courses in clinical skills and clinical reasoning positively impact student performance on the clerkship. Given the increasing emphasis on reducing diagnostic reasoning errors, it is very important to develop this critical area of medical education. An integrated approach between clinical skills and clinical reasoning courses may better predict struggling learners, and better allocate scarce resources to remediate these learners before the clerkship. METHODS: Pre-clerkship and clerkship outcome measures from 514 medical students graduating between 2009 and 2011were analyzed in a multiple linear regression model. RESULTS: Learners with poor performances on integrated pre-clerkship outcome measures had a relative risk of 6.96 and 5.85 for poor performance on National Board of Medical Examiners (NBME) subject exams and clerkship performance, respectively, and explained 22 % of the variance in clerkship NBME subject exam scores and 20.2 % of the variance in clerkship grades. DISCUSSION: Pre-clerkship outcome measures from clinical skills and clinical reasoning courses explained a significant amount of clerkship performance beyond baseline academic ability. These courses provide valuable information regarding student abilities, and may serve as an early indicator for students requiring remediation. CONCLUSIONS: Integrating pre-clerkship outcome measures may be an important aspect of ensuring the validity of this information as the pre-clerkship curriculum becomes compressed, and may serve as the basis for identifying students in need of clinical skills remediation.

Does the MCAT predict medical school and PGY-1 performance?

BACKGROUND: The Medical College Admissions Test (MCAT) is a high-stakes test required for entry to most U. S. medical schools; admissions committees use this test to predict future accomplishment. Although there is evidence that the MCAT predicts success on multiple choice-based assessments, there is little information on whether the MCAT predicts clinical-based assessments of undergraduate and graduate medical education performance. This study looked at associations between the MCAT and medical school grade point average (GPA), Medical Licensing Examination (USMLE) scores, observed patient care encounters, and residency performance assessments. METHODS: This study used data collected as part of the Long-Term Career Outcome Study to determine associations between MCAT scores, USMLE Step 1, Step 2 clinical knowledge and clinical skill, and Step 3 scores, Objective Structured Clinical Examination performance, medical school GPA, and PGY-1 program director (PD) assessment of physician performance for students graduating 2010 and 2011. RESULTS: MCAT data were available for all students, and the PGY PD evaluation response rate was 86.2% (N = 340). All permutations of MCAT scores (first, last, highest, average) were weakly associated with GPA, Step 2 clinical knowledge scores, and Step 3 scores. MCAT scores were weakly to moderately associated with Step 1 scores. MCAT scores were not significantly associated with Step 2 clinical skills Integrated Clinical Encounter and Communication and Interpersonal Skills subscores, Objective Structured Clinical Examination performance or PGY-1 PD evaluations. DISCUSSION: MCAT scores were weakly to moderately associated with assessments that rely on multiple choice testing. The association is somewhat stronger for assessments occurring earlier in medical school, such as USMLE Step 1. The MCAT was not able to predict assessments relying on direct clinical observation, nor was it able to predict PD assessment of PGY-1 performance.

Longitudinal effects of medical students' communication skills on future performance.

BACKGROUND: The Essential Elements of Communication (EEC) were developed from the Kalamazoo consensus statement on physician-patient communication. The Uniformed Services University of the Health Sciences (USU) has adopted a longitudinal curriculum to use the EEC both as a learning tool during standardized patient encounters and as an evaluation tool culminating with the end of preclerkship objective-structured clinical examinations (OSCE). Medical educators have recently emphasized the importance of teaching communication skills, as evidenced by the United States Medical Licensing Examination testing both the integrated clinical encounter (ICE) and communication and interpersonal skills (CIS) within the Step 2 Clinical Skills exam (CS). PURPOSE: To determine the associations between students' EEC OSCE performance at the end of the preclerkship period with later communication skills assessment and evaluation outcomes in the context of a longitudinal curriculum spanning both undergraduate medical education and graduate medical education. METHODS: Retrospective data from preclerkship (overall OSCE scores and EEC OSCE scores) and clerkship outcomes (internal medicine [IM] clinical points and average clerkship National Board of Medical Examiners [NBME] scores) were collected from 167 USU medical students from the class of 2011 and compared to individual scores on the CIS and ICE components of Step 2 CS, as well as to the communication skills component of the program directors' evaluation of trainees during their postgraduate year 1 (PGY-1) residency. In addition to bivariate Pearson correlation analysis, we conducted multiple linear regression analysis to examine the predictive power of the EEC score beyond the IM clerkship clinical points and the average NBME Subject Exams score on the outcome measures. RESULTS: The EEC score was a significant predictor of the CIS score and the PGY-1 communication skills score. Beyond the average NBME Subject Exams score and the IM clerkship clinical points, the EEC score explained an additional 13% of the variance in the Step 2 CIS score and an additional 6% of the variance in the PGY-1 communication skills score. In addition, the EEC score was more closely associated with the CIS score than the ICE score. CONCLUSION: The use of a standardized approach with a communication tool like the EEC can help explain future performance in communication skills independent of other education outcomes. In the context of a longitudinal curriculum, this information may better inform medical educators on learners' communication capabilities and more accurately direct future remediation efforts.

Preclerkship assessment of clinical skills and clinical reasoning: the longitudinal impact on student performance.

PURPOSE: Many medical schools across the United States are undergoing curriculum reform designed, in part, to integrate basic sciences and clinical skills. Evidence has suggested that preclerkship courses in clinical skills and clinical reasoning are predictive of student performance on the clerkship. We hypothesized that a combination of outcome measures from preclerkship clinical skills and clinical reasoning courses (Objective Structured Clinical Examination scores, preceptor evaluations, National Board of Medical Examiners subject examination scores, and small group participation grades) would be correlated to performance in internship (program director [PD]evaluation form at end of first postgraduate year). METHODS: Outcome measures from preclerkship clinical skills and clinical reasoning courses and PD evaluation forms from 514 medical students graduating between 2009 and 2011 were analyzed in a multiple linear regression model. RESULTS: Preclerkship clinical skills and clinical reasoning outcome measures were significant contributors to the linear regression model and were able to explain 13.9% of the variance in expertise and 7.6% of the variance in professionalism as measured by the PD evaluation form. CONCLUSION: Clinical skills and clinical reasoning courses during the preclerkship period explained a significant amount of performance at the graduate medical education level. Our data suggest that these courses provide valuable information regarding student abilities in internship. Early recognition of struggling students may provide an opportunity to break a cycle of poor performance that can persist into residency training.

Impact of increased authenticity in instructional format on preclerkship students' performance: a two-year, prospective, randomized study.

PURPOSE: To address whether increasingly authentic instructional formats are more effective in improving preclerkship medical students' performance. METHOD: From 2007 to 2009, the authors conducted a prospective, randomized, crossover study with second-year medical students in a clinical reasoning course at the Uniformed Services University of the Health Sciences. The authors randomly assigned students to one of three cohorts and used instructional formats of differing authenticity (paper, DVD, standardized patient) to teach three subject areas (abdominal pain, anemia, polyuria). Each cohort received one instructional format for each subject area. The authors collected outcome measures (objective structured clinical exam, video quiz, and essay exam scores) at the end of each academic year. They stratified the students into tertiles by first-year grade point average to investigate the impact of instructional formats on learners of different abilities. RESULTS: Outcomes for students in the top tertile improved with increased authenticity of the instructional format compared with outcomes for students in the middle and bottom tertiles (0.188 versus -0.038 and -0.201, P=.001 and .027, respectively). However, outcomes for students in the bottom tertile decreased when students were given only the paper case, compared with the middle and top tertiles (-0.374 versus 0.043 and 0.023, respectively, P=.001), but subsequently improved with more authentic instructional formats. CONCLUSIONS: The authors could not demonstrate that increased authenticity of the instructional format resulted in improved learner performance. However, they believe that there may be some benefit to tailoring preclerkship clinical education based on students' ability.

Restless legs syndrome due to interferon-alpha.

A patient developed restless legs symptoms paralleling the course of interferon-alpha (IFN alpha) therapy for chronic hepatitis C. Symptoms began during a course of IFN alpha, resolved with its suspension, and recurred on rechallenge. Restless legs syndrome may thus be an adverse effect of IFN alpha treatment.