Using Self-Regulated Learning Microanalysis to Examine Regulatory Processes in Clerkship Students Engaged in Practice Questions.

Introduction: Self-regulated learning is a cyclical process of forethought, performance, and self-reflection that has been used as an assessment tool in medical education. No prior studies have evaluated SRL processes for answering multiple-choice questions (MCQs) and most evaluated one or two iterations of a non-MCQ task. SRL assessment during MCQs may elucidate reasons why learners are successful or not on these questions that are encountered repeatedly during medical education. Methods: Internal medicine clerkship students at three institutions participated in a SRL microanalytic protocol that targeted strategic planning, metacognitive monitoring, causal attributions, and adaptive inferences across seven MCQs. Responses were transcribed and coded according to previously published methods for microanalytic protocols. Results: Forty-four students participated. In the forethought phase, students commonly endorsed prioritizing relevant features as their diagnostic strategy (n = 20, 45%) but few mentioned higher-order diagnostic reasoning processes such as integrating clinical information (n = 5, 11%) or comparing/contrasting diagnoses (n = 0, 0%). However, in the performance phase, students' metacognitive processes included high frequencies of integration (n = 38, 86%) and comparing/contrasting (n = 24, 55%). In the self-reflection phase, 93% (n = 41) of students faulted their management reasoning and 84% (n = 37) made negative references to their abilities. Less than 10% (n = 4) of students indicated that they would adapt their diagnostic reasoning process for these questions. Discussion: This study describes in detail student self-regulatory processes during MCQs. We found that students engaged in higher-order diagnostic reasoning processes but were not explicit about it and seldom reflected critically on these processes after selecting an incorrect answer. Self-reflections focused almost exclusively on management reasoning and negative references to abilities which may decrease self-efficacy. Encouraging students to identify and evaluate diagnostic reasoning processes and make attributions to controllable factors may improve performance.

Roles and Responsibilities of Medicine Subinternship Directors : Medicine Subinternship Director Roles.

BACKGROUND: The internal medicine (IM) subinternship (also referred to as acting internship) plays a crucial part in preparing medical students for residency. The roles, responsibilities, and support provided to subinternship directors have not been described. OBJECTIVE: We sought to describe the current role of IM subinternship directors with respect to their responsibilities, salary support, and reporting structure. DESIGN: Nationally representative, annually recurring thematic survey of IM core clerkship directors with membership in an academic professional association as of September 2017. PARTICIPANTS: A total of 129 core clinical medicine clerkship directors at Liaison Committee on Medical Education fully accredited U.S./U.S.-territory-based medical schools. MAIN MEASURES: Responsibilities, salary support, and reporting structure of subinternship directors. KEY RESULTS: The survey response rate was 83.0% (107/129 medical schools). Fifty-one percent (54/107) of respondents reported overseeing both core clerkship inpatient experiences and/or one or more subinternships. For oversight, 49.1% (28/53) of subinternship directors also reported that they were the clerkship director, 26.4% (14/53) that another faculty member directed all medicine subinternships, and 18.9% (10/53) that each subinternship had its own director. The most frequently reported responsibilities for the subinternship directors were administration, including scheduling, and logistics of student schedules (83.0%, 44/53), course evaluation (81.1%, 43/53), and setting grades 79.2% (42/53). The modal response for estimated FTE per course was 10-20% FTE, with 33.3% (16/48) reporting this level of support and 29.2% (14/54) reporting no FTE support. CONCLUSIONS: The role of the IM subinternship director has become increasingly complex. Since the IM subinternship is critical to preparing students for residency, IM subinternship directors require standard expectations and adequate support. Future studies are needed to determine the appropriate level of support for subinternship directors and to define essential roles and responsibilities.

Determining Grades in the Internal Medicine Clerkship: Results of a National Survey of Clerkship Directors.

PURPOSE: Trust in and comparability of assessments are essential in clerkships in undergraduate medical education for many reasons, including ensuring competency in clinical skills and application of knowledge important for the transition to residency and throughout students' careers. The authors examined how assessments are used to determine internal medicine (IM) core clerkship grades across U.S. medical schools. METHODS: A multisection web-based survey of core IM clerkship directors at 134 U.S. medical schools with membership in the Clerkship Directors in Internal Medicine was conducted in October through November 2018. The survey included a section on assessment practices to characterize current grading scales used, who determines students' final clerkship grades, the nature/type of summative assessments, and how assessments are weighted. Respondents were asked about perceptions of the influence of the National Board of Medical Examiners (NBME) Medicine Subject Examination (MSE) on students' priorities during the clerkship. RESULTS: The response rate was 82.1% (110/134). There was considerable variability in the summative assessments and their weighting in determining final grades. The NBME MSE (91.8%), clinical performance (90.9%), professionalism (70.9%), and written notes (60.0%) were the most commonly used assessments. Clinical performance assessments and the NBME MSE accounted for the largest percentage of the total grade (on average 52.8% and 23.5%, respectively). Eighty-seven percent of respondents were concerned that students' focus on the NBME MSE performance detracted from patient care learning. CONCLUSIONS: There was considerable variability in what IM clerkships assessed and how those assessments were translated into grades. The NBME MSE was a major contributor to the final grade despite concerns about the impact on patient care learning. These findings underscore the difficulty in comparing learners across institutions and serve to advance discussions for how to improve accuracy and comparability of grading in the clinical environment.

SimLEARN Musculoskeletal Training for VHA Primary Care Providers and Health Professions Educators.

A simulation-based training curricula applied to the primary care evaluation and management of shoulder and knee pain resulted in improved access to care for veterans and cost savings for the health care system.

Clerkship Roles and Responsibilities in a Rapidly Changing Landscape: a National Survey of Internal Medicine Clerkship Directors.

BACKGROUND: In the rapidly changing landscape of undergraduate medical education (UME), the roles and responsibilities of clerkship directors (CDs) are not clear. OBJECTIVE: To describe the current roles and responsibilities of Internal Medicine CDs. DESIGN: National annual Clerkship Directors in Internal Medicine (CDIM) cross-sectional survey. PARTICIPANTS: One hundred twenty-nine clerkship directors at all Liaison Committee on Medical Education accredited US medical schools with CDIM membership as of September 1, 2017. MAIN MEASURES: Responsibilities of core CDs, including oversight of other faculty, and resources available to CDs including financial support and dedicated time. KEY RESULT: The survey response rate was 83% (107/129). Ninety-four percent of the respondents oversaw the core clerkship inpatient experience, while 47.7% (n = 51) and 5.6% (n = 6) oversaw the outpatient and longitudinal integrated clerkships respectively. In addition to oversight, CDs were responsible for curriculum development, evaluation and grades, remediation, scheduling, student mentoring, and faculty development. Less than one-third of CDs (n = 33) received the recommended 0.5 full-time equivalent (FTE) support for their roles, and 15% (n = 16) had less than 20% FTE support. An average 0.41 FTE (SD .2) was spent in clinical work and 0.20 FTE (SD .21) in administrative duties. Eighty-three percent worked with other faculty who assisted in the oversight of departmental UME experiences, with FTE support varying by role and institution. Thirty-five percent of CDs (n = 38) had a dedicated budget for managing their clerkship. CONCLUSIONS: The responsibilities of CDs have increased in both number and complexity since the dissemination of previous guidelines for expectations of and for CDs in 2003. However, resources available to them have not substantially changed.

The Clinical Reasoning Mapping Exercise (CResME): a new tool for exploring clinical reasoning.

INTRODUCTION: National organizations have identified a need for the creation of novel approaches to teach clinical reasoning throughout medical education. The aim of this project was to develop, implement and evaluate a novel clinical reasoning mapping exercise (CResME). METHODS: Participants included a convenience sample of first and second year medical students at two US medical schools: University of Central Florida (UCF) and Uniformed Services University of Health Sciences (USUHS). The authors describe the creation and implementation of the CResME. The CResME uses clinical information for multiple disease entities as nodes in different domains (history, physical exam, imaging, laboratory results, etc.), requiring learners to connect these nodes of information in an accurate and meaningful way to develop diagnostic and/or management plans in the process. RESULTS: The majority of medical students at both institutions felt that the CResME promoted their understanding of the differential diagnosis and was a valuable tool to compare and contrast elements of a differential diagnosis. Students at both institutions recommended using the CResME for future sessions. DISCUSSION: The CResME is a promising tool to foster students' clinical reasoning early in medical school. Research is needed on the implementation of the CResME as an instructional and assessment strategy for clinical reasoning throughout medical school training.

The Physician Shortage: A Red Herring in American Health Care Reform.

Although the USA spends more on health care than any other comparable nation, Americans are less healthy than citizens of high-income countries that spend far less. Over the past 12 years, the number of physicians per capita in the USA has been a concerning problem that may contribute to the disparity between health care costs and health status. Some have argued that remediating the shortage of primary care physicians will improve patient health. Others assert that the relationship between health care costs and health outcomes is more complex, influenced by a broad range of variables intrinsic to health care (i.e., provider availability, continuity, coordination); patient factors (ethnicity, socioeconomic status, health behaviors, health literacy, and other social factors); and systems factors (health information management, health information technology and health care measurement itself). This article contends that increasing the physician supply will not improve the health of Americans. Rather, solutions which lower health care costs while concomitantly improving health status will. Aside from community-level actions, health can improve at lower costs by increasing the prevalence of and proficiency in team-based care models, that address individual patient determinants of health, and poorly coordinated care. Future directions for this research and policy development are discussed.

Developing the Next Generation of Physicians.

To improve health care, the USA needs to create a longitudinal medical education system that will develop physicians able to lead the transformation of health care toward a focus on the promotion of healthy behaviors aimed at preventing disease. The development of patient-centered care has been an important step in promoting healthy behaviors. However, to truly develop a meaningful relationship with a patient, a physician must first see them as a person, not as a list of diseases. Medical education should develop physicians able to provide person-centered care - moving beyond patient-centered care to focus more broadly on the entirety of the person, for whom being a patient is merely one aspect of their personhood. Restructuring medical education begins with the admission process itself, followed by longitudinal changes at the undergraduate, graduate, and continuing professional development levels that will reinforce the attributes critical for future physicians. The authors view this longitudinal approach through the theoretical framework of situated cognition, exploring personal, environmental, and social factors leading to success; outline several key stages of medical education from matriculation through continuing professional development; and identify potential areas that merit longitudinal efforts to develop future physicians able to promote positive health behaviors.

Toward a National Conversation on Health: Disruptive Intervention and the Transformation from Health Care to Health.

Over a century ago, Abraham Flexner's landmark report on medical education resulted in the most extensive reforms of medical training in history. They led to major advances in the diagnosis and treatment of disease and the relief of suffering. His prediction that "the physician's function is fast becoming social and preventive, rather than individual and curative," however, was never realized.Instead, with the rise of biomedical science, the scientific method and the American Medical Association, the health care system became increasingly distanced from a holistic approach to life that recognizes the critical role social determinants play in people's health. These developments created the beginning of the regulatory controls that have come to define and shape American health care - and our unhealthy obsession with illness, disease and curative medicine that has resulted in a system that has little to do with health.To realize Flexner's prediction, and to transform health care into a holistic system whose primary goals are focused on health outcomes, six disruptive interventions are proposed. First, health needs to be placed in the context of community. Second, the model of primary care needs to be revised. Third, big data need to be harnessed to provide personalized, consumable, and actionable health knowledge. Fourth, there needs to greater patient engagement, but with fewer face-to-face encounters.Fifth, we need revitalized, collaborative medical training for physicians. And finally, true transformation will require market-driven, not regulatory-constrained, innovation. The evolution from health care to health demands consumer-driven choices that only a deregulated, free market can provide.

Untying the Gordian knot: remediation problems in medical schools that need remediation.

This position paper discusses on-going academic remediation challenges within the field of medical education. More specifically, we identify three common contemporary problems and propose four recommendations to strengthen remediation efforts. Selecting or determining what type of remediation is needed for a particular student is akin to analyzing a Gordian knot with individual, institutional and systemic contributors. More emphasis, including multi-institutional projects and research funding is needed. Recommendations regarding language use and marketing of such programs are given.

Pre-clerkship clinical skills and clinical reasoning course performance: Explaining the variance in clerkship performance : Pre-clerkship predictors of clerkship variance.

INTRODUCTION: Evidence suggests that pre-clerkship courses in clinical skills and clinical reasoning positively impact student performance on the clerkship. Given the increasing emphasis on reducing diagnostic reasoning errors, it is very important to develop this critical area of medical education. An integrated approach between clinical skills and clinical reasoning courses may better predict struggling learners, and better allocate scarce resources to remediate these learners before the clerkship. METHODS: Pre-clerkship and clerkship outcome measures from 514 medical students graduating between 2009 and 2011were analyzed in a multiple linear regression model. RESULTS: Learners with poor performances on integrated pre-clerkship outcome measures had a relative risk of 6.96 and 5.85 for poor performance on National Board of Medical Examiners (NBME) subject exams and clerkship performance, respectively, and explained 22 % of the variance in clerkship NBME subject exam scores and 20.2 % of the variance in clerkship grades. DISCUSSION: Pre-clerkship outcome measures from clinical skills and clinical reasoning courses explained a significant amount of clerkship performance beyond baseline academic ability. These courses provide valuable information regarding student abilities, and may serve as an early indicator for students requiring remediation. CONCLUSIONS: Integrating pre-clerkship outcome measures may be an important aspect of ensuring the validity of this information as the pre-clerkship curriculum becomes compressed, and may serve as the basis for identifying students in need of clinical skills remediation.

Abstracts From the Proceedings of the 2015 Annual Meeting of the Clerkship Directors of Internal Medicine (CDIM).

Since its inception in 1989, Clerkship Directors in Internal Medicine (CDIM) has promoted excellence in medical student education. CDIM members move medical education forward by sharing innovations in curriculum and assessment and discoveries related to educating our students and administering our programs. The Alliance for Academic Internal Medicine, of which CDIM is a founding member, broadens the umbrella beyond student education to include five academically focused specialty organizations representing departments of medicine, teaching hospitals, and medical schools working together to advance learning, discovery, and caring. CDIM held its 2015 annual meeting at Academic Internal Medicine Week in Atlanta, Georgia. This year 36 innovation and research submissions were selected for either oral abstract or poster presentation. The quality of the presentations was outstanding this year and included many of the most important issues in medical education. The CDIM research committee selected the following seven abstracts as being of the highest quality, the most generalizable, and relevant to the readership of Teaching and Learning in Medicine. Two abstracts include information from the CDIM annual survey, which remains a rich source for answering questions about student education on a national level. Looking at trends in medical education, three of the seven selected abstracts mention entrustable professional activities. Three of the abstracts address how we assess student skill and provide them with appropriate feedback. These include two schools' approach to bringing milestones into the medical student realm, use of objective structured clinical exam for assessing clinical skill in clerkship, and what students want in terms of feedback. Four articles deal with curricular innovation. These include interprofessional education, high-value care, transitions of care, and internship preparation. We are pleased to share these abstracts, which represent the breadth and quality of thought of our CDIM members.

Does the MCAT predict medical school and PGY-1 performance?

BACKGROUND: The Medical College Admissions Test (MCAT) is a high-stakes test required for entry to most U. S. medical schools; admissions committees use this test to predict future accomplishment. Although there is evidence that the MCAT predicts success on multiple choice-based assessments, there is little information on whether the MCAT predicts clinical-based assessments of undergraduate and graduate medical education performance. This study looked at associations between the MCAT and medical school grade point average (GPA), Medical Licensing Examination (USMLE) scores, observed patient care encounters, and residency performance assessments. METHODS: This study used data collected as part of the Long-Term Career Outcome Study to determine associations between MCAT scores, USMLE Step 1, Step 2 clinical knowledge and clinical skill, and Step 3 scores, Objective Structured Clinical Examination performance, medical school GPA, and PGY-1 program director (PD) assessment of physician performance for students graduating 2010 and 2011. RESULTS: MCAT data were available for all students, and the PGY PD evaluation response rate was 86.2% (N = 340). All permutations of MCAT scores (first, last, highest, average) were weakly associated with GPA, Step 2 clinical knowledge scores, and Step 3 scores. MCAT scores were weakly to moderately associated with Step 1 scores. MCAT scores were not significantly associated with Step 2 clinical skills Integrated Clinical Encounter and Communication and Interpersonal Skills subscores, Objective Structured Clinical Examination performance or PGY-1 PD evaluations. DISCUSSION: MCAT scores were weakly to moderately associated with assessments that rely on multiple choice testing. The association is somewhat stronger for assessments occurring earlier in medical school, such as USMLE Step 1. The MCAT was not able to predict assessments relying on direct clinical observation, nor was it able to predict PD assessment of PGY-1 performance.

Longitudinal effects of medical students' communication skills on future performance.

BACKGROUND: The Essential Elements of Communication (EEC) were developed from the Kalamazoo consensus statement on physician-patient communication. The Uniformed Services University of the Health Sciences (USU) has adopted a longitudinal curriculum to use the EEC both as a learning tool during standardized patient encounters and as an evaluation tool culminating with the end of preclerkship objective-structured clinical examinations (OSCE). Medical educators have recently emphasized the importance of teaching communication skills, as evidenced by the United States Medical Licensing Examination testing both the integrated clinical encounter (ICE) and communication and interpersonal skills (CIS) within the Step 2 Clinical Skills exam (CS). PURPOSE: To determine the associations between students' EEC OSCE performance at the end of the preclerkship period with later communication skills assessment and evaluation outcomes in the context of a longitudinal curriculum spanning both undergraduate medical education and graduate medical education. METHODS: Retrospective data from preclerkship (overall OSCE scores and EEC OSCE scores) and clerkship outcomes (internal medicine [IM] clinical points and average clerkship National Board of Medical Examiners [NBME] scores) were collected from 167 USU medical students from the class of 2011 and compared to individual scores on the CIS and ICE components of Step 2 CS, as well as to the communication skills component of the program directors' evaluation of trainees during their postgraduate year 1 (PGY-1) residency. In addition to bivariate Pearson correlation analysis, we conducted multiple linear regression analysis to examine the predictive power of the EEC score beyond the IM clerkship clinical points and the average NBME Subject Exams score on the outcome measures. RESULTS: The EEC score was a significant predictor of the CIS score and the PGY-1 communication skills score. Beyond the average NBME Subject Exams score and the IM clerkship clinical points, the EEC score explained an additional 13% of the variance in the Step 2 CIS score and an additional 6% of the variance in the PGY-1 communication skills score. In addition, the EEC score was more closely associated with the CIS score than the ICE score. CONCLUSION: The use of a standardized approach with a communication tool like the EEC can help explain future performance in communication skills independent of other education outcomes. In the context of a longitudinal curriculum, this information may better inform medical educators on learners' communication capabilities and more accurately direct future remediation efforts.

Preclerkship assessment of clinical skills and clinical reasoning: the longitudinal impact on student performance.

PURPOSE: Many medical schools across the United States are undergoing curriculum reform designed, in part, to integrate basic sciences and clinical skills. Evidence has suggested that preclerkship courses in clinical skills and clinical reasoning are predictive of student performance on the clerkship. We hypothesized that a combination of outcome measures from preclerkship clinical skills and clinical reasoning courses (Objective Structured Clinical Examination scores, preceptor evaluations, National Board of Medical Examiners subject examination scores, and small group participation grades) would be correlated to performance in internship (program director [PD]evaluation form at end of first postgraduate year). METHODS: Outcome measures from preclerkship clinical skills and clinical reasoning courses and PD evaluation forms from 514 medical students graduating between 2009 and 2011 were analyzed in a multiple linear regression model. RESULTS: Preclerkship clinical skills and clinical reasoning outcome measures were significant contributors to the linear regression model and were able to explain 13.9% of the variance in expertise and 7.6% of the variance in professionalism as measured by the PD evaluation form. CONCLUSION: Clinical skills and clinical reasoning courses during the preclerkship period explained a significant amount of performance at the graduate medical education level. Our data suggest that these courses provide valuable information regarding student abilities in internship. Early recognition of struggling students may provide an opportunity to break a cycle of poor performance that can persist into residency training.