The Harvard Medical School Pathways curriculum: A comprehensive curricular evaluation.

PURPOSE: The Harvard Medical School Pathways curriculum represents a major reform effort. Our goals were to enhance reasoning and clinical skills and improve the learning environment and students' approach to learning via use of collaborative, case-based pedagogy; early clinical exposure; and enhanced approaches to teaching and evaluating clinical skills. We evaluated the impact of Pathways on key outcomes related to these goals. MATERIALS AND METHODS: In this prospective, mixed-methods study, we compared the last prior-curriculum cohort (2014 matriculation, n = 135) and first new-curriculum cohort (2015 matriculation, n = 135). Measures included Likert-type surveys, focus groups, and test scores to assess outcomes. RESULTS: Compared with prior-curriculum students, new-curriculum students reported higher mean preclerkship learning environment ratings (Educational Climate Inventory, 62.4 versus 51.9, p < 0.0001) and greater satisfaction with the quality of their preclerkship education (88% versus 73%, p = 0.0007). Mean USMLE Step-1 and Step-2 scores did not differ between groups. At graduation, new-curriculum students rated their medical school experience higher in 6 of 7 domains, including 'fostering a culture of curiosity and inquiry' (4.3 versus 3.9, p = 0.006) and focus on 'student-centered learning' (3.9 versus 3.4, p = 0.002). CONCLUSIONS: The new curriculum outperformed or was equal to the prior one on most measures of learning environment and perceived quality of education, without a decline in medical knowledge or clinical skills. Robust longitudinal evaluation provided important feedback for ongoing curriculum improvement.

Does Delaying the United States Medical Licensing Examination Step 1 to After Clerkships Affect Student Performance on Clerkship Subject Examinations?

Phenomenon: Schools are considering the optimal timing of Step 1 of the United States Medical Licensing Examination (USMLE). Two primary reasons for moving Step 1 after the core clerkships are to promote deeper, more integrated basic science learning in clinical contexts and to better prepare students for the increasingly clinical focus of Step 1. Positioning Step 1 after the core clerkships leverages a major national assessment to drive learning, encouraging students to deepen their basic science knowledge while in the clinical setting. Previous studies demonstrated small increases in Step 1 scores, reductions in failure rates, and similar Step 2 Clinical Knowledge scores when Step 1 was after the clerkships. Some schools that have moved Step 1 reported declines in clinical subject examination (CSE) performance. This may be due to shortened pre-clerkship curricula, the absence of the Step 1 study period for knowledge consolidation, or exposure to fewer National Board of Medical Examiners type questions prior to taking CSEs. This multi-institutional study aimed to determine whether student performance on CSEs was affected by moving Step 1 after the core clerkships. Approach: CSE scores for students from eight schools that moved Step 1 after core clerkships between 2012 and 2016 were analyzed in a pre-post format. Hierarchical linear modeling was used to quantify the effect of the curriculum on CSE performance. Additional analysis determined if clerkship order impacted clinical subject exam performance and whether the curriculum change resulted in more students scoring in the lowest percentiles (as defined as below the national fifth percentile) before and after the curricular change. Findings: After moving Step 1 to after the clerkships, collectively these eight schools demonstrated statistically significant lower performance on four CSEs (Medicine, Neurology, Pediatrics, and Surgery) but not Obstetrics/Gynecology or Psychiatry. Comparing performance within the three years pre and post Step 1 change, differences across all clerkships ranged from 0.3 to -2.0 points, with an average difference of -1.1. CSE performance in clerkships taken early in the sequence was more affected by the curricular change, and differences gradually disappeared with subsequent examinations. Medicine and Neurology showed the largest average differences between curricular-group when taken early in the clinical year. Finally, there was a slightly higher chance of scoring below the national fifth percentile in four of the clinical subject exams (Medicine, Neurology, Pediatrics, and Psychiatry) for the cohort with Step 1 after the clerkships. Insights: Moving Step 1 after core clerkships had a small impact on CSE scores overall, with decreased scores for exams early in the clerkship sequence and an increased number of students below the fifth percentile. Score differences have minor effects on clerkship grades, but overall the size of the effect is unlikely to be educationally meaningful. Schools can use a variety of mitigation strategies to address CSE performance and Step 1 preparation in the clerkship phase.

Use of team-based learning pedagogy for predoctoral teaching and learning.

PURPOSE: The purpose of the study was to describe the development and implementation of a Team-based Learning (TBL) educational model in a predoctoral education course to assess its effectiveness in promoting student learning as measured by knowledge acquisition and student satisfaction. METHODS: An interprofessional education course used the TBL structure for the second-year dental students, in which students had an opportunity to first work on the questions individually and then in groups. Each instruction session began with a readiness assurance test (RAT), which students were asked to complete in two formats: each student answered on their own, then each team worked on the same questions to arrive at a consensus decision followed by a team-based application exercise. RESULTS: A significant difference existed in which team scores were higher than individual scores and on average, the teams scored higher than when students worked alone. Student feedback showed a strong preference of TBL over the traditional lecture format. Students found that the sessions helped them to understand the clinical cases from the perspective of other health care fields in this pedagogical approach. CONCLUSION: The TBL methods facilitated an interactive learning environment to promote student-centred learning in a predoctoral education course and the teams performed better in correct evaluation compared with the individual students.

Grading Practices and Distributions Across Internal Medicine Clerkships.

THEORY: Clerkship evaluation and grading practices vary widely between U.S. medical schools. Grade inflation continues to exist, and grade distribution is likely to be different among U.S. medical schools. HYPOTHESES: Increasing the number of available grades curtails "grade inflation." METHOD: A national survey of all Clerkship Directors in Internal Medicine members was administered in 2011. The authors assessed key aspects of grading. RESULTS: Response rate was 76%. Among clerkship directors (CDs), 61% of respondents agreed that grade inflation existed in the internal medicine clerkship at their school, and 43% believed that it helped students obtain better residency positions. With respect to grading practices, 79% of CDs define specific behaviors needed to achieve each grade, and 36% specify an ideal grade distribution. In addition, 44% have a trained core faculty responsible for evaluating students, 35% describe formal grading meetings, and 39% use the Reporter-Interpreter-Manager-Educator (RIME) scheme. Grading scales were described as follows: 4% utilize a pass/fail system, 13% a 3-tier (e.g., Honors/Pass/Fail), 45% 4-tier, 35% 5-tier, and 4% 6+-tier system. There was a trend to higher grades with more tiers available. CONCLUSIONS: Grade inflation continues in the internal medicine clerkship. Almost half of CDs feel that this practice assists students to obtain better residency positions. A minority of programs have a trained core faculty who are responsible for evaluation. About one third have formal grading meetings and use the RIME system; both have been associated with more robust and balanced grading practices. In particular, there is a wide variation between schools in the percentage of students who are awarded the highest grade, which has implications for residency applications. Downstream users of clinical clerkship grades must be fully aware of these variations in grading in order to appropriately judge medical student performance.

The effect of resident duty-hours restrictions on internal medicine clerkship experiences: surveys of medical students and clerkship directors.

UNLABELLED: PHENOMENON: Medical students receive much of their inpatient teaching from residents who now experience restructured teaching services to accommodate the 2011 duty-hour regulations (DHR). The effect of DHR on medical student educational experiences is unknown. We examined medical students' and clerkship directors' perceptions of the effects of the 2011 DHR on internal medicine clerkship students' experiences with teaching, feedback and evaluation, and patient care. APPROACH: Students at 14 institutions responded to surveys after their medicine clerkship or subinternship. Students who completed their clerkship (n = 839) and subinternship (n = 228) March to June 2011 (pre-DHR historical controls) were compared to clerkship students (n = 895) and subinterns (n = 377) completing these rotations March to June 2012 (post-DHR). Z tests for proportions correcting for multiple comparisons were performed to assess attitude changes. The Clerkship Directors in Internal Medicine annual survey queried institutional members about the 2011 DHR just after implementation. FINDINGS: Survey response rates were 64% and 50% for clerkship students and 60% and 48% for subinterns in 2011 and 2012 respectively, and 82% (99/121) for clerkship directors. Post-DHR, more clerkship students agreed that attendings (p =.011) and interns (p =.044) provided effective teaching. Clerkship students (p =.013) and subinterns (p =.001) believed patient care became more fragmented. The percentage of holdover patients clerkship students (p =.001) and subinterns (p =.012) admitted increased. Clerkship directors perceived negative effects of DHR for students on all survey items. Most disagreed that interns (63.1%), residents (67.8%), or attendings (71.1%) had more time to teach. Most disagreed that students received more feedback from interns (56.0%) or residents (58.2%). Fifty-nine percent felt that students participated in more patient handoffs. INSIGHTS: Students perceive few adverse consequences of the 2011 DHR on their internal medicine experiences, whereas their clerkship director educators have negative perceptions. Future research should explore the impact of fragmented patient care on the student-patient relationship and students' clinical skills acquisition.

Stepping Back: How Should Pass/Fail Scoring Influence Step 1 Timing?

ABSTRACT: Although most students complete Step 1 before clerkships, some institutions delay the exam until after clerkships. The change to pass/fail grading adds additional complexity that should be considered when deciding about exam timing. Both early and late administration may affect learning outcomes, learner behavior, student well-being, and residency match success. Step 1 completion before clerkships promotes learning outcomes (e.g., integration and mastery of foundational material), may encourage students to focus on the curriculum, and may better prepare students for clinical science exams (CSEs). However, delaying the exam ensures that students maintain foundational knowledge and may encourage clinical educators to demonstrate basic science illustrations. An early Step 1 may affect learner behavior by allowing clerkship students to focus on clinical learning. The associated National Board of Medical Examiners performance report may also be used for Step 2 and CSE preparation. However, delaying Step 1 allows greater scheduling flexibility based on developmental milestones. Administration of Step 1 before clerkships removes a significant stressor from the clinical year and decompresses the residency application period. However, a delayed Step 1 reduces the pressure on students to engage in numerous extracurricular and research activities to distinguish themselves due to the pass/fail change. An early Step 1 exam may also lead to improved CSE performance, which is often linked to clerkship honors criteria, an increasingly valuable distinction for residency match success after the change to pass/fail. In contrast, delaying Step 1 is associated with higher first-time pass rates, which may be especially important for students at risk for failure. Medical educators and students should collaboratively approach the question of Step 1 timing, considering these factors within the context of the medical school program, curricular constraints and priorities, and students' individual needs and goals.

Grade inflation in the internal medicine clerkship: a national survey.

BACKGROUND: Grade inflation is a growing concern, but the degree to which it continues to exist in 3rd-year internal medicine (IM) clerkships is unknown. PURPOSE: The authors sought to determine the degree to which grade inflation is perceived to exist in IM clerkships in North American medical schools. METHODS: A national survey of all Clerkship Directors in Internal Medicine members was administered in 2009. The authors assessed key aspects of grading. RESULTS: Response rate was 64%. Fifty-five percent of respondents agreed that grade inflation exists in the Internal Medicine clerkship at their school. Seventy-eight percent reported it as a serious/somewhat serious problem, and 38% noted students have passed the IM clerkship at their school who should have failed. CONCLUSIONS: A majority of clerkship directors report that grade inflation still exists. In addition, many note students who passed despite the clerkship director believing they should have failed. Interventions should be developed to address both of these problems.

The Harvard Medical School Pathways Curriculum: Reimagining Developmentally Appropriate Medical Education for Contemporary Learners.

As the U.S. health care system changes and technology alters how doctors work and learn, medical schools and their faculty are compelled to modify their curricula and teaching methods. In this article, educational leaders and key faculty describe how the Pathways curriculum was conceived, designed, and implemented at Harvard Medical School. Faculty were committed to the principle that educators should focus on how students learn and their ability to apply what they learn in the evaluation and care of patients. Using the best evidence from the cognitive sciences about adult learning, they made major changes in the pedagogical approach employed in the classroom and clinic. The curriculum was built upon 4 foundational principles: to enhance critical thinking and provide developmentally appropriate content; to ensure both horizontal integration between courses and vertical integration between phases of the curriculum; to engage learners, foster curiosity, and reinforce the importance of student ownership and responsibility for their learning; and to support students' transformation to a professional dedicated to the care of their patients and to their obligations for lifelong, self-directed learning.The practice of medicine is rapidly evolving and will undoubtedly change in multiple ways over the career of a physician. By emphasizing personal responsibility, professionalism, and thinking skills over content transfer, the authors believe this curriculum will prepare students not only for the first day of practice but also for an uncertain future in the biological sciences, health and disease, and the nation's health care system, which they will encounter in the decades to come.

Entrustable Professional Activities in Oral Health for Primary Care Providers Based on a Scoping Review.

Despite advances in oral health care, inequalities in oral health outcomes persist due to problems in access. With proper training, primary care providers can mitigate this inequality by providing oral health education, screening, and referral to advanced dental treatment. Diverging sets of oral health competencies and guidelines have been released or endorsed by multiple primary care disciplines. The aim of this study was to transform multiple sets of competencies into Entrustable Professional Activities (EPAs) for oral health integration into primary care training. A scoping review of the literature between January 2000 and December 2016 was conducted according to PRISMA methodology to identify all existing sets of competencies. The following primary care disciplines were included in the search: allopathic/osteopathic medical schools and residency programs in family medicine, internal medicine, and pediatrics; physician assistant programs; and nurse practitioner programs. Competencies were compared using the Health Resources and Services Administration Integration of Oral Health and Primary Care Practice competencies as the foundational set and translated into EPAs. The resulting EPAs were tested with a reactor panel. The scoping review produced 1,466 references, of which 114 were selected for full text review. Fourteen competencies were identified as being central to the integration of oral health into primary care. These were converted to seven EPAs for oral health integration into primary care and were mapped onto Accreditation Council for Graduate Medical Education residency competency domains as well to the Association of American Medical Colleges EPAs for graduating medical students. The resulting EPAs delineate the essential, observable work required of primary care providers to ensure that oral health is treated as a critical determinant of overall health.

Competency-Based Medical Education in the Internal Medicine Clerkship: A Report From the Alliance for Academic Internal Medicine Undergraduate Medical Education Task Force.

As medical educators continue to redefine learning and assessment across the continuum, implementation of competency-based medical education in the undergraduate setting has become a focus of many medical schools. While standards of competency have been defined for the graduating student, there is no uniform approach for defining competency expectations for students during their core clerkship year. The authors describe the process by which an Alliance for Academic Internal Medicine task force developed a paradigm for competency-based assessment of students during their inpatient internal medicine (IM) clerkship. Building on work at the resident and fellowship levels, the task force focused on the development of key learning outcomes as defined by entrustable professional activities (EPAs) that were specific to educational experiences on the IM clerkship, as well as identification of high-priority assessment domains. The work was informed by a national survey of clerkship directors.Six key EPAs emerged: generating a differential diagnosis, obtaining a complete and accurate history and physical exam, obtaining focused histories and clinically relevant physical exams, preparing an oral presentation, interpreting the results of basic diagnostic studies, and providing well-organized clinical documentation. A model for assessment was proposed, with descriptors aligned to the scale of supervision and mapped to Accreditation Council for Graduate Medical Education domains of competence. The proposed paradigm offers a standardized template that may be used across IM clerkships, and which would effectively bridge competency evaluation in the clerkship to fourth-year assessment as well as eventual postgraduate training.

SOAP-V: Introducing a method to empower medical students to be change agents in bending the cost curve.

Medical students must learn how to practice high-value, cost-conscious care. By modifying the traditional SOAP (Subjective-Objective-Assessment-Plan) presentation to include a discussion of value (SOAP-V), we developed a cognitive forcing function designed to promote discussion of high-value, cost-conscious care during patient delivery. The SOAP-V model prompts the student to consider (1) the evidence that supports a test or treatment, (2) the patient's preferences and values, and (3) the financial cost of a test or treatment compared to alternatives. Students report their findings to their teams during patient care rounds. This tool has been successfully used at 3 medical schools. Preliminary results find that students who have been trained in SOAP-V feel more empowered to address the economic healthcare crisis, are more comfortable in initiating discussions about value, and are more likely to consider potential costs to the healthcare system.

Blueprint for an Undergraduate Primary Care Curriculum.

In light of the increasing demand for primary care services and the changing scope of health care, it is important to consider how the principles of primary care are taught in medical school. While the majority of schools have increased students' exposure to primary care, they have not developed a standardized primary care curriculum for undergraduate medical education. In 2013, the authors convened a group of educators from primary care internal medicine, pediatrics, family medicine, and medicine-pediatrics, as well as five medical students to create a blueprint for a primary care curriculum that could be integrated into a longitudinal primary care experience spanning undergraduate medical education and delivered to all students regardless of their eventual career choice.The authors organized this blueprint into three domains: care management, specific areas of content expertise, and understanding the role of primary care in the health care system. Within each domain, they described specific curriculum content, including longitudinality, generalism, central responsibility for managing care, therapeutic alliance/communication, approach to acute and chronic care, wellness and prevention, mental and behavioral health, systems improvement, interprofessional training, and population health, as well as competencies that all medical students should attain by graduation.The proposed curriculum incorporates important core features of doctoring, which are often affirmed by all disciplines but owned by none. The authors argue that primary care educators are natural stewards of this curriculum content and can ensure that it complements and strengthens all aspects of undergraduate medical education.