A multispecialty ethnographic study of clinical competency committees (CCCs).

PURPOSE: Clinical competency committees (CCCs) assess residents' performance on their specialty specific milestones, however there is no 'one-size fits all' blueprint for accomplishing this. Thus, CCCs have had to develop their own procedures. The goal of this study was to examine these efforts to assist new programs embarking on this venture and established programs looking to improve their CCC practices and processes. METHODS: We purposefully sampled CCCs across multiple specialties and institutions. Data from three sources were triangulated: (1) online demographic survey, (2) ethnographic observations of CCC meetings and (3) post-observation semi-structured interviews with the program director and/or CCC chairperson. Template analysis was used to build the coding structure. RESULTS: Sixteen observations were completed with 15 different CCCs at 9 institutions. Three main thematic categories that impact the operations of CCCs emerged: (1) Membership structure and members roles, (2) Roles of the CCC in residency and 3) CCC processes, including trainee presentation to the committee and decision-making. While effective practices were observed, substantial variation existed in all three thematic areas. CONCLUSIONS: While CCCs used some known effective practices, substantial variation in structure and processes was notable across CCCs. Future work should explore the impact of this variation on educational outcomes.

A Call to Action From the California Consortium for the Assessment of Clinical Competence: Making the Case for Regional Collaboration.

The discontinuation of the United States Medical Licensing Examination Step 2 Clinical Skills Examination emphasizes the need for other reliable standardized assessments of medical student clinical skills. For 30 years, the California Consortium for the Assessment of Clinical Competence (CCACC) has collaborated in the development of clinical skills assessments and has become a valuable resource for clinicians, standardized patient educators, psychometricians, and medical educators. There are many merits to strong multi-institutional partnerships, including the integration of data across multiple schools to provide feedback to both students and curricula, pooled test performance statistics for analysis and quality assurance, shared best practices and resources, individual professional development, and opportunities for research and scholarship. The infrastructure of the CCACC allows member schools to adapt to a changing medical landscape, from emerging trends in clinical medicine to the limitations imposed by a global pandemic. In the absence of a national examination, there is now a greater need for all medical schools to develop a comprehensive, dynamic, and psychometrically sound assessment that accurately evaluates clinical skills. Medical schools working together in regional consortia have the opportunity to create and implement innovative and robust assessments that evaluate a wide range of clinical skills, ensure that medical students have met an expected level of clinical competency before graduation, and provide a framework that contributes to ongoing efforts for the development of new national clinical skills standards.

Development of Learning Objectives to Guide Enhancement of Chronic Disease Prevention and Management Curricula in Undergraduate Medical Education.

Phenomenon: Chronic disease is a leading cause of death and disability in the United States. With an increase in the demand for healthcare and rising costs related to chronic care, physicians need to be better trained to address chronic disease at various stages of illness in a collaborative and cost-effective manner. Specific and measurable learning objectives are key to the design and evaluation of effective training, but there has been no consensus on chronic disease learning objectives appropriate to medical student education. Approach: Wagner's Chronic Care Model (CCM) was selected as a theoretical framework to guide development of an enhanced chronic disease prevention and management (CDPM) curriculum. Findings of a literature review of CDPM competencies, objectives, and topical statements were mapped to each of the six domains of the CCM to understand the breadth of existing learning topics within each domain. At an in-person meeting, medical educators prepared a survey for the modified Delphi approach. Attendees identified 51 possible learning objectives from the literature review mapping, rephrased the CCM domains as competencies, constructed possible CDPM learning objectives for each competency with the goal of reaching multi-institutional consensus on a limited number of CDPM learning objectives that would be feasible for institutions to use to guide enhancement of medical student curricula related to CDPM. After the meeting, the group developed a survey which included 39 learning objectives. In the study phase of the modified Delphi approach, 32 physician CDPM experts and educators completed an online survey to prioritize the top 20 objectives. The next step occurred at a CDPM interest group in-person meeting with the goal of identifying the top 10 objectives. Findings: The CCM domains were reframed as the following competencies for medical student education: patient self-care management, decision support, clinical information systems, community resources, delivery systems and teams, and health system practice and improvement. Eleven CDPM learning objectives were identified within the six competencies that were most important in developing curriculum for medical students. Insights: These learning objectives cut across education on the prevention and management of individual chronic diseases and frame chronic disease care as requiring the health system science competencies identified in the CCM. They are intended to be used in combination with traditional disease-specific pathophysiology and treatment objectives. Additional efforts are needed to identify specific curricular strategies and assessment tools for each learning objective.

Using Interactive Learning Modules to Teach Value-Based Health Care to Health Professions Trainees Across the United States.

PROBLEM: Despite prominent calls to incorporate value-based health care (VBHC) into medical education, there is still a global need for robust programs to teach VBHC concepts throughout health professions training. APPROACH: In June 2017, Dell Medical School released the first collection (three modules) of a set of free interactive online learning modules, which aim to teach the basic foundations of VBHC to health professions learners at any stage of training and can be incorporated across diverse educational settings. These modules were designed by an interprofessional team based on principles of cognitive engagement for active learning. OUTCOMES: From June 2017 to September 2018, the website received 130,098 pageviews from 8,546 unique users (2,072 registered users), representing 45 states in the United States and 10 foreign countries. As of October 15, 2018, 568 (27%) of registered users completed modules 1-3. Five-hundred thirty-five of these users completed a survey (94% response rate). Nearly all (484/535; 90%) reported overall satisfaction with the curriculum, 522/535 (98%) agreed "after completing the modules, I can define value in health care," and 520/535 (97%) agreed "after completing the modules, I can provide examples of low- and high-value care." Second-year Dell Medical School students reported that they have incorporated value into their clinical clerkships (e.g., by discussing VBHC with peers [43/45; 96%]) as a result of completing the modules. NEXT STEPS: Future plans for the curriculum include the release of additional modules, more robust knowledge assessment, and an expanded learning platform that allows for further community engagement.

Continuity in Undergraduate Medical Education: Mission Not Accomplished.

Evidence is mounting that longitudinal medical student clerkships provide better educational experiences than traditional block clerkship "silos." Education studies across institutions demonstrate positive effects of continuity on medical students, including creating patient-centered learning environments, improving fidelity of evaluations and feedback, improving medical student patient-centeredness, enabling more autonomous functioning in the clinical workplace, and increased recruitment and retention of students into primary care careers. Outcome studies show potential for longitudinal students to add value to patient care. This perspective piece summarizes the current evidence basis for longitudinal clerkships broken down by Kirkpatrick level (reactions, perceptions/attitudes, knowledge, behaviors, and patient benefits). Despite this evidence, expansion of longitudinal clerkships has been slow-i.e., fewer than half of current US medical schools offer one. While more recent curricular innovations center around Entrustable Professional Activities (EPAs), there are clear opportunities for medical schools to use longitudinal clerkships as a lens through which EPAs can be effectively evaluated. This perspective highlights the synergy between longitudinal clerkships and EPAs, showing that successful implementation of the former should empower the latter. While large, complex educational interventions are daunting tasks, change is needed. Regulatory organizations should mandate continuity-focused experiences for US medical graduates.

Faculty development to enhance humanistic teaching and role modeling: a collaborative study at eight institutions.

BACKGROUND: There is increased emphasis on practicing humanism in medicine but explicit methods for faculty development in humanism are rare. OBJECTIVE: We sought to demonstrate improved faculty teaching and role modeling of humanistic and professional values by participants in a multi-institutional faculty development program as rated by their learners in clinical settings compared to contemporaneous controls. DESIGN: Blinded learners in clinical settings rated their clinical teachers, either participants or controls, on the previously validated 10-item Humanistic Teaching Practices Effectiveness (HTPE) questionnaire. PARTICIPANTS: Groups of 7-9 participants at 8 academic medical centers completed an 18-month faculty development program. Participating faculty were chosen by program facilitators at each institution on the basis of being promising teachers, willing to participate in the longitudinal faculty development program. INTERVENTION: Our 18-month curriculum combined experiential learning of teaching skills with critical reflection using appreciative inquiry narratives about their experiences as teachers and other reflective discussions. MAIN MEASURES: The main outcome was the aggregate score of the ten items on the questionnaire at all institutions. KEY RESULTS: The aggregate score favored participants over controls (P = 0.019) independently of gender, experience on faculty, specialty area, and/or overall teaching skills. CONCLUSIONS: Longitudinal, intensive faculty development that employs experiential learning and critical reflection likely enhances humanistic teaching and role modeling. Almost all participants completed the program. Results are generalizable to other schools.

Improving medical literature sourcing by first-year medical students in problem-based learning: outcomes of early interventions.

PURPOSE: To describe and report outcomes of interventions implemented in the preclerkship curriculum at the David Geffen School of Medicine at UCLA to guide students toward use of high-quality information sources and build a foundation for developing fluency in applying primary medical literature to answer clinical questions. METHOD: The authors introduced three phases of change to instruction in literature searching and sourcing for beginning medical students writing learning issue essays: in phase 1 (2003-2006), students were introduced to online resources during orientation week and received a lecture on high-yield literature searching midway through their first curricular block; in phase 2 (2007-2008), the high-yield lecture shifted to orientation week, and a resource matrix and librarian-guided workshop on locating authoritative sources were added; and in phase 3 (2009), peer evaluation and collaboration were implemented. To track changes in sourcing skills, the authors analyzed 3,199 references from 665 essays written by 465 first-year students for two problem-based learning (PBL) cases during the first block of one representative year per phase (2006, 2008, 2009). RESULTS: Over the study period, the authors found significantly increased citations to peer-reviewed journal articles and guidelines and decreased citations to general public Web sites and highly abstracted resources. Peer feedback and collaboration in phase 3 were associated with maintenance of these gains. CONCLUSIONS: Early introduction of instruction on medical literature searching and sourcing, a librarian-guided workshop, and peer collaboration and feedback improved the quality of references cited by students in PBL essays during their first curricular block.

Longitudinal continuity experiences can repair disconnects in the core clerkships for medical students.

The authors describe fundamental changes that have occurred in academic health centers since the 1990 s that have caused an increasingly fragmented experience during core clerkships where medical students risk disconnection from faculty mentors, residents, and patients. Longitudinal "continuity" clinical experiences may constitute a strategy for restoring some of the historic learning conditions. In this issue, Myhre and colleagues and Woloschuk and colleagues compare the performance of students who completed a longitudinal integrated clerkship with the performance of their peers who had completed a traditional rotation-based clerkship year and find that the results are comparable in medical school and after the first year of family medicine residency training. In addition, the authors of this commentary offer observations from their own experience with adding continuity options to traditional core clinical clerkships, with the goal of helping readers understand the range of opportunities and challenges that such initiatives entail.

Clinical clerkship timing revisited: Support for non-uniform sequencing.

BACKGROUND: The logistical necessity of students taking required clinical clerkship rotations in non-uniform sequences may have significant consequences on performance. AIMS: To investigate (1) the impact of previous clinical clerkship experience and the national licensing examination (USMLE Step 1) rankings on end-of-clerkship overall skills assessments and (2) the effect of clinical clerkship order on end-of-year objective structured clinical examination (OSCE) performance. METHOD: The core clinical phase of UCLA consists at six clinical clerkships during a 48-week continuum. The clerkships are structured in two different tracks with different rotation order. Clinical performance scores were analyzed for 124 year-3 students in the two different tracks. RESULTS: Performance, as reviewed on a standardized clinical clerkship evaluation form by faculty and residents, improved significantly across the clinical year, regardless of track suggesting an accumulated advantage of previous experiences. There were no significant differences between tracks on the OSCE. CONCLUSIONS: Overall clinical skills are more directly impacted by the time-of-year and not order whereas knowledge of specific specialties may be impacted by the order rotations that are taken. While this may not be obvious to students, perhaps we should share these results for their use in tracking their personal growth in clinical skills.

Numerical Versus Pass/Fail Scoring on the USMLE: What Do Medical Students and Residents Want and Why?

BACKGROUND: Although the primary purpose of the US Medical Licensing Examination (USMLE) is assessment for licensure, USMLE scores often are used for other purposes, more prominently resident selection. The Committee to Evaluate the USMLE Program currently is considering a number of substantial changes, including conversion to pass/fail scoring. METHODS: A survey was administered to third-year (MS3) and fourth-year (MS4) medical students and residents at a single institution to evaluate opinions regarding pass/fail scoring on the USMLE. RESULTS: Response rate was 59% (n  =  732 of 1249). Reported score distribution for Step 1 was 30% for <220, 38% for 220-240, and 32% for >240, with no difference between MS3s, MS4s, and residents (P  =  .89). Score distribution for Step 2 Clinical Knowledge (CK) was similar. Only 26% of respondents agreed that Step 1 should be pass/fail; 38% agreed with pass/fail scoring for Step 2 CK. Numerical scoring on Step 1 was preferred by respondents who: (1) agreed that the examination gave an accurate estimate of knowledge (odds ratio [OR], 4.23; confidence interval [CI], 2.41-7.43; P < .001); (2) scored >240 (OR, 4.0; CI, 1.92-8.33; P < .001); and (3) felt that acquisition of knowledge might decrease if the examination were pass/fail (OR, 10.15; CI, 3.32-31.02; P < .001). For Step 2 CK, numerical scoring was preferred by respondents who: (1) believed they gained a large amount of knowledge preparing for the examination (OR, 2.63; CI, 1.52-4.76; P < .001); (2) scored >240 (OR, 4.76; CI, 2.86-8.33; P < .001); (3) felt that the amount of knowledge acquired might decrease if it were pass/fail (OR, 28.16; CI, 7.31-108.43; P < .001); and (4) believed their Step 2 CK score was important when applying for residency (OR, 2.37; CI, 1.47-3.84; P < .001). CONCLUSIONS: Students and residents prefer the ongoing use of numerical scoring because they believe that scores are important in residency selection, that residency applicants are advantaged by examination scores, and that scores provide an important impetus to review and solidify medical knowledge.

Assessing patient-centered care: one approach to health disparities education.

BACKGROUND: Patient-centered care has been described as one approach to cultural competency education that could reduce racial and ethnic health disparities by preparing providers to deliver care that is respectful and responsive to the preferences of each patient. In order to evaluate the effectiveness of a curriculum in teaching patient-centered care (PCC) behaviors to medical students, we drew on the work of Kleinman, Eisenberg, and Good to develop a scale that could be embedded across cases in an objective structured clinical examination (OSCE). OBJECTIVE: To compare the reliability, validity, and feasibility of an embedded patient-centered care scale with the use of a single culturally challenging case in measuring students' use of PCC behaviors as part of a comprehensive OSCE. METHODS: A total of 322 students from two California medical schools participated in the OSCE as beginning seniors. Cronbach's alpha was used to assess the internal consistency of each approach. Construct validity was addressed by establishing convergent and divergent validity using the cultural challenge case total score and OSCE component scores. Feasibility assessment considered cost and training needs for the standardized patients (SPs). RESULTS: Medical students demonstrated a moderate level of patient-centered skill (mean = 63%, SD = 11%). The PCC Scale demonstrated an acceptable level of internal consistency (alpha = 0.68) over the single case scale (alpha = 0.60). Both convergent and divergent validities were established through low to moderate correlation coefficients. DISCUSSION: The insertion of PCC items across multiple cases in a comprehensive OSCE can provide a reliable estimate of students' use of PCC behaviors without incurring extra costs associated with implementing a special cross-cultural OSCE. This approach is particularly feasible when an OSCE is already part of the standard assessment of clinical skills. Reliability may be increased with an additional investment in SP training.

A strategy for improving health disparities education in medicine.

INTRODUCTION: A health disparities curriculum that uses evidence-based knowledge rooted in pedagogic theory is needed to educate health care providers to meet the needs of an increasingly diverse U.S. population. DESCRIPTION: The Health Disparities Education: Beyond Cultural Competency Precourse, along with its accompanying Train the Trainer Guide: Health Disparities Education (2008), developed by the Society of General Internal Medicine (SGIM) Disparities Task Force (DTF), is a comprehensive tool to facilitate developing, implementing and evaluating health disparities education. The curriculum includes five modules highlighting several fundamental concepts in health disparities, suggestions for teaching about health disparities in a wide range of settings and strategies for curriculum evaluation. The modules are Disparities Foundations, Teaching Disparities in the Clinical Setting, Disparities Beyond the Clinical Setting, Teaching about Disparities Through Community Involvement, and Curriculum Evaluation. EVALUATION: All five modules were delivered as a precourse at the 31st Annual SGIM Annual Meeting in Pittsburgh, PA and received the "Best Precourse Award". This award is given to the most highly rated precourse based on participant evaluations. The modules have also been adapted into a web-based guide that has been downloaded at least 59 times. CONCLUSION: Ultimately, the modules are designed to develop a professional commitment to eliminating racial and ethnic disparities in health care quality, promote an understanding of the role of health care providers in reducing health care disparities through comprehensive education and training, and provide a framework with which providers can address the causes of disparities in various educational settings.

A framework for developing, implementing, and evaluating a cancer survivorship curriculum for medical students.

BACKGROUND: Cancer survivorship care is not adequately addressed in current medical school curricula. OBJECTIVES: To develop, implement, and evaluate a modular cancer survivorship curriculum that is portable to other educational settings and is designed to provide medical students with a foundation of knowledge, attitudes, and skills related to care for cancer survivors. PROGRAM DESCRIPTION: An expert consensus panel developed a set of learning objectives related to cancer survivorship to guide the development of educational modules, such as computer-based self-instructional modules, problem-based learning cases, videos, and clinical exercises. Course and clerkship chairs were directly involved in the development and implementation of the modules. EVALUATION: A cohort study with a historical control group demonstrated that fourth-year medical students increased their knowledge in survivorship issues and their self-reported level of comfort in care activities compared to similar students who did not receive the survivorship curriculum. CONCLUSIONS: Our framework resulted in a cancer survivorship curriculum that was implemented in a modular manner across the medical curriculum that improved learning and that is potentially portable to other educational settings.

No content without context: integrating basic, clinical, and social sciences in a pre-clerkship curriculum.

BACKGROUND: The basic science curricula in medical schools ultimately succeed or fail at the bedside when students must draw on their pre-clerkship experiences as they learn to form nuanced clinical decisions. Given this expectation, learning context becomes as decisive as content in determining students' recall and application. AIMS: Using the pre-clerkship medical curriculum at the University of California, Los Angeles, as an example, we illustrate how traditional biomedical sciences can be integrated with clinical sciences in a comprehensive foundational curriculum following curricular design features and teaching methods based on learning principles from cognitive psychology and education. METHODS: Multiple planning teams of faculty and students collaborated in the design of the Human Biology and Disease (HB&D) curriculum. Broad participation, careful selection of course chairs, the assistance of educational consultants, ongoing oversight structures, and faculty development were used to develop and sustain the curriculum. RESULTS: The resulting HB&D curriculum features an interdisciplinary spiral block structure including interactive lecture formats, integrative formative and summative examinations, self- and peer-taught laboratories, and problem-based learning with innovative variations. CONCLUSION: Our fully integrated, spiral, pre-clerkship curriculum built on repeating interdisciplinary blocks and longitudinal threads has yielded encouraging results as well as some specific innovations that other schools or individual teachers may find valuable to adapt for use in their own settings.

Preparedness for caring of cancer survivors: a multi-institutional study of medical students and oncology fellows.

BACKGROUND: Despite recent advances in cancer survivorship knowledge and care, most medical schools lack a comprehensive survivorship curriculum, potentially leaving students ill-prepared for caring of survivors. METHODS: A total of 211 students and 22 oncology fellows in 3 institutions completed a questionnaire assessing knowledge and experience in survivorship care. RESULTS: Medical students and oncology fellows lack knowledge in key survivorship issues. Students were exposed to cancer survivors frequently in medical school but only half received instruction or practiced critical components of survivorship care. CONCLUSIONS: Improvement of both undergraduate and postgraduate training in survivorship care is urgently warranted.

The relationship between medical students' knowledge, confidence, experience, and skills related to colorectal cancer screening.

BACKGROUND: Medical student colorectal cancer prevention education is crucial to improving cancer screening rates. METHODS: We surveyed 146 medical students about their knowledge, confidence, and experience with colorectal cancer screening. We then used a multivariate general linear model to assess the relationships between these variables and colorectal cancer screening skills as measured in a standardized patient evaluation. RESULTS: Type and amount of experience providing colorectal cancer screening counseling predicted student performance in the standardized patient encounter, although knowledge and confidence did not. CONCLUSIONS: Increased practice performing cancer screening may improve medical students' ability to implement cancer prevention strategies with patients.