"It's All About the Trust And Building A Foundation:" Evaluation of a Longitudinal Medical Student Coaching Program.

Coaching is increasingly implemented in medical education to support learners' growth, learning, and wellbeing. Data demonstrating the impact of longitudinal coaching programs are needed.We developed and evaluated a comprehensive longitudinal medical student coaching program designed to achieve three aims for students: fostering personal and professional development, advancing physician skills with a growth mindset, and promoting student wellbeing and belonging within an inclusive learning community. We also sought to advance coaches' development as faculty through satisfying education roles with structured training. Students meet with coaches weekly for the first 17 months of medical school for patient care and health systems skills learning, and at least twice yearly throughout the remainder of medical school for individual progress and planning meetings and small-group discussions about professional identity. Using the developmental evaluation framework, we iteratively evaluated the program over the first five years of implementation with multiple quantitative and qualitative measures of students' and coaches' experiences related to the three aims.The University of California, San Francisco, School of Medicine, developed a longitudinal coaching program in 2016 for medical students alongside reform of the four-year curriculum. The coaching program addressed unmet student needs for a longitudinal, non-evaluative relationship with a coach to support their development, shape their approach to learning, and promote belonging and community.In surveys and focus groups, students reported high satisfaction with coaching in measures of the three program aims. They appreciated coaches' availability and guidance for the range of academic, personal, career, and other questions they had throughout medical school. Students endorsed the value of a longitudinal relationship and coaches' ability to meet their changing needs over time. Students rated coaches' teaching of foundational clinical skills highly. Students observed coaches learning some clinical skills with them - skills outside a coach's daily practice. Students also raised some concerns about variability among coaches. Attention to wellbeing and belonging to a learning community were program highlights for students. Coaches benefited from relationships with students and other coaches and welcomed the professional development to equip them to support all student needs.Students perceive that a comprehensive medical student coaching program can achieve aims to promote their development and provide support. Within a non-evaluative longitudinal coach relationship, students build skills in driving their own learning and improvement. Coaches experience a satisfying yet challenging role. Ongoing faculty development within a coach community and funding for the role seem essential for coaches to fulfill their responsibilities.

Differences in Narrative Language in Evaluations of Medical Students by Gender and Under-represented Minority Status.

BACKGROUND: In varied educational settings, narrative evaluations have revealed systematic and deleterious differences in language describing women and those underrepresented in their fields. In medicine, limited qualitative studies show differences in narrative language by gender and under-represented minority (URM) status. OBJECTIVE: To identify and enumerate text descriptors in a database of medical student evaluations using natural language processing, and identify differences by gender and URM status in descriptions. DESIGN: An observational study of core clerkship evaluations of third-year medical students, including data on student gender, URM status, clerkship grade, and specialty. PARTICIPANTS: A total of 87,922 clerkship evaluations from core clinical rotations at two medical schools in different geographic areas. MAIN MEASURES: We employed natural language processing to identify differences in the text of evaluations for women compared to men and for URM compared to non-URM students. KEY RESULTS: We found that of the ten most common words, such as "energetic" and "dependable," none differed by gender or URM status. Of the 37 words that differed by gender, 62% represented personal attributes, such as "lovely" appearing more frequently in evaluations of women (p < 0.001), while 19% represented competency-related behaviors, such as "scientific" appearing more frequently in evaluations of men (p < 0.001). Of the 53 words that differed by URM status, 30% represented personal attributes, such as "pleasant" appearing more frequently in evaluations of URM students (p < 0.001), and 28% represented competency-related behaviors, such as "knowledgeable" appearing more frequently in evaluations of non-URM students (p < 0.001). CONCLUSIONS: Many words and phrases reflected students' personal attributes rather than competency-related behaviors, suggesting a gap in implementing competency-based evaluation of students. We observed a significant difference in narrative evaluations associated with gender and URM status, even among students receiving the same grade. This finding raises concern for implicit bias in narrative evaluation, consistent with prior studies, and suggests opportunities for improvement.

Outcomes of a health coaching intervention delivered by medical students for older adults with uncontrolled type 2 diabetes.

Effective strategies are needed to address the health behaviors of older patients with diabetes. One approach is health coaching, the practice of health education and health promotion through a structured partnership designed to enhance well-being and facilitate the achievement of individuals' health-related goals. The aim of this study was to describe the development of a pilot health coaching curriculum, investigate its effects on geriatric patient outcomes, and examine qualitative feedback by older patients and medical students to the curriculum. This mixed-methods study involved 29 first-year medical students randomly paired with 29 older adults with uncontrolled Type 2 diabetes. Health-related quality of life (HRQoL), stage of change movement, diabetes knowledge, locus of control, Body Mass Index (BMI), and glycosylated hemoglobin (HbA1c) were assessed. Focus groups were used to evaluate patients' and medical students' experiences. Results showed significant increases in patients' HRQoL and stage of change for exercise improved significantly over time. There were no significant changes in stage of change for healthy diet and medication, diabetes knowledge, BMI, and HbA1c from baseline to end of study. Focus group data indicated positive responses by older patients and the medical students. A health coaching curriculum may improve patient outcomes and can provide medical students the skills needed to provide compassionate care for geriatric patients.

Using a Curricular Vision to Define Entrustable Professional Activities for Medical Student Assessment.

BACKGROUND: The new UCSF Bridges Curriculum aims to prepare students to succeed in today's health care system while simultaneously improving it. Curriculum redesign requires assessment strategies that ensure that graduates achieve competence in enduring and emerging skills for clinical practice. AIM: To design entrustable professional activities (EPAs) for assessment in a new curriculum and gather evidence of content validity. SETTING: University of California, San Francisco, School of Medicine. PARTICIPANTS: Nineteen medical educators participated; 14 completed both rounds of a Delphi survey. PROGRAM DESCRIPTION: Authors describe 5 steps for defining EPAs that encompass a curricular vision including refining the vision, defining draft EPAs, developing EPAs and assessment strategies, defining competencies and milestones, and mapping milestones to EPAs. A Q-sort activity and Delphi survey involving local medical educators created consensus and prioritization for milestones for each EPA. PROGRAM EVALUATION: For 4 EPAs, most milestones had content validity indices (CVIs) of at least 78 %. For 2 EPAs, 2 to 4 milestones did not achieve CVIs of 78 %. DISCUSSION: We demonstrate a stepwise procedure for developing EPAs that capture essential physician work activities defined by a curricular vision. Structured procedures for soliciting faculty feedback and mapping milestones to EPAs provide content validity.

The Clinical Microsystems Clerkship at University of California, San Francisco: Integrating Clinical Skills and Health Systems Improvement for Early Medical Students.

PROBLEM: Medical educators recognize that partnering actively with health system leaders closes significant health care experience, quality, and outcomes gaps. Medical schools have explored innovations training physicians to care for both individual patients and populations while improving systems of care. Yet, early medical student education fails to include systems improvement as foundational skills. When health systems science is taught, it is often separated from core clinical skills. APPROACH: The Clinical Microsystems Clerkship at the University of California, San Francisco School of Medicine, launched in 2016, integrates clinical skills training with health systems improvement from the start of medical school. Guided by communities of practice and workplace learning principles, it embeds first-year and second-year students in longitudinal clinical microsystems with physician coaches and interprofessional clinicians one day per week. Students learn medical history, physical examination, patient communication, interprofessional teamwork, and health systems improvement. Assessments include standardized patient examinations and improvement project reports. Program outcome measures include student satisfaction and attitudes, clinical skills performance, and evidence of systems improvement learning, including dissemination and scholarship. OUTCOMES: Students reported high satisfaction (first-year, 4.10; second-year, 4.29, on a scale of 1-5) and value (4.14) in their development as physicians. Clinical skills assessment accuracy was high (70%-96%). Guided by interprofessional clinicians across 15 departments, students completed 258 improvement projects in 3 health systems (academic, safety net, Veterans Affairs). Sample projects reduced disparities in hypertension, improved opiate safety, and decreased readmissions. Graduating students reported both clinical skills and health systems knowledge as important to physician success, patient experience, and clinical outcomes (4.73). Most graduates discussed their projects in residency applications (85%) and disseminated related papers and presentations (54%). NEXT STEPS: Integrating systems improvement, interprofessional teamwork, and clinical skills training can redefine early medical student education. Health system perspectives, long-term outcomes, and sustainability merit further exploration.

Artificial intelligence education: An evidence-based medicine approach for consumers, translators, and developers.

Current and future healthcare professionals are generally not trained to cope with the proliferation of artificial intelligence (AI) technology in healthcare. To design a curriculum that caters to variable baseline knowledge and skills, clinicians may be conceptualized as "consumers", "translators", or "developers". The changes required of medical education because of AI innovation are linked to those brought about by evidence-based medicine (EBM). We outline a core curriculum for AI education of future consumers, translators, and developers, emphasizing the links between AI and EBM, with suggestions for how teaching may be integrated into existing curricula. We consider the key barriers to implementation of AI in the medical curriculum: time, resources, variable interest, and knowledge retention. By improving AI literacy rates and fostering a translator- and developer-enriched workforce, innovation may be accelerated for the benefit of patients and practitioners.

We Have No Choice but to Transform: The Future of Medical Education After the COVID-19 Pandemic.

Medical education exists to prepare the physician workforce that our nation needs, but the COVID-19 pandemic threatened to disrupt that mission. Likewise, the national increase in awareness of social justice gaps in our country pointed out significant gaps in health care, medicine, and our medical education ecosystem. Crises in all industries often present leaders with no choice but to transform-or to fail. In this perspective, the authors suggest that medical education is at such an inflection point and propose a transformational vision of the medical education ecosystem, followed by a 10-year, 10-point plan that focuses on building the workforce that will achieve that vision. Broad themes include adopting a national vision; enhancing medicine's role in social justice through broadened curricula and a focus on communities; establishing equity in learning and processes related to learning, including wellness in learners, as a baseline; and realizing the promise of competency-based, time-variable training. Ultimately, 2020 can be viewed as a strategic inflection point in medical education if those who lead and regulate it analyze and apply lessons learned from the pandemic and its associated syndemics.

A qualitative approach to Bayes' theorem.

While decisions made according to Bayes' theorem are the academic normative standard, the theorem is rarely used explicitly in clinical practice. Yet the principles can be followed without intimidating mathematics. To do so, one can first categorise the prior-probability of the disease being tested for as very unlikely (less likely than 10%), unlikely (10-33%), uncertain (34-66%), likely (67-90%) or very likely (more likely than 90%). Usually, for disorders that are very unlikely or very likely, no further testing is needed. If the prior probability is unlikely, uncertain or likely, a test and a Bayesian-inspired update process incorporating the result can help. A positive result of a good test increases the probability of the disorder by one likelihood category (eg, from uncertain to likely) and a negative test decreases the probability by one category. If testing is needed to escape the extremes of likelihood (eg, a very unlikely but particularly dangerous condition or in the circumstance of population screening, or a very likely condition with a particularly noxious treatment), two tests may be needed to achieve. Negative results of tests with sensitivity ≥99% are sufficient to rule-out a diagnosis; positive results of tests with specificity ≥99% are sufficient to rule-in a diagnosis. This method overcomes some common heuristic errors: ignoring the base rate, probability adjustment errors and order effects. The simplicity of the method, while still adhering to the basic principles of Bayes' theorem, has the potential to increase its application in clinical practice.

A behavioral and systems view of professionalism.

Professionalism may not be sufficient to drive the profound and far-reaching changes needed in the US health care system, but without it, the health care enterprise is lost. Formal statements defining professionalism have been abstract and principle based, without a clear description of what professional behaviors look like in practice. This article proposes a behavioral and systems view of professionalism that provides a practical approach for physicians and the organizations in which they work. A more behaviorally oriented definition makes the pursuit of professionalism in daily practice more accessible and attainable. Professionalism needs to evolve from being conceptualized as an innate character trait or virtue to sophisticated competencies that can and must be taught and refined over a lifetime of practice. Furthermore, professional behaviors are profoundly influenced by the organizational and environmental context of contemporary medical practice, and these external forces need to be harnessed to support--not inhibit--professionalism in practice. This perspective on professionalism provides an opportunity to improve the delivery of health care through education and system-level reform.

The Consequences of Structural Racism on MCAT Scores and Medical School Admissions: The Past Is Prologue.

Those in medical education have a responsibility to prepare a physician workforce that can serve increasingly diverse communities, encourage healthy changes in patients, and advocate for the social changes needed to advance the health of all. The authors of this Perspective discuss many of the likely causes of the observed differences in mean Medical College Admission Test (MCAT) scores between students from groups well represented in medicine and those from groups underrepresented in medicine. The lower mean MCAT scores of underrepresented groups can present challenges to diversifying the physician workforce if medical schools only admit those applicants with the highest MCAT scores. The authors review the psychometric literature, which showed no evidence of bias in the exam, and note that the differences in mean MCAT scores between racial and ethnic groups are similar to those in other measures of academic achievement and performance on high-stakes tests.The authors then describe the ways in which structural racism in the United States has contributed to differences in achievement for underrepresented students compared with well-represented students. These differences are not due to differences in aptitude but to differences in opportunities. The authors describe the widespread consequences of structural racism on economic success, educational opportunity, and bias in the educational environment. They close with 3 recommendations for medical schools that may mitigate the consequences of structural racism while maintaining academic standards and admitting students likely to succeed. Adopting these recommendations may help the medical profession build the diverse physician workforce needed to serve communities today.

Medical Education's Wicked Problem: Achieving Equity in Assessment for Medical Learners.

Despite a lack of intent to discriminate, physicians educated in U.S. medical schools and residency programs often take actions that systematically disadvantage minority patients. The approach to assessment of learner performance in medical education can similarly disadvantage minority learners. The adoption of holistic admissions strategies to increase the diversity of medical training programs has not been accompanied by increases in diversity in honor societies, selective residency programs, medical specialties, and medical school faculty. These observations prompt justified concerns about structural and interpersonal bias in assessment. This manuscript characterizes equity in assessment as a "wicked problem" with inherent conflicts, uncertainty, dynamic tensions, and susceptibility to contextual influences. The authors review the underlying individual and structural causes of inequity in assessment. Using an organizational model, they propose strategies to achieve equity in assessment and drive institutional and systemic improvement based on clearly articulated principles. This model addresses the culture, systems, and assessment tools necessary to achieve equitable results that reflect stated principles. Three components of equity in assessment that can be measured and evaluated to confirm success include intrinsic equity (selection and design of assessment tools), contextual equity (the learning environment in which assessment occurs), and instrumental equity (uses of assessment data for learner advancement and selection and program evaluation). A research agenda to address these challenges and controversies and demonstrate reduction in bias and discrimination in medical education is presented.

Toward Creating Equity in Awards Received During Medical School: Strategic Changes at One Institution.

Membership in the Alpha Omega Alpha Honor Medical Society (AΩA) is a widely recognized achievement valued by residency selection committees and employers. Yet research has shown selection favors students from racial/ethnic groups not underrepresented in medicine (not-UIM). The authors describe efforts to create equity in AΩA selection at the University of California, San Francisco, School of Medicine, through implementation of a holistic selection process, starting with the class of 2017, and present outcomes.Informed by the definition of holistic review, medical school leaders applied strategic changes grounded in evidence on inclusion, mitigating bias, and increasing opportunity throughout the AΩA selection process. These addressed increasing selection committee diversity, revising selection criteria and training committee members to review applications using a new instrument, broadening student eligibility and inviting applications, reviewing blinded applications, and making final selection decisions based on review and discussion of a rank-ordered list of students that equally weighted academic achievement and professional contributions.The authors compared AΩA eligibility and selection outcomes for 3 classes (2014-2016) during clerkship metric-driven selection, which prioritized academic achievement, and 3 classes (2017-2019) during holistic selection. During clerkship metric-driven selection, not-UIM students were 4 times more likely than UIM students to be eligible for AΩA (P = .001) and 3 times more likely to be selected (P = .001). During holistic selection, not-UIM students were 2 times more likely than UIM students to be eligible for AΩA (P = .001); not-UIM and UIM students were similarly likely to be selected (odds ratio = .7, P = .12)This new holistic selection process created equity in representation of UIM students among students selected for AΩA. Centered on equity pedagogy, which advocates dismantling structures that create inequity, this holistic selection process has implications for creating equity in awards selection during medical education.