Social network analysis of publication collaboration of accelerating change in MedEd consortium.

INTRODUCTION: The American Medical Association formed the Accelerating Change in Medical Education Consortium through grants to effect change in medical education. The dissemination of educational innovations through scholarship was a priority. The objective of this study was to explore the patterns of collaboration of educational innovation through the consortium's publications. METHOD: Publications were identified from grantee schools' semi-annual reports. Each publication was coded for the number of citations, Altmetric score, domain of scholarship, and collaboration with other institutions. Social network analysis explored relationships at the midpoint and end of the grant. RESULTS: Over five years, the 32 Consortium institutions produced 168 publications, ranging from 38 papers from one institution to no manuscripts from another. The two most common domains focused on health system science (92 papers) and competency-based medical education (30 papers). Articles were published in 54 different journals. Forty percent of publications involved more than one institution. Social network analysis demonstrated rich publishing relationships within the Consortium members as well as beyond the Consortium schools. In addition, there was growth of the network connections and density over time. CONCLUSION: The Consortium fostered a scholarship network disseminating a broad range of educational innovations through publications of individual school projects and collaborations.

Expanding innovation from undergraduate to graduate medical education: A path of continuous professional development.

A hundred years after the Flexner report laid the foundation for modern medical education, a number of authors commemorated the occasion by commenting on how the medical education system had to change once more to serve 21st century patients. Experts called for standardized outcomes and individualized learner pathways, integration of material across traditional areas, attention to an environment of inquiry, and professional identity formation. The medical education community responded and much has been achieved in the last decade, but much work remains to be done. In this paper we outline how the American Medical Association Accelerating Change in Medical Education Consortium, launched in 2013 through significant funding of transformation projects in undergraduate medical education, expanded its work into graduate medical education, and we look to the future of innovation in medical education.

Realizing the vision of the Lancet Commission on Education of Health Professionals for the 21st Century: Transforming medical education through the Accelerating Change in Medical Education Consortium.

In the last two decades, prompted by the anticipated arrival of the 21st Century and on the centenary of the publication of the Flexner Report, many in medical education called for change to address the expanding chasm between the requirements of the health care system and the educational systems producing the health care workforce. Calls were uniform. Curricular content was missing. There was a mismatch in where people trained and where they were needed to practice, legacy approaches to pedagogical methods that needed to be challenged, an imbalance in diversity of trainees, and a lack of research on educational outcomes, resulting in a workforce that was described as ill-equipped to provide health care in the current and future environment. The Lancet Commission on Education of Health Professionals for the 21st Century published a widely acclaimed report in 2010 that called for a complete and authoritative re-examination of health professional education. This paper describes the innovations of the American Medical Association Accelerating Change in Medical Education Consortium schools as they relate to the recommendations of the Lancet Commission. We outline the successes, challenges, and lessons learned in working to deeply reform medical education.

Students as catalysts for curricular innovation: A change management framework.

Introduction: The role of medical students in catalyzing and leading curricular change in US medical schools is not well described. Here, American Medical Association student and physician leaders in the Accelerating Change in Medical Education initiative use qualitative methods to better define student leadership in curricular change.Methods: The authors developed case studies describing student leadership in curricular change efforts. Case studies were presented at a national medical education workshop; participants provided worksheet reflections and were surveyed, and responses were transcribed. Kotter's change management framework was used to categorize reported student roles in curricular change. Thematic analysis was used to identify barriers to student engagement and activators to overcome these barriers.Results: Student roles spanned all eight steps of Kotter's change management framework. Barriers to student engagement were related to faculty (e.g. view student roles narrowly), students (e.g. fear change or expect faculty-led curricula), or both (e.g. lack leadership training). Activators were: (1) recruiting collaborative faculty, staff, and students; (2) broadening student leadership roles; (3) empowering student leaders; and (4) recognizing student successes.Conclusions: By applying these activators, medical schools can build robust student-faculty partnerships that maximize collaboration, moving students beyond passive educational consumption to change agency and curricular co-creation.

A Proposed Shared Vision for Leadership Development for all Medical Students: A Call from a Coalition of Diverse Medical Schools.

Issue: Despite clear relevance, need, descriptive literature, and student interest, few schools offer required curriculum to develop leadership skills. This paper outlines a proposed shared vision for leadership development drawn from a coalition of diverse medical schools. We advocate that leadership development is about self (looking inward), teams (not hierarchy), and change (looking outward). We propose that leadership development is for all medical students, not for a subset, and we believe that leadership curricula and programs must be experiential and applied. Evidence: This paper also draws on the current literature and the experience of medical schools participating in the American Medical Association's (AMA) Accelerating Change in Medical Education Consortium, confronts the common arguments against leadership training in medical education, and provides three cross-cutting principles that we believe must each be incorporated in all medical student-centered leadership development programs as they emerge and evolve at medical schools. Implications: By confronting common arguments against leadership training and providing a framework for such training, we give medical educators important tools and insights into developing leadership training for all students at their institutions.

Do Gold Humanism Honor Society Inductees Differ From Their Peers in Empathy, Patient-Centeredness, Tolerance of Ambiguity, Coping Style, and Perception of the Learning Environment?

Construct: Induction into the Gold Humanism Honor Society (GHHS) during medical school is recognized as an indicator of humanistic orientation and behavior. Various attitudes and interpersonal orientations including empathy and patient-centeredness have been posited to translate into behaviors constituting humanistic care. BACKGROUND: To our knowledge there has never been a longitudinal, multi-institutional empirical study of the attitudinal and interpersonal orientations correlated with GHHS membership status. APPROACH: We used the American Medical Association Learning Environment Study (LES) data set to explore attitudinal correlates associated with students whose behaviors are recognized by their peers as being exceptionally humanistic. Specifically, we examined whether empathy, patient-centeredness, tolerance of ambiguity, coping style, and perceptions of the learning environment are associated with GHHS membership status. We further considered to what extent GHHS members arrive in medical school with these attitudinal correlates and to what extent they change and evolve differentially among GHHS members compared to their non-GHHS peers. Between 2011 and 2015, 585 students from 13 North American medical schools with GHHS chapters participated in the LES, a longitudinal cohort study using a battery of validated psychometric measures including the Jefferson Scale of Empathy, Patient-Practitioner Orientation Scale and Tolerance of Ambiguity Questionnaire. In the final survey administration, students self-identified as GHHS inductees or not (non-GHHS). T tests, effect sizes, and longitudinal generalized mixed-effects models examined the differences between GHHS and non-GHHS students. RESULTS: Students inducted into GHHS scored significantly higher on average over 4 years than non-GHHS inductees on clinical empathy, patient-centered beliefs, and tolerance of ambiguity. GHHS students reported higher levels of empathy and patient-centeredness at medical school matriculation. This difference persists in the 4th year of medical school and when controlling for time, race, gender, and school. CONCLUSIONS: GHHS inductees enter medical school with different attitudes and beliefs than their non-GHHS classmates. Although humanistic attitudes and beliefs vary over time during students' 4 years, the gap between the two groups remains constant. Medical schools may want to consider selecting for specific humanistic traits during admissions as well as fostering the development of humanism through curricular interventions.

Medical Student Perceptions of the Learning Environment in Medical School Change as Students Transition to Clinical Training in Undergraduate Medical School.

Phenomenon: The learning environment is the physical, social, and psychological context in which a student learns. A supportive learning environment contributes to student well-being and enhances student empathy, professionalism, and academic success, whereas an unsupportive learning environment may lead to burnout, exhaustion, and cynicism. Student perceptions of the medical school learning environment may change over time and be associated with students' year of training and may differ significantly depending on the student's gender or race/ethnicity. Understanding the changes in perceptions of the learning environment related to student characteristics and year of training could inform interventions that facilitate positive experiences in undergraduate medical education. APPROACH: The Medical School Learning Environment Survey (MSLES) was administered to 4,262 students who matriculated at one of 23 U.S. and Canadian medical schools in 2010 and 2011. Students completed the survey at the end of each year of medical school as part of a battery of surveys in the Learning Environment Study. A mixed-effects longitudinal model, t tests, Cohen's d effect size, and analysis of variance assessed the relationship between MSLES score, year of training, and demographic variables. FINDINGS: After controlling for gender, race/ethnicity, and school, students reported worsening perceptions toward the medical school learning environment, with the worst perceptions in the 3rd year of medical school as students begin their clinical experiences, and some recovery in the 4th year after Match Day. The drop in MSLES scores associated with the transition to the clinical learning environment (-0.26 point drop in addition to yearly change, effect size = 0.52, p < .0001) is more than 3 times greater than the drop between the 1st and 2nd year (0.07 points, effect size = 0.14, p < .0001). The largest declines were from items related to work-life balance and informal student relationships. There was some, but not complete, recovery in perceptions of the medical school learning environment in the 4th year. Insights: Perceptions of the medical school learning environment worsen as students continue through medical school, with a stronger decline in perception scores as students' transition to the clinical learning environment. Students reported the greatest drop in finding time for outside activities and students helping one another in the 3rd year. Perceptions differed based on gender and race/ethnicity. Future studies should investigate the specific features of medical schools that contribute most significantly to student perceptions of the medical school learning environment, both positive and negative, to pinpoint potential interventions and improvements.

Implementation of competency-based medical education: are we addressing the concerns and challenges?

CONTEXT: Competency-based medical education (CBME) has emerged as a core strategy to educate and assess the next generation of physicians. Advantages of CBME include: a focus on outcomes and learner achievement; requirements for multifaceted assessment that embraces formative and summative approaches; support of a flexible, time-independent trajectory through the curriculum; and increased accountability to stakeholders with a shared set of expectations and a common language for education, assessment and regulation. OBJECTIVES: Despite the advantages of CBME, numerous concerns and challenges to the implementation of CBME frameworks have been described, including: increased administrative requirements; the need for faculty development; the lack of models for flexible curricula, and inconsistencies in terms and definitions. Additionally, there are concerns about reductionist approaches to assessment in CBME, lack of good assessments for some competencies, and whether CBME frameworks include domains of current importance. This study will outline these issues and discuss the responses of the medical education community. METHODS: The concerns and challenges expressed are primarily categorised as: (i) those related to practical, administrative and logistical challenges in implementing CBME frameworks, and (ii) those with more conceptual or theoretical bases. The responses of the education community to these issues are then summarised. CONCLUSIONS: The education community has begun to address the challenges involved in implementing CBME. Models and guidance exist to inform implementation strategies across the continuum of education, and focus on the more efficient use of resources and technology, and the use of milestones and entrustable professional activities-based frameworks. Inconsistencies in CBME definitions and frameworks remain a significant obstacle. Evolution in assessment approaches from in vitro task-based methods to in vivo integrated approaches is responsive to many of the theoretical and conceptual concerns about CBME, but much work remains to be done to bring rigour and quality to work-based assessment.

The Accelerating Change in Medical Education Consortium: Key Drivers of Transformative Change.

The American Medical Association's (AMA's) Accelerating Change in Medical Education (ACE) initiative, launched in 2013 to foster advancements in undergraduate medical education, has led to the development and scaling of innovations influencing the full continuum of medical training. Initial grants of $1 million were awarded to 11 U.S. medical schools, with 21 schools joining the consortium in 2016 at a lower funding level. Almost one-fifth of all U.S. MD- and DO-granting medical schools are represented in the 32-member consortium. In the first 5 years, the consortium medical schools have delivered innovative educational experiences to approximately 19,000 medical students, who will provide a potential 33 million patient care visits annually. The core initiative objectives focus on competency-based approaches to medical education and individualized pathways for students, training in health systems science, and enhancing the learning environment. At the close of the initial 5-year grant period, AMA leadership sought to catalogue outputs and understand how the structure of the consortium may have influenced its outcomes. Themes from qualitative analysis of stakeholder interviews as well as other sources of evidence aligned with the 4 elements of the transformational leadership model (inspirational motivation, intellectual stimulation, individualized consideration, and idealized influence) and can be used to inform future innovation interventions. For example, the ACE initiative has been successful in stimulating change at the consortium schools and propagating those innovations broadly, with outputs involving medical students, faculty, medical schools, affiliated health systems, and the broader educational landscape. In summary, the ACE initiative has fostered a far-reaching community of innovation that will continue to drive change across the continuum of medical education.

Assessing the Transition of Training in Health Systems Science From Undergraduate to Graduate Medical Education.

BACKGROUND: The American Medical Association Accelerating Change in Medical Education (AMA-ACE) consortium proposes that medical schools include a new 3-pillar model incorporating health systems science (HSS) and basic and clinical sciences. One of the goals of AMA-ACE was to support HSS curricular innovation to improve residency preparation. OBJECTIVE: This study evaluates the effectiveness of HSS curricula by using a large dataset to link medical school graduates to internship Milestones through collaboration with the Accreditation Council for Graduate Medical Education (ACGME). METHODS: ACGME subcompetencies related to the schools' HSS curricula were identified for internal medicine, emergency medicine, family medicine, obstetrics and gynecology (OB/GYN), pediatrics, and surgery. Analysis compared Milestone ratings of ACE school graduates to non-ACE graduates at 6 and 12 months using generalized estimating equation models. RESULTS: At 6 months both groups demonstrated similar HSS-related levels of Milestone performance on the selected ACGME competencies. At 1 year, ACE graduates in OB/GYN scored minimally higher on 2 systems-based practice (SBP) subcompetencies compared to non-ACE school graduates: SBP01 (1.96 vs 1.82, 95% CI 0.03-0.24) and SBP02 (1.87 vs 1.79, 95% CI 0.01-0.16). In internal medicine, ACE graduates scored minimally higher on 3 HSS-related subcompetencies: SBP01 (2.19 vs 2.05, 95% CI 0.04-0.26), PBLI01 (2.13 vs 2.01; 95% CI 0.01-0.24), and PBLI04 (2.05 vs 1.93; 95% CI 0.03-0.21). For the other specialties examined, there were no significant differences between groups. CONCLUSIONS: Graduates from schools with training in HSS had similar Milestone ratings for most subcompetencies and very small differences in Milestone ratings for only 5 subcompetencies across 6 specialties at 1 year, compared to graduates from non-ACE schools. These differences are likely not educationally meaningful.

Stepping Back: Re-evaluating the Use of the Numeric Score in USMLE Examinations.

There are increasing concerns from medical educators about students' over-emphasis on preparing for a high-stakes licensing examination during medical school, especially the US Medical Licensing Examination (USMLE) Step 1. Residency program directors' use of the numeric score (otherwise known as the three-digit score) on Step 1 to screen and select applicants drive these concerns. Since the USMLE was not designed as a residency selection tool, the use of numeric scores for this purpose is often referred to as a secondary and unintended use of the USMLE score. Educators and students are concerned about USMLE's potentially negative influence on curricular innovation and the role of high-stakes examinations in student and trainee well-being. Changing the score reporting of the examinations from a numeric score to pass/fail has been suggested by some. This commentary first reviews the primary use and secondary uses of the USMLE scores. We then focus on the advantages and disadvantages of the currently reported numeric score using Messick's conceptualization of construct validity as our framework. Finally, we propose a path forward to design a comprehensive, more holistic review of residency candidates.

A Responsible Educational Handover: Improving Communication to Improve Learning.

An important tenet of competency-based medical education is that the educational continuum should be seamless. The transition from undergraduate medical education (UME) to graduate medical education (GME) is far from seamless, however. Current practices around this transition drive students to focus on appearing to be competitively prepared for residency. A communication at the completion of UME-an educational handover-would encourage students to focus on actually preparing for the care of patients. In April 2018, the American Medical Association's Accelerating Change in Medical Education consortium meeting included a debate and discussion on providing learner performance measures as part of a responsible educational handover from UME to GME. In this Perspective, the authors describe the resulting 5 recommendations for developing such a handover: (1) The purpose of the educational handover should be to provide medical school performance data to guide continued improvement in learner ability and performance, (2) the process used to create an educational handover should be philosophically and practically aligned with the learner's continuous quality improvement, (3) the educational handover should be learner driven with a focus on individualized learning plans that are coproduced by the learner and a coach or advisor, (4) the transfer of information within an educational handover should be done in a standardized format, and (5) together, medical schools and residency programs must invest in adequate infrastructure to support learner improvement. These recommendations are shared to encourage implementation of the educational handover and to generate a potential research agenda that can inform policy and best practices.

Didactic and experiential training to teach communication skills: the University of Wisconsin-Madison School of Veterinary Medicine collaborative experience.

Teaching communication skills to veterinary students is recognized as important; however, incorporation of this into an already crowded curriculum is difficult. At the University of Wisconsin-Madison School of Veterinary Medicine we provide mandatory communication lectures to freshmen and sophomores, and offer elective experiential courses to juniors and seniors. Providing both didactic and experiential training allows students to learn and practice communication techniques in a "safe" setting. Our approach to experiential training is unique in that graduate students in counseling psychology (masters and doctoral level) act as "clients" for the juniors, and professional simulated pet owners are hired for digitally captured role-plays with the seniors. A unique inter-professional partnership has been formed between the Schools of Veterinary Medicine, Education (Department of Counseling Psychology), and (Human) Medicine and Public Health to provide this experiential training for our students. The purpose of this article is to describe the communication training program at the University of Wisconsin-Madison School of Veterinary Medicine and to encourage other programs to reach across campus and partner with other colleges with the goal of improving training for all of the individuals involved.

The American Medical Association Medical Education Innovation Challenge: Incorporating the Student Voice Into Medical Education Transformation.

PROBLEM: Medical education needs to evolve to continue producing physicians who are able to meet the needs of diverse patient populations. Students can be a unique source of ideas about medical education transformation. APPROACH: In the fall of 2015, the authors created the American Medical Association Medical Education Innovation Challenge, an incentive-based competition for teams of two to four students. The challenge called for teams to "turn medical education on its head" by proposing a change to some aspect of medical education that would better prepare students to meet the health care needs of the future. OUTCOMES: Teams submitted 154 proposals. Themes from the winning teams and those that received an honorable mention included innovative uses of technology, creating physical spaces to pursue solutions to health care problems, wellness education, and longitudinal learning experiences around health equity and advocacy. The authors invited all teams to submit an abstract of their proposal to be published in an abstract book. The four winning teams and the 24 teams that received an honorable mention and submitted an abstract were surveyed to assess the impact of the challenge. Fifteen teams (54%) responded. Ten of those teams (67%) were implementing their idea or a related innovation to some degree. NEXT STEPS: The American Medical Association continues to run a wide variety of innovation challenges (e.g., Healthier Nation Innovation Challenge, Health Care Interoperability & Innovation Challenge) that draw in diverse stakeholders to solve problems in medical education and the health care system more broadly.

Engaging Medical Students in Leadership Development.

Leadership development plays a critical role in preparing collaborative, systems-based physicians. Medical schools across the globe have dedicated significant effort towards programming for medical student leadership development. Students report a variety of existing leadership opportunities, ranging from formal didactics to leadership positions within the community. Students identify lack of time, funding, and the hierarchy of medicine as significant barriers for engaging in leadership opportunities. Students favor a formal leadership curriculum coupled with hands-on opportunities to practice leadership skills. In order to train medical students to be engaged physician leaders, it is imperative to foster practical opportunities for leadership development.

Beyond the United States Medical Licensing Examination Score: Assessing Competence for Entering Residency.

Assessments of physician learners during the transition from undergraduate to graduate medical education generate information that may inform their learning and improvement needs, determine readiness to move along the medical education continuum, and predict success in their residency programs. To achieve a constructive transition for the learner, residency program, and patients, high-quality assessments should provide meaningful information regarding applicant characteristics, academic achievement, and competence that lead to a suitable match between the learner and the residency program's culture and focus.The authors discuss alternative assessment models that may correlate with resident physician clinical performance and patient care outcomes. Currently, passing the United States Medical Licensing Examination Step examinations provides one element of reliable assessment data that could inform judgments about a learner's likelihood for success in residency. Yet, learner capabilities in areas beyond those traditionally valued in future physicians, such as life experiences, community engagement, language skills, and leadership attributes, are not afforded the same level of influence when candidate selections are made.While promising new methods of screening and assessment-such as objective structured clinical examinations, holistic assessments, and competency-based assessments-have attracted increased attention in the medical education community, currently they may be expensive, be less psychometrically sound, lack a national comparison group, or be complicated to administer. Future research and experimentation are needed to establish measures that can best meet the needs of programs, faculty, staff, students, and, more importantly, patients.