Education Scholarship Assessment Reconsidered: Expansion of Glassick's Criteria to Incorporate Health Equity.

ABSTRACT: Recent events have ignited widespread attention to structural racism and implicit bias throughout the U.S. health care system and medical institutions, resulting in a call for antiracism approaches to advance health equity. Medical education leaders are well positioned to advance health equity, not only through their training of fellows, residents, and medical students, but also in their approach to scholarship. Education scholarship drives innovation and critical evaluation of current practices; it impacts and intersects with multiple factors that have the potential to reduce health inequities. Thus, it is critical to prioritize the assessment of education scholarship through a health equity lens. Medical education scholarly dissemination has markedly expanded over the past 2 to 3 decades, yet medical educators have continued to embrace Boyer's and Glassick and colleagues' definitions of scholarship. The authors propose an approach to medical education scholarship assessment that expands each of Glassick's 6 existing criteria to address health inequities and adds health equity as a seventh criterion. With this, medical educators, researchers, reviewers, and others can consider how education scholarship affects diverse populations and settings, direct educational products and scholarship to address health inequities, and raise the importance of advancing health equity in medical education scholarship. By expanding and standardizing the assessment of scholarship to incorporate health equity, the medical education community can foster a cultural shift that brings health equity to the forefront of education scholarship.

Precision Education and Equity: A Participatory Framework to Advance Equitable Assessment.

ABSTRACT: Precision education (PE) may hold promise for the future of the field. Leveraging data and learning analytics to foster continuous improvement of individuals, programs, and organizations seems like a potential mechanism to advance both medical education and health care delivery systems toward a more equitable future. However, PE initiatives may also have unintended consequences and perpetuate inequities instead of ameliorating them. Although there have been some principles, ideas, and suggestions on how PE implementation may promote equity-particularly for the field of assessment-there is a lack of practical and evidence-informed guidance to support a more equitable and participatory approach to PE implementation. This paper provides actionable recommendations on how PE may advance equitable assessment. First, PE implementation must include democratizing access and ownership while enhancing literacy and transparency. Open and transparent access to both data and PE technology has the potential to enhance PE by fostering greater participation, rigor, and potential innovation. Transparency may also safeguard the use of assessment data for equitable purposes. Second, PE implementation must be cocreated with diverse learners. PE has the potential to empower learners if they are given an opportunity to participate in the development, application, and implementation of PE. Overall, a participatory approach to PE implementation has the potential to improve equitable assessment.

Social justice in medical education: a student-led approach to addressing COVID-19 vaccine equity in the Hispanic/Latinx community.

The current healthcare system disproportionately affects vulnerable populations, leading to disparities in health outcomes. As a result, medical schools need to equip future physicians with the tools to identify and address healthcare disparities. The University of Nevada, Reno School of Medicine implemented a Scholarly Concentration in Medical Social Justice (SCiMSJ) program to address this issue. Three medical students joined the program and pioneered a project to address the equitable vaccine distribution within the local Hispanic/Latinx community. After identifying the disparity in vaccine uptake and high levels of vaccine hesitancy, they collaborated with local organizations to address vaccine misinformation and accessibility. They organized outreach events, provided vaccine education, and hosted a vaccine clinic at a Catholic church with a high Hispanic/Latinx congregation. Through their efforts, they administered 1,456 vaccines. The estimated economic and societal impacts of their work was 879 COVID-19 cases avoided, 5 deaths avoided, 45 life years saved, and $29,286 in economic value. The project's success highlights the effectiveness of a student-led approach to promote skill development in social justice training. Leadership skills and coalition building were crucial in overcoming resource limitations and connecting organizations with the necessary volunteer force. Building trust with the Hispanic/Latinx community through outreach efforts and addressing vaccine hesitancy contributed to the well-attended vaccine clinic. The project's framework and approach can be adopted by other medical students and organizations to address health disparities and improve health outcomes in their communities.

The Pandemic and Beyond: Innovation in Cardiovascular Training to Improve Quality of Education and Trainees' Well-being.

During the first 2 years of the coronavirus-19 pandemic, many changes and innovations occurred to overcome the challenges associated with the pandemic and improve cardiovascular training. This review highlights the literature on the pandemic response regarding cardiovascular fellowship education and identifies areas of need to ensure future opportunities for fellows to achieve competency and career advancement. Specifically, we describe the recent changes to the four cornerstones of cardiovascular training: core content education, procedural training, career development, and the well-being of trainees.

Assessment and Evaluation in Social Determinants of Health Education: a National Survey of US Medical Schools and Physician Assistant Programs.

BACKGROUND: Social determinants of health (SDOH) curricular content in medical schools and physician assistant programs are increasing. However, there is little understanding of current practice in SDOH learner assessment and program evaluation, or what the best practices are. OBJECTIVE: Our study aim was to describe the current landscape of assessment and evaluation at US medical schools and physician assistant programs as a first step in developing best practices in SDOH education. DESIGN: We conducted a national survey of SDOH educators from July to December 2020. The 55-item online survey covered learner assessment methods, program evaluation, faculty training, and barriers to effective assessment and evaluation. Results were analyzed using descriptive statistics. PARTICIPANTS: One hundred six SDOH educators representing 26% of medical schools and 23% of PA programs in the USA completed the survey. KEY RESULTS: Most programs reported using a variety of SDOH learner assessment methods. Faculty and self were the most common assessors of learners' SDOH knowledge, attitudes, and skills. Common barriers to effective learner assessment were lack of agreement on "SDOH competency" and lack of faculty training in assessment. Programs reported using evaluation results to refine curricular content, identify the need for new content, and improve assessment strategies. CONCLUSIONS: We identified a heterogeneity of SDOH assessment and evaluation practices among programs, as well as gaps and barriers in their educational practices. Specific guidance from accrediting bodies and professional organizations and agreement on SDOH competency as well as providing faculty with time, resources, and training will improve assessment and evaluation practice and ensure SDOH education is effective for students, patients, and communities.

Downstream funding success of early career researchers for resubmitted versus new applications: A matched cohort.

BACKGROUND: Early career researchers face a hypercompetitive funding environment. To help identify effective intervention strategies for early career researchers, we examined whether first-time NIH R01 applicants who resubmitted their original, unfunded R01 application were more successful at obtaining any R01 funding within 3 and 5 years than original, unfunded applicants who submitted new NIH applications, and we examined whether underrepresented minority (URM) applicants differentially benefited from resubmission. Our observational study is consistent with an NIH working group's recommendations to develop interventions to encourage resubmission. METHODS AND FINDINGS: First-time applicants with US medical school academic faculty appointments who submitted an unfunded R01 application between 2000-2014 yielded 4,789 discussed and 7,019 not discussed applications. We then created comparable groups of first-time R01 applicants (resubmitted original R01 application or submitted new NIH applications) using optimal full matching that included applicant and application characteristics. Primary and subgroup analyses used generalized mixed models with obtaining any NIH R01 funding within 3 and 5 years as the two outcomes. A gamma sensitivity analysis was performed. URM applicants represented 11% and 12% of discussed and not discussed applications, respectively. First-time R01 applicants resubmitting their original, unfunded R01 application were more successful obtaining R01 funding within 3 and 5 years than applicants submitting new applications-for both discussed and not discussed applications: discussed within 3 years (OR 4.17 [95 CI 3.53, 4.93]) and 5 years (3.33 [2.82-3.92]); and not discussed within 3 years (2.81 [2.52, 3.13]) and 5 years (2.47 [2.22-2.74]). URM applicants additionally benefited within 5 years for not discussed applications. CONCLUSIONS: Encouraging early career researchers applying as faculty at a school of medicine to resubmit R01 applications is a promising potential modifiable factor and intervention strategy. First-time R01 applicants who resubmitted their original, unfunded R01 application had log-odds of obtaining downstream R01 funding within 3 and 5 years 2-4 times higher than applicants who did not resubmit their original application and submitted new NIH applications instead. Findings held for both discussed and not discussed applications.

The Dissolution of the Step 2 Clinical Skills Examination and the Duty of Medical Educators to Step Up the Effectiveness of Clinical Skills Assessment.

In this Invited Commentary, the authors explore the implications of the dissolution of the Step 2 Clinical Skills Examination (Step 2 CS) for medical student clinical skills assessment. The authors describe the need for medical educators (at both the undergraduate and graduate levels) to work collaboratively to improve medical student clinical skills assessment to assure the public that medical school graduates have the requisite skills to begin residency training. The authors outline 6 specific recommendations for how to capitalize on the discontinuation of Step 2 CS to improve clinical skills assessment: (1) defining national, end-of-clerkship, and transition-to-residency standards for required clinical skills and for levels of competence; (2) creating a national resource for standardized patient, augmented reality, and virtual reality assessments; (3) improving workplace-based assessment through local collaborations and national resources; (4) improving learner engagement in and coproduction of assessments; (5) requiring, as a new standard for accreditation, medical schools to establish and maintain competency committees; and (6) establishing a national registry of assessment data for research and evaluation. Together, these actions will help the medical education community earn the public's trust by enhancing the rigor of assessment to ensure the mastery of skills that are essential to providing safe, high-quality care for patients.

Collaborative clinical simulation in cardiologic emergency scenarios for medical students. An exploratory study on model applicability and assessment instruments.

Aims: This paper evaluates the feasibility of piloting the collaborative clinical simulation (CCS) model and its assessment instruments applicability for measuring interpersonal, collaborative, and clinical competencies in cardiologic emergency scenarios for medical students. The CCS model is a structured learning model for the acquisition and assessment of clinical competencies through small groups working collaboratively to design and perform in simulated environments supported by technology. Methods: Fifty-five students were allocated in five sessions (one weekly session) conducted with the CCS model within the course Cardiovascular Diseases. The applied practice aimed at the diagnosis and treatment of tachyarrhythmias in a simulated emergency department. In addition to the theoretical classes four weeks before the simulation sessions, students were sent a study guide that summarized the Guide to the European Society of Cardiology. For each simulation session, one clinical simulation instructor, one cardiologist teacher, and the principal investigator participated. Students were divided into three groups (3-5 students) for each-session. They designed, performed, role-played, and debriefed three different diagnoses. Three instruments to assess each group's performance were applied: peer assessment used by groups, performance assessment, created and applied by the cardiologist teacher, and individual satisfaction questionnaire for students. Results: The applicability of the CCS model was satisfactory for both students and teachers. The assessment instruments' internal reliability was good, as was internal consistency with a Cronbach Alpha of 0.7, 0.4, and 0.8 for each section (Interpersonal, Clinical, and Collaborative competencies, respectively). The performance group's evaluation was 0.8 for the two competencies assessed (Tachyarrhythmia and Electrical Cardioversion) and 0.8 for the satisfaction questionnaire's reliability. Conclusions: The CCS model for teaching emergency tachyarrhythmias to medical students was applicable and well accepted. The internal reliability of the assessment instruments was considered satisfactory by measuring satisfaction and performance in the exploratory study.

Using Kern's 6-Step Approach to Integrate Health Systems Science Curricula Into Medical Education.

The term "health systems science" (HSS) has recently emerged as a unifying label for competencies in health care delivery and in population and community health. Despite strong evidence that HSS competencies are needed in the current and future health care workforce, heretofore the integration of HSS into medical education has been slow or fragmented-due, in part, to a lack of evidence that these curricula improve education or population outcomes. The recent COVID-19 pandemic and the national reckoning with racial inequities in the United States further highlight the time-sensitive imperative to integrate HSS content across the medical education continuum. While acknowledging challenges, the authors highlight the unique opportunities inherent in an HSS curriculum and present an elaborated curricular framework for incorporating health care delivery and population health into undergraduate medical education. This framework includes competencies previously left out of medical education, increases the scope of faculty development, and allows for evidence of effectiveness beyond traditional learner-centric metrics. The authors apply a widely adopted 6-step approach to curriculum development to address the unique challenges of incorporating HSS. Two examples-of a module on quality improvement (health care delivery) and of an introductory course on health equity (population and community health)-illustrate how the 6-step approach can be used to build HSS curricula. The Supplemental Digital Appendix (at http://links.lww.com/ACADMED/B106) outlines this approach and provides specific examples and resources. Adapting these resources within local environments to build HSS curricula will allow medical educators to ensure future graduates have the expertise and commitment necessary to effect health systems change and to advocate for their communities, while also building the much-needed evidence for such curricula.

Health and medical care for refugees: design and evaluation of a multidisciplinary clinical elective for medical students.

Objective: Caring for refugee patients places special demands on health professionals. To date, medical students in Germany have rarely been systematically prepared for these challenges. This article reports on the development, conceptualisation, implementation, evaluation, and relevance of a multidisciplinary elective for medical students in the clinical study phase. Methodology: The course content was developed based on a needs-assessment among medical students and in cooperation with medical colleagues working in the field of refugee care. The course consisted of a seminar with medical, legal, administrative and socio-cultural learning content as well as a field placement in the medical outpatient clinic of the local reception centre for asylum seekers, which was accompanied by a systematic reflection process. The evaluation concept contained qualitative and quantitative elements. Results: 123 students completed the elective over six semesters (summer 2016 through to winter 2018). It was continuously evaluated and further developed. The students reported learning progress mainly in the following areas: Legal foundations of the asylum procedure and health care entitlements for asylum seekers; multi-perspectivity through multidisciplinarity as well as professional, ethical, interpersonal, and political insights gained through the practical experience. Summary: To prepare students for the complex challenges to be faced in medical care for refugees, a structured, multidisciplinary teaching programme, which combines theory, practice and reflection helps to foster insights into the many facets of this field of activity. The questions students brought to the seminar, the course contents and evaluation results are intended to inspire the design and implementation of similar courses at other universities.

Medical students' perception of the reliability, usefulness and feasibility of unproctored online formative assessment tests.

Medical education has gone online because of the COVID-19 pandemic. Formative assessment is essential to facilitate the learning process in medical education. However, various challenges arise during online assessment, which include reliability, when done without monitoring and practical concerns like Internet connectivity issues. This study was done to assess the medical students' perceptions of the reliability, usefulness, and practical challenges of online tests. One hundred first-year undergraduate medical students taking up online classes and tests in the subject of physiology were enrolled in this study. A questionnaire with items regarding practical challenges, reliability, and usefulness of the online tests, in general, and about different types of online assessment methods, in particular, were sent to the students online. Each item was rated on a five-point Likert scale, and the responses were analyzed anonymously. A large percentage of students used mobile phones (81.4%) to undertake online tests. Although most students (73.2%; P < 0.001) felt that online tests helped them substantially in learning the subject, network connectivity issues were considered to be a matter of serious concern (85.5%, P < 0.001). Among the assessment methods used, viva voce by video conferencing was thought to be most reliable (83%, P < 0.001). Multiple-choice question-based assessment when done online was felt to be more practically feasible with faster feedback than classroom assessment. The results of the study suggest that medical students find online formative assessments helpful for their learning, despite their concerns about reliability and practical challenges.

Students' perceptions on race in medical education and healthcare.

Major racial disparities continue to exist in our healthcare education, from the underrepresentation of ethnic minorities when teaching about clinical signs to health management in primary and secondary care. A multi-centre group of students discuss what needs to change in medical education to cultivate physicians who are better prepared to care for patients of all backgrounds. We argue that the accurate portrayal of race in medical education is a vital step towards educating medical students to consider alternative explanations to biology when considering health inequities.

Reimagining medical education for primary care in the time of COVID-19: a world view.

This article sets out to highlight the challenges and opportunities for medical education in primary care realised during the COVID-19 pandemic and now being enacted globally. The themes were originally presented during a webinar involving educationalists from around the world and are subsequently discussed by members of the WONCA working party for education. The article recognises the importance of utilising diversity, addressing inequity and responding to the priority health needs of the community through socially accountable practice. The well-being of educators and learners is identified as priority in response to the ongoing global pandemic. Finally, we imagine a new era for medical education drawing on global connection and shared resources to create a strong community of practice.

The COVID-19 Pandemic as an Imperative to Advance Medical Student Assessment: Three Areas for Change.

Conditions caused by the COVID-19 pandemic have disrupted clinical practice and all aspects of medical education. Yet the need to continue to train physicians to care for patients and communities is greater than ever. Medical educators are responding by adapting curricula in response to requirements for social distancing, changing availability of clinical learning opportunities, and limitations on testing center availability for examinations. These disruptions require a systems approach to ensure that learners achieve competence in preparation for advancement in training toward unsupervised practice. In this article, the authors assert that medical educators, obligated by current conditions to adapt educational experiences, should seize the opportunity presented by the pandemic to make needed changes in 3 areas aligned with competency-based medical education: focusing on outcomes, broadening the assessment toolbox, and improving the undergraduate medical education-to-graduate medical education (UME-to-GME) transition. Defined outcomes, as exemplified by entrustable professional activities, will enable curricular designers to shorten and adapt learning experiences by focusing on students' achievement of prespecified learning outcomes. Broadening the assessment toolbox entails capturing more and different assessment information about learners to provide a well-rounded view of their strengths and areas for growth in both traditional and novel settings, such as telehealth. Limitations on available data, such as licensing examination scores and clerkship grades, heighten the urgency to revise the system for the UME-to-GME transition by enhancing the quality and usability of information available to residency program directors. Educators should capitalize on the opportunity presented by altered conditions due to the COVID-19 pandemic to make these needed changes to the educational system, to prepare physicians to provide health care and lead the health care system into the future.

Implementation of global health competencies: A scoping review on target audiences, levels, and pedagogy and assessment strategies.

BACKGROUND: As the field of global health expands, the recognition of structured training for field-based public health professionals has grown. Substantial effort has gone towards defining competency domains for public health professionals working globally. However, there is limited literature on how to implement competency-based training into learning curricula and evaluation strategies. OBJECTIVES: This scoping review seeks to collate the current status, degree of consensus, and best practices, as well as gaps and areas of divergence, related to the implementation of competencies in global health curricula. Specifically, we sought to examine (i) the target audience, (ii) the levels or milestones, and (iii) the pedagogy and assessment approaches. SOURCES OF EVIDENCE: A review of the published and grey literature was completed to identify published and grey literature sources that presented information on how to implement or support global health and public health competency-based education programs. In particular, we sought to capture any attempts to assign levels or milestones, any evaluation strategies, and the different pedagogical approaches. RESULTS: Out of 68 documents reviewed, 21 documents were included which contained data related to the implementation of competency-based training programs; of these, 18 were peer-reviewed and three were from the grey literature. Most of the sources focused on post-graduate public health students, professional trainees pursuing continuing education training, and clinical and allied health professionals working in global health. Two approaches were identified to defining skill level or milestones, namely: (i) defining levels of increasing ability or (ii) changing roles across career stages. Pedagogical approaches featured field experience, direct engagement, group work, and self-reflection. Assessment approaches included self-assessment surveys, evaluations by peers and supervisors, and mixed methods assessments. CONCLUSIONS: The implementation of global health competencies needs to respond to the needs of specific agencies or particular groups of learners. A milestones approach may aide these efforts while also support monitoring and evaluation. Further development is needed to understand how to assess competencies in a consistent and relevant manner.

The importance of regulating the education and training of Traditional Chinese Medicine practitioners and a potential role for ISO/TC 249.

As Traditional Chinese Medicine (TCM) transcends its cultural boundaries and becomes widely used in many countries around the world, one of the major risks to the growing use of TCM internationally is the damage caused to its reputation and to community safety when TCM practitioners are not adequately trained. Ensuring the quality and competency of TCM practitioners is a fundamental requirement. This paper covers (1) the current level of regulation of education and training of TCM practitioners particularly in countries with well developed health systems; (2) the progress of self regulatory standards for education and training developed by international organizations and (3) the potential role of ISO/TC 249 in assisting these initiatives.