Entrustable professional activities as a training and assessment framework in undergraduate medical education: A case study of a multi-institutional pilot.

In 2014, the Association of American Medical Colleges (AAMC) published 13 Core Entrustable Professional Activities (EPAs) that graduating students should be able to perform with indirect supervision when entering residency. A ten-school multi-year pilot was commissioned to test feasibility of implementing training and assessment of the AAMC's 13 Core EPAs. In 2020-21, a case study was employed to describe pilot schools' implementation experiences. Teams from nine of ten schools were interviewed to identify means and contexts of implementing EPAs and lessons learned. Audiotapes were transcribed then coded by investigators using conventional content analysis and a constant comparative method. Coded passages were organized in a database and analyzed for themes. Consensus among school teams regarding facilitators of EPA implementation included team commitment to piloting EPAs; agreement that: proximal EPA adoption with curriculum reform facilitates EPA implementation; EPAs 'naturally fit' in clerkships and provided opportunity for schools to reflect on and adjust curricula and assessments; and inter-school collaboration bolstered individual school progress. Schools did not make high-stakes decisions about student progress (e.g., promotion, graduation), yet EPA assessment results complemented other forms of assessment in providing students with robust formative feedback about their progress. Teams had varied perceptions of school capability to implement an EPA framework, influenced by various levels of dean involvement, willingness, and capability of schools to invest in data systems and provide other resources, strategic deployment of EPAs and assessments, and faculty buy-in. These factors affected varied pace of implementation. Teams agreed on the worthiness of piloting the Core EPAs, but substantial work is still needed to fully employ an EPA framework at the scale of entire classes of students with enough assessments per EPA and with required data validity/reliability. Recommendations stemming from findings may help inform further implementation efforts across other schools adopting or considering an EPA framework.

Reviewing the Reviewer: Medical Student Course Feedback as a Marker of Professional Identity Formation.

Professional identity formation refers to the process by which medical trainees develop and internalize their new roles. In this work, we analyze medical student evaluations of teaching (SETs) as a window into students' developing identities as physicians. Our data consisted of 389 open-ended comments written anonymously by first-year (pre-clerkship) students in mid- and end-of-semester evaluations of small group sessions (mandatory attendance) during one full academic year at Yale School of Medicine. Using a combination of existing frameworks on professional identity formation, the purpose of this project was to: (1) describe the characteristics of comments made by medical students about first-year courses and instructors; (2) categorize the student comments; and (3) explore the usefulness of comments as markers of students' professional identity formation as physicians. Having established baseline information, we hope to follow the same cohort of students through their medical school career to assess if and how their evaluative comments shed light on the development of their professional identities as physicians.

Twelve tips for incorporating and teaching sexual and gender minority health in medical school curricula.

The World Health Organization has identified many barriers to improving the health of lesbian, gay, bisexual, and transgender (LGBT) patients, including challenges to incorporating and teaching about healthcare for such patients, which we call "sexual and gender minority" (SGM) health content. These challenges include structural and logistical barriers to incorporating SGM health content into undergraduate medical curricula, as well as lack of support in identifying high-quality pedagogical methods for teaching this material. Here, we provide twelve tips for incorporating and teaching SGM health curricular content in undergraduate medical education, including resources and strategies to support individual educators. Based on our success in developing and implementing this content, we believe that our approach can be effectively used by individual educators aiming to incorporate SGM health curricular material into their teaching, and to support individuals or groups championing the inclusion of a SGM health topical sequence in medical curricula.

Point-of-Care Ultrasound: Does it Affect Scores on Standardized Assessment Tests Used Within the Preclinical Curriculum?

OBJECTIVES: An increasing number of medical schools are incorporating point-of-care ultrasound (POCUS) into preclinical and clinical curricula. The ultimate effect of this teaching is unclear, and there has been no distinct link between ultrasound (US) learning and existing standardized student assessments. Additionally, neither optimal timing nor methods of POCUS integration have been established. We aimed to demonstrate the effect of US teaching on standardized objective assessments that already exist within the curriculum and, in doing so, discern a route for POCUS curricular integration. METHODS: A longitudinal POCUS pilot curriculum was started in 2013, with the class of 2017. We collected basic science course results, standardized objective structured clinical examination scores, and United States Medical Licensing Examination step 1 scores from both the pilot group (n = 34) and matched control participants (n = 34) from the classes of 2017 and 2018. Scores between POCUS students and controls were analyzed by Student t tests. RESULTS: Students participating in the longitudinal POCUS program scored significantly higher on the physical examination portion of their clinical skill objective structured clinical examination assessment than the control group (mean score, 89.2 versus 85.7; P < .05). This parameter was the only area with a statistically significant difference. CONCLUSIONS: Point-of-care US program implementation may improve students' overall physical examination understanding and performance, even when US performance itself is not being tested. Introducing a POCUS curriculum may work best when designed in conjunction with the physical examination thread of a medical school curriculum.

A Neurology Clerkship Curriculum Using Video-Based Lectures and Just-in-Time Teaching (JiTT).

Introduction: Just-in-time teaching is an educational strategy that involves tailoring in-session learning activities based on student performance in presession assessments. We implemented this strategy in a third-year neurology clerkship. Methods: Linked to core neurology clerkship lectures, eight brief video-based lectures and knowledge assessments were developed. Students watched videos and completed multiple-choice questions, and results were provided to faculty, who were given the opportunity to adjust the in-person lecture accordingly. Feedback was obtained by surveys of students and faculty lecturers and from student focus groups and faculty. Student performance on the end-of-clerkship examination was analyzed. Results: Between October 2016 and April 2017, 135 students participated in the curriculum, and 56 students (41.5%) responded to the surveys. Most students agreed or strongly agreed that the new curriculum enhanced their learning and promoted their sense of responsibility in learning the content. Faculty agreed that this pedagogy helped prepare students for class. Most students watched the entire video-based lecture, although there was a trend toward decreased audience retention with longer lectures. There were no significant changes in performance on the end-of-clerkship examination after implementation of just-in-time teaching. In focus groups, students emphasized the importance of tying just-in-time teaching activities to the lecture and providing video-based lectures well in advance of the lectures. Discussion: Just-in-time teaching using video-based lectures is an acceptable and feasible method to augment learning during a neurology clinical clerkship. We believe this method could be used in other neurology clerkships with similar success.

What indicates competency in systems based practice? An analysis of perspective consistency among healthcare team members.

In many parts of the world the practice of medicine and medical education increasingly focus on providing patient care within context of the larger healthcare system. Our purpose is to solicit perceptions of all professional stakeholders (e.g. nurses) of the system regarding the U.S. ACGME competency Systems Based Practice to uncover the extent to which there is agreement or discrepancy among key system stakeholders. Eighty-eight multidisciplinary personnel (n = 88) from two academic medical centers were invited to participate in one of 14 nominal group process sessions. Participants generated and prioritized resident characteristics that they believed were important for effective System Based Practices. Through content analysis the prioritized attribute statements were coded to identify embedded themes of resident roles and behavior. From the themes, three major resident roles emerged: resident as Self-Manager, Team Collaborator, and Patient Advocate. No one professional group (e.g., nurses, attending physicians, social workers) emphasized all of these roles. Some concepts that are emphasized in the ACGME definition like using cost-benefit analysis were conspicuously absent from the healthcare team generated list. We showed that there are gaps between the key stakeholders prioritizations about the ACGME definition of SBP and, more generally, the behaviors and roles identified by healthcare team stakeholders beyond the U.S. This suggests that within the process of developing a comprehensive working understanding of the Systems Based Practice competency (or other similar competencies, such as in CanMEDS), it is necessary to use multiple stakeholders in the system (perhaps including patients) to more accurately identify key resident roles and observable behaviors.

Independence or autonomy: which is the goal?

At times in psychiatric treatment practice in the United States, the notion of individualism or independence (an American ideal) is confused with autonomy (a rights goal). Client autonomy is defined as the ability of clients to make their own choices. When the societal ideal of independence overrides individual autonomy, inclusion and client well-being may be jeopardized. A case will be presented to illustrate these points. We make recommendations for professional education to protect client rights through understanding the distinction between autonomy and independence.

Mental health case management as a locus for HIV prevention: results from case-manager focus groups.

HIV infection among people with severe mental illness (SMI) is a growing concern, and interventions have been designed to address HIV prevention among these individuals. However, little is known about the preparedness of mental health providers to support these interventions. This study concentrated on mental health case management as a locus for HIV-prevention services. Focus groups of case managers were conducted to learn participants' motivation to adopt HIV-prevention services and barriers/facilitators to such adoption. Participants reported they would be motivated to offer HIV prevention if services were to be presented in the context of existing client relationships and case-management tasks. Barriers and facilitators were discussed at client, provider, and community levels, and recommendations for training were offered. Findings have implications for diffusion of HIV-prevention services in case management, and the line of questioning in focus groups provides a basis for learning about other behavioral health service contexts as loci for disease prevention.