Contradictions and Opportunities: Reconciling Professional Identity Formation and Competency-Based Medical Education.

The widespread adoption of Competency-Based Medical Education (CBME) has resulted in a more explicit focus on learners' abilities to effectively demonstrate achievement of the competencies required for safe and unsupervised practice. While CBME implementation has yielded many benefits, by focusing explicitly on what learners are doing, curricula may be unintentionally overlooking who learners are becoming (i.e., the formation of their professional identities). Integrating professional identity formation (PIF) into curricula has the potential to positively influence professionalism, well-being, and inclusivity; however, issues related to the definition, assessment, and operationalization of PIF have made it difficult to embed this curricular imperative into CBME. This paper aims to outline a path towards the reconciliation of PIF and CBME to better support the development of physicians that are best suited to meet the needs of society. To begin to reconcile CBME and PIF, this paper defines three contradictions that must and can be resolved, namely: (1) CBME attends to behavioral outcomes whereas PIF attends to developmental processes; (2) CBME emphasizes standardization whereas PIF emphasizes individualization; (3) CBME organizes assessment around observed competence whereas the assessment of PIF is inherently more holistic. Subsequently, the authors identify curricular opportunities to address these contradictions, such as incorporating process-based outcomes into curricula, recognizing the individualized and contextualized nature of competence, and incorporating guided self-assessment into coaching and mentorship programs. In addition, the authors highlight future research directions related to each contradiction with the goal of reconciling 'doing' and 'being' in medical education.

Medical Residents' Informal Learning from Pharmacists in the Clinical Workplace.

Workplace-based interactions between residents and pharmacists, though relatively underexplored, might contribute substantially to learning. This international study sought to investigate the affordances residents use for informal learning about medications, their interactions with pharmacists and patterns of resident-pharmacist engagement, as well as residents' perceived impact of these interactions on their learning. Contextual differences between US and Dutch residency training and electronic health record (EHR) may impact informal learning about medications. We conducted a cross-sectional, online, 25-item survey study, including closed-format and open-response questions among current resident physicians (post-graduate years 1-6, from a variety of residency programs n = 803) from the University of California San Francisco, the University of Minnesota, and the University Medical Center Utrecht. Responses from 173 residents in both countries revealed that these physician trainees were afforded opportunities to engage in a wide variety of pharmacotherapy-related activities but engaged differently with social and environmental resources for support. Residents from the United States (US) utilized pharmacists and Up-To-Date, whereas Dutch residents preferentially utilized the online Dutch medication information site and EHR-embedded medication resources. US residents interacted with pharmacists significantly more frequently than Dutch residents. Pharmacists provided residents with a wide range of useful information, much of which is integrated into the medication resources in the Dutch EHR-based decision-support system. While US residents reported overwhelmingly that informal interactions with pharmacists contribute to their learning about medications, Dutch residents' responses did not confirm this. Intentionally designing residents' training to include opportunities for interactions with pharmacists could potentially positively impact residents' informal workplace learning. Supplementary Information: The online version contains supplementary material available at 10.1007/s40670-023-01784-1.

Protocol for an extended scoping review on the use of virtual nominal group technique in research.

INTRODUCTION: Consensus group methods such as the Nominal Group Technique (NGT) and Delphi method are commonly used in research to elicit and synthesize expert opinions when evidence is lacking. Traditionally, the NGT involves a face-to-face interaction. However, due to the COVID-19 pandemic, many in-person meetings have moved to online settings. It is unclear to what extent the NGT has been undertaken in virtual settings. The overarching aim of this scoping review is to explore the use of the virtual NGT in research. Our specific objectives are to answer the following questions: To what extent has the NGT been used virtually? What modifications were made to accommodate this online format? What advantages and disadvantages were noted by authors in comparison with the face-to-face mode of the technique? MATERIALS AND METHODS: This scoping review will follow the steps outlined by Arksey and O'Malley and the PRISMA-ScR guidelines. Several pilot searches were completed to refine inclusion and exclusion criteria. Media Synchronicity Theory will provide a conceptual framework to inform the research, including data extraction and summarizing results. As an additional extension to the literature review, online interviews with corresponding authors will be conducted to gather further information.

How can Entrustable Professional Activities serve the quality of health care provision through licensing and certification?

This paper about Entrustable Professional Activities (EPAs) was solicited to support the discussion about the future of licensing within the Medical Council of Canada. EPAs, units of professional practice to be entrusted to learners or professionals once they have shown to possess sufficient competence, were proposed in 2005 to operationalize competency-based postgraduate medical education and have become widely popular for various health professions education programs in many countries. EPAs break the breadth of competence for license down to units of practice that can be overseen, assessed, monitored, documented, and entrusted. EPAs together may constitute an individual's portfolio of qualifications, and define a scope of practice. A medical license and a specialty certification can then be defined as the required combination of EPAs for which one is qualified at any specific moment in time. That 'snapshot' could change over time and reflect the professional development of the individual, both in their competence and in their privileges to practice. Micro-credentialing and digital badges might become an adequate option to show-case one's scope of practice at any time and operationalize the idea of a dynamic portfolio of EPAs.

Cet article sur les activités professionnelles confiables (APC) a été sollicité pour alimenter la discussion sur l'avenir du titre de licencié au sein du Conseil médical du Canada. En 2005, il a été proposé de se servir des APC, unités de pratique professionnelle qui peuvent être confiées aux apprenants ou aux professionnels une fois qu'ils ont démontré avoir le niveau de compétence nécessaire, pour opérationnaliser la formation médicale postdoctorale basée sur les compétences; depuis, elles sont devenues courantes dans les programmes de formation aux professions de la santé dans de nombreux pays.Les APC décomposent l'étendue des compétences pour l'obtention d'une licence en unités de pratique qui peuvent être supervisées, évaluées, contrôlées, documentées et confiées. Ensemble, les APC peuvent constituer le portfolio de qualifications d'un individu et définir un champ d'exercice. Le titre de licencié et le certificat de spécialité peuvent alors être définis comme représentant la combinaison d'APC qu'une personne est qualifiée à exercer à un moment donné. Ce «cliché instantané¼ peut changer au fil du temps, reflétant le développement professionnel de la personne, tant sur le plan de ses compétences que de ses privilèges d'exercice. Les micro-titres de compétences et le badge numérique pourraient devenir une option adéquate pour présenter à tout moment le champ de pratique d'un médecin et rendre opérationnelle l'idée d'un portfolio dynamique d'APC.

True Entrustment Decisions Regarding Entrustable Professional Activities Happen in the Workplace, not in the Classroom Setting.

Entrustable Professional Activities (EPAs) are workplace responsibilities that directly impact patient care. The use of EPAs allows pharmacy faculty and preceptors to provide learners with feedback and assessment in the clinical setting. Because they focus assessment on a learner's execution of professional activities which requires integration of the respective competencies, EPAs help provide a more holistic picture of a learner's performance. Using EPAs to backwards design classroom learning for those competencies is highly encouraged, but instructors cannot or should not assess performance and make entrustment decisions using EPAs in the classroom setting for several reasons: a learner's classroom performance usually does not predict clinical performance very well, assessment of EPAs require direct observation of the learner performing the EPAs, EPA assessment requires multiple observations of the learner with different patients with varying level of acuity, and most importantly, EPA assessment must result in a decision to trust the learner to perform the clinical activity with limited supervision. By ensuring all entrustment decisions are made in a clinical or experiential setting, students will receive an accurate assessment and benchmark of their performance that will lead them one step closer to becoming independent practitioners.

Clarifying essential terminology in entrustment.

With the rapid uptake of entrustable professional activties and entrustment decision-making as an approach in undergraduate and graduate education in medicine and other health professions, there is a risk of confusion in the use of new terminologies. The authors seek to clarify the use of many words related to the concept of entrustment, based on existing literature, with the aim to establish logical consistency in their use. The list of proposed definitions includes independence, autonomy, supervision, unsupervised practice, oversight, general and task-specific trustworthiness, trust, entrust(ment), entrustable professional activity, entrustment decision, entrustability, entrustment-supervision scale, retrospective and prospective entrustment-supervision scales, and entrustment-based discussion. The authors conclude that a shared understanding of the language around entrustment is critical to strengthen bridges among stages of training and practice, such as undergraduate medical education, graduate medical education, and continuing professional development. Shared language and understanding provide the foundation for consistency in interpretation and implementation across the educational continuum.

Constructing Approaches to Entrustable Professional Activity Development that Deliver Valid Descriptions of Professional Practice.

Issue: Entrustable Professional Activities (EPAs) describe the core tasks health professionals must be competent performing prior to promotion and/or moving into unsupervised practice. When used for learner assessment, they serve as gateways to increased responsibility and autonomy. It follows that identifying and describing EPAs is a high-stakes form of work analysis aiming to describe the core work of a profession. However, hasty creation and adoption of EPAs without rigorous attention to content threatens the quality of judgments subsequently made from using EPA-based assessment tools. There is a clear need for approaches to identify validity evidence for EPAs themselves prior to their deployment in workplace-based assessment. Evidence: For EPAs to realize their potential in health professions education, they must first be constructed to reflect accurately the work of that profession or specialty. If the EPAs fail to do so, they cannot predict a graduate's readiness for or future performance in professional practice. Evaluating the methods used for identification, description, and adoption of EPAs through a construct validity lens helps give leaders and stakeholders of EPA development confidence that the EPAs constructed are, in fact, an accurate representation of the profession's work. Implications: Application of a construct validity lens to EPA development impacts all five commonly followed steps in EPA development: selection of experts; identification of candidate EPAs; iterative revisions; evaluation of proposed EPAs; and formal adoption of EPAs into curricula. It allows curricular developers to avoid pitfalls, bias, and common mistakes. Further, construct validity evidence for EPA development provides assurance that the EPAs adopted are appropriate for use in workplace-based assessment and entrustment decision-making.

A Mobile Learning Module to Support Interprofessional Knowledge Construction in the Health Professions.

Objective. To develop and evaluate a mobile learning module to support knowledge construction between medical and pharmacy students through structured dialogue prompts. Methods. Rheumatologists and pharmacists collaboratively developed a two-week, case-based, asynchronous interprofessional learning module that was delivered via a mobile app and focused on collaborative medication management of a complex case involving a patient with systemic lupus erythematosus. The clinical case evolved over three phases: diagnosis, initial treatment, and medication-related complications. Dialogue prompts were incorporated in each phase as a mechanism to support knowledge construction among learners. Pharmacy and medical student pairs were randomized to receive either high guidance or low guidance prompts for collaborative learning. The student pairs worked together, asynchronously, online, to develop three collaborative care plans. The evaluation of the learning module to support knowledge construction included: analysis of text-based dialogue coded for knowledge construction phases; the accuracy and completeness of the three collaborative care plans; and quantitative and qualitative participant feedback. Results. Sixteen pairs of medical and pharmacy students (n=32) participated. Pairs who received high guidance engaged in all phases of knowledge construction more often than pairs who received low guidance. Guidance phase did not differentially impact collaborative care plan scores. Ninety-eight percent of students agreed or strongly agreed that the module improved their clinical reasoning, interprofessional communication, and knowledge of systemic lupus erythematosus. Conclusion. The knowledge construction framework can guide the design and evaluation of educational interventions such as a mobile learning module to support knowledge construction among health professionals.

Learning Challenges, Teaching Strategies, and Cognitive Load: Insights From the Experience of Seasoned Endoscopy Teachers.

PURPOSE: Learners of medical procedures must develop, refine, and apply schemas for both cognitive and psychomotor constructs, which may strain working memory capacity. Procedures with limitations in visual and tactile information may add risk of cognitive overload. The authors sought to elucidate how experienced procedural teachers perceived learners' challenges and their own teaching strategies in the exemplar setting of gastrointestinal endoscopy. METHOD: The authors interviewed 22 experienced endoscopy teachers in the United States, Canada, and the Netherlands between May 2016 and March 2019 and performed thematic analysis using template analysis method. Interviews addressed learner challenges and teaching strategies from the teacher participants' perspectives. Cognitive load theory informed data interpretation and analysis. RESULTS: Participants described taking steps to "diagnose" trainee ability and identify struggling trainees. They described learning challenges related to trainees (performance over mastery goal orientation, low self-efficacy, lack of awareness), tasks (psychomotor challenges, mental model development, tactile understanding), teachers (teacher-trainee relationship, inadequate teaching, teaching variability), and settings (internal/external distractions, systems issues). Participants described employing strategies that could match intrinsic load to learners' levels (teaching along developmental continuum, motor instruction, technical assistance/takeover), minimize extraneous load (optimize environment, systems solutions, emotional support, define expectations), and optimize germane load (promote mastery, teach schemas, stop and focus). CONCLUSIONS: Participants provided insight into possible challenges while learning complex medical procedures with limitations in sensory channels, as well as teaching strategies that may address these challenges at individual and systems levels. Using cognitive load theory, the authors provide recommendations for procedural teachers.

Approaches of anatomy teaching for seriously resource-deprived countries: A literature review.

Background: Teaching anatomy is an important but expensive part of the medical curriculum, potentially more than many countries can afford. In the search for efficient methods, cost-effectiveness is of utmost importance for such countries. The aim of this contribution is to provide a review of the literature on anatomy teaching methods, evaluating these for feasibility in resource-deprived countries. Methods: A literature review was carried out to identify distinct approaches to anatomy teaching published in the period 2000-2014, using the databases of PubMed, Wiley Online Library, Elsevier, HINARI, Springer, and ERIC. The approaches found were compared against their conceptual, operational, technical, and economic feasibility and Mayer's principles of effective instruction. Results: Our search yielded 432 papers that met the inclusion criteria. We identified 14 methods of teaching anatomy. Based on their conceptual feasibility, dissection and technology enhanced learning approaches appeared to have more benefits than others. Dissection has, besides benefits, many specific drawbacks. Lectures and peer teaching showed better technical and economic feasibility. Educational platforms, radiological imaging, and lectures showed the highest operational feasibility. Dissection and surgery were found to be less feasible with regard to operational, technical, and economic characteristics. Discussion: Based on our findings, the most important recommendations for anatomy teaching in seriously resource-deprived countries include a combination of complementary strategies in 3 different moments, lecturing at the beginning, using virtual learning environment (for self-study), and at the end, using demonstration through prosected specimens and radiological imaging. This provides reasonable insights in anatomy through both dead and living human bodies and their virtual representations.

Envisioning a True Continuum of Competency-Based Medical Education, Training, and Practice.

The existing structure of physician education has developed in siloed stages, with consecutive degrees and certifications and progressively longer training programs. As further fragmentation of health care and training systems will not improve the quality of care and education, the authors argue that a new vision of education, training, and practice as a continuum is needed.They advocate for a model of competency-based medical education that merges with competency-based medical practice. In this system, education and training will result in individual, dynamic portfolios of valid entrustable professional activities (EPAs) for which physicians are certified. Physicians can maintain and renew that entrustment as long as the EPAs remain within their scope of practice. Entrustment occurs initially during training but is then granted for new activities as physicians' careers evolve.This model accounts for the need to keep pace with changes in population health needs and expectations of competence over time. It de-emphasizes the divides between the stages of training and views the continuum from undergraduate medical education until retirement as a whole. Key obligations of self-regulating medical professionals include both the reception and the provision of supervision from and for others, respectively. Learning must be embedded in practice to address expectations regarding new knowledge and skills as they evolve with scientific and technological advances.Entrusting physicians to deliver effective and safe care, based on their performance of the requisite EPAs without supervision, should ensure that they provide high-value, quality care to patients.

Reflections From the Rearview Mirror: Internal Medicine Physicians' Reactions to Clinical Feedback After Transitions of Responsibility.

PURPOSE: Learning from practice is important for continuous improvement of practice. Yet little is known about how physicians assimilate clinical feedback and use it to refine their diagnostic approaches. This study described physicians' reactions to learning that their provisional diagnosis was either consistent or inconsistent with the subsequent diagnosis, identified emotional responses to those findings, and explored potential consequences for future practices. METHOD: In 2016-2017, 22 internal medicine hospitalist and resident physicians at Oregon Health & Science University completed semistructured interviews. Critical incident prompts elicited cases of patient care transitions before the diagnosis was known. Interview questions explored participants' subsequent follow-up. Matrix analysis of case elements, emotional reactions, and perceived practice changes was used to compare patterns of responses between cases of confirming versus disconfirming clinical feedback. RESULTS: Participants described 51 cases. When clinical feedback confirmed provisional diagnoses (17 cases), participants recalled positive emotions, judged their performance as sufficient, and generally reinforced current approaches. When clinical feedback was disconfirming (34 cases), participants' emotional reactions were mostly negative, frequently tempered with rationalizations, and often associated with perceptions of having made a mistake. Perceived changes in practice mostly involved nonspecific strategies such as "trusting my intuition" and "broadening the differential," although some described case-specific strategies that could be applied in similar contexts in the future. CONCLUSIONS: Internists' experiences with posttransition clinical feedback are emotionally charged. Internists' reflections on clinical feedback experiences suggest they are primed to adapt practices for the future, although the usefulness of those adaptations for improving practice is less clear.

An Updated Primer on Entrustable Professional Activities (EPAs) / Guia Atualizado sobre Atividades Profissionais Confiáveis (APCs)

ABSTRACT Since the turn of the millennium, competency-based medical education (CBME) has become a new standard for medical training in many countries. CBME has been operationalized in detailed frameworks of competencies that every physician should demonstrate at graduation, and similar frameworks have been created for specialties. However, the competencies, describing qualities that physicians should possess, do not directly translate into everyday activities of physicians. For that reason, the Entrustable Professional Activities (EPAs) were introduced. EPAs are units of professional practice that may be entrusted to undergraduate students, once they show the competencies needed to perform them without supervision. EPAs have become a popular topic within CBME programs in many countries and hundreds of publications within only a few years. This paper was written to introduce the strengths and weaknesses of EPAs. After a brief historical overview, the reason why EPAs are a bridge between a competency framework and daily clinical practice is explained. While competencies are qualities of individuals, EPAs are units of work. The two can be seen as two dimensions of a matrix, showing that almost all activities in health care are based on multiple competencies, such as communication skill, collaboration, professional behavior, content knowledge. Next, entrustment decision-making as a form of assessment is created and a framework of levels of supervision is presented. Entrustment decisions focus on the level of supervision a student requires for a specific activity, divided into five levels (1: allowed to observe; 2; allowed to perform under direct supervision; 3: allowed to perform under indirect supervision; 4: allowed to perform the activity unsupervised; 5: allowed to supervise the activity performed by more junior learners). For readers interested in applying the concept to practice, a stepwise approach to the curriculum development is proposed. The paper concludes with an overview of the state-of-the-art of working with EPAs across disciplines, professions and countries.

RESUMO Desde a virada do milênio, a Educação Médica Baseada em Competências (EMBC) tornou-se um novo padrão para a formação médica em muitos países. A EMBC foi operacionalizada em estruturas detalhadas de competências que todo médico deve demonstrar na graduação, e estruturas semelhantes foram criadas para especialidades. No entanto, as competências, descrevendo as qualidades que os médicos devem possuir, não se traduzem diretamente nas atividades cotidianas dos médicos. Por essa razão, as Atividades Profissionais Confiáveis (APCs) foram introduzidas. As APCs são unidades de prática profissional que podem ser confiadas aos estudantes, uma vez que demonstram as competências necessárias para executá-las sem supervisão. As APCs se tornaram um tema popular nos programas de EMBC em diferentes países com centenas de publicações em poucos anos. Este trabalho foi escrito para apresentar em língua portuguesa as fortalezas e fragilidades das APCs. Após uma sucinta revisão histórica, expõe-se a razão de as APCs serem uma ponte entre o marco das competências e a prática clínica diária. Enquanto as competências são qualidades dos indivíduos, as APCs são unidades de trabalho. As duas podem ser vistas como duas dimensões de uma matriz, mostrando que quase todas as atividades na área da saúde se baseiam em múltiplas competências, como capacidade de comunicação, colaboração, comportamento profissional e conhecimento de conteúdo. Em continuidade, apresentam-se o modo de elaborar uma tomada de decisão de atribuição como forma de avaliação e os referenciais para os níveis de supervisão. As decisões de atribuição se concentram nos cinco níveis de supervisão que o estudante demanda para realizar uma atividade específica: 1. ao aprendiz é permitido observar; 2. é permitido executar a APC sob supervisão; 3. é permitido realizar a APC com supervisão indireta; 4. é permitido executar a atividade sem supervisão; 5: é permitido supervisionar aprendizes iniciantes. Para os leitores interessados em aplicar esse conceito na prática, é proposto um processo com o passo a passo dentro do desenvolvimento curricular. O artigo conclui com uma revisão do estado da arte do trabalho com as APCs em diferentes disciplinas, profissões e países.

An elective entrustable professional activity-based thematic final medical school year: an appreciative inquiry study among students, graduates, and supervisors.

PURPOSE: The transition from undergraduate to postgraduate training can be facilitated by offering electives that focus on increased patient care responsibilities. This transitional year model in the Netherlands has recently been expanded to offer packages of electives geared to specific residencies and was called "dedicated transitional year" (DTY). At University Medical Center Utrecht, an entrustable professional activity (EPA)-based multidisciplinary DTY in acute care (DTY-AC), rooted in self-determination theory (SDT), has been implemented. The current study aimed to understand strengths and challenges regarding the implementation of this specific DTY. METHODS: An explorative qualitative study among students, graduates, and faculty was conducted using an appreciative inquiry methodological approach. We gathered first-hand accounts of experiences with the DTY-AC in focus groups and interviews with students and interviews with graduates, supervisors, and mentors. Transcripts were analyzed with a directed content analysis approach. RESULTS: Participants found the DTY-AC to focus learning, offering coherence by clear learning objectives, aligned assessment, and teaching sessions and offering a congenial learning community. However, EPAs were not the focal point of workplace assessment and evaluation. Providing sufficient hands-on student engagement in actual acute care situations was another challenge. CONCLUSION: The concept of the thematic DTY is embraced, and it seems to help in meeting the SDT needs. Enhancing delivery in the workplace by improving formal implementation with information and faculty development, expanding EPA-focused workplace assessment, and extending hands-on experience of students could further unlock the potential of this final medical school year design. Our lessons learned may help in the development and implementation of similar programs, other models of DTYs, and final-year redesigns.

A primer on entrustable professional activities.

Entrustable professional activities (EPAs) have become a popular topic within competency-based medical education programs in many countries and hundreds of publications within only a few years. This paper was written to introduce the ins and outs of EPAs. After a brief historical overview, the rational of EPAs, as a bridge between a competency framework and daily clinical practice, is explained. Next, entrustment decision-making as a form of assessment is elaborated and framework of levels of supervision is presented. For readers interested to apply the concept in practice a stepwise approach to curriculum development is proposed. The paper concludes with an overview of the state of the art of working with EPAs in across disciplines, professions and countries.

The History of Medical Education in Europe and the United States, With Respect to Time and Proficiency.

In this article, the authors present a historic overview of the development of medical education in the United States and Europe (in particular the Netherlands), as it relates to the issues of time (duration of the course) and proficiency (performance requirements and examinations). This overview is necessarily limited and based largely on post hoc interpretation, as historic data on time frames are not well documented and the issue of competence has only recently been addressed.During times when there were few, if any, formal regulations, physicians were primarily "learned gentlemen" in command of few effective practical skills, and the duration of education and the competencies acquired by the end of a course simply did not appear to be issues of any interest to universities or state authorities. Though uniform criteria gradually developed for undergraduate medical education, postgraduate specialty training remained, before accreditation organizations set regulations, at the discretion of individual institutions and medical societies. This resulted in large variability in training time and acquired competencies between residency programs, which were often judged on the basis of opaque or questionable criteria. Considering the high costs of health care today and the increasing demand for patient safety and educational efficiency, continuing historic models of nonstandardized practices will no longer be feasible. Efforts to constrain, restructure, and individualize training time and licensing tracks to optimize training for safe care, both in the United States and Europe, are needed.

Guía sobre las actividades profesionales confiables / A primer on entrustable professional activities

Las actividades profesionales confiables (APROC) -entrustable professional activities- se han convertido en un tema de actualidad en los programas de educación médica basados en competencias en diferentes países y han sido objeto de centenares de publicaciones en pocos años. Este trabajo se ha traducido al castellano con el fin de introducir las ventajas e inconvenientes de las APROC. Tras una breve revisión histórica, se describe la razón de ser de las APROC como un puente entre el marco competencial y la práctica clínica diaria. A continuación, se elabora la toma de decisiones como sistema de evaluación y se presenta el marco de los diferentes niveles de supervisión. Para los lectores interesados en aplicar este concepto en la práctica, se propone un proceso paso a paso para el desarrollo de un currículo basado en las APROC. El artículo concluye con una revisión del estado de la cuestión del trabajo con APROC en diferentes disciplinas, profesiones y países (AU)

Entrustable professional activities (EPAs) have become a popular topic within competency-based medical education programs in many countries and hundreds of publications appeared within only a few years. This paper was written to introduce the ins and outs of EPAs in the Spanish language. After a brief historical overview, the rational of EPAs, as a bridge between a competency framework and daily clinical practice, is explained. Next, entrustment decision making as a form of assessment is elaborated and framework of levels of supervision is presented. For readers interested to apply the concept in practice a stepwise approach to curriculum development is proposed. The paper concludes with an overview of the state of the art of working with EPAs across disciplines, professions and countries (AU)

Taking Rater Exposure to Trainees Into Account When Explaining Rater Variability.

BACKGROUND: Rater-based judgments are widely used in graduate medical education to provide more meaningful assessments, despite concerns about rater reliability. OBJECTIVE: We introduced a statistical modeling technique that corresponds to the new rater reliability framework, and present a case example to provide an illustration of the utility of this new approach to assessing rater reliability. METHODS: We used mixed-effects models to simultaneously incorporate random effects for raters and systematic effects of rater role as fixed effects. Study data are clinical performance ratings collected from medical school graduates who were evaluated for their readiness for supervised clinical practice in authentic simulation settings at 2 medical schools in the Netherlands and Germany. RESULTS: The medical schools recruited a maximum of 30 graduates out of 60 (50%) and 180 (17%) eligible candidates, respectively. Clinician raters (n = 25) for the study were selected based on their level of expertise and experience. Graduates were assessed on 7 facets of competence (FOCs) that are considered important in supervisors' entrustment decisions across the 5 cases used. Rater role was significantly associated with 2 FOCs: (1) teamwork and collegiality, and (2) verbal communication with colleagues/supervisors. For another 2 FOCs, rater variability was only partially explained by the role of the rater (a proxy for the amount of direct interaction with the trainee). CONCLUSIONS: Consideration of raters as meaningfully idiosyncratic provides a new framework to explore their influence on assessment scores, which goes beyond considering them as random sources of variability.

Ensuring Resident Competence: A Narrative Review of the Literature on Group Decision Making to Inform the Work of Clinical Competency Committees.

Background The expectation for graduate medical education programs to ensure that trainees are progressing toward competence for unsupervised practice prompted requirements for a committee to make decisions regarding residents' progress, termed a clinical competency committee (CCC). The literature on the composition of these committees and how they share information and render decisions can inform the work of CCCs by highlighting vulnerabilities and best practices. Objective We conducted a narrative review of the literature on group decision making that can help characterize the work of CCCs, including how they are populated and how they use information. Methods English language studies of group decision making in medical education, psychology, and organizational behavior were used. Results The results highlighted 2 major themes. Group member composition showcased the value placed on the complementarity of members' experience and lessons they had learned about performance review through their teaching and committee work. Group processes revealed strengths and limitations in groups' understanding of their work, leader role, and information-sharing procedures. Time pressure was a threat to the quality of group work. Conclusions Implications of the findings include the risks for committees that arise with homogeneous membership, limitations to available resident performance information, and processes that arise through experience rather than deriving from a well-articulated purpose of their work. Recommendations are presented to maximize the effectiveness of CCC processes, including their membership and access to, and interpretation of, information to yield evidence-based, well-reasoned judgments.