Entrustable Professional Activities in Postgraduate General Surgery Training: A Scoping Review.

OBJECTIVE: To provide an overview of the current use of Entrustable Professional Activities (EPAs) in postgraduate general surgery training internationally. BACKGROUND: Entrustable Professional Activities (EPAs) were introduced to connect clinical competencies and the professional activities to be entrusted to trainees on graduation. The popularity of EPAs as a framework for assessment is growing globally, including in general surgery. Anecdotally, there appears to be substantial variation in how they are implemented, yet a formal comparison of their use in postgraduate general surgery training is lacking. METHODS: A scoping review was performed, based on the original five-stage approach described by Arksey and O'Malley with the addition of protocol-specific items from the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols extension for scoping reviews (PRISMA-ScR). RESULTS: Twenty-nine published and grey literature sources were included in the review. Entrustable Professional Activity use in postgraduate general surgery training was identified in 11 unique contexts, including from North America, South America, Europe, Asia, Africa, and Australia. There were substantial differences in the scope and number of EPAs, tools used for EPA assessment, and how EPAs were sequenced through training. Despite wide variation, eight distinct EPAs were common to the majority (>80%) of countries. Several articles described findings of EPA use in postgraduate general surgery training, allowing identification of multiple barriers and facilitators to integration. CONCLUSIONS: This review provides guidance for certification and regulatory bodies, program directors, and institutions with ambitions to implement EPAs for assessment and curricular design. In settings where EPAs are already used, the data may facilitate refinement of programs and strategies.

Medical competence as a multilayered construct.

BACKGROUND: The conceptualisation of medical competence is central to its use in competency-based medical education. Calls for 'fixed standards' with 'flexible pathways', recommended in recent reports, require competence to be well defined. Making competence explicit and measurable has, however, been difficult, in part due to a tension between the need for standardisation and the acknowledgment that medical professionals must also be valued as unique individuals. To address these conflicting demands, a multilayered conceptualisation of competence is proposed, with implications for the definition of standards and approaches to assessment. THE MODEL: Three layers are elaborated. This first is a core layer of canonical knowledge and skill, 'that, which every professional should possess', independent of the context of practice. The second layer is context-dependent knowledge, skill, and attitude, visible through practice in health care. The third layer of personalised competence includes personal skills, interests, habits and convictions, integrated with one's personality. This layer, discussed with reference to Vygotsky's concept of Perezhivanie, cognitive load theory, self-determination theory and Maslow's 'self-actualisation', may be regarded as the art of medicine. We propose that fully matured professional competence requires all three layers, but that the assessment of each layer is different. IMPLICATIONS: The assessment of canonical knowledge and skills (Layer 1) can be approached with classical psychometric conditions, that is, similar tests, circumstances and criteria for all. Context-dependent medical competence (Layer 2) must be assessed differently, because conditions of assessment across candidates cannot be standardised. Here, multiple sources of information must be merged and intersubjective expert agreement should ground decisions about progression and level of clinical autonomy of trainees. Competence as the art of medicine (Layer 3) cannot be standardised and should not be assessed with the purpose of permission to practice. The pursuit of personal excellence in this level, however, can be recognised and rewarded.

Assessing supervisor versus trainee viewpoints of entrustment through cognitive and affective lenses: an artificial intelligence investigation of bias in feedback.

The entrustment framework redirects assessment from considering only trainees' competence to decision-making about their readiness to perform clinical tasks independently. Since trainees and supervisors both contribute to entrustment decisions, we examined the cognitive and affective factors that underly their negotiation of trust, and whether trainee demographic characteristics may bias them. Using a document analysis approach, we adapted large language models (LLMs) to examine feedback dialogs (N = 24,187, each with an associated entrustment rating) between medical student trainees and their clinical supervisors. We compared how trainees and supervisors differentially documented feedback dialogs about similar tasks by identifying qualitative themes and quantitatively assessing their correlation with entrustment ratings. Supervisors' themes predominantly reflected skills related to patient presentations, while trainees' themes were broader-including clinical performance and personal qualities. To examine affect, we trained an LLM to measure feedback sentiment. On average, trainees used more negative language (5.3% lower probability of positive sentiment, p < 0.05) compared to supervisors, while documenting higher entrustment ratings (+ 0.08 on a 1-4 scale, p < 0.05). We also found biases tied to demographic characteristics: trainees' documentation reflected more positive sentiment in the case of male trainees (+ 1.3%, p < 0.05) and of trainees underrepresented in medicine (UIM) (+ 1.3%, p < 0.05). Entrustment ratings did not appear to reflect these biases, neither when documented by trainee nor supervisor. As such, bias appeared to influence the emotive language trainees used to document entrustment more than the degree of entrustment they experienced. Mitigating these biases is nonetheless important because they may affect trainees' assimilation into their roles and formation of trusting relationships.

Exploring Interprofessional Development of Entrustable Professional Activities For Pediatric Intensive Care Fellows: A Proof-of-Concept Study.

Phenomenon: Entrustable professional activities (EPAs) delineate major professional activities that an individual in a given specialty must be "entrusted" to perform, ultimately without supervision, to provide quality patient care. Until now, most EPA frameworks have been developed by professionals within the same specialty. As safe, effective, and sustainable health care ultimately depends on interprofessional collaboration, we hypothesized that members of interprofessional teams might have clear and possibly additional insight into which activities are essential to the professional work of a medical specialist. Approach: We recently employed a national modified Delphi study to develop and validate a set of EPAs for Dutch pediatric intensive care fellows. In this proof-of-concept study, we explored what pediatric intensive care physicians' non-physician team members (physician assistants, nurse practitioners, and nurses) constitute as essential professional activities for PICU physicians and how they regarded the newly developed set of nine EPAs. We compared their judgments with the PICU physicians' opinions. Findings: This study shows that non-physician team members share a mental model with physicians about which EPAs are indispensable for pediatric intensive care physicians. Despite this agreement however, descriptions of EPAs are not always clear for non-physician team members who have to work with them on a daily basis. Insights: Ambiguity as to what an EPA entails when qualifying a trainee can have implications for patient safety and trainees themselves. Input from non-physician team members may add to the clarity of EPA descriptions. This finding supports the involvement of non-physician team members in the developmental process of EPAs for (sub)specialty training programs.

Harmen Tiddens (1923-2002): A butterfly's impact on medical education.

The history of medical education scholarship is often overlooked. Moreover, although productive educational researchers are often recognized for their scholarly contributions in peer-reviewed publications, the impact of others who are not active medical education researchers may be unknown to contemporary educators and scholars. This short paper describes the contributions of Harmen Tiddens, MD PhD to Utrecht and Maastricht Universities where he established the environment and supports for scholars to undertake profoundly influential work. Through his leadership as the founding Dean of Maastricht's new medical school, Dr. Tiddens facilitated educational principles that became exemplary for generations of health professions education scholars and curriculum developers, nationally and internationally.

Investigating feedback orientation in medical learners.

BACKGROUND/PURPOSE: Feedback processes in health professions education (HPE) are not always successful. While recommendations to improve feedback provision dominate the literature, studying specific learner attributes that impact feedback uptake may also improve feedback processes. Feedback orientation is a concept from management science involving four dimensions of learner attributes and attitudes that impact their feedback uptake: utility, accountability, social awareness, and feedback self-efficacy. Feedback orientation may represent a valuable concept in HPE. We aimed to understand medical learners' feedback orientation at different stages in their development. METHODS: We used the Feedback Orientation Scale, a 20-item survey instrument, for a cross-sectional analysis of feedback orientation in medical students and Internal Medicine residents at one large academic center. We performed descriptive statistics and analysis of variance for data analysis. RESULTS: We found the same factors (dimensions) to feedback orientation in our population as in management science. Overall feedback orientation scores were high and were largely consistent across trainee levels. Utility was the domain that was highest across learners, whereas feedback self-efficacy was lowest. CONCLUSIONS: Feedback orientation represents a useful concept to explore medical learners' attitudes toward feedback's role in their development. The four domains can help guide further nuanced feedback research and application.[Box: see text].

Twelve tips to develop entrustable professional activities.

Entrustable professional activities (EPAs), units of professional practice that require proficient integration of multiple competencies and can be entrusted to a sufficiently competent learner, are increasingly being used to define and inform curricula of health care professionals. The process of developing EPAs can be challenging and requires a deep yet pragmatic understanding of the concepts underlying EPA construction. Based on recent literature and the authors' lessons learned, this article provides the following practical and more or less sequential recommendations for developing EPAs: [1] Assemble a core team; [2] Build up expertise; [3] Establish a shared understanding of the purpose of EPAs; [4] Draft preliminary EPAs; [5] Elaborate EPAs; [6] Adopt a framework of supervision; [7] Perform a structured quality check; [8] Use a Delphi approach for refinement and/or consensus; [9] Pilot test EPAs; [10] Attune EPAs to their feasibility in assessment; [11] Map EPAs to existing curriculum; [12] Build a revision plan.

Transdisciplinary entrustable professional activities.

Healthcare has become highly specialized. Specialists, in medicine as well as in nursing, determine much of the high quality of current health care. But healthcare has also become increasingly fragmented, with professionals trained in separate postgraduate silos, with boundaries often difficult to cross. While a century ago, generalists dominated patient care provision, now specialists prevail and risk becoming alienated from each other, losing the ability to adapt to neighboring professional domains. Current health care requires a flexible workforce, ready to serve in multiple contexts, as the COVID-19 crisis has shown.The new concept of transdisciplinary entrustable professional activities, EPAs applicable in more than one specialty, was recently conceived to enhance collaboration and transfer between educational programs in postgraduate nursing in the Netherlands.In this paper, we reflect on our experiences so far, and on practical and conceptual issues concerning transdisciplinary EPAs, such as: who should define, train, assess, and register transdisciplinary EPAs? How can different prior education prepare for similar EPAs? And how do transdisciplinary EPAs affect professional identity?We believe that transdisciplinary EPAs can contribute to creating more flexible curricula and hence to a more coherent, collaborative healthcare workforce, less determined by the boundaries of traditional specialties.

Mobile technologies to support workplace-based assessment for entrustment decisions: Guidelines for programs and educators: AMEE Guide No. 154.

With the rise of competency-based medical education and workplace-based assessment (WBA) since the turn of the century, much has been written about methods of assessment. Direct observation and other sources of information have become standard in many clinical programs. Entrustable professional activities (EPAs) have also become a central focus of assessment in the clinical workplace. Paper and pencil (one of the earliest mobile technologies!) to document observations have become almost obsolete with the advent of digital technology. Typically, clinical supervisors are asked to document assessment ratings using forms on computers. However, accessing these forms can be cumbersome and is not easily integrated into existing clinical workflows. With a call for more frequent documentation, this practice is hardly sustainable, and mobile technology is quickly becoming indispensable. Documentation of learner performance at the point of care merges WBA with patient care and WBA increasingly uses smartphone applications for this purpose.This AMEE Guide was developed to support institutions and programs who wish to use mobile technology to implement EPA-based assessment and, more generally, any type of workplace-based assessment. It covers backgrounds of WBA, EPAs and entrustment decision-making, provides guidance for choosing or developing mobile technology, discusses challenges and describes best practices.

Mentorship in health professions education - an AMEE guide for mentors and mentees: AMEE Guide No. 167.

This AMEE guide discusses theoretical principles and practical strategies for health professions educators to promote impactful mentoring relationships. Traditional definitions are challenged, distinctions are made between roles such as mentor, advisor, coach and sponsor. As educational environments change and options for professional development expand, we argue that the traditional dyadic format of mentoring alone will not help mentees to maximise their professional growth. Newer formats of mentoring are discussed in detail and their advantages and disadvantages compared. We use a variety of theoretical concepts to anchor the practice of mentorship: self-focussed and other-focussed motives; psychological safety; personal interpretive framework; Daloz model for balancing support and challenge; zone of proximal development; communities of practice; and development along multiple layers of competence. Recommended strategies for effective mentoring are based on extensive review of literature, as well as combined professional mentoring experiences of the authors. We use key principles from the theories described and phases of mentoring relationships as foundations for the suggested best practices of mentorship. Finally, we emphasise the role of mentees in their own professional development and provide tips for them on seeking mentors, expanding their mentoring network and taking the lead in setting the agenda during mentoring meetings and formulating action plans for their own advancement.

Preliminary evidence for a Tool to Observe the Construction of Knowledge in Interprofessional teams (TOCK-IP).

Collaborative knowledge construction (KC) is an important process in interprofessional learning and a logical assessment target. A tool supporting the formative evaluation of KC behaviors ideally would be: 1) applicable to interprofessional teams of learners in clinical contexts; 2) informed by contemporary learning frameworks; 3) feasible and useful. No existing assessment tool meets these criteria. This paper describes the development and preliminary validity evidence for a Tool for Observing Construction of Knowledge in Interprofessional teams (TOCK-IP). Following literature review and needs assessment, the TOCK-IP was drafted based upon Gunawardena's five-phase KC model. Educational expert review established content validity. Response process and internal structure validity, feasibility, and utility were assessed through step-wise evaluation. Faculty raters applied the tool to four videos of simulated interactions between health professions learners. Faculty ratings were compared to expert consensus ratings. Thematic analysis of post-rating survey and debrief allowed assessment of feasibility and utility. Across videos, faculty raters' agreement was fair (n = 25; Fleiss' kappa = 0.40, <0.001). Excellent agreement (95%) was found for raters' scores compared to consensus rating. Faculty supported tool feasibility and utility. The TOCK-IP meets the three criteria for evaluating team-level KC and offers a progression roadmap to help learners move toward collaborative learning.

Facilitating flexibility in postgraduate nursing education through entrustable professional activities to address nursing shortages and career prospects.

AIM: To communicate how the Dutch postgraduate nursing education landscape was redesigned using entrustable professional activities (EPAs). The goal of this initiative was to reduce training time, enhance transfer across nursing specialities and contribute to a better-aligned continuum of initial education, postgraduate education and continuing professional development. BACKGROUND: Nursing shortages continue to worsen worldwide. An approach to address this growing shortage is to create a more flexible postgraduate training structure, offering training in the just-in-time and just-as-needed models. EPAs can be used as building blocks for training and assessment. Experience with EPAs (i.e. units of professional practice that can be entrusted once a trainee has demonstrated the required competencies) in health professions education, including nursing, is rising rapidly. While EPAs are largely used to create training flexibility within a programme, they can also be used to create flexibility across programmes. In 2018-2022, training hospitals and education institutions in the Netherlands collaborated in the CZO Flex Level Project to redesign the postgraduate nursing education landscape using EPAs. DISCUSSION: The implementation of a flexible postgraduate nursing education model nationwide will face several challenges. An overview of these challenges and suggestions for future research on the effects of the new structure on nursing competence, satisfaction and career development are provided. CONCLUSION: EPAs can imbue flexibility within and across training programmes. Designing an EPA-based educational landscape requires nationally coordinated efforts. IMPLICATIONS FOR NURSING POLICY: Redesigning educational structures to allow for more flexibility is critical to address major societal challenges in healthcare.

The logic behind entrustable professional activity frameworks: A scoping review of the literature.

INTRODUCTION: Entrustable professional activities (EPAs), discrete profession-specific tasks requiring integration of multiple competencies, are increasingly used to help define and inform curricula of specialty training programmes. Although guidelines exist to help guide the developmental process, deciding what logic to use to draft a preliminary EPA framework poses a crucial but often difficult first step. The logic of an EPA framework can be defined as the perspective used by its developers to break down the practice of a profession into units of professional work. This study aimed to map dominant logics and their rationales across postgraduate medical education and fellowship programmes. METHODS: A scoping review using systematic searches within five electronic databases (Medline, Embase, Google Scholar, Scopus and Web of Science) was performed. Dominant logics of included papers were identified using inductive coding and iterative analysis. RESULTS: In total, 42 studies were included. Most studies were conducted in the United States (n = 22; 52%), Canada (n = 6; 14%) and the Netherlands (n = 4; 10%). Across the reported range of specialties, family medicine (n = 4; 10%), internal medicine (n = 4; 10%), paediatrics (n = 3; 7%) and psychiatry (n = 3; 7%) were the most common. Three dominant logics could be identified, namely, 'service provision', 'procedures' and/or 'disease or patient categories'. The majority of papers (n = 37; 88%) used two or more logics when developing EPA frameworks (median = 3, range = 1-4). Disease or patient groups and service provision were the most common logics used (39% and 37%, respectively). CONCLUSIONS: Most programmes used a combination of logics when trying to capture the essential tasks of a profession in EPAs. For each of the three dominant logics, the authors arrived at a definition and identified benefits, limitations and examples. These findings may potentially inform best practice guidelines for EPA development.

Exploring how feedback reflects entrustment decisions using artificial intelligence.

CONTEXT: Clinical supervisors make judgements about how much to trust learners with critical activities in patient care. Such decisions mediate trainees' opportunities for learning and competency development and thus are a critical component of education. As educators apply entrustment frameworks to assessment, it is important to determine how narrative feedback reflecting entrustment may also address learners' educational needs. METHODS: In this study, we used artificial intelligence (AI) and natural language processing (NLP) to identify characteristics of feedback tied to supervisors' entrustment decisions during direct observation encounters of clerkship medical students (3328 unique observations). Supervisors conducted observations of students and collaborated with them to complete an entrustment-based assessment in which they documented narrative feedback and assigned an entrustment rating. We trained a deep neural network (DNN) to predict entrustment levels from the narrative data and developed an explainable AI protocol to uncover the latent thematic features the DNN used to make its prediction. RESULTS: We found that entrustment levels were associated with level of detail (specific steps for performing clinical tasks), feedback type (constructive versus reinforcing) and task type (procedural versus cognitive). In justifying both high and low levels of entrustment, supervisors detailed concrete steps that trainees performed (or did not yet perform) competently. CONCLUSIONS: Framing our results in the factors previously identified as influencing entrustment, we find a focus on performance details related to trainees' clinical competency as opposed to nonspecific feedback on trainee qualities. The entrustment framework reflected in feedback appeared to guide specific goal-setting, combined with details necessary to reach those goals. Our NLP methodology can also serve as a starting point for future work on entrustment and feedback as similar assessment datasets accumulate.

Expectations for PhDs in health professions education: an international EPA-framed, modified Delphi study.

Health professions education (HPE) has matured into field of study that employs and produces specialized educational scholars. Many academic institutions employ such scholars to support development and innovation in education. Simultaneously, the possibilities to obtain a PhD degree in HPE are expanding. Clarity in the expectations that such a degree brings along can be useful for scholars, employers and institutions. Anticipating that the views of what a PhD in HPE is or should be can vary between institutions, cultures and countries, we conducted an international Delphi study to identify EPAs for HPE PhDs. We used a framework of 24 EPAs resulted from a national consensus study in Iran as input to seek more generalized validity and a wider consensus of reasonably suitable activities. A three-round modified Delphi study was conducted with participation of 15 international experts. Final framework consisted of 17 relevant EPAs with a justification, specifications and limitations, and risks in case of failure per EPA (all had overall CVI > 0.8 for adequacy of description). Eleven EPAs were considered by the majority to be core to PhD training, 16 to be desirable for HPE PhDs as a capability to carry out without supervision, but the majority would trust current HPE PhDs to carry out only 5 of the 17 without supervision. The EPAs identified in this study arguably reflect the expectations of educators with a PhD degree in HPE. The framework has the potential to advance HPE training across countries and to inform personal development and employment decisions.

Entrustable professional activities versus competencies and skills: Exploring why different concepts are often conflated.

Despite explanations in the literature, a returning question in the use of entrustable professional activities (EPAs) is how to distinguish them from competencies and skills. In this article, we attempt to analyze the causes of the frequent confusion and conflation of EPAs with competencies and skills, and argue why the distinction is important for education, qualification and patient safety. 'Tracheotomy', 'lumbar puncture', 'interprofessional collaboration' for example are colloquially called 'skills', but its is a person's ability to perform these activities that is the actual skill; the EPA is simply the activity itself. We identify two possible causes for the confusion. One is a tendency to frame all educational objectives as EPAs. Many objectives of medical training can be conceptualized as EPAs, if 'the ability to do X' is the corresponding competency; but that does not work for all. We offer ways to deal with objectives of training that are not usefully conceptualized as EPAs. A more fundamental cause relates to entrustment decisions. The permission to contribute to health care reflects entrustment. Entrustment decisions are the links or pivots between a person's readiness for the task and the actual task execution. However, if entrustment decisions do not lead to increased autonomy in the practice of health care, but only serve to decide upon the advancement to a next stage of training, EPAs can become the tick boxes learners feel they need to collect to 'pass'. Gradually, then, EPAs can loose their original meaning of units of practice for which one becomes qualified.

Developing entrustable professional activities for university teachers in the health professions.

PURPOSE: There is a widely recognized need to improve teacher professional development as well as recognition of teaching expertise in health professions education (HPE). This study aimed to develop Entrustable Professional Activities (EPAs) for university teachers in HPE as foundations for systems of training, certification, and career opportunities. METHOD: A local expert consultation using a two-round Delphi study at a Dutch academic medical center (round 1: n = 23; round 2: n = 13) was conducted to reach a consensus on an initial set of EPAs developed by the researchers. Subsequently, an international expert consultation was conducted using a survey (n = 21) and a focus group discussion (n = 7) to explore their international value. RESULTS: Local consensus for all nine EPAs was reached in the second round of the Delphi study. The international survey showed a consensus for relevance and usefulness of all but one EPA but not for clarity and comprehensiveness of the EPAs. The international expert consultation revealed a need to tailor the EPA specifications to local contexts. CONCLUSION: We found international consensus for the relevance and usefulness of EPAs for university teachers in HPE but local tailoring for each EPA is needed to acknowledge contextual differences.

Residents' Experiences of Negative Emotions toward Patients: Challenges to their Identities.

PhenomenonMedical learners are more likely than practicing physicians to experience negative emotions toward some patients whom they find challenging, and medical students experience such emotions related to their identity as learners. Little is known about experiences of residents, who are further along in their physician identity formation and have greater autonomy and competence. We explored and characterized how residents understand their experiences of the phenomenon of feeling negative emotions toward patients in relation to their identities as residents. Approach: In 2018, 305 final-year obstetrics and gynecology residents were invited to participate in interviews, which we conducted until reaching theoretical sufficiency. In semi-structured interviews conducted by phone, we probed interactions when residents felt negative emotions toward patients, including reasons for their feelings related to their professional identities, strategies, and curricular desires. The authors coded data and identified patterns using thematic analysis. Findings: Nineteen residents were interviewed by phone. Residents experienced negative emotions toward patients because of challenges to their identities as: physicians - wanting respect and specific unexpected patient behaviors; learners - desiring complete autonomy and experiencing challenges with attending physicians; teachers - wanting to be a role model and protect junior learners; and workers - trying to complete tasks. Among the strategies used to manage feelings toward patients, they struggled with "venting", or complaining about patients, which was not always helpful and residents recognized as perceived negatively by students. They desired curricular support for these interactions such as debriefs and other supported reflection, faculty modeling, and communication skills training. Insights: Like medical students and physicians in practice, residents experience negative emotions toward patients, often because of and made more difficult by their identities as physicians, learners, teachers, and workers. Educators should support residents' reflections about these interactions, model compassionate behavior when feeling challenged by patients, and address unhealthy coping strategies.

In pursuit of a better transition to selected residencies: a quasi-experimental evaluation of a final year of medical school dedicated to the acute care domain.

BACKGROUND: Medical schools seek the best curricular designs for the transition to postgraduate education, such as the Dutch elective-based final, 'transitional' year. Most Dutch graduates work a mean of three years as a physician-not-in-training (PNIT) before entering residency training. To ease the transition to selected specialties and to decrease the duration of the PNIT period, UMC Utrecht introduced an optional, thematic variant of the usual transitional year, that enables the development of theme-specific competencies, in addition to physicians' general competencies. METHODS: We introduced an optional transitional year for interested students around the theme of acute care, called the Acute Care Transitional Year (ACTY). This study aimed to evaluate the ACTY by judging whether graduates meet postgraduate acute care expectations, indicating enhanced learning and preparation for practice. In a comprehensive assessment of acute care knowledge, clinical reasoning, skills, and performance in simulations, we collected data from ACTY students, non-ACTY students interested in acute care, and PNITs with approximately six months of acute care experience. RESULTS: ACTY graduates outperformed non-ACTY graduates on skills and simulations, and had higher odds of coming up to the expectations faculty have of a PNIT, as determined by global ratings. PNITs did better on simulations than ACTY graduates. DISCUSSION: ACTY graduates show better resemblance to PNITs than non-ACTY graduates, suggesting better preparation for postgraduate acute care challenges. CONCLUSION: Transitional years, offering multidisciplinary perspectives on a certain theme, can enhance learning and preparedness for entering residency.

Evaluation of the 2020 European Academy of Neurology virtual congress: transition from a face-to-face to a virtual meeting.

BACKGROUND AND PURPOSE: Due to the COVID-19 pandemic, scientific congresses are increasingly being organized as virtual congresses (VCs). In May 2020, the European Academy of Neurology (EAN) held a VC, free of charge. In the absence of systematic studies on this topic, the aim of this study is to evaluate the attendance and perceived quality of the 2020 EAN VC compared to the 2019 EAN face-to-face congress (FFC). METHODS: An analysis of the demographic data of participants obtained from the online registration was done. A comparison of the two congresses based on a survey with questions on the perception of speakers' performance, quality of networking and other aspects was made. RESULTS: Of 43,596 registered participants, 20,694 active participants attended the VC. Compared to 2019, the number of participants tripled (6916 in 2019) and the cumulated number of participants attending the sessions was five times higher (169,334 in 2020 vs. 33,024 in 2019). Out of active participants 55% were from outside Europe, 42% were board-certified neurologists (FFC 80%) and 21% were students (FFC 0.6%). The content of the congress was evaluated as 'above expectation' by 56% of the attendees (FFC 41%). Of the respondents who had been exposed to earlier EAN congresses 73% preferred the FFC compared to the VC (17%). CONCLUSION: The VC fulfilled the main mission of organizing high quality EAN congresses despite the restrictions of the impersonal format. The geographical distribution of the participants proves the expected higher inclusivity of a VC. The large participation of students and neurologists in training opens new educational potentials for the EAN.