The Enneagram as a Tool for Resident Wellness and Correlation With Accreditation Council for Graduate Medical Education Milestone Achievements.

INTRODUCTION: The Enneagram is an ancient personality typing system developed to improve self-knowledge. Broken down into nine personality types, each is driven by a core motivating factor. Other personality assessments have been used to study the personality profile of surgeons. The purpose of this study is to evaluate the variability in Enneagram type among a single institution's general surgery residents. METHODS: All categorical general surgery residents at a single institution completed an online Enneagram assessment as part of a wellness initiative. Accreditation Council for Graduate Medical Education milestone levels for professionalism (PRO) and interpersonal and communication skills were collected for each resident's intern year. Milestone levels were compared between the nine Enneagram types. RESULTS: All nine Enneagram types were represented among surveyed residents. The most frequent Enneagram type was type 3 (20.69%). There was no significant difference between PRO (P = 0.322) and interpersonal and communication skills (P = 0.645) scores among residents distributed by Enneagram type. CONCLUSIONS: Regardless of core Enneagram type, general surgery residents in this study all achieved appropriate Accreditation Council for Graduate Medical Education milestone levels for entry level of training. The Enneagram can provide self-awareness and understanding of resident differences but does not impact initial assessment of competency in PRO and interpersonal communication skills.

Clinical competency of nurses trained in competency-based versus objective-based education in the Democratic Republic of the Congo: a qualitative study.

BACKGROUND: Designing competency-based education (CBE) programmes is a priority in global nursing education for better nursing care for the population. In the Democratic Republic of the Congo (DRC), object-based education (OBE) remains mainstream in pre-service nursing education programmes. Recently, the Ministry of Health developed a self-assessment tool and quantitatively compared the clinical competency of CBE- and OBE-trained nurses. This study aimed to qualitatively triangulate the results of self-evaluation by exploring perception of supervisors, incumbent CBE-, and OBE-trained nurses in comparison with the competence of the two types of nurses, and to identify influential factors or barriers to their competence in clinical settings. METHODS: A qualitative descriptive approach with conventional content analysis was applied. Twenty interviews with clinical supervisors who oversaw both CBE- and OBE-trained nurses, 22 focus group discussions (FGDs) with CBE-trained nurses, and 21 FGDs with OBA-trained nurses currently working in health facilities were conducted. Participants of the FGDs were selected from the participants of the DRC self-assessment competency comparison study where there was no statistically significance between CBE- and OBE-trained nurses in the demographic characteristics. Data were analysed in terms of the competencies identified by the Ministry of Health. RESULTS: The supervisors recognised that the CBE-trained nurses had stronger competencies in professional communication, making decisions about health problems, and engaging in professional development, but were weak in clinical skills. This study identified challenges for supervisors in assuring standardised care in health facilities with OBE- and CBE-trained nurses, as well as barriers for CBE-trained nurses as a minority in the workplace in demonstrating their competencies. CONCLUSIONS: The study results support the Ministry of Health's policy to expand CBE in pre-service education programmes but reveal that its slow implementation impedes full utilisation of the acquired competencies at health facilities. Implementation could be accelerated by strengthening cooperation among the Ministry of Health's three human resource departments, and developing and implementing a well-planned, legally binding, long-term CBE reform strategy, including an approach to the Continuing Professional Development system.

Cardiac Critical Care Fellowship Training in the United States and Canada: Pediatric Cardiac Intensive Care Society-Endorsed Subcompetencies to the 2022 Entrustable Professional Activities.

OBJECTIVES: We aimed to define and map subcompetencies required for pediatric cardiac critical care (PCCC) fellowship education and training under the auspices of the Pediatric Cardiac Intensive Care Society (PCICS). We used the 2022 frameworks for PCCC fellowship learning objectives by Tabbutt et al and for entrustable professional activities (EPAs) by Werho et al and integrated new subcompetencies to the EPAs. This complementary update serves to provide a foundation for standardized trainee assessment tools for PCCC. DESIGN: A volunteer panel of ten PCICS members who are fellowship education program directors in cardiac critical care used a modified Delphi method to develop the update and additions to the EPA-based curriculum. In this process, the experts rated information independently, and repetitively after feedback, before reaching consensus. The agreed new EPAs were later reviewed and unanimously accepted by all PCICS program directors in PCCC in the United States and Canada and were endorsed by the PCICS in 2023. PROCEDURE AND MAIN RESULTS: The procedure for defining new subcompetencies to the established EPAs comprised six consecutive steps: 1) literature search; 2) selection of key subcompetencies and curricular components; 3) written questionnaire; 4) consensus meeting and critical evaluation; 5) approval by curriculum developers; and 6) PCICS presentation and endorsement. Overall, 110 subcompetencies from six core-competency domains were mapped to nine EPAs with defined levels of entrustment and examples of simple and complex cases. To facilitate clarity and develop a future assessment tool, three EPAs were subcategorized with subcompetencies mapped to the appropriate subcategory. The latter covering common procedures in the cardiac ICU. CONCLUSIONS: This represents the 2023 update to the PCCC fellowship education and training EPAs with the defining and mapping of 110 subcompetencies to the nine established 2022 EPAs. This goal of this update is to serve as the next step in the integration of EPAs into a standardized competency-based assessment framework for trainees in PCCC.

How well do workplace-based assessments support summative entrustment decisions? A multi-institutional generalisability study.

BACKGROUND: Assessment of the Core Entrustable Professional Activities for Entering Residency requires direct observation through workplace-based assessments (WBAs). Single-institution studies have demonstrated mixed findings regarding the reliability of WBAs developed to measure student progression towards entrustment. Factors such as faculty development, rater engagement and scale selection have been suggested to improve reliability. The purpose of this investigation was to conduct a multi-institutional generalisability study to determine the influence of specific factors on reliability of WBAs. METHODS: The authors analysed WBA data obtained for clerkship-level students across seven institutions from 2018 to 2020. Institutions implemented a variety of strategies including selection of designated assessors, altered scales and different EPAs. Data were aggregated by these factors. Generalisability theory was then used to examine the internal structure validity evidence of the data. An unbalanced cross-classified random-effects model was used to decompose variance components. A phi coefficient of >0.7 was used as threshold for acceptable reliability. RESULTS: Data from 53 565 WBAs were analysed, and a total of 77 generalisability studies were performed. Most data came from EPAs 1 (n = 17 118, 32%) 2 (n = 10 237, 19.1%), and 6 (n = 6000, 18.5%). Low variance attributed to the learner (<10%) was found for most (59/77, 76%) analyses, resulting in a relatively large number of observations required for reasonable reliability (range = 3 to >560, median = 60). Factors such as DA, scale or EPA were not consistently associated with improved reliability. CONCLUSION: The results from this study describe relatively low reliability in the WBAs obtained across seven sites. Generalisability for these instruments may be less dependent on factors such as faculty development, rater engagement or scale selection. When used for formative feedback, data from these instruments may be useful. However, such instruments do not consistently provide reasonable reliability to justify their use in high-stakes summative entrustment decisions.

How well do UK assistantships equip medical students for graduate practice? Think EPAs.

The goal of better medical student preparation for clinical practice drives curricular initiatives worldwide. Learning theory underpins Entrustable Professional Activities (EPAs) as a means of safe transition to independent practice. Regulators mandate senior assistantships to improve practice readiness. It is important to know whether meaningful EPAs occur in assistantships, and with what impact. Final year students at one UK medical school kept learning logs and audio-diaries for six one-week periods during a year-long assistantship. Further data were also obtained through interviewing participants when students and after three months as junior doctors. This was combined with data from new doctors from 17 other UK schools. Realist methods explored what worked for whom and why. 32 medical students and 70 junior doctors participated. All assistantship students reported engaging with EPAs but gaps in the types of EPAs undertaken exist, with level of entrustment and frequency of access depending on the context. Engagement is enhanced by integration into the team and shared understanding of what constitutes legitimate activities. Improving the shared understanding between student and supervisor of what constitutes important assistantship activity may result in an increase in the amount and/or quality of EPAs achieved.

Thresholds of becoming: an exploration of threshold concepts as a means to support professional identity formation in competency-based curricula.

Inherent in every clinical preceptor's role is the ability to understand the learning needs of individual trainees, enabling them to meet their potential. Competency-based medical education frameworks have been developed to this end, but efforts to identify behaviours and activities that define competence are based on mapping knowledge, skills and ability, which can be difficult to integrate into a comprehensive picture of who the trainee is becoming. Professional identity formation, in contrast, prioritizes attention to who trainees are becoming, but provision of detailed guidance to preceptors on how to best support this form of development is challenging. The tension that results limits our ability to optimally support learners as strengths in competency development may mask professional identity development gaps and vice versa. To address this tension, this paper examines how the theory of threshold concepts - troublesome ideas that, once appreciated, fundamentally change how you understand and approach a particular activity - can shine light on professional identity formation and its relationship with developing competence. The recognition and identification of threshold concepts is offered as a means to improve our ability to identify, discuss and support behaviours and actions that impact the learner's capacity to act competently as they develop their identity at various stages of training.

The lived experience of Competence by Design: Canadian resident physicians' perspectives.

PURPOSE: Canadian specialist residency programs are in the process of transitioning to a hybrid time and competence model, Competence by Design (CBD), developed by the Royal College of Physicians and Surgeons Canada. Although there is extensive literature around competency-based medical education (CBME), few studies have evaluated the experience of residents after CBME implementation. The purpose of this study was to obtain a rich perspective on the lived experience of residents. METHODS: We designed a qualitative study with inductive thematic analysis of semistructured interview data. The study population was residents in CBD postgraduate training programs in anesthesiology, internal medicine, or surgery (including all surgical subspecialties) at Dalhousie University (Halifax, NS, Canada). RESULTS: Residents identified the following benefits of their programs and CBD: supportive peers and clinical supervisors, a roadmap for residency, formalized feedback opportunities, and program evolution. Resident-identified drawbacks of CBD included: a lack of transparency around CBD, CBD not as advertised, a lack of buy-in, increased administrative burden, difficulties obtaining evidence for entrustable professional activities (EPAs); the onus for CBD on residents, inconsistent feedback, cumbersome technology, and significant psychological burden. Resident-suggested improvements were reducing the number of EPAs, streamlining EPA requirements, increasing transparency and communication with competence committees, providing incentives and continuous education for clinical supervisors, improving on existing electronic interfaces, and developing technology better suited to the needs of CBD. CONCLUSION: This study highlights that the significant administrative and psychological burden of CBD detracts from clinical learning and enthusiasm for residency. Future research could explore whether overcoming the identified challenges will improve residents' experiences.

RéSUMé: OBJECTIF: Les programmes canadiens de résidence spécialisée sont en train de passer à un modèle hybride de temps et de compétence, soit la compétence par conception (CPC); ce modèle a été élaboré par le Collège royal des médecins et chirurgiens du Canada. Bien qu'il existe une abondante documentation sur la formation médicale fondée sur les compétences (FMFC), peu d'études ont évalué l'expérience des résidentes et résidents après la mise en œuvre de la FMFC. Le but de cette étude était d'obtenir une perspective enrichie quant à l'expérience vécue par les résidents et résidentes. MéTHODE: Nous avons conçu une étude qualitative avec une analyse thématique inductive des données d'entretiens semi-structurés. La population étudiée était composée de résident·es des programmes de formation postdoctorale en anesthésiologie, en médecine interne ou en chirurgie (y compris toutes les surspécialités chirurgicales) à l'Université Dalhousie (Halifax, N.-É., Canada). RéSULTATS: Les personnes interrogées ont identifié les avantages suivants de leurs programmes et de la CPC : le soutien des pairs et des superviseur·es cliniques, une feuille de route pour la résidence, des possibilités de rétroaction officielles et l'évolution du programme. Parmi les inconvénients de la CPC identifiés par les résident·es, mentionnons : un manque de transparence autour de la CPC, une CPC ne correspondant pas à ce qui avait été annoncé, un manque d'adhésion, un fardeau administratif accru, des difficultés à obtenir des preuves de participation à des actes professionnels non supervisés (APNS); le fardeau de la CPC incombant aux résident·es, une rétroaction incohérente, une technologie lourde et un fardeau psychologique important. Les améliorations suggérées par les résident·es comprenaient la réduction du nombre d'APNS, la rationalisation des exigences des APNS, l'augmentation de la transparence et de la communication avec les comités de compétence, l'offre d'incitations et de formation continue aux superviseur·es cliniques, l'amélioration des interfaces électroniques existantes et le développement d'une technologie mieux adaptée aux besoins de la CPC. CONCLUSION: Cette étude souligne que le fardeau administratif et psychologique important de la CPC nuit à l'apprentissage clinique et à l'enthousiasme pour la résidence. Les recherches futures pourraient déterminer si le fait de surmonter les défis identifiés améliorerait l'expérience des résidentes et résidents.

Entrustable Professional Activities in Oral and Maxillofacial Surgery Education: A Faculty Development Construct.

The formative and summative evaluations of oral and maxillofacial surgery residents have commonly involved the six core competencies of the Accreditation Council for Graduate Medical Education. Unfortunately, the assessment of a resident's competencies in these six core areas is often subjective such that the written feedback might not be supportive of the resident's learning and continuous professional development. Compounding this problem is that faculty are infrequently trained in providing feedback in these core competencies, thereby adding to the inadequacy of this exercise. Entrustable professional activities (EPAs) represent a unit of professional practice, defined as tasks or responsibilities to be entrusted to the unsupervised execution by a trainee once he or she has attained sufficient specific competence. It is the purpose of this article to review the concept of EPAs that represent a hopeful solution to the theoretical and abstract nature of exclusive competency-based training assessments in resident education. EPAs are specifically proposed for oral and maxillofacial surgery resident education while discussing their serving as a faculty development construct.

Factors influencing academic failure rate among first-year Indian medical students who experienced competency-based medical education curriculum during the COVID-19 pandemic.

OBJECTIVES: The primary objective of the study was to assess the factors that influenced the increased failure rate among first-year Indian medical students who appeared for the Maharashtra University of Health Science (MUHS) summative university examination, having experienced the competency-based medical education (CBME) curriculum for the first time amid the coronavirus disease (COVID-19) pandemic. METHODS: A retrospective cross-sectional online questionnaire-based study was undertaken between July 2021 and November 2021, in which first-year Indian medical students who were enrolled in the Bachelor of Medicine, Bachelor of Surgery (MBBS) program in the year 2019 and appeared for the MUHS summative university examination in February 2021 were invited to participate. Analysis was done using JASP (v0.16.0.0), and the odds ratio for failure was calculated at a significance level of P < 0.05. RESULTS: Responses were obtained from 360 individuals, of whom 74.5% had passed and 25.5% had failed (n = 360). The odds of failure in first-year MBBS summative university examination was higher in students with irregular Internet access, irregular device access, an unsupportive peer environment in college, a National Entrance cum Eligibility Test score below 500, an unsupportive family environment during the lockdown, severe stress, severe depression, testing positive for COVID-19 before the exam, death in the family during the exam, and failing in terms and prelims and students of male gender ( P < 0.01). CONCLUSION: The total failure rate of 27% in the MUHS examination was mainly attributed to interplay between the student's mental health, lack of devices or Internet, and the changed assessment part of the CBME curriculum. Surprisingly, lecture frequencies, teaching patterns, and study resources did not influence the failure rate. These results can be used to formulate interventions that will help to improve academic performance and mental health students and thus help them adapt to the new curriculum.

Fit for Service: Preparing Residents for Neurointensive Care with Entrustable Professional Activities: A Delphi Study.

BACKGROUND: Although the relevance of neurointensive medicine and high-quality training of corresponding physicians is increasingly recognized, there is high heterogeneity in the nature, duration, and quality of neurointensive care curricula around the world. Thus, we aimed to identify, define, and establish validity evidence for entrustable professional activities (EPAs) for postgraduate training in neurointensive care to determine trainees' readiness for being on-call. METHODS: After defining EPAs through an iterative process by an expert group, we used a modified Delphi approach with a single-center development process followed by a national consensus and a single-center validation step. EPAs were evaluated by using the EQual rubric (Queen's EPA Quality Rubric). Interrater reliability was measured with Krippendorff's α. RESULTS: The expert group defined seven preliminary EPAs for neurointensive care. In two consecutive Delphi rounds, EPAs were adapted, and consensus was reached for level of entrustment and time of expiration. Ultimately, EPAs reached a high EQual score of 4.5 of 5 and above. Interrater reliability for the EQual scoring was 0.8. CONCLUSIONS: Using a multistep Delphi process, we defined and established validity evidence for seven EPAs for neurointensive medicine with a high degree of consensus to objectively describe readiness for on-call duty in neurointensive care. This operationalization of pivotal clinical tasks may help to better train clinical residents in neurointensive care across sites and health care systems and has the potential to serve as a blueprint for training in general intensive care medicine. It also represents a starting point for further research and development of medical curricula.

Twelve tips for using the Understanding by Design® curriculum planning framework.

BACKGROUND: Health professions faculty engaged in curriculum planning or redesign can struggle with developing courses or programs that align desired learner outcomes, such as competencies to be applied in a clinical setting, with assessment and instruction. AIMS: Our medical school implemented the Understanding by Design (UbD) framework to achieve alignment of outcomes, assessments and teaching during the renewal of our four-year curriculum. This article shares our strategies and practices for implementing UbD with teams of faculty curriculum developers. DESCRIPTION: The UbD framework is a 'backward' approach to curriculum development that begins by identifying learner outcomes, followed by the development of assessments that demonstrate achievement of competencies and concludes with the design of active learning experiences. UbD emphasizes the development of deep understandings that learners can transfer to novel contexts. CONCLUSIONS: We found UbD to be a flexible, adaptable approach that aligns program and course-level outcomes with learner-centred instruction and principles of competency-based medical education and assessment.

Exploring Interprofessional Development of Entrustable Professional Activities For Pediatric Intensive Care Fellows: A Proof-of-Concept Study.

Phenomenon: Entrustable professional activities (EPAs) delineate major professional activities that an individual in a given specialty must be "entrusted" to perform, ultimately without supervision, to provide quality patient care. Until now, most EPA frameworks have been developed by professionals within the same specialty. As safe, effective, and sustainable health care ultimately depends on interprofessional collaboration, we hypothesized that members of interprofessional teams might have clear and possibly additional insight into which activities are essential to the professional work of a medical specialist. Approach: We recently employed a national modified Delphi study to develop and validate a set of EPAs for Dutch pediatric intensive care fellows. In this proof-of-concept study, we explored what pediatric intensive care physicians' non-physician team members (physician assistants, nurse practitioners, and nurses) constitute as essential professional activities for PICU physicians and how they regarded the newly developed set of nine EPAs. We compared their judgments with the PICU physicians' opinions. Findings: This study shows that non-physician team members share a mental model with physicians about which EPAs are indispensable for pediatric intensive care physicians. Despite this agreement however, descriptions of EPAs are not always clear for non-physician team members who have to work with them on a daily basis. Insights: Ambiguity as to what an EPA entails when qualifying a trainee can have implications for patient safety and trainees themselves. Input from non-physician team members may add to the clarity of EPA descriptions. This finding supports the involvement of non-physician team members in the developmental process of EPAs for (sub)specialty training programs.

Development of the core competency-based entrustable professional activities for Master of Nursing Specialist (MNS) graduates in China.

BACKGROUND: Advanced nursing practice and education with a Master's degree as the necessary preparation, is viewed as a major strategy to cultivate senior nursing talents. Competencies are central to advanced nursing practice and education, but how can competencies be measured? Entrustable professional activities (EPAs) have been used widely in medicine as a practical approach for bridging the gaps between competency and clinical practice. Considering the paucity of research in EPAs for nursing graduates in China, it is needed to develop EPAs specifically for Chinese Master of Nursing Specialist (MNS) graduates to improve patient safety and quality patient care. OBJECTIVES: To develop and evaluate a core competency-based EPAs framework for Chinese MNS graduates. METHODS: A four-stage approach was adopted for the EPAs development, including: (1) forming a research team, (2) drafting an initial EPAs framework, (3) reviewing EPAs framework, and (4) conducting EPAs consensus assessment. RESULTS: A framework containing twelve EPAs was developed, including: 1) perform health assessments, 2) identify and prioritize nursing diagnoses, 3) formulate and implement care plan, 4) perform basic and specialized care operations, 5) recognize and manage medication needs of patients, 6) assess and manage patients with mental health problems, 7) recognize and assist in rescuing critically ill patients, 8) perform transition and handover, 9) participate in multidisciplinary team collaborative care, 10) provide health education and nursing consultation, 11) formulate and implement discharge plans, and 12) instruct nursing students in a clinical setting. The I-CVI score for the two rounds of Delphi ranged from 0.92 ∼ 1.00 and 0.96 ∼ 1.00, respectively. The mean of Equal's score for the three domains ranged from 4.20 ∼ 4.47, 4.25 ∼ 4.51, and 4.23 ∼ 4.37, respectively. CONCLUSION: The developed EPAs framework in this study is a reliable tool to assess the core competencies of Chinese MNS graduates in clinical practice and assist with their curricula design.

Advancing anti-oppression and social justice in healthcare through competency-based medical education (CBME).

Competency-based medical education (CBME) focuses on preparing physicians to improve the health of patients and populations. In the context of ongoing health disparities worldwide, medical educators must implement CBME in ways that advance social justice and anti-oppression. In this article, authors describe how CBME can be implemented to promote equity pedagogy, an approach to education in which curricular design, teaching, assessment strategies, and learning environments support learners from diverse groups to be successful. The five core components of CBME programs - outcomes competency framework, progressive sequencing of competencies, learning experiences tailored to learners' needs, teaching focused on competencies, and programmatic assessment - enable individualization of learning experiences and teaching and encourage learners to partner with their teachers in driving their learning. These educational approaches appreciate each learner's background, experiences, and strengths. Using an exemplar case study, the authors illustrate how CBME can afford opportunities to enhance anti-oppression and social justice in medical education and promote each learner's success in meeting the expected outcomes of training. The authors provide recommendations for individuals and institutions implementing CBME to enact equity pedagogy.

Competency-based medical education: The spark to ignite healthcare's escape fire.

High-value care is what patients deserve and what healthcare professionals should deliver. However, it is not what happens much of the time. Quality improvement master Dr. Don Berwick argued more than two decades ago that American healthcare needs an escape fire, which is a new way of seeing and acting in a crisis situation. While coined in the U.S. context, the analogy applies in other Western healthcare contexts as well. Therefore, in this paper, the authors revisit Berwick's analogy, arguing that medical education can, and should, provide the spark for such an escape fire across the globe. They assert that medical education can achieve this by fully embracing competency-based medical education (CBME) as a way to place medicine's focus on the patient. CBME targets training outcomes that prepare graduates to optimize patient care. The authors use the escape fire analogy to argue that medical educators must drop long-held approaches and tools; treat CBME implementation as an adaptive challenge rather than a technical fix; demand genuine, rich discussions and engagement about the path forward; and, above all, center the patient in all they do.

The future of health professions education.

The need for a fit-for-purpose curriculum with a closer alignment of health professions education with society's needs was addressed at the International Conference on the Future of Health Professions Education held in Miami in November 2022. Issues discussed at the Conference were equity, competency-based education, technology enhanced learning, interprofessional education, lifelong learning, international collaborations, and the changing role of students.

The past, present and future of medical education in Cambodia.

This paper describes the past, present, and future of medical education in Cambodia. Although doctor training began in 1902, the first medical school was not founded until 1946. Since the colonial era, the curriculum and teaching strategies have been strongly influenced by the French system, dominated by didactic lectures and the apprenticeship model. Three chronic issues have plagued medical education in the country following the Khmer Rouge regime: a shortage of doctors, poor-quality training, and lack of relevance to the current and future population needs. An increasing number of medical schools and yearly student enrollment have addressed the first issue. Today, the fundamental challenges have shifted from quantity to ensuring the quality and relevance of medical education. Competency-based medical education (CBME) has been adopted as a new curricular model to tackle the latter two issues. Active collaboration between government institutions, public universities, and development partners drives this curricular reform at the national and institutional levels. This paper further examines the challenges associated with medical education and proposes recommendations.

Curriculum, competency development, and assessment methods of MSc and PhD pharmacy programs: a scoping review.

BACKGROUND/OBJECTIVES: We aim to systematically review and evaluate the current landscape of postgraduate pharmacy education to a) identify current evidence, best practices, challenges, recommendations, and solutions; and b) develop a framework to optimize postgraduate pharmacy programs. METHODS: A scoping review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR). Electronic databases, including PubMed, Scopus, EMBASE, ProQuest, Web of Science, and Google Scholar were utilized. The search covered studies published from January 2011 to September 2023. Following the principles of Arksey and O'Malley's framework, data charting and extraction were performed using a pre-designed data collection tool, followed by the synthesis and grouping of studies based on common themes. RESULTS: Of the 5542 articles found, the review included 36 eligible ones focusing on pharmacy postgraduate education (PhD and MSc), grouped into three themes: 1) courses and curriculum; 2) training and skills development; 3) assessment and mentorship methods. Utilized methodologies included descriptive analyses, questionnaires, surveys, trials, and focus groups/interviews. The studies underscored the need for competency-based curricula with regular evaluations, career planning, and diverse course offerings. Identified key skills and competencies in the studies included soft skills, communication, research, desperate skills (e.g., leadership and management), and critical thinking. The studies also emphasized the value of comprehensive evaluation and peer review methods. Challenges included balancing academic and real-world requirements, training, limited resources, time constraints, and faculty workload. CONCLUSION: Evidence-based suggestions to improve postgraduate pharmacy education include the implementation of practice-oriented courses, value of tailored/or comprehensive assessments, focus on real-world skills, effectiveness of advanced teaching methods, and mentorship role. The proposed framework can guide program enhancement and highlight the need to improve programs holistically, entailing the three themes.

Clinical supervisors' experience of a first-time application of entrustable professional activities in clinical supervision of medical students: findings from a Swedish pilot study.

BACKGROUND: Recently, all medical universities in Sweden jointly developed a framework for Entrustable Professional Activities (EPAs) for work-based training and assessment. This framework is now being introduced nationally in the new 6-year undergraduate medical programme that directly lead to a licence to practise. When EPAs are introduced, it is of central importance to gain clinical supervisors' acceptance to apply the framework in their supervision of students. The aim of this study was therefore to investigate how clinical supervisors, not familiar with EPAs, experience clinical supervision using the framework for EPAs. METHODS: We used a purposive sampling to recruit clinical supervisors. They were given written information on EPAs with a selection of suitable EPAs and the Swedish observation rating scale for assessment of autonomy, and they were offered to attend a 30-minute introductory web course. The participants were informed that EPAs were to be tested, and the students were asked to participate. After the study period the clinical supervisors participated in semi-structured interviews. Inductive qualitative content analysis was used to analyse the transcribed interviews. RESULTS: Three general themes emerged in the qualitative analysis: Promoting Feedback, Trusting Assessments and Engaging Stakeholders. The participants described benefits from using EPAs, but pointed out a need for preparation and adaptation to facilitate implementation. The structure was perceived to provide structured support for feedback, student involvement, entrustment decisions, enabling supervisors to allow the students to do more things independently, although some expressed caution to rely on others' assessments. Another concern was whether assessments of EPAs would be perceived as a form of examination, steeling focus from formative feedback. To understand the concept of EPA, the short web-based course and written information was regarded as sufficient. However, concern was expressed whether EPA could be applied by all clinical supervisors. Involvement and adaption of the workplace was pointed out as important since more frequent observation and feedback, with documentation requirements, increase the time required for supervision. CONCLUSIONS: EPAs were accepted as beneficial, promoting structured feedback and assessments of the students' autonomy. Preparation of supervisors and students as well as involvement and adaptation of the workplace was pointed out as important.

AI in medical education: uses of AI in construction type A MCQs.

BACKGROUND: The introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands for high-quality test items to be used in assessments. This study aimed to assess the use of an AI tool to generate MCQs type A and evaluate its quality. METHODS: The study design was cross-sectional analytics conducted from June 2023 to August 2023. This study utilized formative TBL. The AI tool (ChatPdf.com) was selected to generate MCQs type A. The generated items were evaluated using a questionnaire for subject experts and an item (psychometric) analysis. The questionnaire to the subject experts about items was formed based on item quality and rating of item difficulty. RESULTS: The total number of recurrent staff members as experts was 25, and the questionnaire response rate was 68%. The quality of the items ranged from good to excellent. None of the items had scenarios or vignettes and were direct. According to the expert's rating, easy items represented 80%, and only two had moderate difficulty (20%). Only one item out of the two moderate difficulties had the same difficulty index. The total number of students participating in TBL was 48. The mean mark was 4.8 ± 1.7 out of 10. The KR20 is 0.68. Most items were of moderately difficult (90%) and only one was difficult (10%). The discrimination index of the items ranged from 0.77 to 0.15. Items with excellent discrimination represented 50% (5), items with good discrimination were 3 (30%), and only one time was poor (10%), and one was none discriminating. The non-functional distractors were 26 (86.7%), and the number of non-functional distractors was four (13.3%). According to distractor analysis, 60% of the items were excellent, and 40% were good. A significant correlation (p = 0.4, r = 0.30) was found between the difficulty and discrimination indices. CONCLUSION: Items constructed using AI had good psychometric properties and quality, measuring higher-order domains. AI allows the construction of many items within a short time. We hope this paper brings the use of AI in item generation and the associated challenges into a multi-layered discussion that will eventually lead to improvements in item generation and assessment in general.