Cardiac Critical Care Fellowship Training in the United States and Canada: Pediatric Cardiac Intensive Care Society-Endorsed Subcompetencies to the 2022 Entrustable Professional Activities.

OBJECTIVES: We aimed to define and map subcompetencies required for pediatric cardiac critical care (PCCC) fellowship education and training under the auspices of the Pediatric Cardiac Intensive Care Society (PCICS). We used the 2022 frameworks for PCCC fellowship learning objectives by Tabbutt et al and for entrustable professional activities (EPAs) by Werho et al and integrated new subcompetencies to the EPAs. This complementary update serves to provide a foundation for standardized trainee assessment tools for PCCC. DESIGN: A volunteer panel of ten PCICS members who are fellowship education program directors in cardiac critical care used a modified Delphi method to develop the update and additions to the EPA-based curriculum. In this process, the experts rated information independently, and repetitively after feedback, before reaching consensus. The agreed new EPAs were later reviewed and unanimously accepted by all PCICS program directors in PCCC in the United States and Canada and were endorsed by the PCICS in 2023. PROCEDURE AND MAIN RESULTS: The procedure for defining new subcompetencies to the established EPAs comprised six consecutive steps: 1) literature search; 2) selection of key subcompetencies and curricular components; 3) written questionnaire; 4) consensus meeting and critical evaluation; 5) approval by curriculum developers; and 6) PCICS presentation and endorsement. Overall, 110 subcompetencies from six core-competency domains were mapped to nine EPAs with defined levels of entrustment and examples of simple and complex cases. To facilitate clarity and develop a future assessment tool, three EPAs were subcategorized with subcompetencies mapped to the appropriate subcategory. The latter covering common procedures in the cardiac ICU. CONCLUSIONS: This represents the 2023 update to the PCCC fellowship education and training EPAs with the defining and mapping of 110 subcompetencies to the nine established 2022 EPAs. This goal of this update is to serve as the next step in the integration of EPAs into a standardized competency-based assessment framework for trainees in PCCC.

Factors influencing academic failure rate among first-year Indian medical students who experienced competency-based medical education curriculum during the COVID-19 pandemic.

OBJECTIVES: The primary objective of the study was to assess the factors that influenced the increased failure rate among first-year Indian medical students who appeared for the Maharashtra University of Health Science (MUHS) summative university examination, having experienced the competency-based medical education (CBME) curriculum for the first time amid the coronavirus disease (COVID-19) pandemic. METHODS: A retrospective cross-sectional online questionnaire-based study was undertaken between July 2021 and November 2021, in which first-year Indian medical students who were enrolled in the Bachelor of Medicine, Bachelor of Surgery (MBBS) program in the year 2019 and appeared for the MUHS summative university examination in February 2021 were invited to participate. Analysis was done using JASP (v0.16.0.0), and the odds ratio for failure was calculated at a significance level of P < 0.05. RESULTS: Responses were obtained from 360 individuals, of whom 74.5% had passed and 25.5% had failed (n = 360). The odds of failure in first-year MBBS summative university examination was higher in students with irregular Internet access, irregular device access, an unsupportive peer environment in college, a National Entrance cum Eligibility Test score below 500, an unsupportive family environment during the lockdown, severe stress, severe depression, testing positive for COVID-19 before the exam, death in the family during the exam, and failing in terms and prelims and students of male gender ( P < 0.01). CONCLUSION: The total failure rate of 27% in the MUHS examination was mainly attributed to interplay between the student's mental health, lack of devices or Internet, and the changed assessment part of the CBME curriculum. Surprisingly, lecture frequencies, teaching patterns, and study resources did not influence the failure rate. These results can be used to formulate interventions that will help to improve academic performance and mental health students and thus help them adapt to the new curriculum.

Development, implementation, and evaluation of entrustable professional activities (EPAs) for medical radiation technologists in Taiwan: a nationwide experience.

BACKGROUND: Competency-based medical education (CBME) is an outcomes-oriented approach focused on developing competencies that translate into clinical practice. Entrustable professional activities (EPAs) bridge competency assessment and clinical performance by delineating essential day-to-day activities that can be entrusted to trainees. EPAs have been widely adopted internationally, but not yet implemented for medical radiation professionals in Taiwan. MATERIALS AND METHODS: A nationwide consensus process engaged 97 experts in radiation technology education representing diagnostic radiography, radiation therapy, and nuclear medicine. Preliminary EPAs were developed through the focus group discussion and the modified Delphi method. The validity of these EPAs was evaluated using the QUEPA and EQual tools. RESULTS: Through iterative consensus building, six core EPAs with 18 component observable practice activities (OPAs) in total were developed, encompassing routines specific to each radiation technology specialty. QUEPA and EQual questionnaire data verified these EPAs were valid, and of high quality for clinical teaching and evaluation. CONCLUSION: The consensus development of tailored EPAs enables rigorous competency assessment during medical radiation technology education in Taiwan. Further expansion of EPAs and training of clinical staff could potentially enhance care quality by producing competent professionals.

Teaching Evidence-Based Practice Competencies to Meet Professional Practice Needs.

BACKGROUND: Evidence-based practice (EBP) is a major concept threaded throughout nursing education, yet competencies are not clearly identified in The Essentials. PURPOSE: Nurse leaders'EBP competency expectations for professional practice were explored to inform competency-based education for students and practicing nurses. A secondary aim explored potential effects of misinformation on EBP. METHODS: Descriptive qualitative inquiry was performed with a focus group of 6 clinical nurse leaders. RESULTS: EBP expectations were identified, discriminating between novice entry level and advanced-level nurses. Participants emphasized asking questions, linking evidence to practice, and acknowledging that evidence changes over time. All advanced-level nurses were expected to apply, lead, and teach EBP. Post pandemic, nurses need to reclaim evidence-based practices, critically appraise evidence, and educate patients and families to address misinformation. CONCLUSIONS: Information learned will inform competency-based EBP education for students and nurses in academic and clinical settings.

Competency-Based Virtual Clinical Practicum in Response to COVID-19 Pandemic: A Quality Improvement Project.

PURPOSE: The purpose of the quality improvement (QI) project was to provide a learner and faculty preceptor high quality virtual clinical practicum (VCP) for Wound, Ostomy, Continence (WOC) Nurse learners during the COVID-19 pandemic and disseminate findings. PARTICIPANTS AND SETTING: Project participants were registered nurses post-bachelor's degree or higher with a minimum of 1-year clinical experience who had completed and passed the didactic portion of a Wound Ostomy Continence Nursing Education Program (WOCNEP). Learners completing the WOCNEP's VCP and the faculty preceptors were the subjects for this QI report. The setting was a virtual platform allowing live time visibility and interactions between learners and faculty preceptors including the ability to share documents and procedural videos. An initial group of 62 learners were asked open-ended questions after completion of the VCP; the most frequently recurring themes were converted into 5-point Likert scale questions as the evaluation tool completed by an additional 234 learners. In total, 296 learners completing the VCP evaluated this novel 100% simulation virtual practicum. APPROACH: This QI project evaluated a 100% simulation-based practicum at a WOCENP based in the United States. A competency based VCP used the Competency Outcomes and Performance Assessment (COPA) model. Learners were taught competencies via a preparatory virtual lab and then had to prepare documents and videos or pictures with step-by-step instructions prior to attending a Live Competency Assessment Lab with faculty preceptors and a small group of peer learners. OUTCOMES: Appraisal of the VCP was based on course evaluations anonymously completed by each of the 296 learners. Faculty preceptors were queried regarding their VCP evaluation and certification exam pass rates were tallied. Findings indicate positive outcomes of the VCP competency-based practicum from student and faculty preceptor perspectives along with higher certification pass rates; specifically, wound care pass rates increased by 16%, ostomy care increased by 18% and continence care pass rates increased by 13%. IMPLICATIONS FOR PRACTICE: Our reported experiences strongly suggest a VCP offers an attractive option for fulfilling practicum requirements while reducing barriers of the in-person split option practicum.

Applying a Competency-Based Medical Education Framework to Development of Residents' Feedback Skills.

OBJECTIVE: Feedback is a critically important tool in medical education. This pilot program applies and evaluates a competency-based approach to develop residents' skills in providing feedback to medical students. METHODS: In 2018-2019, a competency-based resident feedback skills program incorporating videorecording of skills, multi-source feedback using assessment tools with validity evidence, and sequential deliberate practice was piloted in a single-center, prospective study at the University of Rochester. Study participants included eight second-year psychiatry residents and 23 third-year clerkship students. After an introduction to foundational feedback concepts in didactic sessions, residents were videorecorded providing feedback to medical students. Recordings were reviewed with a faculty member for feedback. Skills were assessed by students who had received resident feedback, residents, and faculty utilizing a tool with validity evidence. Observations were repeated a total of three times. RESULTS: Mean feedback scores increased from 2.70 at the first feedback observation, to 2.77 at the second feedback observation, to 2.89 at the third feedback observation (maximum 3.00 points). The differences between the first and third sessions (0.19) and second and third sessions (0.12) were statistically significant (p values were < .001 and .007, with SE of 0.4 and 0.4, respectively). CONCLUSIONS: The observed competency-based feedback skills training program for residents using sequential, multi-source review and feedback was feasible and effective. Direct observation is a key component of high-quality feedback, and videorecording is an efficient methodology for observations, enabling both direct observation by the assessor and opportunity for enhanced self-assessment by residents viewing themselves in the feedback encounter.

Implementation of Entrustable Professional Activities in General Surgery: Results of a National Pilot Study.

OBJECTIVE: The ongoing complexity of general surgery training has led to an increased focus on ensuring the competence of graduating residents. Entrustable professional activities (EPAs) are units of professional practice that provide an assessment framework to drive competency-based education. The American Board of Surgery convened a group from the American College of Surgeons, Accreditation Council for Graduate Medical Education (ACGME) Surgery Review Committee, and Association of Program Directors in Surgery to develop and implement EPAs in a pilot group of residency programs across the country. The objective of this pilot study was to determine the feasibility and utility of EPAs in general surgery resident training. METHODS: 5 EPAs were chosen based on the most common procedures reported in ACGME case logs and by practicing general surgeons (right lower quadrant pain, biliary disease, inguinal hernia), along with common activities covering additional ACGME milestones (performing a consult, care of a trauma patient). Levels of entrustment assigned (1 to 5) were observation only, direct supervision, indirect supervision, unsupervised, and teaching others. Participating in site recruitment and faculty development occurred from 2017 to 2018. EPA implementation at individual residency programs began on July 1, 2018, and was completed on June 30, 2020. Each site was assigned 2 EPAs to implement and collected EPA microassessments on residents for those EPAs. The site clinical competency committees (CCC) used these microassessments to make summative entrustment decisions. Data submitted to the independent deidentified data repository every 6 months included the number of microassessments collected per resident per EPA and CCC summative entrustment decisions. RESULTS: Twenty-eight sites were selected to participate in the program and represented geographic and size variability, community, and university-based programs. Over the course of the 2-year pilot programs reported on 14 to 180 residents. Overall, 6,272 formative microassessments were collected (range, 0 to 1144 per site). Each resident had between 0 and 184 microassessments. The mean number of microassessments per resident was 5.6 (SD = 13.4) with a median of 1 [interquartile range (IQR) = 6]. There were 1,763 summative entrustment ratings assigned to 497 unique residents. The average number of observations for entrustment was 3.24 (SD 3.61) with a median of 2 (IQR 3). In general, PGY1 residents were entrusted at the level of direct supervision and PGY5 residents were entrusted at unsupervised practice or teaching others. For each EPA other than the consult EPA, the degree of entrustment reported by the CCC increased by resident level. CONCLUSIONS: These data provide evidence that widespread implementation of EPAs across general surgery programs is possible, but variable. They provide meaningful data that graduating chief residents are entrusted by their faculty to perform without supervision for several common general surgical procedures and highlight areas to target for the successful widespread implementation of EPAs.

"A whole other competence story": exploring faculty perspectives on the process of workplace-based assessment of entrustable professional activities.

The centrality of entrustable professional activities (EPAs) in competency-based medical education (CBME) is predicated on the assumption that low-stakes, high-frequency workplace-based assessments used in a programmatic approach will result in accurate and defensible judgments of competence. While there have been conversations in the literature regarding the potential of this approach, only recently has the conversation begun to explore the actual experiences of clinical faculty in this process. The purpose of this qualitative study was to explore the process of EPA assessment for faculty in everyday practice. We conducted 18 semi-structured interviews with Anesthesia faculty at a Canadian academic center. Participants were asked to describe how they engage in EPA assessment in daily practice and the factors they considered. Interviews were audio-recorded, transcribed, and analysed using the constant comparative method of grounded theory. Participants in this study perceived two sources of tension in the EPA assessment process that influenced their scoring on official forms: the potential constraints of the assessment forms and the potential consequences of their assessment outcome. This was particularly salient in circumstances of uncertainty regarding the learner's level of competence. Ultimately, EPA assessment in CBME may be experienced as higher-stakes by faculty than officially recognized due to these tensions, suggesting a layer of discomfort and burden in the process that may potentially interfere with the goal of assessment for learning. Acknowledging and understanding the nature of this burden and identifying strategies to mitigate it are critical to achieving the assessment goals of CBME.

Competency-based medical education and the McNamara fallacy: Assessing the important or making the assessed important?

The McNamara fallacy refers to the tendency to focus on numbers, metrics, and quantifiable data while disregarding the meaningful qualitative aspects. The existence of such a fallacy in medical education is reviewed in this paper. Competency-based medical education (CBME) has been introduced in India with the goal of having Indian Medical Graduates competent in five different roles - Clinician, Communicator, Leader and member of the health care team, Professional, and Lifelong learner. If we only focus on numbers and structure to assess the competencies pertaining to these roles, we would be falling prey to the McNamara fallacy. To assess these roles in the real sense, we need to embrace the qualitative assessment methods and appreciate their value in competency-based education. This can be done by using various workplace-based assessments, choosing tools based on educational impact rather than psychometric properties, using narratives and descriptive evaluation, giving grades instead of marks, and improving the quality of the questions asked in various exams. There are challenges in adopting qualitative assessment starting with being able to move past the objective-subjective debate, to developing expertise in conducting and documenting such assessment, and adding the rigor of qualitative research methods to enhance its credibility. The perspective on assessment thus needs a paradigm shift - we need to assess the important rather than just making the assessed important; and this would be crucial for the success of the CBME curriculum.

Defining activities in neurovascular microsurgery training: entrustable professional activities for vascular neurosurgery.

BACKGROUND: Entrustable professional activities (EPAs) represent an assessment framework with an increased focus on competency-based assessment. Originally developed and adopted for undergraduate medical education, concerns over resident ability to practice effectively after graduation have led to its implementation in residency training but yet not in vascular neurosurgery. Subjective assessment of resident or fellow performance can be problematic, and thus, we aim to define core EPAs for neurosurgical vascular training. METHODS: We used a nominal group technique in a multistep interaction between a team of experienced neurovascular specialists and a medical educator to identify relevant EPAs. Panel members provided feedback on the EPAs until they reached consent. RESULTS: The process produced seven core procedural EPAs for vascular residency and fellowship training, non-complex aneurysm surgery, complex aneurysm surgery, bypass surgery, arteriovenous malformation resection, spinal dural fistula surgery, perioperative management, and clinical decision-making. CONCLUSION: These seven EPAs for vascular neurosurgical training may support and guide the neurosurgical society in the development and implementation of EPAs as an evaluation tool and incorporate entrustment decisions in their training programs.

How much is enough? Proposing achievement thresholds for core EPAs of graduating medical students in Canada.

PURPOSE: The transition towards Competency-Based Medical Education at the Cumming School of Medicine was accelerated by the reduced clinical time caused by the COVID-19 pandemic. The purpose of this study was to define a standard protocol for setting Entrustable Professional Activity (EPA) achievement thresholds and examine their feasibility within the clinical clerkship. METHODS: Achievement thresholds for each of the 12 AFMC EPAs for graduating Canadian medical students were set by using sequential rounds of revision by three consecutive groups of stakeholders and evaluation experts. Structured communication was guided by a modified Delphi technique. The feasibility/consequence models of these EPAs were then assessed by tracking their completion by the graduating class of 2021. RESULTS: The threshold-setting process resulted in set EPA achievement levels ranging from 1 to 8 across the 12 AFMC EPAs. Estimates were stable after the first round for 9 of 12 EPAs. 96.27% of EPAs were successfully completed by clerkship students despite the shortened clinical period. Feasibility was predicted by the slowing rate of EPA accumulation overtime during the clerkship. CONCLUSION: The process described led to consensus on EPA achievement thresholds. Successful completion of the assigned thresholds was feasible within the shortened clerkship.[Box: see text].

Relationship between epa level of supervision with their associated subcompetency milestone levels in pediatric fellow assessment.

BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment. OBJECTIVES: We hypothesized that 1) there would be a strong correlation between EPA LOS ratings with the milestone levels for the subcompetencies mapped to the EPA; 2) some subcompetencies would be more critical in determining entrustment decisions than others, and 3) the correlation would be weaker if the analysis included only milestones reported to the Accreditation Council for Graduate Medical Education (ACGME). METHODS: In fall 2014 and spring 2015, the Subspecialty Pediatrics Investigator Network asked Clinical Competency Committees to assign milestone levels to each trainee enrolled in a pediatric fellowship for all subcompetencies mapped to 6 Common Pediatric Subspecialty EPAs as well as provide a rating for each EPA based upon a 5-point LOS scale. RESULTS: One-thousand forty fellows were assessed in fall and 1048 in spring, representing about 27% of all fellows. For each EPA and in both periods, the average milestone level was highly correlated with LOS (rho range 0.59-0.74; p < 0.001). Correlations were similar when using a weighted versus unweighted milestone score or using only the ACGME reported milestones (p > 0.05). CONCLUSIONS: We found a strong relationship between milestone level and EPA LOS rating but no difference if the subcompetencies were weighted, or if only milestones reported to the ACGME were used. Our results suggest that representative behaviors needed to effectively perform the EPA, such as key subcompetencies and milestones, allow for future language adaptations while still supporting the current model of assessment. In addition, these data provide additional validity evidence for using these complementary tools in building a program of assessment.

Competency-Based Medical Education in Canadian Radiation Oncology Residency Training: an Institutional Implementation Pilot Study.

Canadian radiation oncology (RO) residency programs transitioned to a competency-based medical education (CBME) training model named Competence by Design (CBD) in July 2019. Prior to this, CBD was piloted in a single RO training program to characterize assessment completion and challenges of implementation. Six residents and seven staff participated in a mixed-methods study and were oriented to CBD. Four Entrustable Professional Activities were assessed over a 4-week-long block and documented using online assessment forms. Anonymized assessments were analyzed to characterize completion. Post-pilot surveys were completed by 4/6 residents and 5/7 staff. Semi-structured post-pilot focus groups were conducted with all residents. Assessments were requested and documented on a weekly basis. Narrative comments were found in 68.1% of assessments, of which 26.7% described specific examples of observed competence or recommendations for improvement. Three of five staff believed that assessments have a negative impact on clinical workflow. Three themes were identified: (1) direct observation is the most challenging aspect of CBD to implement; (2) feedback content can be improved; and (3) staff attitude, clinical workflow, and inaccessibility of assessment forms are the primary barriers to completing assessments. This study demonstrates that CBD assessments can be completed regularly in an outpatient radiation oncology setting and that implementation challenges include improving feedback quality, promoting direct observation, and continuing faculty development to improve perceptions of this assessment model. Further study is required to identify best practices and expectations for the discipline in the era of CBME.

Need for Pandemic Preparedness Teaching during the Medical Curriculum.

When we talk about 20-20 it goes without saying that we are talking about Indian Premier League matches. But when we talk about 2020, we get goosebumps even remembering the memories of the coronavirus disease 2019 (COVID-19) pandemic! It was just about that time when the National Medical Commission (NMC) rolled out the Competency-based Medical Education (CBME) curriculum for the first Bachelor of Medicine, Bachelor of Surgery (MBBS) batch admitted in the 2019-2020 academic year. Who knew that the timetable so well planned would go for a toss due to the global pandemic? It was indeed a learning lesson for all. The word pandemic is derived from the Greek words pan = all and demos = people. An epidemic that affects large geographic areas across the entire world at the same time is called a pandemic. Most of the pandemics are caused by viruses, for example, influenza, acquired immune deficiency syndrome, and now COVID-19. Susceptible individuals get affected, they transmit the organism to many individuals in a short time. International travel spreads the disease globally in a short time and a pandemic is declared. Hence, it is the need of the hour to sensitize the medical students by incorporating the pandemic preparedness module in the medical curriculum. How to cite this article: Londhey V. Need for Pandemic Preparedness Teaching during the Medical Curriculum. J Assoc Physicians India 2023;71(10):11-12.

Establishing Entrustable Professional Activities in Pediatric Cardiac Critical Care.

OBJECTIVES: Define a set of entrustable professional activities for pediatric cardiac critical care that are recognized as the core activities of the subspecialty by a diverse group of pediatric cardiac critical care physicians and that can be broadly and consistently applied irrespective of training pathway. DESIGN: Mixed methods study with sequential integration of qualitative and quantitative data. SETTING: Structured telephone interviews of pediatric cardiac critical care medical directors at Pediatric Cardiac Critical Care Consortium centers followed by an electronic survey of pediatric cardiac critical care physician members of the Pediatric Cardiac Intensive Care Society from across the United States and internationally. SUBJECTS: Pediatric cardiac intensive care physicians. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Twenty-four of 26 eligible Pediatric Cardiac Critical Care Consortium medical directors participated in the interviews. Based on qualitative analyses of interview data, we identified an initial set of nine entrustable professional activities. Fifty-eight of 185 eligible physicians completed a subsequent survey asking them to rate their agreement with the entrustable professional activities. It showed consensus (> 80% agreement) with the entire initial set of entrustable professional activities, with greater than 96% agreement in most cases. The feedback from free-text survey responses was incorporated to generate a final set of entrustable professional activities. CONCLUSIONS: We generated a set of nine entrustable professional activities, which we believe can be broadly applied to any physician training in pediatric cardiac critical care, irrespective of individual training pathway. Next steps include incorporation of these entrustable professional activities into curriculum design and trainee assessment tools.

Making prospective entrustment decisions: Knowing limits, seeking help and defaulting.

INTRODUCTION: Many studies focused on entrustment have not considered prospective entrustment decisions, where clinical competency and entrustment committees determine how much supervision trainees will require in the future for tasks occurring in not completely known contexts. The authors sought to explore factors that influence and determine prospective entrustment decisions made by members of such committees in graduate medical education (GME) and undergraduate medical education (UME). METHODS: The authors conducted a constructivist grounded theory study with 23 faculty participants from GME and UME clinical competency and entrustment committees in the United States between October 2020 and March 2021. Interviews sought to explore factors and considerations participants weigh in making prospective entrustment decisions about trainees. Data collection and analysis occurred in an iterative fashion, ensuring constant comparison. Theoretical sampling was used to confirm, disconfirm and elaborate on the evolving results. RESULTS: Trainees' ability to know limits and seek help is the foundation of participants' prospective entrustment decision making. Most participants, however, describe a presumption of trainee readiness to progress and describe commonly making default prospective entrustment decisions unless 'red flags' in performance are present. Although participants desire sufficient and trusted data about trainee performance to inform decisions, they often lack it. Finally, the perceived permanence and consequences of prospective entrustment decisions influence how participants weigh other factors contributing to prospective entrustment decisions. CONCLUSION: Trainees' ability to know limits and seek help appears to be the foundation of prospective entrustment decision making. Training programmes should strive to collect and employ robust data supporting and questioning the presence of these attributes.

Expectations for PhDs in health professions education: an international EPA-framed, modified Delphi study.

Health professions education (HPE) has matured into field of study that employs and produces specialized educational scholars. Many academic institutions employ such scholars to support development and innovation in education. Simultaneously, the possibilities to obtain a PhD degree in HPE are expanding. Clarity in the expectations that such a degree brings along can be useful for scholars, employers and institutions. Anticipating that the views of what a PhD in HPE is or should be can vary between institutions, cultures and countries, we conducted an international Delphi study to identify EPAs for HPE PhDs. We used a framework of 24 EPAs resulted from a national consensus study in Iran as input to seek more generalized validity and a wider consensus of reasonably suitable activities. A three-round modified Delphi study was conducted with participation of 15 international experts. Final framework consisted of 17 relevant EPAs with a justification, specifications and limitations, and risks in case of failure per EPA (all had overall CVI > 0.8 for adequacy of description). Eleven EPAs were considered by the majority to be core to PhD training, 16 to be desirable for HPE PhDs as a capability to carry out without supervision, but the majority would trust current HPE PhDs to carry out only 5 of the 17 without supervision. The EPAs identified in this study arguably reflect the expectations of educators with a PhD degree in HPE. The framework has the potential to advance HPE training across countries and to inform personal development and employment decisions.

Development and consensus of entrustable professional activities for final-year medical students in anaesthesiology.

BACKGROUND: The transfer of classic concepts of competency-based medical education into clinical practice has been proven to be difficult in the past, being described as partially fragmented, misleading and inadequate. At the beginning of training, novice doctors commonly feel overwhelmed, overloaded and exposed to extreme time pressure. The discrepancy between expected and actual clinical competence of doctors at the start of their speciality training jeopardizes patient safety. The framework of Entrustable Professional Activities (EPAs) is a promising instrument to effectively integrate competency-based training into clinical practice and may help to close this gap and consequently to improve patient safety. METHODS: For anaesthesiology, we developed 5 EPAs for final-year medical students. The EPAs comprised the following seven categories: 1. Title, 2. Specifications, 3. Limitations, 4. Competency domains, 5. Knowledge, abilities and skills, professional attitudes, 6. Assessment and 7. Entrustment. Based on a modified, online-based Delphi study, we further developed and refined these EPAs. Education experts were recruited from the alumni network of the Master of Medical Education (MME) degree course from the University of Heidelberg, Germany. RESULTS: 28 data sets were evaluated in three Delphi rounds. 82% of study participants had previous experience with EPAs. Qualitative and quantitative data formed the basis during the iterative process and resulted in complete descriptions of 5 EPAs for final-year medical students in anaesthesiology. CONCLUSIONS: Our study including the associated description of 5 EPAs represent a further step and starting point for EPA-based curricula in medical training in Germany linking undergraduate training, to residency training and continuous medical education.

Implementation of competence by design in Canadian neurosurgery residency programs.

OBJECTIVE: The Royal College of Physicians and Surgeons of Canada (RCPSC) recently redesigned the Canadian neurosurgery residency training curriculum by implementing a competency-based model of training known as Competence by Design (CBD) centered around the assessment of Entrustable Professional Activities (EPAs). This sequential explanatory mixed-methods study evaluated potential benefits and pitfalls of CBD in Canadian neurosurgery residency education. METHODS: Two four-month interval surveys were distributed to all Canadian neurosurgery residents participating in CBD. The surveys assessed important educational components: CBD knowledge of key stakeholders, potential system barriers, and educational/psychological impacts on residents. Paired t-tests were done to assess changes over time. Based on longitudinal survey responses, semi-structured interviews were conducted to investigate in-depth residents' experience with CBD in neurosurgery. The qualitative analysis followed an explanatory approach, and a thematic analysis was performed. RESULTS: Surveys had 82% average response rate (n = 25). Over time, most residents self-reported that they retrospectively understood concepts around CBD intentions (p = 0.02). Perceived benefits included faculty evaluations with more feedback that was clearer and more objective (53% and 51%). Pitfalls included the amount of time needed to navigate through EPAs (90%) and residents forgetting to initiate EPA forms (71%). There was no significant change over time. During interviews, five key themes were found. Potential solutions identified by residents to enhance their experience included learning analytics data availability, mobile app refinement, and dedicated time to integrate EPAs in the workflow. CONCLUSION: This study was the first to assess resident-perceived benefits and pitfalls of the neurosurgery CBD training program in an educational framework context. In general, residents believed that theoretical principles behind CBD were valuable, but that technological ability and having enough time to request EPA assessments were significant barriers to success. Long-term studies are required to determine the definitive outcomes of CBD on residents' performance and ultimately, on patient care.

Competency-based medical education across the continuum: How well aligned are medical school EPAs to residency milestones?

INTRODUCTION: Competency-based medical education (CBME) provides a framework for describing learner progression throughout training. However, specific approaches to CBME implementation vary widely across educational settings. Alignment between various methods used across the continuum is critical to support transitions and assess learner performance. The purpose of this study was to investigate alignment between CBME frameworks used in undergraduate medical education (UME) and graduate medical education (GME) settings using the US context as a model. METHOD: The authors analyzed content from the core entrustable professional activities for entering residency (Core EPAs; UME model) and residency milestones (GME model). From that analysis, they performed a series of cross-walk activities to investigate alignment between frameworks. After independent review, authors discussed findings until consensus was reached. RESULTS: Some alignment was found for activities associated with history taking, physical examination, differential diagnosis, patient safety, and interprofessional care; however, there were far more examples of misalignment. CONCLUSIONS: These findings highlight challenges creating alignment of assessment frameworks across the continuum of training. The importance of these findings includes implications for assessment and persistence of the educational gap across UME and GME. The authors provide four next steps to improve upon the continuum of education.