Can routine EPA-based assessments predict OSCE performances of undergraduate medical students?

BACKGROUND: Objective structured clinical examination (OSCE) is used worldwide. This study aims to explore potential alternatives to the OSCE by using entrustable professional activities (EPA)-based assessments in the workplace. METHODS: This study enrolled 265 six-year undergraduate medical students (UGY) from 2021 to 2023. During their rotations, students were assessed using 13 EPAs, with the grading methods modified to facilitate application. Before graduation, they participated in two mock OSCEs and a National OSCE. We used generalized estimating equations to analyze the associations between the EPA assessments and the OSCE scores, adjusting for age and sex, and developed a prediction model. EPA8 and EPA9, which represent advanced abilities that were not significant in the regression models, were removed from the prediction model. RESULTS: Most EPAs were significantly correlated with OSCE scores across the three cohorts. The prediction model for forecasting passing in the three OSCEs demonstrated fair predictive capacity (area under curve = 0.82, 0.66, and 0.71 for students graduated in 2021, 2022, and 2023, respectively all p < 0.05). CONCLUSIONS: The workplace-based assessments (EPA) showed a high correlation with competency-based assessments in simulated settings (OSCE). EPAs may serve as alternative tools to formal OSCE for medical students.

The Transformative Care Continuum: implementing an accelerated pathway that addresses the new roles of the family medicine physician.

BACKGROUND: The Transformative Care Continuum (TCC) emerged in 2018 at Ohio University's Heritage College of Osteopathic Medicine, combining a three-year medical education track with a three-year family medicine residency. TCC aligns evolving family physician roles through the Kern model, AMA's Master Adaptive Learner model, Health Systems Science Training, and Kirkpatrick's evaluation model. METHODS: The TCC curriculum emphasizes intensive coaching, clinical encounter video evaluation, reflection, and case-log review. It fosters longitudinal clinical integration, community engagement, and a dynamic learning atmosphere. Students receive rigorous patient-centered communication training and engage in residency-based quality improvement projects, targeting care gap closure and community health in an accelerated 3-year program. OUTCOMES: Assessment of TCC graduates demonstrates advanced team communication, leadership, and project management skills, with entrustable professional activities (EPA) scores meeting or surpassing those of traditional program graduates. Projects led by students have yielded notable clinical enhancements, national recognition, and significant philanthropic funding for non-medical determinants of health. Finally, there is an overall increase in scholarly activity and leadership roles within the residency programs that have engaged these students. DISCUSSION: Lessons reveal intrinsic challenges and heightened academic demands for students and residency programs. Additional educational support for students may be necessary, though costly. Limitations in residency slots and faculty availability as student educators potentially hinder scalability. Ongoing faculty training, cultural support, and early integration of digital systems for curriculum management and evaluation are vital for success. Obtaining patient satisfaction, health outcomes, and program measures remains challenging due to privacy concerns and approval processes between institutions. CONCLUSION: Programs like TCC effectively prepare students for family physician leadership and change management roles through tailored learning, longitudinal experiences, health systems training, and addressing critiques of traditional medical education. Continuous feedback and robust communication strategies are essential for program improvement, fostering well-prepared family physicians committed to health system enhancement.

Policy options to address the effectiveness of health service management graduates in solving Iranian health system challenges: a mixed scoping review and policy Delphi approach.

Background: Iran's healthcare system is grappling with multifaceted challenges, including financial constraints, staffing shortages, infrastructural deficiencies, legal hurdles, and cross-sectoral coordination issues. The integration of health service management graduates into the healthcare workforce is vital to tackle these obstacles effectively. However, the lack of skilled managers can exacerbate problems, leading to inflated costs, and wasted resources. This study aims to propose policy options to improve the effectiveness of healthcare management graduates in exposure to the challenges of Iran's health system. Methods: The study used a mixed-methods design that combined a scoping review and interviews with academics specializing in healthcare management and hospital management, as well as key informants of the Ministry of Health and Medical Education (MoHME), the vice chancellor and deans of faculties of management and paramedicine (December 1, 2022 to February 30, 2023), and a policy Delphi technique (April 1, 2023 to Jun 30, 2023). In the scoping review, we searched PubMed, Web of Science Platform, MEDLINE, Scopus, Google Scholar/Academia, and ERIC for articles published from the inception of each database until August 10, 2022, with an update on October 6, 2022. The search terms included "health services," "healthcare organizations," "healthcare management," "health management education," "Iran," "challenges," "issues," "policy," "interventions," "policy options," "solutions," "policy-making," "effectiveness," "efficacy," and similar terms. We incorporated scholarly articles that presented instances or resolutions demonstrating the impact of health service management graduates in addressing the issues encountered by Iran's healthcare system. Non-English research papers, except Persian, were excluded due to translation resource limitations. Articles from peer-reviewed journals were included based on their publication type, while conference abstracts, book reviews, commentaries, and editorial pieces were considered for review. In the present study, the first step of the modified Delphi methodology involved conducting interviews and qualitative content analysis. Then, through two rounds of online surveys, the policy Delphi technique engaged experts and stakeholders in reviewing and prioritising policy options. Findings: In the scoping review, our initial search of the main databases retrieved 553 articles, with an additional 14 articles from gray literature and 5 studies from local databases, totaling 572 references. 426 studies remained after removing duplicates and reviewing them. We excluded 339 studies that did not align with our study's objectives, leaving us with 87 articles. We had access to the full text of 63 of these studies and ultimately selected 31 for review and thematic analysis. The study involved 21 participants, with a 100% response rate in the interview phase. In the Delphi phase, 64 experts were invited, with 41 participating in Round 1 (64% response rate) and 32 in Round 2 (78% response rate). The scoping review identified eleven policy options, followed by designing an interview guide and presenting nine more options based on expert insights from the interviews. We evaluated twenty policy options using a 5-point Likert scale and modified Delphi methodology to assess their effectiveness, feasibility, relevance, and acceptance cost. The study produced four policy options that were culturally and ethically appropriate, as well as compatible with the context and target population. These options were: 1) training and capacity building based on Iran's health system model; 2) development of the framework of Entrustable Professional Activities (EPAs) for healthcare management graduates; 3) determining the career pathways of healthcare management graduates and reviewing the job categories approved by the Ministry of Health and Medical Education (MoHME); and 4) providing effective collaboration between healthcare management graduates and professionals, policymakers, and stakeholders for integrated health system improvement. Interpretation: The study provides evidence-based recommendations for improving the education, training, and professional deployment of healthcare management graduates in Iran. Funding: This work was supported by the National Agency for Strategic Research in Medical Education (NASR) (Grant Number 4020159).

Empowering Continuing Medical Education (CME) in India: leveraging Kern's instructional design model.

INTRODUCTION: Continuing Medical Education (CME) is vital for healthcare professionals to remain current with advancements and maintain their competence. In India, CME remains in its early stages, lacking a systematic approach. There is a pressing need for a comprehensive framework that addresses needs assessment, program development, accreditation, and credit allocation. Specifically, there is a gap in delivering targeted CME that meets the needs of different medical professionals at appropriate times. The aim of this study is to employ Kern's six steps of curriculum design to plan and evaluate a faculty development program focused on Entrustable Professional Activities (EPAs) for MD (Doctor of Medicine) Biochemistry professionals. METHODS: This study utilized Kern's six-step approach to design a training program on Entrustable Professional Activities (EPAs) tailored for MD Biochemistry professionals. Approval was obtained from the Institutional Human Ethics Committee. Following problem identification, a targeted needs assessment was conducted through expert consultations. The goal of the program was established, focusing on the development and delivery of an interactive online CME program. The program was developed, implemented and evaluated using surveys and feedback questionnaires. RESULTS: A comprehensive literature review revealed a notable gap in EPA-related works for MD Biochemistry program. Expert consultations highlighted significant training needs and barriers, such as limited resources and professional commitments. Consequently, the program's primary objective was to raise awareness and sensitize participants to EPA development. A 4-h online CME was designed, featuring expert-led sessions and collaborative group activities. The program attracted 152 participants and utilized interactive elements, such as polls and chats, to foster engagement. Group activities allowed participants to apply concepts in EPA validation. Pre- and post-program surveys demonstrated significant improvements in participants' knowledge and confidence. Feedback highlighted the practical relevance of the content and the interactive, hands-on nature of the sessions. CONCLUSION: Kern's six-step approach provided a structured and effective framework for developing the CME program, addressing identified needs and barriers, and enhancing faculty development in MD Biochemistry. This study underscores the importance of a systematic approach in CME to improve program effectiveness. TRIAL REGISTRATION: Not applicable.

Medication Errors as a Marker of Resident Competency.

Introduction Educators continue to evaluate ways to assess resident performance in conjunction with the Accreditation Council for Graduate Medical Education (ACGME) general surgery milestones. We investigated whether the rate of medication errors could reflect general surgery resident competency. We hypothesized that the identification of increased medication errors made by general surgery residents could be a potential screening tool to identify residents who are academically at risk prior to their formal biannual milestone evaluation by the clinical competency committee. Methods This is a retrospective cohort study comparing rates of medication ordering errors against ACGME core competency scores over four years in a general surgery residency program at an academic, university-affiliated, level 1 trauma center in the Northeastern United States. Results We identified 95 general surgery residents who inputted 1,164,663 medication orders during the four years studied. There were 1,214 (0.1%) errors identified. Of those, 1,146 (94.4%) were level 3 errors, and 68 (5.6%) were level 4 errors. This represents an error rate of 1.04 errors per 1,000 medication orders. There was a statistically significant decrease in the error rate as the post-graduate year (PGY) level increased (p=0.005). However, there was no correlation between the error rate and individual ACGME milestone competency scores by PGY level. Conclusions We explored whether medication errors may be an early measurement of worsening resident performance as demonstrated by a decrease in ACGME core competency scores. However, the rate of errors did not correlate consistently with these measures. This may underscore that medication errors measure an aspect of resident performance that we do not capture with our current assessments.

Redesigned Entrustable Professional Activity (EPA) Assessments Reduce Grade Inflation in the Experiential Setting.

OBJECTIVE: This study aims to evaluate the impact of redesigning an entrustable professional activities (EPAs) assessment tool on the accuracy of student performance assessment within pharmacy education. METHODS: The study used retrospective programmatic data for students on clinical rotations over a 3-year period and compared entrustment levels assigned by preceptors with suggested entrustment levels. This tool was redesigned to separate formative EPA feedback from final grade determination. Data were analyzed using chi-squared tests to identify trends in students ABOVE, AT, or BELOW the suggested entrustment levels. Additionally, to account for intercohort variability, the relationship between students ABOVE the suggested level of entrustment and postgraduate metrics was examined. RESULTS: After the implementation of the revised tool, there was a significant decrease (-3%) in the percentage of students scoring ABOVE the suggested entrustment levels and an increase in the percentage of students scoring AT (+1%) or BELOW (+2%) the suggested entrustment levels. Changes were also observed in individual patient care settings, with a decrease in grade inflation and an increase in accurate assessments. North American Pharmacist Licensure Examination (NAPLEX) pass rates, residency match rates, and grade point average did not correlate with entrustment levels. CONCLUSION: The redesigned EPA assessment tool demonstrated a decrease in grade inflation resulting in more accurate assessments. The tool's focus on holistic grading and narrative descriptors contributed to better alignment between preceptor assessment and school-suggested achievement levels. This study suggests that EPA assessments in pharmacy education could benefit from a stronger emphasis on formative feedback and the use of holistic assessment methods for final grade determinations. The findings underscore the potential advantages of considering a separation between EPA scoring and final grades, prompting the Academy to explore their assessment practices to better reflect student performance in clinical experiences.

Evaluating Feedback Comments in Entrustable Professional Activities: A Cross-Sectional Study.

INTRODUCTION: Competency-based medical education (CBME) has transformed postgraduate medical training, prioritizing competency acquisition over traditional time-based curricula. Integral to CBME are Entrustable Professional Activities (EPAs), that aim to provide high-quality feedback for trainee development. Despite its importance, the quality of feedback within EPAs remains underexplored. METHODS: We employed a cross-sectional study to explore feedback quality within EPAs, and to examine factors influencing length of written comments and their relationship to quality. We collected and analyzed 1163 written feedback comments using the Quality of Assessment for Learning (QuAL) score. The QuAL aims to evaluate written feedback from low-stakes workplace assessments, based on 3 quality criteria (evidence, suggestion, connection). Afterwards, we performed correlation and regression analyses to examine factors influencing feedback length and quality. RESULTS: EPAs facilitated high-quality written feedback, with a significant proportion of comments meeting quality criteria. Task-oriented and actionable feedback was prevalent, enhancing value of low-stakes workplace assessments. From the statistical analyses, the type of assessment tool significantly influenced feedback length and quality, implicating that direct and video observations can yield superior feedback in comparison to case-based discussions. However, no correlation between entrustment scores and feedback quality was found, suggesting potential discrepancies between the feedback and the score on the entrustability scale. CONCLUSION: This study indicates the role of the EPAs to foster high-quality feedback within CBME. It also highlights the multifaceted feedback dynamics, suggesting the influence of factors such as feedback length and assessment tool on feedback quality. Future research should further explore contextual factors for enhancing medical education practices.

Knowledge, attitudes, and perceptions of residents towards Hospital-at-Home (HaH) and its role in residency training.

BACKGROUND: With the proliferation of Hospital at Home (HaH) programmes globally, there is a need to equip junior doctors with the skills necessary for provision of HaH care. The ideal training structure and clinical requirements for junior doctors to be considered competent in providing HaH care is still poorly understood. This study examines the perceptions of junior doctors towards HaH, and aims to determine the learning needs that might be helpful for future curriculum planning. METHODS: We conducted a cross-sectional study of residents at the National University Health System (NUHS) Singapore. Using a 45-item questionnaire, we explored the knowledge, attitudes and perceptions of residents towards HaH, and their interest in participating in HaH as part of residency training. RESULTS: One hundred six residents responded. Overall knowledge and attitudes were mostly average. Perceptions were neutral but comparatively lower in the domains of safety, efficiency and equity. 69% of residents showed a positive attitude and interest to participate in HaH as part of residency rotations. 80% of respondents were keen to have a 2-4 week rotation incorporated into routine training. Demographic factors that influenced higher scores in various domains included type of residency programme and years of work experience. CONCLUSION: Our findings suggest that residents are interested in participating in HaH. Incorporation of HaH rotations in residency training will allow juniors doctors to receive greater exposure and training in the skills specific to provision of HaH care. Further studies on the introduction of a HaH curriculum and Entrustable Professional Activities (EPAs) specific for HaH in residency training may be useful to to ensure that we have a competent HaH workforce that can support and keep up with the growth of HaH globally.

Developing and Validating Entrustable Professional Activities (EPAs) for Rheumatology Fellowship Training Programs in Saudi Arabia: A Delphi Study.

Background: Entrustable professional activities (EPAs) define the core tasks that a graduating rheumatologist needs to perform independently in practice. The objective of this study was to develop and validate EPAs for rheumatology fellowship training programs in Saudi Arabia. Methods: Experts met to develop an initial set of potential end-of-training EPAs by conducting a comprehensive literature review of EPAs and studying the Saudi rheumatology fellowship curriculum. Then, to validate the EPAs, we conducted two rounds of the modified Delphi technique among rheumatology experts in Saudi Arabia. A response rate of 80% was considered and the minimum number of experts needed to be 25 to 30. Descriptive statistics were utilized to describe participants' demographic characteristics and group responses to each statement in all rounds. The experts were asked to rate the relevancy of each EPA using a 5-point Likert scale in both Delphi rounds. Results: In the preliminary phase, four rheumatologists developed an initial set of 36 core EPAs for rheumatology training program in Saudi Arabia. For the two-rounds Delphi techniques, 32 experts were invited to complete the study. The response rate of the first and second round were, 78.12% (25) and 93.75% (30), respectively. The first-round Delphi resulted in a robust consensus on 31 EPAs for rheumatology training. Five EPAs were excluded, and one new EPA was proposed. In the subsequent round, all 32 EPAs achieved strong consensus. The eliminated EPAs likely fell short in one or more of the following areas: relevance to rheumatology practice in Saudi Arabia, overlapping with other EPAs, or practical challenges in the implementation. Conclusion: We have developed and validated a core set of EPAs for rheumatology fellowship training programs in Saudi Arabia. Mapping and identifying milestones for these EPAs are essential steps to follow to enhance workplace curriculum development.

Entrustable professional activities, emergency medicine and medical education: a systematic review.

INTRODUCTION: Entrustable professional activities (EPAs) are one way to assess competencies, and are designed to bridge the gap between theoretical competencies and real world clinical practice. AIMS: This was a systematic review which aims to answer the question: "Which EPAs related to Emergency Medicine are described for medical schools?". METHODS: We included original qualitative, interventional and observational studies (cross-sectional, case-control, and cohort studies) that described EPAs relevant to Emergency Medicine for Medical School. The search strategy was created using a combination of keywords and standardized index terms related to EPAs and Emergency Medicine. RESULTS: The search strategy identified 991 citations. After screening the titles and abstracts, we identified 85 potentially relevant studies. After the full-text review, a total of 11 reports met the criteria for inclusion. CONCLUSION: Recognizing a patient requiring urgent or emergent care and initiating evaluation and management is the most common EPA related to Emergency Medicine described at Medical Schools. Use of EPAs is associated with increased student satisfaction and improved competences. However, there is a lack of undergraduate EM specific EPAs being systematically developed and published, and this should be an area to be explored in future studies.

Multifaceted Strategy That Improves Students' Achievement of Entrustable Professional Activities Across Advanced Pharmacy Practice Experiences.

OBJECTIVE: To outline an approach to help students achieve Entrustable Professional Activities (EPAs) entrustment during a sequence of Advanced Pharmacy Practice Experiences (APPEs) by implementing longitudinal monitoring and individualized intervention and remediation strategies. METHODS: Using the recommended EPAs within the core APPEs (acute care, ambulatory care, community, institutional), students were expected to achieve entrustment on all EPAs by graduation. A longitudinal monitoring approach, using an "EPA report card," was implemented to continuously identify students at risk of not meeting the EPA requirement of "Level 3" entrustment (perform with reactive supervision). Individualized interventions, including proactive outreach and in-sequence remediation, were incorporated into the APPE core and elective sequence to help ensure all students were entrusted by the end of APPEs without requiring further end-of-year remediation to graduate. RESULTS: For the graduating classes of 2023 and 2024, 12% (8 of 69) and 16% (12 of 75) students, respectively, were identified as at risk of not meeting EPA entrustment. Proactive outreach, in-sequence remediation, or a combination of both strategies, were used to enhance learning and EPA performance. As a result, all students achieved "Level 3" entrustment on the deficient EPA(s) by the end of the APPE sequence. No student required further end-of-year remediation to graduate. CONCLUSION: Utilizing a multifaceted strategy provided timely, real-world practice opportunities to improve the students' achievement of EPAs across the APPE curriculum and decreased the need for end-of-year remediation and potential graduation delays.

How Internal Medicine Clerkship Directors Are Using Entrustable Professional Activities: A National Survey Study.

BACKGROUND: In the present assessment environment in undergraduate medical education at U.S. medical schools, the prevalence and implementation of Entrustable Professional Activities (EPAs) in internal medicine (IM) clerkships are not well understood. OBJECTIVE: To describe the prevalence and approach to EPA use in U.S. IM clerkships. DESIGN: Cross-sectional, nationally representative survey of core IM clerkship directors. PARTICIPANTS: One-hundred forty IM clerkship directors at Liaison Committee on Medical Education-accredited U.S./U.S. territory-based allopathic medical schools with membership in the Clerkship Directors in Internal Medicine (CDIM) as of December 2022. MAIN MEASURES: Use of EPAs in IM core clerkships, including use for grading, types of EPAs, use of supportive measures for assessment, and current validity frameworks. KEY RESULTS: The survey response was 80% (112/140); two additional respondents completed the section on EPA use (n = 114). Approximately half of respondents (47%) reported their IM clerkship used EPAs. Among schools accredited after 1977, a higher percentage was associated with having incorporated EPAs (p = 0.03). The Association of American Medical Colleges Core EPAs for Entering Residency (CEPAER) was the most common framework used by Clerkship Directors (CDs) for developing EPAs (55%). Most CDs (56%) used EPAs for both formative and summative assessments, and approximately half of CDs (48%) used EPAs for a portion of the final grade determination. CDs who used EPAs were no more likely to report efforts to ensure the validity of assessment, the use of faculty development, or that written assessments were a valid measure of students' performance compared to those who did not use EPAs. CONCLUSIONS: Although EPAs have experienced substantial uptake in the IM clerkship and contribute to formative and summative assessment of learners, their use does not appear to be associated with enhanced efforts to obtain validity information.

Entrustable professional activities for bedside clinical teachers.

BACKGROUND: Bedside teaching is an important modality for training medical students and postgraduate trainees in clinical settings. Despite its significance, the effective practice of Bedside teaching has been declining over the past few decades. The literature highlighted the need for structured training, assessment, and certification or in other words entrustment of bedside teachers. The current study aims to develop and validate the Entrustable Professional Activities (EPAs) for bedside clinical teachers. METHODS: A multi-method study with clinical teachers, medical educationists, and postgraduate medical students was conducted from July 2021-22. First, a nominal group using the jigsaw puzzle technique was conducted with 16 participants to identify EPAs. Then these EPAs were mapped and validated by the skills/competencies identified in the literature. Next, the EPAs were evaluated using the EQual rubric by 3 medical educationists. This was followed by two-rounds of modified Delphi to develop consensus among 90 participants in round-one and 69 in round-two. For qualitative data, a thematic analysis was conducted. For quantitative data, means and standard deviations were calculated. RESULTS: The study identified five EPAs for bedside clinical teachers: developing bedside teaching program, planning bedside teaching session, conducting bedside teaching, conducting bedside assessments and evaluating bedside teaching. CONCLUSIONS: This study comprehensively developed and validated a full description of EPAs for bedside clinical teachers. The EPAs identified in the study can serve as a guiding framework for bedside clinical teachers' training, assessment, and entrustment.

Dear Program Directors: There Are Numerous Entrustable Professional Activities on a Burns Rotation!

Background: Burn care has long been an integral part of the scope of plastic surgery, but the time allocated to exposure for plastic surgery residents is under threat due to the range of sub-specialities competing for their time. As part of the Competence by Design approach to plastic surgical training, residents are provided with a list of 52 "Entrustable professional activities' (EPA's) to ensure that core skills and knowledge are acquired. Methods: This survey, distributed via email using a link to Survey MonkeyTM, sought to determine which EPA's were available for completion by plastic surgeons in training during the burn rotation at a major academic burn centre in Canada. Via investigator consensus, 26 of the 52 EPA's were included for assessment; the remaining 26 were not regarded as relevant to the burn centre rotation and therefore better acquired elsewhere. Results: Thirty two residents who underwent a burn rotation between 1 January 2015 and 31 December 2021 completed the anonymous survey. Seventeen of the 26 EPA's evaluated were judged by more than 75% of respondents as being readily amenable to completion during the burn rotation. Most of these EPA's relate to the comprehensive care of patients with acute burn injuries, the management of an in-patient plastic surgery service, and associated quality improvement processes. Residents who completed rotations less than three months in duration had less opportunity to complete a further 8 EPA's in comparison to those who had longer rotations, especially with respect to the care of patients undergoing complex wound care and burn reconstruction. Conclusions: In addition to threatening seamless service delivery at burn centres, reduced resident exposure to the burn rotation may compromise the delivery of burn care in the community. The results of this survey refute any argument that the burn service is a "low yield" rotation from an EPA acquisition perspective.

Historique: Les soins aux grands brûlés font partie intégrante de la chirurgie plastique depuis longtemps, mais le temps alloué à y exposer les résidents en chirurgie plastique est menacé en raison de l'éventail de surspécialités. Dans le cadre de l'approche de compétence par conception à la formation en chirurgie plastique, les résultats reçoivent une liste de 52 « activités professionnelles confiables ¼ (APC) pour assurer qu'ils acquièrent les compétences et le savoir de base. Méthodologie : Ce sondage, distribué par courriel grâce à un lien vers la plateforme Survey MonkeyMD, visait à déterminer quelles APC étaient offertes aux chirurgiens plastiques en formation pendant leur rotation dans un grand centre universitaire pour grands brûlés du Canada. Par consensus des chercheurs, 26 des 52 APC ont été incluses dans l'évaluation. Les 26 autres n'ont pas été considérées comme pertinentes pour la rotation au centre pour grands brûlés, mais mieux à même d'être acquises ailleurs. Résultats:  Au total, 32 résidents qui ont participé à une rotation auprès des grands brûlés entre le 1er janvier 2015 et le 31 décembre 2021 ont rempli le sondage anonyme. Selon plus de 75% d'entre eux, 17 des 26 APC évaluées peuvent facilement être effectuées pendant la rotation auprès des grands brûlés. La plupart de ces APC portent sur les soins complets aux patients atteints de brûlures aiguës, la gestion d'un service de chirurgie plastique aux patients hospitalisés et les processus d'amélioration de la qualité qui s'y associent. Les résidents qui ont effectué leur rotation en moins de trois mois avaient moins l'occasion d'effectuer huit APC de plus par rapport à ceux qui avaient vécu des rotations plus longues, particulièrement à l'égard des soins des plaies complexes aux patients et de la reconstruction après leurs brûlures. Conclusions : En plus de menacer la prestation harmonieuse des services dans les centres pour grands brûlés, la moins grande exposition des résidents à la rotation des grands brûlés peut compromettre la prestation des soins aux grands brûlés dans la communauté. Les résultats de ce sondage réfutent toute prétention selon laquelle les services aux grands brûlés est une rotation « à faible rendement ¼ selon le point de vue de l'acquisition des APC.

Framing our Expectations: Variability in Entrustable Professional Activity Assessments.

OBJECTIVE: To determine the ability of surgical trainees and faculty to correctly interpret entrustability of a resident learner in a modeled patient care scenario. DESIGN: Prospective study utilizing a web-based survey including 4 previously-recorded short videos of resident learners targeted to specific levels of the American Board of Surgery's (ABS) Entrustment Scale. Respondents were asked to choose the entrustment level that best corresponded to their observations of the learner in the video. Responses were subcategorized by low and high entrustment. SETTING: Online, utilizing the Qualtrics survey platform. PARTICIPANTS: Survey targeting US surgical trainees and surgical faculty via email and social media. We received 31 complete responses and 2 responses which completed > 1 video assessment question without demographic information (n = 33). Respondents included 10 trainees (32%) and 21 attending surgeons (68%). RESULTS: Neither faculty nor trainees readily identified the targeted entrustment level for Question 1 (preoperative care of a patient with acute appendicitis with high entrustment, 36% correct), though evaluations of the remaining questions (2 through 4) demonstrated more accuracy (70, 84, and 75% correct, respectively). Faculty were more readily able than trainees to identify low entrustment (level Limited Participation) in intraoperative inguinal hernia repair (95% vs 60%, p = 0.03). After subcategorization to high and low entrustment, both residents and faculty were able to accurately identify entrustment 95% overall. CONCLUSIONS: Both trainees and attending surgeons were able to identify high- and low-performing residents on short video demonstrations using the ABS EPA entrustment scale. This provides additional evidence in support of the need for frequent observations of EPAs to account for the variability in raters' perceptions in addition to complexity of clinical scenarios. Frame-of-reference training via a video-based platform may also be beneficial for both residents and faculty as an ongoing EPA implementation strategy.

AACN competency-based essentials revisit: Evidence-based validation of entrustable professional activities in Asia.

AIM: This study intended to validate the competency-based approach through an entrustable professional activity in the nursing undergraduate education arena in Taiwan. BACKGROUND: Entrustable professional activity is a recommended strategy to enhance nursing competencies and skills. It has been widely applied to nursing education in Western countries, especially graduate programs. However, its effects in eastern countries and undergraduate programs remain unclear. DESIGN: A quasi-experimental comparison design was used. METHOD: The study is conducted at the Department of Nursing at a university in southern Taiwan. A total of 72 Two-Year Nursing Program students participated in the study. After implementing the designated entrustable professional activity in the Wound Care Nursing course, outcomes were measured using the Competency Inventory of Nursing Students, Learning Satisfaction and Objective Structured Clinical Examinations. These outcomes were then compared with post-test results at the end of the semester. About 90 % of students completed the study with the test group (n=31) receiving extra activity and the comparison group (n=34) receiving usual teaching. Data were analyzed through chi-square, paired t and Student's t-test. RESULTS: The test group demonstrated significantly higher scores in perceived competency and clinical examinations than the comparison group. However, both groups experienced an increase in learning satisfaction without reaching a significant difference. CONCLUSION: Results of the study indicate that competency-based pedagogy, e.g., using entrustable professional activities, should be integrated into nursing curricula to meet the new American Association of Colleges of Nursing standards with compelling evidence.

EHR-Driven Delivery of EPA Assessments Significantly Improves Participation.

INTRODUCTION: Digital education tools are a cornerstone in the evolution to CBME through EPAs. Successful implementation requires understanding the variable impacts of EHR-driven delivery of EPAs, flexible digital device access to EPAs, and user-behavior trends. METHODS: Through a HIPAA compliant, flexible-device accessible, surgical education platform, general surgery training programs at 21 institutions collected EPA from July 2023 to April 2024. At 5 EHR-integrated institutions (EHR+), EPA were created for clinical activities based on the OR schedule, automatically pushed to attendings and residents with built in completion reminders. At 16 institutions without EHR integration (EHR-), EPA were initiated manually. To improve user experience, care phases were bundled (cEPA). We compared the EHR+ and EHR- groups, computing descriptive statistics on the cEPAs completed and user behavior metrics. RESULTS: We collected 4187 cEPAs in total, with 82% at EHR+ institutions and 18% at EHR- institutions. Platform triggering dramatically drove cEPA completion for both faculty and residents, 88% and 81%, respectively. Only 3% were initiated by the faculty or resident. Faculty at EHR+ institutions strongly preferred the automated OR-triggered workflow to start their EPAs (Chi-squared test, p ≈ 0). Faculty completed all 3 care phases nearly 80% of the time. Time reminders specifically drive EPA completion for residents and faculty on weekdays and build habits on weekends. 71% of cEPAs completed were by computer, and 29% by phone. More comments were provided when computers were used. Residents reviewed feedback with a median lag of 1 hour and 29 min after results were available. CONCLUSIONS: EHR-driven delivery of EPA leads to a 4.6-fold increase in EPAs completed. EPA initiation is the most critical phase in the workflow and EHR-data driven alerts drive this action. These alerts are also effective drivers of habit formation. Flexible device access is important to increase EPAs completed and improve the usefulness through comments for residents.

Validation of entrustable professional activities for use in neonatal care residency programs.

OBJECTIVE: Define and develop a set of entrustable professional activities (EPAs) to link clinical training and assessment of the hospital components of neonatal care in neonatology medical residency programs. METHODS: An exploratory study was conducted in two phases using a modified Delphi approach. In the first phase, a committee of five neonatology residency program coordinators drafted an initial set of EPAs based on the national matrix of competencies and on EPAs defined by international organizations. In the second phase, a group of neonatal care physicians and medical residents rated the indispensability and clarity of the EPAs and provided comments and suggestions. RESULTS: Seven EPAs were drafted by the coordinators´ committee (n = 5) and used in the content validation process with a group (n = 37) of neonatal care physicians and medical residents. In the first Delphi round, all EPAs reached a content validity index (CVI) above 0.8. The coordinators´ committee analyzed comments and suggestions and revised the EPAs. A second Delphi round with the revised EPAs was conducted to validate and all items maintained a CVI above 0.8 for indispensability and clarity. CONCLUSION: Seven entrustable professional activities were developed to assess residents in the hospital components of neonatal care medicine. These EPAs might contribute to implementing competency-based neonatology medical residency programs grounded in core professional activities.