The Transformative Care Continuum: implementing an accelerated pathway that addresses the new roles of the family medicine physician.

BACKGROUND: The Transformative Care Continuum (TCC) emerged in 2018 at Ohio University's Heritage College of Osteopathic Medicine, combining a three-year medical education track with a three-year family medicine residency. TCC aligns evolving family physician roles through the Kern model, AMA's Master Adaptive Learner model, Health Systems Science Training, and Kirkpatrick's evaluation model. METHODS: The TCC curriculum emphasizes intensive coaching, clinical encounter video evaluation, reflection, and case-log review. It fosters longitudinal clinical integration, community engagement, and a dynamic learning atmosphere. Students receive rigorous patient-centered communication training and engage in residency-based quality improvement projects, targeting care gap closure and community health in an accelerated 3-year program. OUTCOMES: Assessment of TCC graduates demonstrates advanced team communication, leadership, and project management skills, with entrustable professional activities (EPA) scores meeting or surpassing those of traditional program graduates. Projects led by students have yielded notable clinical enhancements, national recognition, and significant philanthropic funding for non-medical determinants of health. Finally, there is an overall increase in scholarly activity and leadership roles within the residency programs that have engaged these students. DISCUSSION: Lessons reveal intrinsic challenges and heightened academic demands for students and residency programs. Additional educational support for students may be necessary, though costly. Limitations in residency slots and faculty availability as student educators potentially hinder scalability. Ongoing faculty training, cultural support, and early integration of digital systems for curriculum management and evaluation are vital for success. Obtaining patient satisfaction, health outcomes, and program measures remains challenging due to privacy concerns and approval processes between institutions. CONCLUSION: Programs like TCC effectively prepare students for family physician leadership and change management roles through tailored learning, longitudinal experiences, health systems training, and addressing critiques of traditional medical education. Continuous feedback and robust communication strategies are essential for program improvement, fostering well-prepared family physicians committed to health system enhancement.

Developing and Validating Entrustable Professional Activities (EPAs) for Rheumatology Fellowship Training Programs in Saudi Arabia: A Delphi Study.

Background: Entrustable professional activities (EPAs) define the core tasks that a graduating rheumatologist needs to perform independently in practice. The objective of this study was to develop and validate EPAs for rheumatology fellowship training programs in Saudi Arabia. Methods: Experts met to develop an initial set of potential end-of-training EPAs by conducting a comprehensive literature review of EPAs and studying the Saudi rheumatology fellowship curriculum. Then, to validate the EPAs, we conducted two rounds of the modified Delphi technique among rheumatology experts in Saudi Arabia. A response rate of 80% was considered and the minimum number of experts needed to be 25 to 30. Descriptive statistics were utilized to describe participants' demographic characteristics and group responses to each statement in all rounds. The experts were asked to rate the relevancy of each EPA using a 5-point Likert scale in both Delphi rounds. Results: In the preliminary phase, four rheumatologists developed an initial set of 36 core EPAs for rheumatology training program in Saudi Arabia. For the two-rounds Delphi techniques, 32 experts were invited to complete the study. The response rate of the first and second round were, 78.12% (25) and 93.75% (30), respectively. The first-round Delphi resulted in a robust consensus on 31 EPAs for rheumatology training. Five EPAs were excluded, and one new EPA was proposed. In the subsequent round, all 32 EPAs achieved strong consensus. The eliminated EPAs likely fell short in one or more of the following areas: relevance to rheumatology practice in Saudi Arabia, overlapping with other EPAs, or practical challenges in the implementation. Conclusion: We have developed and validated a core set of EPAs for rheumatology fellowship training programs in Saudi Arabia. Mapping and identifying milestones for these EPAs are essential steps to follow to enhance workplace curriculum development.

Entrustable professional activities, emergency medicine and medical education: a systematic review.

INTRODUCTION: Entrustable professional activities (EPAs) are one way to assess competencies, and are designed to bridge the gap between theoretical competencies and real world clinical practice. AIMS: This was a systematic review which aims to answer the question: "Which EPAs related to Emergency Medicine are described for medical schools?". METHODS: We included original qualitative, interventional and observational studies (cross-sectional, case-control, and cohort studies) that described EPAs relevant to Emergency Medicine for Medical School. The search strategy was created using a combination of keywords and standardized index terms related to EPAs and Emergency Medicine. RESULTS: The search strategy identified 991 citations. After screening the titles and abstracts, we identified 85 potentially relevant studies. After the full-text review, a total of 11 reports met the criteria for inclusion. CONCLUSION: Recognizing a patient requiring urgent or emergent care and initiating evaluation and management is the most common EPA related to Emergency Medicine described at Medical Schools. Use of EPAs is associated with increased student satisfaction and improved competences. However, there is a lack of undergraduate EM specific EPAs being systematically developed and published, and this should be an area to be explored in future studies.

Medication Errors as a Marker of Resident Competency.

Introduction Educators continue to evaluate ways to assess resident performance in conjunction with the Accreditation Council for Graduate Medical Education (ACGME) general surgery milestones. We investigated whether the rate of medication errors could reflect general surgery resident competency. We hypothesized that the identification of increased medication errors made by general surgery residents could be a potential screening tool to identify residents who are academically at risk prior to their formal biannual milestone evaluation by the clinical competency committee. Methods This is a retrospective cohort study comparing rates of medication ordering errors against ACGME core competency scores over four years in a general surgery residency program at an academic, university-affiliated, level 1 trauma center in the Northeastern United States. Results We identified 95 general surgery residents who inputted 1,164,663 medication orders during the four years studied. There were 1,214 (0.1%) errors identified. Of those, 1,146 (94.4%) were level 3 errors, and 68 (5.6%) were level 4 errors. This represents an error rate of 1.04 errors per 1,000 medication orders. There was a statistically significant decrease in the error rate as the post-graduate year (PGY) level increased (p=0.005). However, there was no correlation between the error rate and individual ACGME milestone competency scores by PGY level. Conclusions We explored whether medication errors may be an early measurement of worsening resident performance as demonstrated by a decrease in ACGME core competency scores. However, the rate of errors did not correlate consistently with these measures. This may underscore that medication errors measure an aspect of resident performance that we do not capture with our current assessments.

Redesigned Entrustable Professional Activity (EPA) Assessments Reduce Grade Inflation in the Experiential Setting.

OBJECTIVE: This study aims to evaluate the impact of redesigning an Entrustable Professional Activities (EPA) assessment tool on the accuracy of student performance assessment within pharmacy education. METHODS: The study utilized retrospective programmatic data for students on clinical rotations over a three-year period and compared entrustment levels assigned by preceptors to suggested entrustment levels. This tool was redesigned to separate formative EPA feedback from final grade determination. Data was analyzed with Chi-Squared tests to look for trends in students ABOVE, AT, or BELOW the suggested entrustment levels. Additionally, to account for variation in inter-cohort variability, the relationship between students ABOVE suggested level of entrustment and post-graduate metrics was examined. RESULTS: After implementation of the revised tool, there was a significant decrease (3%) in students scoring ABOVE suggested entrustment levels and an increase in students scoring AT (1%) or BELOW (2%). Individual patient care settings also exhibited changes, with a decrease in grade inflation and an increase in accurate assessments. NAPLEX pass rates, residency match rates, and grade point average did not correlate with entrustment levels. DISCUSSION: The redesigned EPA assessment tool demonstrated a decrease in grade inflation resulting in more accurate assessments. The tool's focus on holistic grading and narrative descriptors contributed to a better alignment between preceptor assessment and school suggested achievement levels. This study suggests that EPA assessments in pharmacy education could benefit from a stronger emphasis on formative feedback and the use of holistic assessment methods for final grade determinations. The findings underscore the potential advantages of considering a separation between EPA scoring and final grades, prompting the academy to explore their assessment practices to better reflect student performance in clinical experiences.

Evaluating Feedback Comments in Entrustable Professional Activities: A Cross-Sectional Study.

INTRODUCTION: Competency-based medical education (CBME) has transformed postgraduate medical training, prioritizing competency acquisition over traditional time-based curricula. Integral to CBME are Entrustable Professional Activities (EPAs), that aim to provide high-quality feedback for trainee development. Despite its importance, the quality of feedback within EPAs remains underexplored. METHODS: We employed a cross-sectional study to explore feedback quality within EPAs, and to examine factors influencing length of written comments and their relationship to quality. We collected and analyzed 1163 written feedback comments using the Quality of Assessment for Learning (QuAL) score. The QuAL aims to evaluate written feedback from low-stakes workplace assessments, based on 3 quality criteria (evidence, suggestion, connection). Afterwards, we performed correlation and regression analyses to examine factors influencing feedback length and quality. RESULTS: EPAs facilitated high-quality written feedback, with a significant proportion of comments meeting quality criteria. Task-oriented and actionable feedback was prevalent, enhancing value of low-stakes workplace assessments. From the statistical analyses, the type of assessment tool significantly influenced feedback length and quality, implicating that direct and video observations can yield superior feedback in comparison to case-based discussions. However, no correlation between entrustment scores and feedback quality was found, suggesting potential discrepancies between the feedback and the score on the entrustability scale. CONCLUSION: This study indicates the role of the EPAs to foster high-quality feedback within CBME. It also highlights the multifaceted feedback dynamics, suggesting the influence of factors such as feedback length and assessment tool on feedback quality. Future research should further explore contextual factors for enhancing medical education practices.

Knowledge, attitudes, and perceptions of residents towards Hospital-at-Home (HaH) and its role in residency training.

BACKGROUND: With the proliferation of Hospital at Home (HaH) programmes globally, there is a need to equip junior doctors with the skills necessary for provision of HaH care. The ideal training structure and clinical requirements for junior doctors to be considered competent in providing HaH care is still poorly understood. This study examines the perceptions of junior doctors towards HaH, and aims to determine the learning needs that might be helpful for future curriculum planning. METHODS: We conducted a cross-sectional study of residents at the National University Health System (NUHS) Singapore. Using a 45-item questionnaire, we explored the knowledge, attitudes and perceptions of residents towards HaH, and their interest in participating in HaH as part of residency training. RESULTS: One hundred six residents responded. Overall knowledge and attitudes were mostly average. Perceptions were neutral but comparatively lower in the domains of safety, efficiency and equity. 69% of residents showed a positive attitude and interest to participate in HaH as part of residency rotations. 80% of respondents were keen to have a 2-4 week rotation incorporated into routine training. Demographic factors that influenced higher scores in various domains included type of residency programme and years of work experience. CONCLUSION: Our findings suggest that residents are interested in participating in HaH. Incorporation of HaH rotations in residency training will allow juniors doctors to receive greater exposure and training in the skills specific to provision of HaH care. Further studies on the introduction of a HaH curriculum and Entrustable Professional Activities (EPAs) specific for HaH in residency training may be useful to to ensure that we have a competent HaH workforce that can support and keep up with the growth of HaH globally.

AACN competency-based essentials revisit: Evidence-based validation of entrustable professional activities in Asia.

AIM: This study intended to validate the competency-based approach through an entrustable professional activity in the nursing undergraduate education arena in Taiwan. BACKGROUND: Entrustable professional activity is a recommended strategy to enhance nursing competencies and skills. It has been widely applied to nursing education in Western countries, especially graduate programs. However, its effects in eastern countries and undergraduate programs remain unclear. DESIGN: A quasi-experimental comparison design was used. METHOD: The study is conducted at the Department of Nursing at a university in southern Taiwan. A total of 72 Two-Year Nursing Program students participated in the study. After implementing the designated entrustable professional activity in the Wound Care Nursing course, outcomes were measured using the Competency Inventory of Nursing Students, Learning Satisfaction and Objective Structured Clinical Examinations. These outcomes were then compared with post-test results at the end of the semester. About 90 % of students completed the study with the test group (n=31) receiving extra activity and the comparison group (n=34) receiving usual teaching. Data were analyzed through chi-square, paired t and Student's t-test. RESULTS: The test group demonstrated significantly higher scores in perceived competency and clinical examinations than the comparison group. However, both groups experienced an increase in learning satisfaction without reaching a significant difference. CONCLUSION: Results of the study indicate that competency-based pedagogy, e.g., using entrustable professional activities, should be integrated into nursing curricula to meet the new American Association of Colleges of Nursing standards with compelling evidence.

Entrustable professional activities for bedside clinical teachers.

BACKGROUND: Bedside teaching is an important modality for training medical students and postgraduate trainees in clinical settings. Despite its significance, the effective practice of Bedside teaching has been declining over the past few decades. The literature highlighted the need for structured training, assessment, and certification or in other words entrustment of bedside teachers. The current study aims to develop and validate the Entrustable Professional Activities (EPAs) for bedside clinical teachers. METHODS: A multi-method study with clinical teachers, medical educationists, and postgraduate medical students was conducted from July 2021-22. First, a nominal group using the jigsaw puzzle technique was conducted with 16 participants to identify EPAs. Then these EPAs were mapped and validated by the skills/competencies identified in the literature. Next, the EPAs were evaluated using the EQual rubric by 3 medical educationists. This was followed by two-rounds of modified Delphi to develop consensus among 90 participants in round-one and 69 in round-two. For qualitative data, a thematic analysis was conducted. For quantitative data, means and standard deviations were calculated. RESULTS: The study identified five EPAs for bedside clinical teachers: developing bedside teaching program, planning bedside teaching session, conducting bedside teaching, conducting bedside assessments and evaluating bedside teaching. CONCLUSIONS: This study comprehensively developed and validated a full description of EPAs for bedside clinical teachers. The EPAs identified in the study can serve as a guiding framework for bedside clinical teachers' training, assessment, and entrustment.

How Internal Medicine Clerkship Directors Are Using Entrustable Professional Activities: A National Survey Study.

BACKGROUND: In the present assessment environment in undergraduate medical education at U.S. medical schools, the prevalence and implementation of Entrustable Professional Activities (EPAs) in internal medicine (IM) clerkships are not well understood. OBJECTIVE: To describe the prevalence and approach to EPA use in U.S. IM clerkships. DESIGN: Cross-sectional, nationally representative survey of core IM clerkship directors. PARTICIPANTS: One-hundred forty IM clerkship directors at Liaison Committee on Medical Education-accredited U.S./U.S. territory-based allopathic medical schools with membership in the Clerkship Directors in Internal Medicine (CDIM) as of December 2022. MAIN MEASURES: Use of EPAs in IM core clerkships, including use for grading, types of EPAs, use of supportive measures for assessment, and current validity frameworks. KEY RESULTS: The survey response was 80% (112/140); two additional respondents completed the section on EPA use (n = 114). Approximately half of respondents (47%) reported their IM clerkship used EPAs. Among schools accredited after 1977, a higher percentage was associated with having incorporated EPAs (p = 0.03). The Association of American Medical Colleges Core EPAs for Entering Residency (CEPAER) was the most common framework used by Clerkship Directors (CDs) for developing EPAs (55%). Most CDs (56%) used EPAs for both formative and summative assessments, and approximately half of CDs (48%) used EPAs for a portion of the final grade determination. CDs who used EPAs were no more likely to report efforts to ensure the validity of assessment, the use of faculty development, or that written assessments were a valid measure of students' performance compared to those who did not use EPAs. CONCLUSIONS: Although EPAs have experienced substantial uptake in the IM clerkship and contribute to formative and summative assessment of learners, their use does not appear to be associated with enhanced efforts to obtain validity information.

Dear Program Directors: There Are Numerous Entrustable Professional Activities on a Burns Rotation!

Background: Burn care has long been an integral part of the scope of plastic surgery, but the time allocated to exposure for plastic surgery residents is under threat due to the range of sub-specialities competing for their time. As part of the Competence by Design approach to plastic surgical training, residents are provided with a list of 52 "Entrustable professional activities' (EPA's) to ensure that core skills and knowledge are acquired. Methods: This survey, distributed via email using a link to Survey MonkeyTM, sought to determine which EPA's were available for completion by plastic surgeons in training during the burn rotation at a major academic burn centre in Canada. Via investigator consensus, 26 of the 52 EPA's were included for assessment; the remaining 26 were not regarded as relevant to the burn centre rotation and therefore better acquired elsewhere. Results: Thirty two residents who underwent a burn rotation between 1 January 2015 and 31 December 2021 completed the anonymous survey. Seventeen of the 26 EPA's evaluated were judged by more than 75% of respondents as being readily amenable to completion during the burn rotation. Most of these EPA's relate to the comprehensive care of patients with acute burn injuries, the management of an in-patient plastic surgery service, and associated quality improvement processes. Residents who completed rotations less than three months in duration had less opportunity to complete a further 8 EPA's in comparison to those who had longer rotations, especially with respect to the care of patients undergoing complex wound care and burn reconstruction. Conclusions: In addition to threatening seamless service delivery at burn centres, reduced resident exposure to the burn rotation may compromise the delivery of burn care in the community. The results of this survey refute any argument that the burn service is a "low yield" rotation from an EPA acquisition perspective.

Historique: Les soins aux grands brûlés font partie intégrante de la chirurgie plastique depuis longtemps, mais le temps alloué à y exposer les résidents en chirurgie plastique est menacé en raison de l'éventail de surspécialités. Dans le cadre de l'approche de compétence par conception à la formation en chirurgie plastique, les résultats reçoivent une liste de 52 « activités professionnelles confiables ¼ (APC) pour assurer qu'ils acquièrent les compétences et le savoir de base. Méthodologie : Ce sondage, distribué par courriel grâce à un lien vers la plateforme Survey MonkeyMD, visait à déterminer quelles APC étaient offertes aux chirurgiens plastiques en formation pendant leur rotation dans un grand centre universitaire pour grands brûlés du Canada. Par consensus des chercheurs, 26 des 52 APC ont été incluses dans l'évaluation. Les 26 autres n'ont pas été considérées comme pertinentes pour la rotation au centre pour grands brûlés, mais mieux à même d'être acquises ailleurs. Résultats:  Au total, 32 résidents qui ont participé à une rotation auprès des grands brûlés entre le 1er janvier 2015 et le 31 décembre 2021 ont rempli le sondage anonyme. Selon plus de 75% d'entre eux, 17 des 26 APC évaluées peuvent facilement être effectuées pendant la rotation auprès des grands brûlés. La plupart de ces APC portent sur les soins complets aux patients atteints de brûlures aiguës, la gestion d'un service de chirurgie plastique aux patients hospitalisés et les processus d'amélioration de la qualité qui s'y associent. Les résidents qui ont effectué leur rotation en moins de trois mois avaient moins l'occasion d'effectuer huit APC de plus par rapport à ceux qui avaient vécu des rotations plus longues, particulièrement à l'égard des soins des plaies complexes aux patients et de la reconstruction après leurs brûlures. Conclusions : En plus de menacer la prestation harmonieuse des services dans les centres pour grands brûlés, la moins grande exposition des résidents à la rotation des grands brûlés peut compromettre la prestation des soins aux grands brûlés dans la communauté. Les résultats de ce sondage réfutent toute prétention selon laquelle les services aux grands brûlés est une rotation « à faible rendement ¼ selon le point de vue de l'acquisition des APC.

Multifaceted Strategy That Improves Students' Achievement of Entrustable Professional Activities Across Advanced Pharmacy Practice Experiences.

OBJECTIVE: To outline an approach to help students achieve Entrustable Professional Activities (EPAs) entrustment during a sequence of Advanced Pharmacy Practice Experiences (APPEs) by implementing longitudinal monitoring and individualized intervention and remediation strategies. METHODS: Using the recommended EPAs within the core APPEs (acute care, ambulatory care, community, institutional), students were expected to achieve entrustment on all EPAs by graduation. A longitudinal monitoring approach, using an "EPA report card," was implemented to continuously identify students at risk of not meeting the EPA requirement of "Level 3" entrustment (perform with reactive supervision). Individualized interventions, including proactive outreach and in-sequence remediation, were incorporated into the APPE core and elective sequence to help ensure all students were entrusted by the end of APPEs without requiring further end-of-year remediation to graduate. RESULTS: For the graduating classes of 2023 and 2024, 12% (8 of 69) and 16% (12 of 75) students, respectively, were identified as at risk of not meeting EPA entrustment. Proactive outreach, in-sequence remediation, or a combination of both strategies, were used to enhance learning and EPA performance. As a result, all students achieved "Level 3" entrustment on the deficient EPA(s) by the end of the APPE sequence. No student required further end-of-year remediation to graduate. CONCLUSION: Utilizing a multifaceted strategy provided timely, real-world practice opportunities to improve the students' achievement of EPAs across the APPE curriculum and decreased the need for end-of-year remediation and potential graduation delays.

Framing our Expectations: Variability in Entrustable Professional Activity Assessments.

OBJECTIVE: To determine the ability of surgical trainees and faculty to correctly interpret entrustability of a resident learner in a modeled patient care scenario. DESIGN: Prospective study utilizing a web-based survey including 4 previously-recorded short videos of resident learners targeted to specific levels of the American Board of Surgery's (ABS) Entrustment Scale. Respondents were asked to choose the entrustment level that best corresponded to their observations of the learner in the video. Responses were subcategorized by low and high entrustment. SETTING: Online, utilizing the Qualtrics survey platform. PARTICIPANTS: Survey targeting US surgical trainees and surgical faculty via email and social media. We received 31 complete responses and 2 responses which completed > 1 video assessment question without demographic information (n = 33). Respondents included 10 trainees (32%) and 21 attending surgeons (68%). RESULTS: Neither faculty nor trainees readily identified the targeted entrustment level for Question 1 (preoperative care of a patient with acute appendicitis with high entrustment, 36% correct), though evaluations of the remaining questions (2 through 4) demonstrated more accuracy (70, 84, and 75% correct, respectively). Faculty were more readily able than trainees to identify low entrustment (level Limited Participation) in intraoperative inguinal hernia repair (95% vs 60%, p = 0.03). After subcategorization to high and low entrustment, both residents and faculty were able to accurately identify entrustment 95% overall. CONCLUSIONS: Both trainees and attending surgeons were able to identify high- and low-performing residents on short video demonstrations using the ABS EPA entrustment scale. This provides additional evidence in support of the need for frequent observations of EPAs to account for the variability in raters' perceptions in addition to complexity of clinical scenarios. Frame-of-reference training via a video-based platform may also be beneficial for both residents and faculty as an ongoing EPA implementation strategy.

Entrustable Professional Activities in Palliative Medicine: A Faculty and Learner Development Activity.

Background: Faculty development (FD) is critical to the implementation of competency-based medical education (CBME) and yet evidence to guide the design of FD activities is limited. Our aim with this study was to describe and evaluate an FD activity as part of CBME implementation. Methods: Palliative medicine faculty were introduced to entrustable professional activities (EPAs) and gained experience estimating a learner's level of readiness for entrustment by directly observing a simulated encounter. The variation that was found among assessments was discussed in facilitated debrief sessions. Attitudes and confidence levels were measured 1 week and 6 months following debriefs. Results: Participants were able to use the EPA framework when estimating the learner's readiness level for entrustment. Significant improvements in attitudes and level of confidence for several knowledge, skill, and behavior domains were maintained over time. Conclusions: Simulated direct observation and facilitated debriefs contributed to preparing both faculty and learners for CBME and EPA implementation.

Validation of entrustable professional activities for use in neonatal care residency programs.

OBJECTIVE: Define and develop a set of entrustable professional activities (EPAs) to link clinical training and assessment of the hospital components of neonatal care in neonatology medical residency programs. METHODS: An exploratory study was conducted in two phases using a modified Delphi approach. In the first phase, a committee of five neonatology residency program coordinators drafted an initial set of EPAs based on the national matrix of competencies and on EPAs defined by international organizations. In the second phase, a group of neonatal care physicians and medical residents rated the indispensability and clarity of the EPAs and provided comments and suggestions. RESULTS: Seven EPAs were drafted by the coordinators´ committee (n = 5) and used in the content validation process with a group (n = 37) of neonatal care physicians and medical residents. In the first Delphi round, all EPAs reached a content validity index (CVI) above 0.8. The coordinators´ committee analyzed comments and suggestions and revised the EPAs. A second Delphi round with the revised EPAs was conducted to validate and all items maintained a CVI above 0.8 for indispensability and clarity. CONCLUSION: Seven entrustable professional activities were developed to assess residents in the hospital components of neonatal care medicine. These EPAs might contribute to implementing competency-based neonatology medical residency programs grounded in core professional activities.

Towards a flexible and personalised development of veterinarians and veterinary nurses working in a companion animal referral care setting.

In the Netherlands, the demand for veterinarians and veterinary nurses (VNs) working within referral care is rapidly growing and currently exceeds the amount of available board-certified specialists. Simultaneously, a transparent structure to guide training and development and to assess quality of non-specialist veterinarians and VNs working in a referral setting is lacking. In response, we developed learning pathways guided by an entrustable professional activity (EPA) framework and programmatic assessment to support personalised development and competence of veterinarians and VNs working in referral settings. Between 4 and 35 EPAs varying per discipline (n = 11) were developed. To date, 20 trainees across five disciplines have been entrusted. Trainees from these learning pathways have proceeded to acquire new EPAs in addition to their already entrusted set of EPAs or progressed to specialist training during (n = 3) or after successfully completing (n = 1) the learning pathway. Due to their outcome-based approach, the learning pathways support flexible ways of development.

EHR-Driven Delivery of EPA Assessments Significantly Improves Participation.

INTRODUCTION: Digital education tools are a cornerstone in the evolution to CBME through EPAs. Successful implementation requires understanding the variable impacts of EHR-driven delivery of EPAs, flexible digital device access to EPAs, and user-behavior trends. METHODS: Through a HIPAA compliant, flexible-device accessible, surgical education platform, general surgery training programs at 21 institutions collected EPA from July 2023 to April 2024. At 5 EHR-integrated institutions (EHR+), EPA were created for clinical activities based on the OR schedule, automatically pushed to attendings and residents with built in completion reminders. At 16 institutions without EHR integration (EHR-), EPA were initiated manually. To improve user experience, care phases were bundled (cEPA). We compared the EHR+ and EHR- groups, computing descriptive statistics on the cEPAs completed and user behavior metrics. RESULTS: We collected 4187 cEPAs in total, with 82% at EHR+ institutions and 18% at EHR- institutions. Platform triggering dramatically drove cEPA completion for both faculty and residents, 88% and 81%, respectively. Only 3% were initiated by the faculty or resident. Faculty at EHR+ institutions strongly preferred the automated OR-triggered workflow to start their EPAs (Chi-squared test, p ≈ 0). Faculty completed all 3 care phases nearly 80% of the time. Time reminders specifically drive EPA completion for residents and faculty on weekdays and build habits on weekends. 71% of cEPAs completed were by computer, and 29% by phone. More comments were provided when computers were used. Residents reviewed feedback with a median lag of 1 hour and 29 min after results were available. CONCLUSIONS: EHR-driven delivery of EPA leads to a 4.6-fold increase in EPAs completed. EPA initiation is the most critical phase in the workflow and EHR-data driven alerts drive this action. These alerts are also effective drivers of habit formation. Flexible device access is important to increase EPAs completed and improve the usefulness through comments for residents.