Three Years of X + Y Scheduling: Longitudinal Assessment of Resident and Faculty Perceptions.

OBJECTIVE: Five pediatric residency programs implemented true X + Y scheduling in 2018 where residents have continuity clinic in "blocks" rather than half-day per week experiences. We report the impact X + Y scheduling has on pediatric resident and faculty perceptions of patient care and other educational experiences over a 3-year timeframe. METHODS: Electronic surveys were sent to residents and faculty of the participating programs prior to implementing X + Y scheduling and annually thereafter (2018-2021). Survey questions measured resident and faculty perception of continuity clinic schedule satisfaction and the impact of continuity clinic schedules on inpatient and subspecialty rotations. Data were analyzed using z-tests for proportion differences. RESULTS: One hundred and eight six residents were sent the survey preimplementation and 254 to 289 postimplementation with response rates ranging from 47% to 69%. Three hundred and seventy-eight to 395 faculty members were sent the survey with response rates ranging from 26% to 51%. Statistically significant (P < .05) sustained perceived improvements over 3 years with X+Y were seen in outpatient continuity, inpatient workflow, and time for teaching both inpatient and in continuity clinic. CONCLUSIONS: X + Y scheduling can lead to perceived improvements in various aspects of pediatric residency programs. Our study demonstrates these improvements have been sustained over 3 years in the participating programs.

Impact of X+Y Scheduling on Pediatric Resident and Faculty Perceptions of Education and Patient Care.

PURPOSE: Traditional half-day per week continuity clinic experiences can lead to fragmented education in both the inpatient and outpatient arenas. Five pediatric residency programs were granted the ability from the ACGME to create X+Y scheduling where residents have continuity clinic in "blocks" rather than half-day per week experiences. The aim of this study is to assess the impact X+Y scheduling has on pediatric resident and faculty perceptions of patient care and other educational experiences. METHODS: Electronic surveys were sent to residents and faculty of the participating programs both prior to and 12 months after implementing X+Y scheduling. Survey questions measured resident and faculty perception of continuity clinic schedule satisfaction and the impact of continuity clinic schedules on inpatient and subspecialty rotation experiences using a 5-point Likert Scale. Data were analyzed using z-tests for proportion differences for those answering Agree or Strongly Agree between baseline and post-implementation respondents. RESULTS: Hundred and twenty-six out of 186 residents (68%) responded preimplementation and 120 out of 259 residents (47%) responded post-implementation. 384 faculty members were sent the survey with 51% response pre-implementation and 26% response at 12 months. Statistically significant (P < .05) improvements were noted in resident and faculty perceptions of ability to have continuity with patients and inpatient workflow affected by clinic scheduling. CONCLUSIONS: From both resident and faculty perspectives, X+Y scheduling may improve several aspects of patient care and education. X+Y scheduling could be considered as a potential option by pediatric residency programs, especially if validated with more objective data.

Shared Mental Models Among Clinical Competency Committees in the Context of Time-Variable, Competency-Based Advancement to Residency.

PURPOSE: To evaluate response process validity evidence for clinical competency committee (CCC) assessments of first-year residents on a subset of General Pediatrics Entrustable Professional Activities (EPAs) and milestones in the context of a national pilot of competency-based, time-variable (CBTV) advancement from undergraduate to graduate medical education. METHOD: Assessments of 2 EPAs and 8 milestones made by the trainees' actual CCCs and 2 different blinded "virtual" CCCs for 48 first-year pediatrics residents at 4 residency programs between 2016 and 2018 were compared. Residents had 3 different training paths from medical school to residency: time-variable graduation at the same institution as their residency, time-fixed graduation at the same institution, or time-fixed graduation from a different institution. Assessments were compared using ordinal mixed-effects models. RESULTS: Actual CCCs assigned residents higher scores than virtual CCCs on milestones and one EPA's supervision levels. Residents who graduated from a different institution than their residency received lower milestone ratings than either group from the same institution; CBTV residents received higher ratings on one milestone (ICS4) and similar ratings on all others compared with non-CBTV residents who completed medical school at the same institution. CONCLUSIONS: First-year residents who graduated from CBTV medical school programs were assessed as having the same level of competence as residents who graduated from traditional medical school programs, but response process evidence suggests that members of CCCs may also draw on undocumented personal knowledge of the learner to draw conclusions about resident competence.

Narrative Performance Level Assignments at Initial Entrustment and Graduation: Integrating EPAs and Milestones to Improve Learner Assessment.

PURPOSE: To determine which narrative performance level for each general pediatrics entrustable professional activity (EPA) reflects the minimum level clinical competency committees (CCCs) felt should be associated with graduation as well as initial entrustment and compare expected narrative performance levels (ENPLs) for each EPA with actual narrative performance levels (ANPLs) assigned to residents at initial entrustment. METHOD: A series of 5 narratives, corresponding to the 5 milestone performance levels, were developed for each of the 17 general pediatrics EPAs. In academic year (AY) 2015-2016, the CCCs at 22 Association of Pediatric Program Directors Longitudinal Educational Assessment Research Network member sites reported ENPLs for initial entrustment and at time of graduation. From AYs 2015-2016 to 2017-2018, programs reported ANPLs for initial entrustment decisions. ENPLs and ANPLs were compared using a logistic mixed effects model. RESULTS: ENPLs for graduation and entrustment were most often level 3 (competent) followed by level 4 (proficient). For 8 EPAs, the ENPLs for graduation and entrustment were the same. For the remaining 9, some programs would entrust residents before graduation or graduate them before entrusting them. There were 4,266 supervision level reports for initial entrustment for which an ANPL was provided. ANPLs that were lower than the ENPLs were significantly more likely to be assigned to the medical home-well child (OR = 0.39; 95% CI: 0.26-0.57), transition to adult care (OR = 0.43; 95% CI: 0.19-0.95), behavioral or mental health (OR = 0.36; 95% CI: 0.18-0.71), make referrals (OR = 0.31; 95% CI: 0.17-0.55), lead a team (OR = 0.34; 95% CI: 0.22-0.52), and handovers (OR = 0.18; 95% CI: 0.09-0.36) EPAs. CONCLUSIONS: CCCs reported lower ENPLs for graduation than for entrustment for 5 EPAs, possibly indicating curricular gaps that milestones and EPAs could help identify.

Pediatric Chief Resident Exchange Program-A Novel Method to Share Educational Ideas Across Training Programs.

BACKGROUND: Pediatric residency programs offer many conferences and activities to meet the educational needs of their residents. We developed and assessed the Pediatric Chief Resident Exchange Program where pediatric chief residents visited another institution for a day with the goal of sharing educational and curricular innovations between residency programs in an experiential manner. APPROACH/INNOVATION: Pediatric chief residents participated in various activities during the exchange including educational conferences and discussions with residency program leadership at the host institutions. Surveys were administered to all participating chiefs to determine if any changes to educational conferences or curriculum were made or planned to be made at their home program based upon what they observed at the other institution and to have chiefs reflect on what they gained from the experience. RESULTS: Twenty-eight chief residents from 9 programs participated in the exchange program over 3 academic years (2015-2018). All respondents felt the exchange experience was worthwhile. The majority (67%) of programs planned to implement a change at their institution based on participation in the exchange with over half actually making a change by the end of the academic year. Participating chiefs gained a sense of camaraderie, appreciated that other programs experienced similar struggles, and developed further insight into the chief resident role. DISCUSSION: The Pediatric Chief Resident Exchange Program is a novel method of sharing educational practices between institutions that can lead to curricular changes at participating programs. It can also be an opportunity for chief resident professional development.