Thresholds and interpretations: How clinical competency committees identify pediatric residents with performance concerns.

BACKGROUND: Clinical competency committee (CCC) identification of residents with performance concerns is critical for early intervention. METHODS: Program directors and 94 CCC members at 14 pediatric residency programs responded to a written survey prompt asking them to describe how they identify residents with performance concerns. Data was analyzed using thematic analysis. RESULTS: Six themes emerged from analysis and were grouped into two domains. The first domain included four themes, each describing a path through which residents could meet or exceed a concern threshold:1) written comments from rotation assessments are foundational in identifying residents with performance concerns, 2) concerning performance extremes stand out, 3) isolated data points may accumulate to raise concern, and 4) developmental trajectory matters. The second domain focused on how CCC members and program directors interpret data to make decisions about residents with concerns and contained 2 themes: 1) using norm- and/or criterion-referenced interpretation, and 2) assessing the quality of the data that is reviewed. CONCLUSIONS: Identifying residents with performance concerns is important for their education and the care they provide. This study delineates strategies used by CCC members across several programs for identifying these residents, which may be helpful for other CCCs to consider in their efforts.

Categorical Pediatric Residency Program Curriculum Needs: A Study of Graduating Residents and Residency Program Leadership.

BACKGROUND: Pediatric residency programs must adapt their curriculum to meet evolving patient needs yet face limited resources to implement changes resulting in gaps. We performed a categorical pediatric residency program curriculum needs assessment to inform curriculum development efforts. METHODS: We analyzed data from the 2017 American Academy of Pediatrics Annual Survey of Graduating Residents and pediatric program and associate program director polls conducted at a 2019 pediatric residency program director national meeting. We used conventional content analysis to code and categorize. RESULTS: Participants included 528 (53%) graduating residents representing 88% of programs, 89 program directors, and 177 associate program directors representing at minimum 45% of programs. Participants demonstrated concordance on the top 4 needs-additional clinical experiences, career development, business of medicine, and health systems. Program leaders also identified wellness and resiliency; disparities; diversity, equity, and inclusion; and communication. CONCLUSIONS: This is the first categorical pediatric program general curriculum needs assessment conducted of pediatric leadership and graduating residents in over a decade. While program leadership and resident data were collected 2 years apart, we found concordance on the top 4 categories and consistency with prior national needs assessments with the exception of career development. New curriculum development efforts are underway.

Justifications for Discrepancies Between Competency Committee and Program Director Recommended Resident Supervisory Roles.

OBJECTIVE: To explore justifications for differences between summative entrustment decisions made about pediatric residents by individuals who are charged with the review of residents (clinical competency committee, or CCC, members) and those who ultimately make final summative decisions about resident performance (program directors, or PDs). METHODS: Individual CCC member and PD supervisory role categorizations were made in the 2015 to 2016 academic year at 14 pediatric residency programs, placing residents into 1 of 5 progressive supervisory roles. When PD recommendations differed from CCC members, a free-text justification was requested. Free-text responses were analyzed using manifest content analysis. RESULTS: In total, 801 supervisory role categorizations were made by both CCC members and PDs, with the same recommendations made in 685 cases. In the 116 instances of discrepancy, PDs assigned a lower level of supervisory responsibility (n = 73) more often than a greater one (n = 43). When moving residents to a greater supervisory role category, PDs had more justifications anchored in resident performance than experience. When moving residents to a lower supervisory role categorization, PDs conversely noted experience more than performance. CONCLUSIONS: PDs provide more justifications anchored in resident performance when moving residents to a greater supervisory role category compared with CCC members. However, when moving residents to a lower supervisory role categorization, they note experience more than performance. These patterns may or may not be entirely consistent with a competency-based approach and should be explored further.