Implementing Entrustable Professional Activities in Pediatric Fellowships: Facilitating the Process.

BACKGROUND AND OBJECTIVES: Entrustable professional activities (EPAs) will be used for initial certification by the American Board of Pediatrics by 2028. Less than half of pediatric fellowships currently use EPAs for assessment, yet all will need to adopt them. Our objectives were to identify facilitators and barriers to the implementation of EPAs to assess pediatric fellows and to determine fellowship program directors' (FPD) perceptions of EPAs and Milestones. METHODS: We conducted a survey of FPDs from 15 pediatric subspecialties. EPA users were asked about their implementation of EPAs, barriers encountered, and perceptions of EPAs. Nonusers were queried about deterrents to using EPAs. Both groups were asked about potential facilitators of implementation and their perceptions of Milestones. RESULTS: The response rate was 65% (575/883). Of these, 344 (59.8%) were EPA users and 231 (40.2%) were nonusers. Both groups indicated work burden as a barrier to implementation. Nonusers reported more barriers than users (mean [SD]: 7 [3.8] vs 5.8 [3.4], P < .001). Both groups identified training materials and premade assessment forms as facilitators to implementation. Users felt that EPAs were easier to understand than Milestones (89%) and better reflected what it meant to be a practicing subspecialty physician (90%). In contrast, nonusers felt that Milestones were easy to understand (57%) and reflected what it meant to be a practicing subspecialist (58%). CONCLUSIONS: Implementing EPA-based assessment will require a substantial investment by FPDs, facilitated by guidance and easily accessible resources provided by multiple organizations. Perceived barriers to be addressed include FPD time constraints, a need for additional assessment tools, and outcomes data.

Child Health Needs and the Pediatric Gastroenterology Workforce: 2020-2040.

This article is part of an American Board of Pediatrics Foundation-sponsored effort to analyze and forecast the pediatric subspecialty workforce between 2020 and 2040. Herein, an overview of the current pediatric gastroenterology workforce is provided, including demographics, work characteristics, and geographic distribution of practitioners. Brief context is provided on the changing nature of current practice models and the increasing prevalence of some commonly seen disorders. On the basis of a rigorous microsimulation workforce projection model, projected changes from 2020 to 2040 in the number of pediatric gastroenterologists and clinical workforce equivalents in the United States are presented. The article closes with a brief discussion of training, clinical practice, policy, and future workforce research implications of the data presented. This data-driven analysis suggests that the field of pediatric gastroenterology will continue to grow in scope and complexity, propelled by scientific advances and the increasing prevalence of many disorders relevant to the discipline. The workforce is projected to double by 2040, a growth rate faster than most other pediatric subspecialties. Disparities in care related to geography, race, and ethnicity are among the most significant challenges for the years ahead. Changes to training and education, incentives to meet the needs of underserved populations, and new multidisciplinary models for health care delivery will be necessary to optimally meet the volume, diversity, and complexity of children with gastroenterological diseases in the years ahead.

Relationship between epa level of supervision with their associated subcompetency milestone levels in pediatric fellow assessment.

BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment. OBJECTIVES: We hypothesized that 1) there would be a strong correlation between EPA LOS ratings with the milestone levels for the subcompetencies mapped to the EPA; 2) some subcompetencies would be more critical in determining entrustment decisions than others, and 3) the correlation would be weaker if the analysis included only milestones reported to the Accreditation Council for Graduate Medical Education (ACGME). METHODS: In fall 2014 and spring 2015, the Subspecialty Pediatrics Investigator Network asked Clinical Competency Committees to assign milestone levels to each trainee enrolled in a pediatric fellowship for all subcompetencies mapped to 6 Common Pediatric Subspecialty EPAs as well as provide a rating for each EPA based upon a 5-point LOS scale. RESULTS: One-thousand forty fellows were assessed in fall and 1048 in spring, representing about 27% of all fellows. For each EPA and in both periods, the average milestone level was highly correlated with LOS (rho range 0.59-0.74; p < 0.001). Correlations were similar when using a weighted versus unweighted milestone score or using only the ACGME reported milestones (p > 0.05). CONCLUSIONS: We found a strong relationship between milestone level and EPA LOS rating but no difference if the subcompetencies were weighted, or if only milestones reported to the ACGME were used. Our results suggest that representative behaviors needed to effectively perform the EPA, such as key subcompetencies and milestones, allow for future language adaptations while still supporting the current model of assessment. In addition, these data provide additional validity evidence for using these complementary tools in building a program of assessment.

Targeted Assessment of Mucosal Immune Gene Expression Predicts Clinical Outcomes in Children with Ulcerative Colitis.

BACKGROUND AND AIMS: We aimed to determine whether a targeted gene expression panel could predict clinical outcomes in paediatric ulcerative colitis [UC] and investigated putative pathogenic roles of predictive genes. METHODS: In total, 313 rectal RNA samples from a cohort of newly diagnosed paediatric UC patients (PROTECT) were analysed by a real-time PCR microfluidic array for expression of type 1, 2 and 17 inflammation genes. Associations between expression and clinical outcomes were assessed by logistic regression. Identified prognostic markers were further analysed using existing RNA sequencing (RNA-seq) data sets and tissue immunostaining. RESULTS: IL13RA2 was associated with a lower likelihood of corticosteroid-free remission (CSFR) on mesalamine at week 52 (p = .002). A model including IL13RA2 and only baseline clinical parameters was as accurate as an established clinical model, which requires week 4 remission status. RORC was associated with a lower likelihood of colectomy by week 52. A model including RORC and PUCAI predicted colectomy by 52 weeks (area under the receiver operating characteristic curve 0.71). Bulk RNA-seq identified IL13RA2 and RORC as hub genes within UC outcome-associated expression networks related to extracellular matrix and innate immune response, and lipid metabolism and microvillus assembly, respectively. Adult UC single-cell RNA-seq data revealed IL13RA2 and RORC co-expressed genes were localized to inflammatory fibroblasts and undifferentiated epithelial cells, respectively, which was supported by protein immunostaining. CONCLUSION: Targeted assessment of rectal mucosal immune gene expression predicts 52-week CSFR in treatment-naïve paediatric UC patients. Further exploration of IL-13Rɑ2 as a therapeutic target in UC and future studies of the epithelial-specific role of RORC in UC pathogenesis are warranted.

Fellow Entrustment for the Common Pediatric Subspecialty Entrustable Professional Activities Across Subspecialties.

OBJECTIVE: To determine the relationship between level of supervision (LOS) ratings for the Common Pediatric Subspecialty Entrustable Professional Activities (EPAs) with their associated subcompetency milestones across subspecialties and by fellowship training year. METHODS: Clinical Competency Committees (CCCs) in 14 pediatric subspecialties submitted LOS ratings for 6 Common Subspecialty EPAs and subcompetency milestone levels mapped to these EPAs. We examined associations between these subcompetency milestone levels and LOS ratings across subspecialty training year by fitting per-EPA linear mixed effects models, regressing LOS rating on milestone level and on training year. RESULTS: CCCs from 211 pediatric fellowship programs provided data for 369 first, 336 second, and 331 third year fellows. Mean subcompetency milestone levels increased similarly among subspecialties for most EPAs compared with the reference, Adolescent Medicine. Mean subcompetency milestones mapped to each EPA and mean EPA LOS ratings generally increased by training year across all subspecialties. CONCLUSIONS: Subcompetency milestones levels mapped to each Common Subspecialty EPA and the EPA LOS ratings increase similarly across subspecialties and by training year, providing validity evidence for using EPA LOS to assess pediatric subspecialty trainee performance. This study supports the development of tools to facilitated the CCC evaluation process across all pediatric subspecialties.

Continued Supervision for the Common Pediatric Subspecialty Entrustable Professional Activities May Be Needed Following Fellowship Graduation.

PURPOSE: Entrustable professional activities (EPAs) are one approach to competency-based medical education (CBME), and 7 EPAs have been developed that address content relevant for all pediatric subspecialties. However, it is not known what level of supervision fellowship program directors (FPDs) deem necessary for graduation. The Subspecialty Pediatrics Investigator Network (SPIN) investigated FPD perceptions of the minimum level of supervision required for a trainee to successfully graduate. METHOD: In 2017, SPIN surveyed all FPDs of accredited fellowships for 14 subspecialties. For each EPA, the minimum supervision level for graduation (ranging from observation only to unsupervised practice) was set such that no more than 20% of FPDs would accept a lower level. RESULTS: The survey response rate was 82% (660/802). The minimum supervision level for graduation varied across the 7 EPAs from 2 (direct) to 4 (indirect for complex cases), with significant differences between EPAs. The percentage of FPDs desiring a lower minimum supervision level ranged from 3% to 17%. Compared with the 4 nonclinical EPAs (quality improvement, management, lead within the profession, scholarship), the 3 clinical EPAs (consultation, handover, lead a team) had higher minimum supervision graduation levels (P < .001), with less likelihood that an FPD would graduate a learner below their minimum level (P < .001). CONCLUSIONS: Consensus among FPDs across all pediatric subspecialties demonstrates the potential need for ongoing supervision for graduates in all 7 common pediatric subspecialty EPAs after fellowship. As CBME programs are implemented, processes and infrastructure to support new graduates are important considerations for leaders.

Pediatric Gastroenterology, Hepatology, and Nutrition Entrustable Professional Activities: Development of an Assessment Tool and Curricular Resources.

BACKGROUND: Entrustable professional activities (EPAs) are critical activities performed by medical professionals, which can be observed and assessed. Adding on to common EPAs for all pediatric subspecialty trainees, specialty-specific EPAs for pediatric gastroenterology, hepatology, and nutritional fellowship were developed by the North American Society for Pediatric Gastroenterology, Hepatology, and Nutrition (NASPGHAN) EPA Task Force. METHODS: Having developed specialty-specific EPAs, building EPA assessments is the next logical step, as EPAs are included under a larger umbrella of competency-based assessment. Thus, the NASPGHAN EPA Task Force and Training Committee collaborated on an assessment tool and associated curricular resources to aid in tracking trainees' progression to entrustment within individual EPAs and readiness for independent practice. RESULTS: This manuscript reports the development of an EPA assessment tool, including guiding principles and the theory behind the assessment tool, with a focus on simple, meaningful assessments that can provide crucial performance feedback to trainees. In addition, curricular resources were developed, based on the assessment tool, to support training. Ultimately, it is the hope of the NASPGHAN EPA Task Force and Training Committee that this tool can aid training programs in providing formative feedback for trainees, and can be used by training programs and clinical competency committees for summative evaluation.