Implementing Entrustable Professional Activities in Pediatric Fellowships: Facilitating the Process.

BACKGROUND AND OBJECTIVES: Entrustable professional activities (EPAs) will be used for initial certification by the American Board of Pediatrics by 2028. Less than half of pediatric fellowships currently use EPAs for assessment, yet all will need to adopt them. Our objectives were to identify facilitators and barriers to the implementation of EPAs to assess pediatric fellows and to determine fellowship program directors' (FPD) perceptions of EPAs and Milestones. METHODS: We conducted a survey of FPDs from 15 pediatric subspecialties. EPA users were asked about their implementation of EPAs, barriers encountered, and perceptions of EPAs. Nonusers were queried about deterrents to using EPAs. Both groups were asked about potential facilitators of implementation and their perceptions of Milestones. RESULTS: The response rate was 65% (575/883). Of these, 344 (59.8%) were EPA users and 231 (40.2%) were nonusers. Both groups indicated work burden as a barrier to implementation. Nonusers reported more barriers than users (mean [SD]: 7 [3.8] vs 5.8 [3.4], P < .001). Both groups identified training materials and premade assessment forms as facilitators to implementation. Users felt that EPAs were easier to understand than Milestones (89%) and better reflected what it meant to be a practicing subspecialty physician (90%). In contrast, nonusers felt that Milestones were easy to understand (57%) and reflected what it meant to be a practicing subspecialist (58%). CONCLUSIONS: Implementing EPA-based assessment will require a substantial investment by FPDs, facilitated by guidance and easily accessible resources provided by multiple organizations. Perceived barriers to be addressed include FPD time constraints, a need for additional assessment tools, and outcomes data.

Relationship between epa level of supervision with their associated subcompetency milestone levels in pediatric fellow assessment.

BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment. OBJECTIVES: We hypothesized that 1) there would be a strong correlation between EPA LOS ratings with the milestone levels for the subcompetencies mapped to the EPA; 2) some subcompetencies would be more critical in determining entrustment decisions than others, and 3) the correlation would be weaker if the analysis included only milestones reported to the Accreditation Council for Graduate Medical Education (ACGME). METHODS: In fall 2014 and spring 2015, the Subspecialty Pediatrics Investigator Network asked Clinical Competency Committees to assign milestone levels to each trainee enrolled in a pediatric fellowship for all subcompetencies mapped to 6 Common Pediatric Subspecialty EPAs as well as provide a rating for each EPA based upon a 5-point LOS scale. RESULTS: One-thousand forty fellows were assessed in fall and 1048 in spring, representing about 27% of all fellows. For each EPA and in both periods, the average milestone level was highly correlated with LOS (rho range 0.59-0.74; p < 0.001). Correlations were similar when using a weighted versus unweighted milestone score or using only the ACGME reported milestones (p > 0.05). CONCLUSIONS: We found a strong relationship between milestone level and EPA LOS rating but no difference if the subcompetencies were weighted, or if only milestones reported to the ACGME were used. Our results suggest that representative behaviors needed to effectively perform the EPA, such as key subcompetencies and milestones, allow for future language adaptations while still supporting the current model of assessment. In addition, these data provide additional validity evidence for using these complementary tools in building a program of assessment.

Psychosocial supports within pediatric nephrology practices: A pediatric nephrology research consortium survey.

BACKGROUND: The landscape of available psychosocial services within pediatric nephrology care is poorly characterized. However, the effects of kidney disease on emotional health and health-related quality of life are well documented, as is the impact of social determinants of health on kidney disease outcomes. The objectives of this study were to assess pediatric nephrologists' perceptions of available psychosocial services and to elucidate inequities in access to psychosocial care. METHODS: A web-based survey was distributed to members of the Pediatric Nephrology Research Consortium (PNRC). Quantitative analyses were performed. RESULTS: We received responses from 49 of the 90 PNRC centers. With regards to dedicated services, social work was most commonly available (45.5-100%), followed by pediatric psychology (0-57.1%) and neuropsychology (0-14.3%), with no centers having embedded psychiatry. Availability of psychosocial providers was positively associated with nephrology division size, such that as center size increased, access to various psychosocial providers increased. Notably, the majority of respondents indicated that perceived need for psychosocial support exceeds that which is currently available, even at centers with higher levels of current support. CONCLUSIONS: Within the US, there is wide variability in the availability of psychosocial services within pediatric nephrology centers despite a well-documented necessity for the provision of holistic care. Much work remains to better understand the variation in funding for psychosocial services and in utilization of psychosocial professionals in the pediatric nephrology clinic, and to inform key best practices for addressing the psychosocial needs of patients with kidney disease.

A Qualitative Analysis of Assessment and Evaluation Practices Within the Individualized Curriculum.

OBJECTIVE: The Accreditation Council of Graduate Medical Education requires an "individualized curriculum" (IC) in pediatric residency. A shared understanding across programs of methods to evaluate the IC is lacking. We explored pediatric program leaders' perceptions of assessment and evaluation within the IC to further understand and inform most useful practices. METHODS: We conducted a phenomenology study using semi-structured interviews to 1) determine what IC assessment and evaluation strategies are utilized in pediatric residency programs, and 2) explore program leaders' perceptions of the feasibility and value of assessment and evaluation in the IC. We recruited a purposive sample of leaders from 15 pediatric residency programs of various sizes and regions. Interviews were recorded and transcribed. Data were analyzed to produce themes. RESULTS: Three themes arose from our analysis: 1) Systematic assessment of the IC, though desired, is not robust in pediatric residency training; 2) Program differences present unique barriers and facilitators that impact the feasibility of assessment within the IC; and 3) Meaningfulness of assessment in the IC varies by stakeholder. Themes reflected perspectives on individual learner assessment and program evaluation. CONCLUSIONS: While systematic assessment and evaluation of the IC in pediatric residency training is lacking, program leaders desire feasible strategies that are meaningful to the resident, the program, and its leadership team. Leveraging current assessment and evaluation tools and aligning new assessment strategies could promote the integration of IC assessment with other assessments, minimizing burden. More structured IC assessment and evaluation could inform how to best achieve curricular goals of the IC.

An Initiative to Increase Residency Program Diversity.

A physician workforce that reflects the patient population is associated with improved patient outcomes and promotes health equity. Notwithstanding, racial and ethnic disparities persist within US medical schools, making some individuals underrepresented in medicine (URM). We sought to increase the percentage of URM residents who matched into our pediatric residency programs from a baseline of 5% to 35% to achieve demographic parity with our patients. We developed a multifaceted approach using multiple iterative tests of change, with the primary strategy being increased visibility of URM trainees and faculty to residency applicants. Strategies included applicant interviews with URM faculty, interview dinners with URM residents, visibility at academic conferences for URM trainees, development of targeted marketing materials, and a visiting student program supported by networking with URM residents. The primary outcome measure was the percentage of matched residents in the categorical pediatrics, child neurology, and medical genetics training programs who identified as URM. The percentage of URM residents increased to 16% (6 of 37) in 2018, 26% (11 of 43) in 2019, 19% (8 of 43) in 2020, and 21% (9 of 43) in 2021 (a four-year average of 22% URM residents; P = .0002). This progress toward a more representative residency program was met by challenges, such as pipeline concerns, the minority tax, and recruitment during a pandemic. We were able to implement small, low-resource strategies that had a large cumulative impact and could be implemented in other residency programs. Specific tactics and challenges encountered are discussed in this special article.

Fellow Entrustment for the Common Pediatric Subspecialty Entrustable Professional Activities Across Subspecialties.

OBJECTIVE: To determine the relationship between level of supervision (LOS) ratings for the Common Pediatric Subspecialty Entrustable Professional Activities (EPAs) with their associated subcompetency milestones across subspecialties and by fellowship training year. METHODS: Clinical Competency Committees (CCCs) in 14 pediatric subspecialties submitted LOS ratings for 6 Common Subspecialty EPAs and subcompetency milestone levels mapped to these EPAs. We examined associations between these subcompetency milestone levels and LOS ratings across subspecialty training year by fitting per-EPA linear mixed effects models, regressing LOS rating on milestone level and on training year. RESULTS: CCCs from 211 pediatric fellowship programs provided data for 369 first, 336 second, and 331 third year fellows. Mean subcompetency milestone levels increased similarly among subspecialties for most EPAs compared with the reference, Adolescent Medicine. Mean subcompetency milestones mapped to each EPA and mean EPA LOS ratings generally increased by training year across all subspecialties. CONCLUSIONS: Subcompetency milestones levels mapped to each Common Subspecialty EPA and the EPA LOS ratings increase similarly across subspecialties and by training year, providing validity evidence for using EPA LOS to assess pediatric subspecialty trainee performance. This study supports the development of tools to facilitated the CCC evaluation process across all pediatric subspecialties.

Faculty and Peer Support During Pediatric Residency: Association With Performance Outcomes, Race, and Gender.

PURPOSE: To examine the association of resident perception of colleague and faculty support with performance, as measured by milestones-based competency scores, exploring associations between race and gender and perception of support and milestone scoring. METHODS: Resident satisfaction was measured using an annual survey of residents at 49 pediatric residency programs in 2016, 2017, and 2018. Satisfaction with colleague and faculty support was measured using Likert scale survey questions. Pediatric Milestone Competency scores were obtained from the Association of Pediatric Program Directors' Longitudinal Educational Assessment Research Network. Analysis included linear fixed-effects models to examine the relationship between support satisfaction, race, gender, and spring milestone scores. RESULTS: Over 60% of eligible residents responded to the survey. The majority of residents were satisfied with colleague and faculty support, with those identifying as Asian or underrepresented in medicine (URM) reporting lower rates of satisfaction than White peers. Residents satisfied with colleague support had higher milestone scores compared to those with a neutral degree of satisfaction. Residents reporting dissatisfaction with colleague and faculty support had lower milestone scores in most competency domains. Residents identifying as URM had lower milestone scores than White residents, which was partially mediated by lower rates of support satisfaction. CONCLUSIONS: Resident satisfaction with colleague and faculty support correlates with milestone performance. In particular, dissatisfied residents have lower scores than those who are neutral or satisfied. Racial inequities in resident milestone scores may be partially driven by lower rates of support satisfaction among underrepresented residents.

Resident Self-Assessment and Learning Goal Development: Evaluation of Resident-Reported Competence and Future Goals.

OBJECTIVE: To determine incidence of learning goals by competency area and to assess which goals fall into competency areas with lower self-assessment scores. METHODS: Cross-sectional analysis of existing deidentified American Academy of Pediatrics' PediaLink individualized learning plan data for the academic year 2009-2010. Residents self-assessed competencies in the 6 Accreditation Council for Graduate Medical Education (ACGME) competency areas and wrote learning goals. Textual responses for goals were mapped to 6 ACGME competency areas, future practice, or personal attributes. Adjusted mean differences and associations were estimated using multiple linear and logistic regression. RESULTS: A total of 2254 residents reported 6078 goals. Residents self-assessed their systems-based practice (51.8) and medical knowledge (53.0) competencies lowest and professionalism (68.9) and interpersonal and communication skills (62.2) highest. Residents were most likely to identify goals involving medical knowledge (70.5%) and patient care (50.5%) and least likely to write goals on systems-based practice (11.0%) and professionalism (6.9%). In logistic regression analysis adjusting for postgraduate year (PGY), gender, and degree type (MD/DO), resident-reported goal area showed no association with the learner's relative self-assessment score for that competency area. In the conditional logistic regression analysis, with each learner serving as his or her own control, senior residents (PGY2/3+s) who rated themselves relatively lower in a competency area were more likely to write a learning goal in that area than were PGY1s. CONCLUSIONS: Senior residents appear to develop better skills and/or motivation to explicitly turn self-assessed learning gaps into learning goals, suggesting that individualized learning plans may help improve self-regulated learning during residency.

Self-Management and Transition Readiness Assessment: Concurrent, Predictive and Discriminant Validation of the STARx Questionnaire.

INTRODUCTION: The STARx Questionnaire was designed with patient and provider input, to measure self-management and transition skills in adolescents and young adults (AYA) with chronic health conditions. With proven reliability and an empirically-based factor structure, the self-report STARx Questionnaire requires further validation to demonstrate its clinical and research utility. In this study we examine the concurrent, predictive, and discriminant validity of the STARx Questionnaire. METHODS: To examine concurrent validity, the STARx Questionnaire was compared to two other published transition readiness tools. Predictive validity was examined using linear regressions between the STARx Total Score and literacy, medication adherence, quality of life, and health services use. Discriminant validity was examined by comparing the performance of three chronic illness conditions on the STARx Total Score and associated subscales. RESULTS: The STARx Questionnaire and its subscales positively correlated with the scores for both transition readiness tools reflecting strong concurrent validity. The STARx Questionnaire also correlated positively with the literacy, self-efficacy, and adherence measures indicating strong predictive validity; however, it did not correlate with either quality of life or health care utilization. The performance of AYA across three different clinical conditions was not significant, indicating the clinical utility of this HCT tool for a variety of chronic health conditions. CONCLUSION: The strong validity of the STARx Questionnaire, in tandem with its strong reliability, indicated adequate psychometric properties for this generic self-report measure. These strong psychometric properties should contribute to the STARx being a viable measure of health care transition for both research and clinical purposes.

Blueprint for Action: Visioning Summit on the Future of the Workforce in Pediatrics.

The Federation of Pediatric Organizations engaged members of the pediatric community in an 18-month process to envision the future of the workforce in pediatrics, culminating in a Visioning Summit on the Future of the Workforce in Pediatrics. This article documents the planning process and methods used. Four working groups were based on the 4 domains that are likely to affect the future workforce: Child Health Research and Training, Diversity and Inclusion, Gender and Generations, and Pediatric Training Along the Continuum. These groups identified the issues and trends and prioritized their recommendations. Before the summit, 5 key megatrends cutting across all domains were identified:1. Aligning Education to the Emerging Health Needs of Children and Families 2. Promoting Future Support for Research Training and for Child Health Research 3. Striving Toward Mastery Within the Profession 4. Aligning and Optimizing Pediatric Practice in a Changing Health Care Delivery System 5. Taking Advantage of the Changing Demographics and Expertise of the Pediatric Workforce At the Visioning Summit, we assembled members of each of the working groups, the Federation of Pediatric Organizations Board of Directors, and several invited guests to discuss the 5 megatrends and develop the vision, solutions, and actions for each megatrend. Based on this discussion, we offer 10 recommendations for the field of pediatrics and its leading organizations to consider taking action.

Why medical education is being (inexorably) re-imagined and re-designed.

The last widespread reimagining and substantive reform in medical student education followed the Flexner Report (published 1910). Given the dramatic changes in educational methods, pedagogy, and technology, and the dramatic changes in society, medical education has inexorably evolved in intentional and unintentional ways. The transition from the post-Flexnerian model (university-based education with the first 2 years organized around classroom didactics, laboratory/anatomy learning followed by 2 years of inpatient and outpatient clinical experiences organized around a distribution of block and elective rotations) to the models of today (highlighting early clinical exposure, integration of foundational and clinical sciences, longitudinal learning experiences, promotion of self-directed learning skills, and competency-based education) is underway. The focus now is to prepare graduates for the continued explosion of medical knowledge, technological development and expanded patient and societal expectations that increasingly characterize this century. The following five important developments in medical education drive these re-imaging and re-design efforts: (1) patient, societal and governmental pressure to deliver on the Triple Aim; (2) conceptualization of medical education as a translational science; (3) medical knowledge and technology will continue to expand and accelerate the pace of new development; (4) new expectations of present and future generations of learners; and (5) better understanding of the neurobiology of learning. The impact of these developments, and our responses as those dedicated to educating the present and future physicians, will determine much of the outcomes in this journey to evidence-based medical education. With all of the information and techniques available to the inquisitive and diligent teacher, there will be ample rewards for teaching well done.

Kidney transplantation in the United States: economic burden and recent trends analysis.

OBJECTIVE: As kidney transplant is the preferred mode of management of advanced kidney disease and economic trends for kidney transplant procedures are not well known, data were analyzed to assess these trends. DATA SOURCE: Annual data for 1998 to 2008 from the Nationwide Inpatient Sample, Healthcare Cost and Utilization Project, Agency for Healthcare Research and Quality were used to analyze characteristics of patients discharged from hospitals in the United States with kidney transplant as the primary procedure. DATA SYNTHESIS/RESULTS: The population more than 65 years old had the most significant increase in hospitalizations for kidney transplant procedures (P< .01). The mean length of stay decreased by 2.8 days over the period studied (P= .02). Mean hospital charge increased despite a decrease in length of stay resulting in a 225% increase in charge per day of hospitalization, from $6907 in 1998 to $22 484 in 2008. The national aggregate hospital charges for kidney transplant procedures rose from $0.9 billion in 1998 to $3.1 billion in 2008. Kidney transplant was overall ranked sixth by mean cost per hospitalization and ranked seventh by mean charge per hospitalization among the Clinical Classification Software's Services and Procedures in this database in 2008. CONCLUSION: Despite shorter hospital stays, the economic burden of kidney transplants increased from 1998 to 2008.

Self-assessment on the competencies and reported improvement priorities for pediatrics residents.

BACKGROUND: Self-assessment and self-directed learning are essential to becoming an effective physician. OBJECTIVE: To identify factors associated with resident self-assessment on the competencies, and to determine whether residents chose areas of self-assessed relative weakness as areas for improvement in their Individualized Learning Plan (ILP). METHODS: We performed a cross-sectional analysis of the American Academy of Pediatrics' PediaLink ILP database. Pediatrics residents self-assessed their competency in the 6 Accreditation Council for Graduate Medical Education competencies using a color-coded slider scale with end anchors "novice" and "proficient" (0-100), and then chose at least 1 competency to improve. Multivariate regression explored the relationship between overall confidence in core competencies, sex, level of training, and degree (MD or DO) status. Correlation examined whether residents chose to improve competencies in which they rated themselves as lower. RESULTS: A total of 4167 residents completed an ILP in academic year 2009-2010, with residents' ratings improving from advanced beginner (48 on a 0-100 scale) in postgraduate year-1 residents (PGY-1s) to competent (75) in PGY-3s. Residents rated themselves as most competent in professionalism (mean, 75.3) and least competent in medical knowledge (mean, 55.8) and systems-based practice (mean, 55.2). In the adjusted regression model, residents' competency ratings increased by level of training and whether they were men. In PGY-3s, there was no difference between men and women. Residents selected areas for improvement that correlated to competencies where they had rated themselves lower (P < .01). CONCLUSION: Residents' self-assessment of their competencies increased by level of training, although residents rated themselves as least competent in medical knowledge and systems-based practice, even as PGY-3s. Residents tended to choose subcompetencies, which they rated as lower to focus on improving.

Fellows as teachers: a model to enhance pediatric resident education.

OBJECTIVE: Pressures on academic faculty to perform beyond their role as educators has stimulated interest in complementary approaches in resident medical education. While fellows are often believed to detract from resident learning and experience, we describe our preliminary investigations utilizing clinical fellows as a positive force in pediatric resident education. Our objectives were to implement a practical approach to engage fellows in resident education, evaluate the impact of a fellow-led education program on pediatric resident and fellow experience, and investigate if growth of a fellowship program detracts from resident procedural experience. METHODS: This study was conducted in a neonatal intensive care unit (NICU) where fellows designed and implemented an education program consisting of daily didactic teaching sessions before morning clinical rounds. The impact of a fellow-led education program on resident satisfaction with their NICU experience was assessed via anonymous student evaluations. The potential value of the program for participating fellows was also evaluated using an anonymous survey. RESULTS: The online evaluation was completed by 105 residents. Scores were markedly higher after the program was implemented in areas of teaching excellence (4.44 out of 5 versus 4.67, p<0.05) and overall resident learning (3.60 out of 5 versus 4.61, p<0.001). Fellows rated the acquisition of teaching skills and enhanced knowledge of neonatal pathophysiology as the most valuable aspects of their participation in the education program. The anonymous survey revealed that 87.5% of participating residents believed that NICU fellows were very important to their overall training and education. CONCLUSIONS: While fellows are often believed to be a detracting factor to residency training, we found that pediatric resident attitudes toward the fellows were generally positive. In our experience, in the specialty of neonatology a fellow-led education program can positively contribute to both resident and fellow learning and satisfaction. Further investigation into the value of utilizing fellows as a positive force in resident education in other medical specialties appears warranted.

Factors influencing pediatric nephrology trainee entry into the workforce.

BACKGROUND AND OBJECTIVES: Emerging needs in pediatric nephrology (PN) have made the number of nephrologists entering the workforce of critical importance. This study aimed to discern factors that influence PN fellows to choose their career path and decide to enter the PN workforce. DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS: A survey was sent to the American Society of Pediatric Nephrology list of PN fellows (n = 103) in 2008. The 57 fellows (55%) who completed the survey were representative of the group. RESULTS: The majority decided on a career in PN as senior residents, most commonly due to their interest in renal physiology and academics. They felt residents chose other fields due to lack of interest/exposure to PN, financial constraints, and perceived PN workload. Fellows identified workload and their perception of faculty dissatisfaction as important concerns with PN. None of the respondents planned to leave fellowship, but 21% have considered this. Twenty-eight percent knew a PN fellow who resigned, thought to be due to workload, personal conflicts, and perceived faculty dissatisfaction. CONCLUSIONS: Exposing residents to PN earlier in training and emphasizing positive features may create greater interest in PN. PN programs should be cognizant of workload and the influence of faculty dissatisfaction. Ongoing evaluation of PN fellow perceptions can assist in efforts to enhance recruitment and retention.

Assessment and treatment of short stature in pediatric patients with chronic kidney disease: a consensus statement.

Growth failure is a clinically important issue in children with chronic kidney disease (CKD) and is associated with significant morbidity and mortality. Many factors contribute to impaired growth in these children, including abnormalities in the growth hormone (GH)-insulin-like growth factor-I (IGF-I) axis, malnutrition, acidosis, and renal bone disease. The management of growth failure in children with CKD is complicated by the presence of other disease-related complications requiring medical intervention. Despite evidence of GH efficacy and safety in this population, some practitioners and families have been reluctant to institute GH therapy, citing an unwillingness to comply with daily injections, reimbursement difficulties, or impending renal transplantation. Suboptimal attention to growth failure management may be further compounded by a lack of clinical guidelines for the appropriate assessment and treatment of growth failure in these children. This review of growth failure in children with CKD concludes with an algorithm developed by members of the consensus committee, outlining their recommendations for appropriate steps to improve growth and overall health outcomes in children with CKD.