Implementing Entrustable Professional Activities in Pediatric Fellowships: Facilitating the Process.

BACKGROUND AND OBJECTIVES: Entrustable professional activities (EPAs) will be used for initial certification by the American Board of Pediatrics by 2028. Less than half of pediatric fellowships currently use EPAs for assessment, yet all will need to adopt them. Our objectives were to identify facilitators and barriers to the implementation of EPAs to assess pediatric fellows and to determine fellowship program directors' (FPD) perceptions of EPAs and Milestones. METHODS: We conducted a survey of FPDs from 15 pediatric subspecialties. EPA users were asked about their implementation of EPAs, barriers encountered, and perceptions of EPAs. Nonusers were queried about deterrents to using EPAs. Both groups were asked about potential facilitators of implementation and their perceptions of Milestones. RESULTS: The response rate was 65% (575/883). Of these, 344 (59.8%) were EPA users and 231 (40.2%) were nonusers. Both groups indicated work burden as a barrier to implementation. Nonusers reported more barriers than users (mean [SD]: 7 [3.8] vs 5.8 [3.4], P < .001). Both groups identified training materials and premade assessment forms as facilitators to implementation. Users felt that EPAs were easier to understand than Milestones (89%) and better reflected what it meant to be a practicing subspecialty physician (90%). In contrast, nonusers felt that Milestones were easy to understand (57%) and reflected what it meant to be a practicing subspecialist (58%). CONCLUSIONS: Implementing EPA-based assessment will require a substantial investment by FPDs, facilitated by guidance and easily accessible resources provided by multiple organizations. Perceived barriers to be addressed include FPD time constraints, a need for additional assessment tools, and outcomes data.

Level of Supervision for the Entrustable Professional Activities Common to General Pediatrics and the Subspecialties Decreases from Residency to Fellowship.

OBJECTIVES: To compare level of supervision (LOS) ratings of graduating pediatric residents with their assessments as fellows for the five Entrustable Professional Activities (EPAs) common to general pediatrics and the subspecialties and to determine if the difference between ratings from residency to fellowship is less for the QI and Practice Management EPAs, since the skills needed to perform these may be less context-dependent. METHODS: We compared ratings of graduating residents with their assessments as fellows using LOS data from two sequential EPA studies. RESULTS: There were 65 ratings from 41 residents at the first fellow assessment. At graduation, most residents needed little to no supervision for all EPAs with 94% (61/65) of ratings level four or five. In contrast, only 5/65 (8%) of the first fellow assessments were level four or five. The ratings difference for the QI and Practice Management EPAs was similar to the others. CONCLUSIONS: LOS ratings for the EPAs common to generalists and subspecialists reset as residents become fellows. There was no evidence that the QI and Practice Management EPAs are less context-dependent. This study provides additional validity evidence for using these LOS scales to assess trainees in pediatric residency and fellowship.

Analysis of fellowship program director opinions of entrustable professional activities in adolescent medicine fellowship.

OBJECTIVES: This study aimed to explore the minimum entrustable professional activity (EPA) supervision levels at which pediatric fellowship program directors (FPDs) would be willing to graduate fellows and the levels deemed necessary for safe and effective practice for each of the common pediatric subspecialty and the four adolescent medicine-specific EPAs. METHODS: This cross-sectional study utilized survey data from pediatric FPDs in 2017. FPDs indicated the minimum level of supervision (LOS) for fellows at graduation and for safe and effective practice. RESULTS: 82 percent (23/28) of adolescent medicine FPDs completed the survey. For each EPA, there were differences (p<0.05) between LOS expected for graduation and for safe and effective practice. There was also variability in the level at which FPDs would graduate fellows. CONCLUSIONS: This study summarizes pediatric FPD opinions regarding the minimum levels of supervision required for fellows at the time of graduation as well as the levels deemed necessary for safe and effective practice. The difference between the minimum LOS at which FPDs would graduate a fellow and that deemed appropriate for safe and effective practice, along with variability in minimum LOS for graduation, highlight the need for clearer standards for fellowship graduation as well as more structured early career support for ongoing learning. These data highlight variability in FPD opinion regarding such expectations and both the need to better define desired training outcomes and potential need for post-graduation supervision in clinical practice.

Child Health and the US Pediatric Subspecialty Workforce: Planning for the Future.

This article opens a multi-article Pediatrics supplement that provides a rigorous analysis of the projected pediatric subspecialty workforce in the United States. Congenital variations, epigenetics, exposures, lifestyle, preventive care, and medical interventions from conception through young adulthood set the stage for health and wellbeing in adulthood. Although care provided by pediatric subspecialists is associated with better outcomes and lower costs compared with adult providers, the authors of recent articles in the lay and medical literature have questioned the capacity of pediatric subspecialists to meet children's health care needs. This article highlights that, despite numerous advances in prevention, diagnosis, and treatment, the last decade has witnessed increasing numbers of children with acute or chronic physical and mental health disorders, including medical complexity, obesity, type 2 diabetes, anxiety, depression, and suicidality, all of which are exacerbated by poverty, racism, and other social drivers of health. In this article, we then describe the variability in the demographics, practice characteristics, and geographic distribution of the 15 core pediatric subspecialties certified by the American Board of Pediatrics. We then discuss the rationale and approach to the development of a pediatric subspecialty workforce model that forecasts subspecialist supply from 2020 to 2040 for 14 subspecialties at the national and subnational levels (not including the newest subspecialty, pediatric hospital medicine), accounting for US Census Bureau child population projections. The model does not account for the unique physical and mental needs of individual children, nor does it address the increasingly precarious commitment to, and financing of, pediatric subspecialty care in the US health care system impacting market demand.

Child Health Needs and the Pediatric Critical Care Medicine Workforce: 2020-2040.

This article, focused on the current and future pediatric critical care medicine (PCCM) workforce, is part of a supplement in Pediatrics anticipating the future supply of the pediatric subspecialty workforce. It draws on information available in the literature, data from the American Board of Pediatrics, and findings from a model that estimates the future supply of pediatric subspecialists developed by the American Board of Pediatrics Foundation in collaboration with the Carolina Workforce Research Center at the University of North Carolina at Chapel Hill's Cecil G. Sheps Center for Health Services Research and Strategic Modeling and Analysis Ltd. A brief history of the field of PCCM is provided, followed by an in-depth examination of the current PCCM workforce and a subsequent evaluation of workforce forecasts from 2020 to 2040. Under baseline conditions, the PCCM workforce is expected to increase by 105% during the forecasted period, more than any other pediatric subspecialty. Forecasts are modeled under a variety of multifactorial conditions meant to simulate the effects of changes to the supply of PCCM subspecialists, with only modest changes observed. Future PCCM workforce demand is unclear, although some suggest an oversupply may exist and that market forces may correct this. The findings generate important questions regarding the future state of the PCCM workforce and should be used to guide trainees considering a PCCM career, subspecialty leaders responsible for hosting training programs, staffing ICUs, and governing bodies that oversee training program accreditation and subspecialist certification.

Child Health Needs and the Pediatric Emergency Medicine Workforce: 2020-2040.

Approximately 30 million ill and injured children annually visit emergency departments (EDs) in the United States. Data suggest that patients seen in pediatric EDs by board-certified pediatric emergency medicine (PEM) physicians receive higher-quality care than those cared for by non-PEM physicians. These benefits, coupled with the continued growth in PEM since its inception in the early 1990s, have impacted child health broadly. This article is part of a Pediatrics supplement focused on predicting the future pediatric subspecialty workforce supply by drawing on the American Board of Pediatrics workforce data and a microsimulation model of the future pediatric subspecialty workforce. The article discusses the utilization of acute care services in EDs, reviews the current state of the PEM subspecialty workforce, and presents projected numbers of PEM subspecialists at the national, census region, and census division on the basis of this pediatric subspecialty workforce supply model through 2040. Implications of this model on education and training, clinical practice, policy, and future workforce research are discussed. Findings suggest that, if the current growth in the field of PEM continues on the basis of the increasing number and size of fellowship programs, even with a potential reduction in percentage of clinical time and attrition of senior physicians, the PEM workforce is anticipated to increase nationally. However, the maldistribution of PEM physicians is likely to be perpetuated with the highest concentration in New England and Mid-Atlantic regions and "PEM deserts" in less populated areas.

Child Health Needs and the Pediatric Hospital Medicine Workforce: 2020-2040.

Pediatric hospital medicine (PHM) established a new model of care for hospitalized children in the United States nearly 3 decades ago. In that time, the field experienced rapid growth while distinguishing itself through contributions to medical education, quality improvement, clinical and health services research, patient safety, and health system leadership. Hospital systems have also invested in using in-house pediatricians to manage various inpatient care settings as patient acuity has accelerated. National PHM leaders advocated for board certification in 2014, and the first certification examination was administered by the American Board of Pediatrics in 2019. In this article, we describe the development of the subspecialty, including evolving definitions and responsibilities of pediatric hospitalists. Although PHM was not included in the model forecasting future pediatric subspecialties through 2040 in this supplement because of limited historical data, in this article, we consider the current and future states of the workforce in relation to children's health needs. Expected challenges include potential alterations to residency curriculum, changes in the number of fellowship positions, expanding professional roles, concerns related to job sustainability and burnout, and closures of pediatric inpatient units in community hospitals. We simultaneously forecast growing demand in the PHM workforce arising from the increasing prevalence of children with medical complexity and increasing comanagement of hospitalized children between pediatric hospitalists and other subspecialists. As such, our forecast incorporates a degree of uncertainty and points to the need for ongoing investments in future research to monitor and evaluate the size, scope, and needs of pediatric hospitalists and the PHM workforce.

Child Health Needs and the Pediatric Cardiology Workforce: 2020-2040.

This article evaluates the pediatric cardiology (PC) workforce and forecasts its future supply. Produced as part of a supplement in Pediatrics, this effort represents a collaboration among the American Board of Pediatrics Foundation, the University of North Carolina at Chapel Hill's Carolina Health Workforce Research Center, the Strategic Modeling and Analysis Ltd., and members of the pediatric subspecialty community. PC is a complex subspecialty including care from fetal life through adulthood and in practice settings that range from the outpatient clinic to procedural settings to the cardiac ICU. Complex subdisciplines include imaging, electrophysiology, heart failure, and interventional and critical care. Using American Board of Pediatrics data, US Census Bureau data, and data from the modeling project, projections were created to model the subspecialty workforce through 2040. Across all modeling scenarios considered, there is considerable projected growth in the supply of pediatric cardiologists by 2040. However, there is significant regional variation in the projected supply of trainees relative to demand in terms of local population growth, with evidence of a likely mismatch between areas surrounding training centers versus areas of greatest workforce need. In addition, this article highlights areas for future focus, including efforts to attract more residents to the subspecialty in general, particularly underrepresented minority members; increased support, more part-time career options, and improved academic career advancement for women in PC; and the development of better "real-time" workforce data to guide trainees and training programs in decisions regarding sub-subspecialty job availability.

Projecting the Future Pediatric Subspecialty Workforce: Summary and Recommendations.

This article summarizes the findings of a Pediatrics supplement addressing the United States workforce for 15 pediatric subspecialties. It includes results from a microsimulation model projecting supply through 2040; growth is forecasted to be uneven across the subspecialties with worsening geographic maldistribution. Although each subspecialty has unique characteristics, commonalities include (1) the changing demographics and healthcare needs of children, including mental health; (2) poor outcomes for children experiencing adverse social drivers of health, including racism; and (3) dependence on other subspecialties. Common healthcare delivery challenges include (1) physician shortages for some subspecialties; (2) misalignment between locations of training programs and subspecialists and areas of projected child population growth; (3) tension between increasing subsubspecialization to address rare diseases and general subspecialty care; (4) the need to expand clinical reach through collaboration with other physicians and advanced practice providers; (5) the lack of parity between Medicare, which funds much of adult care, and Medicaid, which funds over half of pediatric subspecialty care; and (6) low compensation of pediatric subspecialists compared with adult subspecialists. Overall, subspecialists identified the lack of a central authority to monitor and inform child healthcare provided by pediatric subspecialists as a challenge. Future research on the pediatric subspecialty workforce and the children it serves will be necessary to ensure these children's needs are met. Together, these articles provide overarching and subspecialty-specific recommendations to improve training, recruitment, and retention of a diverse workforce, implement innovative models of care, drive policy changes, and advise future research.

Exploring Factors for Implementation of EPAs in Pediatric Subspecialty Fellowships: A Qualitative Study of Program Directors.

OBJECTIVE: To understand fellowship program directors' (FPDs) perspectives on facilitators and barriers to using entrustable professional activities (EPAs) in pediatric subspecialty training. METHODS: We performed a qualitative study of FPDs, balancing subspecialty, program size, geographic region and current uses of EPAs. A study coordinator conducted 1-on-1 interviews using a semistructured approach to explore EPA use or nonuse and factors supporting or preventing their use. Investigators independently coded transcribed interviews using an inductive approach and the constant comparative method. Group discussion informed code structure development and refinement. Iterative data collection and analysis continued until theoretical sufficiency was achieved, yielding a thematic analysis. RESULTS: Twenty-eight FPDs representing 11 pediatric subspecialties were interviewed, of whom 16 (57%) reported current EPA use. Five major themes emerged: (1) facilitators including the intuitive nature and simple wording of EPAs; (2) barriers such as workload burden and lack of a regulatory requirement; (2) variable knowledge and training surrounding EPAs, leading to differing levels of understanding; (3) limited current use of EPAs, even among self-reported users; and (4) complementary nature of EPAs and milestones. FPDs acknowledged the differing strengths of both EPAs and milestones but sought additional knowledge about the value added by EPAs for assessing trainees, including the impact on outcomes. CONCLUSIONS: Identified themes can inform effective and meaningful EPA implementation strategies: Supporting and educating FPDs, ongoing assessment of the value of EPAs in training, and practical integration with current workflow. Generating additional data and engaging stakeholders is critical for successful implementation for the pediatric subspecialties.

Minimum Supervision Levels Required for Pediatric Cardiology Fellowship Graduation by Pediatric Cardiology Fellowship Program Directors.

Entrustable professional activities (EPAs) are "observable essential tasks expected to be performed by a physician for safe patient care in practice." Six Pediatric Cardiology (PC) EPAs and their level of supervision (LOS) scales were developed by medical educators in PC using a modified Delphi process and reviewed by the Subspecialty Pediatrics Investigator Network (SPIN). However, their general use in assessment for PC fellows for graduation requirements has yet to be studied. The objective of this study was to determine the minimum LOS required for PC fellows to graduate and compare it with the minimum LOS expected for safe and effective practice for the six PC EPAs, from the perspective of the PC Fellowship Program Directors(FPD). All Fellowship Program Directors(FPD) of ACGME-accredited PC fellowships were surveyed through SPIN between April 2017 and August 2017. For each of the PC EPAs, the FPDs were asked to indicate the minimum LOS expected for graduation and whether they would allow a fellow to graduate if this level was not achieved and the minimum LOS expected for a practicing pediatric cardiologist to provide safe and effective patient care. The minimum LOS was defined as the LOS for which no more than 20% of FPDs would want a lower level. The survey response rate was 80% (47/59). The majority of the FPDs did not require a minimum LOS of five corresponding to unsupervised practice in any of the six PC EPAs at graduation. For EPAs related to imaging, arrhythmia management, and management of cardiac problems, the minimum LOS for graduation was 3, corresponding to being "trusted to perform a task with indirect supervision for most simple and a few complex cases." For the EPAs related to interventional cardiology, heart failure pulmonary hypertension, and cardiac intensive care, the minimum LOS for graduation was 2, corresponding to being "trusted to perform a task only with direct supervision and coaching." The minimum LOS considered necessary for safe and effective practice for all but one EPA was 3. For the EPA related to the management of cardiac problems, the minimum LOS for safe practice was 4, corresponding to being "trusted to execute tasks independently except for few complex and critical cases." Most PC FPDs reported they would not require fellows to achieve the highest entrustment level for any of the six PC EPAs for graduation. It is crucial that educational programs evolve to address these essential activities during training better and that stakeholders ensure that graduating PC fellows have adequate resources and infrastructure to continue professional development as early career pediatric cardiologists.

Relationship between epa level of supervision with their associated subcompetency milestone levels in pediatric fellow assessment.

BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment. OBJECTIVES: We hypothesized that 1) there would be a strong correlation between EPA LOS ratings with the milestone levels for the subcompetencies mapped to the EPA; 2) some subcompetencies would be more critical in determining entrustment decisions than others, and 3) the correlation would be weaker if the analysis included only milestones reported to the Accreditation Council for Graduate Medical Education (ACGME). METHODS: In fall 2014 and spring 2015, the Subspecialty Pediatrics Investigator Network asked Clinical Competency Committees to assign milestone levels to each trainee enrolled in a pediatric fellowship for all subcompetencies mapped to 6 Common Pediatric Subspecialty EPAs as well as provide a rating for each EPA based upon a 5-point LOS scale. RESULTS: One-thousand forty fellows were assessed in fall and 1048 in spring, representing about 27% of all fellows. For each EPA and in both periods, the average milestone level was highly correlated with LOS (rho range 0.59-0.74; p < 0.001). Correlations were similar when using a weighted versus unweighted milestone score or using only the ACGME reported milestones (p > 0.05). CONCLUSIONS: We found a strong relationship between milestone level and EPA LOS rating but no difference if the subcompetencies were weighted, or if only milestones reported to the ACGME were used. Our results suggest that representative behaviors needed to effectively perform the EPA, such as key subcompetencies and milestones, allow for future language adaptations while still supporting the current model of assessment. In addition, these data provide additional validity evidence for using these complementary tools in building a program of assessment.

Development of an Approach to Assessing Pediatric Fellows' Transport Medical Control Skills.

BACKGROUND AND OBJECTIVE: Pediatric interfacility transport teams facilitate access to subspecialty care, and physicians often guide management remotely as transport medical control (TMC). Pediatric subspecialty fellows frequently perform TMC duties, but tools assessing competency are lacking. Our objective was to develop content validity for the items required to assess pediatric subspecialty fellows' TMC skills. METHODS: We conducted a modified Delphi process among transport and fellow education experts in pediatric critical care medicine, pediatric emergency medicine, neonatal-perinatal medicine, and pediatric hospital medicine. The study team generated an initial list of items on the basis of a literature review and personal experience. A modified Delphi panel of transport experts was recruited to participate in 3 rounds of anonymous, online voting on the importance of the items using a 3-point Likert scale (marginal, important, essential). We defined consensus for inclusion as ≥80% agreement that an item was important/essential and consensus for exclusion as ≥80% agreement that an item was marginal. RESULTS: The study team of 20 faculty drafted an initial list of items. Ten additional experts in each subspecialty served on the modified Delphi panel. Thirty-six items met the criteria for inclusion, with widespread agreement across subspecialties. Only 1 item, "discussed bed availability," met the criteria for inclusion among some subspecialties but not others. The study team consolidated the final list into 26 items for ease of use. CONCLUSIONS: Through a consensus-based process among transport experts, we generated content validity for the items required to assess pediatric subspecialty fellows' TMC skills.

The APPD Longitudinal Educational Assessment Research Network's First Decade.

ABSTRACT: In 2009, the Association of Pediatric Program Directors (APPD) Longitudinal Educational Assessment Research Network (LEARN), a national educational research network, was formed. We report on evaluation of the network after 10 years of operation by reviewing program context, input, processes, and products to measure its progress in performing educational research that advances training of future pediatricians. Historical changes in medical education shaped the initial development of the network. APPD LEARN now includes 74% (148 of 201) of US Pediatric residency programs and has recently incorporated a network of Pediatric subspecialty fellowship programs. At the time of this evaluation, APPD LEARN had approved 19 member-initiated studies and 14 interorganizational studies, resulting in 23 peer-reviewed publications, numerous presentations, and 7 archived sharable data sets. Most publications focused on how and when interventions work rather than whether they work, had high scores for reporting rigor, and included organizational and objective performance outcomes. Member program representatives had positive perceptions of APPD LEARN's success, with most highly valuing participation in research that impacts training, access to expertise, and the ability to make authorship contributions for presentations and publication. Areas for development and improvement identified in the evaluation include adopting a formal research prioritization process, infrastructure changes to support educational research that includes patient data, and expanding educational outreach within and outside the network. APPD LEARN and similar networks contribute to high-rigor research in pediatric education that can lead to improvements in training and thereby the health care of children.

Are Final Residency Milestones Correlated With Early Fellowship Performance in Pediatrics?

PURPOSE: Milestones have been used to assess trainees across graduate medical education programs and reflect a developmental continuum from novice to expert. This study examined whether residency milestones are correlated with initial fellowship milestone performance in pediatrics. METHOD: This retrospective cohort study used descriptive statistics to assess milestone scores from pediatric fellows who began fellowship training between July 2017 and July 2020. Milestone scores were obtained at the end of residency (R), middle of the first fellowship year (F1), and end of the first fellowship year (F2). RESULTS: Data represent 3,592 unique trainees. High composite R scores, much lower F1 scores, and slightly higher F2 scores were found over time for all pediatric subspecialities. R scores were positively correlated with F1 scores (Spearman ρ = 0.12, P < .001) and F2 scores (Spearman ρ = 0.15, P < .001). Although scores are negligibly different when trainees graduate from residency, there were differences in F1 and F2 scores among fellows in different specialties. Those who trained at the same institution for residency and fellowship had higher composite milestone F1 and F2 scores compared with those who trained at different institutions ( P < .001). The strongest associations were between R and F2 scores for the professionalism and communication milestones, although associations were still relatively weak overall (r s = 0.13-0.20). CONCLUSIONS: This study found high R scores and low F1 and F2 scores across all shared milestones, with weak association of scores within competencies, indicating that milestones are context dependent. Although professionalism and communication milestones had a higher correlation compared with the other competencies, the association was still weak. Residency milestones may be useful for individualized education in early fellowship, but fellowship programs should be cautious about overreliance on R scores due to the weak correlation with F1 and F2 scores.

Clinical competency committee perceptions of entrustable professional activities and their value in assessing fellows: A qualitative study of pediatric subspecialty program directors.

OBJECTIVES: To examine the composition and processes of Clinical Competency Committees (CCCs) assigning entrustable professional activity (EPA) levels of supervision for pediatric subspecialty fellows and to examine fellowship program director (FPD) perspectives about using EPAs to determine fellows' graduation readiness. METHODS: A qualitative study was performed using one-on-one interviews with a purposeful sample of pediatric subspecialty FPDs to yield a thematic analysis. Semi-structured interview guides were used for participants who self-identified as EPA users or non-users. Inductive analysis and coding were performed on transcripts until theoretical sufficiency was attained. RESULTS: Twenty-eight FPDs were interviewed. There was significant variability in the composition and processes of CCCs across subspecialties. FPDs felt that CCCs intuitively understand what entrustment means, allowing for ease of application of level of supervision (LOS) scales and consensus. FPDs perceived that EPAs provided a global assessment of fellows and are one tool to determine graduation readiness. CONCLUSIONS: Although there was variability in the makeup and processes of CCCs across subspecialties, FPDs believe EPAs are intuitive and relatively easy to implement. Consensus can be reached easily using EPA-specific LOS scales focusing on entrustment. FPDs desire a better understanding of how EPAs should be used for graduation.

Pediatric Emergency Medicine Fellowship Program Directors' Viewpoint: Minimum Levels of Entrustment for Graduating Fellows and Practicing Physicians to Perform the Subspecialty's Professional Activities.

OBJECTIVES: Entrustable Professional Activities (EPAs) are essential tasks physicians perform within their professions. Entrustment levels that pediatric emergency medicine (PEM) fellowship program directors (FPDs) expect graduating fellows to achieve for PEM-specific and common pediatric subspecialty EPAs remain unreported. This study aims to determine minimum entrustment levels FPDs require fellows to achieve to graduate from fellowship and to compare FPD expectations for fellows versus practicing PEM physicians. METHODS: Secondary analysis of PEM-specific data from a national multispecialty cross-sectional survey of pediatric subspecialty FPDs. For 6 PEM-specific and 7 common pediatric subspecialty EPAs, PEM FPDs indicated (1) minimum entrustment levels fellows should achieve by training completion, (2) whether they would allow a fellow to graduate below these minimum levels, and (3) minimum levels for safe and effective practice by PEM physicians. Minimum levels were defined as the level that more than 80% of FPDs would not drop below. RESULTS: Sixty of 77 PEM FPDs (78%) completed the survey. Most respondents did not require fellows to achieve the highest level (level 5-no supervision) by graduation for any PEM-specific EPAs. The median level FPDs expected for practicing PEM physicians was 5 (trusted to perform without supervision) for EPAs 1 and 4 and level 4 (indirect supervision for complex cases) for the remaining PEM-specific EPAs. Minimum levels expected by FPDs for common subspecialty pediatric EPAs were lower for both groups. CONCLUSIONS: Most PEM FPDs indicated that they would graduate fellows before their achievement of the highest entrustment level for all EPAs. Most also indicated that they do not expect practicing PEM physicians to perform all EPAs without supervision. These findings indicate need for stakeholders to evaluate current structure and outcomes of PEM fellowship programs and for institutions and organizations to ensure adequate support in time and resources for ongoing learning for practicing PEM physicians.

Measuring the Resting Energy Expenditure in Children on Extracorporeal Membrane Oxygenation: A Prospective Pilot Study.

Both overfeeding and underfeeding critically ill children are problematic. This prospective pilot study evaluated the resting energy expenditure in infants and children requiring extracorporeal membrane oxygenation (ECMO) support. An indirect calorimeter was used to measure oxygen consumption (VO 2 ) and carbon dioxide production (VCO 2 ) from the mechanical ventilator. Blood gases were used to determine VO 2 and VCO 2 from the ECMO circuit. Values from the mechanical ventilator and ECMO circuit were added, and the resting energy expenditure (REE) (Kcal/kg/day) was calculated. Measurements were obtained > 24 hours after ECMO support was initiated (day 2 of ECMO), 1 day before ECMO discontinuation or transfer, and 1 day after decannulation. Data were compared with the predicted energy expenditure. Seven patients aged 3 months to 13 years were included. The REE varied greatly both above and below predicted values, from 26 to 154 KCal/kg/day on day 2 of ECMO support. In patients with septic shock, the REE was > 300% above the predicted value on day 2 of ECMO. Before ECMO discontinuation, two of six (33%) children continued to have a REE > 110% of predicted. Three patients had measurements after decannulation, all with a REE < 90% of predicted. REE measurements can be obtained by indirect calorimetry in children receiving ECMO support. ECMO may not provide metabolic rest for all children as a wide variation in REE was observed. For optimal care, individual testing should be considered to match calories provided with the metabolic demand.

Benefits and Limitations of Virtual Recruitment: Perspectives From Subspeciality Directors.

BACKGROUND AND OBJECTIVES: Because of the coronavirus disease 2019 pandemic and recommendations from a range of leaders and organizations, the pediatrics subspecialty 2020 recruitment season was entirely virtual. Minimal data exist on the effect of this change to guide future strategies. The aim of this study was to understand the effects of virtual recruitment on pediatric subspecialty programs as perceived by program leaders. METHODS: This concurrent, triangulation, mixed-methods study used a survey that was developed through an iterative (3 cycles), consensus-building, modified Delphi process and sent to all pediatric subspecialty program directors (PSPDs) between April and May 2021. Descriptive statistics and thematic analysis were used, and a conceptual framework was developed. RESULTS: Forty-two percent (352 of 840) of PSPDs responded from 16 of the 17 pediatric (94%) subspecialties; 60% felt the virtual interview process was beneficial to their training program. A majority of respondents (72%) reported cost savings were a benefit; additional benefits included greater efficiency of time, more applicants per day, greater faculty involvement, and perceived less time away from residency for applicants. PSPDs reported a more diverse applicant pool. Without an in-person component, PSPDs worried about programs and applicants missing informative, in-person interactions and applicants missing hospital tours and visiting the city. A model based upon theory of change was developed to aid program considerations for future application cycles. CONCLUSIONS: PSPDs identified several benefits to virtual recruitment, including ease of accommodating increased applicants with a diverse applicant pool and enhanced faculty involvement. Identified limitations included reduced interaction between the applicant and the larger institution/city.

Best Practices in Medical Documentation: A Curricular Module.

OBJECTIVE: To create and validate a checklist for high-quality documentation and pilot a multi-modal, immersive educational module across multiple institutions. We hypothesized that this module would improve knowledge, skills, and attitudes in medical documentation. METHODS: Module design was grounded in an established curriculum design framework. We conducted the study across 12 pediatric critical care fellowship programs between September 2017 and January 2018. Workshops were allotted 90 minutes for completion. We utilized a pre-/post- study design to determine the workshop's impact. Changes in knowledge were assessed through pre and post testing. Changes in skills were evaluated with a validated checklist for inclusion of key documentation elements. Changes in attitudes were determined through learner self-assessment RESULTS: 83 of 138 eligible fellows (60%) started the module and 62 of 83 (75%) completed data sets for analysis. Immediate post-testing demonstrated modest statistically significant improvement in knowledge, skills, and attitudes. The workshop was easily disseminated and deployed CONCLUSIONS: This study demonstrates that a multi-modal educational intervention can lead to improvement in medical documentation knowledge, skills, and attitudes in a cohort of PCCM fellows and be easily disseminated for use by other specialties and types of clinicians.