Relationship between epa level of supervision with their associated subcompetency milestone levels in pediatric fellow assessment.

BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment. OBJECTIVES: We hypothesized that 1) there would be a strong correlation between EPA LOS ratings with the milestone levels for the subcompetencies mapped to the EPA; 2) some subcompetencies would be more critical in determining entrustment decisions than others, and 3) the correlation would be weaker if the analysis included only milestones reported to the Accreditation Council for Graduate Medical Education (ACGME). METHODS: In fall 2014 and spring 2015, the Subspecialty Pediatrics Investigator Network asked Clinical Competency Committees to assign milestone levels to each trainee enrolled in a pediatric fellowship for all subcompetencies mapped to 6 Common Pediatric Subspecialty EPAs as well as provide a rating for each EPA based upon a 5-point LOS scale. RESULTS: One-thousand forty fellows were assessed in fall and 1048 in spring, representing about 27% of all fellows. For each EPA and in both periods, the average milestone level was highly correlated with LOS (rho range 0.59-0.74; p < 0.001). Correlations were similar when using a weighted versus unweighted milestone score or using only the ACGME reported milestones (p > 0.05). CONCLUSIONS: We found a strong relationship between milestone level and EPA LOS rating but no difference if the subcompetencies were weighted, or if only milestones reported to the ACGME were used. Our results suggest that representative behaviors needed to effectively perform the EPA, such as key subcompetencies and milestones, allow for future language adaptations while still supporting the current model of assessment. In addition, these data provide additional validity evidence for using these complementary tools in building a program of assessment.

Burnout in Pediatric Critical Care Medicine Fellows.

OBJECTIVES: Assess the overall level of burnout in pediatric critical care medicine fellows and examine factors that may contribute to or protect against its development. DESIGN: Cross-sectional observational study. SETTING: Accreditation Council for Graduate Medical Education-accredited pediatric critical care medicine fellowship programs across the United States. SUBJECTS: Pediatric critical care medicine fellows and program directors. INTERVENTIONS: Web-based survey that assessed burnout via the Maslach Burnout Inventory, as well as other measures that elicited demographics, sleepiness, social support, perceptions about prior training, relationships with colleagues, and environmental burnout. MEASUREMENTS AND MAIN RESULTS: One-hundred eighty-seven fellows and 47 program directors participated. Fellows from 30% of programs were excluded due to lack of program director participation. Average values on each burnout domain for fellows were higher than published values for other medical professionals. Personal accomplishment was greater (lower burnout) among fellows more satisfied with their career choice (ß 9.319; p ≤ 0.0001), spiritual fellows (ß 1.651; p = 0.0286), those with a stress outlet (ß 3.981; p = 0.0226), those comfortable discussing educational topics with faculty (ß 3.078; p = 0.0197), and those comfortable seeking support from their co-fellows (ß 3.762; p = 0.0006). Depersonalization was higher for second year fellows (ß 2.034; p = 0.0482), those with less educational debt (ß -2.920; p = 0.0115), those neutral/dissatisfied with their career choice (ß -6.995; p = 0.0031), those with nursing conflict (ß -3.527; p = 0.0067), those who perceived burnout among co-fellows (ß 1.803; p = 0.0352), and those from ICUs with an increased number of patient beds (ß 5.729; p ≤ 0.0001). Emotional exhaustion was higher among women (ß 2.933; p = 0.0237), those neutral/dissatisfied with their career choice (ß -7.986; p = 0.0353), and those who perceived burnout among co-fellows (ß 5.698; p ≤ 0.0001). Greater sleepiness correlated with higher burnout by means of lower personal accomplishment (r = -1.64; p = 0.0255) and higher emotional exhaustion (r = 0.246; p = 0.0007). Except for tangible support, all other forms of social support showed a small to moderate correlation with lower burnout. CONCLUSIONS: Pediatric critical care medicine fellows in the United States are experiencing high levels of burnout, which appears to be influenced by demographics, fellow perceptions of their work environment, and satisfaction with career choice. The exclusion of fellows at 30% of the programs may have over or underestimated the actual level of burnout in these trainees.

Timely Hemodynamic Resuscitation and Outcomes in Severe Pediatric Traumatic Brain Injury: Preliminary Findings.

OBJECTIVES: Early resuscitation may improve outcomes in pediatric traumatic brain injury (TBI). We examined the association between timely treatment of hypotension and hypoxia during early care (prehospital or emergency department locations) and discharge outcomes in children with severe TBI. METHODS: Hypotension was defined as systolic blood pressure less than 70 + 2 (age in years), and hypoxia was defined as PaO2 less than 60 mm Hg or oxygen saturation less than 90% in accordance with the 2003 Brain Trauma Foundation guidelines. Timely treatment of hypotension and hypoxia during early care was defined as the treatment within 30 minutes of a documented respective episode. Two hundred thirty-six medical records of children younger than 18 years with severe TBI from 5 regional pediatric trauma centers were examined. Main outcomes were in-hospital mortality and discharge Glasgow Outcome Scale (GOS) score. RESULTS: Hypotension occurred in 26% (60/234) during early care and was associated with in-hospital mortality (23.3% vs 8.6%; P = 0.01). Timely treatment of hypotension during early care occurred in 92% (55/60) by use of intravenous fluids, blood products, or vasopressors and was associated with reduced in-hospital mortality [adjusted relative risk (aRR), 0.46; 95% confidence interval, 0.24-0.90] and less likelihood of poor discharge GOS (aRR, 0.54; 95% confidence interval, 0.39-0.76) when compared to children with hypotension who were not treated in a timely manner. Early hypoxia occurred in 17% (41/236) and all patients received timely oxygen treatment. CONCLUSIONS: Timely resuscitation during early care was common and associated with lower in-hospital mortality and favorable discharge GOS in severe pediatric TBI.

Frequency of and factors associated with emergency department intracranial pressure monitor placement in severe paediatric traumatic brain injury.

OBJECTIVE: To examine the frequency of and factors associated with emergency department (ED) intracranial pressure (ICP) monitor placement in severe paediatric traumatic brain injury (TBI). METHODS: Retrospective, multicentre cohort study of children <18 years admitted to the ED with severe TBI and intubated for >48 hours from 2007 to 2011. RESULTS: Two hundred and twenty-four children had severe TBI and 75% underwent either ED, operating room (OR) or paediatric intensive care unit (PICU) ICP monitor placement. Four out of five centres placed ICP monitors in the ED, mostly (83%) fibreoptic. Nearly 40% of the patients who received ICP monitors get it placed in the ED (29% overall). Factors associated with ED ICP monitor placement were as follows: age 13 to <18 year olds compared to infants (aRR 2.02; 95% CI 1.37, 2.98), longer ED length of stay (LOS) (aRR 1.15; 95% CI 1.08, 1.21), trauma centre designation paediatric only I/II compared to adult/paediatric I/II (aRR 1.71; 95% CI 1.48, 1.98) and higher mean paediatric TBI patient volume (aRR 1.88;95% CI 1.68, 2.11). Adjusted for centre, higher bedside ED staff was associated with longer ED LOS (aRR 2.10; 95% CI 1.06, 4.14). CONCLUSION: ICP monitors are frequently placed in the ED at paediatric trauma centres caring for children with severe TBI. Both patient and organizational level factors are associated with ED ICP monitor placement.

Guideline Adherence and Hospital Costs in Pediatric Severe Traumatic Brain Injury.

OBJECTIVES: Adherence to pediatric traumatic brain injury guidelines has been associated with improved survival and better functional outcome. However, the relationship between guideline adherence and hospitalization costs has not been examined. To evaluate the relationship between adherence to pediatric severe traumatic brain injury guidelines, measured by acute care clinical indicators, and the total costs of hospitalization associated with severe traumatic brain injury. DESIGN: Retrospective cohort study. SETTING: Five regional pediatric trauma centers affiliated with academic medical centers. PATIENTS: Demographic, injury, treatment, and charge data were included for pediatric patients (17 yr) with severe traumatic brain injury. INTERVENTIONS: Percent adherence to clinical indicators was determined for each patient. Cost-to-charge ratios were used to estimate ICU and total hospital costs for each patient. Generalized linear models evaluated the association between healthcare costs and adherence rate. MEASUREMENTS AND MAIN RESULTS: Cost data for 235 patients were examined. Estimated mean adjusted hospital costs were $103,485 (95% CI, 98,553-108,416); adjusted ICU costs were $82,071 (95% CI, 78,559-85,582). No association was found between adherence to guidelines and total hospital or ICU costs, after adjusting for patient and injury characteristics. Adjusted regression model results provided cost ratio equal to 1.01 for hospital and ICU costs (95% CI, 0.99-1.03 and 0.99-1.02, respectively). CONCLUSIONS: Adherence to severe pediatric traumatic brain injury guidelines at these five leading pediatric trauma centers was not associated with increased hospitalization and ICU costs. Therefore, cost should not be a factor as institutions and providers strive to provide evidence-based guideline driven care of children with severe traumatic brain injury.

Practice Patterns in Pediatric Critical Care Medicine: Results of a Workforce Survey.

OBJECTIVE: To obtain current data on practice patterns of the U.S. pediatric critical care medicine workforce. DATA SOURCES: Membership of the American Academy of Pediatrics Section on Critical Care and individuals certified by the American Board of Pediatrics in pediatric critical care medicine. STUDY SELECTION: All active members of the American Academy of Pediatrics Section on Critical Care, and nonduplicative individuals certified by the American Board of Pediatrics in pediatric critical care medicine, were classified as eligible to participate in this electronically administered workforce survey. DATA EXTRACTION: Data were extracted by a doctorate-level research professional. Extracted data included demographic information, work environment, number of hours worked, training, clinical responsibilities, work satisfaction and burnout, and plans to leave the practice of pediatric critical care medicine. DATA SYNTHESIS: Of 1,857 individuals contacted, 923 completed the survey (49.7%). The majority of respondents were white, male, non-Hispanic, university-employed, and taught residents. Respondents who worked full time were on clinical intensive care service for a median of 15 wk/yr and responsible for a median of 13 ICU beds, working a median of 60 hr/wk. Total night call responsibility was a median of 60 nights/yr; about half of respondents indicated night call was in-hospital. Fewer than half were engaged in basic science or clinical research. Compared with earlier data, there was minimal change in work hours and proportion of time devoted to research, but there was an increase in the proportion of female pediatric critical care medicine physicians. CONCLUSIONS: These data provide a description of the typical intensivist and a snapshot of the current pediatric critical care medicine workforce, which may be experiencing a mild-to-moderate undersupply. The results are useful for assessing the current workforce and valuable for future planning.

Acute care clinical indicators associated with discharge outcomes in children with severe traumatic brain injury.

OBJECTIVE: The effect of the 2003 severe pediatric traumatic brain injury (TBI) guidelines on outcomes has not been examined. We aimed to develop a set of acute care guideline-influenced clinical indicators of adherence and tested the relationship between these indicators during the first 72 hours after hospital admission and discharge outcomes. DESIGN: Retrospective multicenter cohort study. SETTING: Five regional pediatric trauma centers affiliated with academic medical centers. PATIENTS: Children under 18 years with severe traumatic brain injury (admission Glasgow Coma Scale score ≤ 8, International Classification of Diseases, 9th Edition, diagnosis codes of 800.0-801.9, 803.0-804.9, 850.0-854.1, 959.01, 950.1-950.3, 995.55, maximum head abbreviated Injury Severity Score ≥ 3) who received tracheal intubation for at least 48 hours in the ICU between 2007 and 2011 were examined. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Total percent adherence to the clinical indicators across all treatment locations (prehospital, emergency department, operating room, and ICU) during the first 72 hours after admission to study center were determined. Main outcomes were discharge survival and Glasgow Outcome Scale score. Total adherence rate across all locations and all centers ranged from 68% to 78%. Clinical indicators of adherence were associated with survival (adjusted hazard ratios, 0.94; 95% CI, 0.91-0.96). Three indicators were associated with survival: absence of prehospital hypoxia (adjusted hazard ratios, 0.20; 95% CI, 0.08-0.46), early ICU start of nutrition (adjusted hazard ratios, 0.06; 95% CI, 0.01-0.26), and ICU PaCO2 more than 30 mm Hg in the absence of radiographic or clinical signs of cerebral herniation (adjusted hazard ratios, 0.22; 95% CI, 0.06-0.8). Clinical indicators of adherence were associated with favorable Glasgow Outcome Scale among survivors (adjusted hazard ratios, 0.99; 95% CI, 0.98-0.99). Three indicators were associated with favorable discharge Glasgow Outcome Scale: all operating room cerebral perfusion pressure more than 40 mm Hg (adjusted relative risk, 0.61; 95% CI, 0.58-0.64), all ICU cerebral perfusion pressure more than 40 mm Hg (adjusted relative risk, 0.73; 95% CI, 0.63-0.84), and no surgery (any type; adjusted relative risk, 0.68; 95% CI, 0.53- 0.86). CONCLUSIONS: Acute care clinical indicators of adherence to the Pediatric Guidelines were associated with significantly higher discharge survival and improved discharge Glasgow Outcome Scale. Some indicators were protective, regardless of treatment location, suggesting the need for an interdisciplinary approach to the care of children with severe traumatic brain injury.

Development of learning objectives and a validated testing tool for management of pediatric mechanical ventilation*.

OBJECTIVES: Graduate medical education is shifting toward an outcome-based paradigm, where physicians are evaluated for competency using well-defined criteria. Our aim was to learning objectives and a testing tool to assess competency in the management of mechanical ventilation for infants, children, and adolescents and to verify that the test was reliable and valid. DESIGN: Prospective reliability and validity study. SETTING: Large, university-affiliated academic hospital. SUBJECTS: Sixty-one total subjects from five different academic centers divided into three groups of varying experience. The groups were second- and third-year pediatric residents (Novice), second- and third-year pediatric critical care fellows (Advanced), and pediatric critical care faculty (Expert). INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Ten learning objectives considered important for the management of pediatric mechanical ventilation were developed from expert opinion and current evidence. Based on these objectives, a 35-question multiple choice, knowledge- and case-based test was created. Content validity was achieved by consensus of three experts in pediatric critical care medicine evaluating whether the questions reflected the learning objectives and the responses were consistent with current practice and evidence-based medicine. The test was then administered to the three groups to establish construct validity. The "Novice" group scored a mean of 34.6% (95% CI, 28-41%), the "Advanced" group a mean of 59.4% (95% CI, 53-65%), and the "Expert" group a mean of 74.8% (95% CI, 69-80%), with p less than 0.01 for all comparisons. As determined by Hoyt's analysis, the reliability coefficient was 0.89, reflecting excellent reliability. CONCLUSIONS: This is the first description of specific learning objectives for management of pediatric mechanical ventilation and the first validated and reliable testing tool for assessing knowledge. This tool could be used by fellowship programs to assess fellow competency and identify knowledge gaps in this area prior to completion of training. Further work must be done to determine the criteria for determination of competency.

Child Health Needs and the Pediatric Emergency Medicine Workforce: 2020-2040.

Approximately 30 million ill and injured children annually visit emergency departments (EDs) in the United States. Data suggest that patients seen in pediatric EDs by board-certified pediatric emergency medicine (PEM) physicians receive higher-quality care than those cared for by non-PEM physicians. These benefits, coupled with the continued growth in PEM since its inception in the early 1990s, have impacted child health broadly. This article is part of a Pediatrics supplement focused on predicting the future pediatric subspecialty workforce supply by drawing on the American Board of Pediatrics workforce data and a microsimulation model of the future pediatric subspecialty workforce. The article discusses the utilization of acute care services in EDs, reviews the current state of the PEM subspecialty workforce, and presents projected numbers of PEM subspecialists at the national, census region, and census division on the basis of this pediatric subspecialty workforce supply model through 2040. Implications of this model on education and training, clinical practice, policy, and future workforce research are discussed. Findings suggest that, if the current growth in the field of PEM continues on the basis of the increasing number and size of fellowship programs, even with a potential reduction in percentage of clinical time and attrition of senior physicians, the PEM workforce is anticipated to increase nationally. However, the maldistribution of PEM physicians is likely to be perpetuated with the highest concentration in New England and Mid-Atlantic regions and "PEM deserts" in less populated areas.

Child Health Needs and the Pediatric Cardiology Workforce: 2020-2040.

This article evaluates the pediatric cardiology (PC) workforce and forecasts its future supply. Produced as part of a supplement in Pediatrics, this effort represents a collaboration among the American Board of Pediatrics Foundation, the University of North Carolina at Chapel Hill's Carolina Health Workforce Research Center, the Strategic Modeling and Analysis Ltd., and members of the pediatric subspecialty community. PC is a complex subspecialty including care from fetal life through adulthood and in practice settings that range from the outpatient clinic to procedural settings to the cardiac ICU. Complex subdisciplines include imaging, electrophysiology, heart failure, and interventional and critical care. Using American Board of Pediatrics data, US Census Bureau data, and data from the modeling project, projections were created to model the subspecialty workforce through 2040. Across all modeling scenarios considered, there is considerable projected growth in the supply of pediatric cardiologists by 2040. However, there is significant regional variation in the projected supply of trainees relative to demand in terms of local population growth, with evidence of a likely mismatch between areas surrounding training centers versus areas of greatest workforce need. In addition, this article highlights areas for future focus, including efforts to attract more residents to the subspecialty in general, particularly underrepresented minority members; increased support, more part-time career options, and improved academic career advancement for women in PC; and the development of better "real-time" workforce data to guide trainees and training programs in decisions regarding sub-subspecialty job availability.

Child Health Needs and the Pediatric Critical Care Medicine Workforce: 2020-2040.

This article, focused on the current and future pediatric critical care medicine (PCCM) workforce, is part of a supplement in Pediatrics anticipating the future supply of the pediatric subspecialty workforce. It draws on information available in the literature, data from the American Board of Pediatrics, and findings from a model that estimates the future supply of pediatric subspecialists developed by the American Board of Pediatrics Foundation in collaboration with the Carolina Workforce Research Center at the University of North Carolina at Chapel Hill's Cecil G. Sheps Center for Health Services Research and Strategic Modeling and Analysis Ltd. A brief history of the field of PCCM is provided, followed by an in-depth examination of the current PCCM workforce and a subsequent evaluation of workforce forecasts from 2020 to 2040. Under baseline conditions, the PCCM workforce is expected to increase by 105% during the forecasted period, more than any other pediatric subspecialty. Forecasts are modeled under a variety of multifactorial conditions meant to simulate the effects of changes to the supply of PCCM subspecialists, with only modest changes observed. Future PCCM workforce demand is unclear, although some suggest an oversupply may exist and that market forces may correct this. The findings generate important questions regarding the future state of the PCCM workforce and should be used to guide trainees considering a PCCM career, subspecialty leaders responsible for hosting training programs, staffing ICUs, and governing bodies that oversee training program accreditation and subspecialist certification.

Projecting the Future Pediatric Subspecialty Workforce: Summary and Recommendations.

This article summarizes the findings of a Pediatrics supplement addressing the United States workforce for 15 pediatric subspecialties. It includes results from a microsimulation model projecting supply through 2040; growth is forecasted to be uneven across the subspecialties with worsening geographic maldistribution. Although each subspecialty has unique characteristics, commonalities include (1) the changing demographics and healthcare needs of children, including mental health; (2) poor outcomes for children experiencing adverse social drivers of health, including racism; and (3) dependence on other subspecialties. Common healthcare delivery challenges include (1) physician shortages for some subspecialties; (2) misalignment between locations of training programs and subspecialists and areas of projected child population growth; (3) tension between increasing subsubspecialization to address rare diseases and general subspecialty care; (4) the need to expand clinical reach through collaboration with other physicians and advanced practice providers; (5) the lack of parity between Medicare, which funds much of adult care, and Medicaid, which funds over half of pediatric subspecialty care; and (6) low compensation of pediatric subspecialists compared with adult subspecialists. Overall, subspecialists identified the lack of a central authority to monitor and inform child healthcare provided by pediatric subspecialists as a challenge. Future research on the pediatric subspecialty workforce and the children it serves will be necessary to ensure these children's needs are met. Together, these articles provide overarching and subspecialty-specific recommendations to improve training, recruitment, and retention of a diverse workforce, implement innovative models of care, drive policy changes, and advise future research.

Level of Supervision for the Entrustable Professional Activities Common to General Pediatrics and the Subspecialties Decreases from Residency to Fellowship.

OBJECTIVES: To compare level of supervision (LOS) ratings of graduating pediatric residents with their assessments as fellows for the five Entrustable Professional Activities (EPAs) common to general pediatrics and the subspecialties and to determine if the difference between ratings from residency to fellowship is less for the QI and Practice Management EPAs, since the skills needed to perform these may be less context-dependent. METHODS: We compared ratings of graduating residents with their assessments as fellows using LOS data from two sequential EPA studies. RESULTS: There were 65 ratings from 41 residents at the first fellow assessment. At graduation, most residents needed little to no supervision for all EPAs with 94% (61/65) of ratings level four or five. In contrast, only 5/65 (8%) of the first fellow assessments were level four or five. The ratings difference for the QI and Practice Management EPAs was similar to the others. CONCLUSIONS: LOS ratings for the EPAs common to generalists and subspecialists reset as residents become fellows. There was no evidence that the QI and Practice Management EPAs are less context-dependent. This study provides additional validity evidence for using these LOS scales to assess trainees in pediatric residency and fellowship.

Exploring Factors for Implementation of EPAs in Pediatric Subspecialty Fellowships: A Qualitative Study of Program Directors.

OBJECTIVE: To understand fellowship program directors' (FPDs) perspectives on facilitators and barriers to using entrustable professional activities (EPAs) in pediatric subspecialty training. METHODS: We performed a qualitative study of FPDs, balancing subspecialty, program size, geographic region and current uses of EPAs. A study coordinator conducted 1-on-1 interviews using a semistructured approach to explore EPA use or nonuse and factors supporting or preventing their use. Investigators independently coded transcribed interviews using an inductive approach and the constant comparative method. Group discussion informed code structure development and refinement. Iterative data collection and analysis continued until theoretical sufficiency was achieved, yielding a thematic analysis. RESULTS: Twenty-eight FPDs representing 11 pediatric subspecialties were interviewed, of whom 16 (57%) reported current EPA use. Five major themes emerged: (1) facilitators including the intuitive nature and simple wording of EPAs; (2) barriers such as workload burden and lack of a regulatory requirement; (2) variable knowledge and training surrounding EPAs, leading to differing levels of understanding; (3) limited current use of EPAs, even among self-reported users; and (4) complementary nature of EPAs and milestones. FPDs acknowledged the differing strengths of both EPAs and milestones but sought additional knowledge about the value added by EPAs for assessing trainees, including the impact on outcomes. CONCLUSIONS: Identified themes can inform effective and meaningful EPA implementation strategies: Supporting and educating FPDs, ongoing assessment of the value of EPAs in training, and practical integration with current workflow. Generating additional data and engaging stakeholders is critical for successful implementation for the pediatric subspecialties.

Are pediatric critical care medicine fellowships teaching and evaluating communication and professionalism?

OBJECTIVES: To describe the teaching and evaluation modalities used by pediatric critical care medicine training programs in the areas of professionalism and communication. DESIGN: Cross-sectional national survey. SETTING: Pediatric critical care medicine fellowship programs. SUBJECTS: Pediatric critical care medicine program directors. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Survey response rate was 67% of program directors in the United States, representing educators for 73% of current pediatric critical care medicine fellows. Respondents had a median of 4 years experience, with a median of seven fellows and 12 teaching faculty in their program. Faculty role modeling or direct observation with feedback were the most common modalities used to teach communication. However, six of the eight (75%) required elements of communication evaluated were not specifically taught by all programs. Faculty role modeling was the most commonly used technique to teach professionalism in 44% of the content areas evaluated, and didactics was the technique used in 44% of other professionalism content areas. Thirteen of the 16 required elements of professionalism (81%) were not taught by all programs. Evaluations by members of the healthcare team were used for assessment for both competencies. The use of a specific teaching technique was not related to program size, program director experience, or training in medical education. CONCLUSIONS: A wide range of techniques are currently used within pediatric critical care medicine to teach communication and professionalism, but there are a number of required elements that are not specifically taught by fellowship programs. These areas of deficiency represent opportunities for future investigation and improved education in the important competencies of communication and professionalism.

A prospective observational quality improvement study of the sustained effects of a program to reduce unplanned extubations in a pediatric intensive care unit.

BACKGROUND: The use of endotracheal intubation is routine in the care of critically ill children. Unplanned extubation exposes the patient to morbidity and mortality over and above that associated with the patient's underlying disease. All unplanned extubations are unacceptable because of their potential for causing unnecessary harm to the patient. OBJECTIVE: To prospectively determine whether a quality improvement program adopted 9 years ago has continued to be successful in maintaining a low rate of unplanned extubation in our pediatric intensive care unit (PICU). DESIGN: Prospective, observational study. SETTING: 10-bed PICU in an urban, county, teaching hospital. PATIENTS: All intubated pediatric patients in the PICU from February 15, 2009 to February 14, 2010. INTERVENTION: None. MEASUREMENTS AND RESULTS: Prior to the implementation of the program in 2000, our PICU had an unplanned extubation rate of 6.4 unplanned extubations per 100 ventilated days. After implementation of the quality improvement program, the rate of unplanned extubation decreased to 1.0 unplanned extubation per 100 ventilated days. In this study, we reevaluated the unplanned extubation rate 9 years after the implementation of the quality improvement program. We found that the rate had remained unchanged (P > 0.05): 1.5 unplanned extubations per 100 ventilated days as compared to 1.0 unplanned extubation per 100 ventilated days. There were no significant differences (P > 0.05) in age, weight, endotracheal tube size, duration of intubation or rate of unplanned extubation. LIMITATIONS: In this study, no randomization took place, in which one group was not subject to the quality improvement program. We did not account for potential changes in severity of illness or staffing issues. CONCLUSIONS: In the 9 years since implementation, our program has remained successful in decreasing unplanned extubations. It is important to periodically reevaluate quality improvement programs to determine whether they have continued to achieve their intended goals. The initiative is reported here using the Standards for Quality Improvement Reporting Excellence (SQUIRE).

Measuring the Resting Energy Expenditure in Children on Extracorporeal Membrane Oxygenation: A Prospective Pilot Study.

Both overfeeding and underfeeding critically ill children are problematic. This prospective pilot study evaluated the resting energy expenditure in infants and children requiring extracorporeal membrane oxygenation (ECMO) support. An indirect calorimeter was used to measure oxygen consumption (VO 2 ) and carbon dioxide production (VCO 2 ) from the mechanical ventilator. Blood gases were used to determine VO 2 and VCO 2 from the ECMO circuit. Values from the mechanical ventilator and ECMO circuit were added, and the resting energy expenditure (REE) (Kcal/kg/day) was calculated. Measurements were obtained > 24 hours after ECMO support was initiated (day 2 of ECMO), 1 day before ECMO discontinuation or transfer, and 1 day after decannulation. Data were compared with the predicted energy expenditure. Seven patients aged 3 months to 13 years were included. The REE varied greatly both above and below predicted values, from 26 to 154 KCal/kg/day on day 2 of ECMO support. In patients with septic shock, the REE was > 300% above the predicted value on day 2 of ECMO. Before ECMO discontinuation, two of six (33%) children continued to have a REE > 110% of predicted. Three patients had measurements after decannulation, all with a REE < 90% of predicted. REE measurements can be obtained by indirect calorimetry in children receiving ECMO support. ECMO may not provide metabolic rest for all children as a wide variation in REE was observed. For optimal care, individual testing should be considered to match calories provided with the metabolic demand.

Development of an Approach to Assessing Pediatric Fellows' Transport Medical Control Skills.

BACKGROUND AND OBJECTIVE: Pediatric interfacility transport teams facilitate access to subspecialty care, and physicians often guide management remotely as transport medical control (TMC). Pediatric subspecialty fellows frequently perform TMC duties, but tools assessing competency are lacking. Our objective was to develop content validity for the items required to assess pediatric subspecialty fellows' TMC skills. METHODS: We conducted a modified Delphi process among transport and fellow education experts in pediatric critical care medicine, pediatric emergency medicine, neonatal-perinatal medicine, and pediatric hospital medicine. The study team generated an initial list of items on the basis of a literature review and personal experience. A modified Delphi panel of transport experts was recruited to participate in 3 rounds of anonymous, online voting on the importance of the items using a 3-point Likert scale (marginal, important, essential). We defined consensus for inclusion as ≥80% agreement that an item was important/essential and consensus for exclusion as ≥80% agreement that an item was marginal. RESULTS: The study team of 20 faculty drafted an initial list of items. Ten additional experts in each subspecialty served on the modified Delphi panel. Thirty-six items met the criteria for inclusion, with widespread agreement across subspecialties. Only 1 item, "discussed bed availability," met the criteria for inclusion among some subspecialties but not others. The study team consolidated the final list into 26 items for ease of use. CONCLUSIONS: Through a consensus-based process among transport experts, we generated content validity for the items required to assess pediatric subspecialty fellows' TMC skills.

Fellow Entrustment for the Common Pediatric Subspecialty Entrustable Professional Activities Across Subspecialties.

OBJECTIVE: To determine the relationship between level of supervision (LOS) ratings for the Common Pediatric Subspecialty Entrustable Professional Activities (EPAs) with their associated subcompetency milestones across subspecialties and by fellowship training year. METHODS: Clinical Competency Committees (CCCs) in 14 pediatric subspecialties submitted LOS ratings for 6 Common Subspecialty EPAs and subcompetency milestone levels mapped to these EPAs. We examined associations between these subcompetency milestone levels and LOS ratings across subspecialty training year by fitting per-EPA linear mixed effects models, regressing LOS rating on milestone level and on training year. RESULTS: CCCs from 211 pediatric fellowship programs provided data for 369 first, 336 second, and 331 third year fellows. Mean subcompetency milestone levels increased similarly among subspecialties for most EPAs compared with the reference, Adolescent Medicine. Mean subcompetency milestones mapped to each EPA and mean EPA LOS ratings generally increased by training year across all subspecialties. CONCLUSIONS: Subcompetency milestones levels mapped to each Common Subspecialty EPA and the EPA LOS ratings increase similarly across subspecialties and by training year, providing validity evidence for using EPA LOS to assess pediatric subspecialty trainee performance. This study supports the development of tools to facilitated the CCC evaluation process across all pediatric subspecialties.

Minimum Supervision Levels Required by Program Directors for Pediatric Pulmonary Fellow Graduation.

Background: Entrustable professional activities (EPAs) define the essential tasks expected of subspecialists in unsupervised practice. Although EPAs have been piloted in some programs, their use for summative assessment of pediatric pulmonology fellows for graduation has not been studied. Objective: To determine the minimum level of supervision that pediatric pulmonary program directors (PDs) require of their fellows for graduation and compare it with the minimum level of supervision they expect for a practicing subspecialist for the five pediatric pulmonology EPAs. Methods: Using a modified Delphi approach, we developed supervision scales for the five pediatric pulmonology EPAs and conducted a national survey of pediatric pulmonary PDs in the United States through the Subspecialty Pediatric Investigators Network between April 2017 and August 2017. Results: Forty-six pediatric pulmonary PDs completed the survey, representing a response rate of 85%. The majority did not require fellows to be trusted to practice without supervision for graduation for any of the five EPAs (level 5); the median minimum level of supervision they required was 4, equating to indirect supervision for complex cases. The minimum level for graduation, defined by consensus as the level of supervision for which no more than 20% of PDs would want the level to be lower to allow a fellow to graduate, was 3, which corresponded to requiring supervision for both simple and complex cases. There was a statistically significant difference between the minimum level of supervision deemed necessary by PDs for graduation and for practice as a subspecialist for each of the EPAs. Conclusion: Most pediatric pulmonary PDs reported that they would graduate fellows who may still require indirect supervision for the five pediatric pulmonology EPAs. The findings suggest a need for stakeholders to reevaluate the structure and outcomes of training programs and ensure support for pediatric pulmonologists in their early practice period.