Implementing Entrustable Professional Activities in Pediatric Fellowships: Facilitating the Process.

BACKGROUND AND OBJECTIVES: Entrustable professional activities (EPAs) will be used for initial certification by the American Board of Pediatrics by 2028. Less than half of pediatric fellowships currently use EPAs for assessment, yet all will need to adopt them. Our objectives were to identify facilitators and barriers to the implementation of EPAs to assess pediatric fellows and to determine fellowship program directors' (FPD) perceptions of EPAs and Milestones. METHODS: We conducted a survey of FPDs from 15 pediatric subspecialties. EPA users were asked about their implementation of EPAs, barriers encountered, and perceptions of EPAs. Nonusers were queried about deterrents to using EPAs. Both groups were asked about potential facilitators of implementation and their perceptions of Milestones. RESULTS: The response rate was 65% (575/883). Of these, 344 (59.8%) were EPA users and 231 (40.2%) were nonusers. Both groups indicated work burden as a barrier to implementation. Nonusers reported more barriers than users (mean [SD]: 7 [3.8] vs 5.8 [3.4], P < .001). Both groups identified training materials and premade assessment forms as facilitators to implementation. Users felt that EPAs were easier to understand than Milestones (89%) and better reflected what it meant to be a practicing subspecialty physician (90%). In contrast, nonusers felt that Milestones were easy to understand (57%) and reflected what it meant to be a practicing subspecialist (58%). CONCLUSIONS: Implementing EPA-based assessment will require a substantial investment by FPDs, facilitated by guidance and easily accessible resources provided by multiple organizations. Perceived barriers to be addressed include FPD time constraints, a need for additional assessment tools, and outcomes data.

Pediatric Pulmonary Milestones 2.0: Development, Lessons Learned, and Future Directions.

Pediatric pulmonology fellowship training programs are required by the Accreditation Council for Graduate Medical Education to report Pediatric Subspecialty Milestones biannually to track fellow progress. However, several issues, such as lack of subspecialty-specific context and ambiguous language, have raised concerns about their validity and applicability to use for fellow assessment and curriculum development. In this Perspective, we briefly share the process of the Pediatric Pulmonology Milestones 2.0 Work Group in creating new specialty-specific Milestones and tailoring information on the Harmonized Milestones to pediatric pulmonologists, with the goal of improving the Milestones' utility for stakeholders, including pulmonology fellows, faculty, program directors, and accrediting bodies. In addition, we created a supplemental guide to better link the Milestones to pulmonary-specific scenarios to create a shared mental model between stakeholders and remove a potential detriment to validity. Through the process, a number of guiding principles were clarified, including: 1) every Milestone should be able to be assessed independently, without overlap with other Milestones; 2) there should be clear developmental progression from one Milestone to the next; 3) Milestones should be based on the unique skills expected of pediatric pulmonologists; and 4) health equity should be a core component to highlight as a top priority to all stakeholders. In this Perspective, we describe these principles that guided formulation of the Pediatric Pulmonary Milestones to help familiarize the pediatric pulmonary community with the new Milestones. In addition, we share lessons learned and challenges in our process to inform other specialties that may soon participate in this process.

Relationship between epa level of supervision with their associated subcompetency milestone levels in pediatric fellow assessment.

BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment. OBJECTIVES: We hypothesized that 1) there would be a strong correlation between EPA LOS ratings with the milestone levels for the subcompetencies mapped to the EPA; 2) some subcompetencies would be more critical in determining entrustment decisions than others, and 3) the correlation would be weaker if the analysis included only milestones reported to the Accreditation Council for Graduate Medical Education (ACGME). METHODS: In fall 2014 and spring 2015, the Subspecialty Pediatrics Investigator Network asked Clinical Competency Committees to assign milestone levels to each trainee enrolled in a pediatric fellowship for all subcompetencies mapped to 6 Common Pediatric Subspecialty EPAs as well as provide a rating for each EPA based upon a 5-point LOS scale. RESULTS: One-thousand forty fellows were assessed in fall and 1048 in spring, representing about 27% of all fellows. For each EPA and in both periods, the average milestone level was highly correlated with LOS (rho range 0.59-0.74; p < 0.001). Correlations were similar when using a weighted versus unweighted milestone score or using only the ACGME reported milestones (p > 0.05). CONCLUSIONS: We found a strong relationship between milestone level and EPA LOS rating but no difference if the subcompetencies were weighted, or if only milestones reported to the ACGME were used. Our results suggest that representative behaviors needed to effectively perform the EPA, such as key subcompetencies and milestones, allow for future language adaptations while still supporting the current model of assessment. In addition, these data provide additional validity evidence for using these complementary tools in building a program of assessment.

Clinical competency committee perceptions of entrustable professional activities and their value in assessing fellows: A qualitative study of pediatric subspecialty program directors.

OBJECTIVES: To examine the composition and processes of Clinical Competency Committees (CCCs) assigning entrustable professional activity (EPA) levels of supervision for pediatric subspecialty fellows and to examine fellowship program director (FPD) perspectives about using EPAs to determine fellows' graduation readiness. METHODS: A qualitative study was performed using one-on-one interviews with a purposeful sample of pediatric subspecialty FPDs to yield a thematic analysis. Semi-structured interview guides were used for participants who self-identified as EPA users or non-users. Inductive analysis and coding were performed on transcripts until theoretical sufficiency was attained. RESULTS: Twenty-eight FPDs were interviewed. There was significant variability in the composition and processes of CCCs across subspecialties. FPDs felt that CCCs intuitively understand what entrustment means, allowing for ease of application of level of supervision (LOS) scales and consensus. FPDs perceived that EPAs provided a global assessment of fellows and are one tool to determine graduation readiness. CONCLUSIONS: Although there was variability in the makeup and processes of CCCs across subspecialties, FPDs believe EPAs are intuitive and relatively easy to implement. Consensus can be reached easily using EPA-specific LOS scales focusing on entrustment. FPDs desire a better understanding of how EPAs should be used for graduation.

The history of workforce concerns in pediatric pulmonary Medicine.

Children are affected by a broad spectrum of acute and chronic respiratory disorders. The number of children with respiratory disease is increasing, as are the complexity of disease pathophysiology and the management demands on pediatric pulmonologists. Despite slowly increasing numbers of board-certified pediatric pulmonologists, large areas of the country are underserved and there is a perception of an impending workforce crisis. There are multiple reasons for these concerns. A joint effort between the Pediatric Pulmonology Division Directors Association and Pediatric Pulmonary Training Directors Association was undertaken to address these issues.

Scholarly activity training in pediatric pulmonology fellowship programs.

BACKGROUND: Scholarly activity training is a required component of pediatric pulmonology fellowship programs. However, there are no data on resources and barriers to training and factors associated with fellow productivity. METHODS: We surveyed US pediatric pulmonology fellowship program directors (FPDs) between March and October 2019. Our primary outcome was fellow productivity (>75% of fellows in the past 5 years had a manuscript accepted in a peer-reviewed journal). Analyses included descriptive statistics, χ2 and Fisher's exact tests for categorical values, and t-test or Wilcoxon rank-sum test for numerical values. RESULTS: Sixty-one percent (33/54) of FPDs completed the survey. Seventy-nine percent reported that most fellows completed clinical, basic science, or translational research. However, only 21% reported that most fellows pursued research positions after graduation; academic clinical positions were more common. For 21%, lack of funding and competing clinical responsibilities were barriers to completing the scholarly activity. Only 39% had highly productive programs; those FPDs were more likely to be highly satisfied with fellow scholarly activity products (p = 0.049) and have >6 publications in the previous 3 years (p = 0.03). Fifty-two percent of FPDs believed that pediatric pulmonary training should be shortened to 2 years for those pursuing clinical or clinician-educator careers. CONCLUSIONS: Barriers to scholarly activity training in pediatric pulmonology programs threaten the pipeline of academic pediatric pulmonologists and physician-investigators. Aligning fellow scholarly activity and clinical training with the skills required in their postgraduate positions could optimize the utilization of limited resources and better support career development.

Fellow Entrustment for the Common Pediatric Subspecialty Entrustable Professional Activities Across Subspecialties.

OBJECTIVE: To determine the relationship between level of supervision (LOS) ratings for the Common Pediatric Subspecialty Entrustable Professional Activities (EPAs) with their associated subcompetency milestones across subspecialties and by fellowship training year. METHODS: Clinical Competency Committees (CCCs) in 14 pediatric subspecialties submitted LOS ratings for 6 Common Subspecialty EPAs and subcompetency milestone levels mapped to these EPAs. We examined associations between these subcompetency milestone levels and LOS ratings across subspecialty training year by fitting per-EPA linear mixed effects models, regressing LOS rating on milestone level and on training year. RESULTS: CCCs from 211 pediatric fellowship programs provided data for 369 first, 336 second, and 331 third year fellows. Mean subcompetency milestone levels increased similarly among subspecialties for most EPAs compared with the reference, Adolescent Medicine. Mean subcompetency milestones mapped to each EPA and mean EPA LOS ratings generally increased by training year across all subspecialties. CONCLUSIONS: Subcompetency milestones levels mapped to each Common Subspecialty EPA and the EPA LOS ratings increase similarly across subspecialties and by training year, providing validity evidence for using EPA LOS to assess pediatric subspecialty trainee performance. This study supports the development of tools to facilitated the CCC evaluation process across all pediatric subspecialties.

Continued Supervision for the Common Pediatric Subspecialty Entrustable Professional Activities May Be Needed Following Fellowship Graduation.

PURPOSE: Entrustable professional activities (EPAs) are one approach to competency-based medical education (CBME), and 7 EPAs have been developed that address content relevant for all pediatric subspecialties. However, it is not known what level of supervision fellowship program directors (FPDs) deem necessary for graduation. The Subspecialty Pediatrics Investigator Network (SPIN) investigated FPD perceptions of the minimum level of supervision required for a trainee to successfully graduate. METHOD: In 2017, SPIN surveyed all FPDs of accredited fellowships for 14 subspecialties. For each EPA, the minimum supervision level for graduation (ranging from observation only to unsupervised practice) was set such that no more than 20% of FPDs would accept a lower level. RESULTS: The survey response rate was 82% (660/802). The minimum supervision level for graduation varied across the 7 EPAs from 2 (direct) to 4 (indirect for complex cases), with significant differences between EPAs. The percentage of FPDs desiring a lower minimum supervision level ranged from 3% to 17%. Compared with the 4 nonclinical EPAs (quality improvement, management, lead within the profession, scholarship), the 3 clinical EPAs (consultation, handover, lead a team) had higher minimum supervision graduation levels (P < .001), with less likelihood that an FPD would graduate a learner below their minimum level (P < .001). CONCLUSIONS: Consensus among FPDs across all pediatric subspecialties demonstrates the potential need for ongoing supervision for graduates in all 7 common pediatric subspecialty EPAs after fellowship. As CBME programs are implemented, processes and infrastructure to support new graduates are important considerations for leaders.

Scholarly Activity During Pediatric Fellowship.

BACKGROUND AND OBJECTIVES: The educational requirements for pediatric fellows include at least 12 months of scholarly activity and generation of a work product. Yet there lacks detailed guidance on how programs can best integrate scholarly activity training into fellowships. Our objectives were to understand the resources and barriers to training and identify factors associated with productivity. METHODS: We surveyed pediatric fellowship program directors (FPDs) nationally in 2019. Data analysis included descriptive statistics, χ2 and Fisher's exact tests, and multivariable modeling to identify factors associated with high productivity (>75% of fellows in the past 5 years had an article from their fellowship accepted). RESULTS: A total of 499 of 770 FPDs responded (65%). A total of 174 programs (35%) were highly productive. The most frequent major barriers were a lack of funding for fellows to conduct scholarship (21%, n = 105) and lack of sufficient divisional faculty mentorship (16%, n = 79). The median number of months for scholarship with reduced clinical obligations scholarship was 17. A total of 40% (n = 202) of FPDs believed training should be shortened to 2 years for clinically oriented fellows. Programs with a T32 and a FPD with >5 publications in the past 3 years were twice as likely to be productive. Not endorsing lack of adequate Scholarship Oversight Committee expertise and a research curriculum as barriers was associated with increased productivity (odds ratio = 1.83-1.65). CONCLUSIONS: Despite significant protected fellow research time, most fellows do not publish. Ensuring a program culture of research may provide the support needed to take projects to publication. The fellowship community may consider reevaluating the fellowship duration, particularly for those pursing nonresearch focused careers.

Funding sources and effects of limited funding in pediatric pulmonology fellowship programs.

BACKGROUND: The pediatric pulmonology workforce is at risk. Access to pediatric pulmonologists to meet patient needs is limited and recruitment of new trainees to replace the aging, retiring physician population may be inadequate. Furthermore, sources of funding for graduate medical education are insecure. However, no prior studies have identified the funding sources of pediatric pulmonology fellowships or the effects of funding constraints. METHODS: We conducted a national survey of pediatric pulmonology training directors (PPTD) in the United States between 1 November, 2016 and 9 February, 2017 to examine the sources of funding for pediatric pulmonary fellows and the effect of funding limitations. RESULTS: We obtained data from 48 PPTD, representing 89% of pediatric pulmonology programs (N = 54). Limitations in funding restricted program size in 31% of programs. A significant number of programs had no funding to cover educational resources such as advanced degrees (38%), courses (23%), society membership (25%), and journals and books (15%). Twenty seven percent of PPTD perceived their program as financially insecure for academic year 2019 and beyond. CONCLUSIONS: Insufficient funding has limited the size of pediatric pulmonology programs and access to important educational resources. It is critical to ensure that there is adequate funding for pediatric pulmonology fellowship programs, as insecurity further endangers the pediatric pulmonology workforce and future provision of care for children with respiratory diseases.

Funding Sources and Perceived Financial Insecurity in Pediatric Subspecialty Fellowship Programs.

OBJECTIVE: Shortages of pediatric subspecialists exist in many fields with insufficient recruitment of new fellows. The current system of funding graduate medical education is inadequate. We examined funding sources for trainee salary and educational expenses in pediatric fellowship programs, effects of funding constraints, and program characteristics associated with financial insecurity as reported by fellowship program directors (FPD). METHODS: We conducted a national survey of FPD between November 1, 2016 and February 9, 2017. We used multivariable logistic regression to examine the association between perceived financial insecurity, program characteristics, and funding sources for fellow salary. RESULTS: We obtained data from 519 FPD, representing 14 different pediatric subspecialties. FPD reported that funding limitations restricted program size and educational resources in 22% and 36% of programs, respectively. Nineteen percent of FPD perceived funding of their program to be insecure. Programs with 7 or more fellows (OR .50 [95% CI .27-.90], P = .03) or hospital or graduate medical education/Children's Hospital graduate medical education funding (OR .58 [95% CI .35-.96], P = .04) were less likely to be perceived as insecure. Conversely, programs with extramural (OR 1.74 [95% CI 1.07-2.81], P = .03) or division funding (OR 1.70 [95% CI 1.02-2.82], P = .04) or in subspecialties with more than 25% unfilled positions or programs (OR 1.86 [95% CI 1.11-3.09], P = .02) were more likely to be perceived as insecure. CONCLUSIONS: Perceived financial insecurity of fellowship programs was strongly associated with program size, funding source, and unfilled positions, limiting recruitment and resources. Stable funding of fellowship programs is critical to maintain an adequate pediatric subspecialty workforce.

[The contribution of cognitive and psychomotor evaluation tools to the assessment of driving potential].

Israeli law requires physicians to report to the authorities all patients, 16 years old and older, who suffer from medical conditions that could possibly impact their ability to drive safely in order not to endanger themselves or others. Despite this clearly defined ruling, in the year 2000 the Israel State Comptroller, reported that only 5% of the physicians reported patients whom they identified as suffering from a deterioration of skills that could result in dangerous and incompetent driving. A mere 1.5% of the total number of referrals to the Medical Institute for Traffic Safety were made by physicians and half of those who were referred were ultimately found to be incompetent for driving by the authorities. Due to the lax reporting, it is entirely probable that there are drivers suffering from medical conditions that could severely impair their ability to drive safely. Physicians, as a rule, must perform their duties confronted by an ethical dilemma. They have been trained to maintain the patient's independence and well-being and keep their medical history confidential. On the other hand, they also have an obligation to society. In addition, the physician may be uncertain how the patient's disability may affect his driving skills. The objective of this paper is to increase the physician's awareness of these issues and introduce evaluation tools for assessing driving competency. This would enhance the physician's professional ability to make decisions based on current valid and reliable practice. The occupational therapy departments of Israel's hospitals that specialize in driver rehabilitation utilize a variety of evaluation tools for assessing driving skills, which include the evaluation of motor, sensory, visual, cognitive and behavioral abilities. This paper focuses on cognitive and psychomotor tools that have been psychometrically tested and found to be reliable for assessing driving skills. They are currently in use in Israel's driving rehabilitation centers and abroad. All of the tools reviewed in this article have already appeared in peer-reviewed articles.