Clinical competency committee perceptions of entrustable professional activities and their value in assessing fellows: A qualitative study of pediatric subspecialty program directors.

OBJECTIVES: To examine the composition and processes of Clinical Competency Committees (CCCs) assigning entrustable professional activity (EPA) levels of supervision for pediatric subspecialty fellows and to examine fellowship program director (FPD) perspectives about using EPAs to determine fellows' graduation readiness. METHODS: A qualitative study was performed using one-on-one interviews with a purposeful sample of pediatric subspecialty FPDs to yield a thematic analysis. Semi-structured interview guides were used for participants who self-identified as EPA users or non-users. Inductive analysis and coding were performed on transcripts until theoretical sufficiency was attained. RESULTS: Twenty-eight FPDs were interviewed. There was significant variability in the composition and processes of CCCs across subspecialties. FPDs felt that CCCs intuitively understand what entrustment means, allowing for ease of application of level of supervision (LOS) scales and consensus. FPDs perceived that EPAs provided a global assessment of fellows and are one tool to determine graduation readiness. CONCLUSIONS: Although there was variability in the makeup and processes of CCCs across subspecialties, FPDs believe EPAs are intuitive and relatively easy to implement. Consensus can be reached easily using EPA-specific LOS scales focusing on entrustment. FPDs desire a better understanding of how EPAs should be used for graduation.

Relationship between epa level of supervision with their associated subcompetency milestone levels in pediatric fellow assessment.

BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment. OBJECTIVES: We hypothesized that 1) there would be a strong correlation between EPA LOS ratings with the milestone levels for the subcompetencies mapped to the EPA; 2) some subcompetencies would be more critical in determining entrustment decisions than others, and 3) the correlation would be weaker if the analysis included only milestones reported to the Accreditation Council for Graduate Medical Education (ACGME). METHODS: In fall 2014 and spring 2015, the Subspecialty Pediatrics Investigator Network asked Clinical Competency Committees to assign milestone levels to each trainee enrolled in a pediatric fellowship for all subcompetencies mapped to 6 Common Pediatric Subspecialty EPAs as well as provide a rating for each EPA based upon a 5-point LOS scale. RESULTS: One-thousand forty fellows were assessed in fall and 1048 in spring, representing about 27% of all fellows. For each EPA and in both periods, the average milestone level was highly correlated with LOS (rho range 0.59-0.74; p < 0.001). Correlations were similar when using a weighted versus unweighted milestone score or using only the ACGME reported milestones (p > 0.05). CONCLUSIONS: We found a strong relationship between milestone level and EPA LOS rating but no difference if the subcompetencies were weighted, or if only milestones reported to the ACGME were used. Our results suggest that representative behaviors needed to effectively perform the EPA, such as key subcompetencies and milestones, allow for future language adaptations while still supporting the current model of assessment. In addition, these data provide additional validity evidence for using these complementary tools in building a program of assessment.

Closing Disparities in Pediatric Diabetes Telehealth Care: Lessons From Telehealth Necessity During the COVID-19 Pandemic.

The coronavirus disease 2019 (COVID-19) pandemic necessitated using telehealth to bridge the clinical gap, but could increase health disparities. This article reports on a chart review of diabetes telehealth visits occurring before COVID-19, during shelter-in-place orders, and during the reopening period. Visits for children with public insurance and for those who were non-English speaking were identified. Telehealth visits for children with public insurance increased from 26.2% before COVID-19 to 37.3% during shelter-in-place orders and 34.3% during reopening. Telehealth visits for children who were non-English speaking increased from 3.5% before COVID-19 to 17.5% during shelter-in-place orders and remained at 15.0% during reopening. Pandemic-related telehealth expansion included optimization of workflows to include patients with public insurance and those who did not speak English. Increased participation by those groups persisted during the reopening phase, indicating that prioritizing inclusive telehealth workflows can reduce disparities in access to care.

Improving pediatric endocrinology trainees' knowledge about insulin pumps and continuous glucose monitors with online spaced education: Technology Knowledge Optimization in T1D (TeKnO T1D).

OBJECTIVE: We explored the impact of TeKnO T1D, an online, case-based, spaced education curriculum about insulin pump and continuous glucose monitor (CGM) use in pediatric type 1 diabetes management. METHODS: Pediatric endocrinology fellows (n = 64) were randomized to receive an educational curriculum focused on either insulin pumps or CGMs. Fellows received interactive questions twice weekly via email or mobile app. Median time to completion was 76.5 days. The primary outcome was change in knowledge as measured by performance on multiple-choice questions (MCQ) from the pre-test to the post-test. RESULTS: Forty-eight of 64 (75%) learners completed the curriculum and assessments. The pump group improved from 35.0 ± 15% on the pre-test MCQs to 61.1 ± 17% on the post-test, a 12.2 absolute percentage point greater improvement on pump-specific items than the CGM group (P = .03). The CGM group improved from 30.3 ± 15% on the pre-test MCQs to 61.4 ± 21% on the post-test, a 28.7 absolute percentage point greater improvement on CGM-specific items than the pump group (P < .001). Both groups were more likely to report an appropriate level of understanding of their respective technologies after completing the corresponding curriculum. In thematic analysis of qualitative data, fellows indicated that knowledge gains led to improved patient care. There was universal agreement about enjoyment and effectiveness of the curricula. CONCLUSIONS: TeKnO T1D proved to be an engaging, effective way to improve endocrinology fellows' knowledge and confidence about insulin pumps and CGM use in the management of pediatric type 1 diabetes.

Measuring change in knowledge acquisition of Rwandan residents: using the American Board of Pediatrics International In-Training Examination (I-ITE) as an independent tool to monitor individual and departmental improvements during the Human Resources for Health program: an observational study.

BACKGROUND: Rwanda is the only African country to use the pediatric International In-Training Examination (I-ITE). The objectives of this study were to use the scores from the I-ITE to outline the baseline level of knowledge of Rwandan residents entering the pediatric residency and the trends in knowledge acquisition from 2012 to 2018, during the Human Resources for Health (HRH) Program, an education partnership between the Rwanda Ministry of Health and a consortium of US universities. METHODS: A retrospective descriptive analysis of the I-ITE exam scores, taken by all Rwandan pediatric residents for five of the six academic years of the study period. Individual resident scores were weighted using the non-Rwandan I-ITE sites to minimise confounding from annual variations in exam difficulty. Statistical analysis included descriptives with ANOVA to compare variation in annual mean scores. RESULTS: Eighty-four residents took 213 I-ITE exam sittings over the five exam cycles. The mean weighted I-ITE score of all residents increased from 34% in 2013 to 49% (p < 0.001) in 2018. The 32-point gap between the mean US-ITE and Rwandan I-ITE score in 2012-2013 was reduced to a 16-point gap in 2017-2018. First year resident (PG1) scores, which likely reflect the knowledge level of undergraduate medical students entering the residency program, increased from 34.8 to 44.3% (p = 0.002) between 2013 and 2018. CONCLUSIONS: The I-ITE is an independent, robust tool, measuring both learners and the institutional factors supporting residents. This is the first study to demonstrate that the I-ITE can be used to monitor resident knowledge acquisition in resource-limited settings, where assessment of resident knowledge can be a major challenge facing the academic medicine community. The significant increase in I-ITE scores between 2012 and 18 reflects the substantial curricular reorganisation accomplished through collaboration between Rwandan and US embedded faculty and supports the theory that programs such as HRH are highly effective at improving the quality of residency programs and undergraduate medical education.

Effects of MetAP2 inhibition on hyperphagia and body weight in Prader-Willi syndrome: A randomized, double-blind, placebo-controlled trial.

AIMS: There are no treatments for the extreme hyperphagia and obesity in Prader-Willi syndrome (PWS). The bestPWS clinical trial assessed the efficacy, safety and tolerability of the methionine aminopeptidase 2 (MetAP2) inhibitor, beloranib. MATERIALS AND METHODS: Participants with PWS (12-65 years old) were randomly assigned (1:1:1) to biweekly placebo, 1.8 mg beloranib or 2.4 mg beloranib injection for 26 weeks at 15 US sites. Co-primary endpoints were the changes in hyperphagia [measured by Hyperphagia Questionnaire for Clinical Trials (HQ-CT); possible score 0-36] and weight by intention-to-treat. ClinicalTrials.gov registration: NCT02179151. RESULTS: One-hundred and seven participants were included in the intention-to-treat analysis: placebo (n = 34); 1.8 mg beloranib (n = 36); or 2.4 mg beloranib (n = 37). Improvement (reduction) in HQ-CT total score was greater in the 1.8 mg (mean difference -6.3, 95% CI -9.6 to -3.0; P = .0003) and 2.4 mg beloranib groups (-7.0, 95% CI -10.5 to -3.6; P = .0001) vs placebo. Compared with placebo, weight change was greater with 1.8 mg (mean difference - 8.2%, 95% CI -10.8 to -5.6; P < .0001) and 2.4 mg beloranib (-9.5%, 95% CI -12.1 to -6.8; P < .0001). Injection site bruising was the most frequent adverse event with beloranib. Dosing was stopped early due to an imbalance in venous thrombotic events in beloranib-treated participants (2 fatal events of pulmonary embolism and 2 events of deep vein thrombosis) compared with placebo. CONCLUSIONS: MetAP2 inhibition with beloranib produced statistically significant and clinically meaningful improvements in hyperphagia-related behaviours and weight loss in participants with PWS. Although investigation of beloranib has ceased, inhibition of MetAP2 is a novel mechanism for treating hyperphagia and obesity.

The High Direct Medical Costs of Prader-Willi Syndrome.

OBJECTIVE: To assess medical resource utilization associated with Prader-Willi syndrome (PWS) in the US, hypothesized to be greater relative to a matched control group without PWS. STUDY DESIGN: We used a retrospective case-matched control design and longitudinal US administrative claims data (MarketScan) during a 5-year enrollment period (2009-2014). Patients with PWS were identified by Classification of Diseases, Ninth Revision, Clinical Modification diagnosis code 759.81. Controls were matched on age, sex, and payer type. Outcomes included total, outpatient, inpatient and prescription costs. RESULTS: After matching and application of inclusion/exclusion criteria, we identified 2030 patients with PWS (1161 commercial, 38 Medicare supplemental, and 831 Medicaid). Commercially insured patients with PWS (median age 10 years) had 8.8-times greater total annual direct medical costs than their counterparts without PWS (median age 10 years: median costs $14 907 vs $819; P < .0001; mean costs: $28 712 vs $3246). Outpatient care comprised the largest portion of medical resource utilization for enrollees with and without PWS (median $5605 vs $675; P < .0001; mean $11 032 vs $1804), followed by mean annual inpatient and medication costs, which were $10 879 vs $1015 (P < .001) and $6801 vs $428 (P < .001), respectively. Total annual direct medical costs were ∼42% greater for Medicaid-insured patients with PWS than their commercially insured counterparts, an increase partly explained by claims for Medicaid Waiver day and residential habilitation. CONCLUSION: Direct medical resource utilization was considerably greater among patients with PWS than members without the condition. This study provides a first step toward quantifying the financial burden of PWS posed to individuals, families, and society.

Transcranial direct current stimulation reduces food-craving and measures of hyperphagia behavior in participants with Prader-Willi syndrome.

Prader-Willi syndrome (PWS) is a neurodevelopmental genetic disorder characterized by intellectual disabilities and insatiable appetite with compulsive eating leading to severe obesity with detrimental health consequences. Transcranial direct current stimulation (tDCS) has been shown to modulate decision-making and cue-induced food craving in healthy adults. We conducted a pilot double blind, sham-controlled, multicenter study of tDCS modulation of food drive and craving in 10 adult PWS participants, 11 adult obese (OB) and 11 adult healthy-weight control (HWC) subjects. PWS and OB subjects received five consecutive daily sessions of active or sham tDCS over the right dorsolateral prefrontal cortex (DLPFC), while HWC received a single sham and active tDCS in a crossover design. Standardized psychometric instruments assessed food craving, drive and hyperphagia by self-report and caregiver assessment over 30 days. Robust baseline differences were observed in severity scores for the Three-Factor Eating Questionnaire (TFEQ) and Dykens Hyperphagia Questionnaire (DHQ) for PWS compared to HWC while obese participants were more similar to HWC. Active tDCS stimulation in PWS was associated with a significant change from baseline in TFEQ Disinhibition (Factor II) (Ƶ = 1.9, P < 0.05, 30 days) and Total Scores (Ƶ = 2.3, P < 0.02, 30 days), and participant ratings of the DHQ Severity (Ƶ = 1.8, P < 0.06, 5 days) and Total Scores (Ƶ = 1.9, P < 0.05, 15 days). These findings support sustained neuromodulatory effects and efficacy of tDCS to reduce food drive and behaviors impacting hyperphagia in PWS. Transcranial direct current stimulation may represent a straight-forward, low risk and low cost method to improve care, management and quality of life in PWS.

Exploring Factors for Implementation of EPAs in Pediatric Subspecialty Fellowships: A Qualitative Study of Program Directors.

OBJECTIVE: To understand fellowship program directors' (FPDs) perspectives on facilitators and barriers to using entrustable professional activities (EPAs) in pediatric subspecialty training. METHODS: We performed a qualitative study of FPDs, balancing subspecialty, program size, geographic region and current uses of EPAs. A study coordinator conducted 1-on-1 interviews using a semistructured approach to explore EPA use or nonuse and factors supporting or preventing their use. Investigators independently coded transcribed interviews using an inductive approach and the constant comparative method. Group discussion informed code structure development and refinement. Iterative data collection and analysis continued until theoretical sufficiency was achieved, yielding a thematic analysis. RESULTS: Twenty-eight FPDs representing 11 pediatric subspecialties were interviewed, of whom 16 (57%) reported current EPA use. Five major themes emerged: (1) facilitators including the intuitive nature and simple wording of EPAs; (2) barriers such as workload burden and lack of a regulatory requirement; (2) variable knowledge and training surrounding EPAs, leading to differing levels of understanding; (3) limited current use of EPAs, even among self-reported users; and (4) complementary nature of EPAs and milestones. FPDs acknowledged the differing strengths of both EPAs and milestones but sought additional knowledge about the value added by EPAs for assessing trainees, including the impact on outcomes. CONCLUSIONS: Identified themes can inform effective and meaningful EPA implementation strategies: Supporting and educating FPDs, ongoing assessment of the value of EPAs in training, and practical integration with current workflow. Generating additional data and engaging stakeholders is critical for successful implementation for the pediatric subspecialties.

Implementing Entrustable Professional Activities in Pediatric Fellowships: Facilitating the Process.

BACKGROUND AND OBJECTIVES: Entrustable professional activities (EPAs) will be used for initial certification by the American Board of Pediatrics by 2028. Less than half of pediatric fellowships currently use EPAs for assessment, yet all will need to adopt them. Our objectives were to identify facilitators and barriers to the implementation of EPAs to assess pediatric fellows and to determine fellowship program directors' (FPD) perceptions of EPAs and Milestones. METHODS: We conducted a survey of FPDs from 15 pediatric subspecialties. EPA users were asked about their implementation of EPAs, barriers encountered, and perceptions of EPAs. Nonusers were queried about deterrents to using EPAs. Both groups were asked about potential facilitators of implementation and their perceptions of Milestones. RESULTS: The response rate was 65% (575/883). Of these, 344 (59.8%) were EPA users and 231 (40.2%) were nonusers. Both groups indicated work burden as a barrier to implementation. Nonusers reported more barriers than users (mean [SD]: 7 [3.8] vs 5.8 [3.4], P < .001). Both groups identified training materials and premade assessment forms as facilitators to implementation. Users felt that EPAs were easier to understand than Milestones (89%) and better reflected what it meant to be a practicing subspecialty physician (90%). In contrast, nonusers felt that Milestones were easy to understand (57%) and reflected what it meant to be a practicing subspecialist (58%). CONCLUSIONS: Implementing EPA-based assessment will require a substantial investment by FPDs, facilitated by guidance and easily accessible resources provided by multiple organizations. Perceived barriers to be addressed include FPD time constraints, a need for additional assessment tools, and outcomes data.

Premature adrenarche in Prader-Willi syndrome is associated with accelerated pre-pubertal growth and advanced bone age.

OBJECTIVES: Prader-Willi syndrome (PWS) is characterized by obesity, growth hormone deficiency, hypogonadism, and a high prevalence of premature adrenarche despite reported hypothalamic-pituitary-adrenal axis dysfunction. While idiopathic premature adrenarche is associated with accelerated pre-pubertal growth and advanced bone age, the consequences of elevated adrenal androgens on growth and bone maturation in PWS remain unknown. This study therefore sought to describe age-related changes in dehydroepiandrosterone sulfate (DHEAS) and their effects on growth and bone maturation in PWS. METHODS: This retrospective observational study included 62 children with PWS. Simple and multiple regression models were constructed to relate age and BMI-SDS with DHEAS levels. Height velocity was compared to age and sex-based norms with t-tests and two-way ANOVA. Patterns in bone age Z-score were examined with two-way ANOVA, and the contributions of age, BMI-SDS, and DHEAS to bone age Z-score were analyzed with multiple regression. RESULTS: DHEAS levels rose earlier and were less strongly correlated with age in males and females with PWS (R2=0.12 and 0.30) compared to healthy controls (R2=0.89 and 0.88) in a pattern unrelated to BMI-SDS (adjusted R2=0.076, p=0.10 for age, and 0.29 for BMI-SDS). Mid-childhood height velocity was increased in males and preserved in females with PWS before declining at the age of expected puberty (p<0.0001). Peri-adrenarchal bone age was advanced in a manner associated with DHEAS but not BMI-SDS (p<0.0001; adjusted R2=0.48, p=0.0014 for DHEAS, and 0.78 for BMI-SDS). CONCLUSIONS: An obesity-independent increase in adrenal androgens is associated with accelerated mid-childhood growth and bone maturation in PWS.

Linking oxytocin and arginine vasopressin signaling abnormalities to social behavior impairments in Prader-Willi syndrome.

Prader-Willi syndrome (PWS) is a genetic neurodevelopmental disorder. Global hypothalamic dysfunction is a core feature of PWS and has been implicated as a driver of many of PWS's phenotypic characteristics (e.g., hyperphagia-induced obesity, hypogonadism, short stature). Although the two neuropeptides (i.e., oxytocin [OXT] and arginine vasopressin [AVP]) most implicated in mammalian prosocial functioning are of hypothalamic origin, and social functioning is markedly impaired in PWS, there has been little consideration of how dysregulation of these neuropeptide signaling pathways may contribute to PWS's social behavior impairments. The present article addresses this gap in knowledge by providing a comprehensive review of the preclinical and clinical PWS literature-spanning endogenous neuropeptide measurement to exogenous neuropeptide administration studies-to better understand the roles of OXT and AVP signaling in this population. The preponderance of evidence indicates that OXT and AVP signaling are indeed dysregulated in PWS, and that these neuropeptide pathways may provide promising targets for therapeutic intervention in a patient population that currently lacks a pharmacological strategy for its debilitating social behavior symptoms.

Fellow Entrustment for the Common Pediatric Subspecialty Entrustable Professional Activities Across Subspecialties.

OBJECTIVE: To determine the relationship between level of supervision (LOS) ratings for the Common Pediatric Subspecialty Entrustable Professional Activities (EPAs) with their associated subcompetency milestones across subspecialties and by fellowship training year. METHODS: Clinical Competency Committees (CCCs) in 14 pediatric subspecialties submitted LOS ratings for 6 Common Subspecialty EPAs and subcompetency milestone levels mapped to these EPAs. We examined associations between these subcompetency milestone levels and LOS ratings across subspecialty training year by fitting per-EPA linear mixed effects models, regressing LOS rating on milestone level and on training year. RESULTS: CCCs from 211 pediatric fellowship programs provided data for 369 first, 336 second, and 331 third year fellows. Mean subcompetency milestone levels increased similarly among subspecialties for most EPAs compared with the reference, Adolescent Medicine. Mean subcompetency milestones mapped to each EPA and mean EPA LOS ratings generally increased by training year across all subspecialties. CONCLUSIONS: Subcompetency milestones levels mapped to each Common Subspecialty EPA and the EPA LOS ratings increase similarly across subspecialties and by training year, providing validity evidence for using EPA LOS to assess pediatric subspecialty trainee performance. This study supports the development of tools to facilitated the CCC evaluation process across all pediatric subspecialties.

The prevalence of COVID-19 in healthcare personnel in an adult and pediatric academic medical center.

BACKGROUND: It is vital to know which healthcare personnel (HCP) have a higher chance of testing positive for severe acute respiratory syndrome coronavirus 2 (COVID-19). METHODS: A retrospective analysis was conducted at Stanford Children's Health (SCH) and Stanford Health Care (SHC) in Stanford, California. Analysis included all HCP, employed by SCH or SHC, who had a COVID-19 reverse transcriptase polymerase chain reaction (RT-PCR) test resulted by the SHC Laboratory, between March 1, 2020 and June 15, 2020. The primary outcome was the RT-PCR percent positivity and prevalence of COVID-19 for HCP and these were compared across roles. RESULTS: SCH and SHC had 24,081 active employees, of which 142 had at least 1 positive COVID-19 test. The overall HCP prevalence of COVID-19 was 0.59% and percent positivity was 1.84%. Patient facing HCPs had a significantly higher prevalence (0.66% vs 0.43%; P = .0331) and percent positivity (1.95% vs 1.43%; P = .0396) than nonpatient facing employees, respectively. Percent positivity was higher in food service workers (9.15%), and environmental services (5.96%) compared to clinicians (1.93%; P < .0001) and nurses (1.46%; P < .0001), respectively. DISCUSSION AND CONCLUSION: HCP in patient-facing roles and in support roles had a greater chance of being positive of COVID-19.

Achieving Entrustable Professional Activities During Fellowship.

BACKGROUND AND OBJECTIVES: Entrustable Professional Activities (EPAs) were developed to assess pediatric fellows. We previously showed that fellowship program directors (FPDs) may graduate fellows who still require supervision. How this compares with their expectations for entrustment of practicing subspecialists is unknown. METHODS: We surveyed US FPDs in 14 pediatric subspecialties through the Subspecialty Pediatrics Investigator Network between April and August 2017. For each of 7 common pediatric subspecialty EPAs, we compared the minimum level of supervision that FPDs required for graduation with the level they expected of subspecialists for safe and effective practice using the Friedman rank sum test and paired t test. We compared differences between subspecialties using linear regression. RESULTS: We collected data from 660 FPDs (response rate 82%). For all EPAs, FPDs did not require fellows to reach the level of entrustment for graduation that they expected of subspecialists to practice (P < .001). FPDs expected the least amount of supervision for the EPAs consultation and handovers. Mean differences between supervision levels for graduation and practice were smaller for clinical EPAs (consultation, handovers, lead a team) when compared with nonclinical EPAs (quality improvement, management, lead the profession and scholarship; P = .001) and were similar across nearly all subspecialties. CONCLUSIONS: Fellowship graduates may need continued development of clinical and nonclinical skills in their early practice period, underscoring a need for continued assessment and mentoring. Graduation readiness must be based on clear requirements, with alignment of FPD expectations and regulatory standards, to ensure quality care for patients.

Prader Willi syndrome: endocrine updates and new medical therapies.

PURPOSE OF REVIEW: Prader Willi syndrome is characterized not only by hyperphagia frequently resulting in obesity, but also by endocrine dysfunction across a variety of axes. This article reviews the most recent literature regarding possible causes of hyperphagia and the nature of endocrinopathies seen in Prader Willi syndrome, as well as current research into possible therapies. RECENT FINDINGS: Investigation into neurologic, metabolic and hormonal drivers of hyperphagia and obesity has revealed new insights and clarified underlying pathophysiology. Additional studies continue to elucidate the hormonal deficiencies seen in the syndrome, allowing for improvements in clinical care. SUMMARY: The underlying causes of the hyperphagia and progressive obesity frequently seen in Prader Willi Syndrome are largely unknown and likely multifactorial. Understanding the hormonal and metabolic drivers at work in PWS, as well as the nature of other hormonal dysfunction seen in the syndrome is necessary to guide current management and future research directions.