Taking Our Pulse: Examining 5 Years of Data from the Association of Pediatric Program Directors Research and Scholarship Learning Community.

BACKGROUND: The Association of Pediatric Program Directors Research and Scholarship Learning Community (RSLC) prioritizes and comprehensively reviews medical education surveys directed to residency program leadership. Each survey is reviewed by two members of RSLC and the Chair and Vice Chair using a standardized scoring rubric and a limited number of surveys are accepted per cycle. METHODS: Internal review data from 2015 to 2020 were analyzed to determine factors associated with survey acceptance, and for surveys accepted for distribution, determine factors associated with response rates or dissemination status. One-Way analysis of variance (ANOVA) assessed differences in evaluation scores by initial determination status. T-tests and Pearson Product Correlation assessed associations between evaluation scores and response rates by dissemination status. RESULTS: The majority (47/81; 58%) of surveys submitted to RSLC are eventually accepted for distribution. Response rates for distributed surveys varied between 14% and 73%. Most (35/47; 74%) surveys distributed through RSLC are presented (62%) and/or published (60%). Higher review scores were associated with acceptance for distribution but not with response rates or dissemination status. CONCLUSION: Most surveys are eventually accepted by RSLC for distribution and those distributed often get published or presented despite variability in response rates.

Getting the Most Out of Your Medical Education Survey: 11 Tips From the Association of Pediatric Program Directors Research and Scholarship Learning Community.

OBJECTIVE: Surveys in medical education are commonplace. However, survey studies often lack scientific rigor. Well-designed surveys can ensure improved response rates and higher likelihood of dissemination. The purpose of this paper is to provide guidance for investigators planning to survey pediatric residency leaders METHODS: We examined the Association of Pediatric Program Directors Research and Scholarship Learning Community (APPD-RSLC) submissions, acceptances, and outcomes between 2015 and 2020. Additionally, we performed a literature review of survey design methods with the help of a research librarian. We established a list of tips and settled on the 11 included here by group discussion and consensus. CONCLUSION: These 11 tips provide specific recommendations for successful design of medical education surveys distributed by the APPD based on experience from current and former leaders of the RSLC and literature review in survey design and implementation.

A scoping review of social media in child, adolescents and young adults: research findings in depression, anxiety and other clinical challenges.

BACKGROUND: Social media and other technologies are reshaping communication and health. AIMS: This review addresses the relationship between social media use, behavioural health conditions and psychological well-being for youth aged <25 years. METHOD: A scoping review of 11 literature databases from 2000 to 2020 explored research studies in youth in five areas: clinical depression and anxiety, quantitative use, social media mode, engagement and qualitative dimensions and health and well-being. RESULTS: Out of 2820 potential literature references, 140 met the inclusion criteria. The foci were clinical depression and anxiety disorders (n = 78), clinical challenges (e.g. suicidal ideation, cyberbullying) (n = 34) and psychological well-being (n = 28). Most studies focused on Facebook, Twitter, Instagram and YouTube. Few studies are longitudinal in design (n = 26), had comparison groups (n = 27), were randomised controlled trials (n = 3) or used structured assessments (n = 4). Few focused on different youth and sociodemographic populations, particularly for low-income, equity-seeking and deserving populations. Studies examined association (n = 120; 85.7%), mediating (n = 16; 11.4%) and causal (n = 4; 2.9%) relationships. Prospective, longitudinal studies of depression and anxiety appear to indicate that shorter use (≤3 h/day) and purposeful engagement is associated with better mood and psychological well-being. Depression may predict social media use and reduce perception of support. Findings provide families, teachers and providers ways to engage youth. CONCLUSIONS: Research opportunities include clinical outcomes from functional perspective on a health continuum, diverse youth and sociodemographic populations, methodology, intervention and privacy issues. More longitudinal studies, comparison designs and effectiveness approaches are also needed. Health systems face clinical, training and professional development challenges.

Are Final Residency Milestones Correlated With Early Fellowship Performance in Pediatrics?

PURPOSE: Milestones have been used to assess trainees across graduate medical education programs and reflect a developmental continuum from novice to expert. This study examined whether residency milestones are correlated with initial fellowship milestone performance in pediatrics. METHOD: This retrospective cohort study used descriptive statistics to assess milestone scores from pediatric fellows who began fellowship training between July 2017 and July 2020. Milestone scores were obtained at the end of residency (R), middle of the first fellowship year (F1), and end of the first fellowship year (F2). RESULTS: Data represent 3,592 unique trainees. High composite R scores, much lower F1 scores, and slightly higher F2 scores were found over time for all pediatric subspecialities. R scores were positively correlated with F1 scores (Spearman ρ = 0.12, P < .001) and F2 scores (Spearman ρ = 0.15, P < .001). Although scores are negligibly different when trainees graduate from residency, there were differences in F1 and F2 scores among fellows in different specialties. Those who trained at the same institution for residency and fellowship had higher composite milestone F1 and F2 scores compared with those who trained at different institutions ( P < .001). The strongest associations were between R and F2 scores for the professionalism and communication milestones, although associations were still relatively weak overall (r s = 0.13-0.20). CONCLUSIONS: This study found high R scores and low F1 and F2 scores across all shared milestones, with weak association of scores within competencies, indicating that milestones are context dependent. Although professionalism and communication milestones had a higher correlation compared with the other competencies, the association was still weak. Residency milestones may be useful for individualized education in early fellowship, but fellowship programs should be cautious about overreliance on R scores due to the weak correlation with F1 and F2 scores.

COVID-19 Pandemic Impact on Pediatricians Entering the Pediatric Workforce.

OBJECTIVE: Determine extent of impact of coronavirus disease 2019 (COVID-19) pandemic on career choice and employment of pediatricians entering pediatric workforce. METHODS: A national, cross-sectional electronic survey of pediatricians registering for the 2021 American Board of Pediatrics initial general certifying examination on the impact of the COVID-19 pandemic on 3 aspects of career (career choice, employment search, employment offers) was performed. Data were analyzed using descriptive statistics and multivariate logistic regression to determine factors associated with the pandemic's impact on career. Thematic analysis was used to generate themes for open-ended survey questions. RESULTS: Over half (52.3%, 1767 of 3380) of pediatricians responded. Overall, 29.1% reported that the pandemic impacted their career (career choice [10.4%], employment search [15.6%], or employment offers [19.0%]); applicants to general pediatrics (GP) (52.9%) or pediatric hospitalist (PH) positions (49.3%) were most affected. Multivariate logistic regression modeling found those applying to GP (odds ratio [OR]: 3.83, 95% confidence interval [CI]: 2.22-6.60), PH (OR: 9.02, 95% CI: 5.60-14.52), and International Medical Graduates (IMGs) (OR: 1.90; 95% CI: 1.39-2.59) most likely to experience any career impact. CONCLUSIONS: Almost one third of pediatricians registering for the initial general pediatrics certifying examination reported their careers were impacted by the COVID-19 pandemic, with 10% of respondents reporting the pandemic impacted their career choice. Half of new pediatricians seeking employment reported being impacted by the pandemic, particularly IMGs. As the pandemic evolves, career advising will continue to be critical to support trainees in their career choices and employment.

Enhancing Learner Engagement Through Experiential Learning With Learner-Generated Data.

Integrating self-generated learner data into hands-on curricula enhances learner engagement with material and self-assessed learning. Using learner self-generated data to enhance learner engagement can have widespread applicability and benefit for use in design of educational curricula.

The Early Effects of the Coronavirus Disease-19 Pandemic on Pediatric Resident Education: A National Assessment.

PURPOSE: Residency programs must ensure resident competence for independent practice. The coronavirus disease-19 (COVID-19) pandemic disrupted health care delivery, impacting pediatric residencies. This study examines the impact on pediatric resident education. METHODS: The authors conducted a mixed methods national survey of pediatric residency program directors (PDs) from May 2020 to July 2020. Data analysis included descriptive statistics, chi-square, and Wilcoxon rank sum tests. Multivariable modeling identified factors associated with resident preparation for more senior roles. Thematic analysis was performed on open-ended questions about PD COVID-19 pandemic recommendations to peers, Accreditation Council for Graduate Medical Education and American Board of Pediatrics. RESULTS: Response rate was 55% (110/199). PDs reported the COVID-19 pandemic negatively affected inpatient (n = 86, 78.2%), and outpatient education (n = 104, 94.5%), procedural competence (n = 64; 58.2%), and resident preparation for more senior roles (n = 50, 45.5%). In bivariate analyses, increasingly negative impacts on inpatient and outpatient education were associated with an increasingly negative impact on resident preparation for more senior roles (P = .03, P = .008), these relationships held true in multivariable analysis. Qualitative analysis identified 4 themes from PD recommendations: 1) Clear communication from governing bodies and other leaders; 2) Flexibility within programs and from governing bodies; 3) Clinical exposure is key for competency development; 4) Online platforms are important for education, communication, and support. CONCLUSIONS: The COVID-19 pandemic negatively impacted inpatient and outpatient education. When these were more negatively impacted, resident preparation for more senior roles was worse, highlighting the importance of competency based medical education to tailor experiences ensuring each resident is competent for independent practice.

Effect of a Novel Mindfulness Curriculum on Burnout During Pediatric Internship: A Cluster Randomized Clinical Trial.

IMPORTANCE: Mindfulness curricula can improve physician burnout, but implementation during residency presents challenges. OBJECTIVE: To examine whether a novel mindfulness curriculum implemented in the first 6 months of internship reduces burnout. DESIGN, SETTING, AND PARTICIPANTS: This pragmatic, multicenter, stratified cluster randomized clinical trial of a mindfulness curriculum randomized 340 pediatric interns to the intervention or control arm within program pairs generated based on program size and region. Fifteen US pediatric training programs participated from June 14, 2017, to February 28, 2019. INTERVENTIONS: The intervention included 7 hour-long sessions of a monthly mindfulness curriculum (Mindfulness Intervention for New Interns) and a monthly mindfulness refresher implemented during internship. The active control arm included monthly 1-hour social lunches. MAIN OUTCOMES AND MEASURES: The primary outcome was emotional exhaustion (EE) as measured by the Maslach Burnout Inventory 9-question EE subscale (range, 7-63; higher scores correspond to greater perceived burnout). Secondary outcomes were depersonalization, personal accomplishment, and burnout. The study assessed mindfulness with the Five Facet Mindfulness Questionnaire and empathy with the Interpersonal Reactivity Index subscales of perspective taking and empathetic concern. Surveys were implemented at baseline, month 6, and month 15. RESULTS: Of the 365 interns invited to participate, 340 (93.2%; 255 [75.0%] female; 51 [15.0%] 30 years or older) completed surveys at baseline; 273 (74.8%) also participated at month 6 and 195 (53.4%) at month 15. Participants included 194 (57.1%) in the Mindfulness Intervention for New Interns and 146 (42.9%) in the control arm. Analyses were adjusted for baseline outcome measures. Both arms' EE scores were higher at 6 and 15 months than at baseline, but EE did not significantly differ by arm in multivariable analyses (6 months: 35.4 vs 32.4; adjusted difference, 3.03; 95% CI, -0.14 to 6.21; 15 months: 33.8 vs 32.9; adjusted difference, 1.42; 95% CI, -2.42 to 5.27). None of the 6 secondary outcomes significantly differed by arm at month 6 or month 15. CONCLUSIONS AND RELEVANCE: A novel mindfulness curriculum did not significantly affect EE, burnout, empathy, or mindfulness immediately or 9 months after curriculum implementation. These findings diverge from prior nonrandomized studies of mindfulness interventions, emphasizing the importance of rigorous study design and suggesting that additional study is needed to develop evidence-based methods to reduce trainee burnout. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT03148626.

Scholarly activity training in pediatric pulmonology fellowship programs.

BACKGROUND: Scholarly activity training is a required component of pediatric pulmonology fellowship programs. However, there are no data on resources and barriers to training and factors associated with fellow productivity. METHODS: We surveyed US pediatric pulmonology fellowship program directors (FPDs) between March and October 2019. Our primary outcome was fellow productivity (>75% of fellows in the past 5 years had a manuscript accepted in a peer-reviewed journal). Analyses included descriptive statistics, χ2 and Fisher's exact tests for categorical values, and t-test or Wilcoxon rank-sum test for numerical values. RESULTS: Sixty-one percent (33/54) of FPDs completed the survey. Seventy-nine percent reported that most fellows completed clinical, basic science, or translational research. However, only 21% reported that most fellows pursued research positions after graduation; academic clinical positions were more common. For 21%, lack of funding and competing clinical responsibilities were barriers to completing the scholarly activity. Only 39% had highly productive programs; those FPDs were more likely to be highly satisfied with fellow scholarly activity products (p = 0.049) and have >6 publications in the previous 3 years (p = 0.03). Fifty-two percent of FPDs believed that pediatric pulmonary training should be shortened to 2 years for those pursuing clinical or clinician-educator careers. CONCLUSIONS: Barriers to scholarly activity training in pediatric pulmonology programs threaten the pipeline of academic pediatric pulmonologists and physician-investigators. Aligning fellow scholarly activity and clinical training with the skills required in their postgraduate positions could optimize the utilization of limited resources and better support career development.

Demystifying the Op-Ed. A Novel Group Writing Workshop to Improve Upon Existing Pediatric Advocacy Training.

An op-ed writing workshop utilizing a group compilation exercise increases participant self-reported comfort in writing op-eds and has led to published op-eds. An experiential op-ed writing workshop could be incorporated into advocacy curricula in pediatric residency programs.

Stages of Milestones Implementation: A Template Analysis of 16 Programs Across 4 Specialties.

BACKGROUND: Since 2013, US residency programs have used the competency-based framework of the Milestones to report resident progress and to provide feedback to residents. The implementation of Milestones-based assessments, clinical competency committee (CCC) meetings, and processes for providing feedback varies among programs and warrants systematic examination across specialties. OBJECTIVE: We sought to determine how varying assessment, CCC, and feedback implementation strategies result in different outcomes in resource expenditure and stakeholder engagement, and to explore the contextual forces that moderate these outcomes. METHODS: From 2017 to 2018, interviews were conducted of program directors, CCC chairs, and residents in emergency medicine (EM), internal medicine (IM), pediatrics, and family medicine (FM), querying their experiences with Milestone processes in their respective programs. Interview transcripts were coded using template analysis, with the initial template derived from previous research. The research team conducted iterative consensus meetings to ensure that the evolving template accurately represented phenomena described by interviewees. RESULTS: Forty-four individuals were interviewed across 16 programs (5 EM, 4 IM, 5 pediatrics, 3 FM). We identified 3 stages of Milestone-process implementation, including a resource-intensive early stage, an increasingly efficient transition stage, and a final stage for fine-tuning. CONCLUSIONS: Residency program leaders can use these findings to place their programs along an implementation continuum and gain an understanding of the strategies that have enabled their peers to progress to improved efficiency and increased resident and faculty engagement.

Health Care Provider Practices and Perceptions During Family-Centered Rounds With Limited English-Proficient Families.

OBJECTIVE: To increase understanding of current practices and perceptions of family-centered rounds (FCR) by providers for limited English-proficient (LEP) families relative to English-proficient families. METHODS: Using grounded theory methodology, we conducted ethnographic observations of FCR for LEP and English-proficient families on the pediatric wards at an urban teaching hospital. Focused coding of observation fieldnotes was performed independently, followed by regular group meetings to discuss discrepancies, refine codes, and identify theoretical direction. Data informed development of an interview guide used to conduct interviews with pediatric physicians, nurses, and interpreters. The iterative analysis process continued with interview transcriptions. RESULTS: FCR of 36 unique patient families were observed, of which 10 were LEP families. We conducted 20 interviews with 7 residents, 3 attendings, 5 nurses, and 5 interpreters. Major themes included: 1) standardization of FCR is needed to address equity issues for LEP families, 2) redefining the roles of medical interpreters would enhance the interpersonal interactions and relationships between families and health care providers, and 3) improving resources to allow interpreters to be used consistently will increase equity for LEP families. CONCLUSIONS: Many differences exist in FCR for LEP versus English-proficient families. FCR for LEP families may be optimized with standardization and training, redefining the interpreters' roles, and improving access to interpreters.

Scholarly Activity During Pediatric Fellowship.

BACKGROUND AND OBJECTIVES: The educational requirements for pediatric fellows include at least 12 months of scholarly activity and generation of a work product. Yet there lacks detailed guidance on how programs can best integrate scholarly activity training into fellowships. Our objectives were to understand the resources and barriers to training and identify factors associated with productivity. METHODS: We surveyed pediatric fellowship program directors (FPDs) nationally in 2019. Data analysis included descriptive statistics, χ2 and Fisher's exact tests, and multivariable modeling to identify factors associated with high productivity (>75% of fellows in the past 5 years had an article from their fellowship accepted). RESULTS: A total of 499 of 770 FPDs responded (65%). A total of 174 programs (35%) were highly productive. The most frequent major barriers were a lack of funding for fellows to conduct scholarship (21%, n = 105) and lack of sufficient divisional faculty mentorship (16%, n = 79). The median number of months for scholarship with reduced clinical obligations scholarship was 17. A total of 40% (n = 202) of FPDs believed training should be shortened to 2 years for clinically oriented fellows. Programs with a T32 and a FPD with >5 publications in the past 3 years were twice as likely to be productive. Not endorsing lack of adequate Scholarship Oversight Committee expertise and a research curriculum as barriers was associated with increased productivity (odds ratio = 1.83-1.65). CONCLUSIONS: Despite significant protected fellow research time, most fellows do not publish. Ensuring a program culture of research may provide the support needed to take projects to publication. The fellowship community may consider reevaluating the fellowship duration, particularly for those pursing nonresearch focused careers.

Scholarly Evaluation of Curricula and Educational Programs: Using a Systematic Approach to Produce Publishable Scholarship.

The goal of designing innovative curricula and programs in medical education is to create interventions that will change the attitudes, knowledge, skills, and behaviors of learners in order to prepare them to contribute to the health of patients and communities they serve. Systematic evaluation allows curriculum/program developers to optimize their curriculum/program and ensure that the goals of the curriculum/program are met. While curriculum/program evaluation is distinct from educational research, when approached in a rigorous manner, curriculum/program evaluation can be published as educational scholarship. The goal of our paper is to equip readers with tools to apply a scholarly approach to curriculum/program evaluation to produce findings that will advance the field. We start by defining curricula, educational programs, learner assessment, and evaluation. We then briefly describe examples of best practice models for curriculum/program development that incorporate the critical step of planning for evaluation. Building on published work, we distinguish the use of best practice models and conceptual frameworks to inform curriculum/program development and evaluation. More specifically, we outline steps to plan an evaluation that demonstrates WHAT was effective, describes HOW the curriculum/program contributed to the outcomes achieved, and points to WHY the curriculum/program led to the outcomes observed. We conclude with key considerations for publishing findings of an evaluation, including what to include in each section of a manuscript.