A novel workplace-based assessment for competency-based decisions and learner feedback.

BACKGROUND: Increased recognition of the importance of competency-based education and assessment has led to the need for practical and reliable methods to assess relevant skills in the workplace. METHODS: A novel milestone-based workplace assessment system was implemented in 15 pediatrics residency programs. The system provided: (1) web-based multisource feedback (MSF) and structured clinical observation (SCO) instruments that could be completed on any computer or mobile device; and (2) monthly feedback reports that included competency-level scores and recommendations for improvement. RESULTS: For the final instruments, an average of five MSF and 3.7 SCO assessment instruments were completed for each of 292 interns; instruments required an average of 4-8 min to complete. Generalizability coefficients >0.80 were attainable with six MSF observations. Users indicated that the new system added value to their existing assessment program; the need to complete the local assessments in addition to the new assessments was identified as a burden of the overall process. CONCLUSIONS: Outcomes - including high participation rates and high reliability compared to what has traditionally been found with workplace-based assessment - provide evidence for the validity of scores resulting from this novel competency-based assessment system. The development of this assessment model is generalizable to other specialties.

A Survey Study of Motivators for Pediatric Hospitalists to Work in the Community.

BACKGROUND AND OBJECTIVE: The loss of pediatric beds in the community has contributed to decreased access to pediatric inpatient and emergency services. Community pediatric hospitalist programs could reduce the overhead of inpatient care, promoting the financial feasibility of caring for hospitalized children closer to home. This study aims to determine which career motivators are the most important for pediatric hospitalists to begin working in, remain in, and leave the community setting. METHODS: A survey was sent to a convenience sample of 269 community hospitalists from 31 different sites. Sites were invited if the program director was known to the authors. Responses were evaluated and χ-square or Fisher's exact test were used to compare the differences. RESULTS: One hundred twenty six community pediatric hospitalists completed the survey (response rate 49.1%). The 3 most important motivators for pediatric hospitalists to begin working in the community were work-life integration (80%), geographic location (75%), and flexible hours (71%). Pediatric hospitalists who planned to leave the community setting were more likely to cite mentoring and teaching opportunities (76% vs 32%, P = .0002), opportunities for research and quality improvement (29% vs 10%, P = .021), and paid time for nonclinical interests (52% vs 26%, P = .02) as very important. CONCLUSIONS: This study demonstrates key motivators for pediatric hospitalists to work in the community and elucidates motivators for transitioning to larger pediatric centers. This knowledge may be used to guide community pediatric hospital medicine recruitment and program development that could lead to improved retention.

Gender and work-life balance: Results of a national survey of pediatric hospitalists.

In medicine, difficulty integrating work and home can lead to decreased job satisfaction, diminished well-being, and increased turnover. Understanding the experience of pediatric hospitalists can provide insights into building a stable, long-term workforce. We aim to examine gender differences in work-life balance and parental leave for physicians practicing Pediatric Hospital Medicine. METHODS: This was a cross-sectional survey study of 1096 pediatric hospitalists. Responses were collected via an online survey platform and summarized using descriptive statistics, including frequency distributions and measures of central tendency. A multivariable logistic regression was used to examine associated variables and work-life balance satisfaction. We analyzed free responses on parental leave to provide nuance to quantitative survey data. RESULTS: Five hundred and sixty-five respondents (52% response rate) completed the survey with 71% women. 343 (62%) prioritize work-life balance in career decision-making. Women report taking on more household responsibilities than their partners (41.4% vs. 8.4%; p < .001) including a larger percentage of caregiving and domestic tasks. Female gender and performing <50% caregiving were associated with decreased work-life balance satisfaction; performing <50% domestic tasks increased satisfaction. Median parental leaves were 4 weeks, with men taking significantly shorter leaves (3.5 vs. 6 weeks; p < .001) and more "paid back" time off. CONCLUSION: Work-life balance is an important factor in career decisions for men and women. Women perceive carrying a larger load at home. Qualitative results suggest that parental leave may be inadequate in length and salary support for men and women. This study adds insights into work-life integration in PHM.

Gender Communication Differences on a Pediatric Provider Listserv.

BACKGROUND AND OBJECTIVES: Gender-based communication differences are described in educational online communities, but have not been rigorously evaluated in medical online communities. Understanding gender differences in communication may provide insight into gender disparities in the medical profession. Our objective was to describe gender differences in post frequency, content, and language styles on the American Academy of Pediatrics Section on Hospital Medicine (SOHM) listserv. METHODS: Posts were obtained from publicly available SOHM listserv archives. The first month of every quarter of 2019 and 2020 were reviewed. Two reviewers assigned a post topic (clinical, research, etc) and format (question vs statement) to all deidentified original posts (K = 1.0 topic, 0.89 format). Six trained reviewers assigned language styles (intraclass coefficient = 0.73, indicating good agreement). RESULTS: We analyzed 1592 posts: 287 original posts and 1305 responses. Frequency: Women authored 50% of posts. The 9 most frequent posters (7 men, 2 women) accounted for 19.5% of posts. Content: Men's posts had more words than women's (132.51 vs 112.3, P ≤ .01). Men were more likely to post about health policy and research (P < .001). Men were more likely to post statements compared with women (39% vs 21%, P < .001). Style: Men's posts were more likely to be coded adversarial (12.3% vs 5.5%, P < .001) authoritative (12.2% vs 6.5%, P < .001) or self-amplifying (6.5% vs 3.6%, P < .001). CONCLUSIONS: Women contribute disproportionately fewer posts to the American Academy of Pediatrics SOHM listserv compared with their percentage in the subspecialty. We noted significant gender differences in language style and content, which may impact career development and online community inclusion.

Association Between Gender and Salary Among Pediatric Hospital Medicine Physicians.

OBJECTIVES: Gender-based disparities in salary exist in multiple fields of medicine. However, there is limited data examining gender inequities in salary in pediatric hospital medicine (PHM). Our primary objective was to assess whether gender-based salary differences exist in PHM. The secondary objective was to assess if, among women, the differences in salary varied on the basis of leadership positions or self-identified race and ethnicity. METHODS: We conducted a survey-based, cross-sectional study of pediatric hospitalists in December 2021. Our primary outcomes were base and total salary, adjusted for the reported number of average weekly work hours. We performed subanalyses by presence of a leadership position, as well as race. We used a weighted t test using inverse probability weighting to compare the outcomes between genders. RESULTS: A total of 559 eligible people responded to our survey (51.0%). After propensity score weighting, women's mean base salary was 87.7% of men's base (95% confidence interval [CI] 79.8%-96.4%, P < .01), and women's total salary was 85.6% of men's total (95% CI 73.2%-100.0%, P = .05) salary. On subgroup analysis of respondents with a leadership position, women's total salary was 80.6% of men's total salary (95% CI 68.7%-94.4%, P < .01). Although women who identified as white had base salaries that were 86.6% of white men's base salary (95% CI 78.5%-95.5%, P < .01), there was no gender-based difference noted between respondents that identified as nonwhite (88.4% [69.9%-111.7%] for base salary, 80.3% [57.2% to 112.7%]). CONCLUSIONS: Gender-based discrepancies in salary exists in PHM, which were increased among those with leadership roles. Continued work and advocacy are required to achieve salary equity within PHM.

Exploring Medical Student Experiences With Direct Observation During the Pediatric Clerkship.

PURPOSE: Direct observation (DO) enables assessment of vital competencies, such as clinical skills. Despite national requirement that medical students experience DOs during each clerkship, the frequency, length, quality, and context of these DOs are not well established. This study examines the quality, quantity, and characteristics of DOs obtained during pediatrics clerkships across multiple institutions. METHOD: This multimethod study was performed at 6 U.S.-based institutions from March through October 2022. In the qualitative phase, focus groups and/or semistructured interviews were conducted with third-year medical students at the conclusion of pediatrics clerkships. In the quantitative phase, the authors administered an internally developed instrument after focus group discussions or interviews. Qualitative data were analyzed using thematic analysis, and quantitative data were analyzed using anonymous survey responses. RESULTS: Seventy-three medical students participated in 20 focus groups, and 71 (97.3%) completed the survey. The authors identified 7 themes that were organized into key principles: before, during, and after DO. Most students reported their DOs were conducted primarily by residents (62 [87.3%]) rather than attendings (6 [8.4%]) in inpatient settings. Participants reported daily attending observation of clinical reasoning (38 [53.5%]), communication (39 [54.9%]), and presentation skills (58 [81.7%]). One-third reported they were never observed taking a history by an inpatient attending (23 [32.4%]), and one-quarter reported they were never observed performing a physical exam (18 [25.4%]). CONCLUSIONS: This study revealed that students are not being assessed for performing vital clinical skills in the inpatient setting by attendings as frequently as previously believed. When observers set expectations, create a safe learning environment, and follow up with actionable feedback, medical students perceive the experience as valuable; however, the DO experience is currently suboptimal. Therefore, a high-quality, competency-based clinical education for medical students is necessary to directly drive future patient care by way of a competent physician workforce.

A Multisite Survey of Pediatric Hospitalists' Practices in Soliciting Feedback From Trainees.

OBJECTIVE: There is evidence that pediatric attending physicians value receiving feedback from trainees. With this study, we sought to determine the extent to which pediatric hospitalists value, solicit, and receive feedback from residents and medical students on specific areas of the attending's performance and identify perceived barriers to trainees' providing feedback. METHODS: A web-based survey was sent to pediatric hospitalists at 9 institutions in 2022. Survey questions were developed from existing literature, trainee input, faculty expertise, and a framework on the qualities of exemplary pediatric educators. Respondents answered yes-no and multiitem Likert scale questions and selected answers from predetermined lists related to feedback solicitation from trainees. χ-Square and Wilcoxon rank test statistics were used to analyze questions. RESULTS: Responses were gathered from 91 of 189 surveyed individuals (response rate: 48.1%). Respondents almost unanimously "agreed" or "strongly agreed" that feedback from medical students (88, 96.7%) and residents (89, 97.8%) can be valuable, but feedback was considered more valuable from residents (P <.05). Attending physicians asked for and received feedback more from residents than from medical students (P <.05). Attending physicians most commonly asked for feedback on "teaching skills." The largest perceived barriers to receiving feedback from trainees were trainee lacking comfort with giving feedback, trainee lacking awareness that providing feedback is within their role, and fear of retaliation. CONCLUSIONS: Although pediatric hospitalist respondents nearly unanimously valued feedback from trainees, attending physicians were inconsistent in their feedback solicitation practices. Attending physicians were more likely to ask for and receive feedback from residents than from medical students.

Impact of COVID-19 on the Sense of Job Security Among Community Pediatric Hospitalists.

OBJECTIVES: The coronavirus disease 2019 (COVID-19) pandemic offers a prime opportunity to examine the ability of community pediatric hospital medicine programs to respond to external stressors. This study aims to characterize the impact of the COVID-19 pandemic on compensation and furlough among community pediatric hospitalists, as well as self-reported sense of job security. METHODS: This study was part of a larger quantitative project investigating community pediatric hospitalists' career motivators. The survey was drafted through an iterative process by the authors. It was disseminated via e-mail to a convenience sample of community pediatric hospitalists obtained through direct contact with community pediatric hospital medicine programs. Data were collected on changes in compensation and furlough because of COVID-19, as well as worry about job security measured as self-reported worry about one's job being permanently terminated on a 5-point Likert scale. RESULTS: Data were collected from 31 hospitals across the United States with 126 completed surveys. Because of COVID-19, many community pediatric hospitalists experienced reduced base pay and benefits and a minority experienced furlough. Nearly two-thirds (64%) reported some worry about job security. Initial base pay reduction, working in suburban areas compared with rural areas, and affiliation with a university-based center or free-standing children's hospital were significantly associated with greater worry about job security. CONCLUSIONS: The initial response to the COVID-19 pandemic resulted in changes in compensation and furlough for some community pediatric hospitalists and many expressed concerns about job security. Future studies should identify protective factors for community pediatric hospitalists' job security.

Learner Handoffs Within Clinical Rotations: From the Resident Perspective.

PURPOSE: Competency-based medical education relies on repeated longitudinal assessments of learners. Frequent attending physician transitions within clinical rotations present a significant barrier to the educational continuity required in competency-based medical education. Learner handoffs (LHs), or the transfer of information regarding learners on a team among faculty supervisors, is a potential solution. Although literature is available on educational leader and clinical faculty perspectives on LHs, perspectives of the learners have been less well described. METHOD: This qualitative study used thematic analysis of pediatric resident focus groups from 3 programs of varying size and geographic location from July to December 2021. Two authors independently read the first 3 transcripts to generate a codebook and then coded the remaining transcripts independently to ensure thematic saturation. Emerging themes were discussed and revised until a consensus was achieved. RESULTS: Forty-four pediatric residents from 3 programs participated in 8 focus groups. Themes were identified regarding LHs' positive impact on the (1) learner, (2) clinical practice, and (3) learning environment. Participants described numerous positive benefits to their own development, team functioning, trust, and patient safety. This experience was counterbalanced by risk of bias in the current LH context. Suggestions for the implementation of a structured LH framework were provided, with a focus on the content ( what information), process ( who is involved), and format ( how is it delivered) of LHs. Participants believed that the creation of a structured LH tool may mitigate perceived challenges, including bias and lack of transparency. CONCLUSIONS: Residents recognize potential benefits to learners themselves, their clinical practice, and their learning environment through LHs but express concerns regarding further propagating bias. The development of a structured and learner-centered LH tool could accelerate learner professional development while mitigating perceived challenges. Future research should define essential components of an LH model with input from all key stakeholders.

When educators are locked down: transitioning an international faculty development program from in-person to online during the COVID-19 pandemic in China.

Introduction: The coronavirus disease 2019 (COVID-19) pandemic forced international faculty development programs in medical education to forgo in-person activities and transition to online learning. We sought to examine changes in international medical educators' evaluations of our faculty development program as it transitioned due to the pandemic. Methods: We compared survey responses from participants in our International Medical Educators Program between 2019 (in-person) and 2020 (online). The 43-item survey addressed aspects such as program evaluation and self-assessment of curriculum development and teaching skills. We analyzed data using t-tests to compare means and chi-square test for categorical variables, and performed thematic analysis of open-ended responses. Results: We found that trainees in both cohorts rated the program highly with regard to overall program quality and self-assessed learning outcomes, but the 2019 group reported stronger relationships with peers and instructors. Some scores for self-assessed outcomes were lower for the 2020 class, but no statistically significant differences were found in pre- and post- training scores between the two cohorts. Four themes emerged from the feedback: positive program utility, IMEP as an example of good curriculum design, timing issues, and online learning environment challenges. Conclusions: Despite pandemic challenges, the transition to online faculty development was favorably evaluated, with high confidence in the applicability of learned skills. Future efforts should focus on fostering community and optimizing interaction times to enhance learning experiences. The study contributes insights for global medical education communities in pandemic circumstances.

The 2021 Pediatric Hospital Medicine Workforce: Results of a National Survey of Program Leaders.

OBJECTIVE: Pediatric Hospital Medicine (PHM) is a young subspecialty with practice models that continue to evolve. To inform program and workforce planning, it is essential to understand the current state. This study sought to delineate current work models for PHM. METHODS: In the spring of 2021, we conducted a survey-based cohort study of individuals identifying as PHM program leaders. Individuals were invited based on membership in the 3 PHM sponsoring societies. Additional respondents were recruited through society listservs. RESULTS: One hundred ninety-eight program leaders responded to the program model survey. One-half covered only community sites, 21.2% covered only university sites, and 21.2% covered both university and community sites. Programs provided a diverse set of services, with community sites covering more services, including newborn nurseries, emergency department consultation, and delivery room care. Median total hours for 1.0 clinical full time equivalent were 1849 across all sites, 1800 at university-only sites, and 1900 at community-only sites. Inpatient floor patient caps, when present, were higher for resident covered versus noncovered teams (16 vs 13). Similarly, back-up activation was higher for resident-covered teams (15-16) than noncovered teams (12-13.5). CONCLUSIONS: Current data on clinical work hours for pediatric hospitalists are consistent with recent, smaller studies, suggesting that the current national median for a 1.0 FTE clinical position at university-based sites is 1800 annual hours. Community hospitalists often work more clinical hours than university sites and more commonly provide a broader range of service lines. More studies are needed to explore the differences between community and university site work models.

Gender Distribution of Scholarship and Measures of National Recognition in Hospital Medicine.

OBJECTIVE: Our specific aim was to assess the gender distribution of aspects of scholarly productivity and professional standing for pediatric hospital medicine over a 5-year period. We also evaluated for correlation between the makeup of editorial boards, conference planning committees, and chosen content. METHODS: We reviewed scholarly publications, presentations, editorial boards, planning committees, awardees, and society leadership in pediatric hospital medicine from 2015 to 2019 and determined gender using published methods to assess for differences between observed proportions of women authors and presenters and the proportion of women in the field. RESULTS: The field of pediatric hospital medicine at large is 69% women (95% confidence internal [CI] 68%-71%), and an estimated 57% of senior members are women (95% CI 54%-60%). We evaluated 570 original science manuscripts and found 67% (95% CI 63%-71%) women first authors and 49% (95% CI 44%-53%) women senior authors. We evaluated 1093 presentations at national conferences and found 69% (95% CI 65%-72%) women presenters of submitted content and 44% (95% CI 37%-51%) women presenters of invited content. Senior authorship and invited speaking engagements demonstrated disproportionately low representation of women when compared with senior members of the field (senior authorship, P = .002; invited presenters, P < .001). Strong positive correlation between gender composition of conference planning committees and selected content was also noted (r = 0.94). CONCLUSION: Our study demonstrated representative gender distribution for some aspects of scholarly productivity in pediatric hospital medicine; however, a lack of gender parity exists in senior roles.

An Annotated Bibliography of Key Studies in Medical Education in 2020: Applying the Current Literature to Educational Practice and Scholarship.

Pediatric medical educators, with their multitude of responsibilities, may have difficulty staying abreast with both medical education and specialty specific medical literature. The body of medical literature is growing at an exponential rate. This annotated bibliography serves as a summary of highlighted medical education literature in the year 2020. The purpose was to identify manuscripts which have the potential to significantly influence a pediatric medical educator's practice. The authors reviewed abstracts from 14 medical education and specialty journals using a two-staged review process. Each stage of review was completed by 2 different authors. A total of 1861 abstracts were reviewed and ultimately 15 key manuscripts were identified. The authors grouped the manuscripts into 6 core domains: diversity and inclusion, faculty development, feedback, learner development, mentorship, and teaching skills. Condensed summaries of each medical education manuscript likely to influence educational practice are provided by the authors in this annotated bibliography.

How Perceived Burnout Alters Frontline Educators' Assessments in the Clinical Learning Environment.

OBJECTIVE: This study explores frontline educators' experience with learner burnout in the clinical learning environment (CLE) and how perceived burnout may impact assessment. METHODS: A survey was sent to 105 Pediatric Hospital Medicine faculty and fellows at 7 sites across the United States representing diverse CLEs. They were invited to participate in an 11-question web-based survey that was developed, edited, and revised in step-wise fashion. It consisted of 5-point Likert scale, forced-choice, and dichotomous questions. Data from the web-based survey were compiled for descriptive purposes and analyzed for trends. RESULTS: The response rate was 53%. Most respondents (83%) perceive learner burnout at least once per year, but median comfort in identifying burnout was 3 (scale 1-5, 3 = neutral). Factors associated with comfort were education as primary niche (P = .01) and having wellness training (P = .045). In terms of the impact of perceived learner burnout impacts on assessment, 88% report impact on feedback sessions and 60% reported impact on summative assessment; most are more lenient. Stated belief in whether perceived burnout should or should not impact assessment had 60% sensitivity and 84% specificity in predicting whether it does. CONCLUSIONS: Frontline educators routinely perceive learner burnout in the CLE and it often impacts educators' assessment of a learner. The discrepancy between the expected and actual impact may suggest amplification of known barriers to accurate assessment in the CLE. Comfort associated with wellness training suggests that interventions targeting frontline educators in the CLE may improve their ability to simultaneously support and assess learners.

Gender Distribution in Pediatric Hospital Medicine Leadership.

Pediatric Hospital Medicine (PHM), a field early in its development and with a robust pipeline of women, is in a unique position to lead the way in gender equity. We describe the proportion of women in divisional and fellowship leadership positions at university-based PHM programs (n = 142). When compared with the PHM field at large, women appear to be underrepresented as PHM division/program leaders (70% vs 55%; P< .001) but not as fellowship directors (70% vs 66%; P > .05). Women appear proportionally represented in associate/assistant leadership roles when compared with the distribution of the PHM field at large. Tracking these trends overtime is essential to advancing the field.

Flying Solo: Effectiveness of Attendingless Family-Centered Rounds on Improving Resident Autonomy.

BACKGROUND AND OBJECTIVES: The Accreditation Council for Graduate Medical Education requires that residents demonstrate increasing autonomy during their training. Although residents report a better educational environment with hospitalists present during family-centered rounds (FCRs), there is a concern that attending presence may reduce resident autonomy. We aim to determine the effect of FCRs without an attending during rounds on senior residents' sense of autonomy. METHODS: We conducted a multicenter, retrospective, preintervention-postintervention study at 5 children's hospitals to evaluate the effect of rounding without an attending on senior residents' self-efficacy, using a questionnaire developed by using Bandura's principles of self-efficacy and Accreditation Council for Graduate Medical Education milestones. Questions addressed skills of diagnosis and/or management, communication, teaching, and team management. We compared preintervention and postintervention results using paired t tests and Wilcoxon rank tests. One-way analysis of variance tests were used to compare means among >2 groups. RESULTS: 116 (82% response rate) of 142 eligible senior residents completed the questionnaire, which yielded a high reliability (α = 0.80) with a 1-factor score. The average composite score of self-efficacy significantly improved after intervention compared with the preintervention score (66.71 ± 6.95 vs 60.91 ± 6.82; P < .001). Additional analyses revealed meaningful improvement of each individual item postintervention. The highest gain was reported in directing bedside teaching (71.8% vs 42.5%; P < .001) and answering learner questions on rounds (70.7% vs 47.0%; P < .001). CONCLUSIONS: Conducting FCRs without an attending increases resident reported self-efficacy regarding core elements of patient care and team leadership. In future studies, researchers should examine the impact of rounding without the attending on other stakeholders, such as students, interns, patients and/or families.

Influences on and Characteristics of the Professional Identity Formation of Clinician Educators: A Qualitative Analysis.

PURPOSE: Professional identity formation is the process of internalizing the ideals, values, and beliefs of a profession. In recent years, research on clinician-educator (CE) identity formation has expanded, yet gaps exist in understanding initial influences on an educator identity, sustainment throughout a career, and development of successful pathways for early CEs. This study explored the initial influences on and characteristics of the professional identity formation of CEs in an age-diverse, multispecialty population in the United States. METHOD: This was a cross-sectional qualitative study of a purposive sample of medical educators at 6 institutions across the United States between 2018 and 2019. Focus groups were conducted to obtain participants' perspectives on their career choice and subsequent formation of their professional identity as CEs. The authors used a thematic analysis of focus group data to identify themes and domains through an iterative process. RESULTS: Twelve focus groups were conducted with a total of 93 participants. Responses were categorized into 5 domains: community supportive of medical education, culture of institution and training, personal characteristics, facilitators, and professionalization of medical education. Themes highlighted the importance of role models and mentors, an affinity and aptitude for teaching and education, specific facilitators for entry into a career in medical education, the evolution from a layperson, importance of formalized training programs, and a supportive academic community. CONCLUSIONS: Clinicians experienced a variety of factors that influenced their initial career choice in medical education and subsequent professional identity formation as a CE. This study confirms and expands the current understanding of this process in an age-diverse, multispecialty population of CEs. Educators and administrators designing career development programs across the continuum of medical education should consider these aspects as they mentor and support their learners and faculty.

An Annotated Bibliography of Key Studies in Medical Education in 2019: Applying the Current Literature to Educational Practice and Scholarship.

Pediatric medical educators have the dual challenge of remaining up-to-date in the field of pediatrics and in the field of medical education. Due to the volume of information published in these 2 fields it can be nearly impossible to remain current in both fields of practice. To facilitate interpretation of the most recent medical education research, the authors conducted an annotated bibliography of medical education literature published in 2019. The purpose of this annotated bibliography was to identify manuscripts which had the potential to significantly influence a pediatric educator's practice. Using a 2-staged review process, the authors reviewed abstracts from 13 medical education and specialty journals. All reviews were independently completed by 2 different reviewers for each journal in both stages. A total of 4700 abstracts were reviewed and 17 key manuscripts were identified. The authors grouped the key manuscripts into 6 core themes: bedside teaching, learning climate, bias, learner autonomy, learner in trouble, and resident competency. This annotated bibliography provides the authors' condensed summary of the medical education manuscripts most likely to influence educational practices for the busy pediatric medical educator.