Gender Difference in Teaching Evaluation Scores of Pediatric Faculty.

OBJECTIVE: To evaluate associations between faculty gender and milestone-based teaching assessment scores assigned by residents. METHODS: We performed a retrospective cohort study of milestone-based clinical teaching assessments of pediatric faculty completed by pediatric residents at a mid-sized residency program from July 2016 to June 2019. Assessments included 3 domains (Clinical Interactions, Teaching Skills, Role Modeling/Professionalism) comprised of a total of 11 sub-competency items. We used multilevel logistic regression accounting for repeat measures and clustering to evaluate associations between faculty gender and assessment scores in the 1) top quartile, 2) bottom quartile, or 3) top-box (highest score). Findings were adjusted for faculty rank and academic track, and resident year and gender. RESULTS: Over 3 years, 2889 assessments of 104 faculty were performed by 91 residents. Between assessments of women and men faculty, there were no significant differences in the odds of receiving a score in the top quartile for the 3 domains (Clinical aOR 0.99, P = .86; Teaching aOR 0.99, P = .93; Role Modeling aOR 0.87, P = .089). However, assessments of women were more likely to receive a score in the bottom quartile in both Teaching (aOR 1.23, P = .019) and Role Modeling (aOR 1.26, P = .008). Assessments of women also had lower odds of receiving the highest score in 6 of 11 sub-competencies. CONCLUSION: Results suggest that gender bias may play a role in resident assessments of pediatric faculty. Future studies are needed to determine if findings are replicated in other settings and to identify opportunities to reduce the gender gap in pediatric academic medicine.

First, do no harm: impact of the transition to an integrated curriculum on medical knowledge acquisition of the transitional cohort.

INTRODUCTION: Many medical schools are moving toward integrated curricula in response to the 2010 Carnegie report. However, there is often apprehension that student performance on standard assessment metrics of medical knowledge acquisition could suffer during the transition period. Therefore, we sought to analyze the impact of curriculum redesign on the medical knowledge acquisition of the transitional cohort, as measured by NBME subject exam scores. METHODS: The University of Wisconsin School of Medicine and Public Health Legacy curriculum followed a standard 2 + 2 medical school educational model, including traditional, department-based, third-year clinical clerkships. In the new ForWard curriculum, students enter clinical rotations one semester earlier, and those core clinical experiences are organized within four integrated blocks combining traditional clerkship specialties. This retrospective program evaluation compares NBME subject exam scores between the final cohort of Legacy third-year students (2016-17) and first cohort of ForWard students (2018) for the Adult Ambulatory Medicine, Medicine, Neurology, Obstetrics and Gynecology, Pediatrics, Psychiatry, and Surgery exams. RESULTS: NBME subject exam mean scores ranged from 75.5-79.4 for the Legacy cohort and 74.9-78.7 for the ForWard cohort, with no statistically significant differences in scores identified for each individual exam analyzed. Results remained constant when controlled for student demographic variables. DISCUSSION: Faculty and students may worry about impacts to the transitional cohort during curriculum redesign, however our results suggest no substantive negative effects to acquisition of medical knowledge during transition to an integrated curriculum. Further monitoring is necessary to examine whether medical knowledge acquisition remains stable or changes after the integrated curriculum is established.

Gender-Based Linguistic Analysis of Pediatric Clinical Faculty Evaluations.

BACKGROUND: Gendered stereotypes are embedded in the culture of medicine. Women are stereotypically expected to act collaboratively and less assertively, while men are expected to act with authority and power. Whether gender-biased language is expressed in academic pediatric teaching evaluations is unknown. OBJECTIVE: Determine whether stereotypic gender-based linguistic differences exist in resident evaluations of pediatric faculty. METHODS: We performed a retrospective cross-sectional study of clinical faculty evaluations by pediatric residents in a single program from July 2016 to June 2019. Using Linguistic Inquiry and Word Count, responses to 2 open-ended questions were analyzed for stereotypic language. Categories were reported as a percent of total words written. Comparisons between gender groups were conducted using nonparametric Wilcoxon rank sum tests. Rates of word use within each category were analyzed using logistic regression where faculty and resident gender were included as predictor variables. RESULTS: A total of 6436 free-text responses from 3218 unique evaluations were included. As hypothesized, evaluations of women faculty were less likely than those of men to include certain agentic language like power (odds ratio [OR] 0.9, P < .001) and insight (OR 0.9, P < .001), and research words (OR 0.6, P = .003). As expected, evaluations of women were more likely to include grindstone words, like "hardworking" (OR 1.2, P = .012). Contrary to our hypothesis, women received fewer teaching words like "mentor" (OR 0.9, P = .048) and communal words like "friendly" (OR 0.6, P = .001). CONCLUSION: Certain stereotypic language was demonstrated in clinical teaching evaluations of pediatric faculty. These findings should be further examined to improve gender inequities in academic pediatrics.

Patient care, public health, and a pandemic: adapting educational experiences in the clinical years.

The University of Wisconsin Madison School of Medicine and Public Health rapidly adapted its four-year, three-phase medical doctorate clinical curriculum at the onset of the COVID-19 in Spring 2020. Medical students in clinical rotations, our Phase 2 and 3 of the ForWard curriculum, temporarily stopped face to face care of patients, transitioning instead to online learning. For Phase 2 students, this single 12- week interim course included didactic content from all required integrated blocks and the creation of a new content which taught public health principles in the context of historical pandemics. Phase 3 students were rescheduled into online electives, which course directors had offered in the past and agreed to offer again during this time. All Phase 3 students participated in a Public Health Preparedness course after its rapid redesign for online delivery and scaling for an entire class. Phase 2 students returned in July 2020 to abbreviated 8-week integrated blocks that retained approximately 83% of the clinical time students would have received in the intended 12-week integrated blocks. This was possible through the frontloading of teaching sessions to the interim course and creative scheduling of clinical experiences. The 2015 curricular redesign to the integrated curriculum facilitated effective coordination and teamwork that enabled these thoughtful, rapid adjustments to the curriculum.

Evaluation and Improvement of Intern Progress Note Assessments and Plans.

OBJECTIVES: Progress notes communicate providers' assessments of patients' diagnoses, progress, and treatment plans; however, providers perceive that note quality has degraded since the introduction of electronic health records. In this study, we aimed to (1) develop a tool to evaluate progress note assessments and plans with high interrater reliability and (2) assess whether a bundled intervention was associated with improved intern note quality without delaying note file time. METHODS: An 8-member stakeholder team developed a 19-item progress note assessment and plan evaluation (PNAPE) tool and bundled intervention consisting of a new note template and intern training curriculum. Interrater reliability was evaluated by calculating the intraclass correlation coefficient. Blinded assessors then used PNAPE to evaluate assessment and plan quality in pre- and postintervention notes (fall 2017 and 2018). RESULTS: PNAPE revealed high internal interrater reliability between assessors (intraclass correlation coefficient = 0.86; 95% confidence interval: 0.66-0.95). Total median PNAPE score increased from 13 (interquartile range [IQR]: 12-15) to 15 (IQR: 14-17; P = .008), and median file time decreased from 4:30 pm (IQR: 2:33 pm-6:20 pm) to 1:13 pm (IQR: 12:05 pm-3:59 pm; P < .001) in pre- and postintervention notes. In the postintervention period, a higher proportion of assessments and plans indicated the primary problem requiring ongoing hospitalization and progress of this problem (P = .0016 and P < .001, respectively). CONCLUSIONS: The PNAPE tool revealed high reliability between assessors, and the bundled intervention may be associated with improved intern note assessment and plan quality without delaying file time. Future studies are needed to evaluate whether these improvements can be sustained throughout residency and reproduced in future intern cohorts and other inpatient settings.

Resident Workshop to Improve Inpatient Documentation Using the Progress Note Assessment and Plan Evaluation (PNAPE) Tool.

Introduction: Physicians enter residency with varied knowledge regarding the purpose of progress notes and proficiency writing them. The objective of this study was to test whether resident knowledge, beliefs, and confidence writing inpatient progress notes improved after a 2.5-hour workshop intervention. Methods: An educational workshop and note assessment tool was constructed by resident and faculty stakeholders based on a review of literature and institutional best practices. The Progress Note Assessment and Plan Evaluation (PNAPE) tool was designed to assess adherence to best practices in the assessment and plan section of progress notes. Thirty-four residents from a midsized pediatric residency program attended the workshop, which consisted of didactics and small-group work evaluating sample notes using the PNAPE tool. Participants completed a four-question online pre- and postworkshop survey to evaluate their knowledge of progress note components and attitudes regarding note importance. Pre-post analysis was performed with Chi-square testing for true/false questions, and Mann-Whitney testing for Likert scale questions and summative scores. Results: A majority of pediatric residents completed the preintervention (n = 26, 76% response rate) and postintervention (n = 23, 68% response rate) surveys. Accurate response rate improved in 15 of 20 of the true/false items, with a statistically significant improvement in five items. Resident perceptions of note importance and confidence in note writing also increased. Discussion: A workshop intervention may effectively educate pediatric residents about progress note best practices. Further studies should assess the impact of the intervention on sustained knowledge and beliefs about progress notes and subsequent note quality.

Feeding during High-Flow Nasal Cannula for Bronchiolitis: Associations with Time to Discharge.

BACKGROUND: High-flow nasal cannula (HFNC) is increasingly used to treat children hospitalized with bronchiolitis; however, the best practices for feeding during HFNC and the impact of feeding on time to discharge and adverse events are unknown. The study objective was to assess whether feeding exposure during HFNC was associated with time to discharge or feeding-related adverse events. METHODS: This retrospective cohort study included inpatients aged 1-24 months receiving HFNC for bronchiolitis at an academic children's hospital from January 1, 2015 to March 1, 2017. Feeding exposures during HFNC were categorized as fed or not fed. Among fed children, we further evaluated mixed (oral and tube) or exclusive oral feeding. The primary outcome was time to discharge after HFNC cessation. Secondary outcomes were aspiration, intubation after HFNC, and seven-day readmission. RESULTS: Of 123 children treated with HFNC, 45 (37 %) were never fed. A total of 78 children (63%) were fed; 50 (41%) were exclusively orally fed and 28 (23 %) had mixed feeding. Median (interquartile range) time to discharge after HFNC was 29.5 hours (23.5-47.9) and 39.8 hours (26.4-61.5) hours in the fed and not fed groups, respectively. In adjusted models, time to discharge was shorter with any feeding (hazard ratio [HR] 2.17; 95% CI: 1.34-3.50) and with exclusive oral feeding (HR 2.13; 95% CI: 1.31-3.45) compared with no feeding. Time to discharge from HFNC initiation was shorter for exclusive oral feeding versus not feeding (propensity weighted HR 1.97 [95% CI: 1.13-3.43]). Adverse events (one intubation, one aspiration pneumonia, one readmission) occurred in both groups. LIMITATIONS: Assessment of feeding exposure did not account for quantity and duration. DISCUSSION: Children fed while receiving HFNC for bronchiolitis may have shorter time to discharge than those not fed. Feeding-related adverse events were rare regardless of the feeding method. Controlled prospective studies addressing residual confounding are needed to justify a change in the current practice.

Earlier Hospital Discharge With Prospectively Designated Discharge Time in the Electronic Health Record.

BACKGROUND AND OBJECTIVES: Hospital discharge requires multidisciplinary coordination. Insufficient coordination impacts patient flow, resource use, and postdischarge outcomes. Our objectives were to (1) implement a prospective, multidisciplinary discharge timing designation in the electronic health record (EHR) and (2) evaluate its association with discharge timing. METHODS: This quality-improvement study evaluated the implementation of confirmed discharge time (CDT), an EHR designation representing specific discharge timing developed jointly by a patient's family and the health care team. CDT was intended to support task management and coordination of multidisciplinary discharge processes and could be entered and viewed by all team members. Four plan-do-study-act improvement phases were studied: (1) baseline, (2) provider education, (3) provider feedback, and (4) EHR modification. Statistical process control charts tracked CDT use and the proportion of discharges before noon. Length of stay was used as a balancing measure. RESULTS: During the study period from April 2013 through March 2017, 20 133 pediatric discharges occurred, with similar demographics observed throughout all phases. Mean CDT use increased from 0% to 62%, with special cause variations being detected after the provider education and EHR modification phases. Over the course of the study, the proportion of discharges before noon increased by 6.2 percentage points, from 19.9% to 26.1%, whereas length of stay decreased from 47 (interquartile range: 25-95) to 43 (interquartile range: 24-88) hours (both P < .001). CONCLUSIONS: The implementation of a prospective, multidisciplinary EHR discharge time designation was associated with more before-noon discharges. Next steps include replicating results in other settings and determining populations that are most responsive to discharge coordination efforts.

Influence of race and socioeconomic status on engagement in pediatric primary care.

OBJECTIVE: To understand the association of race/ethnicity with engagement in pediatric primary care and examine how any racial/ethnic disparities are influenced by socioeconomic status. METHODS: Visit videos and parent surveys were obtained for 405 children who visited for respiratory infections. Family and physician engagement in key visit tasks (relationship building, information exchange, and decision making) were coded. Two parallel regression models adjusting for covariates and clustering by physician were constructed: (1) race/ethnicity only and (2) race/ethnicity with SES (education and income). RESULTS: With and without adjustment for SES, physicians seeing Asian families spoke 24% fewer relationship building utterances, compared to physicians seeing White, non-Latino families (p<0.05). Latino families gathered 24% less information than White, non-Latino families (p<0.05), but accounting for SES mitigates this association. Similarly, African American families were significantly less likely to be actively engaged in decision making (OR=0.32; p<0.05), compared to White, non-Latino families, but adjusting for SES mitigated this association. CONCLUSION: While engagement during pediatric visits differed by the family's race/ethnicity, many of these differences were eliminated by accounting for socioeconomic status. PRACTICE IMPLICATIONS: Effective targeting and evaluation of interventions to reduce health disparities through improving engagement must extend beyond race/ethnicity to consider socioeconomic status more broadly.