Effects of a Gender-Balancing Strategy on Resident Panels in a Primary Care Setting.

BACKGROUND: Patients often prefer gender concordance when choosing a primary care practitioner. In a trainee setting, this may lead to unequal training opportunities for male and female resident physicians. Residency leadership may be interested in ways to promote balance in patient empanelment. OBJECTIVE: To assess the efficacy of an intervention to equalize imbalance in patient gender on resident primary care panels. DESIGN: Observational cohort study. PARTICIPANTS: Categorial internal medicine residents beginning residency in 2020. INTERVENTIONS: The panels of internal medicine residents were manually rebalanced at the beginning of training for a new cohort of residents with the goal of having similar numbers of male and female patients on each resident's panel. MAIN MEASURES: Panel data was observed for 2 years following intervention. Number of male patients, number of female patients, and overall panel size were compared between male and female residents at baseline, 6 months, and 24 months. KEY RESULTS: The analysis included 28 female residents and 20 male residents. After rebalancing, baseline panels had similar numbers of male patients (median of 50 on both male and female residents' panels; average panel 54.7% male) and female patients (median of 41.5 on female residents' panels and 41 on male residents' panels; average panel 45.3% female). At the end of the follow-up period, a significant difference was observed in the median number of male patients (59.5 and 43.5; p < 0.001) and female patients (33.5 and 48.5; p < 0.001) between male and female residents, but no difference was observed in overall panel size. CONCLUSIONS: A steady drift towards gender concordance was observed over 2 years following a rebalancing intervention. Program leadership overseeing primary care empanelment for resident physicians may consider periodic rebalancing of panels in addition to other interventions to ensure equal training opportunities and best prepare residents for future practice.

Gender Disparities in Electronic Health Record Usage and Inbasket Burden for Internal Medicine Residents.

BACKGROUND: Studies have demonstrated patients hold different expectations for female physicians compared to male physicians, including higher expectations for patient-centered communication and addressing socioeconomic or emotional needs. Recent evidence indicates this gender disparity extends to the electronic health record (EHR). Similar studies have not been conducted with resident physicians. OBJECTIVE: This study seeks to characterize differences in EHR workload for female resident physicians compared to male resident physicians. DESIGN: This study evaluated 12 months of 156 Mayo Clinic internal medicine residents' inbasket data from July 2020 to June 2021 using Epic's Signal and Physician Efficiency Profile (PEP) data. Excel, BlueSky Statistics, and SAS analytical software were used for analysis. Paired t-tests and analysis of variance were used to compare PEP data by gender and postgraduate year (PGY). "Male" and "female" were used in substitute for "gender" as is precedent in the literature. SUBJECTS: Mayo Clinic internal medicine residents. MAIN MEASURES: Total time spent in EHR per day; time in inbasket and notes per day; time in notes per appointment; number of patient advice requests made through the portal; message turnaround time. KEY RESULTS: Female residents received more patient advice requests per year (p = 0.004) with an average of 86.7 compared to 68, resulting in 34% more patient advice requests per day worked (p < 0.001). Female residents spent more time in inbasket per day (p = 0.002), in notes per day (p < 0.001), and in notes per appointment (p = 0.001). Resident panel comparisons revealed equivocal sizes with significantly more female patients on female (n = 55) vs male (n = 34) resident panels (p < 0.001). There was no difference in message turnaround time, total messages, or number of results received. CONCLUSIONS: Female resident physicians experience significantly more patient-initiated messages and EHR workload despite equivalent number of results and panel size. Gender differences in inbasket burden may disproportionally impact the resident educational experience.

Management of the Electronic Health Record Inbox: Results From a National Survey of Internal Medicine Program Directors.

Background Internal medicine (IM) resident physicians spend a considerable amount of time managing their inbox as part of their longitudinal continuity clinic experience. There are no standardized guidelines for how programs should train, monitor, or supervise residents in this type of patient care. Objective To understand how IM residency programs educate, monitor, and supervise resident electronic health record (EHR) inbox management as part of their longitudinal continuity clinic and determine whether patient safety events have occurred due to EHR inbox-related patient care decisions made by unsupervised resident physicians. Methods In August 2021, 439 program directors at accredited US IM residency programs who were members of the Association of Program Directors in Internal Medicine (APDIM) were asked 12 questions developed by the study authors and APDIM survey committee members regarding resident EHR inbox management as part of the annual APDIM survey. Results Two hundred and sixty-seven (61%) PDs responded. The majority (224 of 267, 84%) of programs provided guidelines for expected message response times; less than half (115, 43%) monitored timeliness metrics. Only half (135; 51%) of programs required faculty supervision of inbox messages for all residents; 28% (76) did not require supervision for any residents. Twenty-one percent of PDs (56) reported awareness of a patient safety event occurring due to an unsupervised resident inbox-related patient care decision. Conclusions Substantial variability exists in how IM residency programs train, monitor, supervise, and provide coverage for resident inbox work. Program directors are aware of patient safety events resulting from unsupervised resident inbox management.

Education curriculum assessment for teaching electrocardiography: Rationale and design for the prospective, international, randomized controlled EDUCATE trial.

BACKGROUND: Electrocardiogram (ECG) interpretation training is a fundamental component of medical education across disciplines. However, the skill of interpreting ECGs is not universal among medical graduates, and numerous barriers and challenges exist in medical training and clinical practice. An evidence-based and widely accessible learning solution is needed. DESIGN: The EDUcation Curriculum Assessment for Teaching Electrocardiography (EDUCATE) Trial is a prospective, international, investigator-initiated, open-label, randomized controlled trial designed to determine the efficacy of self-directed and active-learning approaches of a web-based educational platform for improving ECG interpretation proficiency. Target enrollment is 1000 medical professionals from a variety of medical disciplines and training levels. Participants will complete a pre-intervention baseline survey and an ECG interpretation proficiency test. After completion, participants will be randomized into one of four groups in a 1:1:1:1 fashion: (i) an online, question-based learning resource, (ii) an online, lecture-based learning resource, (iii) an online, hybrid question- and lecture-based learning resource, or (iv) a control group with no ECG learning resources. The primary endpoint will be the change in overall ECG interpretation performance according to pre- and post-intervention tests, and it will be measured within and compared between medical professional groups. Secondary endpoints will include changes in ECG interpretation time, self-reported confidence, and interpretation accuracy for specific ECG findings. CONCLUSIONS: The EDUCATE Trial is a pioneering initiative aiming to establish a practical, widely available, evidence-based solution to enhance ECG interpretation proficiency among medical professionals. Through its innovative study design, it tackles the currently unaddressed challenges of ECG interpretation education in the modern era. The trial seeks to pinpoint performance gaps across medical professions, compare the effectiveness of different web-based ECG content delivery methods, and create initial evidence for competency-based standards. If successful, the EDUCATE Trial will represent a significant stride towards data-driven solutions for improving ECG interpretation skills in the medical community.

Dismissal disagreement and discharge delays: Associations of patient-clinician plan of care agreement with discharge outcomes.

BACKGROUND: Many hospitalized patients do not understand or agree with their clinicians about their discharge plan. However, the effect of disagreement on discharge outcomes is unknown. OBJECTIVE: To measure the correlation between patient-clinician care agreement and discharge outcomes. DESIGN: A prospective cohort study was performed from September 2019 to March 2020 (Rochester, MN, USA). SETTING AND PARTICIPANTS: Internal medicine patients and their primary clinician (resident, advanced practice clinician or attending) hospitalized from September 2019-March 2020 at Mayo Clinic Hospital. Participants were independently surveyed following hospital day #3 ward rounds regarding the goals of the hospitalization and discharge planning. MAIN OUTCOME AND MEASURES: Patient-clinician agreement for main diagnosis, patient's main concern, and four domains of discharge planning was assessed. Readiness for hospital discharge, delayed discharge, and 30-day readmission was measured. Then, associations between patient-clinician agreement, delayed discharge, and 30-day readmissions were analyzed using multivariable logistic regression. RESULTS: Of the 436 patients and clinicians, 17.7% completely agreed about what needs to be accomplished before dismissal, 40.8% agreed regarding discharge date, and 71.1% agreed regarding discharge location. In the multivariable model, patient-clinician agreement scores were not significantly correlated with discharge outcomes. Patient-clinician agreement on discharge location was higher for those discharged to home (81.5%) versus skilled nursing facility (48.5%) or assisted living (42.9%) (p < .0001). The agreement on the expected length of stay was highest for home-goers (45.9%) compared to skilled nursing (32.0%) or assisted living (21.4%) (p = .004). CONCLUSIONS: Patients and their clinicians frequently disagree about when and where a patient will go after hospitalization, particularly for those discharged to a skilled nursing facility. While disagreement did not predict discharge outcomes, our findings suggest opportunities to improve effective communication and promote shared mental models regarding discharge earlier in the hospital stay.

Physician Identification Badges: A Multispecialty Quality Improvement Study to Address Professional Misidentification and Bias.

OBJECTIVE: To evaluate whether providing resident physicians with "DOCTOR" role identification badges would impact perceptions of bias in the workforce and alter misidentification rates. PARTICIPANTS AND METHODS: Between October 2019 and December 2019, we surveyed 341 resident physicians in the anesthesiology, dermatology, internal medicine, neurologic surgery, otorhinolaryngology, and urology departments at Mayo Clinic in Rochester, Minnesota, before and after an 8-week intervention of providing "DOCTOR" role identification badges. Differences between paired preintervention and postintervention survey answers were measured, with a focus on the frequency of experiencing perceived bias and role misidentification (significance level, α=.01). Free-text comments were also compared. RESULTS: Of the 159 residents who returned both the before and after surveys (survey response rate, 46.6% [159 of 341]), 128 (80.5%) wore the "DOCTOR" badge. After the intervention, residents who wore the badges were statistically significantly less likely to report role misidentification at least once a week from patients, nonphysician team members, and other physicians (50.8% [65] preintervention vs 10.2% [13] postintervention; 35.9% [46] vs 8.6% [11]; 18.0% [23] vs 3.9% [5], respectively; all P<.001). The 66 female residents reported statistically significantly fewer episodes of gender bias (65.2% [43] vs 31.8% [21]; P<.001). The 13 residents who identified as underrepresented in medicine reported statistically significantly less misidentification from patients (84.6% [11] vs 23.1% [3]; P=.008); although not a statistically significant difference, the 13 residents identifying as underrepresented in medicine also reported less misidentification with nonphysician team members (46.2% [6] vs 15.4% [2]; P=.13). CONCLUSION: Residents reported decreased role misidentification after use of a role identification badge, most prominently improved among women. Decreasing workplace bias is essential in efforts to improve both diversity and inclusion efforts in training programs.

Effect of Resident Gender and Surname Origin on Clinical Load: Observational Cohort Study in an Internal Medicine Continuity Clinic.

BACKGROUND: Studies show patients may have gender or racial preferences for physicians. OBJECTIVE: To determine the degree to which physicians' gender and name characteristics influenced physician clinical load in medical practice, including patient panel size and percent of slots filled. DESIGN: Observational cohort study of a continuity clinic site in Rochester, MN, from July 1, 2015 to June 30, 2017 ("historical" period) and July 1, 2018 to January 30, 2020 ("contemporary" period). PARTICIPANTS: Internal medicine resident physicians. MAIN MEASURES: Resident gender, name, and race came from residency management system data. Panel size, percent of appointment slots filled ("slot fill"), panel percent female, and panel percent non-White came from the electronic health record. Multivariable linear regression models calculated beta estimates with 95% confidence intervals and R2 for the impact of physician gender, surname origin, name character length, and name consonant-to-vowel ratio on each outcome, adjusting for race and year of residency. KEY RESULTS: Of the 307 internal medicine residents, 122 (40%) were female and 197 (64%) were White. Their patient panels were 51% female (SD 16) and 74% White (SD 6). Female gender was associated with a 5.3 (95% CI 2.7-7.9) patient increase in panel size and a 1.5% (95% CI -0.6 to 3.7) increase in slot fill. European, non-Hispanic surname was associated with a 5.3 (95% CI 2.6-7.9) patient increase in panel size and a 4.3 percent (95% CI 2.1-6.4) increase in slot fill. Race and other name characteristics were not associated with physician clinical load. From the historical to contemporary period, the influence of name characteristics decreased from 9 to 4% for panel size and from 15 to 5% for slot fill. CONCLUSIONS: Female gender and European, non-Hispanic surname origin are associated with increased physician clinical load-even more than race. While these disparities may have serious consequences, they are also addressable.

How do we assess resilience and grit among internal medicine residents at the Mayo Clinic? A longitudinal validity study including correlations with medical knowledge, professionalism and clinical performance.

BACKGROUND: There has been limited research on the positive aspects of physician wellness and to our knowledge there have been no validity studies on measures of resilience and grit among internal medicine (IM) residents. OBJECTIVES: To investigate the validity of resilience (10 items Connor-Davidson Resilience Scale (CD-RISC 10)) and grit (Short Grit Scale (GRIT-S)) scores among IM residents at a large academic centre, and assess potential associations with previously validated measures of medical knowledge, clinical performance and professionalism. METHODS: We evaluated CD-RISC 10 and GRIT-S instrument scores among IM residents at the Mayo Clinic Rochester, Minnesota between July 2017 and June 2019. We analysed dimensionality, internal consistency reliability and criterion validity in terms of relationships between resilience and grit, with standardised measures of residents' medical knowledge (in-training examination (ITE)), clinical performance (faculty and peer evaluations and Mini-Clinical Evaluation Examination (mini-CEX)) and professionalism/dutifulness (conference attendance and evaluation completion). RESULTS: A total of 213 out of 253 (84.2%) survey-eligible IM residents provided both CD-RISC 10 and GRIT-S survey responses. Internal consistency reliability (Cronbach alpha) was excellent for CD-RISC 10 (0.93) and GRIT-S (0.82) overall, and for the GRIT subscales of consistency of interest (0.84) and perseverance of effort (0.71). CD-RISC 10 scores were negatively associated with ITE percentile (ß=-3.4, 95% CI -6.2 to -0.5, p=0.02) and mini-CEX (ß=-0.2, 95% CI -0.5 to -0.02, p=0.03). GRIT-S scores were positively associated with evaluation completion percentage (ß=2.51, 95% CI 0.35 to 4.67, p=0.02) and conference attendance (ß=2.70, 95% CI 0.11 to 5.29, p=0.04). CONCLUSIONS: This study revealed favourable validity evidence for CD-RISC 10 and GRIT-S among IM residents. Residents demonstrated resilience within a competitive training environment despite less favourable test performance and grittiness that was manifested by completing tasks. This initial validity study provides a foundation for further research on resilience and grit among physicians in training.

Does Increased Schedule Flexibility Lead to Change? A National Survey of Program Directors on 2017 Work Hours Requirements.

BACKGROUND: The learning and working environment for resident physicians shifted dramatically over the past two decades, with increased focus on work hours, resident wellness, and patient safety. Following two multi-center randomized trials comparing 16-h work limits for PGY-1 trainees to more flexible rules, the ACGME implemented new flexible work hours standards in 2017. OBJECTIVE: We sought to determine program directors' (PDs) support for the work hour changes and programmatic response. DESIGN: In 2017, US Internal Medicine PDs were surveyed about their degree of support for extension of PGY-1 work hour limits, whether they adopted the new maximum continuous work hours permitted, and reasons for their decisions. KEY RESULTS: The response rate was 70% (266/379). Fifty-seven percent of PDs (n = 151) somewhat/strongly support the new work hour rules for PGY-1 residents, while only 25% of programs (N = 66) introduced work periods greater than 16-h on any rotation. Higher rates of adopting change were seen in PDs who strongly/somewhat supported the change (56/151 [37%], P < 0.001), had tenure of 6+ years (33/93 [35%], P = 0.005), were of non-general internal medicine subspecialty (30/80 [38%], P = 0.003), at university-based programs (35/101 [35%], P = 0.009), and with increasing number of approved positions (< 38, 10/63 [16%]; 38-58, 13/69 [19%]; 59-100, 15/64 [23%]; > 100, 28/68 [41%], P = 0.005). Areas with the greatest influence for PDs not extending work hours were the 16-h rule working well (56%) and risk to PGY1 well-being (47%). CONCLUSIONS: Although the majority of PDs support the ACGME 2017 work hours rules, only 25% of programs made immediate changes to extend hours. These data reveal that complex, often competing, forces influence PDs' decisions to change trainee schedules.

Assessment of Training in Health Disparities in US Internal Medicine Residency Programs.

Importance: Health disparities continue to exist despite the call to increase education of health care practitioners. An assessment of health disparities education has not been previously studied in a national cohort. Objective: To describe and compare the curriculum on health disparities from the perspective of program directors and perceptions of training among internal medicine residents. Design, Setting, and Participants: This cross-sectional survey study used a survey of US internal medicine program directors, the 2015 Association of Program Directors in Internal Medicine annual survey, which included questions about health disparities curriculum, and a 1-time survey of US internal medicine residents that asked questions related to their training in health disparities on the American College of Physicians 2015 Internal Medicine In-Training Examination. All internal medicine program directors who were members of Association of Program Directors in Internal Medicine (368 of 396 accredited programs), and internal medicine residents who took the Internal Medicine In-Training Examination were eligible. Final analysis of the merged data set was completed in 2018. Exposures: Questions were included on the annual Association of Program Directors in Internal Medicine survey and the Internal Medicine In-Training Examination. Main Outcomes and Measures: Program directors reported on presence of health disparities curriculum, educational methods, quality, barriers and challenges to curriculum, and Clinical Learning Environment Review. Residents reported whether they received training and quality of the training in health disparities. Results: A total of 227 program directors (response rate, 61.7%) and 22 723 residents (response rate, 87.2%) responded to the surveys. A total of 90 program directors (39.6%) reported a curriculum in health disparities, but among these, only 16 program directors (17.8%) felt quality of their education was very good or excellent. In more than half of the programs (52 programs [55.9%]), outcomes of the curriculum were not measured. After merging, the combined data set included 18 883 residents from 366 APDIM member programs with 225 program director responses. Among these, 13 251 residents (70.2%) reported some training in caring for patients at risk for health disparities. Of residents who reported receiving training, 10 494 (79.2%) rated the quality as very good or excellent. Conclusions and Relevance: These findings suggest that that despite the Clinical Learning Environment Review mandate and Accreditation Council for Graduate Medical Education required competencies for training in health disparities, relatively few internal medicine programs in the US provided educational curriculum. Additionally, the existence of health disparities curricula in internal medicine training programs was not associated with resident's perception of training or its quality.

Characteristics of internal medicine residents who successfully match into cardiology fellowships.

BACKGROUND: The unique traits of residents who matriculate into subspecialty fellowships are poorly understood. We sought to identify characteristics of internal medicine (IM) residents who match into cardiovascular (CV) fellowships. METHODS: We conducted a retrospective cohort study of 8 classes of IM residents who matriculated into residency from 2007 to 2014. The primary outcome was successful match to a CV fellowship within 1 year of completing IM residency. Independent variables included residents' licensing exam scores, research publications, medical school reputation, Alpha Omega Alpha (AOA) membership, declaration of intent to pursue CV in the residency application personal statement, clinical evaluation scores, mini-clinical evaluation exercise scores, in-training examination (ITE) performance, and exposure to CV during residency. RESULTS: Of the 339 included residents (59% male; mean age 27) from 120 medical schools, 73 (22%) matched to CV fellowship. At the time of residency application, 104 (31%) had ≥1 publication, 38 (11%) declared intention to pursue CV in their residency application personal statement, and 104 (31%) were members of AOA. Prior to fellowship application, 111 (33%) completed a CV elective rotation. At the completion of residency training, 108 (32%) had ≥3 publications. In an adjusted logistic regression analysis, declaration of intention to pursue CV (OR 6.4, 99% CI 1.7-23.4; p < 0.001), completion of a CV elective (OR 7.3, 99% CI 2.8-19.0; p < 0.001), score on the CV portion of the PGY-2 ITE (OR 1.05, 99% CI 1.02-1.08; p < 0.001), and publication of ≥3 manuscripts (OR 4.7, 99% CI 1.1-20.5; p = 0.007) were positively associated with matching to a CV fellowship. Overall PGY-2 ITE score was negatively associated (OR 0.93, 99% CI 0.90-0.97; p < 0.001) with matching to a CV fellowship. CONCLUSIONS: Residents' matriculation into CV fellowships was associated with declaration of CV career intent, completion of a CV elective rotation, CV medical knowledge, and research publications during residency. These findings may be useful when advising residents about pursuing careers in CV. They may also help residents understand factors associated with a successful match to a CV fellowship. The negative association between matching into CV fellowship and overall ITE score may indicate excessive subspecialty focus during IM residency.

Characteristics of Effective Teachers of Invasive Bedside Procedures: A Multi-institutional Qualitative Study.

BACKGROUND: Faculty supervision of invasive bedside procedures (IBPs) in the ICU may enhance procedural education and ensure patient safety. However, there is limited research on teaching effectiveness in the ICU, and there are no best teaching practices regarding the supervision of IBPs. RESEARCH QUESTION: We conducted a multi-institutional qualitative study of pulmonary and critical care medicine faculty and fellows to better understand characteristics of effective IBP teachers. STUDY DESIGN AND METHODS: Separate focus groups (FGs) were conducted with fellows and faculty at four large academic institutions that were geographically distributed across the United States. FGs were facilitated by a trained investigator, audio-recorded, and transcribed verbatim for analysis. Themes were identified inductively and compared with constructs from social and situated learning theories. Data were analyzed between and across professional groups. Qualitative research software (NVivo; QSR International) was used to facilitate data organization and create an audit trail of the analysis. A multidisciplinary research team was engaged to minimize interpretive bias. RESULTS: Thirty-three faculty and 30 fellows participated. Inductive analysis revealed three categories of themes among successful IBP teachers: traits, behaviors, and context. Traits included calm demeanor, trust, procedural competence, and effective communication. Behaviors included leading preprocedure huddles to assess learners' experiences and define expectations; debriefing to provide feedback; and allowing appropriate autonomy. Context included learning climate, levels of distraction, patient acuity, and institutional culture. INTERPRETATION: We identified specific traits and behaviors of effective IBP teachers that intersect with the practice environment, which highlights the challenge of teaching IBPs. Notably, FG participants emphasized interpersonal, more than technical, aspects of successful IBP teachers. These findings should inform future curricula on teaching IBPs in the ICU, standardize IBP teaching for pulmonary and critical care medicine fellows, and reduce patient injury from procedural complications.

Characteristics and quality of rotation-specific resident learning goals: a prospective study.

Background: Residents are expected to develop the skills to set learning goals. Setting learning goals is part of self-regulated learning, setting the foundation for creating a learning plan, deploying learning strategies, and assessing their progress to those goals. While effective goal setting is essential to resident self-regulated learning, residents struggle with setting learning goals and desire faculty assistance with goal setting.Objective: We aimed to characterize the topics and quality of residents' rotation-specific learning goals.Design: We conducted a prospective study of 153 internal medicine residents, assessing 455 learning goals for general medicine inpatient rotations. We coded learning goal themes, competencies, and learning domains, and assessed quality using the validated Learning Goal Scoring Rubric. We compared topic categories, competencies, learning domains, and quality between the first and second months of postgraduate (PGY)-1 residents and between PGY-1 and PGY-3 residents. We assessed factors associated with learning goal completion.Results: The overall response rate was 80%. The top three learning goal categories were patient management, specific diseases related to general medicine, and teaching skills. There were no changes in learning goal characteristics between PGY-1 months (p ≥ 0.04). There were differences between PGY-1 and PGY-3 residents' learning goals in patient management (28% vs 6%; p < .001), specific disease conditions (19% vs 3%; p < .001), and teaching skills (2% vs 56%; p < .001). There was no difference in learning goal quality between PGY-1 months (1.63 vs. 1.67; p = 0.82). The PGY-3 learning goals were of higher quality than PGY-1 learning goals for the 'specific goal' item (1.38 vs. 0.98, p = 0.005), but not for other items or overall (all p ≥ 0.02). Residents reported 85% (297/347) learning goal completion.Conclusions: Resident rotation-specific learning goals reflect a broad array of topics. Residents' learning goal quality was low and residents may benefit from guidance to support residents' learning goals.

Internal Medicine Resident Professionalism Assessments: Exploring the Association With Patients' Overall Satisfaction With Their Hospital Stay.

PURPOSE: Successful training of internal medicine (IM) residents requires accurate assessments. Patients could assess IM residents in a hospital setting, but medical educators must understand how contextual factors may affect assessments. The objective was to investigate relationships between patient, resident, and hospital-encounter characteristics and the results of patient assessments of IM resident professionalism. METHOD: The authors performed a prospective cohort study of postgraduate year 1 (PGY-1) IM residents and their patients at 4 general medicine inpatient teaching services at Mayo Clinic Hospital-Rochester, Saint Marys Campus in Rochester, Minnesota, from July 1, 2015, through June 30, 2016. Patient assessments of resident professionalism were adapted from validated instruments. Multivariable modeling with generalized estimating equations was used to determine associations between patient assessment scores and characteristics of residents, residents' clinical performance and evaluations (including professionalism assessments in other settings), patients, and hospital encounters and to account for repeated assessments of residents. RESULTS: A total of 409 patients assessed 72 PGY-1 residents (mean [SD], 5.7 [3.0] patient assessments per resident). In the multivariable model, only the highest rating out of 5 levels for overall satisfaction with hospital stay was significantly associated with patient assessment scores of resident professionalism (ß [SE], 0.80 [0.08]; P < .001). Hospitalized patients' assessment scores of resident professionalism were not significantly correlated with assessment scores of resident professionalism in other clinical settings. CONCLUSIONS: Hospitalized patients' assessment scores of in-hospital resident professionalism were strongly correlated with overall patient satisfaction with hospital stay but were not correlated with resident professionalism in other settings. The limitations of patient evaluations should be considered before incorporating these evaluations into programs of assessment.

Relationship Between Institutional Investment in High-Value Care (HVC) Performance Improvement and Internal Medicine Residents' Perceptions of HVC Training.

PURPOSE: To measure the association between institutional investment in high-value care (HVC) performance improvement and resident HVC experiences. METHOD: The authors analyzed data from two 2014 surveys assessing institutions' investments in HVC performance improvement as reported by program directors (PDs) and residents' perceptions of the frequency of HVC teaching, participation in HVC-focused quality improvement (QI), and views on HVC topics. The authors measured the association between institutional investment and resident-reported experiences using logistic regression, controlling for program and resident characteristics. RESULTS: The sample included 214 programs and 9,854 residents (59.3% of 361 programs, 55.2% of 17,851 residents surveyed). Most PDs (158/209; 75.6%) reported some support. Residents were more likely to report HVC discussions with faculty at least a few times weekly if they trained in programs that offered HVC-focused faculty development (odds ratio [OR] = 1.19; 95% confidence interval [CI] 1.04-1.37; P = .01), that supported such faculty development (OR = 1.21; 95% CI 1.04-1.41; P = .02), or that provided physician cost-of-care performance data (OR = 1.19; 95% CI 1.03-1.39; P = .02). Residents were more likely to report participation in HVC QI if they trained in programs with a formal HVC curriculum (OR = 1.83; 95% CI 1.48-2.27; P < .001) or with HVC-focused faculty development (OR = 1.46; 95% CI 1.15-1.85; P = .002). CONCLUSIONS: Institutional investment in HVC-related faculty development and physician feedback on costs of care may increase the frequency of HVC teaching and resident participation in HVC-related QI.

Immunization education for internal medicine residents: A cluster-randomized controlled trial.

PURPOSE: The aims of this study are to evaluate the impact of a novel immunization curriculum based on the Preferred Cognitive Styles and Decision Making Model (PCSDM) on internal medicine (IM) resident continuity clinic patient panel immunization rates, as well as resident immunization knowledge, attitudes, and practices (KAP). METHODS: A cluster-randomized controlled trial was performed among 143 IM residents at Mayo Clinic to evaluate the PCSDM curriculum plus fact-based immunization curriculum (intervention) compared to fact-based immunization curriculum alone (control) on the outcomes of resident continuity clinic patient panel immunization rates for influenza, pneumococcal, tetanus, pertussis, and zoster vaccines. Pre-study and post-study immunization KAP surveys were administered to IM residents. RESULTS: Ninety-nine residents participated in the study. Eighty-two residents completed pre-study and post-study surveys. Influenza and pertussis immunization rates improved for both intervention and control groups. There was no significant difference in immunization rate improvement between the groups. Influenza immunization rates improved significantly by 33.4% and 32.3% in the intervention and control groups, respectively. The odds of receiving influenza immunization at the end of the study relative to pre-study for the entire study cohort was 4.6 (p < 0.0001). The odds of having received pertussis immunization at the end of the study relative to pre-study for the entire study cohort was 1.2 (p = 0.0002). Both groups had significant improvements in immunization knowledge. The intervention group had significant improvements in multiple domains that assessed confidence in counseling patients on immunizations. CONCLUSIONS: Fact-based immunization education was useful in improving IM resident immunization rates for influenza and pertussis. The PCSDM immunization curriculum did not lead to increases in immunization rates compared with the fact-based curriculum, but it did significantly increase resident confidence in communicating with patients about vaccines.

US Internal Medicine Program Director Perceptions of Alignment of Graduate Medical Education and Institutional Resources for Engaging Residents in Quality and Safety.

Alignment between institutions and graduate medical education (GME) regarding quality and safety initiatives (QI) has not been measured. The objective was to determine US internal medicine residency program directors' (IM PDs) perceived resourcing for QI and alignment between GME and their institutions. A national survey of IM PDs was conducted in the Fall of 2013. Multivariable linear regression was used to test association between a novel Integration Score (IS) measuring alignment between GME and the institution via PD perceptions. The response rate was 72.6% (265/365). According to PDs, residents were highly engaged in QI (82%), but adequate funding (14%) and support personnel (37% to 61%) were lower. Higher IS correlated to reports of funding for QI (76.3% vs 54.5%, P = .012), QI personnel (67.3% vs 41.1%, P < .001), research experts (70.5% vs 50.0%, P < .001), and computer experts (69.0% vs 45.8%, P < .001) for QI assistance. Apparent mismatch between GME and institutional resources exists, and the IS may be useful in measuring GME-institutional leadership alignment in QI.

Flipped Classrooms in Graduate Medical Education: A National Survey of Residency Program Directors.

PURPOSE: To begin to quantify and understand the use of the flipped classroom (FC)-a progressive, effective, curricular model-in internal medicine (IM) education in relation to residency program and program director (PD) characteristics. METHOD: The authors conducted a survey that included the Flipped Classroom Perception Instrument (FCPI) in 2015 regarding programs' use and PDs' perceptions of the FC model. RESULTS: Among the 368 IM residency programs, PDs at 227 (61.7%) responded to the survey and 206 (56.0%) completed the FCPI. Regarding how often programs used the FC model, 34 of the 206 PDs (16.5%) reported "never"; 44 (21.4%) reported "very rarely"; another 44 (21.4%) reported "somewhat rarely"; 59 (28.6%) reported "sometimes"; 16 (7.8%) reported "somewhat often"; and 9 (4.4%) reported "very often." The mean FCPI score (standard deviation [SD]) for the in-class application factor (4.11 [0.68]) was higher (i.e., more favorable) than for the preclass activity factor (3.94 [0.65]) (P < .001). FC perceptions (mean [SD]) were higher among younger PDs (≤ 50 years, 4.12 [0.62]; > 50 years, 3.94 [0.61]; P = .04) and women compared with men (4.28 [0.56] vs. 3.91 [0.62]; P < .001). PDs with better perceptions of FCs had higher odds of using FCs (odds ratio, 4.768; P < .001). CONCLUSIONS: Most IM programs use the FC model at least to some extent, and PDs prefer the interactive in-class components over the independent preclass activities. PDs who are women and younger perceived the model more favorably.