Evidence for validity of the epidemic-pandemic impacts inventory (brief healthcare module): Internal structure and association with other variables.

The COVID-19 pandemic has subjected healthcare workers to enormous stress. Measuring the impact of this public health emergency is essential to developing strategies that can effectively promote resilience and wellness. The Epidemic-Pandemic Impacts Inventory Supplemental Healthcare Module-Brief Version (EPII-SHMb) was developed to measure impacts among occupational cohorts serving on the front lines of healthcare. While this instrument has been utilized in COVID-19 related studies, little is known about its psychometric properties. This study collects evidence for validity of the EPII-SHMb by evaluating its internal structure and how its scores associate with other variables. Physicians and nursing staff across a large New York health system were cross-sectionally surveyed using an online questionnaire between June and November 2020. Exploratory factor analysis resulted in a 3-factor solution, identifying factors Lack of Workplace Safety (7 items), Death/Dying of Patients (3 items), and Lack of Outside Support (2 items). Internal consistency was high overall and within physician/nursing and gender subgroups (Cronbach's alpha: 0.70 - 0.81). Median scores on Death/Dying of Patients were higher among those who directly cared for COVID-19 patients or worked in COVID-19 hospital units. These results are promising. Additional studies evaluating other dimensions of validity are necessary.

Optimizing allocation of curricular content across the Undergraduate & Graduate Medical Education Continuum.

BACKGROUND: Medical educators struggle to incorporate socio-cultural topics into crowded curricula. The "continuum of learning" includes undergraduate and graduate medical education. Utilizing an exemplar socio-cultural topic, we studied the feasibility of achieving expert consensus among two groups of faculty (experts in medical education and experts in social determinants of health) on which aspects of the topic could be taught during undergraduate versus graduate medical education. METHODS: A modified Delphi method was used to generate expert consensus on which learning objectives of social determinants of health are best taught at each stage of medical education. Delphi respondents included experts in medical education or social determinants of health. A survey was created using nationally published criteria for social determinants of health learning objectives. Respondents were asked 1) which learning objectives were necessary for every physician (irrespective of specialty) to develop competence upon completion of medical training and 2) when the learning objective should be taught. Respondents were also asked an open-ended question on how they made the determination of when in the medical education continuum the learning objective should be taught. RESULTS: 26 out of 55 experts (13 social determinants of health and 13 education experts) responded to all 3 Delphi rounds. Experts evaluated a total of 49 learning objectives and were able to achieve consensus for at least one of the two research questions for 45 of 49 (92%) learning objectives. 50% more learning objectives reached consensus for inclusion in undergraduate (n = 21) versus graduate medical education (n = 14). CONCLUSIONS: A modified Delphi technique demonstrated that experts could identify key learning objectives of social determinants of health needed by all physicians and allocate content along the undergraduate and graduate medical education continuum. This approach could serve as a model for similar socio-cultural content. Future work should employ a qualitative approach to capture principles utilized by experts when making these decisions.

The Impact of Physicians' COVID-19 Pandemic Occupational Experiences on Mental Health.

OBJECTIVE: To examine the association between a number of negative COVID-19 occupational experiences and probable anxiety, depression, and PTSD among physicians. METHODS: Cross-sectional examination of longitudinal registry data consisting of physician personal and occupational well-being. Multivariable logistic regressions were performed to determine the association between negative COVID-19 experiences and outcomes. RESULTS: Of the 620 eligible physicians, approximately half were female (49%), and 71% white with a mean age of 46.51 (SD = 13.28). A one-point increase in negative experience score was associated with a 23% increase in probable anxiety (OR = 1.23, 95% CI: 1.14-1.34), a 23% increase in probable depression (OR = 1.23, 95% CI: 1.13-1.33), and a 41% increase in probable PTSD (OR = 1.41, 95% CI: 1.30-1.52). CONCLUSIONS: Negative pandemic experiences were strongly associated with adverse mental health outcomes while greater resilience was protective.

Evaluating burnout during the COVID-19 pandemic among physicians in a large health system in New York.

PURPOSE: The COVID-19 pandemic has generated significant psychological distress among health care workers worldwide. New York State, particularly New York City and surrounding counties, were especially affected, and experienced over 430,000 COVID-19 cases and 25,000 deaths by mid-August 2020. We hypothesized that physicians and trainees (residents/fellows) who were redeployed outside of their specialty to treat COVID-19 inpatients would have higher burnout. METHODS: We conducted a cross-sectional survey to assess burnout among attending and trainee physicians who provided patient care during the COVID-19 pandemic between March-May 2020 across a diverse health care system in New York. Separate multivariable logistic regressions were performed to determine the association between redeployment and measures of burnout: Emotional Exhaustion (EE) and Depersonalization. Burnout measures were also compared by physician vs trainee status. The differential association between redeployment and outcomes with respect to trainee status was also evaluated. RESULTS: Redeployment was significantly associated with increased odds of EE {OR =1.53, 95% CI: 1.01-2.31} after adjusting for gender and Epidemic-Pandemic Impacts Inventory (EPII) score. Similarly, being a trainee, especially a junior level trainee, was associated with increased odds of EE {OR = 1.59, 95% CI: 1.01-2.51} after adjusting for gender and EPII scores. However, neither redeployment nor trainee status were significantly associated with Depersonalization. Interactions between redeployment and trainee status were not significant for any of the outcomes (p>.05). CONCLUSION: Physicians who were redeployed to treat COVID-19 patients had higher reported measures of EE. Trainees, irrespective of redeployment status, had higher EE as compared with attendings. Additional research is needed to understand the long-term impact of redeployment on burnout among redeployed physicians. Programs to identify and address potential burnout among physicians, particularly trainees, during pandemics may be beneficial.

Toward the Quadruple Aim: Impact of a Humanistic Mentoring Program to Reduce Burnout and Foster Resilience.

OBJECTIVE: To assess the effect of a faculty development program (Mentoring and Professionalism in Training [MAP-IT]) that fosters humanism in medicine on elements of burnout and the development of resilience. PARTICIPANTS AND METHODS: The cohort of participants was drawn from a cross-section of disciplines and represented a diverse group of health professionals, including physicians, nurses, physician assistants, pharmacists, psychologists, social workers, and chaplains. The 106 participants were divided into 12 groups, each of which was facilitated by two or three leaders. Each group completed the MAP-IT curriculum from October 1, 2017, through July 31, 2018. All participants and leaders completed the Connor-Davidson Resilience Scale and the Maslach Burnout Inventory (assessing emotional exhaustion, depersonalization, and personal accomplishment) before and after completion of the program. RESULTS: The participants' scores for emotional exhaustion and depersonalization remained unchanged following the completion of the MAP-IT curriculum. However, their scores for personal accomplishment and resilience increased significantly and approximated those of the leaders. CONCLUSION: The MAP-IT program has shown effectiveness both in fostering resilience and a sense of personal accomplishment. The time is ripe for institutional programming to create and foster the personal tools needed to prevent burnout and its sequelae.

A Faculty Development Graduate Medical Education Retreat to Teach and Address Social Determinants of Health.

BACKGROUND: Social determinants of health (SDH) account for a large percentage of health outcomes. Therefore, ensuring providers can address SDH is paramount yet curricula in this area is limited. AIM: The authors aimed to raise awareness, identify learning opportunities, foster positive attitudes, and equip educators to implement SDH curriculum. SETTING AND PARTICIPANTS: This retreat occurred at a large academic institution and had over 130 participants who represented 56 distinct training programs and over 20 disciplines. PROGRAM DESCRIPTION: The retreat was titled "Social Determinants of Health: Walking in Your Patients' Shoes." The retreat was holistic and used a multidimensional approach that included traditional learning, team-based learning, reflective practice, and prompted action. PROGRAM EVALUATION: The evaluation of this retreat included electronic surveys and both qualitative and quantitative data. The retreat's quality and effectiveness at improving participants' knowledge and skill in addressing SDH was highly rated and resulted in numerous programs, including surgical and subspecialty programs reporting adopting SDH curricular and clinical workflow changes. DISCUSSION: The retreat was successful and reached a wide and diverse set of faculty educators and can serve as an education model to the graduate medical education community on how to start to develop "physician-citizens."

Incoming Interns Perceived Preparedness for Core Entrustable Professional Activities.

INTRODUCTION: The AAMC described 13 core entrustable professional activities (EPAs) for which every graduating medical student should perform proficiently on day 1 of residency. We studied how prepared starting interns felt in the core EPAs. METHODS: Interns from a diverse health system were surveyed on how well medical school prepared them in the 13 core EPAs. Data were collected on type of medical school, participation in an acting/sub-internship (AI/SI), knowledge of EPAs, and participation in an EPA experience. RESULTS: We collected 224 surveys out of 384 (58%) interns. 61.2% attended allopathic, 14.6% attended osteopathic, and 24.2% attended international schools. 67% had not heard of EPAs. 29% had an EPA experience of which 82% were required. 80% or more felt prepared in all EPAs except orders (60.7%) and handovers (73%). Allopathic interns were significantly more likely to have heard of EPAs and participated in an EPA experience than international. Allopathic interns felt more prepared than international in oral presentations and evidence-based medicine. Interns who participated in an EPA experience felt more prepared for oral presentation and evidence-based medicine. There were small but significant differences in feeling prepared in certain EPAs and types of AI/SI taken. CONCLUSION: The majority of interns entering residency have not heard of EPAs with fewer than 1/3 of interns participating in an EPA experience. International graduates were less likely to be aware or have experience with EPAs and report being less prepared in oral presentation and evidence-based medicine compared to allopathic graduates.

Program Director Perceptions of Proficiency in the Core Entrustable Professional Activities.

BACKGROUND: The Association of American Medical Colleges describes 13 core entrustable professional activities (EPAs) that every graduating medical student should be expected to perform proficiently on day 1 of residency, regardless of chosen specialty. Studies have shown wide variability in program director (PD) confidence in interns' abilities to perform these core EPAs. Little is known regarding comparison of United States Medical Licensing Examination (USMLE) scores with proficiency in EPAs. OBJECTIVE: We determined if PDs from a large health system felt confident in their postgraduate year 1 residents' abilities to perform the 13 core EPAs, and compared perceived EPA proficiency with USMLE Step 1 and Step 2 scores. METHODS: The PDs were asked to rate their residents' proficiency in each EPA and to provide residents' USMLE scores. Timing coincided with the reporting period for resident milestones. RESULTS: Surveys were completed on 204 of 328 residents (62%). PDs reported that 69% of residents (140 of 204) were prepared for EPA 4 (orders/prescriptions), 61% (117 of 192) for EPA 7 (form clinical questions), 68% (135 of 198) for EPA 8 (handovers), 63% (116 of 185) for EPA 11 (consent), and 38% (49 of 129) for EPA 13 (patient safety). EPA ratings and USMLE 1 and 2 were negatively correlated (r(101) = -0.23, P = .031). CONCLUSIONS: PDs felt that a significant percentage of residents were not adequately prepared in order writing, forming clinical questions, handoffs, informed consent, and promoting a culture of patient safety. We found no positive association between USMLE scores and EPA ratings.

Using Objective Structured Teaching Encounters (OSTEs) to prepare chief residents to be emotionally intelligent leaders.

BACKGROUND: Chief Residents must lead, manage and mentor a diverse and often large group of residents, however there is a lack of formal leadership training throughout graduate medical education. OBJECTIVE: Development of a 3-part Chief Resident (CR) Program focused on leading, managing and mentoring. DESIGN: Each participant completes an Emotional Intelligence (EI) Inventory prior to the day-long event. Participants receive their EI scores at the beginning of the program, which features interactive sessions on leadership, management, and feedback skills. The program then reinforces the application of their new knowledge about EI through a four station OSTE (Observed Structured Teaching Encounter). CRs practice feedback and coaching skills in a simulated environment where they need to provide the context of formative feedback to a standardized resident. RESULTS: The aggregated mean pre-session EI score for all participants was 76.9 (an ideal score is >85). An independent-samples t-test compared the CRs' leadership and feedback performance on their first and second OSTE performance within a single afternoon session. There was a significant difference between the first OSTE performance (M = 47.92, SD = 7.8) and the second OSTE performance (M = 51.22, SD = 6.9); t (68) = 1.99, p = 0.006. These results suggest that participating in multiple OSTEs positively reinforces the core interpersonal and communication skills discussed in the didactic and practiced in the interactive portions of the program. CONCLUSION: The low mean pre-session EI score achieved by our participants supports the idea that CRs enter their new roles with a level of EI that can be enhanced. CRs had an overall positive reaction to EI and its application to the core skills addressed in the program, highlighting the fact that similar programs could be used to train early career physicians to be more skilled and comfortable with leading, managing and mentoring. ABBREVIATIONS: CR: Chief resident; EI: Emotional intelligence; GME: Graduate medical education; OSTE: Objective structured teaching encounter.

Associations between subspecialty fellowship interest and knowledge of internal medicine: a hypothesis-generating study of internal medicine residents.

BACKGROUND: Little is known about whether and how medical knowledge relates to interest in subspecialty fellowship training. The purpose of this study was to examine the relationships between residents' interest in subspecialty fellowship training and their knowledge of internal medicine (IM). METHODS: A questionnaire was emailed to 48 categorical postgraduate-year (PGY) two and three residents at a New York university-affiliated IM residency program in 2007 using the Survey Monkey online survey instrument. Overall and content area-specific percentile scores from the IM in-training examination (IM-ITE) for the same year was used to determine objective knowledge. RESULTS: Forty-five of 48 residents (response rate was 93.8%) completed the survey. Twenty-two (49%) were PG2 residents and 23(51%) were PGY3 residents. Sixty percent of respondents were male. Six (13%) residents were graduates of U.S. medical schools. Eight (18%) reported formal clinical training prior to starting internal medicine residency in the U.S. Of this latter group, 6 (75%) had training in IM and 6 (75) % reported a training length of 3 years or less. Thirty-seven of 45 (82%) residents had a subspecialty fellowship interest. Residents with a fellowship interest had a greater mean overall objective knowledge percentile score (56.44 vs. 31.67; p = 0.04) as well as greater mean percentile scores in all content areas of IM. The adjusted mean difference was statistically significant (p < 0.02) across three content areas. CONCLUSIONS: More than half of surveyed residents indicated interest in pursuing a subspecialty fellowship. Fellowship interest appears positively associated with general medical knowledge in this study population. Further work is needed to explore motivation and study patterns among internal medicine residents.

Evaluating an end-of-life curriculum in a medical residency program.

The ability to meet patient needs at the end of life is important. Boston University Residency Program in Medicine initiated a 1-week-long end-of-life curriculum that included a hospice care orientation, core articles, and home hospice visits. Evaluated was the impact of the rotation on participant knowledge and attitude. Knowledge was assessed by pretest and posttest questionnaires and compared with more senior resident controls, naïve to the curriculum. Attitudes toward issues relating to end-of-life care and subjective change in knowledge were assessed comparing subjects' retrospective preintervention and postintervention responses included in the postintervention questionnaire. Forty-five second-year participants completed both questionnaires. Participants demonstrated significant improvements in attitude and self-assessed knowledge of end-of-life care in 23 of 24 Likert-type scale questions. The end-of-life curriculum led to significant improvements in participant knowledge and attitudes about the conceptual and practical aspects of end-of-life care. The structure of the rotation should be reproducible in many locales.

Using claims data to examine mortality trends following hospitalization for heart attack in Medicare.

OBJECTIVE: To see if changes in the demographics and illness burden of Medicare patients hospitalized for acute myocardial infarction (AMI) from 1995 through 1999 can explain an observed rise (from 32 percent to 34 percent) in one-year mortality over that period. DATA SOURCES: Utilization data from the Centers for Medicare and Medicaid Services (CMS) fee-for-service claims (MedPAR, Outpatient, and Carrier Standard Analytic Files); patient demographics and date of death from CMS Denominator and Vital Status files. For over 1.5 million AMI discharges in 1995-1999 we retain diagnoses from one year prior, and during, the case-defining admission. STUDY DESIGN: We fit logistic regression models to predict one-year mortality for the 1995 cases and apply them to 1996-1999 files. The CORE model uses age, sex, and original reason for Medicare entitlement to predict mortality. Three other models use the CORE variables plus morbidity indicators from well-known morbidity classification methods (Charlson, DCG, and AHRQ's CCS). Regressions were used as is--without pruning to eliminate clinical or statistical anomalies. Each model references the same diagnoses--those recorded during the pre- and index admission periods. We compare each model's ability to predict mortality and use each to calculate risk-adjusted mortality in 1996-1999. PRINCIPAL FINDINGS: The comprehensive morbidity classifications (DCG and CCS) led to more accurate predictions than the Charlson, which dominated the CORE model (validated C-statistics: 0.81, 0.82, 0.74, and 0.66, respectively). Using the CORE model for risk adjustment reduced, but did not eliminate, the mortality increase. In contrast, adjustment using any of the morbidity models produced essentially flat graphs. CONCLUSIONS: Prediction models based on claims-derived demographics and morbidity profiles can be extremely accurate. While one-year post-AMI mortality in Medicare may not be worsening, outcomes appear not to have continued to improve as they had in the prior decade. Rich morbidity information is available in claims data, especially when longitudinally tracked across multiple settings of care, and is important in setting performance targets and evaluating trends.