A new look at an old well-being construct: evaluating the psychometric properties of 9, 5, and 1-item versions of emotional exhaustion metrics.

Objective: To compare the relative strengths (psychometric and convergent validity) of four emotional exhaustion (EE) measures: 9- and 5-item scales and two 1-item metrics. Patients and methods: This was a national cross-sectional survey study of 1409 US physicians in 2013. Psychometric properties were compared using Cronbach's alpha, Confirmatory Factor Analysis (CFA), Exploratory Factor Analysis (EFA), and Spearman's Correlations. Convergent validity with subjective happiness (SHS), depression (CES-D10), work-life integration (WLI), and intention to leave current position (ITL) was assessed using Spearman's Correlations and Fisher's R-to-Z. Results: The 5-item EE scale correlated highly with the 9-item scale (Spearman's rho = 0.828), demonstrated excellent internal reliability (alpha = 0.87), and relative to the 9-item, exhibited superior CFA model fit (RMSEA = 0.082, CFI = 0.986, TLI = 0.972). The 5-item EE scale correlated as highly as the 9-item scale with SHS, CES-D10, and WLI, and significantly stronger than the 9-item scale to ITL. Both 1-item EE metrics had significantly weaker correlation with SHS, CES-D10, WLI, and ITL (Fisher's R-to-Z; p < 0.05) than the 5- and 9-item EE scales. Conclusion: The 5-item EE scale was repeatedly found equivalent or superior to the 9-item version across analyses, particularly with respect to the CFA results. As there is no cost to using the briefer 5-item EE scale, the burden on respondents is smaller, and widespread access to administering and interpreting an excellent wellbeing metric is enhanced at a critical time in global wellbeing research. The single item EE metrics exhibited lower convergent validity than the 5- and 9-item scales, but are acceptable for detecting a signal of EE when using a validated EE scale is not feasible. Replication of psychometrics and open-access benchmarking results for use of the 5-tem EE scale further enhance access and utility of this metric.

Corrigendum: The language of healthcare worker emotional exhaustion: a linguistic analysis of longitudinal survey.

[This corrects the article DOI: 10.3389/fpsyt.2022.1044378.].

Assessing Leadership Behavior in Health Care: Introducing the Local Leadership Scale of the SCORE Survey.

BACKGROUND: Engaged and accessible leadership is a key component of care excellence. However, the field lacks brief, reliable, and actionable measures of feedback and coaching-related behaviors of local leaders (for example, provides frequent feedback). The current study introduces a five-item Local Leadership (LL) scale by examining its psychometric properties, providing benchmarking across demographic factors and work settings, assessing its association with psychological safety, and testing whether LL predicts reports of restricted activities and absenteeism. METHODS: In this cross-sectional study, 23,853 questionnaires were distributed across 31 Midwestern US hospitals. The survey included the LL scale, as well as safety culture and well-being scales. Psychometric analyses (Cronbach's α, confirmatory factor analysis [CFA] fit: root square mean error of the approximation [RMSEA], comparative fit index [CFI], Tucker-Lewis index [TLI]), Spearman correlations, t-tests, and analyses of variance (ANOVAs) were used to test the properties of the LL scale and differences by health care worker and work setting characteristics. RESULTS: A total of 16,797 surveys were returned (70.4% response rate). The LL scale exhibited strong psychometric properties (Cronbach's α = 0.94; RMSEA = 0.079; CFI = 0.99; TLI = 0.98). LL scores differed by role, shift, shift length, and years in specialty. Of all roles, leaders (for example, managers) rated leaders most favorably. Nonclinical (vs. clinical) and nonsurgical (vs. surgical) work settings reported higher LL. LL scores correlated positively with psychological safety, absenteeism, and activities restricted due to illness. CONCLUSION: The LL scale exhibits strong psychometric properties, convergent validity with psychological safety, and variation by work setting, work setting type, role, shift, shift length, and specialty. The study indicates that assessing leadership behaviors with the LL scale is useful and offers actionable behaviors for leaders to improve safety culture within teams.

Leadership Behavior Associations with Domains of Safety Culture, Engagement, and Health Care Worker Well-Being.

BACKGROUND: Leadership is a key driver of health care worker well-being and engagement, and feedback is an essential leadership behavior. Methods for evaluating interaction norms of local leaders are not well developed. Moreover, associations between local leadership and related domains are poorly understood. This study sought to evaluate health care worker leadership behaviors in relation to burnout, safety culture, and engagement using the Local Leadership scale of the Safety, Communication, Operational Reliability, and Engagement (SCORE) survey. METHODS: The SCORE survey was administered to 31 Midwestern hospitals as part of a broad effort to measure care context, with domains including Local Leadership, Emotional Exhaustion/Burnout, Safety Climate, and Engagement. Mixed-effects hierarchical logistic regression was used to evaluate the relationships between local leadership scores and related domains, adjusted for role and work-setting characteristics. RESULTS: Of the 23,853 distributed surveys, 16,797 (70.4%) were returned. Local leadership scores averaged 68.8 ± 29.1, with 7,338 (44.2%) reporting emotional exhaustion, 9,147 (55.9%) reporting concerning safety climate, 10,974 (68.4%) reporting concerning teamwork climate, 7,857 (47.5%) reporting high workload, and 3,436 (20.7%) reporting intentions to leave. Each 10-point increase in local leadership score was associated with odds ratios of 0.72 (95% confidence interval [CI] 0.71-0.73) for burnout, 0.48 (95% CI 0.47-0.49) for concerning safety climate, 0.64 (95% CI 0.63-0.66) for concerning teamwork climate, 0.90 (95% CI 0.89-0.92) for high workload, and 0.80 (95% CI 0.78-0.81) for intentions to leave, after adjustment for unit and provider characteristics. CONCLUSION: Local leadership behaviors are readily measurable using a five-item scale and strongly associate with established domains of health care worker well-being, safety culture, and engagement.

Teamwork Before and During COVID-19: The Good, the Same, and the Ugly .

OBJECTIVES: The COVID 19 pandemic placed unprecedented strain on healthcare systems and workers, likely also impacting patient safety and outcomes. This study aimed to understand how teamwork climate changed during that pandemic and how these changes affected safety culture and workforce well-being. METHODS: This cross-sectional observational study of 50,000 healthcare workers (HCWs) in 3 large U.S. health systems used scheduled culture survey results at 2 distinct time points: before and during the first year of the COVID 19 pandemic. The SCORE survey measured 9 culture domains: teamwork climate, safety climate, leadership engagement, improvement readiness, emotional exhaustion, emotional exhaustion climate, thriving, recovery, and work-life balance. RESULTS: Response rate before and during the pandemic was 75.45% and 74.79%, respectively. Overall, HCWs reporting favorable teamwork climate declined (45.6%-43.7%, P < 0.0001). At a facility level, 35% of facilities saw teamwork climate decline, while only 4% saw an increase in teamwork climate. Facilities with decreased teamwork climate had associated decreases in every culture domain, while facilities with improved teamwork climate maintained well-being domains and saw improvements in every other culture domain. CONCLUSIONS: Healthcare worker teamwork norms worsened during the COVID-19 pandemic. Teamwork climate trend was closely associated with other safety culture metrics. Speaking up, resolving conflicts, and interdisciplinary coordination of care were especially predictive. Facilities sustaining these behaviors were able to maintain other workplace norms and workforce well-being metrics despite a global health crisis. Proactive team training may provide substantial benefit to team performance and HCW well-being during stressful times.

Emotional Exhaustion Among US Health Care Workers Before and During the COVID-19 Pandemic, 2019-2021.

Importance: Extraordinary strain from COVID-19 has negatively impacted health care worker (HCW) well-being. Objective: To determine whether HCW emotional exhaustion has increased during the pandemic, for which roles, and at what point. Design, Setting, and Participants: This survey study was conducted in 3 waves, with an electronic survey administered in September 2019, September 2020, and September 2021 through January 2022. Participants included hospital-based HCWs in clinical and nonclinical (eg, administrative support) roles at 76 community hospitals within 2 large health care systems in the US. Exposures: Safety, Communication, Organizational Reliability, Physician, and Employee Burnout and Engagement (SCORE) survey domains of emotional exhaustion and emotional exhaustion climate. Main Outcomes and Measures: The percentage of respondents reporting emotional exhaustion (%EE) in themselves and a climate of emotional exhaustion (%EEclim) in their colleagues. Survey items were answered on a 5-point scale from 1 (strongly disagree) to 5 (strongly agree); neutral or higher scores were counted as "percent concerning" for exhaustion. Results: Electronic surveys were returned by 37 187 (of 49 936) HCWs in 2019, 38 460 (of 45 268) in 2020, and 31 475 (of 41 224) in 2021 to 2022 for overall response rates of 74.5%, 85.0%, and 76.4%, respectively. The overall sample comprised 107 122 completed surveys. Nursing was the most frequently reported role (n = 43 918 [40.9%]). A total of 17 786 respondents (16.9%) reported less than 1 year at their facility, 59 226 (56.2%) reported 1 to 10 years, and 28 337 (26.9%) reported 11 years or more. From September 2019 to September 2021 through January 2022, overall %EE increased from 31.8% (95% CI, 30.0%-33.7%) to 40.4% (95% CI, 38.1%-42.8%), with a proportional increase in %EE of 26.9% (95% CI, 22.2%-31.8%). Physicians had a decrease in %EE from 31.8% (95% CI, 29.3%-34.5%) in 2019 to 28.3% (95% CI, 25.9%-31.0%) in 2020 but an increase during the second year of the pandemic to 37.8% (95% CI, 34.7%-41.3%). Nurses had an increase in %EE during the pandemic's first year, from 40.6% (95% CI, 38.4%-42.9%) in 2019 to 46.5% (95% CI, 44.0%-49.1%) in 2020 and increasing again during the second year of the pandemic to 49.2% (95% CI, 46.5%-51.9%). All other roles showed a similar pattern to nurses but at lower levels. Intraclass correlation coefficients revealed clustering of exhaustion within work settings across the 3 years, with coefficients of 0.15 to 0.17 for emotional exhaustion and 0.22 to 0.24 for emotional exhaustion climate, higher than the .10 coefficient typical of organizational climate (a medium effect for shared variance), suggestive of a social contagion effect of HCW exhaustion. Conclusions and Relevance: This large-scale survey study of HCWs spanning 3 years offers substantial evidence that emotional exhaustion trajectories varied by role but have increased overall and among most HCW roles since the onset of the pandemic. These results suggest that current HCW well-being resources and programs may be inadequate and even more difficult to use owing to lower workforce capacity and motivation to initiate and complete well-being interventions.

The Psychological Safety Scale of the Safety, Communication, Operational, Reliability, and Engagement (SCORE) Survey: A Brief, Diagnostic, and Actionable Metric for the Ability to Speak Up in Healthcare Settings.

OBJECTIVES: The current study aimed to guide the assessment and improvement of psychological safety (PS) by (1) examining the psychometric properties of a brief novel PS scale, (2) assessing relationships between PS and other safety culture domains, (3) exploring whether PS differs by healthcare worker demographic factors, and (4) exploring whether PS differs by participation in 2 institutional programs, which encourage PS and speaking-up with patient safety concerns (i.e., Safety WalkRounds and Positive Leadership WalkRounds). METHODS: Of 13,040 eligible healthcare workers across a large academic health system, 10,627 (response rate, 81%) completed the 6-item PS scale, demographics, safety culture scales, and questions on exposure to institutional initiatives. Psychometric analyses, correlations, analyses of variance, and t tests were used to test the properties of the PS scale and how it differs by demographic factors and exposure to PS-enhancing initiatives. RESULTS: The PS scale exhibited strong psychometric properties, and a 1-factor model fit the data well (Cronbach α = 0.80; root mean square error approximation = 0.08; Confirmatory Fit Index = 0.97; Tucker-Lewis Fit Index = 0.95). Psychological Safety scores differed significantly by role, shift, shift length, and years in specialty. The PS scale correlated significantly and in expected directions with safety culture scales. The PS score was significantly higher in work settings with higher rates of exposure to Safety WalkRounds or Positive Leadership WalkRounds. CONCLUSIONS: The PS scale is brief, diagnostic, and actionable. It exhibits strong psychometric properties; is associated with better safety, teamwork climate, and well-being; differs by demographic factors; and is significantly higher for those who have been exposed to PS-enhancing initiatives.

The language of healthcare worker emotional exhaustion: A linguistic analysis of longitudinal survey.

Importance: Emotional exhaustion (EE) rates in healthcare workers (HCWs) have reached alarming levels and been linked to worse quality of care. Prior research has shown linguistic characteristics of writing samples can predict mental health disorders. Understanding whether linguistic characteristics are associated with EE could help identify and predict EE. Objectives: To examine whether linguistic characteristics of HCW writing associate with prior, current, and future EE. Design setting and participants: A large hospital system in the Mid-West had 11,336 HCWs complete annual quality improvement surveys in 2019, and 10,564 HCWs in 2020. Surveys included a measure of EE, an open-ended comment box, and an anonymous identifier enabling HCW responses to be linked across years. Linguistic Inquiry and Word Count (LIWC) software assessed the frequency of one exploratory and eight a priori hypothesized linguistic categories in written comments. Analysis of covariance (ANCOVA) assessed associations between these categories and past, present, and future HCW EE adjusting for the word count of comments. Comments with <20 words were excluded. Main outcomes and measures: The frequency of the linguistic categories (word count, first person singular, first person plural, present focus, past focus, positive emotion, negative emotion, social, power) in HCW comments were examined across EE quartiles. Results: For the 2019 and 2020 surveys, respondents wrote 3,529 and 3,246 comments, respectively, of which 2,101 and 1,418 comments (103,474 and 85,335 words) contained ≥20 words. Comments using more negative emotion (p < 0.001), power (i.e., references relevant to status, dominance, and social hierarchies, e.g., own, order, and allow) words (p < 0.0001), and words overall (p < 0.001) were associated with higher current and future EE. Using positive emotion words (p < 0.001) was associated with lower EE in 2019 (but not 2020). Contrary to hypotheses, using more first person singular (p < 0.001) predicted lower current and future EE. Past and present focus, first person plural, and social words did not predict EE. Current EE did not predict future language use. Conclusion: Five linguistic categories predicted current and subsequent HCW EE. Notably, EE did not predict future language. These linguistic markers suggest a language of EE, offering insights into EE's etiology, consequences, measurement, and intervention. Future use of these findings could include the ability to identify and support individuals and units at high risk of EE based on their linguistic characteristics.

Using safety culture results to guide the merger of four general practices in the UK.

BACKGROUND: The rapid merger in a crisis of three GP practices to incorporate the patients from a neighbouring closing surgery, led to the redesign of primary care provision. A deliberate focus on patient safety and staff engagement was maintained throughout this challenging transition to working at scale in an innovative, integrated and collaborative GP model. METHOD: 3 cycles of a staff culture tool (Safety, Communication, Organizational Reliability, Physician & Employee burn-out and Engagement) were performed at intervals of 9-12 months with structured feedback and engagement with staff after each round. The impact of different styles of feedback, the effect of specific interventions, and overall changes in safety climate and culture domains were observed in detail throughout this time period. RESULTS: Strong themes demonstrated were that: there was a general improvement in all culture domains; specific focus on teams that expressed they were struggling created the most effective outcomes; an initial lack of trust of the management structure improved; adapting and tailoring the styles of feedback was most efficacious; and burn-out scores dropped progressively. A unique observation of the rate at which different modalities of safety climate and culture change with time is demonstrated. CONCLUSION: With limited time, resources and energy, especially at times of crisis or change, the rapid and accurate identification of which domains of 'culture' and which teams required the most input at each stage of the journey is invaluable. Using this tool and prioritising patient safety, enables rapid and effective positive change to the culture and shape of expanding practices. It affirms that new models of working at scale in GP can be positively embraced with improvements in safety culture, if this is deliberately focused on and included in the transition process.

Providing feedback following Leadership WalkRounds is associated with better patient safety culture, higher employee engagement and lower burnout.

BACKGROUND: There is a poorly understood relationship between Leadership WalkRounds (WR) and domains such as safety culture, employee engagement, burnout and work-life balance. METHODS: This cross-sectional survey study evaluated associations between receiving feedback about actions taken as a result of WR and healthcare worker assessments of patient safety culture, employee engagement, burnout and work-life balance, across 829 work settings. RESULTS: 16 797 of 23 853 administered surveys were returned (70.4%). 5497 (32.7% of total) reported that they had participated in WR, and 4074 (24.3%) reported that they participated in WR with feedback. Work settings reporting more WR with feedback had substantially higher safety culture domain scores (first vs fourth quartile Cohen's d range: 0.34-0.84; % increase range: 15-27) and significantly higher engagement scores for four of its six domains (first vs fourth quartile Cohen's d range: 0.02-0.76; % increase range: 0.48-0.70). CONCLUSION: This WR study of patient safety and organisational outcomes tested relationships with a comprehensive set of safety culture and engagement metrics in the largest sample of hospitals and respondents to date. Beyond measuring simply whether WRs occur, we examine WR with feedback, as WR being done well. We suggest that when WRs are conducted, acted on, and the results are fed back to those involved, the work setting is a better place to deliver and receive care as assessed across a broad range of metrics, including teamwork, safety, leadership, growth opportunities, participation in decision-making and the emotional exhaustion component of burnout. Whether WR with feedback is a manifestation of better norms, or a cause of these norms, is unknown, but the link is demonstrably potent.

Assessing the readability of ClinicalTrials.gov.

OBJECTIVE: ClinicalTrials.gov serves critical functions of disseminating trial information to the public and helping the trials recruit participants. This study assessed the readability of trial descriptions at ClinicalTrials.gov using multiple quantitative measures. MATERIALS AND METHODS: The analysis included all 165,988 trials registered at ClinicalTrials.gov as of April 30, 2014. To obtain benchmarks, the authors also analyzed 2 other medical corpora: (1) all 955 Health Topics articles from MedlinePlus and (2) a random sample of 100,000 clinician notes retrieved from an electronic health records system intended for conveying internal communication among medical professionals. The authors characterized each of the corpora using 4 surface metrics, and then applied 5 different scoring algorithms to assess their readability. The authors hypothesized that clinician notes would be most difficult to read, followed by trial descriptions and MedlinePlus Health Topics articles. RESULTS: Trial descriptions have the longest average sentence length (26.1 words) across all corpora; 65% of their words used are not covered by a basic medical English dictionary. In comparison, average sentence length of MedlinePlus Health Topics articles is 61% shorter, vocabulary size is 95% smaller, and dictionary coverage is 46% higher. All 5 scoring algorithms consistently rated CliniclTrials.gov trial descriptions the most difficult corpus to read, even harder than clinician notes. On average, it requires 18 years of education to properly understand these trial descriptions according to the results generated by the readability assessment algorithms. DISCUSSION AND CONCLUSION: Trial descriptions at CliniclTrials.gov are extremely difficult to read. Significant work is warranted to improve their readability in order to achieve CliniclTrials.gov's goal of facilitating information dissemination and subject recruitment.

Ginkgo and Warfarin Interaction in a Large Veterans Administration Population.

Ginkgo biloba is a widely used herbal product that could potentially have a severe interaction with warfarin, which is the most frequently prescribed anticoagulant agent in North America. Literature, however, provides conflicting evidence on the presence and severity of the interaction. In this study, we developed text processing methods to extract the ginkgo usage and combined it with prescription data on warfarin from a very large clinical data respository. Our statistical analysis suggests that taking concurrently with warfarin, gingko does significantly increase patients' risk of a bleeding adverse event (hazard ratio = 1.38, 95%CI: 1.20 to 1.58, p<.001). This study also is the first attempt of using a large medical record databaseto confirm a suspected herb-drug interaction.

Development of an Alert System to Detect Drug Interactions with Herbal Supplements using Medical Record Data.

While potential medication-to-medication interaction alerting engines exist in many clinical applications, few systems exist to automatically alert on potential medication to herbal supplement interactions. We have developed a preliminary knowledge base and rules alerting engine that detects 259 potential interactions between 9 supplements, 62 cardiac medications, and 19 drug classes. The rules engine takes into consideration 12 patient risk factors and 30 interaction warning signs to help determine which of three different alert levels to categorize each potential interaction. A formative evaluation was conducted with two clinicians to set initial thresholds for each alert level. Additional work is planned add more supplement interactions, risk factors, and warning signs as well as to continue to set and adjust the inputs and thresholds for each potential interaction.

Applying multiple methods to assess the readability of a large corpus of medical documents.

Medical documents provided to patients at the end of an episode of care, such as discharge summaries and referral letters, serve as an important vehicle to convey critical information to patients and families. Increasingly, healthcare institutions are also experimenting with granting patients direct electronic access to other types of clinical narratives that are not typically shared unless explicitly requested, such as progress notes. While these efforts have great potential to improve information transparency, their value can be severely diminished if patients are unable to read and thus unable to properly interpret the medical documents shared to them. In this study, we approached the problem by contrasting the 'readability' of two types of medical documents: referral letters vs. other genres of narrative clinician notes not explicitly intended for direct viewing by patients. To establish a baseline for comparison, we also computed readability scores of MedlinePlus articles - exemplars of fine patient education materials carefully crafted for lay audiences. We quantified document readability using four different measures. Differences in the results obtained through these measures are also discussed.

Exploring the use of large clinical data to inform patients for shared decision making.

Barriers to patient participation in the shared decision making process prevent patients from fully participating in evaluating treatment options and treatment selection. Patients who use a decision aid are more informed and engaged in the shared decision making process. Patient decision aids do not use real clinical data for patient information and may not represent the data well. We designed an interface, for a shared decision making aid, that leverages clinical data to inform risk ratios and create patient stories, or vignettes, and present a visual representation of quantified treatment outcomes data. Usability testing was conducted with experts to evaluate the interface and the utility of using real clinical information that patients can explore. The experts' comments were transcribed and coded for themes. Themes were quantified and comments were interpreted for refinement and modification to the patient decision aid interface and data visualization.