Beyond order-based nursing workload: A retrospective cohort study in intensive care units.

INTRODUCTION: In order to be positioned to address the increasing strain of burnout and worsening nurse shortage, a better understanding of factors that contribute to nursing workload is required. This study aims to examine the difference between order-based and clinically perceived nursing workloads and to quantify factors that contribute to a higher clinically perceived workload. DESIGN: A retrospective cohort study was used on an observational dataset. METHODS: We combined patient flow, nurse staffing and assignment, and workload intensity data and used multivariate linear regression to analyze how various shift, patient, and nurse-level factors, beyond order-based workload, affect nurses' clinically perceived workload. RESULTS: Among 53% of our samples, the clinically perceived workload is higher than the order-based workload. Factors associated with a higher clinically perceived workload include weekend or night shifts, shifts with a higher census, patients within the first 24 h of admission, and male patients. CONCLUSIONS: The order-based workload measures tended to underestimate nurses' clinically perceived workload. We identified and quantified factors that contribute to a higher clinically perceived workload, discussed the potential mechanisms as to how these factors affect the clinically perceived workload, and proposed targeted interventions to better manage nursing workload. CLINICAL RELEVANCE: By identifying factors associated with a high clinically perceived workload, the nurse manager can provide appropriate interventions to lighten nursing workload, which may further reduce the risk of nurse burnout and shortage.

Examining the Generalizability of Pretrained De-identification Transformer Models on Narrative Nursing Notes.

BACKGROUND: Narrative nursing notes are a valuable resource in informatics research with unique predictive signals about patient care. The open sharing of these data, however, is appropriately constrained by rigorous regulations set by the Health Insurance Portability and Accountability Act (HIPAA) for the protection of privacy. Several models have been developed and evaluated on the open-source i2b2 dataset. A focus on the generalizability of these models with respect to nursing notes remains understudied. OBJECTIVES: The study aims to understand the generalizability of pretrained transformer models and investigate the variability of personal protected health information (PHI) distribution patterns between discharge summaries and nursing notes with a goal to inform the future design for model evaluation schema. METHODS: Two pretrained transformer models (RoBERTa, ClinicalBERT) fine-tuned on i2b2 2014 discharge summaries were evaluated on our data inpatient nursing notes and compared with the baseline performance. Statistical testing was deployed to assess differences in PHI distribution across discharge summaries and nursing notes. RESULTS: RoBERTa achieved the optimal performance when tested on an external source of data, with an F1 score of 0.887 across PHI categories and 0.932 in the PHI binary task. Overall, discharge summaries contained a higher number of PHI instances and categories of PHI compared with inpatient nursing notes. CONCLUSION: The study investigated the applicability of two pretrained transformers on inpatient nursing notes and examined the distinctions between nursing notes and discharge summaries concerning the utilization of personal PHI. Discharge summaries presented a greater quantity of PHI instances and types when compared with narrative nursing notes, but narrative nursing notes exhibited more diversity in the types of PHI present, with some pertaining to patient's personal life. The insights obtained from the research help improve the design and selection of algorithms, as well as contribute to the development of suitable performance thresholds for PHI.

Identifying Barriers to The Implementation of Communicating Narrative Concerns Entered by Registered Nurses, An Early Warning System SmartApp.

BACKGROUND: Nurses are at the frontline of detecting patient deterioration. We developed Communicating Narrative Concerns Entered by Registered Nurses (CONCERN), an early warning system for clinical deterioration that generates a risk prediction score utilizing nursing data. CONCERN was implemented as a randomized clinical trial at two health systems in the Northeastern United States. Following the implementation of CONCERN, our team sought to develop the CONCERN Implementation Toolkit to enable other hospital systems to adopt CONCERN. OBJECTIVE: The aim of this study was to identify the optimal resources needed to implement CONCERN and package these resources into the CONCERN Implementation Toolkit to enable the spread of CONCERN to other hospital sites. METHODS: To accomplish this aim, we conducted qualitative interviews with nurses, prescribing providers, and information technology experts in two health systems. We recruited participants from July 2022 to January 2023. We conducted thematic analysis guided by the Donabedian model. Based on the results of the thematic analysis, we updated the α version of the CONCERN Implementation Toolkit. RESULTS: There was a total of 32 participants included in our study. In total, 12 themes were identified, with four themes mapping to each domain in Donabedian's model (i.e., structure, process, and outcome). Eight new resources were added to the CONCERN Implementation Toolkit. CONCLUSIONS: This study validated the α version of the CONCERN Implementation Toolkit. Future studies will focus on returning the results of the Toolkit to the hospital sites to validate the ß version of the CONCERN Implementation Toolkit. As the development of early warning systems continues to increase and clinician workflows evolve, the results of this study will provide considerations for research teams interested in implementing early warning systems in the acute care setting.

Understanding the Technical Implementation of a Clinical Decision Support SmartApp: A Qualitative Analysis.

CONCERN is a SmartApp that identifies patients at risk for deterioration. This study aimed to understand the technical components and processes that should be included in our Implementation Toolkit. In focus groups with technical experts five themes emerged: 1) implementation challenges, 2) implementation facilitators, 3) project management, 4) stakeholder engagement, and 5) security assessments. Our results may aid other teams in implementing healthcare SmartApps.

Dissemination of Strategies for Reducing Excessive Documentation Burden: 25x5 Task Force Activities Relevant to Nursing.

Burnout and workforce shortages are having a negative impact on nurses globally, particularly after the COVID-19 pandemic. Within the United States, excessive documentation burden (DocBurden) has been linked to nurse burnout. The experience of a system or system-imposed process inhibiting patient care is a core focus area of nursing informatics research. The American Medical Informatics Association (AMIA) 25x5 Task Force to Reduce DocBurden was created in 2022 to decrease U.S. health professionals' excessive DocBurden to 25% of current state within five years through impactful solutions across health systems that decrease non-value-added documentation, and leverage public/private partnerships and advocacy. This case study will describe the work of the 25x5 Task Force that is relevant to nursing practice. Specifically, we will describe three projects: A) Toolkit for Reducing Excessive DocBurden, B) Development of Pulse Survey for Health Professionals Perceived DocBurden, and C) HIT Roadmap to Promote Interoperability.

Toward Alleviating Clinician Documentation Burden: A Scoping Review of Burden Reduction Efforts.

BACKGROUND: Studies have shown that documentation burden experienced by clinicians may lead to less direct patient care, increased errors, and job dissatisfaction. Implementing effective strategies within health care systems to mitigate documentation burden can result in improved clinician satisfaction and more time spent with patients. However, there is a gap in the literature regarding evidence-based interventions to reduce documentation burden. OBJECTIVES: The objective of this review was to identify and comprehensively summarize the state of the science related to documentation burden reduction efforts. METHODS: Following Joanna Briggs Institute Manual for Evidence Synthesis and Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) guidelines, we conducted a comprehensive search of multiple databases, including PubMed, Medline, Embase, CINAHL Complete, Scopus, and Web of Science. Additionally, we searched gray literature and used Google Scholar to ensure a thorough review. Two reviewers independently screened titles and abstracts, followed by full-text review, with a third reviewer resolving any discrepancies. Data extraction was performed and a table of evidence was created. RESULTS: A total of 34 articles were included in the review, published between 2016 and 2022, with a majority focusing on the United States. The efforts described can be categorized into medical scribes, workflow improvements, educational interventions, user-driven approaches, technology-based solutions, combination approaches, and other strategies. The outcomes of these efforts often resulted in improvements in documentation time, workflow efficiency, provider satisfaction, and patient interactions. CONCLUSION: This scoping review provides a comprehensive summary of health system documentation burden reduction efforts. The positive outcomes reported in the literature emphasize the potential effectiveness of these efforts. However, more research is needed to identify universally applicable best practices, and considerations should be given to the transfer of burden among members of the health care team, quality of education, clinician involvement, and evaluation methods.

Multisite Pragmatic Cluster-Randomized Controlled Trial of the CONCERN Early Warning System.

Importance: Late predictions of hospitalized patient deterioration, resulting from early warning systems (EWS) with limited data sources and/or a care team's lack of shared situational awareness, contribute to delays in clinical interventions. The COmmunicating Narrative Concerns Entered by RNs (CONCERN) Early Warning System (EWS) uses real-time nursing surveillance documentation patterns in its machine learning algorithm to identify patients' deterioration risk up to 42 hours earlier than other EWSs. Objective: To test our a priori hypothesis that patients with care teams informed by the CONCERN EWS intervention have a lower mortality rate and shorter length of stay (LOS) than the patients with teams not informed by CONCERN EWS. Design: One-year multisite, pragmatic controlled clinical trial with cluster-randomization of acute and intensive care units to intervention or usual-care groups. Setting: Two large U.S. health systems. Participants: Adult patients admitted to acute and intensive care units, excluding those on hospice/palliative/comfort care, or with Do Not Resuscitate/Do Not Intubate orders. Intervention: The CONCERN EWS intervention calculates patient deterioration risk based on nurses' concern levels measured by surveillance documentation patterns, and it displays the categorical risk score (low, increased, high) in the electronic health record (EHR) for care team members. Main Outcomes and Measures: Primary outcomes: in-hospital mortality, LOS; survival analysis was used. Secondary outcomes: cardiopulmonary arrest, sepsis, unanticipated ICU transfers, 30-day hospital readmission. Results: A total of 60 893 hospital encounters (33 024 intervention and 27 869 usual-care) were included. Both groups had similar patient age, race, ethnicity, and illness severity distributions. Patients in the intervention group had a 35.6% decreased risk of death (adjusted hazard ratio [HR], 0.644; 95% confidence interval [CI], 0.532-0.778; P<.0001), 11.2% decreased LOS (adjusted incidence rate ratio, 0.914; 95% CI, 0.902-0.926; P<.0001), 7.5% decreased risk of sepsis (adjusted HR, 0.925; 95% CI, 0.861-0.993; P=.0317), and 24.9% increased risk of unanticipated ICU transfer (adjusted HR, 1.249; 95% CI, 1.093-1.426; P=.0011) compared with patients in the usual-care group. Conclusions and Relevance: A hospital-wide EWS based on nursing surveillance patterns decreased in-hospital mortality, sepsis, and LOS when integrated into the care team's EHR workflow. Trial Registration: ClinicalTrials.gov Identifier: NCT03911687.

Defining documentation burden (DocBurden) and excess DocBurden for all health professionals: A scoping review.

OBJECTIVE: Efforts to reduce documentation burden (DocBurden) for all health professionals (HP) are aligned with national initiatives to improve clinician wellness and patient safety. Yet DocBurden has not been precisely defined, limiting national conversations and rigorous, reproducible, and meaningful measures. Increasing attention to DocBurden motivated this work to establish a standard definition of DocBurden, with the emergence of excessive DocBurden as a term. METHODS: We conducted a scoping review of DocBurden definitions and descriptions, searching six databases for scholarly, peer-reviewed, and gray literature sources, using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extensions for Scoping Review (PRISMA-ScR) guidance. For the concept clarification phase of work, we used the American Nursing Informatics Association (ANIA)'s 6-Domains of Burden Framework. RESULTS: A total of 153 articles were included based on a priori criteria. Most articles described a focus on DocBurden, but only 18% (n=28) provided a definition. We define excessive DocBurden as the stress and unnecessarily heavy work a HP or healthcare team experiences when usability of documentation systems and documentation activities (i.e., generation, review, analysis and synthesis of patient data) are not aligned in support of care delivery. A negative connotation was attached to burden without a neutral state in included sources, which does not align with dictionary definitions of burden. CONCLUSIONS: Existing literature does not distinguish between a baseline or required task load to conduct patient care resulting from usability issues(DocBurden), and the unnecessarily heavy tasks and requirements that contribute to excessive DocBurden. Our definition of excessive DocBurden explicitly acknowledges this distinction, to support development of meaningful measures for understanding and intervening on excessive DocBurden locally, nationally and internationally.

A Practical Approach to Optimize Computerized Provider Order Entry Systems and Reduce Clinician Burden: Pre-Post Evaluation of Vendor-Derived "Order Friction" Data.

Computerized provider order entry (CPOE) systems have been cited as a significant contributor to clinician burden. Vendor-derived measures and data sets have been developed to help with optimization of CPOE systems. We describe how we analyzed vendor-derived Order Friction (OF) EHR log data at our health system and propose a practical approach for optimizing CPOE systems by reducing OF. We also conducted a pre-post intervention study using OF data to evaluate the impact of defaulting the frequency of urine, stool and nasal swab tests and found that all modified orders had significantly fewer changes required per order (p<0.01). Our proposed approach is a six-step process: 1) understand the ordering process, 2) understand OF data elements contextually, 3) explore ordering user-level factors, 4) evaluate order volume and friction from different order sources, 5) optimize order-level design, 6) identify high volume alerts to evaluate for appropriateness.

A Computational Framework to Evaluate Emergency Department Clinician Task Switching in the Electronic Health Record Using Event Logs.

Workflow fragmentation, defined as task switching, may be one proxy to quantify electronic health record (EHR) documentation burden in the emergency department (ED). Few measures have been operationalized to evaluate task switching at scale. Theoretically grounded in the time-based resource-sharing model (TBRSM) which conceives task switching as proportional to the cognitive load experienced, we describe the functional relationship between cognitive load and the time and effort constructs previously applied for measuring documentation burden. We present a computational framework, COMBINE, to evaluate multilevel task switching in the ED using EHR event logs. Based on this framework, we conducted a descriptive analysis on task switching among 63 full-time ED physicians from one ED site using EHR event logs extracted between April-June 2021 (n=2,068,605 events) which were matched to scheduled shifts (n=952). On average, we found a high volume of event-level (185.8±75.3/hr) and within-(6.6±1.7/chart) and between-patient chart (27.5±23.6/hr) switching per shift worked.

Variability in Nursing Documentation Patterns across Patients' Hospital Stays.

This study explores the variability in nursing documentation patterns in acute care and ICU settings, focusing on vital signs and note documentation, and examines how these patterns vary across patients' hospital stays, documentation types, and comorbidities. In both acute care and critical care settings, there was significant variability in nursing documentation patterns across hospital stays, by documentation type, and by patients' comorbidities. The results suggest that nurses adapt their documentation practices in response to their patients' fluctuating needs and conditions, highlighting the need to facilitate more individualized care and tailored documentation practices. The implications of these findings can inform decisions on nursing workload management, clinical decision support tools, and EHR optimizations.

A Delphi Process to Identify Relevant Outcomes That May Be Associated With a Predictive Analytic Tool to Detect Hemodynamic Deterioration in the Intensive Care Unit.

Background The critical care literature has seen an increase in the development and validation of tools using artificial intelligence for early detection of patient events or disease onset in the intensive care unit (ICU). The hemodynamic stability index (HSI) was found to have an AUC of 0.82 in predicting the need for hemodynamic intervention in the ICU. Future studies using this tool may benefit from targeting those outcomes that are more relevant to clinicians and most achievable. Methods A three-round Delphi study was conducted with a panel of 10 critical care physicians and three nurses in the United States to identify outcomes that may be most relevant and achievable with the HSI when evaluated for use in the ICU. To achieve criteria for relevance, at least 65% of panelists had to rate an outcome as a 4 or 5 on a 5-point scale. Results Nineteen of 24 outcomes that may be associated with the HSI achieved consensus for relevance. The Kemeny-Young approach was used to develop a matrix depicting the distribution of outcomes considering both relevance and achievability. "Reduces time spent in hemodynamic instability" and "reduces times to recognition of hemodynamic instability" were the highest-ranking outcomes considering both relevance and achievability. Conclusion This Delphi study was a feasible method to identify relevant outcomes that may be associated with an appropriate predictive analytic tool in the ICU. These findings can provide insight to researchers looking to study such tools to impact outcomes relevant to critical care practitioners. Future studies should test these tools in the ICU that target the most clinically relevant and achievable outcomes, such as time spent hemodynamically unstable or time until actionable nursing assessment or treatment.

Identifying Reuse and Redundancies in Respiratory Flowsheet Documentation: Implications for Clinician Documentation Burden.

Documentation burden is experienced by clinical end-users of the electronic health record. Flowsheet measure reuse and clinical concept redundancy are two contributors to documentation burden. In this paper, we described nursing flowsheet documentation hierarchy and frequency of use for one month from two hospitals in our health system. We examined respiratory care management documentation in greater detail. We found 59 instances of reuse of respiratory care flowsheet measure fields over two or more templates and groups, and 5 instances of clinical concept redundancy. Flowsheet measure fields for physical assessment observations and measurements were the most frequently documented and most reused, whereas respiratory intervention documentation was less frequently reused. Further research should investigate the relationship between flowsheet measure reuse and redundancy and EHR information overload and documentation burden.