Multisite Pragmatic Cluster-Randomized Controlled Trial of the CONCERN Early Warning System.

Importance: Late predictions of hospitalized patient deterioration, resulting from early warning systems (EWS) with limited data sources and/or a care team's lack of shared situational awareness, contribute to delays in clinical interventions. The COmmunicating Narrative Concerns Entered by RNs (CONCERN) Early Warning System (EWS) uses real-time nursing surveillance documentation patterns in its machine learning algorithm to identify patients' deterioration risk up to 42 hours earlier than other EWSs. Objective: To test our a priori hypothesis that patients with care teams informed by the CONCERN EWS intervention have a lower mortality rate and shorter length of stay (LOS) than the patients with teams not informed by CONCERN EWS. Design: One-year multisite, pragmatic controlled clinical trial with cluster-randomization of acute and intensive care units to intervention or usual-care groups. Setting: Two large U.S. health systems. Participants: Adult patients admitted to acute and intensive care units, excluding those on hospice/palliative/comfort care, or with Do Not Resuscitate/Do Not Intubate orders. Intervention: The CONCERN EWS intervention calculates patient deterioration risk based on nurses' concern levels measured by surveillance documentation patterns, and it displays the categorical risk score (low, increased, high) in the electronic health record (EHR) for care team members. Main Outcomes and Measures: Primary outcomes: in-hospital mortality, LOS; survival analysis was used. Secondary outcomes: cardiopulmonary arrest, sepsis, unanticipated ICU transfers, 30-day hospital readmission. Results: A total of 60 893 hospital encounters (33 024 intervention and 27 869 usual-care) were included. Both groups had similar patient age, race, ethnicity, and illness severity distributions. Patients in the intervention group had a 35.6% decreased risk of death (adjusted hazard ratio [HR], 0.644; 95% confidence interval [CI], 0.532-0.778; P<.0001), 11.2% decreased LOS (adjusted incidence rate ratio, 0.914; 95% CI, 0.902-0.926; P<.0001), 7.5% decreased risk of sepsis (adjusted HR, 0.925; 95% CI, 0.861-0.993; P=.0317), and 24.9% increased risk of unanticipated ICU transfer (adjusted HR, 1.249; 95% CI, 1.093-1.426; P=.0011) compared with patients in the usual-care group. Conclusions and Relevance: A hospital-wide EWS based on nursing surveillance patterns decreased in-hospital mortality, sepsis, and LOS when integrated into the care team's EHR workflow. Trial Registration: ClinicalTrials.gov Identifier: NCT03911687.

Addressing bias in preterm birth research: The role of advanced imputation techniques for missing race and ethnicity in perinatal health data.

OBJECTIVES: To evaluate the effectiveness of Bayesian Improved Surname Geocoding (BISG) and Bayesian Improved First Name Surname Geocoding (BIFSG) in estimating race and ethnicity, and how they influence odds ratios for preterm birth. METHODS: We analyzed hospital birth admission electronic health records (EHR) data (N = 9985). We created two simulation sets with 40 % of race and ethnicity data missing randomly or more likely for non-Hispanic black birthing people who had preterm birth. We calculated C-statistics to evaluate how accurately BISG and BIFSG estimate race and ethnicity. We examined the association between race and ethnicity and preterm birth using logistic regression and reported odds ratios (OR). RESULTS: BISG and BIFSG showed high accuracy for most racial and ethnic categories (C-statistics = 0.94-0.97, 95 % confidence intervals [CI] = 0.92-0.97). When race and ethnicity were not missing at random, BISG (OR = 1.25, CI = 0.97-1.62) and BIFSG (OR = 1.38, CI = 1.08-1.76) resulted in positive estimates mirroring the true association (OR = 1.68, CI = 1.34-2.09) for Non-Hispanic Black birthing people, while traditional methods showed contrasting estimates (Complete case OR = 0.62, CI = 0.41-0.94; multiple imputation OR = 0.63, CI = 0.40-0.98). CONCLUSIONS: BISG and BIFSG accurately estimate missing race and ethnicity in perinatal EHR data, decreasing bias in preterm birth research, and are recommended over traditional methods to reduce potential bias.

Identifying Barriers to The Implementation of Communicating Narrative Concerns Entered by Registered Nurses, An Early Warning System SmartApp.

BACKGROUND: Nurses are at the frontline of detecting patient deterioration. We developed Communicating Narrative Concerns Entered by Registered Nurses (CONCERN), an early warning system for clinical deterioration that generates a risk prediction score utilizing nursing data. CONCERN was implemented as a randomized clinical trial at two health systems in the Northeastern United States. Following the implementation of CONCERN, our team sought to develop the CONCERN Implementation Toolkit to enable other hospital systems to adopt CONCERN. OBJECTIVE: The aim of this study was to identify the optimal resources needed to implement CONCERN and package these resources into the CONCERN Implementation Toolkit to enable the spread of CONCERN to other hospital sites. METHODS: To accomplish this aim, we conducted qualitative interviews with nurses, prescribing providers, and information technology experts in two health systems. We recruited participants from July 2022 to January 2023. We conducted thematic analysis guided by the Donabedian model. Based on the results of the thematic analysis, we updated the α version of the CONCERN Implementation Toolkit. RESULTS: There was a total of 32 participants included in our study. In total, 12 themes were identified, with four themes mapping to each domain in Donabedian's model (i.e., structure, process, and outcome). Eight new resources were added to the CONCERN Implementation Toolkit. CONCLUSIONS: This study validated the α version of the CONCERN Implementation Toolkit. Future studies will focus on returning the results of the Toolkit to the hospital sites to validate the ß version of the CONCERN Implementation Toolkit. As the development of early warning systems continues to increase and clinician workflows evolve, the results of this study will provide considerations for research teams interested in implementing early warning systems in the acute care setting.

Characterizing nursing time with patients using computer vision.

BACKGROUND: Compared to other providers, nurses spend more time with patients, but the exact quantity and nature of those interactions remain largely unknown. The purpose of this study was to characterize the interactions of nurses at the bedside using continuous surveillance over a year long period. METHODS: Nurses' time and activity at the bedside were characterized using a device that integrates the use of obfuscated computer vision in combination with a Bluetooth beacon on the nurses' identification badge to track nurses' activities at the bedside. The surveillance device (AUGi) was installed over 37 patient beds in two medical/surgical units in a major urban hospital. Forty-nine nurse users were tracked using the beacon. Data were collected 4/15/19-3/15/20. Statistics were performed to describe nurses' time and activity at the bedside. RESULTS: A total of n = 408,588 interactions were analyzed over 670 shifts, with >1.5 times more interactions during day shifts (n = 247,273) compared to night shifts (n = 161,315); the mean interaction time was 3.34 s longer during nights than days (p < 0.0001). Each nurse had an average of 7.86 (standard deviation [SD] = 10.13) interactions per bed each shift and a mean total interaction time per bed of 9.39 min (SD = 14.16). On average, nurses covered 7.43 beds (SD = 4.03) per shift (day: mean = 7.80 beds/nurse/shift, SD = 3.87; night: mean = 7.07/nurse/shift, SD = 4.17). The mean time per hourly rounding (HR) was 69.5 s (SD = 98.07) and 50.1 s (SD = 56.58) for bedside shift report. DISCUSSION: As far as we are aware, this is the first study to provide continuous surveillance of nurse activities at the bedside over a year long period, 24 h/day, 7 days/week. We detected that nurses spend less than 1 min giving report at the bedside, and this is only completed 20.7% of the time. Additionally, hourly rounding was completed only 52.9% of the time and nurses spent only 9 min total with each patient per shift. Further study is needed to detect whether there is an optimal timing or duration of interactions to improve patient outcomes. CLINICAL RELEVANCE: Nursing time with the patient has been shown to improve patient outcomes but precise information about how much time nurses spend with patients has been heretofore unknown. By understanding minute-by-minute activities at the bedside over a full year, we provide a full picture of nursing activity; this can be used in the future to determine how these activities affect patient outcomes.

Examining the Generalizability of Pretrained De-identification Transformer Models on Narrative Nursing Notes.

BACKGROUND: Narrative nursing notes are a valuable resource in informatics research with unique predictive signals about patient care. The open sharing of these data, however, is appropriately constrained by rigorous regulations set by the Health Insurance Portability and Accountability Act (HIPAA) for the protection of privacy. Several models have been developed and evaluated on the open-source i2b2 dataset. A focus on the generalizability of these models with respect to nursing notes remains understudied. OBJECTIVES: The study aims to understand the generalizability of pretrained transformer models and investigate the variability of personal protected health information (PHI) distribution patterns between discharge summaries and nursing notes with a goal to inform the future design for model evaluation schema. METHODS: Two pretrained transformer models (RoBERTa, ClinicalBERT) fine-tuned on i2b2 2014 discharge summaries were evaluated on our data inpatient nursing notes and compared with the baseline performance. Statistical testing was deployed to assess differences in PHI distribution across discharge summaries and nursing notes. RESULTS: RoBERTa achieved the optimal performance when tested on an external source of data, with an F1 score of 0.887 across PHI categories and 0.932 in the PHI binary task. Overall, discharge summaries contained a higher number of PHI instances and categories of PHI compared with inpatient nursing notes. CONCLUSION: The study investigated the applicability of two pretrained transformers on inpatient nursing notes and examined the distinctions between nursing notes and discharge summaries concerning the utilization of personal PHI. Discharge summaries presented a greater quantity of PHI instances and types when compared with narrative nursing notes, but narrative nursing notes exhibited more diversity in the types of PHI present, with some pertaining to patient's personal life. The insights obtained from the research help improve the design and selection of algorithms, as well as contribute to the development of suitable performance thresholds for PHI.

Understanding the Technical Implementation of a Clinical Decision Support SmartApp: A Qualitative Analysis.

CONCERN is a SmartApp that identifies patients at risk for deterioration. This study aimed to understand the technical components and processes that should be included in our Implementation Toolkit. In focus groups with technical experts five themes emerged: 1) implementation challenges, 2) implementation facilitators, 3) project management, 4) stakeholder engagement, and 5) security assessments. Our results may aid other teams in implementing healthcare SmartApps.

Using Natural Language Processing to Identify Stigmatizing Language in Labor and Birth Clinical Notes.

INTRODUCTION: Stigma and bias related to race and other minoritized statuses may underlie disparities in pregnancy and birth outcomes. One emerging method to identify bias is the study of stigmatizing language in the electronic health record. The objective of our study was to develop automated natural language processing (NLP) methods to identify two types of stigmatizing language: marginalizing language and its complement, power/privilege language, accurately and automatically in labor and birth notes. METHODS: We analyzed notes for all birthing people > 20 weeks' gestation admitted for labor and birth at two hospitals during 2017. We then employed text preprocessing techniques, specifically using TF-IDF values as inputs, and tested machine learning classification algorithms to identify stigmatizing and power/privilege language in clinical notes. The algorithms assessed included Decision Trees, Random Forest, and Support Vector Machines. Additionally, we applied a feature importance evaluation method (InfoGain) to discern words that are highly correlated with these language categories. RESULTS: For marginalizing language, Decision Trees yielded the best classification with an F-score of 0.73. For power/privilege language, Support Vector Machines performed optimally, achieving an F-score of 0.91. These results demonstrate the effectiveness of the selected machine learning methods in classifying language categories in clinical notes. CONCLUSION: We identified well-performing machine learning methods to automatically detect stigmatizing language in clinical notes. To our knowledge, this is the first study to use NLP performance metrics to evaluate the performance of machine learning methods in discerning stigmatizing language. Future studies should delve deeper into refining and evaluating NLP methods, incorporating the latest algorithms rooted in deep learning.

Improving Patient-Reported Outcomes in Stroke Care using Remote Blood Pressure Monitoring and Telehealth.

BACKGROUND: Inequities in health care access leads to suboptimal medication adherence and blood pressure (BP) control. Informatics-based approaches may deliver equitable care and enhance self-management. Patient-reported outcomes (PROs) complement clinical measures to assess the impact of illness on patients' well-being in poststroke care. OBJECTIVES: The aim of this study was to determine the feasibility of incorporating PROs into Telehealth After Stroke Care (TASC) and to explore the effect of this team-based remote BP monitoring program on psychological distress and quality of life in an underserved urban setting. METHODS: Patients discharged home from a Comprehensive Stroke Center were randomized to TASC or usual care for 3 months. They were provided with a BP monitor and a tablet that wirelessly transmitted data to a cloud-based platform, which were integrated with the electronic health record. Participants who did not complete the tablet surveys were contacted via telephone or e-mail. We collected the Patient-Reported Outcomes Measurement Information System Managing Medications and Treatment (PROMIS-MMT), Patient Activation Measure (PAM), Neuro-QOL (Quality of Life in Neurological Disorders) Cognitive Function, Neuro-QOL Depression, and Patient Health Questionnaire-9 (PHQ-9). T-tests and linear regression were used to evaluate the differences in PRO change between the arms. RESULTS: Of the 50 participants, two-thirds were Hispanic or non-Hispanic Black individuals. Mechanisms of PRO submission for the arms included tablet (62 vs. 47%), phone (24 vs. 37%), tablet with phone coaching (10 vs. 16%), and e-mail (4 vs. 0%). PHQ-9 depressive scores were nominally lower in TASC at 3 months compared with usual care (2.7 ± 3.6 vs. 4.0 ± 4.1; p = 0.06). No significant differences were observed in PROMIS-MMT, PAM, or Neuro-QoL measures. CONCLUSION: Findings suggest the feasibility of collecting PROs through an interactive web-based platform. The team-based remote BP monitoring demonstrated a favorable impact on patients' well-being. Patients equipped with appropriate resources can engage in poststroke self-care to mitigate inequities in health outcomes.

Predicting emergency department visits and hospitalizations for patients with heart failure in home healthcare using a time series risk model.

OBJECTIVES: Little is known about proactive risk assessment concerning emergency department (ED) visits and hospitalizations in patients with heart failure (HF) who receive home healthcare (HHC) services. This study developed a time series risk model for predicting ED visits and hospitalizations in patients with HF using longitudinal electronic health record data. We also explored which data sources yield the best-performing models over various time windows. MATERIALS AND METHODS: We used data collected from 9362 patients from a large HHC agency. We iteratively developed risk models using both structured (eg, standard assessment tools, vital signs, visit characteristics) and unstructured data (eg, clinical notes). Seven specific sets of variables included: (1) the Outcome and Assessment Information Set, (2) vital signs, (3) visit characteristics, (4) rule-based natural language processing-derived variables, (5) term frequency-inverse document frequency variables, (6) Bio-Clinical Bidirectional Encoder Representations from Transformers variables, and (7) topic modeling. Risk models were developed for 18 time windows (1-15, 30, 45, and 60 days) before an ED visit or hospitalization. Risk prediction performances were compared using recall, precision, accuracy, F1, and area under the receiver operating curve (AUC). RESULTS: The best-performing model was built using a combination of all 7 sets of variables and the time window of 4 days before an ED visit or hospitalization (AUC = 0.89 and F1 = 0.69). DISCUSSION AND CONCLUSION: This prediction model suggests that HHC clinicians can identify patients with HF at risk for visiting the ED or hospitalization within 4 days before the event, allowing for earlier targeted interventions.

Navigating Infection Control Processes in a COVID-19 Only Safety-Net Hospital at the Height of the Pandemic.

Hospitals faced extraordinary challenges during the pandemic. Some of these were directly related to patient care-expanding capacities, adjusting services, and using new knowledge to save lives in a dynamically changing situation. Other challenges were regulatory. The COVID-19 pandemic significantly disrupted routine hospital infection control practices. We report the results of an interview study with 13 individuals associated with infection control in a small independent hospital. We employed the Systems Engineering Initiative for Patient Safety (SEIPS) model as a theoretical framework and as a basis to analyze data. The findings revealed how routine practices and protocols were displaced in notable ways. Due to COVID-19, clinical activities were modified, and the increased demands of regulatory reporting became laborious, and punitive if reports were late. Strategies are needed to mitigate increases in healthcare-associated infections. Our examination of the information flows, transformation, and needs shows areas in which digital tool creation and the use of a trained informatics workforce could ameliorate and automate many processes.

Modelling Information Needs and Sources in a COVID-19 Designated Hospital.

COVID-19 remains an important focus of study in the field of public health informatics. COVID-19 designated hospitals have played an important role in the management of patients affected by the disease. In this paper we describe our modelling of the needs and sources of information for infectious disease practitioners and hospital administrators used to manage a COVID-19 outbreak. Infectious disease practitioner and hospital administrator stakeholders were interviewed to learn about their information needs and where they obtained their information. Stakeholder interview data were transcribed and coded to extract use case information. The findings indicate that participants used many and varied sources of information in the management of COVID-19. The use of multiple, differing sources of data led to considerable effort. In modelling participants' activities, we identified potential subsystems that could be used as a basis for developing an information system specific to the public health needs of hospitals providing care to COVID-19 patients.

Comparing Responses to COVID-19 Across Institutions: Conceptualization of an Emergency Response Maturity Model.

The impact of Covid-19 on hospitals was profound, with many lower-resourced hospitals' information technology resources inadequate to efficiently meet the new needs. We interviewed 52 personnel at all levels in two New York City hospitals to understand their issues in emergency response. The large differences in IT resources show the need for a schema to classify hospital IT readiness for emergency response. Here we propose a set of concepts and model, inspired by the Health Information Management Systems Society (HIMSS) maturity model. The schema is designed to permit evaluation of hospital IT emergency readiness, permitting remediation of IT resources where necessary.

Data Science Implementation Trends in Nursing Practice: A Review of the 2021 Literature.

OBJECTIVES: The goal of this work was to provide a review of the implementation of data science-driven applications focused on structural or outcome-related nurse-sensitive indicators in the literature in 2021. By conducting this review, we aim to inform readers of trends in the nursing indicators being addressed, the patient populations and settings of focus, and lessons and challenges identified during the implementation of these tools. METHODS: We conducted a rigorous descriptive review of the literature to identify relevant research published in 2021. We extracted data on model development, implementation-related strategies and measures, lessons learned, and challenges and stakeholder involvement. We also assessed whether reports of data science application implementations currently follow the guidelines of the Developmental and Exploratory Clinical Investigations of DEcision support systems driven by AI (DECIDE-AI) framework. RESULTS: Of 4,943 articles found in PubMed (NLM) and CINAHL (EBSCOhost), 11 were included in the final review and data extraction. Systems leveraging data science were developed for adult patient populations and were primarily deployed in hospital settings. The clinical domains targeted included mortality/deterioration, utilization/resource allocation, and hospital-acquired infections/COVID-19. The composition of development teams and types of stakeholders involved varied. Research teams more frequently reported on implementation methods than implementation results. Most studies provided lessons learned that could help inform future implementations of data science systems in health care. CONCLUSION: In 2021, very few studies report on the implementation of data science-driven applications focused on structural- or outcome-related nurse-sensitive indicators. This gap in the sharing of implementation strategies needs to be addressed in order for these systems to be successfully adopted in health care settings.

Eliciting Insights From Chat Logs of the 25X5 Symposium to Reduce Documentation Burden: Novel Application of Topic Modeling.

BACKGROUND: Addressing clinician documentation burden through "targeted solutions" is a growing priority for many organizations ranging from government and academia to industry. Between January and February 2021, the 25 by 5: Symposium to Reduce Documentation Burden on US Clinicians by 75% (25X5 Symposium) convened across 2 weekly 2-hour sessions among experts and stakeholders to generate actionable goals for reducing clinician documentation over the next 5 years. Throughout this web-based symposium, we passively collected attendees' contributions to a chat functionality-with their knowledge that the content would be deidentified and made publicly available. This presented a novel opportunity to synthesize and understand participants' perceptions and interests from chat messages. We performed a content analysis of 25X5 Symposium chat logs to identify themes about reducing clinician documentation burden. OBJECTIVE: The objective of this study was to explore unstructured chat log content from the web-based 25X5 Symposium to elicit latent insights on clinician documentation burden among clinicians, health care leaders, and other stakeholders using topic modeling. METHODS: Across the 6 sessions, we captured 1787 messages among 167 unique chat participants cumulatively; 14 were private messages not included in the analysis. We implemented a latent Dirichlet allocation (LDA) topic model on the aggregated dataset to identify clinician documentation burden topics mentioned in the chat logs. Coherence scores and manual examination informed optimal model selection. Next, 5 domain experts independently and qualitatively assigned descriptive labels to model-identified topics and classified them into higher-level categories, which were finalized through a panel consensus. RESULTS: We uncovered ten topics using the LDA model: (1) determining data and documentation needs (422/1773, 23.8%); (2) collectively reassessing documentation requirements in electronic health records (EHRs) (252/1773, 14.2%); (3) focusing documentation on patient narrative (162/1773, 9.1%); (4) documentation that adds value (147/1773, 8.3%); (5) regulatory impact on clinician burden (142/1773, 8%); (6) improved EHR user interface and design (128/1773, 7.2%); (7) addressing poor usability (122/1773, 6.9%); (8) sharing 25X5 Symposium resources (122/1773, 6.9%); (9) capturing data related to clinician practice (113/1773, 6.4%); and (10) the role of quality measures and technology in burnout (110/1773, 6.2%). Among these 10 topics, 5 high-level categories emerged: consensus building (821/1773, 46.3%), burden sources (365/1773, 20.6%), EHR design (250/1773, 14.1%), patient-centered care (162/1773, 9.1%), and symposium comments (122/1773, 6.9%). CONCLUSIONS: We conducted a topic modeling analysis on 25X5 Symposium multiparticipant chat logs to explore the feasibility of this novel application and elicit additional insights on clinician documentation burden among attendees. Based on the results of our LDA analysis, consensus building, burden sources, EHR design, and patient-centered care may be important themes to consider when addressing clinician documentation burden. Our findings demonstrate the value of topic modeling in discovering topics associated with clinician documentation burden using unstructured textual content. Topic modeling may be a suitable approach to examine latent themes presented in web-based symposium chat logs.

A qualitative analysis of stigmatizing language in birth admission clinical notes.

The presence of stigmatizing language in the electronic health record (EHR) has been used to measure implicit biases that underlie health inequities. The purpose of this study was to identify the presence of stigmatizing language in the clinical notes of pregnant people during the birth admission. We conducted a qualitative analysis on N = 1117 birth admission EHR notes from two urban hospitals in 2017. We identified stigmatizing language categories, such as Disapproval (39.3%), Questioning patient credibility (37.7%), Difficult patient (21.3%), Stereotyping (1.6%), and Unilateral decisions (1.6%) in 61 notes (5.4%). We also defined a new stigmatizing language category indicating Power/privilege. This was present in 37 notes (3.3%) and signaled approval of social status, upholding a hierarchy of bias. The stigmatizing language was most frequently identified in birth admission triage notes (16%) and least frequently in social work initial assessments (13.7%). We found that clinicians from various disciplines recorded stigmatizing language in the medical records of birthing people. This language was used to question birthing people's credibility and convey disapproval of decision-making abilities for themselves or their newborns. We reported a Power/privilege language bias in the inconsistent documentation of traits considered favorable for patient outcomes (e.g., employment status). Future work on stigmatizing language may inform tailored interventions to improve perinatal outcomes for all birthing people and their families.

Assessing Usability and Ambulatory Clinical Staff Satisfaction with Two Electronic Health Records.

BACKGROUND: A growing body of literature has linked usability limitations within electronic health records (EHRs) to adverse outcomes which may in turn affect EHR system transitions. NewYork-Presbyterian Hospital, Columbia University College of Physicians and Surgeons (CU), and Weill Cornell Medical College (WC) are a tripartite organization with large academic medical centers that initiated a phased transition of their EHRs to one system, EpicCare. OBJECTIVES: This article characterizes usability perceptions stratified by provider roles by surveying WC ambulatory clinical staff already utilizing EpicCare and CU ambulatory clinical staff utilizing iterations of Allscripts before the implementation of EpicCare campus-wide. METHODS: A customized 19-question electronic survey utilizing usability constructs based on the Health Information Technology Usability Evaluation Scale was anonymously administered prior to EHR transition. Responses were recorded with self-reported demographics. RESULTS: A total of 1,666 CU and 1,065 WC staff with ambulatory self-identified work setting were chosen. Select demographic statistics between campus staff were generally similar with small differences in patterns of clinical and EHR experience. Results demonstrated significant differences in EHR usability perceptions among ambulatory staff based on role and EHR system. WC staff utilizing EpicCare accounted for more favorable usability metrics than CU across all constructs. Ordering providers (OPs) denoted less usability than non-OPs. The Perceived Usefulness and User Control constructs accounted for the largest differences in usability perceptions. The Cognitive Support and Situational Awareness construct was similarly low for both campuses. Prior EHR experience demonstrated limited associations. CONCLUSION: Usability perceptions can be affected by role and EHR system. OPs consistently denoted less usability overall and were more affected by EHR system than non-OPs. While there was greater perceived usability for EpicCare to perform tasks related to care coordination, documentation, and error prevention, there were persistent shortcomings regarding tab navigation and cognitive burden reduction, which have implications on provider efficiency and wellness.

Understanding the perceived role of electronic health records and workflow fragmentation on clinician documentation burden in emergency departments.

OBJECTIVE: Understand the perceived role of electronic health records (EHR) and workflow fragmentation on clinician documentation burden in the emergency department (ED). METHODS: From February to June 2022, we conducted semistructured interviews among a national sample of US prescribing providers and registered nurses who actively practice in the adult ED setting and use Epic Systems' EHR. We recruited participants through professional listservs, social media, and email invitations sent to healthcare professionals. We analyzed interview transcripts using inductive thematic analysis and interviewed participants until we achieved thematic saturation. We finalized themes through a consensus-building process. RESULTS: We conducted interviews with 12 prescribing providers and 12 registered nurses. Six themes were identified related to EHR factors perceived to contribute to documentation burden including lack of advanced EHR capabilities, absence of EHR optimization for clinicians, poor user interface design, hindered communication, increased manual work, and added workflow blockages, and five themes associated with cognitive load. Two themes emerged in the relationship between workflow fragmentation and EHR documentation burden: underlying sources and adverse consequences. DISCUSSION: Obtaining further stakeholder input and consensus is essential to determine whether these perceived burdensome EHR factors could be extended to broader contexts and addressed through optimizing existing EHR systems alone or through a broad overhaul of the EHR's architecture and primary purpose. CONCLUSION: While most clinicians perceived that the EHR added value to patient care and care quality, our findings underscore the importance of designing EHRs that are in harmony with ED clinical workflows to alleviate the clinician documentation burden.

Integrating health disparities content into health informatics courses: a cross-sectional survey study and recommendations.

Objective: To assess the extent to which health disparities content is integrated in multidisciplinary health informatics training programs and examine instructor perspectives surrounding teaching strategies and challenges, including student engagement with course material. Materials and Methods: Data for this cross-sectional, descriptive study were collected between April and October 2019. Instructors of informatics courses taught in the United States were recruited via listservs and email. Eligibility was contingent on course inclusion of disparities content. Participants completed an online survey with open- and closed-ended questions to capture administrative- and teaching-related aspects of disparities education within informatics. Quantitative data were analyzed using descriptive statistics; qualitative data were analyzed using inductive coding. Results: Invitations were sent to 141 individuals and 11 listservs. We obtained data from 23 instructors about 24 informatics courses containing health disparities content. Courses were taught primarily in graduate-level programs (n = 21, 87.5%) in informatics (n = 9, 33.3%), nursing (n = 7, 25.9%), and information science (n = 6, 22.2%). The average course covered 6.5 (range 2-13) social determinants of health; socioeconomic status and race/ethnicity (both n = 21, 87.5%) were most frequently addressed. Instructors described multiple obstacles, including lack of resources and time to cover disparities topics adequately, topic sensitivity, and student-related challenges (eg, lack of prior understanding about disparities). Discussion: A foundational and translational knowledge in health disparities is critical to a student's ability to develop future equitable informatics solutions. Based on our findings, we provide recommendations for the intentional and required integration of health disparities-specific content in informatics curricula and competencies.

Emergency Nursing Workforce, Burnout, and Job Turnover in the United States: A National Sample Survey Analysis.

INTRODUCTION: Few studies have examined emergency nurses who have left their job to better understand the reason behind job turnover. It also remains unclear whether emergency nurses differ from other nurses regarding burnout and job turnover reasons. Our study aimed to test differences in reasons for turnover or not currently working between emergency nurses and other nurses; and ascertain factors associated with burnout as a reason for turnover among emergency nurses. METHODS: We conducted a secondary analysis of 2018 National Sample Survey for Registered Nurses data (weighted N = 3,004,589) from Health Resources and Services Administration. Data were analyzed using descriptive statistics, chi-square and t-test, and unadjusted and adjusted logistic regression applying design sampling weights. RESULTS: There were no significant differences in burnout comparing emergency nurses with other nurses. Seven job turnover reasons were endorsed by emergency nurses and were significantly higher than other nurses: insufficient staffing (11.1%, 95% confidence interval [CI] 8.6-14.2, P = .01), physical demands (5.1%, 95% CI 3.4-7.6, P = .44), patient population (4.3%, 95% CI 2.9-6.3, P < .001), better pay elsewhere (11.5%, 95% CI 9-14.7, P < .001), career advancement/promotion (9.6%, 95% CI 7.0-13.2, P = .01), length of commute (5.1%, 95% CI 3.4-7.5, P = .01), and relocation (5%, 95% CI 3.6-7.0, P = .01). Increasing age and increased years since nursing licensure was associated with decreased odds of burnout. DISCUSSION: Several modifiable factors appear associated with job turnover. Interventions and future research should account for unit-specific factors that may precipitate nursing job turnover.

Natural Language Processing of Nursing Notes: An Integrative Review.

Natural language processing includes a variety of techniques that help to extract meaning from narrative data. In healthcare, medical natural language processing has been a growing field of study; however, little is known about its use in nursing. We searched PubMed, EMBASE, and CINAHL and found 689 studies, narrowed to 43 eligible studies using natural language processing in nursing notes. Data related to the study purpose, patient population, methodology, performance evaluation metrics, and quality indicators were extracted for each study. The majority (86%) of the studies were conducted from 2015 to 2021. Most of the studies (58%) used inpatient data. One of four studies used data from open-source databases. The most common standard terminologies used were the Unified Medical Language System and Systematized Nomenclature of Medicine, whereas nursing-specific standard terminologies were used only in eight studies. Full system performance metrics (eg, F score) were reported for 61% of applicable studies. The overall number of nursing natural language processing publications remains relatively small compared with the other medical literature. Future studies should evaluate and report appropriate performance metrics and use existing standard nursing terminologies to enable future scalability of the methods and findings.