The identification of clusters of risk factors and their association with hospitalizations or emergency department visits in home health care.

AIMS: To identify clusters of risk factors in home health care and determine if the clusters are associated with hospitalizations or emergency department visits. DESIGN: A retrospective cohort study. METHODS: This study included 61,454 patients pertaining to 79,079 episodes receiving home health care between 2015 and 2017 from one of the largest home health care organizations in the United States. Potential risk factors were extracted from structured data and unstructured clinical notes analysed by natural language processing. A K-means cluster analysis was conducted. Kaplan-Meier analysis was conducted to identify the association between clusters and hospitalizations or emergency department visits during home health care. RESULTS: A total of 11.6% of home health episodes resulted in hospitalizations or emergency department visits. Risk factors formed three clusters. Cluster 1 is characterized by a combination of risk factors related to "impaired physical comfort with pain," defined as situations where patients may experience increased pain. Cluster 2 is characterized by "high comorbidity burden" defined as multiple comorbidities or other risks for hospitalization (e.g., prior falls). Cluster 3 is characterized by "impaired cognitive/psychological and skin integrity" including dementia or skin ulcer. Compared to Cluster 1, the risk of hospitalizations or emergency department visits increased by 1.95 times for Cluster 2 and by 2.12 times for Cluster 3 (all p < .001). CONCLUSION: Risk factors were clustered into three types describing distinct characteristics for hospitalizations or emergency department visits. Different combinations of risk factors affected the likelihood of these negative outcomes. IMPACT: Cluster-based risk prediction models could be integrated into early warning systems to identify patients at risk for hospitalizations or emergency department visits leading to more timely, patient-centred care, ultimately preventing these events. PATIENT OR PUBLIC CONTRIBUTION: There was no involvement of patients in developing the research question, determining the outcome measures, or implementing the study.

Clinical notes: An untapped opportunity for improving risk prediction for hospitalization and emergency department visit during home health care.

BACKGROUND/OBJECTIVE: Between 10 and 25% patients are hospitalized or visit emergency department (ED) during home healthcare (HHC). Given that up to 40% of these negative clinical outcomes are preventable, early and accurate prediction of hospitalization risk can be one strategy to prevent them. In recent years, machine learning-based predictive modeling has become widely used for building risk models. This study aimed to compare the predictive performance of four risk models built with various data sources for hospitalization and ED visits in HHC. METHODS: Four risk models were built using different variables from two data sources: structured data (i.e., Outcome and Assessment Information Set (OASIS) and other assessment items from the electronic health record (EHR)) and unstructured narrative-free text clinical notes for patients who received HHC services from the largest non-profit HHC organization in New York between 2015 and 2017. Then, five machine learning algorithms (logistic regression, Random Forest, Bayesian network, support vector machine (SVM), and Naïve Bayes) were used on each risk model. Risk model performance was evaluated using the F-score and Precision-Recall Curve (PRC) area metrics. RESULTS: During the study period, 8373/86,823 (9.6%) HHC episodes resulted in hospitalization or ED visits. Among five machine learning algorithms on each model, the SVM showed the highest F-score (0.82), while the Random Forest showed the highest PRC area (0.864). Adding information extracted from clinical notes significantly improved the risk prediction ability by up to 16.6% in F-score and 17.8% in PRC. CONCLUSION: All models showed relatively good hospitalization or ED visit risk predictive performance in HHC. Information from clinical notes integrated with the structured data improved the ability to identify patients at risk for these emergent care events.

Detecting Language Associated With Home Healthcare Patient's Risk for Hospitalization and Emergency Department Visit.

BACKGROUND: About one in five patients receiving home healthcare (HHC) services are hospitalized or visit an emergency department (ED) during a home care episode. Early identification of at-risk patients can prevent these negative outcomes. However, risk indicators, including language in clinical notes that indicate a concern about a patient, are often hidden in narrative documentation throughout their HHC episode. OBJECTIVE: The aim of the study was to develop an automated natural language processing (NLP) algorithm to identify concerning language indicative of HHC patients' risk of hospitalizations or ED visits. METHODS: This study used the Omaha System-a standardized nursing terminology that describes problems/signs/symptoms that can occur in the community setting. First, five HHC experts iteratively reviewed the Omaha System and identified concerning concepts indicative of HHC patients' risk of hospitalizations or ED visits. Next, we developed and tested an NLP algorithm to identify these concerning concepts in HHC clinical notes automatically. The resulting NLP algorithm was applied on a large subset of narrative notes (2.3 million notes) documented for 66,317 unique patients ( n = 87,966 HHC episodes) admitted to one large HHC agency in the Northeast United States between 2015 and 2017. RESULTS: A total of 160 Omaha System signs/symptoms were identified as concerning concepts for hospitalizations or ED visits in HHC. These signs/symptoms belong to 31 of the 42 available Omaha System problems. Overall, the NLP algorithm showed good performance in identifying concerning concepts in clinical notes. More than 18% of clinical notes were detected as having at least one concerning concept, and more than 90% of HHC episodes included at least one Omaha System problem. The most frequently documented concerning concepts were pain, followed by issues related to neuromusculoskeletal function, circulation, mental health, and communicable/infectious conditions. CONCLUSION: Our findings suggest that concerning problems or symptoms that could increase the risk of hospitalization or ED visit were frequently documented in narrative clinical notes. NLP can automatically extract information from narrative clinical notes to improve our understanding of care needs in HHC. Next steps are to evaluate which concerning concepts identified in clinical notes predict hospitalization or ED visit.

Nursing Documentation Variation Across Different Medical Facilities Within an Integrated Healthcare System.

The purpose of this study was to demonstrate nursing documentation variation based on electronic health record design and its relationship with different levels of care by reviewing how various flowsheet measures, within the same electronic health record across an integrated healthcare system, are documented in different types of medical facilities. Flowsheet data with information on patients who were admitted to academic medical centers, community hospitals, and rehabilitation centers were used to calculate the frequency of flowsheet entries documented. We then compared the distinct flowsheet measures documented in five flowsheet templates across the different facilities. We observed that each type of healthcare facility appeared to have distinct clinical care foci and flowsheet measures documented differed within the same template based on facility type. Designing flowsheets tailored to study settings can meet the needs of end users and increase documentation efficiency by reducing time spent on unrelated flowsheet measures. Furthermore, this process can save nurses time for direct patient care.

Development and validation of early warning score system: A systematic literature review.

OBJECTIVES: This review aims to: 1) evaluate the quality of model reporting, 2) provide an overview of methodology for developing and validating Early Warning Score Systems (EWSs) for adult patients in acute care settings, and 3) highlight the strengths and limitations of the methodologies, as well as identify future directions for EWS derivation and validation studies. METHODOLOGY: A systematic search was conducted in PubMed, Cochrane Library, and CINAHL. Only peer reviewed articles and clinical guidelines regarding developing and validating EWSs for adult patients in acute care settings were included. 615 articles were extracted and reviewed by five of the authors. Selected studies were evaluated based on the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) checklist. The studies were analyzed according to their study design, predictor selection, outcome measurement, methodology of modeling, and validation strategy. RESULTS: A total of 29 articles were included in the final analysis. Twenty-six articles reported on the development and validation of a new EWS, while three reported on validation and model modification. Only eight studies met more than 75% of the items in the TRIPOD checklist. Three major techniques were utilized among the studies to inform their predictive algorithms: 1) clinical-consensus models (n = 6), 2) regression models (n = 15), and 3) tree models (n = 5). The number of predictors included in the EWSs varied from 3 to 72 with a median of seven. Twenty-eight models included vital signs, while 11 included lab data. Pulse oximetry, mental status, and other variables extracted from electronic health records (EHRs) were among other frequently used predictors. In-hospital mortality, unplanned transfer to the intensive care unit (ICU), and cardiac arrest were commonly used clinical outcomes. Twenty-eight studies conducted a form of model validation either within the study or against other widely-used EWSs. Only three studies validated their model using an external database separate from the derived database. CONCLUSION: This literature review demonstrates that the characteristics of the cohort, predictors, and outcome selection, as well as the metrics for model validation, vary greatly across EWS studies. There is no consensus on the optimal strategy for developing such algorithms since data-driven models with acceptable predictive accuracy are often site-specific. A standardized checklist for clinical prediction model reporting exists, but few studies have included reporting aligned with it in their publications. Data-driven models are subjected to biases in the use of EHR data, thus it is particularly important to provide detailed study protocols and acknowledge, leverage, or reduce potential biases of the data used for EWS development to improve transparency and generalizability.

Information Needs and the Use of Documentation to Support Collaborative Decision-Making: Implications for the Reduction of Central Line-Associated Blood Stream Infections.

It is clear that interdisciplinary communication and collaboration have the potential to mitigate healthcare-associated harm, yet there is limited research on how communication through documentation in the patient record can support collaborative decision making. Understanding what information is needed to support collaborative decision making is necessary to design electronic health information systems that facilitate effective communication and, ultimately, safe care. To explore this issue, we focused on information needs related to central venous catheter management and the prevention of central line-associated blood stream infections. Semistructured interviews were conducted with nurses working in an intensive care unit. Interview transcripts were analyzed using inductive thematic analysis. Three themes were identified: (1) challenges managing documentation in multiple places in the absence of formal documentation processes for central venous catheter management; (2) lack of standardized decision-making processes for managing central venous catheters; and (3) oral communication holds it together. Our findings provide a foundation for the development of EHR functional requirements that enhance communication regarding the management of central venous catheters and facilitate the prompt removal of unnecessary lines.

The Role of Nurse Managers in the Adoption of Health Information Technology: Findings From a Qualitative Study.

OBJECTIVE: This study aims to investigate the role of nurse managers in supporting point-of-care nurses' health information technology (IT) use and identify strategies employed by nurse managers to improve adoption, while also gathering point-of-care nurses' perceptions of these strategies. BACKGROUND: Nurse managers are essential in facilitating point-of-care nurses' use of health IT; however, the underlying phenomenon for this facilitation remains unreported. METHODS: A qualitative descriptive study was conducted with 10 nurse managers and 14 point-of-care nurses recruited from a mental health hospital environment in Ontario, Canada. Inductive and deductive content analyses were used to analyze the semistructured interviews. RESULTS: Nurse managers adopt the role of advocate, educator, and connector, using the following strategies: communicating system updates, demonstrating use of health IT, linking staff to resources, facilitating education, and providing IT oversight. CONCLUSIONS: Nurse managers use a variety of strategies to support nurses' use of health IT. Future research should focus on the effectiveness of these strategies.

Predicting emergency department visits and hospitalizations for patients with heart failure in home healthcare using a time series risk model.

OBJECTIVES: Little is known about proactive risk assessment concerning emergency department (ED) visits and hospitalizations in patients with heart failure (HF) who receive home healthcare (HHC) services. This study developed a time series risk model for predicting ED visits and hospitalizations in patients with HF using longitudinal electronic health record data. We also explored which data sources yield the best-performing models over various time windows. MATERIALS AND METHODS: We used data collected from 9362 patients from a large HHC agency. We iteratively developed risk models using both structured (eg, standard assessment tools, vital signs, visit characteristics) and unstructured data (eg, clinical notes). Seven specific sets of variables included: (1) the Outcome and Assessment Information Set, (2) vital signs, (3) visit characteristics, (4) rule-based natural language processing-derived variables, (5) term frequency-inverse document frequency variables, (6) Bio-Clinical Bidirectional Encoder Representations from Transformers variables, and (7) topic modeling. Risk models were developed for 18 time windows (1-15, 30, 45, and 60 days) before an ED visit or hospitalization. Risk prediction performances were compared using recall, precision, accuracy, F1, and area under the receiver operating curve (AUC). RESULTS: The best-performing model was built using a combination of all 7 sets of variables and the time window of 4 days before an ED visit or hospitalization (AUC = 0.89 and F1 = 0.69). DISCUSSION AND CONCLUSION: This prediction model suggests that HHC clinicians can identify patients with HF at risk for visiting the ED or hospitalization within 4 days before the event, allowing for earlier targeted interventions.

Factors Influencing Clinician Trust in Predictive Clinical Decision Support Systems for In-Hospital Deterioration: Qualitative Descriptive Study.

BACKGROUND: Clinician trust in machine learning-based clinical decision support systems (CDSSs) for predicting in-hospital deterioration (a type of predictive CDSS) is essential for adoption. Evidence shows that clinician trust in predictive CDSSs is influenced by perceived understandability and perceived accuracy. OBJECTIVE: The aim of this study was to explore the phenomenon of clinician trust in predictive CDSSs for in-hospital deterioration by confirming and characterizing factors known to influence trust (understandability and accuracy), uncovering and describing other influencing factors, and comparing nurses' and prescribing providers' trust in predictive CDSSs. METHODS: We followed a qualitative descriptive methodology conducting directed deductive and inductive content analysis of interview data. Directed deductive analyses were guided by the human-computer trust conceptual framework. Semistructured interviews were conducted with nurses and prescribing providers (physicians, physician assistants, or nurse practitioners) working with a predictive CDSS at 2 hospitals in Mass General Brigham. RESULTS: A total of 17 clinicians were interviewed. Concepts from the human-computer trust conceptual framework-perceived understandability and perceived technical competence (ie, perceived accuracy)-were found to influence clinician trust in predictive CDSSs for in-hospital deterioration. The concordance between clinicians' impressions of patients' clinical status and system predictions influenced clinicians' perceptions of system accuracy. Understandability was influenced by system explanations, both global and local, as well as training. In total, 3 additional themes emerged from the inductive analysis. The first, perceived actionability, captured the variation in clinicians' desires for predictive CDSSs to recommend a discrete action. The second, evidence, described the importance of both macro- (scientific) and micro- (anecdotal) evidence for fostering trust. The final theme, equitability, described fairness in system predictions. The findings were largely similar between nurses and prescribing providers. CONCLUSIONS: Although there is a perceived trade-off between machine learning-based CDSS accuracy and understandability, our findings confirm that both are important for fostering clinician trust in predictive CDSSs for in-hospital deterioration. We found that reliance on the predictive CDSS in the clinical workflow may influence clinicians' requirements for trust. Future research should explore the impact of reliance, the optimal explanation design for enhancing understandability, and the role of perceived actionability in driving trust.

Unique Patient-Reported Hospital Safety Concerns With Online Tool: MySafeCare.

BACKGROUND: Hospitalized patients and their care partners have valuable and unique perspectives of the medical care they receive. Direct and real-time reporting of patients' safety concerns, though limited in the acute care setting, could provide opportunities to improve patient care. METHODS: We implemented the MySafeCare (MSC) application on six acute care units for 18 months as part of a patient-centered health information technology intervention to promote engagement and safety in the acute care setting. The web-based application allowed hospitalized patients to submit safety concerns anonymously and in real time. We describe characteristics of patient submissions including their categorizations. We evaluated rates of submissions to MSC and compared them with rates of submissions to the Patient Family Relations department at the hospital. In addition, we performed thematic analysis of narrative concerns submitted to the application. RESULTS: We received 46 submissions to MSC and 33% of concerns received were anonymous. The overall rate of submissions was 0.6 submissions per 1000 patient-days and was considerably lower than the rate of submissions to the Patient Family Relations during the same period (4.1 per 1000 patient-days). Identified themes of narrative concerns included unmet care needs and preferences, inadequate communication, and concerns about safety of care. CONCLUSIONS: Although the submission rate to the application was low, MSC captured important content directly from hospitalized patients or their care partners. A web-based patient safety reporting tool for patients should be studied further to understand patient and care partner use and willingness to engage, as well as potential effects on patient safety outcomes.

25 × 5 Symposium to Reduce Documentation Burden: Report-out and Call for Action.

BACKGROUND: The widespread adoption of electronic health records and a simultaneous increase in regulatory demands have led to an acceleration of documentation requirements among clinicians. The corresponding burden from documentation requirements is a central contributor to clinician burnout and can lead to an increased risk of suboptimal patient care. OBJECTIVE: To address the problem of documentation burden, the 25 by 5: Symposium to Reduce Documentation Burden on United States Clinicians by 75% by 2025 (Symposium) was organized to provide a forum for experts to discuss the current state of documentation burden and to identify specific actions aimed at dramatically reducing documentation burden for clinicians. METHODS: The Symposium consisted of six weekly sessions with 33 presentations. The first four sessions included panel presentations discussing the challenges related to documentation burden. The final two sessions consisted of breakout groups aimed at engaging attendees in establishing interventions for reducing clinical documentation burden. Steering Committee members analyzed notes from each breakout group to develop a list of action items. RESULTS: The Steering Committee synthesized and prioritized 82 action items into Calls to Action among three stakeholder groups: Providers and Health Systems, Vendors, and Policy and Advocacy Groups. Action items were then categorized into as short-, medium-, or long-term goals. Themes that emerged from the breakout groups' notes include the following: accountability, evidence is critical, education and training, innovation of technology, and other miscellaneous goals (e.g., vendors will improve shared knowledge databases). CONCLUSION: The Symposium successfully generated a list of interventions for short-, medium-, and long-term timeframes as a launching point to address documentation burden in explicit action-oriented ways. Addressing interventions to reduce undue documentation burden placed on clinicians will necessitate collaboration among all stakeholders.

Documentation of hospitalization risk factors in electronic health records (EHRs): a qualitative study with home healthcare clinicians.

OBJECTIVE: To identify the risk factors home healthcare (HHC) clinicians associate with patient deterioration and understand how clinicians respond to and document these risk factors. METHODS: We interviewed multidisciplinary HHC clinicians from January to March of 2021. Risk factors were mapped to standardized terminologies (eg, Omaha System). We used directed content analysis to identify risk factors for deterioration. We used inductive thematic analysis to understand HHC clinicians' response to risk factors and documentation of risk factors. RESULTS: Fifteen HHC clinicians identified a total of 79 risk factors that were mapped to standardized terminologies. HHC clinicians most frequently responded to risk factors by communicating with the prescribing provider (86.7% of clinicians) or following up with patients and caregivers (86.7%). HHC clinicians stated that a majority of risk factors can be found in clinical notes (ie, care coordination (53.3%) or visit (46.7%)). DISCUSSION: Clinicians acknowledged that social factors play a role in deterioration risk; but these factors are infrequently studied in HHC. While a majority of risk factors were represented in the Omaha System, additional terminologies are needed to comprehensively capture risk. Since most risk factors are documented in clinical notes, methods such as natural language processing are needed to extract them. CONCLUSION: This study engaged clinicians to understand risk for deterioration during HHC. The results of our study support the development of an early warning system by providing a comprehensive list of risk factors grounded in clinician expertize and mapped to standardized terminologies.

Comparison of a Voluntary Safety Reporting System to a Global Trigger Tool for Identifying Adverse Events in an Oncology Population.

OBJECTIVE: There is a lack of research on adverse event (AE) detection in oncology patients, despite the propensity for iatrogenic harm. Two common methods include voluntary safety reporting (VSR) and chart review tools, such as the Institute for Healthcare Improvement's Global Trigger Tool (GTT). Our objective was to compare frequency and type of AEs detected by a modified GTT compared with VSR for identifying AEs in oncology patients in a larger clinical trial. METHODS: Patients across 6 oncology units (from July 1, 2013, through May 29, 2015) were randomly selected. Retrospective chart reviews were conducted by a team of nurses and physicians to identify AEs using the GTT. The VSR system was queried by the department of quality and safety of the hospital. Adverse event frequencies, type, and harm code for both methods were compared. RESULTS: The modified GTT detected 0.90 AEs per patient (79 AEs in 88 patients; 95% [0.71-1.12] AEs per patient) that were predominantly medication AEs (53/79); more than half of the AEs caused harm to the patients (41/79, 52%), but only one quarter were preventable (21/79; 27%). The VSR detected 0.24 AEs per patient (21 AEs in 88 patients; 95% [0.15-0.37] AEs per patient), a large plurality of which were medication/intravenous related (8/21); more than half did not cause harm (70%). Only 2% of the AEs (2/100) were detected by both methods. CONCLUSIONS: Neither the modified GTT nor the VSR system alone is sufficient for detecting AEs in oncology patient populations. Further studies exploring methods such as automated AE detection from electronic health records and leveraging patient-reported AEs are needed.

Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review.

BACKGROUND: . OBJECTIVE: Electronic health records (EHRs) are linked with documentation burden resulting in clinician burnout. While clear classifications and validated measures of burnout exist, documentation burden remains ill-defined and inconsistently measured. We aim to conduct a scoping review focused on identifying approaches to documentation burden measurement and their characteristics. MATERIALS AND METHODS: Based on Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) Extension for Scoping Reviews (ScR) guidelines, we conducted a scoping review assessing MEDLINE, Embase, Web of Science, and CINAHL from inception to April 2020 for studies investigating documentation burden among physicians and nurses in ambulatory or inpatient settings. Two reviewers evaluated each potentially relevant study for inclusion/exclusion criteria. RESULTS: Of the 3482 articles retrieved, 35 studies met inclusion criteria. We identified 15 measurement characteristics, including 7 effort constructs: EHR usage and workload, clinical documentation/review, EHR work after hours and remotely, administrative tasks, cognitively cumbersome work, fragmentation of workflow, and patient interaction. We uncovered 4 time constructs: average time, proportion of time, timeliness of completion, activity rate, and 11 units of analysis. Only 45.0% of studies assessed the impact of EHRs on clinicians and/or patients and 40.0% mentioned clinician burnout. DISCUSSION: Standard and validated measures of documentation burden are lacking. While time and effort were the core concepts measured, there appears to be no consensus on the best approach nor degree of rigor to study documentation burden. CONCLUSION: Further research is needed to reliably operationalize the concept of documentation burden, explore best practices for measurement, and standardize its use.

Identifying Urinary Tract Infection-Related Information in Home Care Nursing Notes.

OBJECTIVES: Urinary tract infection (UTI) is common in home care but not easily captured with standard assessment. This study aimed to examine the value of nursing notes in detecting UTI signs and symptoms in home care. DESIGN: The study developed a natural language processing (NLP) algorithm to automatically identify UTI-related information in nursing notes. SETTING AND PARTICIPANTS: Home care visit notes (n = 1,149,586) and care coordination notes (n = 1,461,171) for 89,459 patients treated in the largest nonprofit home care agency in the United States during 2014. MEASURES: We generated 6 categories of UTI-related information from literature and used the Unified Medical Language System (UMLS) to identify a preliminary list of terms. The NLP algorithm was tested on a gold standard set of 300 clinical notes annotated by clinical experts. We used structured Outcome and Assessment Information Set data to extract the frequency of UTI-related emergency department (ED) visits or hospitalizations and explored time-patterns in documentation of UTI-related information. RESULTS: The NLP system achieved very good overall performance (F measure = 0.9, 95% CI: 0.87-0.93) based on the test results obtained by using the notes for patients admitted to the ED or hospital due to UTI. UTI-related information was significantly more prevalent (P < .01 for all the tests) in home care episodes with UTI-related ED admission or hospitalization vs the general patient population; 81% of home care episodes with UTI-related hospitalization or ED admission had at least 1 category of UTI-related information vs 21.6% among episodes without UTI-related hospitalization or ED admission. Frequency of UTI-related information documentation increased in advance of UTI-related hospitalization or ED admission, peaking within a few days before the event. CONCLUSIONS AND IMPLICATIONS: Information in nursing notes is often overlooked by stakeholders and not integrated into predictive modeling for decision-making support, but our findings highlight their value in early risk identification and care guidance. Health care administrators should consider using NLP to extract clinical data from nursing notes to improve early detection and treatment, which may lead to quality improvement and cost reduction.

Characterizing Multitasking and Workflow Fragmentation in Electronic Health Records among Emergency Department Clinicians: Using Time-Motion Data to Understand Documentation Burden.

BACKGROUND: The impact of electronic health records (EHRs) in the emergency department (ED) remains mixed. Dynamic and unpredictable, the ED is highly vulnerable to workflow interruptions. OBJECTIVES: The aim of the study is to understand multitasking and task fragmentation in the clinical workflow among ED clinicians using clinical information systems (CIS) through time-motion study (TMS) data, and inform their applications to more robust and generalizable measures of CIS-related documentation burden. METHODS: Using TMS data collected among 15 clinicians in the ED, we investigated the role of documentation burden, multitasking (i.e., performing physical and communication tasks concurrently), and workflow fragmentation in the ED. We focused on CIS-related tasks, including EHRs. RESULTS: We captured 5,061 tasks and 877 communications in 741 locations within the ED. Of the 58.7 total hours observed, 44.7% were spent on CIS-related tasks; nearly all CIS-related tasks focused on data-viewing and data-entering. Over one-fifth of CIS-related task time was spent on multitasking. The mean average duration among multitasked CIS-related tasks was shorter than non-multitasked CIS-related tasks (20.7 s vs. 30.1 s). Clinicians experienced 1.4 ± 0.9 task switches/min, which increased by one-third when multitasking. Although multitasking was associated with a significant increase in the average duration among data-entering tasks, there was no significant effect on data-viewing tasks. When engaged in CIS-related task switches, clinicians were more likely to return to the same CIS-related task at higher proportions while multitasking versus not multitasking. CONCLUSION: Multitasking and workflow fragmentation may play a significant role in EHR documentation among ED clinicians, particularly among data-entering tasks. Understanding where and when multitasking and workflow fragmentation occurs is a crucial step to assessing potentially burdensome clinician tasks and mitigating risks to patient safety. These findings may guide future research on developing more scalable and generalizable measures of CIS-related documentation burden that do not necessitate direct observation techniques (e.g., EHR log files).

Clinician and Health Care Leaders' Experiences with-and Perceptions of-COVID-19 Documentation Reduction Policies and Practices.

BACKGROUND: Substantial strategies to reduce clinical documentation were implemented by health care systems throughout the coronavirus disease-2019 (COVID-19) pandemic at national and local levels. This natural experiment provides an opportunity to study the impact of documentation reduction strategies on documentation burden among clinicians and other health professionals in the United States. OBJECTIVES: The aim of this study was to assess clinicians' and other health care leaders' experiences with and perceptions of COVID-19 documentation reduction strategies and identify which implemented strategies should be prioritized and remain permanent post-pandemic. METHODS: We conducted a national survey of clinicians and health care leaders to understand COVID-19 documentation reduction strategies implemented during the pandemic using snowball sampling through professional networks, listservs, and social media. We developed and validated a 19-item survey leveraging existing post-COVID-19 policy and practice recommendations proposed by Sinsky and Linzer. Participants rated reduction strategies for impact on documentation burden on a scale of 0 to 100. Free-text responses were thematically analyzed. RESULTS: Of the 351 surveys initiated, 193 (55%) were complete. Most participants were informaticians and/or clinicians and worked for a health system or in academia. A majority experienced telehealth expansion (81.9%) during the pandemic, which participants also rated as highly impactful (60.1-61.5) and preferred that it remain (90.5%). Implemented at lower proportions, documenting only pertinent positives to reduce note bloat (66.1 ± 28.3), changing compliance rules and performance metrics to eliminate those without evidence of net benefit (65.7 ± 26.3), and electronic health record (EHR) optimization sprints (64.3 ± 26.9) received the highest impact scores compared with other strategies presented; support for these strategies widely ranged (49.7-63.7%). CONCLUSION: The results of this survey suggest there are many perceived sources of and solutions for documentation burden. Within strategies, we found considerable support for telehealth, documenting pertinent positives, and changing compliance rules. We also found substantial variation in the experience of documentation burden among participants.

Healthcare Process Modeling to Phenotype Clinician Behaviors for Exploiting the Signal Gain of Clinical Expertise (HPM-ExpertSignals): Development and evaluation of a conceptual framework.

OBJECTIVE: There are signals of clinicians' expert and knowledge-driven behaviors within clinical information systems (CIS) that can be exploited to support clinical prediction. Describe development of the Healthcare Process Modeling Framework to Phenotype Clinician Behaviors for Exploiting the Signal Gain of Clinical Expertise (HPM-ExpertSignals). MATERIALS AND METHODS: We employed an iterative framework development approach that combined data-driven modeling and simulation testing to define and refine a process for phenotyping clinician behaviors. Our framework was developed and evaluated based on the Communicating Narrative Concerns Entered by Registered Nurses (CONCERN) predictive model to detect and leverage signals of clinician expertise for prediction of patient trajectories. RESULTS: Seven themes-identified during development and simulation testing of the CONCERN model-informed framework development. The HPM-ExpertSignals conceptual framework includes a 3-step modeling technique: (1) identify patterns of clinical behaviors from user interaction with CIS; (2) interpret patterns as proxies of an individual's decisions, knowledge, and expertise; and (3) use patterns in predictive models for associations with outcomes. The CONCERN model differentiated at risk patients earlier than other early warning scores, lending confidence to the HPM-ExpertSignals framework. DISCUSSION: The HPM-ExpertSignals framework moves beyond transactional data analytics to model clinical knowledge, decision making, and CIS interactions, which can support predictive modeling with a focus on the rapid and frequent patient surveillance cycle. CONCLUSIONS: We propose this framework as an approach to embed clinicians' knowledge-driven behaviors in predictions and inferences to facilitate capture of healthcare processes that are activated independently, and sometimes well before, physiological changes are apparent.

Identifying nursing documentation patterns associated with patient deterioration and recovery from deterioration in critical and acute care settings.

OBJECTIVES: Nursing documentation behavior within electronic health records may reflect a nurse's concern about a patient and can be used to predict patient deterioration. Our study objectives were to quantify variations in nursing documentation patterns, confirm those patterns and variations with clinicians, and identify which patterns indicate patient deterioration and recovery from clinical deterioration events in the critical and acute care settings. METHODS: We collected patient data from electronic health records and conducted a regression analysis to identify different nursing documentation patterns associated with patient outcomes resulting from clinical deterioration events in the intensive care unit (ICU) and acute care unit (ACU). The primary outcome measures were whether patients were discharged alive from the hospital or expired during their hospital encounter. Secondary outcome measures were clinical deterioration events. RESULTS: In the ICU, the increased documentation of heart rate, body temperature, and withheld medication administrations were significantly associated with inpatient mortality. In the ACU, the documentation of blood pressure, respiratory rate with comments, singular vital signs, and withheld medications were significantly related to inpatient mortality. In contrast, the documentation of heart rate and "as needed" medication administrations were significantly associated with patient survival to discharge in the ACU. CONCLUSION: We successfully identified and confirmed the clinical relevancy of the nursing documentation patterns indicative of patient deterioration and recovery from clinical deterioration events in both the ICU and ACU.

The Communicating Narrative Concerns Entered by Registered Nurses (CONCERN) Clinical Decision Support Early Warning System: Protocol for a Cluster Randomized Pragmatic Clinical Trial.

BACKGROUND: Every year, hundreds of thousands of inpatients die from cardiac arrest and sepsis, which could be avoided if those patients' risk for deterioration were detected and timely interventions were initiated. Thus, a system is needed to convert real-time, raw patient data into consumable information that clinicians can utilize to identify patients at risk of deterioration and thus prevent mortality and improve patient health outcomes. The overarching goal of the COmmunicating Narrative Concerns Entered by Registered Nurses (CONCERN) study is to implement and evaluate an early warning score system that provides clinical decision support (CDS) in electronic health record systems. With a combination of machine learning and natural language processing, the CONCERN CDS utilizes nursing documentation patterns as indicators of nurses' increased surveillance to predict when patients are at the risk of clinical deterioration. OBJECTIVE: The objective of this cluster randomized pragmatic clinical trial is to evaluate the effectiveness and usability of the CONCERN CDS system at 2 different study sites. The specific aim is to decrease hospitalized patients' negative health outcomes (in-hospital mortality, length of stay, cardiac arrest, unanticipated intensive care unit transfers, and 30-day hospital readmission rates). METHODS: A multiple time-series intervention consisting of 3 phases will be performed through a 1-year period during the cluster randomized pragmatic clinical trial. Phase 1 evaluates the adoption of our algorithm through pilot and trial testing, phase 2 activates optimized versions of the CONCERN CDS based on experience from phase 1, and phase 3 will be a silent release mode where no CDS is viewable to the end user. The intervention deals with a series of processes from system release to evaluation. The system release includes CONCERN CDS implementation and user training. Then, a mixed methods approach will be used with end users to assess the system and clinician perspectives. RESULTS: Data collection and analysis are expected to conclude by August 2022. Based on our previous work on CONCERN, we expect the system to have a positive impact on the mortality rate and length of stay. CONCLUSIONS: The CONCERN CDS will increase team-based situational awareness and shared understanding of patients predicted to be at risk for clinical deterioration in need of intervention to prevent mortality and associated harm. TRIAL REGISTRATION: ClinicalTrials.gov NCT03911687; https://clinicaltrials.gov/ct2/show/NCT03911687. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/30238.