Use of Real-Time Information to Predict Future Arrivals in the Emergency Department.

STUDY OBJECTIVE: We aimed to build prediction models for shift-level emergency department (ED) patient volume that could be used to facilitate prediction-driven staffing. We sought to evaluate the predictive power of rich real-time information and understand 1) which real-time information had predictive power and 2) what prediction techniques were appropriate for forecasting ED demand. METHODS: We conducted a retrospective study in an ED site in a large academic hospital in New York City. We examined various prediction techniques, including linear regression, regression trees, extreme gradient boosting, and time series models. By comparing models with and without real-time predictors, we assessed the potential gain in prediction accuracy from real-time information. RESULTS: Real-time predictors improved prediction accuracy on models without contemporary information from 5% to 11%. Among extensive real-time predictors examined, recent patient arrival counts, weather, Google trends, and concurrent patient comorbidity information had significant predictive power. Out of all the forecasting techniques explored, SARIMAX (Seasonal Autoregressive Integrated Moving Average with eXogenous factors) achieved the smallest out-of-sample the root mean square error (RMSE) of 14.656 and mean absolute prediction error (MAPE) of 8.703%. Linear regression was the second best, with out-of-sample RMSE and MAPE equal to 15.366 and 9.109%, respectively. CONCLUSION: Real-time information was effective in improving the prediction accuracy of ED demand. Practice and policy implications for designing staffing paradigms with real-time demand forecasts to reduce ED congestion were discussed.

Primary Care Nurse Practitioner Work Environments and Hospitalizations and ED Use Among Chronically Ill Medicare Beneficiaries.

BACKGROUND: Nurse practitioners (NPs) play a critical role in delivering primary care, particularly to chronically ill elderly. Yet, many NPs practice in poor work environments which may affect patient outcomes. OBJECTIVE: We investigated the relationship between NP work environments in primary care practices and hospitalizations and emergency department (ED) use among chronically ill elderly. RESEARCH DESIGN: We used a cross-sectional design to collect survey data from NPs about their practices. The survey data were merged with Medicare claims data. SUBJECTS: In total, 979 primary care practices employing NPs and delivering care to chronically ill Medicare beneficiaries (n=452,931) from 6 US states were included. MEASURES: NPs completed the Nurse Practitioner-Primary Care Organizational Climate Questionnaire-a valid and reliable measure for work environment. Data on hospitalizations and ED use was obtained from Medicare claims. We used Cox regression models to estimate risk ratios. RESULTS: After controlling for covariates, we found statistically significant associations between practice-level NP work environment and 3 outcomes: Ambulatory Care Sensitive (ACS) ED visits, all-cause ED visits, and all-cause hospitalizations. With a 1-unit increase in the work environment score, the risk of an ACS-ED visit decreased by 4.4% [risk ratio (RR)=0.956; 99% confidence interval (CI): 0.918-0.995; P=0.004], an ED visit by 3.5% (RR=0.965; 99% CI: 0.933-0.997; P=0.005), and a hospitalization by 4.0% (RR=0.960;99% CI: 0.928-0.993; P=0.002). There was no relationship between NP work environment and ACS hospitalizations. CONCLUSION: Favorable NP work environments are associated with lower hospital and ED utilization. Practice managers should focus on NP work environments in quality improvement strategies.

The mediating role of anxiety/depression symptoms between adverse childhood experiences (ACEs) and somatic symptoms in adolescents.

INTRODUCTION: This study examines the relationships among recent adverse childhood experiences (ACEs), somatic symptoms, and anxiety/depression symptoms during adolescence and whether anxiety/depression symptoms mediate the relationship between ACEs and somatic symptoms. METHODS: Longitudinal prospective data from the Longitudinal Studies of Child Abuse and Neglect study of 1354 children and their primary caregivers in the United States was used in this study. A longitudinal cross-lagged path analysis among recent ACEs, anxiety/depression symptoms, and somatic symptoms at three points during adolescence (ages 12, 14, and 16 years) was conducted. RESULTS: The sample was 51% female and 53% African American. The results indicated significant concurrent associations between recent ACEs and increased anxiety/depression symptoms at ages 12, 14, and 16 (ß = .27, p < .001; ß = .15, p < .001; ß = .07, p < .05) and between anxiety/depression symptoms and increased somatic symptoms at ages 12, 14, and 16 years (ß = .44, p < .001; ß = .39, p < .001; ß = .49, p < .001). Moreover, anxiety/depression symptoms significantly mediated the relationship between recent ACEs and concurrent somatic symptoms at ages 12, 14, and 16 years (ß = .12, p < .001; ß = .06, p < .001; ß = .04, p < .05). However, there was no significant relationship between recent ACEs and somatic symptoms. CONCLUSION: The findings suggest that anxiety/depression symptoms mediate the concurrent relationships between recent ACEs and somatic symptoms at ages 12, 14, and 16. Clinicians should consider assessing anxiety/depression symptoms and possible concurrent exposure to ACEs when caring for adolescents who present with somatic symptoms.

Nursing Documentation Variation Across Different Medical Facilities Within an Integrated Healthcare System.

The purpose of this study was to demonstrate nursing documentation variation based on electronic health record design and its relationship with different levels of care by reviewing how various flowsheet measures, within the same electronic health record across an integrated healthcare system, are documented in different types of medical facilities. Flowsheet data with information on patients who were admitted to academic medical centers, community hospitals, and rehabilitation centers were used to calculate the frequency of flowsheet entries documented. We then compared the distinct flowsheet measures documented in five flowsheet templates across the different facilities. We observed that each type of healthcare facility appeared to have distinct clinical care foci and flowsheet measures documented differed within the same template based on facility type. Designing flowsheets tailored to study settings can meet the needs of end users and increase documentation efficiency by reducing time spent on unrelated flowsheet measures. Furthermore, this process can save nurses time for direct patient care.

Exploring Practices of Bedside Shift Report and Hourly Rounding. Is There an Impact on Patient Falls?

OBJECTIVE: To describe the relationship of inpatient falls to bedside shift report (BSR) and hourly rounding (HR). BACKGROUND: Falls are a major healthcare concern. Although measures such as BSR and HR are reported to reduce falls, studies are often based on self-reported data related to nurse compliance with protocols for HR and bedside report. METHODS: Observational data were collected on nursing tasks, including BSR and HR. RESULTS: Nine thousand six hundred ninety-three observations were recorded on 11 units at 4 hospitals over 281 shifts. Falls were associated with shift and day of the week but not BSR, HR, or the frequency of encounters with the patient. The regression model included frequency with patient, shift, day of week, and HR. CONCLUSIONS: Increased nurse frequency with patient may signal increased fall risks. Bedside shift report and HR may require robust and sustained interventions to provide lasting effects.

Programmatic details and outcomes of an Academic-Practice Research Fellowship for clinical nurses.

AIM: Describe the programmatic details and outcomes of a competitive, two-year Academic-Practice Research Fellowship for clinical nurses. BACKGROUND: Numerous barriers challenge clinical nurses in their ability to conduct and disseminate research. We describe and evaluate a competitive, semi-structured, two-year Academic-Practice Research Fellowship in which clinical nurse 'fellows' accepted into the program are paired with a faculty mentor at a school of nursing to conduct and disseminate a research study that addresses a clinical problem identified by the fellow. The fellowship is facilitated by the Director of Academic-Practice Partnerships jointly appointed between a school of nursing and affiliated acute care hospitals, and with resources provided by both. The vast majority of didactic training is provided outside the classroom. METHODS: We reviewed administrative records to describe the programmatic details and outcomes of the program. RESULTS: Thirteen nurses were accepted into the first three cohorts of the Academic-Practice Research Fellowship. Among the five fellows in the graduating first cohort, all successfully completed their research, presented their findings at national or international conference(s) and four have submitted manuscripts for publication, with two being accepted for publication. The eight current fellows are meeting all delineated milestones and timelines. Evaluations demonstrate the effectiveness of the fellowship in enhancing the professional development and research capacity of clinical nurses. CONCLUSIONS: The Academic-Practice Research Fellowship program integrates expertise and resources across academia and practice and has resulted in the successful conduct and dissemination of clinically relevant research by fulltime practicing nurses in the acute care setting.

The Jonas Scholars Program-Evaluation of a decade-long program to advance doctoral-prepared nurses.

BACKGROUND: The Jonas Scholars Program of Jonas Nursing & Veterans Healthcare aims to advance the pipeline of doctoral-prepared, research-focused, and practice-focused faculty via student financial support and leadership training. PURPOSE: Program evaluation of the Jonas Scholars Program. We describe the reach of the program over time, scholar characteristics, and report on graduated scholars that are currently employed in faculty and clinical positions. METHOD: Retrospective analysis of administrative records from the Jonas Scholars Program spanning 2008 to 2016. FINDINGS: The Jonas Scholars Program has grown substantially since its inception. From 2008 to 2016, a total of 1,032 doctoral students at 174 universities across the United States have received financial support through the program. Scholars have a mean age of 38 and nearly two-thirds are enrolled in a research-focused PhD program. Most graduated scholars for which data are available are primarily faculty in nursing schools 185 (30.7%), providing direct patient care 171 (28.4%), or conducting research 118 (19.8%). DISCUSSION: The Jonas Scholars Program supports the pipeline of a younger generation of doctoral-prepared nurses that are faculty in schools of nursing, providing direct patient care and conducting research.

Concurrent Detection of Bacterial Pathogens in Hospital Roommates.

BACKGROUND: Some nurse-driven interventions have successfully reduced rates of healthcare-associated infections, though incidence remains unacceptably high. Bacterial contamination in patient rooms may be a source of exposure for patients and thus a target for future interventions; however, few studies have investigated the role of the patient room on organism acquisition. OBJECTIVES: The purpose of this study was to determine the incidence of concurrent detection of bacterial pathogens among patients sharing a hospital room. METHODS: We performed a retrospective network analysis using electronic administrative and clinical data collected from all patients admitted in 2006 through 2012 to four New York City hospitals, totaling 2,065 beds within 183 inpatient units. A computerized algorithm identified concurrent organism detection among roommates, defined as two patients who shared a room on at least 1 day and had a first positive culture for the same organism within 3 days following cohabitation. RESULTS: In total, 741,271 patient admissions were included. The algorithm identified 373 concurrent detection events: 158 (42%) in which the patients' first positive cultures were drawn after they were no longer sharing a room but within 3 days of cohabitation, 144 (39%) in which the patients' first positive cultures were drawn while they were still sharing a room but on different days, and 71 (19%) in which the patients' first positive cultures were drawn while they were sharing a room on the same day. DISCUSSION: Methods to improve environmental decontamination should be included as part of a comprehensive approach to infection prevention in hospitals. Nurses have an important role to play in the planning and implementation of interventions to reduce bioburden in the patient environment.

Linking to Improve Nursing Care and Knowledge: Evaluation of an Initiative to Provide Research Support to Clinical Nurses.

OBJECTIVES: The aim of this study is to describe and evaluate the impact of the Linking to Improve Nursing Care and Knowledge (LINK) project on increasing nurse-led clinical research. BACKGROUND: Nurse-generated research is the cornerstone of evidence-based practice and continues to be a marker of nursing excellence. However, the dearth of PhD-prepared nurses creates a challenge for creating an environment to promote clinical nursing research. We evaluated the LINK project, an academic-clinical partnership, to assess its impact and feasibility, for fostering nurse-led clinical research. METHODS: The LINK project created a formal command and control structure bringing together existing academic resources, including a PhD-prepared nurse researcher, a biostatistician, and a development of a formal research consultation request process. Measures tracked over a 12-month period included average response time, request volume, client satisfaction, institutional review board (IRB)-submitted protocols, and work products. RESULTS: All measures exceeded expectations with an average 1-day request response time, 35 requests, 98% client satisfaction, a 367% increase in nurse-led IRB approved protocols from the previous 12-month period, and 2 publications in peer-reviewed journals. CONCLUSIONS: The process and outcome measures indicate that the LINK project is feasible, sustainable, and reproducible. We were able to meet and, in many cases, exceed measurement goals. In addition, implementation science literature indicates that the most valid measure of a successful project rollout is user satisfaction and usefulness. The LINK project received consistently positive feedback.

Targeted Interventions to Advance a Culture of Inquiry at a Large, Multicampus Hospital Among Nurses.

OBJECTIVES: The aim of this study is to assist nurse leaders in developing innovative structures to foster a culture of inquiry among professional nurses. BACKGROUND: Critical to nurse's engagement in evidence-based practice (EBP) is a culture of inquiry, in which nurses critically evaluate patient care activities and actively review existing evidence to address identified clinical issues. A bundle of structural interventions was implemented across a large, multisite hospital to advance a culture of inquiry. We measured the impact of these interventions on nurses' library use and on nurses' knowledge, attitudes, and practices towards EBP. METHODS: Structural interventions included: 1) EBP and Research Committee meetings, in which nurses were educated on how to formulate a clinical question and critically appraise a research article; 2) Academic Partners Program, in which nurse academicians provided scholarly mentorship and guidance during monthly committee meetings; 3) hiring of clinical nurse scientists who provided 1-on-1 education and mentorship to clinical nurses in EBP and research; and 4) a Nurse Residency Program partnership, in which newly graduated nurses were required to complete an EBP project. We examined the impact of these structural interventions on nurses' use of library resources and nurses' knowledge, attitudes, and practices toward EBP. RESULTS: The implementation of structural interventions to support nurses' engagement in EBP was associated with a significant increase in the number of nurse-generated library consultative requests over time. Results showed high levels of nurse knowledge, attitudes, and practices in EBP. CONCLUSIONS: Nurse leaders may advance a culture of inquiry by providing the infrastructure to support EBP activities and by empowering nurses to question and seek answer to identified practice questions. Infrastructures should include access to scientific articles and partnerships with schools of nursing. Additional research is needed to validate nurse library use as a measure of nurse engagement in EBP.

Visualization of Data Regarding Infections Using Eye Tracking Techniques.

OBJECTIVE: To evaluate ease of use and usefulness for nurses of visualizations of infectious disease transmission in a hospital. DESIGN: An observational study was used to evaluate perceptions of several visualizations of data extracted from electronic health records designed using a participatory approach. Twelve nurses in the master's program in an urban research-intensive nursing school participated in May 2015. METHODS: A convergent parallel mixed method was used to evaluate nurses' perceptions on ease of use and usefulness of five visualization conveying trends in hospital infection transmission applying think-aloud, interview, and eye-tracking techniques. FINDINGS: Subjective data from the interview and think-aloud techniques indicated that participants preferred the traditional line graphs in simple data representation due to their familiarity, clarity, and easiness to read. An objective quantitative measure of eye movement analysis (444,421 gaze events) identified a high degree of participants' attention span in infographics in all three scenarios. All participants responded with the correct answer within 1 min in comprehensive tests. CONCLUSIONS: A user-centric approach was effective in developing and evaluating visualizations for hospital infection transmission. For the visualizations designed by the users, the participants were easily able to comprehend the infection visualizations on both line graphs and infographics for simple visualization. The findings from the objective comprehension test and eye movement and subjective attitudes support the feasibility of integrating user-centric visualization designs into electronic health records, which may inspire clinicians to be mindful of hospital infection transmission. Future studies are needed to investigate visualizations and motivation, and the effectiveness of visualization on infection rate. CLINICAL RELEVANCE: This study designed visualization images using clinical data from electronic health records applying a user-centric approach. The design insights can be applied for visualizing patient data in electronic health records.

Multisite Pragmatic Cluster-Randomized Controlled Trial of the CONCERN Early Warning System.

Importance: Late predictions of hospitalized patient deterioration, resulting from early warning systems (EWS) with limited data sources and/or a care team's lack of shared situational awareness, contribute to delays in clinical interventions. The COmmunicating Narrative Concerns Entered by RNs (CONCERN) Early Warning System (EWS) uses real-time nursing surveillance documentation patterns in its machine learning algorithm to identify patients' deterioration risk up to 42 hours earlier than other EWSs. Objective: To test our a priori hypothesis that patients with care teams informed by the CONCERN EWS intervention have a lower mortality rate and shorter length of stay (LOS) than the patients with teams not informed by CONCERN EWS. Design: One-year multisite, pragmatic controlled clinical trial with cluster-randomization of acute and intensive care units to intervention or usual-care groups. Setting: Two large U.S. health systems. Participants: Adult patients admitted to acute and intensive care units, excluding those on hospice/palliative/comfort care, or with Do Not Resuscitate/Do Not Intubate orders. Intervention: The CONCERN EWS intervention calculates patient deterioration risk based on nurses' concern levels measured by surveillance documentation patterns, and it displays the categorical risk score (low, increased, high) in the electronic health record (EHR) for care team members. Main Outcomes and Measures: Primary outcomes: in-hospital mortality, LOS; survival analysis was used. Secondary outcomes: cardiopulmonary arrest, sepsis, unanticipated ICU transfers, 30-day hospital readmission. Results: A total of 60 893 hospital encounters (33 024 intervention and 27 869 usual-care) were included. Both groups had similar patient age, race, ethnicity, and illness severity distributions. Patients in the intervention group had a 35.6% decreased risk of death (adjusted hazard ratio [HR], 0.644; 95% confidence interval [CI], 0.532-0.778; P<.0001), 11.2% decreased LOS (adjusted incidence rate ratio, 0.914; 95% CI, 0.902-0.926; P<.0001), 7.5% decreased risk of sepsis (adjusted HR, 0.925; 95% CI, 0.861-0.993; P=.0317), and 24.9% increased risk of unanticipated ICU transfer (adjusted HR, 1.249; 95% CI, 1.093-1.426; P=.0011) compared with patients in the usual-care group. Conclusions and Relevance: A hospital-wide EWS based on nursing surveillance patterns decreased in-hospital mortality, sepsis, and LOS when integrated into the care team's EHR workflow. Trial Registration: ClinicalTrials.gov Identifier: NCT03911687.

A Computational Framework to Evaluate Emergency Department Clinician Task Switching in the Electronic Health Record Using Event Logs.

Workflow fragmentation, defined as task switching, may be one proxy to quantify electronic health record (EHR) documentation burden in the emergency department (ED). Few measures have been operationalized to evaluate task switching at scale. Theoretically grounded in the time-based resource-sharing model (TBRSM) which conceives task switching as proportional to the cognitive load experienced, we describe the functional relationship between cognitive load and the time and effort constructs previously applied for measuring documentation burden. We present a computational framework, COMBINE, to evaluate multilevel task switching in the ED using EHR event logs. Based on this framework, we conducted a descriptive analysis on task switching among 63 full-time ED physicians from one ED site using EHR event logs extracted between April-June 2021 (n=2,068,605 events) which were matched to scheduled shifts (n=952). On average, we found a high volume of event-level (185.8±75.3/hr) and within-(6.6±1.7/chart) and between-patient chart (27.5±23.6/hr) switching per shift worked.

Variability in Nursing Documentation Patterns across Patients' Hospital Stays.

This study explores the variability in nursing documentation patterns in acute care and ICU settings, focusing on vital signs and note documentation, and examines how these patterns vary across patients' hospital stays, documentation types, and comorbidities. In both acute care and critical care settings, there was significant variability in nursing documentation patterns across hospital stays, by documentation type, and by patients' comorbidities. The results suggest that nurses adapt their documentation practices in response to their patients' fluctuating needs and conditions, highlighting the need to facilitate more individualized care and tailored documentation practices. The implications of these findings can inform decisions on nursing workload management, clinical decision support tools, and EHR optimizations.

Understanding the perceived role of electronic health records and workflow fragmentation on clinician documentation burden in emergency departments.

OBJECTIVE: Understand the perceived role of electronic health records (EHR) and workflow fragmentation on clinician documentation burden in the emergency department (ED). METHODS: From February to June 2022, we conducted semistructured interviews among a national sample of US prescribing providers and registered nurses who actively practice in the adult ED setting and use Epic Systems' EHR. We recruited participants through professional listservs, social media, and email invitations sent to healthcare professionals. We analyzed interview transcripts using inductive thematic analysis and interviewed participants until we achieved thematic saturation. We finalized themes through a consensus-building process. RESULTS: We conducted interviews with 12 prescribing providers and 12 registered nurses. Six themes were identified related to EHR factors perceived to contribute to documentation burden including lack of advanced EHR capabilities, absence of EHR optimization for clinicians, poor user interface design, hindered communication, increased manual work, and added workflow blockages, and five themes associated with cognitive load. Two themes emerged in the relationship between workflow fragmentation and EHR documentation burden: underlying sources and adverse consequences. DISCUSSION: Obtaining further stakeholder input and consensus is essential to determine whether these perceived burdensome EHR factors could be extended to broader contexts and addressed through optimizing existing EHR systems alone or through a broad overhaul of the EHR's architecture and primary purpose. CONCLUSION: While most clinicians perceived that the EHR added value to patient care and care quality, our findings underscore the importance of designing EHRs that are in harmony with ED clinical workflows to alleviate the clinician documentation burden.

Improving Patient-Reported Outcomes in Stroke Care using Remote Blood Pressure Monitoring and Telehealth.

BACKGROUND: Inequities in health care access leads to suboptimal medication adherence and blood pressure (BP) control. Informatics-based approaches may deliver equitable care and enhance self-management. Patient-reported outcomes (PROs) complement clinical measures to assess the impact of illness on patients' well-being in poststroke care. OBJECTIVES: The aim of this study was to determine the feasibility of incorporating PROs into Telehealth After Stroke Care (TASC) and to explore the effect of this team-based remote BP monitoring program on psychological distress and quality of life in an underserved urban setting. METHODS: Patients discharged home from a Comprehensive Stroke Center were randomized to TASC or usual care for 3 months. They were provided with a BP monitor and a tablet that wirelessly transmitted data to a cloud-based platform, which were integrated with the electronic health record. Participants who did not complete the tablet surveys were contacted via telephone or e-mail. We collected the Patient-Reported Outcomes Measurement Information System Managing Medications and Treatment (PROMIS-MMT), Patient Activation Measure (PAM), Neuro-QOL (Quality of Life in Neurological Disorders) Cognitive Function, Neuro-QOL Depression, and Patient Health Questionnaire-9 (PHQ-9). T-tests and linear regression were used to evaluate the differences in PRO change between the arms. RESULTS: Of the 50 participants, two-thirds were Hispanic or non-Hispanic Black individuals. Mechanisms of PRO submission for the arms included tablet (62 vs. 47%), phone (24 vs. 37%), tablet with phone coaching (10 vs. 16%), and e-mail (4 vs. 0%). PHQ-9 depressive scores were nominally lower in TASC at 3 months compared with usual care (2.7 ± 3.6 vs. 4.0 ± 4.1; p = 0.06). No significant differences were observed in PROMIS-MMT, PAM, or Neuro-QoL measures. CONCLUSION: Findings suggest the feasibility of collecting PROs through an interactive web-based platform. The team-based remote BP monitoring demonstrated a favorable impact on patients' well-being. Patients equipped with appropriate resources can engage in poststroke self-care to mitigate inequities in health outcomes.

A Scoping Review of Integrated Medical Devices and Clinical Decision Support in the Acute Care Setting.

BACKGROUND: Seamless data integration between point-of-care medical devices and the electronic health record (EHR) can be central to clinical decision support systems (CDSS). OBJECTIVE: The objective of this scoping review is to (1) examine the existing evidence related to integrated medical devices, primarily medication pump devices, and associated clinical decision support (CDS) in acute care settings and (2) to identify how acute care clinicians may use device CDS in clinical decision-making. The rationale for this review is that integrated devices are ubiquitous in the acute care setting, and they generate data that may help to contribute to the situational awareness of the clinical team necessary to provide individualized patient care. METHODS: This scoping review was conducted using the Joanna Briggs Institute Manual for Evidence Synthesis and the Preferred Reporting Items for Systematic Reviews and Meta-analyses Extensions for Scoping Review guidelines. PubMed, CINAHL, IEEE Xplore, and Scopus databases were searched for scholarly, peer-reviewed journals indexed between January 1, 2010 and December 31, 2020. A priori inclusion criteria were established. RESULTS: Of the 1,924 articles screened, 18 were ultimately included for synthesis, and primarily included articles on devices such as intravenous medication pumps and vital signs machines. Clinical alarm burden was mentioned in most of the articles, and despite not including the term "medication" there were many articles about smart pumps being integrated with the EHR. The Revised Technology, Nursing & Patient Safety Conceptual Model provided the organizational framework. Ten articles described patient assessment, monitoring, or surveillance use. Three articles described patient protection from harm. Four articles described direct care use scenarios, all of which described insulin administration. One article described a hybrid situation of patient communication and monitoring. Most of the articles described devices and decision support primarily used by registered nurses (RNs). CONCLUSION: The articles in this review discussed devices and the associated CDSS that are used by clinicians, primarily RNs, in the daily provision of care for patients. Integrated device data provide insight into user-device interactions and help to illustrate health care processes, especially the activities when providing direct care to patients in an acute care setting. While there are CDSS designed to support the clinician while working with devices, RNs and providers may disregard this guidance, and defer to their own expertise. Additionally, if clinicians perceive CDSS as intrusive, they are at risk for alarm and alert fatigue if CDSS are not tailored to sync with the workflow of the end-user. Areas for future research include refining inclusion criteria to examine the evidence for devices and their CDS that are most likely used by other groups' health care professionals (i.e., doctors and therapists), using integrated device metadata and deep learning analytics to identify patterns in care delivery, and decision support tools for patients using their own personal data.

Using Time Series Clustering to Segment and Infer Emergency Department Nursing Shifts from Electronic Health Record Log Files.

Few computational approaches exist for abstracting electronic health record (EHR) log files into clinically meaningful phenomena like clinician shifts. Because shifts are a fundamental unit of work recognized in clinical settings, shifts may serve as a primary unit of analysis in the study of documentation burden. We conducted a proof- of-concept study to investigate the feasibility of a novel approach using time series clustering to segment and infer clinician shifts from EHR log files. From 33,535,585 events captured between April-June 2021, we computationally identified 43,911 potential shifts among 2,285 (74.2%) emergency department nurses. On average, computationally-identified shifts were 10.6±3.1 hours long. Based on data distributions, we classified these shifts based on type: day, evening, night; and length: 12-hour, 8-hour, other. We validated our method through manual chart review of computationally-identified 12-hour shifts achieving 92.0% accuracy. Preliminary results suggest unsupervised clustering methods may be a reasonable approach for rapidly identifying clinician shifts.

Factors Influencing Clinician Trust in Predictive Clinical Decision Support Systems for In-Hospital Deterioration: Qualitative Descriptive Study.

BACKGROUND: Clinician trust in machine learning-based clinical decision support systems (CDSSs) for predicting in-hospital deterioration (a type of predictive CDSS) is essential for adoption. Evidence shows that clinician trust in predictive CDSSs is influenced by perceived understandability and perceived accuracy. OBJECTIVE: The aim of this study was to explore the phenomenon of clinician trust in predictive CDSSs for in-hospital deterioration by confirming and characterizing factors known to influence trust (understandability and accuracy), uncovering and describing other influencing factors, and comparing nurses' and prescribing providers' trust in predictive CDSSs. METHODS: We followed a qualitative descriptive methodology conducting directed deductive and inductive content analysis of interview data. Directed deductive analyses were guided by the human-computer trust conceptual framework. Semistructured interviews were conducted with nurses and prescribing providers (physicians, physician assistants, or nurse practitioners) working with a predictive CDSS at 2 hospitals in Mass General Brigham. RESULTS: A total of 17 clinicians were interviewed. Concepts from the human-computer trust conceptual framework-perceived understandability and perceived technical competence (ie, perceived accuracy)-were found to influence clinician trust in predictive CDSSs for in-hospital deterioration. The concordance between clinicians' impressions of patients' clinical status and system predictions influenced clinicians' perceptions of system accuracy. Understandability was influenced by system explanations, both global and local, as well as training. In total, 3 additional themes emerged from the inductive analysis. The first, perceived actionability, captured the variation in clinicians' desires for predictive CDSSs to recommend a discrete action. The second, evidence, described the importance of both macro- (scientific) and micro- (anecdotal) evidence for fostering trust. The final theme, equitability, described fairness in system predictions. The findings were largely similar between nurses and prescribing providers. CONCLUSIONS: Although there is a perceived trade-off between machine learning-based CDSS accuracy and understandability, our findings confirm that both are important for fostering clinician trust in predictive CDSSs for in-hospital deterioration. We found that reliance on the predictive CDSS in the clinical workflow may influence clinicians' requirements for trust. Future research should explore the impact of reliance, the optimal explanation design for enhancing understandability, and the role of perceived actionability in driving trust.

Extubation during extracorporeal membrane oxygenation in adults: An international qualitative study on experts' opinions.

BACKGROUND: Extracorporeal membrane oxygenation in adults (adult-ECMO), a modification of cardiopulmonary bypass is increasingly used. Liberation from mechanical ventilation, or extubation, during adult-ECMO remains a challenge. OBJECTIVES: This study aimed to understand expert perceptions of the reasonableness of extubation during adult-ECMO and the usefulness of an extubation clinical practice guideline (ECPG). METHODS: Homogeneous purposive sampling, focus groups, and interviews with a discussion guide, and direct content, thematic analysis were used. RESULTS: Fourteen volunteers participated with different educational levels (79% Doctor of Medicine, 14% Registered Nurse, 7% Nurse Practitioner), from high-volume ECMO centers of various annual ECMO runs (50% 30-49 ECMO/year, 36% 50-99 ECMO/year, 14% >100 ECMO/year) worldwide (64% North America, 21% South America, 7% Europe, 7% Asia). Seven themes were identified: paucity of evidence, mindsets towards using an ECPG, barriers, criteria and benefits of extubation, culture towards extubation and vision of the future. Participants recommended aiming for extubation based on patient selection, and a standardized extubation approach with an ECPG or team decision-making. CONCLUSION: Application of adult-ECMO is expanding, during which extubation remains difficult. Experts recommend two methods of a standardized extubation approach.