Small Patients but a Heavy Lift: Workload and Burnout of Advanced Practice Providers and Physicians in a Level IV Neonatal Intensive Care Unit.

OBJECTIVE: This study explored the association between workload and the level of burnout reported by clinicians in our neonatal intensive care unit (NICU). A qualitative analysis was used to identify specific factors that contributed to workload and modulated clinician workload in the NICU. STUDY DESIGN: We conducted a study utilizing postshift surveys to explore workload of 42 NICU advanced practice providers and physicians over a 6-month period. We used multinomial logistic regression models to determine associations between workload and burnout. We used a descriptive qualitative design with an inductive thematic analysis to analyze qualitative data. RESULTS: Clinicians reported feelings of burnout on nearly half of their shifts (44%), and higher levels of workload during a shift were associated with report of a burnout symptom. Our study identified 7 themes related to workload in the NICU. Two themes focused on contributors to workload, 3 themes focused on modulators of workload, and the final 2 themes represented mixed experiences of clinicians' workload. CONCLUSION: We found an association between burnout and increased workload. Clinicians in our study described common contributors to workload and actions to reduce workload. Decreasing workload and burnout along with improving clinician well-being requires a multifaceted approach on unit and systems levels.

Workload In Neonatology (WORKLINE): Validation and feasibility of a system for measuring clinician workload integrated into the electronic health record.

OBJECTIVE: The purpose of the study was to validate WORKLINE, a NICU specific clinician workload model and to evaluate the feasibility of integrating WORKLINE into our EHR. STUDY DESIGN: This was a prospective, observational study of the workload of 42 APPs and physicians in a large academic medical center NICU over a 6-month period. We used regression models with robust clustered standard errors to test associations of WORKLINE values with NASA Task Load Index (NASA-TLX) scores. RESULTS: We found significant correlations between WORKLINE and NASA-TLX scores. APP caseload was not significantly associated with WORKLINE scores. We successfully integrated the WORKLINE model into our EHR to automatically generate workload scores. CONCLUSION: WORKLINE provides an objective method to quantify the workload of clinicians in the NICU, and for APPs, performed better than caseload numbers to reflect workload. Integrating the WORKLINE model into the EHR was feasible and enabled automated workload scores.

Perioperative Care Structures and Non-Routine Events: Network Analysis.

Non-routine events (NREs) are any aspect of care perceived by clinicians as a deviation from optimal care. The reporting of NREs to peers (or care teams) may help healthcare organizations improve patient safety in high-risk work environments (e.g., surgery). While various factors, including care structure and organizational factors may influence a clinician's NRE reporting behavior, their role has not been systematically studied. We conducted a retrospective study relying on NREs and electronic health records to determine if perioperative interaction structures among clinicians are associated with the frequency of NRE reporting in a large academic medical center. The data covers November 1, 2016, to January 31, 2019 and includes 295 perioperative clinicians, 225 neonatal surgical cases, and 543 NREs. Using network analysis, we measured a clinician's status in interaction structures according to the sociometric factors of degree, betweenness, and eigenvector centrality. We applied a proportional odds model to measure the relationship between each sociometric factor and NRE reporting frequency. Our findings indicate that the centrality of clinicians is directly associated with the quantity of NREs per surgical case.

A pilot study to determine the incidence, type, and severity of non-routine events in neonates undergoing gastrostomy tube placement.

BACKGROUND: Non-routine events (NRE) are defined as any suboptimal occurrences in a process being measured in the opinion of the reporter and comes from the field of human factors engineering. These typically occur well up-stream of an adverse event and NRE measurement has not been applied to the complex context of neonatal surgery. We sought to apply this novel safety event measurement methodology to neonates in the NICU undergoing gastrostomy tube placement. METHODS: A prospective pilot study was conducted between November 2016 and August 2020 in the Level IV NICU and the pediatric operating rooms of an urban academic children's hospital to determine the incidence, severity, impact, and contributory factors of clinician-reported non-routine events (NREs, i.e., deviations from optimal care) and 30-day NSQIP occurrences in neonates receiving a G-tube. RESULTS: Clinicians reported at least one NRE in 32 of 36 (89%) G-tube cases, averaging 3.0 (Standard deviation: 2.5) NRE reports per case. NSQIP-P review identified 7 cases (19%) with NSQIP-P occurrences and each of these cases had multiple reported NREs. One case in which NREs were not reported was without NSQIP-P occurrences. The odds ratio of having a NSQIP-P occurrence with the presence of an NRE was 0.695 (95% CI 0.06-17.04). CONCLUSION: Despite being considered a "simple" operation, >80% of neonatal G-tube placement operations had at least one reported NRE by an operative team member. In this pilot study, NRE occurrence was not significantly associated with the subsequent reporting of an NSQIP-P occurrence. Understanding contributory factors of NREs that occur in neonatal surgery may promote surgical safety efforts and should be evaluated in larger and more diverse populations. LEVEL OF EVIDENCE: IV.

Assessing Neonatal Intensive Care Unit Structures and Outcomes Before and During the COVID-19 Pandemic: Network Analysis Study.

BACKGROUND: Health care organizations (HCOs) adopt strategies (eg. physical distancing) to protect clinicians and patients in intensive care units (ICUs) during the COVID-19 pandemic. Many care activities physically performed before the COVID-19 pandemic have transitioned to virtual systems during the pandemic. These transitions can interfere with collaboration structures in the ICU, which may impact clinical outcomes. Understanding the differences can help HCOs identify challenges when transitioning physical collaboration to the virtual setting in the post-COVID-19 era. OBJECTIVE: This study aims to leverage network analysis to determine the changes in neonatal ICU (NICU) collaboration structures from the pre- to the intra-COVID-19 era. METHODS: In this retrospective study, we applied network analysis to the utilization of electronic health records (EHRs) of 712 critically ill neonates (pre-COVID-19, n=386; intra-COVID-19, n=326, excluding those with COVID-19) admitted to the NICU of Vanderbilt University Medical Center between September 1, 2019, and June 30, 2020, to assess collaboration between clinicians. We characterized pre-COVID-19 as the period of September-December 2019 and intra-COVID-19 as the period of March-June 2020. These 2 groups were compared using patients' clinical characteristics, including age, sex, race, length of stay (LOS), and discharge dispositions. We leveraged the clinicians' actions committed to the patients' EHRs to measure clinician-clinician connections. We characterized a collaboration relationship (tie) between 2 clinicians as actioning EHRs of the same patient within the same day. On defining collaboration relationship, we built pre- and intra-COVID-19 networks. We used 3 sociometric measurements, including eigenvector centrality, eccentricity, and betweenness, to quantify a clinician's leadership, collaboration difficulty, and broad skill sets in a network, respectively. We assessed the extent to which the eigenvector centrality, eccentricity, and betweenness of clinicians in the 2 networks are statistically different, using Mann-Whitney U tests (95% CI). RESULTS: Collaboration difficulty increased from the pre- to intra-COVID-19 periods (median eccentricity: 3 vs 4; P<.001). Nurses had reduced leadership (median eigenvector centrality: 0.183 vs 0.087; P<.001), and neonatologists with broader skill sets cared for more patients in the NICU structure during the pandemic (median betweenness centrality: 0.0001 vs 0.005; P<.001). The pre- and intra-COVID-19 patient groups shared similar distributions in sex (~0 difference), race (4% difference in White, and 3% difference in African American), LOS (interquartile range difference in 1.5 days), and discharge dispositions (~0 difference in home, 2% difference in expired, and 2% difference in others). There were no significant differences in the patient demographics and outcomes between the 2 groups. CONCLUSIONS: Management of NICU-admitted patients typically requires multidisciplinary care teams. Understanding collaboration structures can provide fine-grained evidence to potentially refine or optimize existing teamwork in the NICU.

Measuring Collaboration Through Concurrent Electronic Health Record Usage: Network Analysis Study.

BACKGROUND: Collaboration is vital within health care institutions, and it allows for the effective use of collective health care worker (HCW) expertise. Human-computer interactions involving electronic health records (EHRs) have become pervasive and act as an avenue for quantifying these collaborations using statistical and network analysis methods. OBJECTIVE: We aimed to measure HCW collaboration and its characteristics by analyzing concurrent EHR usage. METHODS: By extracting concurrent EHR usage events from audit log data, we defined concurrent sessions. For each HCW, we established a metric called concurrent intensity, which was the proportion of EHR activities in concurrent sessions over all EHR activities. Statistical models were used to test the differences in the concurrent intensity between HCWs. For each patient visit, starting from admission to discharge, we measured concurrent EHR usage across all HCWs, which we called temporal patterns. Again, we applied statistical models to test the differences in temporal patterns of the admission, discharge, and intermediate days of hospital stay between weekdays and weekends. Network analysis was leveraged to measure collaborative relationships among HCWs. We surveyed experts to determine if they could distinguish collaborative relationships between high and low likelihood categories derived from concurrent EHR usage. Clustering was used to aggregate concurrent activities to describe concurrent sessions. We gathered 4 months of EHR audit log data from a large academic medical center's neonatal intensive care unit (NICU) to validate the effectiveness of our framework. RESULTS: There was a significant difference (P<.001) in the concurrent intensity (proportion of concurrent activities: ranging from mean 0.07, 95% CI 0.06-0.08, to mean 0.36, 95% CI 0.18-0.54; proportion of time spent on concurrent activities: ranging from mean 0.32, 95% CI 0.20-0.44, to mean 0.76, 95% CI 0.51-1.00) between the top 13 HCW specialties who had the largest amount of time spent in EHRs. Temporal patterns between weekday and weekend periods were significantly different on admission (number of concurrent intervals per hour: 11.60 vs 0.54; P<.001) and discharge days (4.72 vs 1.54; P<.001), but not during intermediate days of hospital stay. Neonatal nurses, fellows, frontline providers, neonatologists, consultants, respiratory therapists, and ancillary and support staff had collaborative relationships. NICU professionals could distinguish high likelihood collaborative relationships from low ones at significant rates (3.54, 95% CI 3.31-4.37 vs 2.64, 95% CI 2.46-3.29; P<.001). We identified 50 clusters of concurrent activities. Over 87% of concurrent sessions could be described by a single cluster, with the remaining 13% of sessions comprising multiple clusters. CONCLUSIONS: Leveraging concurrent EHR usage workflow through audit logs to analyze HCW collaboration may improve our understanding of collaborative patient care. HCW collaboration using EHRs could potentially influence the quality of patient care, discharge timeliness, and clinician workload, stress, or burnout.

A Time and Motion Analysis of Nursing Workload and Electronic Health Record Use in the Emergency Department.

INTRODUCTION: The use of an electronic health record may create unanticipated consequences for emergency care delivery. We sought to describe emergency department nursing task distribution and the use of the electronic health record. METHODS: This was a prospective observational study of nurses in the emergency department using a time-and-motion methodology. Three trained research assistants conducted 1:1 observations between March and September 2019. Nurse tasks were classified into 6 established categories: electronic health record, direct/indirect patient care, communication, personal time, and other. Nurses' perceived workload was assessed using the National Aeronautics and Space Administration (NASA) Task Load Index. RESULTS: Twenty-three observations were conducted over 46 hours. Overall, nurses spent 27% of their time on electronic health record tasks, 25% on direct patient care, 17% on personal time, 15% on indirect patient care, and 6% on communication. During morning (7 am-12 pm) and afternoon shifts (12 pm-3 pm), the use of the health record was the most commonly performed task, whereas indirect patient care was the task most performed during evening shifts (3 pm-12 pm). Using the National Aeronautics and Space Administration (NASA) Task Load Index, nurses reported an increase in mental demand and effort during afternoon shifts compared with morning shifts. DISCUSSION: We observed that emergency nurses spent more time using the electronic health record as compared to other tasks. Increased usability of the electronic health record, particularly during high occupancy periods, may be a target for improvement.

Collaboration Structures in COVID-19 Critical Care: Retrospective Network Analysis Study.

BACKGROUND: Few intensive care unit (ICU) staffing studies have examined the collaboration structures of health care workers (HCWs). Knowledge about how HCWs are connected to the care of critically ill patients with COVID-19 is important for characterizing the relationships among team structures, care quality, and patient safety. OBJECTIVE: We aimed to discover differences in the teamwork structures of COVID-19 critical care by comparing HCW collaborations in the management of critically ill patients with and without COVID-19. METHODS: In this retrospective study, we used network analysis methods to analyze the electronic health records (EHRs) of 76 critically ill patients (with COVID-19: n=38; without COVID-19: n=38) who were admitted to a large academic medical center, and to learn about HCW collaboration. We used the EHRs of adult patients who were admitted to the COVID-19 ICU at the Vanderbilt University Medical Center (Nashville, Tennessee, United States) between March 17, 2020, and May 31, 2020. We matched each patient according to age, gender, and their length of stay. Patients without COVID-19 were admitted to the medical ICU between December 1, 2019, and February 29, 2020. We used two sociometrics-eigencentrality and betweenness-to quantify HCWs' statuses in networks. Eigencentrality characterizes the degree to which an HCW is a core person in collaboration structures. Betweenness centrality refers to whether an HCW lies on the path of other HCWs who are not directly connected. This sociometric was used to characterize HCWs' broad skill sets. We measured patient staffing intensity in terms of the number of HCWs who interacted with patients' EHRs. We assessed the statistical differences in the core and betweenness statuses of HCWs and the patient staffing intensities of COVID-19 and non-COVID-19 critical care, by using Mann-Whitney U tests and reporting 95% CIs. RESULTS: HCWs in COVID-19 critical care were more likely to frequently work with each other (eigencentrality: median 0.096) than those in non-COVID-19 critical care (eigencentrality: median 0.057; P<.001). Internal medicine physicians in COVID-19 critical care had higher core statuses than those in non-COVID-19 critical care (P=.001). Nurse practitioners in COVID-19 care had higher betweenness statuses than those in non-COVID-19 care (P<.001). Compared to HCWs in non-COVID-19 settings, the EHRs of critically ill patients with COVID-19 were used by a larger number of internal medicine nurse practitioners (P<.001), cardiovascular nurses (P<.001), and surgical ICU nurses (P=.002) and a smaller number of resident physicians (P<.001). CONCLUSIONS: Network analysis methodologies and data on EHR use provide a novel method for learning about differences in collaboration structures between COVID-19 and non-COVID-19 critical care. Health care organizations can use this information to learn about the novel changes that the COVID-19 pandemic has imposed on collaboration structures in urgent care.

Mining tasks and task characteristics from electronic health record audit logs with unsupervised machine learning.

OBJECTIVE: The characteristics of clinician activities while interacting with electronic health record (EHR) systems can influence the time spent in EHRs and workload. This study aims to characterize EHR activities as tasks and define novel, data-driven metrics. MATERIALS AND METHODS: We leveraged unsupervised learning approaches to learn tasks from sequences of events in EHR audit logs. We developed metrics characterizing the prevalence of unique events and event repetition and applied them to categorize tasks into 4 complexity profiles. Between these profiles, Mann-Whitney U tests were applied to measure the differences in performance time, event type, and clinician prevalence, or the number of unique clinicians who were observed performing these tasks. In addition, we apply process mining frameworks paired with clinical annotations to support the validity of a sample of our identified tasks. We apply our approaches to learn tasks performed by nurses in the Vanderbilt University Medical Center neonatal intensive care unit. RESULTS: We examined EHR audit logs generated by 33 neonatal intensive care unit nurses resulting in 57 234 sessions and 81 tasks. Our results indicated significant differences in performance time for each observed task complexity profile. There were no significant differences in clinician prevalence or in the frequency of viewing and modifying event types between tasks of different complexities. We presented a sample of expert-reviewed, annotated task workflows supporting the interpretation of their clinical meaningfulness. CONCLUSIONS: The use of the audit log provides an opportunity to assist hospitals in further investigating clinician activities to optimize EHR workflows.

Defining the Epidemiology of Safety Risks in Neonatal Intensive Care Unit Patients Requiring Surgery.

OBJECTIVE: The aim of the study was to determine the incidence, type, severity, preventability, and contributing factors of nonroutine events (NREs)-events perceived by care providers or skilled observers as a deviations from optimal care based on the clinical situation-in the perioperative (i.e., preoperative, operative, and postoperative) care of surgical neonates in the neonatal intensive care unit and operating room. METHODS: A prospective observational study of noncardiac surgical neonates, who received preoperative and postoperative neonatal intensive care unit care, was conducted at an urban academic children's hospital between November 1, 2016, and March 31, 2018. One hundred twenty-nine surgical cases in 109 neonates were observed. The incidence and description of NREs were collected via structured researcher-administered survey tool of involved clinicians. Primary measurements included clinicians' ratings of NRE severity and contributory factors and trained research assistants' ratings of preventability. RESULTS: One or more NREs were reported in 101 (78%) of 129 observed cases for 247 total NREs. Clinicians reported 2 (2) (median, interquartile range) NREs per NRE case with a maximum severity of 3 (1) (possible range = 1-5). Trained research assistants rated 47% of NREs as preventable and 11% as severe and preventable. The relative risks for National Surgical Quality Improvement Program - pediatric major morbidity and 30-day mortality were 1.17 (95% confidence interval = 0.92-1.48) and 1.04 (95% confidence interval = 1.00-1.08) in NRE cases versus non-NRE cases. CONCLUSIONS: The incidence of NREs in neonatal perioperative care at an academic children's hospital was high and of variable severity with a myriad of contributory factors.

Factors Influencing Time-Dependent Quality Indicators for Patients With Suspected Acute Coronary Syndrome.

OBJECTIVES: Rapid risk stratification and timely treatment are critical to favorable outcomes for patients with acute coronary syndrome (ACS). Our objective was to identify patient and system factors that influence time-dependent quality indicators (QIs) for patients with unstable angina/non-ST elevation myocardial infarction (NSTEMI) in the emergency department (ED). METHODS: A retrospective, cohort study was conducted during a 42-month period of all patients 24 years or older suspected of having ACS as defined by receiving an electrocardiogram and at least 1 cardiac biomarker test. Cox regression was used to model the effects of patient characteristics, ancillary service use, staffing provisions, equipment availability, and ED and hospital crowding on ACS QIs. RESULTS: Emergency department adherence rates to national standards for electrocardiogram readout time and biomarker turnaround time were 42% and 37%, respectively. Cox regression models revealed that chief complaints without chest pain and the timing of stress testing and medication administration were associated with the most significant delays. CONCLUSIONS: Patient and system factors both significantly influenced QI times in this cohort with unstable angina/NSTEMI. These results illustrate both the complexity of diagnosing patients with NSTEMI and the competing effects of clinical and system factors on patient flow through the ED.

Improving the Effectiveness of Health Information Technology: The Case for Situational Analytics.

Health information technology has contributed to improvements in quality and safety in clinical settings. However, the implementation of new technologies in health care has also been associated with the introduction of new sociotechnical hazards, produced through a range of complex interactions that vary with social, physical, temporal, and technological context. Other industries have been confronted with this problem and have developed advanced analytics to examine context-specific activities of workers and related outcomes. The skills and data exist in health care to develop similar insights through situational analytics, defined as the application of analytic methods to characterize human activity in situations and identify patterns in activity and outcomes that are influenced by contextual factors. This article describes the approach of situational analytics and potentially useful data sources, including trace data from electronic health record activity, reports from users, qualitative field data, and locational data. Key implementation requirements are discussed, including the need for collaboration among qualitative researchers and data scientists, organizational and federal level infrastructure requirements, and the need to implement a parallel research program in ethics to understand how the data are being used by organizations and policy makers.

Provider Networks in the Neonatal Intensive Care Unit Associate with Length of Stay.

We strive to understand care coordination structures of multidisciplinary teams and to evaluate their effect on post-surgical length of stay (PSLOS) in the Neonatal Intensive Care Unit (NICU). Electronic health record (EHR) data were extracted for 18 neonates, who underwent gastrostomy tube placement surgery at the Vanderbilt University Medical Center NICU. Based on providers' interactions with the EHR (e.g. viewing, documenting, ordering), provider-provider relations were learned and used to build patient-specific provider networks representing the care coordination structure. We quantified the networks using standard network analysis metrics (e.g., in-degree, out-degree, betweenness centrality, and closeness centrality). Coordination structure effectiveness was measured as the association between the network metrics and PSLOS, as modeled by a proportional-odds, logistical regression model. The 18 provider networks exhibited various team compositions and various levels of structural complexity. Providers, whose patients had lower PSLOS, tended to disperse patient-related information to more colleagues within their network than those, who treated higher PSLOS patients (P = 0.0294). In the NICU, improved dissemination of information may be linked to reduced PSLOS. EHR data provides an efficient, accessible, and resource-friendly way to study care coordination using network analysis tools. This novel methodology offers an objective way to identify key performance and safety indicators of care coordination and to study dissemination of patient-related information within care provider networks and its effect on care. Findings should guide improvements in the EHR system design to facilitate effective clinical communications among providers.

Implementing Strategies to Identify and Mitigate Adverse Safety Events: A Case Study with Unplanned Extubations.

BACKGROUND: Patient safety events result from failures in complex health care delivery processes. To ensure safety, teams must implement ways to identify events that occur in a nonrandom fashion and respond in a timely manner. To illustrate this, one children's hospital's experience with an outbreak of unplanned extubations (UEs) in the neonatal ICU (NICU) is described. METHODS: The quality improvement team measured UEs using three complementary data streams. Interventions to decrease the rate of UE were tested with success. Three statistical process control (SPC) charts (u-chart, g-chart, and an exponentially weighted moving average [EWMA] chart) were used for real-time monitoring. RESULTS: From July 2015 to May 2016, the UE rate was stable at 1.1 UE/100 ventilator days. In early June 2016, a cluster of UEs, including four events within one week, was observed. Two of three SPC charts showed special cause variation, although at different time points. The EWMA chart alerted the team more than two weeks earlier than the u-chart. Within days of discovering the outbreak, the team identified that the hospital had replaced the tape used to secure endotracheal tubes with a nearly identical product. After multiple tape products were tested over the next month, the team selected one that returned the system to a state of stability. CONCLUSION: Ongoing monitoring using SPC charts allowed early detection and rapid mitigation of an outbreak of UEs in the NICU. This highlights the importance of continuous monitoring using tools such as SPC charts that can alert teams to both improvement and worsening of processes.

Modeling Care Team Structures in the Neonatal Intensive Care Unit through Network Analysis of EHR Audit Logs.

BACKGROUND: In the neonatal intensive care unit (NICU), predefined acuity-based team care models are restricted to core roles and neglect interactions with providers outside of the team, such as interactions that transpire via electronic health record (EHR) systems. These unaccounted interactions may be related to the efficiency of resource allocation, information flow, communication, and thus impact patient outcomes. This study applied network analysis methods to EHR audit logs to model the interactions of providers beyond their core roles to better understand the interaction network patterns of acuity-based teams and relationships of the network structures with postsurgical length of stay (PSLOS). METHODS: The study used the EHR log data of surgical neonates from a large academic medical center. The study included 104 surgical neonates, for whom 9,206 unique actions were performed by 457 providers in their EHRs. We applied network analysis methods to model EHR provider interaction networks of acuity-based teams in NICU postoperative care. We partitioned each EHR network into three subnetworks based on interaction types: (1) interactions between known core providers who were documented in scheduling records (core subnetwork); (2) interactions between core and noncore providers (extended subnetwork); and (3) interactions between noncore providers (extended subnetwork). For each core subnetwork, we assessed its capability to replicate predefined core-provider relations as documented in scheduling records. We further compared each EHR network, as well as its subnetworks, using standard network measures to determine its differences in network topologies. We conducted a case study to learn provider interaction networks taking care of 15 neonates who underwent gastrostomy tube placement surgery from EHR log data and measure the effectiveness of the interaction networks on PSLOS by the proportional-odds model. RESULTS: The provider networks of four acuity-based teams (two high and two low acuity), along with their subnetworks, were discovered. We found that beyond capturing the predefined core-provider relations, EHR audit logs can also learn a large number of relations between core and noncore providers or among noncore providers. Providers in the core subnetwork exhibited a greater number of connections with each other than with providers in the extended subnetworks. Many more providers in the core subnetwork serve as a hub than those in the other types of subnetworks. We also found that high-acuity teams exhibited more complex network structures than low-acuity teams, with high-acuity team generating 6,416 interactions between 407 providers compared with 931 interactions between 124 providers, respectively. In addition, we discovered that high-acuity and low-acuity teams shared more than 33 and 25% of providers with each other, respectively, but exhibited different collaborative structures demonstrating that NICU providers shift across different acuity teams and exhibit different network characteristics. Results of case study show that providers, whose patients had lower PSLOS, tended to disperse patient-related information to more colleagues within their network than those who treated higher PSLOS patients (p = 0.03). CONCLUSION: Network analysis can be applied to EHR log data to model acuity-based NICU teams capturing interactions between providers within the predesigned core team as well as those outside of the core team. In the NICU, dissemination of information may be linked to reduced PSLOS. EHR log data provide an efficient, accessible, and research-friendly way to study provider interaction networks. Findings should guide improvements in the EHR system design to facilitate effective interactions between providers.

Human performance measures for the evaluation of process control human-system interfaces in high-fidelity simulations.

We reviewed the available literature on measuring human performance to evaluate human-system interfaces (HSIs), focused on high-fidelity simulations of industrial process control systems, to identify best practices and future directions for research and operations. We searched the available literature and then conducted in-depth review, structured coding, and analysis of 49 articles, which described 42 studies. Human performance measures were classified across six dimensions: task performance, workload, situation awareness, teamwork/collaboration, plant performance, and other cognitive performance indicators. Many studies measured performance in more than one dimension, but few studies addressed more than three dimensions. Only a few measures demonstrated acceptable levels of reliability, validity, and sensitivity in the reviewed studies in this research domain. More research is required to assess the measurement qualities of the commonly used measures. The results can provide guidance to direct future research and practice for human performance measurement in process control HSI design and deployment.

Meta-analysis of surgeon-performed central line placement: Real-time ultrasound versus landmark technique.

BACKGROUND: Major health care agencies recommend real-time ultrasound (RTUS) guidance during insertion of percutaneous central venous catheters (CVC) based on studies in which CVCs were placed by nonsurgeons. We conducted a meta-analysis to compare outcomes for surgeon-performed RTUS-guided CVC insertion versus traditional landmark technique. METHODS: A systematic review of the literature was performed, identifying randomized controlled trials (RCT) and prospective "safety studies" of surgeon-performed CVC insertions comparing landmark to RTUS techniques. Searches were conducted in MEDLINE, Cochrane, and Web of Science, with additional relevant articles identified through examination of the bibliographies and citations of the included studies. Two independent reviewers selected relevant studies that matched inclusion criteria, and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were followed. A meta-analysis was conducted using random effects models to compare success and complication rates. RESULTS: Three RCTs were identified totaling 456 patients. The RTUS guidance was associated with better first attempt success (odds ratio [OR], 4.7; 95% confidence interval [CI], 1.5-14.7, p = 0.008) and overall success (OR 6.5, 95% CI: 2.7-15.7, p < 0.0001). However, there were no differences in overall complication (OR 1.9 (95% CI, 0.8-4.4, p = 0.14)) or arterial puncture (OR 2.0 (95% CI, 0.7-5.6, p = 0.18) rates between the two methods. CONCLUSION: Despite many studies involving nonsurgeons, there are only three RCTs comparing RTUS versus landmark technique for surgeon-performed CVC placement. The RTUS guidance is associated with better success than landmark technique, but no difference in complication rates. No study evaluated how RTUS was implemented. Larger studies examining RTUS use during surgeon-performed CVC placements are needed. LEVEL OF EVIDENCE: Systematic review and meta-analysis, level III.

Understanding Emergency Care Delivery Through Computer Simulation Modeling.

In 2017, Academic Emergency Medicine convened a consensus conference entitled, "Catalyzing System Change through Health Care Simulation: Systems, Competency, and Outcomes." This article, a product of the breakout session on "understanding complex interactions through systems modeling," explores the role that computer simulation modeling can and should play in research and development of emergency care delivery systems. This article discusses areas central to the use of computer simulation modeling in emergency care research. The four central approaches to computer simulation modeling are described (Monte Carlo simulation, system dynamics modeling, discrete-event simulation, and agent-based simulation), along with problems amenable to their use and relevant examples to emergency care. Also discussed is an introduction to available software modeling platforms and how to explore their use for research, along with a research agenda for computer simulation modeling. Through this article, our goal is to enhance adoption of computer simulation, a set of methods that hold great promise in addressing emergency care organization and design challenges.

Cry presence and amplitude do not reflect cortical processing of painful stimuli in newborns with distinct responses to touch or cold.

OBJECTIVE: Newborns requiring hospitalisation frequently undergo painful procedures. Prevention of pain in infants is of prime concern because of adverse associations with physiological and neurological development. However, pain mitigation is currently guided by behavioural observation assessments that have not been validated against direct evidence of pain processing in the brain. The aim of this study was to determine whether cry presence or amplitude is a valid indicator of pain processing in newborns. DESIGN: Prospective observational cohort. SETTING: Newborn nursery. PATIENTS: Healthy infants born at >37 weeks and <42 weeks gestation. INTERVENTIONS: We prospectively studied newborn cortical responses to light touch, cold and heel stick, and the amplitude of associated infant vocalisations using our previously published paradigms of time-locked electroencephalogram (EEG) with simultaneous audio recordings. RESULTS: Latencies of cortical peak responses to each of the three stimuli type were significantly different from each other. Of 54 infants, 13 (24%), 19 (35%) and 35 (65%) had cries in response to light touch, cold and heel stick, respectively. Cry in response to non-painful stimuli did not predict cry in response to heel stick. All infants with EEG data had measurable pain responses to heel stick, whether they cried or not. There was no association between presence or amplitude of cries and cortical nociceptive amplitudes. CONCLUSIONS: In newborns with distinct brain responses to light touch, cold and pain, cry presence or amplitude characteristics do not provide adequate behavioural markers of pain signalling in the brain. New bedside assessments of newborn pain may need to be developed using brain-based methodologies as benchmarks in order to provide optimal pain mitigation.

Evaluation of Voice Acoustics as Predictors of Clinical Depression Scores.

OBJECTIVE: The aim of the present study was to determine if acoustic measures of voice, characterizing specific spectral and timing properties, predict clinical ratings of depression severity measured in a sample of patients using the Hamilton Depression Rating Scale (HAMD) and Beck Depression Inventory (BDI-II). STUDY DESIGN: This is a prospective study. METHODS: Voice samples and clinical depression scores were collected prospectively from consenting adult patients who were referred to psychiatry from the adult emergency department or primary care clinics. The patients were audio-recorded as they read a standardized passage in a nearly closed-room environment. Mean Absolute Error (MAE) between actual and predicted depression scores was used as the primary outcome measure. RESULTS: The average MAE between predicted and actual HAMD scores was approximately two scores for both men and women, and the MAE for the BDI-II scores was approximately one score for men and eight scores for women. Timing features were predictive of HAMD scores in female patients while a combination of timing features and spectral features was predictive of scores in male patients. Timing features were predictive of BDI-II scores in male patients. CONCLUSION: Voice acoustic features extracted from read speech demonstrated variable effectiveness in predicting clinical depression scores in men and women. Voice features were highly predictive of HAMD scores in men and women, and BDI-II scores in men, respectively. The methodology is feasible for diagnostic applications in diverse clinical settings as it can be implemented during a standard clinical interview in a normal closed room and without strict control on the recording environment.