Electronic health record-supported implementation of an evidence-based pathway for perioperative surgical care.

OBJECTIVES: Enhanced recovery pathways (ERPs) are evidence-based approaches to improving perioperative surgical care. However, the role of electronic health records (EHRs) in their implementation is unclear. We examine how EHRs facilitate or hinder ERP implementation. MATERIALS AND METHODS: We conducted interviews with informaticians and clinicians from US hospitals participating in an ERP implementation collaborative. We used inductive thematic analysis to analyze transcripts and categorized hospitals into 3 groups based on process measure adherence. High performers exhibited a minimum 80% adherence to 6 of 9 metrics, high improvers demonstrated significantly better adherence over 12 months, and strivers included all others. We mapped interrelationships between themes using causal loop diagrams. RESULTS: We interviewed 168 participants from 8 hospitals and found 3 thematic clusters: (1) "EHR difficulties" with the technology itself and contextual factors related to (2) "EHR enablers," and (3) "EHR barriers" in ERP implementation. Although all hospitals experienced issues, high performers and improvers successfully integrated ERPs into EHRs through a dedicated multidisciplinary team with informatics expertise. Strivers, while enacting some fixes, were unable to overcome individual resistance to EHR-supported ERPs. DISCUSSION AND CONCLUSION: We add to the literature describing the limitations of EHRs' technological capabilities to facilitate clinical workflows. We illustrate how organizational strategies around engaging motivated clinical teams with informatics training and resources, especially with dedicated technical support, moderate the extent of EHRs' support to ERP implementation, causing downstream effects for hospitals to transform technological challenges into care-improving opportunities. Early and consistent involvement of informatics expertise with frontline EHR clinician users benefited the efficiency and effectiveness of ERP implementation and sustainability.

Implementing Enhanced Recovery Pathways: A Qualitative Study of Factors That Distinguished Higher Performing Hospitals.

OBJECTIVE: The aim of this study was to explore barriers and facilitators to implementing enhanced recovery pathways, with a focus on identifying factors that distinguished hospitals achieving greater levels of implementation success. BACKGROUND: Despite the clinical effectiveness of enhanced recovery pathways, the implementation of these complex interventions varies widely. While there is a growing list of contextual factors that may affect implementation, little is known about which factors distinguish between higher and lower levels of implementation success. METHODS: We conducted in-depth interviews with 168 perioperative leaders, clinicians, and staff from 8 US hospitals participating in the Agency for Healthcare Research and Quality Safety Program for Improving Surgical Care and Recovery. Guided by the Consolidated Framework for Implementation Research, we coded interview transcripts and conducted a thematic analysis of implementation barriers and facilitators. We also rated the perceived effect of factors on different levels of implementation success, as measured by hospitals' adherence with 9 process measures over time. RESULTS: Across all hospitals, factors with a consistently positive effect on implementation included information-sharing practices and the implementation processes of planning and engaging. Consistently negative factors included the complexity of the pathway itself, hospitals' infrastructure, and the implementation process of "executing" (particularly in altering electronic health record systems). Hospitals with the greatest improvement in process measure adherence were distinguished by clinicians' positive knowledge and beliefs about pathways and strong leadership support from both clinicians and executives. CONCLUSION: We draw upon diverse perspectives from across the perioperative continuum of care to qualitatively describe implementation factors most strongly associated with successful implementation of enhanced recovery pathways.

The TeamSTEPPS for Improving Diagnosis Team Assessment Tool: Scale Development and Psychometric Evaluation.

INTRODUCTION: One in three patients is affected by diagnosis-related communication failures. Only a few valid and reliable instruments that measure teamwork and communication exist, and none of those focus on improving diagnosis. The authors developed, refined, and psychometrically evaluated the TeamSTEPPSⓇ for Improving Diagnosis Team Assessment Tool (TAT), which assesses diagnostic teamwork and communication in five critical teamwork domains and can be used to identify strengths and opportunities for improvement and monitor performance. METHODS: The TAT was administered as a cross-sectional survey to 360 health professionals across nine diverse US health systems. Content and construct validity were evaluated through pilot implementation and subject matter expert review. Reliability and internal consistency were assessed with Cronbach's alpha. To understand sources of variation in TAT scores and assess the tool's consistency across diverse health care organizations, generalizability theory (G-theory) was used. Best practices in screening for careless responding identified participants with random or nonvarying responses. RESULTS: Analyses indicated strong support for the tool. Content validity findings indicated that the TAT encompassed relevant diagnostic improvement teamwork and communication content. Construct validity, evaluated through pilot implementations, demonstrated the tool's effectiveness in assessing teamwork categories. Reliability analyses confirmed the TAT's internal consistency, with an overall Cronbach's alpha of 0.97. Each dimension of the TAT exhibited good reliability coefficients, ranging from 0.83 to 0.95. G-theory analysis showed that variations in TAT scores were primarily attributed to respondents (28.0%) and scale dimensions (59.6%); both are desirable facets of variation. Further, examination of careless respondents ensured the accuracy and quality of the results, enhancing the TAT's credibility as a valuable diagnostic improvement tool. CONCLUSION: Psychometric evaluation demonstrated that the TAT is a reliable and valid instrument for assessing teamwork and communication among and across diagnostic teams. The TAT adds a novel, evidence-based, psychometrically sound measurement tool to help advance diagnostic teamwork and communication to improve patient care and outcomes.

Critical Behaviors for Perioperative Improvement Teams.

Effectively leading perioperative safety and quality improvement requires a multidisciplinary team approach. However, leaders are often left without clear guidance on how to assemble and manage teams in these settings. We employ a Delphi process to prioritize specific behavioral strategies surgical safety and quality leaders can use to improve their chances of success implementing improvement efforts. We present the panel's consensus practical guidance on designing, managing, sustaining, training their teams as well as managing team boundaries and the organizational context.

Towards diagnostic excellence on academic ward teams: building a conceptual model of team dynamics in the diagnostic process.

OBJECTIVES: Achieving diagnostic excellence on medical wards requires teamwork and effective team dynamics. However, the study of ward team dynamics in teaching hospitals is relatively underdeveloped. We aim to enhance understanding of how ward team members interact in the diagnostic process and of the underlying behavioral, psychological, and cognitive mechanisms driving team interactions. METHODS: We used mixed-methods to develop and refine a conceptual model of how ward team dynamics in an academic medical center influence the diagnostic process. First, we systematically searched existing literature for conceptual models and empirical studies of team dynamics. Then, we conducted field observations with thematic analysis to refine our model. RESULTS: We present a conceptual model of how medical ward team dynamics influence the diagnostic process, which serves as a roadmap for future research and interventions in this area. We identified three underexplored areas of team dynamics that are relevant to diagnostic excellence and that merit future investigation (1): ward team structures (e.g., team roles, responsibilities) (2); contextual factors (e.g., time constraints, location of team members, culture, diversity); and (3) emergent states (shared mental models, psychological safety, team trust, and team emotions). CONCLUSIONS: Optimizing the diagnostic process to achieve diagnostic excellence is likely to depend on addressing all of the potential barriers and facilitators to ward team dynamics presented in our model.

Use of a Real-Time Locating System to Assess Internal Medicine Resident Location and Movement in the Hospital.

Importance: The patient-physician clinical encounter is the cornerstone of medical training, yet residents spend as little as 12% of their time in direct patient contact. Objectives: To use a real-time locating system (RTLS) to characterize intern work experiences in the hospital, understand factors associated with time spent at patients' bedsides, and inform future interventions to increase time spent with patients. Design, Setting, and Participants: This cross-sectional study was conducted from July 1, 2018, to June 30, 2019 (ie, the academic year 2018-2019). Internal medicine residents from postgraduate year 1 (interns) at an academic medical center wore an infrared badge that recorded location and duration (eg, patient room, ward hall, physician workroom). Data were analyzed from September 1, 2020, to August 30, 2021. Main Outcomes and Measures: Main outcome was time (in minutes) at the bedside; the unit of analysis was a 24-hour intern day or interval of time within the day (eg, rounding period). Descriptive statistics are reported overall, by intern, and for 5 clinical service categories. Multilevel modeling assessed the association of intern, service, and calendar time with time spent at the bedside. Results: Data from 43 of 52 interns (82.7%) encompassing 95 275 hours of observations were included for analyses. Twenty-six interns (60.5%) were women. Interns were detected for a mean (SD) of 722.8 (194.4) minutes per 24-hour period; 13.4% of this time was spent in patient rooms (mean [SD] time, 96.8 [57.2] minutes) and 33.3% in physician workrooms (mean [SD] time, 240.9 [228.8] minutes). Mean percentage of time at the bedside during a 24-hour period varied among interns from 8.8% to 18.3%. Mean (SD) percentage of time at the bedside varied by service for the 24-hour period from 11.7% (6.6%) for nononcology subspecialties to 15.4% (6.0%) for oncology, and during rounds from 8.0% (12.4%) for nononcology subspecialties to 26.5% (12.1%) for oncology. In multilevel modeling, the individual intern accounted for 8.1% of overall variance in time spent at the bedside during a 24-hour period, and service accounted for 18.0% of variance during rounds. Conclusions and Relevance: The findings of this cross-sectional study support previous evidence suggesting that interns spend only a small proportion of time with hospitalized patients. The differences in time spent in patients' rooms among interns and during rounds constitute an opportunity to design interventions that bring trainees back to the bedside.

Human Factors and Ergonomics in Healthcare: Industry Demands and a Path Forward.

This article reviews three industry demands that will impact the future of Human Factors and Ergonomics in Healthcare settings. These demands include the growing population of older adults, the increasing use of telemedicine, and a focus on patient-centered care. Following, we discuss a path forward through improved medical teams, error management, and safety testing of medical devices and tools. Future challenges are discussed.

Demographic and technological factors influencing virtual seizure clinic visit satisfaction before and during the Covid-19 pandemic in rural Hawaii.

BACKGROUND: Telemedicine clinic visits traditionally originated from spoke clinic sites, but recent trends have favored home-based telemedicine, particularly in the time of Covid-19. Our study focused on identification of barriers and factors influencing perceptions of care with use of home-based telemedicine in patients with seizures living in rural Hawaii. We additionally compared characteristics of patients using telemedicine versus in-person clinic visits prior to the Covid-19 pandemic. METHODS: For the retrospective portion of our study, we queried charts of adult outpatients treated by the two full-time epileptologists at a Level 4 epilepsy center accredited by the National Association of Epilepsy Centers between November 2018 and December 2019. We included patients who live on the neighbor islands of Hawaii but not on Oahu, i.e., patients who would require air travel to see an epileptologist. There had been no set protocol at the epilepsy center for telemedicine referral; our practice had been to offer telemedicine visits to all neighbor island patients when felt to be appropriate. We collected demographic and clinic visit data. For the prospective portion we surveyed neighbor island patients or their caregivers, seen via home-based telemedicine between March 2020 and December 2020. We obtained verbal consent for study participation. Survey questions addressed satisfaction with clinical care, visit preferences, and potential barriers to care. RESULTS: In a 14-month period prior to the Covid-19 pandemic, 75 (61%) neighbor island patients were seen exclusively in-person in seizure clinic while 47 (39%) had at least one telemedicine visit. 39% of patients seen only in-person were female whereas 38% of patients seen by telemedicine were female. Patients seen in-person had an older median age (47.2 years) compared to those seen at least once by telemedicine (42.4 years). The no-show rate was 13% for in-person visits versus 4% for telemedicine visits. Among patients seen in person, 17% were Asian, 32% Native Hawaiian, and 47% White, whereas patients seen by telemedicine were 15% Asian, 23% Native Hawaiian, and 57% White. Patients who were seen in person lived in zip codes with median household income of $68,516 and patients who were seen by telemedicine lived in zip codes with median household income of $67,089. Patients who were seen in person lived in zip codes in which 78% of the population had access to broadband internet, whereas patients who were seen by telemedicine lived in zip codes in which 79% of the population had access to broadband internet. During the Covid-19 pandemic, we surveyed 47 consecutive patients seen by telemedicine, 45% female with median age of 33 years. Telemedicine connection was set up by the patient in 74% of cases, or by the patient's mother (15%), other family member (9%), or other caregiver (2 %). Median patient satisfaction score was 5 ("highly satisfied") on a 5-point Likert scale with mean score of 4.6. Telemedicine visit was done using a smartphone by 62% of patients, a computer by 36% of patients, and a tablet by 2% of patients. A home WiFi connection was used in 83% of patients. CONCLUSIONS: Home-based telemedicine visits provide a high-satisfaction method for seizure care delivery despite some obstacles. Demographic disparities may be an obstacle to telemedicine care and seem to relate to race and possibly age, rather than to sex/gender, household income, or access to broadband internet. Additionally, despite high satisfaction overall, more patients felt the physical exam was superior at in-person clinic visits and more patients expressed a preference for in-person visits. During the Covid-19 pandemic when there may be barriers to in-person clinic visits, home-based telemedicine is a feasible alternative.

Smart agent system for insulin infusion protocol management: a simulation-based human factors evaluation study.

OBJECTIVE: To compare the insulin infusion management of critically ill patients by nurses using either a common standard (ie, human completion of insulin infusion protocol steps) or smart agent (SA) system that integrates the electronic health record and infusion pump and automates insulin dose selection. DESIGN: A within subjects design where participants completed 12 simulation scenarios, in 4 blocks of 3 scenarios each. Each block was performed with either the manual standard or the SA system. The initial starting condition was randomised to manual standard or SA and alternated thereafter. SETTING: A simulation-based human factors evaluation conducted at a large academic medical centre. SUBJECTS: Twenty critical care nurses. INTERVENTIONS: A systems engineering intervention, the SA, for insulin infusion management. MEASUREMENTS: The primary study outcomes were error rates and task completion times. Secondary study outcomes were perceived workload, trust in automation and system usability, all measured with previously validated scales. MAIN RESULTS: The SA system produced significantly fewer dose errors compared with manual calculation (17% (n=20) vs 0, p<0.001). Participants were significantly faster, completing the protocol using the SA system (p<0.001). Overall ratings of workload for the SA system were significantly lower than with the manual system (p<0.001). For trust ratings, there was a significant interaction between time (first or second exposure) and the system used, such that after their second exposure to the two systems, participants had significantly more trust in the SA system. Participants rated the usability of the SA system significantly higher than the manual system (p<0.001). CONCLUSIONS: A systems engineering approach jointly optimised safety, efficiency and workload considerations.

Team Physiological Dynamics: A Critical Review.

OBJECTIVE: Review the use of physiological measurement in team settings and propose recommendations to improve the state of the science. BACKGROUND: New sensor and analytical capabilities enable exploration of relationships between team members' physiological dynamics. We conducted a review of physiological measures used in research on teams to understand (1) how these measures are theoretically and operationally related to team constructs and (2) what types of validity evidence exist for physiological measurement in team settings. METHOD: We identified 32 articles that investigated task-performing teams using physiological data. Articles were coded on several dimensions, including team characteristics. Study findings were categorized by relationships tested between team physiological dynamics (TPD) and team inputs, mediators/processes, outputs, or psychometric properties. RESULTS: TPD researchers overwhelmingly measure single physiological systems. Although there is research linking TPD to inputs and outputs, the research on processes is underdeveloped. CONCLUSION: We recommend several theoretical, methodological, and statistical themes to expand the growth of the TPD field. APPLICATION: Physiological measures, once established as reliable indicators of team functioning, might be used to diagnose suboptimal team states and cue interventions to ameliorate these states.

Reducing Three Infections Across Cardiac Surgery Programs: A Multisite Cross-Unit Collaboration.

Using a pre-post design, this study examined the impact of a multifaceted program to simultaneously improve 3 health care-associated infections and patient safety culture throughout the cardiac surgery service line in 11 hospitals. Interventions included the Comprehensive Unit-based Safety Program to improve safety culture and evidence-based bundles to prevent central line-associated bloodstream infection (CLABSI), surgical site infection (SSI), and ventilator-associated pneumonia (VAP). CLABSIs and SSIs showed a downward trend over 2 years, then the rates returned to levels similar to baseline in the third year. VAP rate changes were difficult to interpret because of the VAP definition change. Patient safety culture domain "hospital management support" showed significant improvement, but feedback and communication about errors and staffing declined. Simultaneous implementation of multiple interventions across units is challenging. The findings highlight the importance of sustainment efforts and suggest future work should anticipate both positive and negative change in safety culture dimensions.

Human Factors Evaluation of the Universal Anaesthesia Machine: Assessing Equipment with High-Fidelity Simulation Prior to Deployment in a Resource-Constrained Environment.

BACKGROUND: Anesthesia providers in low- and middle-income countries face many challenges, including poor availability of functioning equipment designed to meet their environmental, organizational, and resource constraints. These are serious global health disparities which threaten access to care and patient safety for those who receive surgical care. In this study, we conducted a simulation-based human factors analysis of the Universal Anaesthesia Machine (UAM®), a device designed to support anesthesia providers in austere medical settings. Our team anticipated the introduction of the UAM® to the two major referral hospitals in Freetown, Sierra Leone. A prior observational study had identified these two hospitals as having environmental conditions consistent with an austere environment: an unstable electrical grid, as well as limited access to compressed oxygen, biomedical support, and consumables. Although the Baltimore simulation environment cannot reproduce all of the challenges present in a resource-constrained environment such as Sierra Leone, the major impediments to standard anesthesia machine functionality and human factors-associated use can be reproduced with the use of high-fidelity simulation. Using anesthesia care providers who have limited UAM® familiarity, this study allowed for the examination of machine-user issues in a controlled environment in preparation for further field studies concerning equipment introduction, training and device deployment in Sierra Leone. The goals of this study were: 1. to assess the usability of the UAM® (machine-user interface, simulated patient use, symbology, etc.) across different provider user groups during simulation of use in scenarios depicting routine use in healthy patients, use in clinically challenging patients and use in environmentally-challenging scenarios in a controlled setting devoid of patient risk, and 2. To gather feedback on available UAM manuals and cognitive aides and UAM usability issues in order to guide development of curricula for training providers on use of the UAM® in the intended austere clinical environments. METHODS: Residents, fellows, attending physician anesthesiologists, student nurse anesthetists, and nurse anesthetists participated in a variety of simulations involving the Universal Anaesthesia Machine® at the Johns Hopkins Medicine Simulation Center between September 2012 and July 2013. Data collected included participant demographics, performance during simulation scenarios captured with critical action checklists, workload ratings captured with the National Aeronautics and Space Administration Task Load Index (NASA TLX), and participant reactions to UAM® use captured through a post-session survey and semi-structured usability debriefing. The scenarios were: 1. normal use (machine check, induction, and maintenance of an uneventful case), 2. use in a challenging clinical condition (acute onset of bronchospasm) and 3.use in an adverse environmental event (power failure). Critical action checklists and workload ratings were analyzed by Analysis of Covariance (ANCOVA) to control for participant demographics. Usability debriefings were analyzed qualitatively. RESULTS: Thirty-five anesthesia providers participated in the study. Overall participant ratings, observations of performance in simulation scenarios, and usability debriefings indicated a high level of usability for the UAM®. Mean participant ratings were high for ease of use (5.4 ± 0.96) and clarity of instruction (6.2 ± 0.87) on a 7-point scale in which higher ratings indicate more positive perceptions. After adjusting for clinical experience, workload ratings were significantly higher in the bronchospasm scenario than in the normal/routine use (P = 0.046; 95% CI, 0.33-34.7) or power failure scenarios (P = 0.012; 95% CI, 5.24-37.9). Thirty-two specific usability issues were identified and grouped into five themes: device design and labeling, machine use during simulation scenarios, user-anticipated errors or hazards, curriculum issues, and overall impressions of the UAM®. CONCLUSIONS: The UAM® design addresses many of the key challenges facing anesthesia providers in resource-constrained settings. The simulation-based human factors evaluation described here successfully identified opportunities for continued refinement of the initial device design as well as issues to be addressed in future curricula and cognitive aides.

Managing creativity and compliance in the pursuit of patient safety.

BACKGROUND: Are creativity and compliance mutually exclusive? In clinical settings, this question is increasingly relevant. Hospitals and clinics seek the creative input of their employees to help solve persistent patient safety issues, such as the prevention of bloodstream infections, while simultaneously striving for greater adherence to evidence-based guidelines and protocols. Extant research provides few answers about how creativity works in such contexts. METHODS: Cross-sectional survey data were collected from employees in 24 different U.S.-based outpatient hemodialysis clinics. Linear mixed-effects models were utilized to test study hypotheses. Professional status, clinic climate variables, and interaction terms were modeled as fixed effects, with a random effect for clinic included in all models. RESULTS: Our results show that high status employees contributed more creative patient safety improvement ideas compared to low status employees. However, when high status employees were part of clinics with a stronger safety climate of compliance, they contributed fewer creative ideas compared to their counterparts working in clinics with a reduced compliance orientation. We also predicted low status employees working in less punitive clinics would contribute more creative ideas, but this hypothesis was not fully supported. CONCLUSIONS: This study suggests that in hospitals and clinics that rely on strict protocols and formal hierarchies to meet their goals, the factors that promote creativity may be distinctively context-dependent. Implications for theory, practice, as well as future directions for research examining creativity in healthcare and safety critical contexts are discussed.

A comparison of two structured taxonomic strategies in capturing adverse events in U.S. hospitals.

OBJECTIVE: To compare the Agency for Healthcare Research and Quality's Quality and Safety Review System (QSRS) and the proposed triadic structure for the 11th version of the International Classification of Disease (ICD-11) in their ability to capture adverse events in U.S. hospitals. DATA SOURCES/STUDY SETTING: One thousand patient admissions between 2014 and 2016 from three general, acute care hospitals located in Maryland and Washington D.C. STUDY DESIGN: The admissions chosen for the study were a random sample from all three hospitals. DATA COLLECTION/EXTRACTION METHODS: All 1000 admissions were abstracted through QSRS by one set of Certified Coding Specialists and a different set of coders assigned the draft ICD-11 codes. Previously assigned ICD-10-CM codes for 230 of the admissions were also used. PRINCIPAL FINDINGS: We found less than 20 percent agreement between QSRS and ICD-11 in identifying the same adverse event. The likelihood of a mismatch between QSRS and ICD-11 was almost twice that of a match. The findings were similar to the agreement found between QSRS and ICD-10-CM in identifying the same adverse event. When coders were provided with a list of potential adverse events, the sensitivity and negative predictive value of ICD-11 improved. CONCLUSIONS: While ICD-11 may offer an efficient way of identifying adverse events, our analysis found that in its draft form, it has a limited ability to capture the same types of events as QSRS. Coders may require additional training on identifying adverse events in the chart if ICD-11 is going to prove its maximum benefit.