Real-Time User Feedback to Support Clinical Decision Support System Improvement.

OBJECTIVES: To improve clinical decision support (CDS) by allowing users to provide real-time feedback when they interact with CDS tools and by creating processes for responding to and acting on this feedback. METHODS: Two organizations implemented similar real-time feedback tools and processes in their electronic health record and gathered data over a 30-month period. At both sites, users could provide feedback by using Likert feedback links embedded in all end-user facing alerts, with results stored outside the electronic health record, and provide feedback as a comment when they overrode an alert. Both systems are monitored daily by clinical informatics teams. RESULTS: The two sites received 2,639 Likert feedback comments and 623,270 override comments over a 30-month period. Through four case studies, we describe our use of end-user feedback to rapidly respond to build errors, as well as identifying inaccurate knowledge management, user-interface issues, and unique workflows. CONCLUSION: Feedback on CDS tools can be solicited in multiple ways, and it contains valuable and actionable suggestions to improve CDS alerts. Additionally, end users appreciate knowing their feedback is being received and may also make other suggestions to improve the electronic health record. Incorporation of end-user feedback into CDS monitoring, evaluation, and remediation is a way to improve CDS.

Improving Allergy Documentation: A Retrospective Electronic Health Record System-Wide Patient Safety Initiative.

OBJECTIVES: Documentation of allergies in a coded, non-free-text format in the electronic health record (EHR) triggers clinical decision support to prevent adverse events. Health system-wide patient safety initiatives to improve EHR allergy documentation by specifically decreasing free-text allergy entries have not been reported. The goal of this initiative was to systematically reduce free-text allergen entries in the EHR allergy module. METHODS: We assessed free-text allergy entries in a commercial EHR used at a multihospital integrated health care system in the greater Boston area. Using both manual and automated methods, a multidisciplinary consensus group prioritized high-risk and frequently used free-text allergens for conversion to coded entries, added new allergen entries, and deleted duplicate allergen entries. Environmental allergies were moved to the patient problem list. RESULTS: We identified 242,330 free-text entries, which included a variety of environmental allergies (42%), food allergies (18%), contrast media allergies (13%), "no known allergy" (12%), drug allergies (2%), and "no contrast allergy" (2%). Most free-text entries were entered by medical assistants in ambulatory settings (34%) and registered nurses in perioperative settings (20%). We remediated a total of 52,206 free-text entries with automated methods and 79,578 free-text entries with manual methods. CONCLUSIONS: Through this multidisciplinary intervention, we identified and remediated 131,784 free-text entries in our EHR to improve clinical decision support and patient safety. Additional strategies are required to completely eliminate free-text allergy entry, and establish systematic, consistent, and safe guidelines for documenting allergies.

Association of Physician Characteristics With Early Adoption of Virtual Health Care.

Importance: The rapid transition to virtual health care has depended on physician and patient abilities to adopt new technology and workflows. Physicians transitioning more slowly or not at all could result in access challenges for their patients. Objective: To identify physician characteristics associated with the transition to virtual health care in a large regional health care system. Design, Setting, and Participants: This retrospective cross-sectional study uses administrative health system databases to analyze data from all 3473 physicians providing ambulatory care through a large New England health care system, which includes 12 hospitals and their ambulatory practices, from October 1, 2019, through December 31, 2020. Exposures: Physicians characterized based on gender, popularized generational demographic cohort (Silent Generation, born 1928-1945; Baby Boomers, born 1946-1964; Generation X, born 1965-1980; and Millennials, born 1981-1996), specialty (behavioral health, primary care, medical, and surgical), and hospital affiliation as well as selected patient characteristics (number of visits and proportion of patients with self-pay or Medicaid insurance, aged 65 years or older, preference for speaking a language other than English, from a racial or ethnic minority group, and with an active patient portal). Main Outcomes and Measures: Early adoption of virtual health care. Bivariate comparisons were made, and regression modeling was used to examine characteristics associated with the likelihood of early adoption of virtual health care. Results: Of 3473 physicians conducting ambulatory visits during the study period, 1624 (46.8%) were women, 83 (2.4%) were in the Silent Generation, 994 (28.6%) were Baby Boomers, 1637 (47.1%) were in Generation X, and 759 (21.9%) were Millennials. There were 1649 physicians (47.5%) in medical specialties, 749 physicians (21.6%) in surgical specialties, and 248 physicians (7.1%) in behavioral health. After accounting for other characteristics, female (odds ratio [OR], 1.23; 95% CI, 1.06-1.44), behavioral health (OR, 2.92; 95% CI, 2.11-4.04), and primary care (OR, 1.69; 95% CI, 1.36-2.09) physicians had greater odds of being early adopters, and physicians in the Silent Generation (OR, 0.39, 95% CI, 0.24-0.65) and in surgical specialties (OR, 0.46; 95% CI, 0.38-0.57) were less likely to be early adopters. Patient characteristics were less strongly associated with physician adoption. Conclusions and Relevance: In this cross-sectional study, there was physician-level variation in the adoption of virtual health care, with female, primary care, and behavioral health physicians in this system most likely to lead the transformation to virtual health care.

Digital triage: Novel strategies for population health management in response to the COVID-19 pandemic.

The COVID-19 pandemic has created unique challenges for the U.S. healthcare system due to the staggering mismatch between healthcare system capacity and patient demand. The healthcare industry has been a relatively slow adopter of digital innovation due to the conventional belief that humans need to be at the center of healthcare delivery tasks. However, in the setting of the COVID-19 pandemic, artificial intelligence (AI) may be used to carry out specific tasks such as pre-hospital triage and enable clinicians to deliver care at scale. Recognizing that the majority of COVID-19 cases are mild and do not require hospitalization, Partners HealthCare (now Mass General Brigham) implemented a digitally-automated pre-hospital triage solution to direct patients to the appropriate care setting before they showed up at the emergency department and clinics, which would otherwise consume resources, expose other patients and staff to potential viral transmission, and further exacerbate supply-and-demand mismatching. Although the use of AI has been well-established in other industries to optimize supply and demand matching, the introduction of AI to perform tasks remotely that were traditionally performed in-person by clinical staff represents a significant milestone in healthcare operations strategy.

The effect of daily bathing with chlorhexidine on the acquisition of methicillin-resistant Staphylococcus aureus, vancomycin-resistant Enterococcus, and healthcare-associated bloodstream infections: results of a quasi-experimental multicenter trial.

OBJECTIVE: Spread of multidrug-resistant organisms within the intensive care unit (ICU) results in substantial morbidity and mortality. Novel strategies are needed to reduce transmission. This study sought to determine if the use of daily chlorhexidine bathing would decrease the incidence of colonization and bloodstream infections (BSI) because of methicillin-resistant Staphylococcus aureus (MRSA) and vancomycin-resistant Enterococcus (VRE) among ICU patients. DESIGN, SETTING, AND PATIENTS: Six ICUs at four academic centers measured the incidence of MRSA and VRE colonization and BSI during a period of bathing with routine soap for 6 months and then compared results with a 6-month period where all admitted patients received daily bathing with a chlorhexidine solution. Changes in incidence were evaluated by Poisson and segmented regression modeling. INTERVENTIONS: Daily bathing with a chlorhexidine-containing solution. MEASUREMENTS AND MAIN RESULTS: Acquisition of MRSA decreased 32% (5.04 vs. 3.44 cases/1000 patient days, p = 0.046) and acquisition of VREdecreased 50% (4.35 vs. 2.19 cases/1000 patient days, p = 0.008) following the introduction of daily chlorhexidine bathing. Segmented regression analysis demonstrated significant reductions in VRE bacteremia (p = 0.02) following the introduction of chlorhexidine bathing. VRE-colonized patients bathed with chlorhexidine had a lower risk of developing VRE bacteremia (relative risk 3.35; 95% confidence interval 1.13-9.87; p = 0.035), suggesting that reductions in the level of colonization led to the observed reductions in BSI. CONCLUSION: We conclude that daily chlorhexidine bathing among ICU patients may reduce the acquisition of MRSA and VRE. The approach is simple to implement and inexpensive and may be an important adjunctive intervention to barrier precautions to reduce acquisition of VRE and MRSA and the subsequent development of healthcare-associated BSI.

Continuous Video Recording of Electronic Health Record User Sessions to Support Usability and Safety.

Electronic health records (EHRs) have been shown to improve safety and quality. However, usability and safety issues with EHRs have been reported. The current state of the art in usability testing is to have clinicians conduct simulated activities in a usability lab. In this poster, we describe our experience with continuous recording of real-world EHR use to improve safety and usability.

Implementation of a Novel User Interface for Review of Clinical Microbiology Results.

Compared to other laboratory data, microbiology data are a complex mix of quantitative and qualitative results that return iteratively over time. Commercial electronic health records (EHR) frequently have limitations in the manner in which they manage microbiology data, not attempting to codify data but rather displaying it as text. This contributes to time-consuming and error-prone clinical workflows. We developed a microbiology viewer application to aggregate results and implemented it in our EHR.

Continuous Improvement of Clinical Decision Support via an Embedded Survey Tool.

Clinical decision support systems (CDSS) are widely used to improve patient care and guide workflow. End users can be valuable contributors to monitoring for CDSS malfunctions. However, they often have little means of providing direct feedback on the design and build of such systems. In this study, we describe an electronic survey tool deployed from within the electronic health record and coupled with a conversation with Clinical Informaticians as a method to manage CDSS design and lifecycle.

Importance of clinical decision support system response time monitoring: a case report.

Clinical decision support (CDS) systems are prevalent in electronic health records and drive many safety advantages. However, CDS systems can also cause unintended consequences. Monitoring programs focused on alert firing rates are important to detect anomalies and ensure systems are working as intended. Monitoring efforts do not generally include system load and time to generate decision support, which is becoming increasingly important as more CDS systems rely on external, web-based content and algorithms. We report a case in which a web-based service caused significant increase in the time to generate decision support, in turn leading to marked delays in electronic health record system responsiveness, which could have led to patient safety events. Given this, it is critical to consider adding decision support-time generation to ongoing CDS system monitoring programs.

Strain-relatedness of methicillin-resistant Staphylococcus aureus isolates recovered from patients with repeated infection.

Invasive disease following methicillin-resistant Staphylococcus aureus (MRSA) detection is common, regardless of whether initial detection involves colonization or infection. We assessed the genetic relatedness of isolates obtained > or =2 weeks apart representing either repeated infections or colonization-infection sets to determine if infections are likely to be caused by previously harbored strains. We found that MRSA infection following initial colonization or infection is caused by the same strain in most cases, suggesting that a single successful attempt at decolonization may prevent the majority of later infection.

Development and evaluation of a novel user interface for reviewing clinical microbiology results.

Background: Microbiology laboratory results are complex and cumbersome to review. We sought to develop a new review tool to improve the ease and accuracy of microbiology results review. Methods: We observed and informally interviewed clinicians to determine areas in which existing microbiology review tools were lacking. We developed a new tool that reorganizes microbiology results by time and organism. We conducted a scenario-based usability evaluation to compare the new tool to existing legacy tools, using a balanced block design. Results: The average time-on-task decreased from 45.3 min for the legacy tools to 27.1 min for the new tool (P < .0001). Total errors decreased from 41 with the legacy tools to 19 with the new tool (P = .0068). The average Single Ease Question score was 5.65 (out of 7) for the new tool, compared to 3.78 for the legacy tools (P < .0001). The new tool scored 88 ("Excellent") on the System Usability Scale. Conclusions: The new tool substantially improved efficiency, accuracy, and usability. It was subsequently integrated into the electronic health record and rolled out system-wide. This project provides an example of how clinical and informatics teams can innovative alongside a commercial Electronic Health Record (EHR).

Preventing catheter-associated bloodstream infections: a survey of policies for insertion and care of central venous catheters from hospitals in the prevention epicenter program.

OBJECTIVE: To determine the extent to which evidence-based practices for the prevention of central venous catheter (CVC)-associated bloodstream infections are incorporated into the policies and practices of academic intensive care units (ICUs) in the United States and to determine variations in the policies on CVC insertion, use, and care. DESIGN: A 9-page written survey of practices and policies for nontunneled CVC insertion and care. SETTING: ICUs in 10 academic tertiary-care hospitals. PARTICIPANTS: ICU medical directors and nurse managers. RESULTS: Twenty-five ICUs were surveyed (1-6 ICUs per hospital). In 80% of the units, 5 separate groups of clinicians inserted 24%-50% of all nontunneled CVCs. In 56% of the units, placement of more than two-thirds of nontunneled CVCs was performed in a single location in the hospital. Twenty units (80%) had written policies for CVC insertion. Twenty-eight percent of units had a policy requiring maximal sterile-barrier precautions when CVCs were placed, and 52% of the units had formal educational programs with regard to CVC insertion. Eighty percent of the units had a policy requiring staff to perform hand hygiene before inserting CVCs, but only 36% and 60% of the units required hand hygiene before accessing a CVC and treating the exit site, respectively. CONCLUSION: ICU policy regarding the insertion and care of CVCs varies considerably from hospital to hospital. ICUs may be able to improve patient outcome if evidence-based guidelines for CVC insertion and care are implemented.

A multicenter intervention to prevent catheter-associated bloodstream infections.

BACKGROUND: Education-based interventions can reduce the incidence of catheter-associated bloodstream infection. The generalizability of findings from single-center studies is limited. OBJECTIVE: To assess the effect of a multicenter intervention to prevent catheter-associated bloodstream infections. DESIGN: An observational study with a planned intervention. SETTING: Twelve intensive care units and 1 bone marrow transplantation unit at 6 academic medical centers. PATIENTS: Patients admitted during the study period. INTERVENTION: Updates of written policies, distribution of a 9-page self-study module with accompanying pretest and posttest, didactic lectures, and incorporation into practice of evidence-based guidelines regarding central venous catheter (CVC) insertion and care. MEASUREMENTS: Standard data collection tools and definitions were used to measure the process of care (ie, the proportion of nontunneled catheters inserted into the femoral vein and the condition of the CVC insertion site dressing for both tunneled and nontunneled catheters) and the incidence of catheter-associated bloodstream infection. RESULTS: Between the preintervention period and the postintervention period, the percentage of CVCs inserted into the femoral vein decreased from 12.9% to 9.4% (relative ratio, 0.73; 95% confidence interval [CI], 0.61-0.88); the total proportion of catheter insertion site dressings properly dated increased from 26.6% to 34.4% (relative ratio, 1.29; 95% CI, 1.17-1.42), and the overall rate of catheter-associated bloodstream infections decreased from 11.2 to 8.9 infections per 1,000 catheter-days (relative rate, 0.79; 95% CI, 0.67-0.93). The effect of the intervention varied among individual units. CONCLUSIONS: An education-based intervention that uses evidence-based practices can be successfully implemented in a diverse group of medical and surgical units and reduce catheter-associated bloodstream infection rates.

Assessing information system readiness for mitigating malpractice risk through simulation: results of a multi-site study.

OBJECTIVE: To develop and test an instrument for assessing a healthcare organization's ability to mitigate malpractice risk through clinical decision support (CDS). MATERIALS AND METHODS: Based on a previously collected malpractice data set, we identified common types of CDS and the number and cost of malpractice cases that might have been prevented through this CDS. We then designed clinical vignettes and questions that test an organization's CDS capabilities through simulation. Seven healthcare organizations completed the simulation. RESULTS: All seven organizations successfully completed the self-assessment. The proportion of potentially preventable indemnity loss for which CDS was available ranged from 16.5% to 73.2%. DISCUSSION: There is a wide range in organizational ability to mitigate malpractice risk through CDS, with many organizations' electronic health records only being able to prevent a small portion of malpractice events seen in a real-world dataset. CONCLUSION: The simulation approach to assessing malpractice risk mitigation through CDS was effective. Organizations should consider using malpractice claims experience to facilitate prioritizing CDS development.

Pseudo-outbreak of multidrug-resistant Mycobacterium tuberculosis associated with presumed laboratory processing contamination.

An investigation prompted by six positive cultures for multidrug-resistant Mycobacterium tuberculosis during a 7-week period found that an unusual resistance pattern, temporal proximity of laboratory processing, and identical DNA fingerprints supported the theory of cross-contamination. Laboratory processing procedures included specimen batching and multi-use vials of buffer solution. Processing procedures were changed and no additional cases of suspected cross-contamination have been observed.