Usability Testing of Situation Awareness Clinical Decision Support in the Intensive Care Unit.

OBJECTIVE: Our objective was to evaluate the usability of an automated clinical decision support (CDS) tool previously implemented in the pediatric intensive care unit (PICU) to promote shared situation awareness among the medical team to prevent serious safety events within children's hospitals. METHODS: We conducted a mixed-methods usability evaluation of a CDS tool in a PICU at a large, urban, quaternary, free-standing children's hospital in the Midwest. Quantitative assessment was done using the system usability scale (SUS), while qualitative assessment involved think-aloud usability testing. The SUS was scored according to survey guidelines. For think-aloud testing, task times were calculated, and means and standard deviations were determined, stratified by role. Qualitative feedback from participants and moderator observations were summarized. RESULTS: Fifty-one PICU staff members, including physicians, advanced practice providers, nurses, and respiratory therapists, completed the SUS, while ten participants underwent think-aloud usability testing. The overall median usability score was 87.5 (interquartile range: 80-95), with over 96% rating the tool's usability as "good" or "excellent." Task completion times ranged from 2 to 92 seconds, with the quickest completion for reviewing high-risk criteria and the slowest for adding to high-risk criteria. Observations and participant responses from think-aloud testing highlighted positive aspects of learnability and clear display of complex information that is easily accessed, as well as opportunities for improvement in tool integration into clinical workflows. CONCLUSION: The PICU Warning Tool demonstrates good usability in the critical care setting. This study demonstrates the value of postimplementation usability testing in identifying opportunities for continued improvement of CDS tools.

Clinician Perspectives on Continuous Monitor Use in a Children's Hospital: A Qualitative Study.

BACKGROUND AND OBJECTIVES: Variation in continuous cardiopulmonary monitor (cCPM) use across children's hospitals suggests preference-based use. We sought to understand how clinical providers make decisions to use cCPMs. METHODS: We conducted a qualitative study using semi-structed interviews with clinicians (nurses, respiratory therapists [RTs], and resident and attending physicians) from 2 hospital medicine units at a children's hospital. The interview guide employed patient cases and open-ended prompts to elicit information about workflows and decision-making related to cCPM, and we collected basic demographic information about participants. We used an inductive approach following thematic analysis to code transcripts and create themes. RESULTS: We interviewed 5 nurses, 5 RTs, 7 residents, and 7 attending physicians. We discovered that clinicians perceive a low threshold for starting cCPM, and this often occurred as a default action at admission. Clinicians thought of cCPMs as helping them cope with uncertainty. Despite acknowledging considerable flaws in how cCPMs were used, they were perceived as a low-risk intervention. Although RNs and RTs were most aware of the patient's current condition and number of alarms, physicians decided when to discontinue monitors. No structured process for identifying when to discontinue monitors existed. CONCLUSIONS: We concluded that nurses, physicians, and RTs often default to cCPM use and lack a standardized process for identifying when cCPM should be discontinued. Interventions aiming to reduce monitor use will need to account for or target these factors.

Improved recognition of lung function decline as signal of cystic fibrosis pulmonary exacerbation: a Cystic Fibrosis Learning Network Innovation Laboratory quality improvement initiative.

INTRODUCTION: Cystic fibrosis (CF) is a systemic autosomal recessive condition characterised by progressive lung disease. CF pulmonary exacerbations (PEx) are episodes of worsening respiratory status, and frequent PEx are a risk factor for accelerated lung function decline, yet many people with CF (PwCF) go untreated at the time of decline. The goal of this quality improvement (QI) initiative was to improve recognition, treatment and follow-up of PEx in PwCF. METHODS: Using the Model for Improvement, the Cystic Fibrosis Learning Network (CFLN) initiated a QI innovation laboratory (iLab) with a global aim to decrease the rate of lung function decline in PwCF. The iLab standardised definitions for signals of PEx using a threshold for decline in forced expiratory volume in one second (FEV1) and/or changes in symptoms. The FEV1 decline signal was termed FIES (FEV1-indicated exacerbation signal). Processes for screening and recognition of FIES and/or symptom changes, a treatment algorithm and follow-up in the presence of a signal were tested concurrently in multiple settings. SPECIFIC AIMS: The specific aim is to increase the per cent of PwCF assessed for a PEx signal at ambulatory encounters and to increase the per cent of recommendations to follow-up within 6 weeks for PwCF experiencing a PEx signal. RESULTS: FIES recognition increased from 18.6% to 73.4% across all teams during the iLab, and every team showed an improvement. Of PwCF assessed, 15.8% experienced an FIES event (>10% decline in FEV1 per cent predicted (FEV1pp)). Follow-up within 6 weeks was recommended for an average of 70.5% of those assessed for FIES and had an FEV1pp decline greater than 5%. CONCLUSION: The CFLN iLab successfully defined and implemented a process to recognise and follow-up PEx signals. This process has the potential to be spread to the larger CF community. Further studies are needed to assess the impact of these processes on PwCF outcomes.