Usability Assessment of Secure Messaging for Clinical Document Sharing between Health Care Providers and Patients.

BACKGROUND: Web-based patient portals feature secure messaging systems that enable health care providers and patients to communicate information. However, little is known about the usability of these systems for clinical document sharing. OBJECTIVE: This article evaluates the usability of a secure messaging system for providers and patients in terms of its ability to support sharing of electronic clinical documents. METHODS: We conducted usability testing with providers and patients in a human-computer interaction laboratory at a Midwestern U.S. hospital. Providers sent a medication list document to a fictitious patient via secure messaging. Separately, patients retrieved the clinical document from a secure message and returned it to a fictitious provider. We collected use errors, task completion, task time, and satisfaction. RESULTS: Twenty-nine individuals participated: 19 providers (6 physicians, 6 registered nurses, and 7 pharmacists) and 10 patients. Among providers, 11 (58%) attached and sent the clinical document via secure messaging without requiring assistance, in a median (range) of 4.5 (1.8-12.7) minutes. No patients completed tasks without moderator assistance. Patients accessed the secure messaging system within 3.6 (1.2-15.0) minutes; retrieved the clinical document within 0.8 (0.5-5.7) minutes; and sent the attached clinical document in 6.3 (1.5-18.1) minutes. Although median satisfaction ratings were high, with 5.8 for providers and 6.0 for patients (scale, 0-7), we identified 36 different use errors. Physicians and pharmacists requested additional features to support care coordination via health information technology, while nurses requested features to support efficiency for their tasks. CONCLUSION: This study examined the usability of clinical document sharing, a key feature of many secure messaging systems. Our results highlight similarities and differences between provider and patient end-user groups, which can inform secure messaging design to improve learnability and efficiency. The observations suggest recommendations for improving the technical aspects of secure messaging for clinical document sharing.

Usability evaluation of a medication reconciliation tool: Embedding safety probes to assess users' detection of medication discrepancies.

OBJECTIVE: An electronic medication reconciliation tool was previously developed by another research team to aid provider-patient communication for medication reconciliation. To evaluate the usability of this tool, we integrated artificial safety probes into standard usability methods. The objective of this article is to describe this method of using safety probes, which enabled us to evaluate how well the tool supports users' detection of medication discrepancies. MATERIALS AND METHODS: We completed a mixed-method usability evaluation in a simulated setting with 30 participants: 20 healthcare professionals (HCPs) and 10 patients. We used factual scenarios but embedded three artificial safety probes: (1) a missing medication (i.e., omission); (2) an extraneous medication (i.e., commission); and (3) an inaccurate dose (i.e., dose discrepancy). We measured users' detection of each probe to estimate the probability that a HCP or patient would detect these discrepancies. Additionally, we recorded participants' detection of naturally occurring discrepancies. RESULTS: Each safety probe was detected by ≤50% of HCPs. Patients' detection rates were generally higher. Estimates indicate that a HCP and patient, together, would detect 44.8% of these medication discrepancies. Additionally, HCPs and patients detected 25 and 45 naturally-occurring discrepancies, respectively. DISCUSSION: Overall, detection of medication discrepancies was low. Findings indicate that more advanced interface designs are warranted. Future research is needed on how technologies can be designed to better aid HCPs' and patients' detection of medication discrepancies. CONCLUSION: This is one of the first studies to evaluate the usability of a collaborative medication reconciliation tool and assess HCPs' and patients' detection of medication discrepancies. Results demonstrate that embedded safety probes can enhance standard usability methods by measuring additional, clinically-focused usability outcomes. The novel safety probes we used may serve as an initial, standard set for future medication reconciliation research. More prevalent use of safety probes could strengthen usability research for a variety of health information technologies.

Community health integration through pharmacy process and ergonomics redesign (CHIPPER).

As the expansion and utilisation of community pharmacy systems increases, so does the risk for an adverse drug event to occur. In attempts to mitigate this risk, many community pharmacies implement health information technology (IT); however, there are challenges in integrating the wider systems components necessary for a successful implementation with minimal unintended consequences. The purpose of this paper is to introduce a Community Health Integration through Pharmacy Process and Ergonomics Redesign (CHIPPER) framework, which explores the multiple angles of health IT integration to support medication delivery processes in community pharmacy systems. Specifically, CHIPPER identifies the information flows that occur between different parts of the system (initiation, upstream, midstream and downstream) with varying end-users and tasks related to medication delivery processes. In addition to the justification and presentation of the CHIPPER model, this paper reviews several broad applications for CHIPPER and presents two example studies that demonstrate the CHIPPER framework. Practitioner Summary: Most medication delivery in the US occurs through outpatient-based community pharmacy practice. Community pharmacies are challenged by inconsistent and incomplete information flow and technology integration between providers, pharmacy practitioners and patients. This paper presents a framework for improved healthcare systems engineering analysis of pharmacy practice, with case study examples.