Clinicians satisfaction with CPOE ease of use and effect on clinicians' workflow, efficiency and medication safety.

OBJECTIVES: To study the satisfaction of end-users of a computerized physician order entry (CPOE) system concerning ease of use and the effect on users' workflow, efficiency, and medication safety and to seek users' opinions regarding required improvements of the system. Usability evaluation had shown that this system, which was in use for almost a decade, contained a number of severe usability problems. So another objective of the study was to determine whether there was a direct relation between user satisfaction and the results of a usability evaluation of the system. METHODS: Two survey questionnaires were distributed to CPOE system users (physicians and nurses) working in inpatient departments of a university hospital. Questionnaires included items that were rated using a five point Likert scale. Multiple choice questions with space for free text additions also were used to collect qualitative data concerning the use of the CPOE system and the users' opinion concerning system requirements for improvement. Data were analyzed using descriptive statistics and by the use of Mann-Whitney U and Kruskal Wallis tests. RESULTS: Two hundred seventeen physicians and 587 nurses were eligible to participate in this study (response rate 49% and 56% respectively). Physicians were satisfied with the CPOE ease of use (median 3.8, interquartile range [IQR] 3.3-4), and the effect on workflow (median 3.7, IQR 3.3-4), medication safety (median 3.75, IQR 3-4), and efficiency (median 4, IQR 3-4). Nurses also had a positive attitude towards CPOE ease of use (median 3.6, IQR 3-4), and its effect on workflow (median 3, IQR 3-3.6), medication safety (median 3, IQR 2.5-3.5), and efficiency (median 3.5, IQR 3-4). Users mainly indicated that the system needs: supplementary functionalities (e.g. alerts for allergies), improvement of current functionalities, integration with other hospital information systems and improvement of information presentation (e.g. a clear medication overview). Users did not use some current functionalities because of lack of awareness of the functionalities or having difficulty in using them. CONCLUSIONS: Users of this CPOE system, which was used for almost a decade, were satisfied with the system's ease of use and its effect on efficiency, workflow and medication safety although the system showed many usability problems and lacked some functionalities. In this case study, therefore, there seems no direct relation between the results of the earlier performed usability evaluation and user satisfaction as determined in the current study.

Effect of predefined order sets and usability problems on efficiency of computerized medication ordering.

OBJECTIVES: To study the effect of predefined order sets on the efficiency of computerized medication ordering, and to analyze the effect of different types of usability problems on ordering efficiency. METHODS: Crossover study to comparing the efficiency of two methods of ordering (with and without use of predefined order sets) in a laboratory setting using a computerized physician order entry system (CPOE). The excess number of mouse clicks and keystrokes (the difference in number of mouse clicks and keystrokes needed by each physician and the minimally required numbers to accomplish the ordering tasks) for each method was measured and per physician, occurrences of usability problems during the task sessions were recorded. Observed usability problems were categorized using Zhang et al.'s heuristic principles of good user interface design. The effect of different types of usability problems on the excess number of mouse clicks and keystrokes was statistically analyzed. RESULTS: The median excess number of mouse clicks and keystrokes needed by physicians was 6.2 times lower in the method with predefined order sets (p<0.01). The excess number of mouse clicks and keystrokes was significantly increased by vague and erroneous system messages with a factor of 2.62 (95% CI 2.24-3.07), the use of unfamiliar language and terminology by a factor of 1.28 (95% CI 1.14-1.43), and non-informative system feedback by a factor of 1.15 (95% CI 1.03-1.28), respectively. Other categories of usability problems had little influence on ordering efficiency. CONCLUSIONS: Predefined order sets can improve the efficiency of computerized ordering by reducing the excess number of mouse clicks and keystrokes. However, the efficiency of computerized ordering can be significantly impaired by usability problems due to vague and incorrect system messages, unfamiliar language, and non-informative system feedback.