Design and Implementation of a Novel Web-Based E-Learning Tool for Education of Health Professionals on the Antibiotic Vancomycin.

BACKGROUND: Traditional approaches to health professional education are being challenged by increased clinical demands and decreased available time. Web-based e-learning tools offer a convenient and effective method of delivering education, particularly across multiple health care facilities. The effectiveness of this model for health professional education needs to be explored in context. OBJECTIVES: The study aimed to (1) determine health professionals' experience and knowledge of clinical use of vancomycin, an antibiotic used for treatment of serious infections caused by methicillin-resistant Staphylococcus aureus (MRSA) and (2) describe the design and implementation of a Web-based e-learning tool created to improve knowledge in this area. METHODS: We conducted a study on the design and implementation of a video-enhanced, Web-based e-learning tool between April 2014 and January 2016. A Web-based survey was developed to determine prior experience and knowledge of vancomycin use among nurses, doctors, and pharmacists. The Vancomycin Interactive (VI) involved a series of video clips interspersed with question and answer scenarios, where a correct response allowed for progression. Dramatic tension and humor were used as tools to engage users. Health professionals' knowledge of clinical vancomycin use was obtained from website data; qualitative participant feedback was also collected. RESULTS: From the 577 knowledge survey responses, pharmacists (n=70) answered the greatest number of questions correctly (median score 4/5), followed by doctors (n=271; 3/5) and nurses (n=236; 2/5; P<.001). Survey questions on target trough concentration (75.0%, 433/577) and rate of administration (64.9%, 375/577) were answered most correctly, followed by timing of first level (49%, 283/577), maintenance dose (41.9%, 242/577), and loading dose (38.0%, 219/577). Self-reported "very" and "reasonably" experienced health professionals were also more likely to achieve correct responses. The VI was completed by 163 participants during the study period. The rate of correctly answered VI questions on first attempt was 65% for nurses (n=63), 68% for doctors (n=86), and 82% for pharmacists (n=14; P<.001), reflecting a similar pattern to the knowledge survey. Knowledge gaps were identified for loading dose (39.2% correct on first attempt; 64/163), timing of first trough level (50.3%, 82/163), and subsequent trough levels (47.9%, 78/163). Of the 163 participants, we received qualitative user feedback from 51 participants following completion of the VI. Feedback was predominantly positive with themes of "entertaining," "engaging," and "fun" identified; however, there were some technical issues identified relating to accessibility from different operating systems and browsers. CONCLUSIONS: A novel Web-based e-learning tool was successfully developed combining game design principles and humor to improve user engagement. Knowledge gaps were identified that allowed for targeting of future education strategies. The VI provides an innovative model for delivering Web-based education to busy health professionals in different locations.

Evaluating the Effect of a Web-Based E-Learning Tool for Health Professional Education on Clinical Vancomycin Use: Comparative Study.

BACKGROUND: Internet-based learning for health professional education is increasing. It offers advantages over traditional learning approaches, as it enables learning to be completed at a time convenient to the user and improves access where facilities are geographically disparate. We developed and implemented the Vancomycin Interactive (VI) e-learning tool to improve knowledge on the clinical use of the antibiotic vancomycin, which is commonly used for treatment of infections caused by methicillin-resistant Staphylococcus aureus (MRSA). OBJECTIVE: The aims of this study were to evaluate the effect of the VI e-learning tool on (1) survey knowledge scores and (2) clinical use of vancomycin among health professionals. METHODS: We conducted a comparative pre-post intervention study across the 14 hospitals of two health districts in New South Wales, Australia. A knowledge survey was completed by nurses, doctors, and pharmacists before and after release of a Web-based e-learning tool. Survey scores were compared with those obtained following traditional education in the form of an email intervention. Survey questions related to dosing, administration, and monitoring of vancomycin. Outcome measures were survey knowledge scores among the three health professional groups, vancomycin plasma trough levels, and vancomycin approvals recorded on a computerized clinical decision support system. RESULTS: Survey response rates were low at 26.87% (577/2147) preintervention and 8.24% (177/2147) postintervention. The VI was associated with an increase in knowledge scores (maximum score=5) among nurses (median 2, IQR 1-2 to median 2, IQR 1-3; P<.001), but not among other professional groups. The comparator email intervention was associated with an increase in knowledge scores among doctors (median 3, IQR 2-4 to median 4, IQR 2-4; P=.04). Participants who referred to Web-based resources while completing the e-learning tool achieved higher overall scores than those who did not (P<.001). The e-learning tool was not shown to be significantly more effective than the comparator email in the clinical use of vancomycin, as measured by plasma levels within the therapeutic range. CONCLUSIONS: The e-learning tool was associated with improved knowledge scores among nurses, whereas the comparator email was associated with improved scores among doctors. This implies that different strategies may be required for optimizing the effectiveness of education among different health professional groups. Low survey response rates limited conclusions regarding the tool's effectiveness. Improvements to design and evaluation methodology may increase the likelihood of a demonstrable effect from e-learning tools in the future.