Effectiveness of social giving on the engagement of pharmacy professionals with a computer-based education platform: a pilot randomized controlled trial.

BACKGROUND: Computer-based education is gaining popularity in healthcare professional development education due to ease of distribution and flexibility. However, there are concerns regarding user engagement. This pilot study aims to: 1) assess the feasibility and acceptability of a social reward and the corresponding study design; and 2) to provide preliminary data on the impact of social reward on user engagement. METHODS: A mixed method study combing a four-month pilot randomized controlled trial (RCT), surveys and interviews. The RCT was conducted using a computer-based education platform. Participants in the intervention group had access to a social reward feature, where they earned one meal for donation when completing a quiz with a passing score. Participants in the control group did not have access to this feature. Feasibility and acceptability of the social reward were assessed using surveys and telephone interviews. Feasibility of the RCT was assessed by participant recruitment and retention. User engagement was assessed by number of quizzes and modules completed. RESULTS: A total of 30 pharmacy professionals were recruited with 15 users in each arm. Participants reported high acceptability of the intervention. The total number of quizzes completed by the intervention group was significantly higher compared to the control group (n = 267 quizzes Vs. n = 97 quizzes; p-value 0.023). CONCLUSION: The study demonstrates the feasibility and acceptability of a web-based trial with pharmacy professionals and the social reward intervention. It also shows that the social reward can improve user engagement. A future definitive RCT will explore the sustainability of the intervention.

Evaluating the Effectiveness of the Computer-Based Education Platform, Pharmacy5in5, on Pharmacists' Knowledge of Anticholinergic Toxicity Using a Randomized Controlled Trial.

BACKGROUND: Computer-based education has been widely implemented in healthcare professional development education. However, there has been little examination of the potential for computer-based education to enhance pharmacists' knowledge. This study aims to assess the effectiveness of computer-based education on improving pharmacists' knowledge compared to printed education material. METHODS: This study was a web-based randomized controlled trial. Participants were randomly allocated to either an intervention group where they had access to the computer-based education module on Pharmacy5in5.ca or to a control group where they had access to printed educational material. Knowledge gain was assessed using a pre- and post-knowledge test. RESULTS: A total of 120 pharmacists were recruited and 101 completed the post-knowledge test (50/60 in the intervention group; 51/60 in the control group). Both groups showed a significant increase in knowledge gain (intervention group: pre-test mean score 19.35 ± 3.56, post-test mean score 22.42 ± 3.812, p value < 0.001; control group pre-test mean score 19.22 ± 3.45, post-test mean score 23.29 ± 3.087, p value < 0.001). However, the difference in knowledge change was not significant between the two groups (22.42 vs. 23.29, p value = 0.333). CONCLUSIONS: In this study, a computer-based education module enhanced pharmacists' knowledge to a similar degree to printed education material. Efforts should be made to provide computer-based education as an option to support pharmacists' professional development.

Assessing pharmacists' knowledge and compliance with narcotic inventory management using a computer-based educational platform.

OBJECTIVES: Pharmacy professionals are required to take all necessary steps to protect commonly misused drugs such as opioids at their pharmacies to minimize the risk of diversion. The aim of this study is to assess Canadian pharmacy professionals' knowledge and compliance with federal and provincial regulations using the computer-based educational platform Pharmacy5in5. METHODS: A Narcotic Inventory module was created and reviewed by experts representing provincial and federal regulators. Descriptive statistics were used to analyze users' performance in quizzes. Binomial regression and logistic regression models were used to investigate the effect of demographic factors on users' performance. P-values less than 0.05 were considered statistically significant. KEY FINDINGS: The analysis included data collected over a period of three months. A total of 792 users accessed the Narcotic Inventory module on the Pharmacy5in5 website between July 2019 and November 2019. Most of the users were licenced pharmacists (64%), female (72%), received their training in Canada (68%), and were practising in Ontario (80%). Users performed best on the quiz addressing the steps for reconciliation of inventory (93%), and worst on the quiz reviewing how to prepare for a Health Canada visit (66%). CONCLUSIONS: Overall, pharmacy professionals showed adequate knowledge of the CDSA and provincial/territorial regulations regarding opioids inventory management. Conversely, the study highlighted poor compliance with the reporting of losses and theft of controlled substances by pharmacy professionals. Innovative approaches are needed to influence pharmacy professionals' behaviours to improve their compliance with best practices concerning inventory management to reduce drug diversion.

Assessing Performance and Engagement on a Computer-Based Education Platform for Pharmacy Practice.

A computer-based education platform was developed using a theory-based approach to help Canadian pharmacy professionals adopt their full scope of practice. Data from the platform were used to identify factors that impacted user performance and engagement. A de-identified dataset included response data for 21 unique modules, including quiz responses and self-reflection questions. Outcome measures included user performance (mean quiz score) and engagement (completion rate for attempted modules). Analysis of variance (ANOVA), multivariate regression modelling, and machine learning cluster analysis were used to analyze the data. Of the 5290 users, 68% were pharmacists, 11% were technicians, 13% were pharmacy students, and 8% were pharmacy technician students. Four clusters were identified separately for pharmacists and technicians. Clusters with the higher performance and engagement tended to have more users practicing in community pharmacies while the lower performing clusters tended have more internationally trained users. In the regression modelling, pharmacists performed better than technicians and students while students were more engaged (p < 0.0001). Further, internationally trained pharmacists had slightly lower scores but similar engagement compared to domestically trained pharmacists (p < 0.0001). Users demonstrated higher performance on modules related to scope of practice than on clinical topics, and were most engaged with topics directly impacting daily practice such as influenza vaccinations and new and emerging subjects such as cannabis. The cluster analysis suggests that performance and engagement with a computer-based educational platform in pharmacy may be more related to place of practice than to personal demographic factors such as age or gender.

Using a course pilot in the development of an online problem-based learning (PBL) therapeutics course in a post-professional PharmD program.

BACKGROUND AND PURPOSE: To assess whether the traditional problem-based learning (PBL) process can be replicated in an online environment, and to identify any barriers and facilitators to learning using a course pilot. EDUCATIONAL ACTIVITY AND SETTING: Eight alumni and one experienced tutor participated in a two-week simulated PBL course comprised of two three-hour synchronous online tutorials. Blackboard Collaborate® software was used to permit audio and visual interaction. The PBL tutorials were recorded and observed by the researchers. Participants completed satisfaction surveys after the pilot, and were invited to take part in a focus group to debrief about their experience. FINDINGS: Once the steep learning curve with the technology was overcome, the quality of the PBL process was similar in the online course as it was in the face-to-face course. Several key factors for success were identified through analysis of the videotaped sessions, and interviews with the participants in the course pilot. SUMMARY: Conducting a course pilot study demonstrated that an online PBL course is feasible, and identified some considerations to facilitate success.