A teamwork OSCE station - Encompassing shared decision making between a doctor, pharmacist and patient.

BACKGROUND AND PURPOSE: Teamwork with a focus on incorporating interprofessional education (IPE) is a core skill taught in pharmacy curriculum. Including the patient in shared decision making has become a more empathetic and holistic approach to care. Teamwork skills and approaches are usually assessed by peers via group work. EDUCATIONAL ACTIVITY AND SETTING: A teamwork Objective Structured Clinical Examination (OSCE) station was implemented in 2022 in two countries, conducted in final year pharmacy students where students had to solve a clinical scenario with a doctor and patient in the room and manage any resistances to therapy recommendations. Students were marked on their collaborative skills and how they articulated clinical evidence to justify their therapy recommendations to reach an optimal goal to suit the team. Perception data from students simulated patients and doctors were also collected. FINDINGS: Across both countries (n = 414), the overall mean score was 79.1% (24.0%SD) across six different OSCE cases. Students generally struggled with the concept of engaging in a two-way conversation, and often presented their full recommendations without any breaks to confirm understanding or agreement. Simulated patients appreciated the OSCE showing a patient role in decision making. Simulated doctors valued the OSCE for its assessment of clinical justification in times of disagreement. Overall, 86.2% of students (n = 354) agreed or strongly agreed the station assessed their teamwork skills adequately. SUMMARY: A teamwork OSCE station is a valuable assessment for assessing shared decision making skills and more work around prepare students to engage in two-way conversations is needed.

Do students' self-reflections of performance align with their graded performance in objective structured clinical exams?

INTRODUCTION: Self-awareness of strengths and weaknesses through self-reflection are important for life-long learning and development. The aim of this study was to assess the alignment in third-year undergraduate pharmacy students' self-reflections of their objective structured clinical exam (OSCE) performance to their actual OSCE scores and explore the most common aspects students reflected on as markers of perceived performance. METHODS: Students completed a three-station OSCE and a written self-reflection about their performance. These reflections were coded using a latent pattern content analysis, with categories defined as "doing well (≥ 50% on exam)" and "not doing well (< 50% on exam)" and compared to their actual OSCE exam scores, to determine the degree of alignment. RESULTS: Two hundred sixty-nine students completed the OSCE and reflection. Students had a low degree of alignment between their self-reflections and actual OSCE performance. Low alignment was overwhelmingly prevalent and significant in high-achieving students with OSCE scores of ≥90%. Most common aspects students reflected on as indicators of performance were finishing on time and communicating effectively. High-achieving students reflected on aspects such as empathy, systematic questioning, and patient teach-back as aspects of their performance. CONCLUSIONS: Student reflections on exam performance do not align with their actual performance, particularly amongst the high-achieving students. High-achieving students were more aware of the different aspects that affected their performance. To ensure that high-achieving students are aware of their strengths, educators should provide more targeted feedback mechanisms and positive reassurances to help these students become more confident in their decision-making skills.

Substitution of a Traditional Face-to-Face Workshop With Virtual Escape Room in Higher Education: A Cost-Effectiveness Analysis.

INTRODUCTION: Online education games are gaining ground in health profession education, yet there is limited literature on its costs. This study is an economic evaluation of the substitution of a face-to-face (F2F) workshop with an online escape room game teaching the same content. METHODS: A traditional F2F workshop on hepatitis management was conducted with 364 students in 2021 and was compared with a virtual self-run escape room game called Hepatitiscape™, which was used by 417 students in 2022. The outcomes were final examination and objective structured clinical examination (OSCE) scores for hepatitis stations. An incremental cost-effectiveness ratio was used to compare costs and outcomes. Student perceptions of the delivery of Hepatitiscape™ were also captured using an online questionnaire. RESULTS: Delivering the hepatitis case workshop via Hepatitiscape™ yielded an additional 4.77% increase in the final examination score and a 21.04% increase in the OSCE score at an additional cost of AUD $4212 in the first year compared with F2F delivery. This equated to an incremental cost-effectiveness ratio of AUD 883 per additional score of final examination and AUD 200 per additional score of OSCE for hepatitis stations. Hepatitiscape™ became cost saving from the second year onward. Student perception data revealed their recall of content was higher owing to the iterative design of the gaming elements. CONCLUSIONS: Hepatitiscape™ is likely to be a cost-effective strategy to deliver workshops that are routinely delivered F2F to test knowledge-based constructs. In addition, virtual gaming has a logistical advantage over F2F delivery in that it enhances student participation from remote locations and allows for better control and flexibility of content delivery with increasing or decreasing cohort sizes, and can have potential long-term sustainable savings.