Pharmacy students' perspectives on the initial implementation of a teaching electronic medical record: results from a mixed-methods assessment.

BACKGROUND: Electronic medical records (EMRs) have been used for nearly three decades. Pharmacists use EMRs on a daily basis, but EMRs have only recently been incorporated into pharmacy education. Some pharmacy programs have implemented teaching electronic medical records (tEMRs), but best practices for incorporating tEMRs into pharmacy education remain unknown. The objectives of this study were to 1) assess pharmacy students' views and experiences with a tEMR; and 2) identify current learning activities and future priorities for tEMR use in pharmacy education. METHODS: We used a mixed-methods approach, including three, two-hour student focus groups and a 42-item web-based survey to examine student perspectives of the tEMR. All first, second, and third year professional pharmacy students were eligible to participate in the survey and a focus group. Web-based survey items were measured on a 7-point Likert scale, and quantitative analyses included descriptive statistics. Two researchers independently coded transcripts using both deductive and inductive approaches to identify emergent themes. These analysts met and resolved any coding discrepancies via consensus. RESULTS: Focus groups were conducted with 22 total students, with 6-8 students represented from each year of pharmacy training. The survey was completed by 156 students: 47 first year, 55 second year, and 54 third year. Overall, 48.7% of survey respondents altogether agreed or strongly agreed that using the tEMR enhanced their learning in pharmacy classes and laboratories. Qualitative data were organized into four major themes regarding tEMR adoption: current priorities for use within the pharmacy curriculum; tEMR benefits; tEMR barriers; and future priorities for tEMR use to prepare students for pharmacy practice. CONCLUSIONS: This study reveals pharmacy students' perspectives and attitudes towards using a tEMR, the types of classroom activities that incorporate the tEMR, and students' future suggestions to enhance the design or application of the tEMR for their learning. Our research findings may aid other pharmacy programs and promote more effective use of tEMRs in pharmacy education. In the long-term, this study may strengthen pharmacy education on EMRs and thus increase the efficacy and safety of pharmacists' EMR use for patients' medication management.

The Impact of COVID-19 on Pharmacy Student Stress During High-Stakes, Performance-Based Assessments in Skills-Based Courses.

Objective. To compare stress levels of pharmacy students in high-stakes, performance-based assessments administered during skills-based laboratory courses in normal classroom environments versus pandemic classroom environments impacted by COVID-19.Methods. In 2019, prior to the start of the COVID-19 pandemic, Doctor of Pharmacy (PharmD) students' stress levels were assessed via a voluntary, paper-based survey before and after performance-based assessments. Students were given a modified version of this survey in 2020 during the pandemic. The 2019 and 2020 survey responses were compared using Wilcoxon rank sum tests.Results. Pharmacy students reported higher perceived stress levels before performance-based assessments (3.8 vs 3.5) and after performance-based assessments (2.8 vs 2.5) prior to the pandemic compared to during the pandemic. Students identified stress as negatively impacting their performance-based assessment performance in both years (3.4 vs 3.1). Students had similar interest in wellness activities in both phases.Conclusion. Colleges of pharmacy should consider implementing stress relief programs around high-stakes assessments as well as prioritizing wellness initiatives within curricula.

Improving the Remediation Process for Skills-based Laboratory Courses in the Doctor of Pharmacy Curriculum.

When students fail to meet minimum competence standards on summative pharmacy skills-based assessments, remediation can be used to ensure student readiness for progression. Skills-based remediation is challenging as a high volume of resources is required to develop an action plan that addresses the heterogeneity in student needs and to create and execute another assessment equivalent to the initial assessment. Although many Doctor of Pharmacy (PharmD) programs face these same challenges, there is no consensus on how to best address them. Recently, faculty from six PharmD programs convened to share ideas and approaches to overcoming these challenges. This commentary aims to define remediation as it pertains to summative skills-based assessments, share our consensus views regarding remediation best practices, and highlight areas where there is more work to be done. Our intent is to advance the ongoing conversation and empower institutions to develop their own effective and impactful skills-based remediation policies, procedures, and activities.

Changes to summative skills-based assessments within the Big Ten Academic Alliance Performance-Based Assessment Collaborative (BTAA-PBAC) due to COVID-19.

Background: In Spring 2020 many academic institutions transitioned to remote learning in response to the developing COVID-19 pandemic. These changes affected skills-based training, as schools of pharmacy were forced to transition traditionally in-person assessments to a remote setting. The purpose of this article is to describe the experience of pharmacy skills lab coordinators when transitioning summative skills-based assessments (SSBA). Methods: A web-based survey instrument administered through QualtricsXM was sent to all institutions in the Big Ten Academic Alliance-Performance Based Assessment Collaborative. Only one member from each institution completed the survey on behalf of the institution. The survey consisted of four sections: changes made to skills evaluated; changes made to the delivery of those evaluations; challenges to and strategies used by the skills lab program when switching to remote learning; and recommendations for incorporating remote learning within future SSBAs. Survey respondents were invited to participate in an optional unstructured interview regarding survey answers. Results: Nine of ten invited institutions responded to the survey. Of the nine respondents, three participated in the post-survey interview. Overall, 79.5% (93/117) of skills planned to be assessed were assessed with or without modification, with 8.5% (10/117) of skills canceled and 10.3% (12/117) of skills assessments postponed. The most common challenges mentioned were the lack of preparation time, inability to assess certain skills virtually, and student barriers. The most common recommendations made were to prioritize lab components and incorporate flexibility in planning and scheduling. Discussion: The results indicate that most skills were still assessed during the Spring 2020 semester. Though the transition to remote learning was challenging and unique for each institution, common strategies and recommendations identified here provide opportunities for academics to analyze and prioritize learning objectives and to rethink how to develop and deliver SSBAs as remote assessments.

A mixed-methods study of pharmacy instructors' early experiences with a teaching electronic medical record.

INTRODUCTION: As use of electronic medical records (EMRs) increases in healthcare, multiple accreditation organizations recommend training future clinicians on EMRs as part of the academic curriculum. Therefore, some pharmacy programs now utilize an academic EMR. Our objective was to examine pharmacy instructors' early experiences with a commercially available teaching EMR (tEMR) in order to identify current and future priorities along with benefits and barriers to academic EMR use in pharmacy education. METHODS: We conducted semi-structured interviews and a web-based survey with pharmacy instructors. Interview and survey data analyses consisted of hybrid inductive/deductive approaches to coding data and descriptive statistics, respectively. We mapped themes to the Pharmacists' Patient Care Process (PPCP). RESULTS: Seven instructors participated in interviews, and 10 completed the survey. We identified 25 interview themes that were generally congruent with survey responses. A noted benefit of the tEMR was providing a large repository of real-life patient data. Instructors' current priorities for tEMR activities primarily aligned with "collect," "assess," and "plan" steps of the PPCP. One reported barrier was insufficient training regarding the tEMR capabilities. Instructors offered innovative ideas for future academic EMR use, including pharmacokinetics, incident reporting, and longitudinal cases. CONCLUSIONS: Study findings are most applicable to pharmacy programs in the early stages of academic EMR adoption. We identified opportunities for pharmacy programs to facilitate innovative, future use of academic EMRs, including curriculum planning, so pharmacy students gain experience using EMR functions for each PPCP step and develop more advanced EMR skills.

Student Pharmacists' Ability to Organize Complex Medication Regimens According to the Universal Medication Schedule.

Objective. To assess student pharmacists' ability to impact the administration of complex prescription regimens using the universal medication schedule in a standardized laboratory exercise. Methods. First and third professional year (P1 and P3) student pharmacists at three colleges of pharmacy completed a required activity to simplify and organize a complex medication regimen. Using a medication box, students planned how and when they would advise a patient to take seven fictitious medications over a 24-hour period. Picture documentation of each students' activity was used for data analysis. Descriptive statistics were used to compare P1 and P3 students' performance, and an independent t test was used to assess the frequency of daily dosing. A chi-square analysis was used to compare differences between P1 and P3 students, and analysis of variance was used to compare differences among individual institutions. Results. Of 842 students invited, 459 P1 and 372 P3 students (98.7%) consented to participate. Student pharmacists recommended 5.1 (SD=1.0; Range=3-11) dosing intervals per 24 hours, with 27% of students successfully reducing the regimen to four total intervals. The P3 students were more effective than the P1 students in planning the number of dosing intervals (4.9 vs 5.4 per 24 hours). Conclusion. Student pharmacists may become more effective at organizing complex medication regimens as they proceed through the pharmacy curriculum and gain experience. Student pharmacists can translate what they learned from this exercise to potentially improve patients' self-organized medication regimens.

Pharmacy Student Perceptions and Preferences of In-person Versus Video-Recorded Evaluations in Skills-Based Courses.

Objective. To determine pharmacy students' preferences for and perceptions of in-person and video evaluations.Methods. A mixed methods survey was administered to 447 first-, second-, and third-year students enrolled in a public US Doctor of Pharmacy program. A survey instrument with 14 quantitative items and four qualitative items was used to measure student perceptions. Eight response choice items measured preferences. Paired t tests were used to compare students' perceptions. Independent t tests were used to compare perceptions between students who experienced and had not experienced video evaluations. Two researchers performed thematic content analysis of the qualitative responses.Results. Students (n=444, 99.3% response rate) perceived in-person evaluations more positively for all items except nervousness. Students who experienced video technology felt significantly more positive about video evaluations than students who had little or no experience using video technology on nine items. The students who experienced video technology felt significantly less positive toward video evaluations in terms of quality (1.24 vs. 0.83) and amount (1.14 vs 0.77) of written feedback. Although students valued the interaction with a larger, more diverse pool of evaluators that was made possible by video evaluations, they did not view video technology as applicable to their future practice.Conclusion. Students viewed in-person evaluations significantly more positively than video evaluations. This effect was mitigated by greater exposure to video technology, suggesting that concerns regarding video evaluations are based on conjecture rather than experience. This study highlights the need to reduce the technological issues associated with video evaluations and improve the written feedback provided to students.

Utilization of external reviews by colleges of pharmacy during the promotion and tenure process for pharmacy practice faculty.

OBJECTIVE: To evaluate the use of external reviews by colleges of pharmacy (COP) during the promotion and tenure process for pharmacy practice faculty. METHODS: A 25-item web-based survey was sent to 112 Pharmacy Practice Department Chairs. Results were analyzed via descriptive statistics. RESULTS: Fifty-four of 112 colleges (48%) responded to the survey, although respondents had the option to skip questions. Of those who responded, 82% utilize external review in their Promotion and Tenure evaluation. At the majority of colleges that responded, reviewers are selected from a combination of sources including the candidates' personal list and in most circumstances someone other than the candidate contacts the reviewer to determine interest and availability. At almost all responding colleges, the reviewer receives the candidate's curriculum vitae and specific guidelines for completing the review. Based upon 40 respondents, colleges request the reviewer(s) to evaluate the candidate's research (100%), teaching (80%), clinical practice (73%) and external service (73%). CONCLUSION: The goal of this project was to examine the current use of external review during the Promotion and Tenure process for pharmacy practice faculty. This data is a sample of what is being done at the schools that responded. The majority of responding COP utilize external reviews, however methods and requirements vary considerably.

Faculty perception of team-based learning over multiple semesters.

INTRODUCTION: Perspectives from faculty regarding team-based learning (TBL) are not well understood. Previous studies describe faculty preference for TBL due to increased student interaction despite requiring increased time for design. The perception of changes in faculty workload over multiple semesters has not been measured. This research evaluates faculty workload and perceived student engagement after implementing TBL in a required non-prescription medication course over multiple semesters. METHODS: TBL was implemented in the non-prescription medication course and continued for three consecutive semesters. Faculty members' perception of TBL was captured using an anonymous survey. The survey was an 11 item questionnaire with five Likert-type response options to identify changes in workload, training, and student interaction using TBL. RESULTS: Twenty-eight total responses were collected from 10 faculty members who taught in at least one of the four semesters. Results were aggregated based on the number of semesters faculty continually taught in the course. More respondents agreed than disagreed that participation from and interactions with students increased with the TBL course compared to traditional lectures. However, more respondents believed the TBL course approach was more difficult and reported increased workload in the initial semester taught. Enjoyment of teaching increased for a majority of respondents. DISCUSSION AND CONCLUSIONS: This is the first study to explore the impact of TBL implementation over multiple semesters. These data can be used to help implement TBL in pharmacy school curricula.