Debate as an Active Learning Pedagogy Among Pharmacy Students in a Public Health Course.

OBJECTIVE: To evaluate the impact of a debate activity on pharmacy students' knowledge of public health and health policy topics. METHODS: Forty-six second-year pharmacy students in a required public health and health policy course debated universal healthcare coverage for Americans using the Lincoln-Douglas oral debate format. Demographic data, including age and gender, were collected. Knowledge (before/after) of universal healthcare principles was assessed via a rubric-embedded quiz related to the activity objectives. The students' perceptions of the educational value of the debate were assessed before and after the debate using a 12-item Likert scale (1 = strongly disagree through 5 = strongly agree) and open-ended questions. Descriptive statistics and thematic analysis were conducted using SPSS v25 and Atlas.ti version 9, respectively. Wilcoxon t tests were conducted to compare preknowledge and postknowledge scores. An α level of 0.05 was utilized. RESULTS: Forty-two students completed the perceptions survey, yielding a 96 % response rate. The mean age was 24 ± 4 years and primarily female (63 %). Most students had no previous experience with debates (80.4 %) and there was a statistically significant improvement in knowledge after the debate from 66.5 % ± 13.4 % to 80.7 % ± 12 % , for a total increase of 14.2 %. Open responses indicated that students believed their overall knowledge about other healthcare systems increased and they developed literature review and communications skills. CONCLUSION: The debate activity enhanced the students' knowledge and assessment of controversial public health issues that will be useful during their pharmacy education and careers. The students perceived that the debates enriched their learning.

Finalizing the Work Related to the Curriculum Outcomes and Example Objectives and Entrustable Professional Activities (COEPA) Document: The Report of the 2022-2023 Academic Affairs Standing Committee.

The 2022-2023 Academic Affairs Committee (AAC) was charged to (1) complete the Center for the Advancement of Pharmacy Education Outcomes and Entrustable Professional Activities (EPAs) revisions (now renamed as COEPA - Curriculum Outcomes and Entrustable Professional Activities) after receiving feedback at the 2022 American Association of Colleges of Pharmacy (AACP) Annual Meeting; (2) offer guidance on how the revised COEPA education outcomes and EPA statements should be used by member institutions, faculty, preceptor, and students; (3) guide input into the ongoing revision of the Accreditation Council for Pharmacy Education (ACPE) standards for the Doctor of Pharmacy program. The published report of the 2021-2022 AAC outlines the work of the Committee through the spring of 2022.1 This 2022-2023 AAC report focuses on the work related to finalizing the COEPA educational outcomes, EPAs, preamble, and glossary and formally receiving approval from the AACP Board of Directors.2 This report also describes the creation of a COEPA guidance document, including educational outcomes example learning objectives, and EPA example tasks for the Academy, however, the actual guidance document will be published separately. Finally, this current report outlines the feedback the AAC sought, received, synthesized, summarized, and prioritized from key interested and affected parties about the ACPE 2016 standards revisions for the ACPE 2025 draft standards.3 The Committee offers revisions for 1 AACP policy statement pertaining to diversity, equity, inclusion, accessibility, justice, and anti-racism. One new policy statement is also offered that urges ACPE to create accreditation standards for pharmacy education that support diversity, equity, inclusion, accessibility, justice, and anti-racism, despite presence of laws, executive orders, and policies that oppose these concepts.

Perceptions and Practices for Evaluating Faculty Workload by Pharmacy Education Administration/Leadership.

OBJECTIVE: To assess how department chairs/administrators define, measure, and evaluate faculty workload to better understand practices within the Academy. METHODS: An 18-item survey was distributed to department chairs/administrators via American Association of Colleges of Pharmacy Connect. Participants identified if they are a primary decision maker for faculty workload, whether their program has a workload policy, how workload is calculated, and how faculty satisfaction with workload equity is measured. RESULTS: Of 71 participants initiating the survey, data from 64 participants from 52 colleges/schools were eligible for analysis. Leaders of practice departments reported that their faculty spend an average of 38% of their time on teaching (compared to 46% for non-practice departments), 13% on research (vs 37%), 12% on service (vs 16%), and 36% on clinical practice (vs 0%). Most survey participants (n = 57, 89%) are at schools/colleges with a tenure system, and about 24 participants reported that faculty workload metrics differ across departments/divisions. Teaching assignments and service are reportedly negotiable between faculty and supervisors, and workload expectations are widely variable. The majority indicated they do not analyze faculty satisfaction with workload fairness (n = 35) and faculty do not provide evaluative feedback on how supervisors assign faculty workload (n = 34). Of 6 priorities considered when determining workload, 'support college/school strategies and priorities' ranked highest (1.92) and 'trust between the chair and faculty' ranked lowest (4.87). CONCLUSION: Overall, only half of the participants reported having a clear, written process of quantifying faculty workload. The use of workload metrics may be needed for evidence-based decision-making for personnel management and resource allocation.

An Update on the Progress Toward Gender Equity in US Academic Pharmacy.

Objective. To evaluate the status of gender equity in US pharmacy education since the two previous publications on the topic in 2004 and 2014.Methods. Data were gathered from existing national databases, internal American Association of Colleges of Pharmacy (AACP) databases, AACP meeting minutes, published reports, scholarly articles, pharmacy association websites, individual school websites, and LinkedIn profiles. Differences between men and women were evaluated on degree completion, discipline, rank, tenure status, research, leadership development, leadership positions, salaries, and professional awards. Comparisons were also made to academic medicine and dentistry.Results. Fifty-one percent of full-time faculty members across all academic pharmacy disciplines are women. The percentage of women at the rank of professor was 36.6%, compared to 25% in 2014. Of the 2992 tenured or tenure track pharmacy faculty, 39.2% were women. Out of 388 department chairs, 146 were women. Throughout 2014-2021, there were 121 chief executive officer (CEO) dean permanent appointments, with men holding 91 (75.2%) and women holding 30 (24.8%). Women received 29.7% of the National Institutes of Health grants awarded to pharmacy schools compared to men (70.3%), although women's funding amount was higher. In both the pharmacy practice discipline and all sciences disciplines, the total salary across all ranks and years in rank was significantly higher for men than women, even for department chairs, but there were no differences for CEO deans. To date, women have received 13% of four national pharmacy organizations' top 13 awards.Conclusion. Since 2014, some achievement gaps have narrowed, but areas of concern still exist and need continued attention and resources so inequities can be eliminated. Women in academic pharmacy need mentoring and support to extend throughout the trajectory of their careers in areas such as academic advancement, grant applications, salary negotiation, leadership pursuit, and award applications.

A Systematic Review of Assessment Tools Measuring Cultural Competence Outcomes Relevant to Pharmacy Education.

Objective. To identify and describe validated assessment tools that measure cultural competence and are relevant to pharmacy education.Methods. A systematic approach was used to identify quantitative cultural competence assessment tools relevant to pharmacy education. A systematic search of the literature was conducted using the OVID and EBSCO databases and a manual search of journals deemed likely to include tools relevant to pharmacy education. To be eligible for the review, the tools had to be developed using a study sample from the United States, have at least one peer-reviewed validated publication, be applicable to the pharmacy profession, and be published since 2010.Results. The systematic literature and manual search identified 27 tools. Twelve assessment tools met the criteria to be included in the summary and their relevancy to pharmacy education is discussed.Conclusion. A review of literature demonstrates that assessment tools vary widely and there is no one tool that can effectively assess all aspects of cultural competence in pharmacy students or the Doctor of Pharmacy curriculum. As cultural competence is a priority within the accreditation standards for pharmacy education, PharmD programs are encouraged to develop additional tools that measure observed performance.

Student perceptions of the utility of the Pharmacy Curriculum Outcomes Assessment.

INTRODUCTION: This study assessed student perceptions, preparation, and result use strategies of the Pharmacy Curriculum Outcomes Assessment (PCOA). Secondarily, it studied the effect of schools/colleges of pharmacy (S/COP) PCOA management on student perceptions. METHODS: A 52-item electronic questionnaire assessed PCOA preparation of final year students, review/use of results, remediation participation, self-reported motivation, and perceptions of the exam's ability to measure PCOA blueprint areas and North American Pharmacy Licensure Examination (NAPLEX)/advanced pharmacy practice experience (APPE) readiness. Programs were given a questionnaire to determine their PCOA practices. RESULTS: The student survey was completed by 341 students (40% response rate). Students prepared very little for the PCOA and few reported participation in PCOA-based remediation (6%). Students perceived the PCOA to measure the four domains moderately well, although administrative sciences were significantly lower. Students reported less confidence in the exam's ability to measure APPE/NAPLEX-readiness. Although few used the PCOA to guide their NAPLEX preparation (18%), they were more likely to do so than for APPEs (4%). Students reported a higher perceived increase in motivation if PCOA results were connected to APPE placement, remediation, and progression as opposed to prizes, rewards, or other recognitions. CONCLUSION: This is the first multi-institutional study to review student perceptions about the PCOA. These data can be used along with other PCOA data to help schools develop incentive, remediation, and examination administration procedures depending on the programs desired use for the PCOA exam.

Predicting Pharmacy Curriculum Outcomes Assessment Performance Using Admissions, Curricular, Demographics, and Preparation Data.

Objective. To determine the factors, including a preparation test, that best predict pharmacy students' performance on the Pharmacy Curriculum Outcomes Assessment (PCOA). Methods. Two cohorts of third-year pharmacy students completed a 100-item locally created PCOA pre-test, the PCOA Prep. This PCOA Prep was a cumulative knowledge test that was administered in the fall semester. In the spring semester, the students completed the 200-item PCOA and a separate survey on study habits and confidence. A retrospective review of students' demographics data, pre-pharmacy admission variables, and pharmacy school factors were collected. Correlation and regression analyses were conducted to evaluate which factors predicted students' PCOA total scaled score as well as scores in areas 1-4. Results. One hundred seventy-nine students were included in the study. The majority were female (55%), white (54%), and 28 (SD=5.4) years old on average. Students' average score on the PCOA Prep test was 80.7% (SD=7.8). The stepwise multiple linear regression model for the PCOA total scaled score included the PCOA Prep test, cumulative GPA at the end of the didactic curriculum, race/ethnicity, Pharmacy College Admission Test (PCAT) Verbal, PCAT Biology, and a class identifier. Including the PCOA Prep test explained more variance than the model without the test. Conclusion. This study revealed that student performance on a locally created cumulative knowledge test best predicted the PCOA Total Scaled Score. These results offer insights into additional contributing factors that influence students' PCOA performance and how colleges and schools of pharmacy could identify at-risk students who may need knowledge remediation prior to beginning advanced pharmacy practice experiences.

Career Skills Assessment in a Doctor of Pharmacy Curriculum.

Objective. To assess students' knowledge of, perceived importance of, and confidence in six career skills areas (curriculum vitae/resume writing, interviewing skills/business attire, phone interviews, thank you notes, business/dining etiquette, and networking) before, immediately after, and six months after participating in a career skills workshop. Methods. All students in a senior-level seminar course participated in the same simulation/performance-based workshop that was coupled with verbal or rubric-based feedback for each of the areas. Results. Ninety-one students participated in the study and all students' knowledge significantly increased over the study as determined by study baseline, conclusion, and six-month follow-up assessments. At study follow-up, knowledge increased an average of +7.1 percentage points from baseline. Multivariate analysis indicated significant increases in confidence from baseline to follow-up ranging from +0.15 to +0.29 across the six workshop areas, with resume/CV preparation having the highest increase. From study onset to follow-up, students perceived that the six career skills areas were above the average importance midpoint (3.0). Conclusion. The workshop was effective in increasing students' knowledge and confidence of essential career skills vital to pursuing post-graduate employment. These career skills are important for helping students distinguish themselves in a competitive job market.

A Progressive, Collaborative Process to Improve a Curriculum and Define an Assessment Program.

OBJECTIVE: To revise the University of Oklahoma College of Pharmacy's professional program outcomes and create an assessment map using results from previous peer review and mapping of all professional courses and curricular streams of knowledge, skills, and attitudes (KSAs). DESIGN: After consolidating 15 original program outcomes into 11 more precise outcome statements, defining KSAs for each, and getting faculty approval of them, the committee detailed measurable program expectations upon graduation for each outcome and created an assessment map identifying where KSAs were taught, how they were to be assessed, and the expected ability level (novice, competent, proficient) for each across the curriculum. ASSESSMENT: The committee's work identified deficits, inconsistencies, and disproportionalities in professional program assessment. It recommended assessments to capture student achievement of each outcome, identified performance levels and criteria to measure outcomes progressively in each professional year, and outlined a process to provide students periodic reports on their progress in achieving each outcome. CONCLUSION: This work establishes a firm foundation for ongoing efforts to measure effectiveness of the professional program, especially in light of Accreditation Council for Pharmacy Education's (ACPE) revised accreditation standards.

Incremental development of an integrated assessment method for the professional curriculum.

OBJECTIVE: To incrementally create and embed biannual integrated knowledge and skills examinations into final examinations of the pharmacy practice courses offered in the first 3 years of the pharmacy curriculum that would account for 10% of each course's final course grade. DESIGN: An ad hoc integrated examination committee was formed and tasked with addressing 4 key questions. Integrated examination committees for the first, second, and third years of the curriculum were established and tasked with identifying the most pertinent skills and knowledge-based content from each required course in the curriculum, developing measurable objectives addressing the pertinent content, and creating or revising multiple-choice and performance-based questions derived from integrated examination objectives. An Integrated Examination Review Committee evaluated all test questions, objectives, and student performance on each question, and revised the objectives and questions as needed for the following year's iteration. Eight performance objectives for the examinations were measured. ASSESSMENT: All 8 performance objectives were achieved. Sixty-four percent of the college's faculty members participated in the integrated examination process, improving the quality of the examination. The incremental development and implementation of the examinations over a 3-year period minimized the burden on faculty time while engaging them in the process. Student understanding of expectations for knowledge and skill retention in the curriculum also improved. CONCLUSIONS: Development of biannual integrated examinations in the first 3 years of the classroom curriculum enhanced the college's culture of assessment and addressed accreditation guidelines for formative and summative assessment of students' knowledge and skills. The course will continue to be refined each year.

Assessment of streams of knowledge, skill, and attitude development across the doctor of pharmacy curriculum.

OBJECTIVE: To continue efforts of quality assurance following a 5-year curricular mapping and course peer review process, 18 topics ("streams") of knowledge, skills, and attitudes were assessed across the doctor of pharmacy (PharmD) curriculum. DESIGN: The curriculum committee merged the 18 topics into 9 streams. Nine ad hoc committees ("stream teams") of faculty members and preceptors evaluated the content, integration, and assessment for their assigned streams across the 4 professional years. Committees used a reporting tool and curriculum database to complete their reviews. ASSESSMENT: After each team presented their findings and recommendations at a faculty retreat, the 45 faculty members were asked to list their top priorities for curriculum improvement. The 5 top priorities identified were: redefinition and clarification of program outcomes; improved coordination of streams across the curriculum; consistent repetition and assessment of math skills throughout the curriculum; focused nonprescription and self-care teaching into an individual course; and improved development of problem solving. CONCLUSIONS: This comprehensive assessment enabled the college to identify areas for curriculum improvement that were not readily apparent to the faculty from prior reviews of individual courses.

Relationship between case question prompt format and the quality of responses.

OBJECTIVES: To compare the effectiveness of 2 case question formats (multiple choice and open ended) to prompt faculty members and students to explore multiple solutions and use factual evidence to defend their solutions. METHODS: Doctor of pharmacy (PharmD) faculty members and students responded to 2 pharmacy law/ethics cases, one followed by a case question prompt in multiple-choice format and the other by a question in open-ended format. The number of conclusions and the quality of the arguments generated were assessed using general linear modeling. RESULTS: PharmD faculty members outperformed students on every outcome variable measured, demonstrating expert problem-solving skills. All participants provided better quality arguments when the case prompt question was in multiple-choice format. CONCLUSIONS: The better quality arguments prompted by multiple-choice case questions suggests this format should be used when constructing case question prompts.