A Progressive, Collaborative Process to Improve a Curriculum and Define an Assessment Program.

OBJECTIVE: To revise the University of Oklahoma College of Pharmacy's professional program outcomes and create an assessment map using results from previous peer review and mapping of all professional courses and curricular streams of knowledge, skills, and attitudes (KSAs). DESIGN: After consolidating 15 original program outcomes into 11 more precise outcome statements, defining KSAs for each, and getting faculty approval of them, the committee detailed measurable program expectations upon graduation for each outcome and created an assessment map identifying where KSAs were taught, how they were to be assessed, and the expected ability level (novice, competent, proficient) for each across the curriculum. ASSESSMENT: The committee's work identified deficits, inconsistencies, and disproportionalities in professional program assessment. It recommended assessments to capture student achievement of each outcome, identified performance levels and criteria to measure outcomes progressively in each professional year, and outlined a process to provide students periodic reports on their progress in achieving each outcome. CONCLUSION: This work establishes a firm foundation for ongoing efforts to measure effectiveness of the professional program, especially in light of Accreditation Council for Pharmacy Education's (ACPE) revised accreditation standards.

Incremental development of an integrated assessment method for the professional curriculum.

OBJECTIVE: To incrementally create and embed biannual integrated knowledge and skills examinations into final examinations of the pharmacy practice courses offered in the first 3 years of the pharmacy curriculum that would account for 10% of each course's final course grade. DESIGN: An ad hoc integrated examination committee was formed and tasked with addressing 4 key questions. Integrated examination committees for the first, second, and third years of the curriculum were established and tasked with identifying the most pertinent skills and knowledge-based content from each required course in the curriculum, developing measurable objectives addressing the pertinent content, and creating or revising multiple-choice and performance-based questions derived from integrated examination objectives. An Integrated Examination Review Committee evaluated all test questions, objectives, and student performance on each question, and revised the objectives and questions as needed for the following year's iteration. Eight performance objectives for the examinations were measured. ASSESSMENT: All 8 performance objectives were achieved. Sixty-four percent of the college's faculty members participated in the integrated examination process, improving the quality of the examination. The incremental development and implementation of the examinations over a 3-year period minimized the burden on faculty time while engaging them in the process. Student understanding of expectations for knowledge and skill retention in the curriculum also improved. CONCLUSIONS: Development of biannual integrated examinations in the first 3 years of the classroom curriculum enhanced the college's culture of assessment and addressed accreditation guidelines for formative and summative assessment of students' knowledge and skills. The course will continue to be refined each year.