Perceptions and Utility of Course Evaluations in US Pharmacy Schools.

OBJECTIVE: This study aimed to describe the purpose, implementation, and perceived utility of course evaluations in pharmacy programs. METHODS: After a literature review, a 34-item survey was developed, pretested, and sent to assessment administrators at accredited pharmacy programs (N = 139) with at least 3 follow-ups. Descriptive and inferential statistics were performed in IBM SPSS Statistics software. RESULTS: A total of 90 programs responded (64.7% response rate). Most students (94%) were offered the opportunity to complete course evaluations. Some students completed evaluations during the course (47%), while others did so within 1 week of completion of the course (49%). Whether or not class time was given for students to complete the survey was often dependent on faculty choice (52.2%). Results were typically released after final grades were posted (92%), in time to use for the next semester of teaching (77%). Faculty were chosen to be evaluated by the number of teaching hours (50%) followed by all instructors (45.6%). Programs used the results for performance reviews by chairs (91%), course coordinator reviews (84%), and committee continuous quality improvement efforts (72%). Most programs did not provide faculty guidance on using evaluations (78%) nor development/mentoring (57%); only 22% of programs offered student development in completing evaluations. CONCLUSION: While most programs invite feedback from all students via evaluations, most did not provide guidance to faculty on how to use this feedback for faculty or course development purposes. A more robust process to optimize the use of course evaluations should be developed.

Capturing employer's perceptions of key variables in exceptional new practitioners' success by using a modified Delphi process.

INTRODUCTION: The primary aim was to determine the key variables in a new practitioner's success from the perspective of pharmacy employers. A secondary aim was to describe the use of a modified Delphi process to collect quality information from external constituents. METHODS: A historical review of the literature was conducted to ensure the inquiry extended existing thinking and to aid the development of questions. An asynchronous, online two-round modified Delphi process was used to gather input and develop consensus. The findings were verified by crosswalking with the Habits of Mind. Additionally, the strategies for inviting panelists, practitioner response rates, and the amount and quality of the data collected were examined. RESULTS: The historical review yielded 25 articles that were categorized by disciplines studied, methods used, and characteristics found. Fourteen seasoned employers participated. Nine themes describing the behaviors and practices of exceptional new practitioners were identified. These themes were categorized into three groups: Change-Leader, Self-Manager, or Relationship-Builder. Additionally, all the themes mapped to multiple Habits of Mind. As a method for constituent input, the Delphi process yielded employer response rates per school ranging from 10% to 67% and produced five single-spaced pages of text (2124 words) for analysis. CONCLUSIONS: These descriptions of behaviors and practices of exceptional new practitioners build upon existing literature and provide additional guidance for professional development curricula. Additionally, an asynchronous, online Delphi panel can be a useful method to glean important insights from experienced pharmacy employers.

Determining Indicators of High-Quality Application Activities for Team-Based Learning.

Objective. To determine the indicators of quality for application activities in pharmacy team-based learning (TBL). Methods. A modified Delphi process was conducted with pharmacy TBL experts. Twenty-three experts met the inclusion criteria, including having at least four years of TBL experience, designing at least eight TBL sessions, training others to use TBL, and authoring a peer-reviewed TBL pharmacy paper. In round 1, panelists responded to five open-ended questions about their successful TBL applications activities, including satisfaction with the activity and methods for creating positive student outcomes. In round 2, panelists indicated their level of agreement with the round 1 quality indicators using a four-point Likert rating. Consensus was set at 80% strongly agree/agree. In an open comment period, panelists provided suggestions to help expand the indicator descriptions. Indicators were verified based on TBL and the education literature. Results. Twenty panelists (87% of those eligible) responded in round 1 and 17 (85% participation) in round 2. Sixteen quality indicators were identified in round 1, with 14 achieving consensus in round 2. "Uses authentic pharmacy challenges or situations" (88% strongly agree/agree) and "incorporates or provides effective feedback to groups" (88% strongly agree/agree) met consensus. However, "has multiple right answers" (76% strongly agree/agree) and "incorporates elements from school specific emphases (eg, faith, underserved)" (53% strongly agree/agree) did not reach consensus. Conclusions. These indicators can assist faculty members in designing application activities to provide high-quality TBL exercises that promote deep thinking and engaged classroom discussion. The indicators could also guide faculty development and quality improvement efforts, such as peer review of application activities.

Pharmacist-provided medication therapy management (MTM) program impacts outcomes for employees with diabetes.

The objective of this prospective, pre-post longitudinal study was to assess the impact of pharmacist-provided medication therapy management (MTM) services on employees' health and well-being by evaluating their clinical and humanistic outcomes. City of Toledo employees and/or their spouses and dependents with diabetes with or without comorbid conditions were enrolled in the pharmacist-conducted MTM program. Participants scheduled consultations with the pharmacist at predetermined intervals. Overall health outcomes, such as clinical markers, health-related quality of life (HRQoL), disease knowledge, and social and process measures, were documented at these visits and assessed for improvement. Changes in patient outcomes over time were analyzed using Wilcoxon signed rank and Friedman test at an a priori level of 0.05. Spearman correlation was used to measure the relationship between clinical and humanistic outcomes. A total of 101 patients enrolled in the program. At the end of 1 year, patients' A1c levels decreased on average by 0.27 from their baseline values. Systolic and diastolic blood pressure also decreased on average by 6.0 and 4.2 mmHg, respectively. Patient knowledge of disease conditions and certain aspects or components of HRQoL also improved. Improvements in social and process measures also were also observed. Improved clinical outcomes and quality of life can affect employee productivity and help reduce costs for employers by reducing disease-related missed days of work. Employers seeking to save costs and impact productivity can utilize the services provided by pharmacists.

Improving the economic and humanistic outcomes for diabetic patients: making a case for employer-sponsored medication therapy management.

BACKGROUND: The purpose of this study was to determine the cost savings of a pharmacist-led, employer-sponsored medication therapy management (MTM) program for diabetic patients and to assess for any changes in patient satisfaction and self-reported medication adherence for enrollees. METHODS: Participants in this study were enrollees of an employer-sponsored MTM program. They were included if their primary medical insurance and prescription coverage was from the City of Toledo, they had a diagnosis of type 2 diabetes, and whether or not they had been on medication or had been given a new prescription for diabetes treatment. The data were analyzed on a prospective, pre-post longitudinal basis, and tracked for one year following enrollment. Outcomes included economic costs, patient satisfaction, and self-reported patient adherence. Descriptive statistics were used to characterize the population, calculate the number of visits, and determine the mean costs for each visit. Friedman's test was used to determine changes in outcomes due to the nonparametric nature of the data. RESULTS: The mean number of visits to a physician's office decreased from 10.22 to 7.07. The mean cost of these visits for patients increased from $47.70 to $66.41, but use of the emergency room and inpatient visits decreased by at least 50%. Employer spending on emergency room visits decreased by $24,214.17 and inpatient visit costs decreased by $166,610.84. Office visit spending increased by $11,776.41. A total cost savings of $179,047.80 was realized by the employer at the end of the program. Significant improvements in patient satisfaction and adherence were observed. CONCLUSION: Pharmacist interventions provided through the employer-sponsored MTM program led to substantial cost savings to the employer with improved patient satisfaction and adherence on the part of employees at the conclusion of the program.

Evaluation of outcomes of a medication therapy management program for patients with diabetes.

OBJECTIVE: To measure the impact of an employer-sponsored, pharmacist-provided medication therapy management (MTM) program on clinical outcomes and social and process measures for patients with diabetes with or without associated comorbid conditions. METHODS: Prospective longitudinal study that took place at seven independent pharmacies in Lucas County, OH. A total of 228 patients with diabetes were enrolled. At 6-month intervals, patients were counseled by their pharmacists. Outcome measures included clinical outcomes (glycosylated hemoglobin [A1C], systolic blood pressure (SBP), and diastolic blood pressure [DBP]), social measures (caffeine intake, alcohol consumption, smoking, and exercise), and process measures (visits to ophthalmologist, podiatrist, and dentist). Wilcoxon signed-rank test and percentages were used to report findings. RESULTS: Mean (± SD) A1C concentration decreased from 7.08 ± 1.54% to 6.89 ± 1.30% at 12 months. Patients with A1C levels greater than 7% at baseline averaged a decrease of 0.5% at 6 months and 0.75% at 12 months. Mean SBP values decreased significantly from baseline to 12 months. A total of 87 patients with a baseline SBP greater than 130 mm Hg experienced a significant change in blood pressure from baseline to 6 months (-7.1 ± 3.32 mm Hg), and 65 patients experienced a significant change in blood pressure from baseline to 12 months (-11.49 ± 0.15 mm Hg). A total of 104 patients with a baseline DBP more than 80 mm Hg experienced a significant decrease of 4.44 ± 1.25 mm Hg at 6 months. Caffeine and alcohol consumption and smoking decreased and exercise increased. In addition, the percentage of patients who visited specialists increased. CONCLUSION: Patients with diabetes experienced improvements in multiple clinical, social, and process measures.