Promoting diversity, equity and inclusion awareness in clinical documentation through postgraduate year one training.

BACKGROUND AND PURPOSE: As healthcare providers increasingly focus on emerging issues of diversity, equity and inclusion (DEI) in patient care, less is known about the training in postgraduate year one (PGY1) pharmacy residency on DEI clinical documentation considerations. This pilot project explored whether training, discussion and self-reflection within a peer review activity promoted DEI self-awareness in clinical documentation through a centralized curriculum of a multisite PGY1. EDUCATIONAL ACTIVITY AND SETTING: Building upon an established peer review of clinical documentation activity, PGY1 pharmacy residents practicing in ambulatory care settings received training on DEI considerations and completed small and large group discussions, a post-activity mixed methods survey with self-reflection prompts, and a three-month follow-up survey. FINDINGS: Twenty-two residents participated in the peer review of clinical documentation activity, DEI training and discussions. Twelve residents completed the post-activity survey with reflection prompts; 6 (50%) reported similar previous DEI training prior to residency. After the DEI training and discussions, 12 (100%) agreed or strongly agreed that their awareness of DEI documentation considerations increased; 10 (83%) would document their submitted notes differently, while one resident was unsure and one would not make changes. Twelve residents completed the follow-up survey three months following the activity. Themes from the free-text responses on key learnings collected post-activity and three-month post (respectively) included: 1) new knowledge, increased self-awareness, and intended action and 2) increased self-awareness and changes in note-making convention. SUMMARY: Integrating DEI training, discussion, and self-reflection prompts into a peer review clinical documentation activity increased self-awareness and knowledge of DEI considerations and promoted intended changes in patient care documentation for pharmacy residents. Regardless of previous training, residents reported continued self-awareness and changes in documentation conventions continued three months later.

Assessment of a Scholars Program Designed to Enhance Pharmacy Students' Competitiveness for Postgraduate Residency Training.

Objective. To assess pharmacy residency match/placement rates and student perceptions of a program designed to enhance Doctor of Pharmacy (PharmD) student competitiveness for postgraduate residency positions. Methods. The Scholars Program was developed to provide advanced training to select PharmD students who had an interest in postgraduate residency training and was completed during the third and fourth professional years. The program consisted of mentoring; elective coursework encompassing clinical practice, teaching, and leadership; modified experiential education; journal club meetings; teaching assistant duties; conducting research and/or scholarship; and delivering professional presentations. Residency match/placement rates of students who had completed the program were compared to national data and to students in the school who were not enrolled in the program. Perceptions of the program were assessed using an online survey. Results. Sixty-four students enrolled in and completed the Scholars Program from 2013 to 2019. Of these, 58 (91%) pursued postgraduate residency training. Students enrolled in the program had a higher combined phase 1/phase 2 match rate (91.4% vs 67.4%) than students in other PharmD programs across the United States. Similarly, students enrolled in the Scholars Program had a higher combined phase 1/phase 2 match rate (91.4% vs 62.9%) and overall residency placement rate (96.6% vs 67.0%) compared to students in the school who were not enrolled in the program. More than 85% of students enrolled in the Scholars Program who pursued residency training agreed that the program prepared them for and helped them attain a postgraduate residency. Conclusion. Pharmacy students enrolled in the Scholars Program experienced high residency match/placement rates and viewed the program as valuable preparation for postgraduate training.

Assessment of mental health needs and barriers to care in students enrolled in doctor of pharmacy and pharmaceutical sciences programs.

INTRODUCTION: The purpose of this study is to identify doctor of pharmacy and pharmaceutical sciences students' perceived barriers to mental health care and interest in mental health interventions and to assess student attitudes and perceptions of mental illness. METHODS: A mixed-methods survey was given to 706 students participating in a doctor of pharmacy and pharmaceutical sciences curricula to assess students' perceived barriers to care, interest in mental health resources and interventions within their curricula, attitudes towards seeking treatment, and perceived stigma. The last section included free text responses in which students expressed additional comments unacknowledged by previous sections. Quantitative data was analyzed using descriptive statistics, and free text responses were analyzed using thematic coding. RESULTS: From February to March 2018, 256 responses were received out of 706 students with a response rate of 36%. The most cited barriers to seeking mental health treatment were lack of time, lack of finances, and stigma-related concerns (25%, 13%, and 11%, respectively) with the most desired interventions being the implementation of an onsite counselor and wellness space. A majority of participants (88%) believe professional help for mental illness is effective; however, 63% cited they were negatively impacted by internal stigma. Common themes addressed in the free text responses reinforced these ideas and included additional responses regarding the impact of school culture. CONCLUSION: Students within a doctor of pharmacy and pharmaceutical sciences program experience non-stigma and stigma-related barriers to seeking mental health treatment.

Assessment of mental health in doctor of pharmacy students.

INTRODUCTION: Pharmacy student mental health is of increasing concern to faculty, administrators, and students. The objectives of this study were to investigate the mental health of doctor of pharmacy (PharmD) students at a four-year college of pharmacy (COP), compare components of mental health of PharmD students to the general university campus students, and examine the relationship between academic distress and specific components of mental health. METHODS: The mental health status of PharmD students was measured using the Counseling Center Assessment of Psychological Symptoms (CCAPS-62), a validated survey tool assessing eight subscales of mental health. Comparisons were made within the PharmD student population and to the general campus population at the same university, who were surveyed during the same time period. Statistical analysis included a series of univariate regressions and chi square testing. RESULTS: Fifty-eight percent of PharmD students (193/332) voluntarily participated in the study. Over 25% of PharmD students scored in the high severity range for depression, generalized anxiety, academic distress, and eating concerns. Academic distress scores were significantly worse for second-year PharmD students, while hostility scores were significantly worse for third-year PharmD students. Correlations were identified between academic distress and depression, generalized anxiety, and social anxiety. PharmD scores in several subscales were significantly worse than the general campus population. CONCLUSION: High academic stress levels and poor mental health outcomes were observed in PharmD students. Identification and implementation of methods to reduce the psychological distress of PharmD students are needed.

Career Skills Assessment in a Doctor of Pharmacy Curriculum.

Objective. To assess students' knowledge of, perceived importance of, and confidence in six career skills areas (curriculum vitae/resume writing, interviewing skills/business attire, phone interviews, thank you notes, business/dining etiquette, and networking) before, immediately after, and six months after participating in a career skills workshop. Methods. All students in a senior-level seminar course participated in the same simulation/performance-based workshop that was coupled with verbal or rubric-based feedback for each of the areas. Results. Ninety-one students participated in the study and all students' knowledge significantly increased over the study as determined by study baseline, conclusion, and six-month follow-up assessments. At study follow-up, knowledge increased an average of +7.1 percentage points from baseline. Multivariate analysis indicated significant increases in confidence from baseline to follow-up ranging from +0.15 to +0.29 across the six workshop areas, with resume/CV preparation having the highest increase. From study onset to follow-up, students perceived that the six career skills areas were above the average importance midpoint (3.0). Conclusion. The workshop was effective in increasing students' knowledge and confidence of essential career skills vital to pursuing post-graduate employment. These career skills are important for helping students distinguish themselves in a competitive job market.

Pharmacy student awareness, aspiration, and preparation for post graduate education (PGE) fellowship in US: A cross-sectional study.

INTRODUCTION: Fellowship opportunities are seen by pharmacy students and graduates as an option to assist in furthering pharmacy knowledge in a specific field or area of interest. Pharmaceutical industry fellowships are the most common pharmacy fellowship available to students. There has been little research on what motivates students to pursue a fellowship and what student characteristics may help predict interest in a fellowship. METHODS: A survey was distributed to P1, P2, and P3 students. The survey took 10-15 min to complete and contained 28 questions. The difference in students' characteristics between fellowship interested students and non-fellowship interested students were examined using chi-square tests and t-tests for categorical variables and continuous variables, respectively. Logistic regression was used to examine predictors of pursuing a fellowship. RESULTS: Age, work experience, and attendance during a fellowship roundtable were all found to be statistically significant predictors of pursuit of a fellowship. Financial obligations, family obligations, and feeling unprepared were the most common reasons for not pursuing a fellowship. DISCUSSION AND CONCLUSIONS: Students earlier in the curriculum were more likely to express interest in pursuing a fellowship. Overall, students felt ill-prepared for the fellowship application process. In addition, fellowship roundtables may be useful for pharmacy programs to help students in their pursuit of fellowships.

Implementation and lessons learned from a mock trial as a teaching-learning and assessment activity.

BACKGROUND AND PURPOSE: To describe implementation and lessons learned from use of a mock trial as a teaching-learning and assessment activity in a required evidence-based practice course. This innovative self-directed learning strategy reinforced evidence-based skills and affective domain competencies in Center for the Advancement of Pharmaceutical Education (CAPE) 2013 Outcomes and Accreditation Council for Pharmacy Education (ACPE) Standards 2016. EDUCATIONAL ACTIVITY AND SETTING: During spring semesters 2015 and 2016, first professional year (P1) cohorts were divided into teams and assigned controversial topics to research and debate in mock trials. The activity provided opportunities for teaching-learning and assessment. Statistical analysis included inter-rater reliability (IRR), comparison of faculty-judge and student-juror evaluation of trial performance. FINDINGS: Two cohorts were divided into eight teams (four per cohort) to debate four issues. Students within each team were assigned individual scores. Mean individual scores are reported by trial/topic. Faculty-judges and student-jurors rated eight criteria including content/knowledge, critical thinking, application/discussion of federal/state law, citations/references, visual aids, delivery/style, and active listening. Analysis indicated students met competency expectations with overall judges' and jurors' mean scores above 54/60 points (90%) in 2015 and above 51/60 points (85%) in 2016. Judges' scores showed a wider distribution than jurors' scores. Peer evaluation mean scores were above 55/60 points in all four trials. Intra-class correlation was calculated. Judges' scores had excellent IRR in two trials, and good IRR in a third trial, whereas jurors had good IRR in one trial. SUMMARY: Evaluation scores demonstrated students successfully applied knowledge and skills from this and prior P1 courses, and met competency expectations for the mock trial.

An analysis of the use of Pharmacy Curriculum Outcomes Assessment (PCOA) scores within one professional program.

OBJECTIVE: The Pharmacy Curriculum Outcomes Assessment (PCOA) is a recent assessment requirement for US pharmacy professional programs. This study analyses PCOA scores for uses described in the 2016 Standards with data from one professional program. METHODS: PCOA data were analyzed for two consecutive classes (n=215) of pharmacy students at the end of their didactic curriculum to explore relationships among PCOA scores, grade point average (GPA), and North American Pharmacist Licensure Examination (NAPLEX) scores utilizing regression analyses. RESULTS: Decisions about student learning based on PCOA scores and GPA indicated remediation would have been prescribed for approximately 7% of students. In comparison, NAPLEX scores revealed a 1% failure rate among the study sample. Relationships between PCOA scores and GPA (r=0.47) and NAPLEX (r=0.51) were moderate to large, respectively. GPA explained a larger portion of unique variance (14%) than PCOA (8%) in NAPLEX scores. CONCLUSIONS: In this sample of students, academic decisions would have varied depending upon the learning assessment, which is consistent with a moderate correlation between GPA and PCOA scores. Although PCOA scores correlate with GPA and NAPLEX, PCOA scores explained a smaller portion of unique variance in NAPLEX scores than GPA. The ongoing establishment of validity evidence of PCOA scores is important for meaningful interpretation of scores for the intended uses.

Establishing the Validity and Reliability Evidence of Preceptor Assessment of Student Tool.

Objective. To evaluate the validity and reliability evidence of the preceptor assessment of student tool (PAST) which was designed to assess doctor of pharmacy (PharmD) student rotation performance. Methods. Evaluation data were loaded into WINSTEPS software to conduct a Rasch rating scale analysis. Validity evidence was examined from construct and content validity perspectives, and reliability was assessed via student and item separation index and reliability coefficient. Data from 435 observations were included in the analysis. Results. All 19 items measured the same construct of interest and the five-point rating scale functioned appropriately and differentiated students' ability. However, the item/person map indicated an absence of items at the end of the measurement continuum. Conclusion. Although adding items at the end of the measurement continuum may be beneficial, PAST showed good validity and reliability evidence when used to evaluate PharmD student rotations and is suitable to assess mastery learning.

Developing an Assessment Process for a Master's of Science Degree in a Pharmaceutical Sciences Program.

Objective. To develop a program-level assessment process for a master's of science degree in a pharmaceutical sciences (MSPS) program. Design. Program-level goals were created and mapped to course learning objectives. Embedded assessment tools were created by each course director and used to gather information related to program-level goals. Initial assessment iterations involved a subset of offered courses, and course directors met with the department assessment committee to review the quality of the assessment tools as well as the data collected with them. Insights from these discussions were used to improve the process. When all courses were used for collecting program-level assessment data, a modified system of guided reflection was used to reduce demands on committee members. Assessment. The first two iterations of collecting program-level assessment revealed problems with both the assessment tools and the program goals themselves. Course directors were inconsistent in the Bloom's Taxonomy level at which they assessed student achievement of program goals. Moreover, inappropriate mapping of program goals to course learning objectives were identified. These issues led to unreliable measures of how well students were doing with regard to program-level goals. Peer discussions between course directors and the assessment committee led to modification of program goals as well as improved assessment data collection tools. Conclusion. By starting with a subset of courses and using course-embedded assessment tools, a program-level assessment process was created with little difficulty. Involving all faculty members and avoiding comparisons between courses made obtaining faculty buy-in easier. Peer discussion often resulted in consensus on how to improve assessment tools.

Implementation and assessment of a required transitions-of-care residency rotation.

PURPOSE: The implementation of a required residency rotation in transitions of care (TOCs) and the resulting resident-led clinical interventions and learning experiences are described. SUMMARY: A newly required four-week TOC rotation was implemented for postgraduate year 1 (PGY1) pharmacy residents at Massachusetts General Hospital (MGH). Unlike acute care rotations, this learning experience encouraged residents to focus on providing direct patient care in a holistic manner and use pharmacologic and nonpharmacologic strategies to improve patient outcomes. The residents encountered patients with multiple comorbidities and were expected to manage common chronic diseases in a predominantly geriatric population. This rotation focuses on medically complex patients at high risk for readmission. TOC pharmacists and residents collaborate with multidisciplinary teams in both the outpatient and inpatient settings around the time of discharge from the hospital. All residents found the experience valuable and believed that the lessons learned would be incorporated into their future clinical practice. Residents gained a thorough understanding of conducting comprehensive medication reviews, assessing barriers to patients' understanding of and adherence to their medications, and working as part of a multidisciplinary team to address and overcome medication-related barriers during TOCs. CONCLUSION: The TOC rotation at MGH provided PGY1 residents with a better understanding of the challenges of continuity of care, the impact of medication access on patient outcomes, and the promotion of medication adherence through patient engagement. The activities reported most valuable by residents included providing direct patient education, performing case reviews with the preceptor, collaborating with the preceptor on patient visits, and completing comprehensive medication reviews.

Introduction and Assessment of a Blended-Learning Model to Teach Patient Assessment in a Doctor of Pharmacy Program.

Objective. To integrate a blended-learning model into a two-course patient assessment sequence in a doctor of pharmacy (PharmD) program and to assess the academic performance and perceptions of enrolled students. Design. A blended-learning model consisting of a flipped classroom format was integrated into a patient assessment (PA) course sequence. Course grades of students in the blended-learning (intervention) and traditional-classroom (control) groups were compared. A survey was administered to assess student perceptions. Assessment. The mean numeric grades of students in the intervention group were higher than those of students in the traditional group (PA1 course: 92.2±3.1 vs 90.0±4.3; and PA2 course: 90.3±4.9 vs 85.8±4.2). Eighty-six percent of the students in the intervention group agreed that the instructional methodologies used in this course facilitated understanding of the material. Conclusion. The blended-learning model was associated with improved academic performance and was well-received by students.

The Value of Pharmacy Residency Training for Health Systems: An Annotated Bibliography.

PURPOSE: Identify and summarize articles that describe the value that pharmacy residency training offers to sponsoring health systems. SUMMARY: There is a tremendous gap between the number of resident applicants and the number of pharmacy residencies available. Informing health-system administration executives about the proven value of residency training is key to expanding the number of available positions. To address this disparity, a comprehensive and systematic literature search to identify publications highlighting the value that pharmacy residency training provides to the sponsor hospital or health system was conducted. Articles were identified through query of PubMed and SciVerse SCOPUS and through review of bibliographies from relevant articles. Twenty articles were identified and summarized in this annotated bibliography that demonstrate perceived and quantitative value of pharmacy residency training for health systems that sponsor residency training. CONCLUSION: Pharmacy residency training programs are essential for pharmacists that will primarily engage in direct patient care activities. This annotated bibliography includes key publications that provide evidence of the value that pharmacy residents provide to the sponsoring health system. This manuscript will aid prospective residency directors interested in developing new residency positions at new institutions or for residency program directors interested in expanding the total number of resident positions available at the existing sites.

Impact of High-Fidelity Simulation and Pharmacist-Specific Didactic Lectures in Addition to ACLS Provider Certification on Pharmacy Resident ACLS Performance.

PURPOSE: This pilot study explored the use of multidisciplinary high-fidelity simulation and additional pharmacist-focused training methods in training postgraduate year 1 (PGY1) pharmacy residents to provide Advanced Cardiovascular Life Support (ACLS) care. Pharmacy resident confidence and comfort level were assessed after completing these training requirements. METHODS: The ACLS training requirements for pharmacy residents were revised to include didactic instruction on ACLS pharmacology and rhythm recognition and participation in multidisciplinary high-fidelity simulation ACLS experiences in addition to ACLS provider certification. Surveys were administered to participating residents to assess the impact of this additional education on resident confidence and comfort level in cardiopulmonary arrest situations. RESULTS: The new ACLS didactic and simulation training requirements resulted in increased resident confidence and comfort level in all assessed functions. Residents felt more confident in all areas except providing recommendations for dosing and administration of medications and rhythm recognition after completing the simulation scenarios than with ACLS certification training and the didactic components alone. All residents felt the addition of lectures and simulation experiences better prepared them to function as a pharmacist in the ACLS team. CONCLUSION: Additional ACLS training requirements for pharmacy residents increased overall awareness of pharmacist roles and responsibilities and greatly improved resident confidence and comfort level in performing most essential pharmacist functions during ACLS situations.

Participants' perceptions of a multidisciplinary training program for graduate and postgraduate students in drug use management and policy.

OBJECTIVE: To determine graduate and postgraduate students' perceptions of a drug use management and policy program that applied wide-ranging policy research skills to inform pharmaceutical decision-making. DESIGN: Nine cohorts of graduate and postgraduate students from diverse academic and professional backgrounds were paired with health-system preceptors for 4 months, and supported by faculty advisors and administrators, to complete research projects that generated evidence to inform policy decisions. ASSESSMENT: A self-administered survey instrument was sent to all alumni of the program over the previous 10 years. The majority of respondents indicated: their prior academic coursework could be applied to everyday life; service-learning projects complemented university programs; participation led to greater awareness of decision-makers' needs and appreciation of their tacit knowledge; and communication abilities were enhanced with decision-makers, and academics. Many also reported personal desire to fulfill healthcare-system research needs; personal belief in their ability to make a difference; and increased postgraduation marketability. CONCLUSION: A drug use management and policy program allowed graduate students from various disciplines to develop new skills and collaborate with experts to produce research evidence that was relevant to drug policy that addressed real-world problems.

Physical assessment experience in a problem-based learning course.

OBJECTIVE: To evaluate the impact of a physical-assessment learning experience implemented in the problem-based learning (PBL) format of the third year of a doctor of pharmacy (PharmD) program. DESIGN: Students enrolled in a PBL course completed survey instruments to measure knowledge and confidence before and after participating in the learning experience. A simulation stethoscope was used to teach students abnormal pulmonary and cardiovascular sounds in 1-hour sessions for each of 12 PBL groups. ASSESSMENT: The 92 students enrolled in the PBL course completed pre- and post-experience survey instruments. Students' scores on knowledge questions increased significantly (p < 0.0001) from 40.4% ± 11.4% at baseline to 62.5% ± 13.7% and 63.1 ± 11.6%, respectively, on the 2 sets of post-experience questions. Students scored a median of 3 or 4 on a 5-point Likert scale after a learning experience on questions measuring confidence. CONCLUSION: Use of a simulation stethoscope in a physical-assessment learning experience increased pharmacy students' knowledge in performing pulmonary and cardiovascular assessment techniques.

Objective Structured Clinical Examinations (OSCEs) compared with traditional assessment methods.

OBJECTIVES: To compare objective structured clinical examinations (OSCEs) and traditional assessment methods among recent pharmacy graduates. METHODS: Individual student performance in OSCEs was compared with performance on traditional pharmacy-practice examinations at the same level of program study. RESULTS: A moderate correlation was found between individual attainment in OSCE examinations and on traditional pharmacy practice examinations at the same level. CONCLUSIONS: OSCEs add value to traditional methods of assessment because the 2 evaluation methods measure different competencies.