Exploring the use of ChatGPT to analyze student course evaluation comments.

BACKGROUND: Since the release of ChatGPT, numerous positive applications for this artificial intelligence (AI) tool in higher education have emerged. Faculty can reduce workload by implementing the use of AI. While course evaluations are a common tool used across higher education, the process of identifying useful information from multiple open-ended comments is often time consuming. The purpose of this study was to explore the use of ChatGPT in analyzing course evaluation comments, including the time required to generate themes and the level of agreement between instructor-identified and AI-identified themes. METHODS: Course instructors independently analyzed open-ended student course evaluation comments. Five prompts were provided to guide the coding process. Instructors were asked to note the time required to complete the analysis, the general process they used, and how they felt during their analysis. Student comments were also analyzed through two independent Open-AI ChatGPT user accounts. Thematic analysis was used to analyze the themes generated by instructors and ChatGPT. Percent agreement between the instructor and ChatGPT themes were calculated for each prompt, along with an overall agreement statistic between the instructor and two ChatGPT themes. RESULTS: There was high agreement between the instructor and ChatGPT results. The highest agreement was for course-related topics (range 0.71-0.82) and lowest agreement was for weaknesses of the course (range 0.53-0.81). For all prompts except themes related to student experience, the two ChatGPT accounts demonstrated higher agreement with one another than with the instructors. On average, instructors took 27.50 ± 15.00 min to analyze their data (range 20-50). The ChatGPT users took 10.50 ± 1.00 min (range 10-12) and 12.50 ± 2.89 min (range 10-15) to analyze the data. In relation to reviewing and analyzing their own open-ended course evaluations, instructors reported feeling anxiety prior to the process, satisfaction during the process, and frustration related to findings. CONCLUSIONS: This study offers valuable insights into the potential of ChatGPT as a tool for analyzing open-ended student course evaluation comments in health professions education. However, it is crucial to ensure ChatGPT is used as a tool to assist with the analysis and to avoid relying solely on its outputs for conclusions.

Distribution of Female and Male First and Last Authorship across Drug Delivery Related Journals with Respect to Year and Journal Impact Factor.

First and last authorship are important metrics of productivity and scholarly success for trainees and professors. For 11 drug delivery-related journals in 2021, the percentage of female first (39.5%) and last (25.7%) authorship was reported. A strong negative correlation, with female first (rp = -0.73) and female last authorship (rp = -0.66), was observed with respect to journal impact factor. In contrast, there was a strong positive correlation with male first and last authorship (rp = 0.71). Papers were ∼1.5 times more likely to have a male first author, and ∼3 times more likely to have a male last author, than females. A female was 22% more likely to have first authorship if the last author was female, although there is an ∼1% increase per year in female authorship with male last authorship, which equates to equality in first authorship by 2044. Considering that drug delivery is composed of engineering, chemistry, and pharmaceutical science disciplines, the observed 25.7% female last authorship does not represent the approximately 35.5% to 50% of professors that are female in these disciplines, internationally. Overall, female authorship in drug delivery-related journals should improve to better represent the work of female senior authors.

Processes and perceptions of chemotherapy supply chain in Ethiopia: A mixed-method study.

BACKGROUND: The impact and downstream effects of the chemotherapy supply chain in Ethiopia are not well understood. The purpose of this study was to identify perceived gaps in supply chain and characterize their impact on patient care. METHODS: A concurrent mixed-method study was conducted at a large academic cancer center in Ethiopia. In-depth interviews (IDIs) and surveys were completed in collaboration with external stakeholders with knowledge about chemotherapy supply chain in Ethiopia. Thematic coding was used for qualitative analysis of IDI and descriptive statistics were used to summarize quantitative survey data. RESULTS: Six stakeholders participated in the IDIs and seven completed surveys. IDIs revealed that most chemotherapeutic agents are purchased by the Ethiopian Pharmaceutical Supply Agency (EPSA) and are distributed to cancer treatment centers. A free-market purchasing option also exists, but for chemotherapy obtained outside of government-subsidized channels, the potential for substandard or falsified chemotherapy was a concern. Participants expressed confidence that the correct treatment was administered to patients, but viewpoints on reliability and consistency of medication supply were variable. Quantitative data from the survey showed that participants were not confident that medications are prepared safely and correctly. Improper storage and manipulation of high-risk medications remain a significant risk to staff. CONCLUSIONS: This study provides insight from a healthcare staff perspective on how gaps in the chemotherapy supply chain process impact patient care in a low-income country. Inventory management, disruptions in supply chain, and product integrity were perceived as the largest gaps in the current chemotherapy supply chain structure.

Validity evidence for a virtual multiple mini interview at a pharmacy program.

BACKGROUND: Numerous health professions schools have transitioned to virtual admissions interviews in recent years. While some research suggests that virtual multiple mini-interviews (vMMIs) are feasible, acceptable, and more affordable, there is a paucity of research concerning the validity of this approach. The purpose of this study was to examine the validity and reliability of vMMIs and explore differences in performance between vMMI and in-person MMIs. METHODS: Data were collected for two years of in-person MMIs and two years of vMMIs at a pharmacy program/school in the United States. An exploratory factor analysis (principal components analysis) with varimax rotation and Kaiser rule (i.e. retaining factors with eigenvalue > 1.0) was used to explore the construct validity of the vMMI data. Pearson correlation was used to examine correlations between vMMI stations and Cronbach alpha was used to determine the internal consistency of each station. Independent t-tests were used to examine differences between in-person MMI and vMMI scores. Cohen's d was used to determine effect sizes. RESULTS: Four hundred and thirty-eight (42.69%) candidates completed an in-person MMI and 588 (57.31%) completed a vMMI. Factor analysis indicated that each vMMI station formed a single factor with loads ranging from 0.86 to 0.96. The vMMI stations accounted for most of the total variance, demonstrated weak to negligible intercorrelations, and high internal consistency. Significant differences between in-person and vMMI scores were found for the teamwork-giving, teamwork-receiving, and integrity stations. Medium effect sizes were found for teamwork-giving and teamwork-receiving and a small effect size was found for integrity. CONCLUSIONS: Initial evidence suggests that the vMMI is a valid and reliable alternative to in-person MMIs. Additional research is needed to examine sources of differences in rating patterns between the two approaches and identify strategies that align with institutional priorities for recruitment and admissions.

Exploring cognitive apprenticeship and teaching practices in pharmacy education.

Health professions schools in the United States and internationally have engaged in curricular changes to better prepare students for the future of health care. However, designing or selecting evidence-based teaching activities can be a challenge. Research suggests the Cognitive Apprenticeship theory is an effective framework for the health professions to inform instruction design, yet these studies have mainly focused on the clinical setting and not the didactic learning environment. This study used qualitative methods to explore the Cognitive Apprenticeship framework in the didactic learning environment and the teaching practices that pharmacy faculty used to explicate their expert thinking to students. Faculty were observed using all four Cognitive Apprenticeship dimensions (ie, Content, Sequencing, Methods, Sociology) in their teaching practice. Patterns were observed in the data revealing complex, short and sometimes spontaneous teaching practices that faculty used to promote learning.

Development and implementation of a formative instructional coaching program using the Teaching Practices Inventory within a health professions program.

BACKGROUND: A growing body of literature describes teaching practices that are positively associated with student achievement. Observing, characterizing, and providing feedback on these teaching practices is a necessary, yet significant challenge to improving teaching quality. This study describes the design, implementation, and evaluation of an instructional coaching program created to provide formative feedback to instructors based on their use of evidence-based teaching practices. METHODS: The program was designed for formative purposes utilizing an instrument adapted from the Teaching Practices Inventory. All faculty were invited to participate in the program on a voluntary basis when the program launched in Fall 2019. Program coaches included any School personnel who completed required training. Two rounds of instrument development were conducted with multiple observers and assessed using Krippendorff's Alpha. The program was evaluated using an anonymous post-session survey. RESULTS: Interrater reliability of the form improved over two rounds of piloting and no differences were found in scoring between trainees and education professionals. Seventeen observations were completed by nine coaches. Instructors indicated that feedback was practical, timely, specific, and collegial, suggesting that including student perspectives (e.g., focus groups, student course evaluations) in the coaching program might be helpful. CONCLUSIONS: Creating programs that emphasize and foster the use of evidence-based teaching are critical for health professions education. Additional research is needed to further develop coaching programs that ensure teaching practices in the health professions are optimizing student learning.

A review to characterise and map the growth mindset theory in health professions education.

INTRODUCTION: Growth mindset is a motivation theory proposed by Carol Dweck that posits our beliefs about intelligence, and the ability to change mindsets can have impacts on how we approach challenges, respond to criticism challenges and orient our goals. This study characterised articles on growth mindset theory in health professions education to: summarise the aspects of growth mindset being researched, describe the discussed benefits of growth mindset theory and outline strategies discussed that may promote a growth mindset. METHODS: A systematic review of the literature yielded 4927 articles-articles were reviewed and excluded if they were outside of health professions education and did not discuss Dweck's growth mindset theory. The final review yielded 14 research articles and 13 commentaries, which were characterised and analysed using content analysis. RESULTS: The included articles were published in 2016 and beyond; the articles represented a diverse context, participant type and approach. Most research studies measured participant mindsets and evaluated the correlation with other variables (eg grit, well-being, anxiety). Articles often highlighted benefits and strategies to promote a growth mindset at the learner, educator and organisation level. The most common learner benefits were to help them be more receptive to feedback as well as increased resiliency and perseverance, educator benefits focused on supporting collaborative relationships and safe learning environments. The most prevalent strategies discussed were teaching learners about growth mindset theory, shifting faculty feedback to emphasise effort and to prioritise feedback across the organisation. CONCLUSION: The growth mindset framework has been shown in other fields to help others manage educational challenges and enhance learning environments. Researchers are encouraged to explore how interventions such as teaching about and prioritising a growth mindset can support learners, health care professionals, educators and organisations.

Twelve tips to stimulate creative problem-solving with design thinking.

Design thinking is increasingly applied in healthcare and health professions education to generate innovative solutions to difficult problems. The design thinking framework helps individuals approach problems with a user-centered focus; the emphasis is on understanding the user experience, their challenges, and possible design solutions that are aligned with their needs. In this twelve tips paper, we describe strategies that health professions educators can use to prepare for, conduct, and support design thinking. These strategies may also be useful to learners, practitioners, and organizations to address complex problems.

Situational judgment test validity: an exploratory model of the participant response process using cognitive and think-aloud interviews.

BACKGROUND: Situational judgment tests (SJTs) are used in health sciences education to measure examinee knowledge using case-based scenarios. Despite their popularity, there is a significant gap in the validity research on the response process that demonstrates how SJTs measure their intended constructs. A model of SJT response processes has been proposed in the literature by Robert Ployhart; however, few studies have explored and expanded the factors. The purpose of this study was to describe the factors involved in cognitive processes that examinees use as they respond to SJT items in a health professions education context. METHODS: Thirty participants-15 student pharmacists and 15 practicing pharmacists-completed a 12-item SJT designed to measure empathy. Each participant engaged in a think-aloud interview while completing the SJT, followed by a cognitive interview probing their decision-making processes. Interviews were transcribed and independently coded by three researchers to identify salient factors that contributed to response processes. RESULTS: The findings suggest SJT response processes include all four stages (comprehension, retrieval, judgment, and response selection) as initially proposed by Ployhart. The study showed factors from other published research were present, including job-specific knowledge and experiences, emotional intelligence, and test-taking. The study also identified new factors not yet described, including identifying a task objective in the scenario, assumptions about the scenario, perceptions about the scenario, and the setting of the item. CONCLUSIONS: This study provides additional SJT validity evidence by exploring participants' response processes through cognitive and think-aloud interviews. It also confirmed the four-stage model previously described by Ployhart and identified new factors that may influence SJT response processes. This study contributes to the literature with an expanded SJT response process model in a health professions education context and offers an approach to evaluate SJT response processes in the future.

Patient engagement in first cycle comprehensive chemotherapy consultation pharmacist services and impact on patient activation.

BACKGROUND: Healthcare systems and policy makers worldwide are demonstrating interest in shared decision making, which requires patient activation. Patient activation can be measured using a validated tool called the patient activation measure-10. First cycle comprehensive chemotherapy consultation services (3CS) is provided by an oncology pharmacy team member during a patient encounter at the beginning of the patient's treatment for cancer. METHODS: This was a single center, prospective, non-randomized, observational clinical study in patients with cancer who required a new chemotherapy plan. A baseline patient activation measure-10 survey was administered and a pharmacy team member met with the patient to complete the first cycle 3CS encounter. Within two business days of that encounter, a second patient activation measure-10 survey was administered, and thus, patients served as their own control. RESULTS: Forty-nine patients who met the inclusion criteria were enrolled, of which 36 completed the study. Mean patient activation measure-10 scores measured at baseline and two business days after the 3CS encounter were significantly different (68.5 ± SD 14.7 vs. 75.0 ± SD 14.3, p = 0.001). This difference persisted when evaluated by gender (female: 70.0 ± SD 14.8 vs. 81.6 ± SD 10.5, p = 0.001; male: 66.1 ± SD 14.8 vs. 70.8 ± SD 14.7, p = 0.022). CONCLUSION: This study demonstrates that cancer patients had significantly increased patient activation scores after engagement in a 3CS encounter provided by an oncology pharmacy team. Further studies are needed to verify these data in a larger population, different healthcare settings, and to evaluate for patients who have solid tumor malignancies.

A qualitative review of the design thinking framework in health professions education.

BACKGROUND: Design thinking is a problem-solving framework that has been used to enhance patient experiences, improve clinical outcomes, and refine medical curricula. This study reviewed the use of design thinking in health professions education. METHODS: A search yielded 169 articles, which were excluded if they were: (1) not related to education; (2) lacking an application of design thinking; or (3) not associated with healthcare. The final review yielded 15 articles, which were analyzed using qualitative methods. RESULTS: All articles were published in 2009 or later and were diverse in their context, participants, and approach. Six studies emphasized the early stages of design thinking, with inspiration and ideation stages fostered through a variety of activities, such as lectures, small group discussions, and workshops. Studies examined a range of outcomes, including self-efficacy, perceptions, and solutions to a specific problem. CONCLUSIONS: Our findings raise important considerations for health professions education, including the extent to which we should: 1) teach design thinking to students as a skill-based tool to prepare students for problem solving in complex healthcare environments; and 2) use design thinking to create, implement, and refine health professions curricula and educational programs. Despite the apparent benefits of design thinking, many questions for health professions education remain.

Using the multiple mini interview as an assessment strategy within the first year of a health professions curriculum.

BACKGROUND: The multiple mini-interview (MMI) is a common assessment strategy used in student selection. The MMI as an assessment strategy within a health professions curriculum, however, has not been previously studied. This study describes the integration of a 5-station MMI as part of an end-of-year capstone following the first year of a health professions curriculum. The goal of the capstone MMI was to assess professional competencies of students and to offer formative feedback to prepare students for their upcoming clinical practice experiences. The purpose of this study was to evaluate the psychometric properties of an MMI integrated into a health professions curriculum. METHODS: Five capstone MMI stations were designed to each evaluate a single construct assessed by one rater. A principal component analysis (PCA) was used to evaluate the structure of the model and its ability to distinguish 5 separate constructs. A Multifaceted Rasch Measurement (MFRM) model assessed student performance and estimated the sources of measurement error attributed to 3 facets: student ability, rater stringency, and station difficulty. At the conclusion, students were surveyed about the capstone MMI experience. RESULTS: The PCA confirmed the MMI reliably assessed 5 unique constructs and performance on each station was not strongly correlated with one another. The 3-facet MFRM analysis explained 58.79% of the total variance in student scores. Specifically, 29.98% of the variance reflected student ability, 20.25% reflected rater stringency, and 8.56% reflected station difficulty. Overall, the data demonstrated an acceptable fit to the MFRM model. The majority of students agreed the MMI allowed them to effectively demonstrate their communication (80.82%), critical thinking (78.77%), and collaboration skills (70.55%). CONCLUSIONS: The MMI can be a valuable assessment strategy of professional competence within a health professions curriculum. These findings suggest the MMI is well-received by students and can produce reliable results. Future research should explore the impact of using the MMI as a strategy to monitor longitudinal competency development and inform feedback approaches.

Cognitive apprenticeship in health sciences education: a qualitative review.

Cognitive apprenticeship theory emphasizes the process of making expert thinking "visible" to students and fostering the cognitive and meta-cognitive processes required for expertise. The purpose of this review was to evaluate the use of cognitive apprenticeship theory with the primary aim of understanding how and to what extent the theory has been applied to the design, implementation, and analysis of education in the health sciences. The initial search yielded 149 articles, with 45 excluded because they contained the term "cognitive apprenticeship" only in reference list. The remaining 104 articles were categorized using a theory talk coding scheme. An in depth qualitative synthesis and review was conducted for the 26 articles falling into the major theory talk category. Application of cognitive apprenticeship theory tended to focus on the methods dimension (e.g., coaching, mentoring, scaffolding), with some consideration for the content and sociology dimensions. Cognitive apprenticeship was applied in various disciplines (e.g., nursing, medicine, veterinary) and educational settings (e.g., clinical, simulations, online). Health sciences education researchers often used cognitive apprenticeship to inform instructional design and instrument development. Major recommendations from the literature included consideration for contextual influences, providing faculty development, and expanding application of the theory to improve instructional design and student outcomes. This body of research provides critical insight into cognitive apprenticeship theory and extends our understanding of how to develop expert thinking in health sciences students. New research directions should apply the theory into additional aspects of health sciences educational research, such as classroom learning and interprofessional education.

Candidate Evaluation Using Targeted Construct Assessment in the Multiple Mini-Interview: A Multifaceted Rasch Model Analysis.

Construct: A 7-station multiple mini-interview (MMI) circuit was implemented and assessed for 214 candidates rated by 37 interviewers (N = 1,498 ratings). The MMI stations were designed to assess 6 specific constructs (adaptability, empathy, integrity, critical thinking, teamwork [receiving instruction], teamwork [giving instruction]) and one open station about the candidate's interest in the school. BACKGROUND: Despite the apparent benefits of the MMI, construct-irrelevant variance continues to be a topic of study. Refining the MMI to more effectively measure candidate ability is critical to improving our ability to identify and select candidates that are equipped for success within health professions education and the workforce. APPROACH: Each station assessed a single construct and was rated by a single interviewer who was provided only the name of the candidate and no additional information about the candidate's background, application, or prior academic performance. All interviewers received online and in-person training in the fall prior to the MMI and the morning of the MMI. A 3-facet multifaceted Rasch measurement analysis was completed to determine interviewer severity, candidate ability, and MMI station difficulty and examine how the model performed overall (e.g., rating scale). RESULTS: Altogether, the Rasch measures explained 62.84% of the variance in the ratings. Differences in candidate ability explained 45.28% of the variance in the data, whereas differences in interviewer severity explained 16.09% of the variance in the data. None of the interviewers had Infit or Outfit mean-square scores greater than 1.7, and only 2 (5.4%) had mean-square scores less than 0.5. CONCLUSIONS: The data demonstrated acceptable fit to the multifaceted Rasch measurement model. This work is the first of its kind in pharmacy and provides insight into the development of an MMI that provides useful and meaningful candidate assessment ratings for institutional decision making.

Student experiences across multiple flipped courses in a single curriculum.

CONTEXT: The flipped classroom approach has garnered significant attention in health professions education, which has resulted in calls for curriculum-wide implementations of the model. However, research to support the development of evidence-based guidelines for large-scale flipped classroom implementations is lacking. OBJECTIVES: This study was designed to examine how students experience the flipped classroom model of learning in multiple courses within a single curriculum, as well as to identify specific elements of flipped learning that students perceive as beneficial or challenging. METHODS: A qualitative analysis of students' comments (n = 6010) from mid-course and end-of-course evaluations of 10 flipped courses (in 2012-2014) was conducted. Common and recurring themes were identified through systematic iterative coding and sorting using the constant comparison method. Multiple coders, agreement through consensus and member checking were utilised to ensure the trustworthiness of findings. RESULTS: Several themes emerged from the analysis: (i) the perceived advantages of flipped learning coupled with concerns about implementation; (ii) the benefits of pre-class learning and factors that negatively affect these benefits, such as quality and quantity of learning materials, as well as overall increase in workload, especially in the context of multiple concurrent flipped courses; (iii) the role of the instructor in the flipped learning environment, particularly in engaging students in active learning and ensuring instructional alignment, and (iv) the need for assessments that emphasise the application of knowledge and critical thinking skills. CONCLUSIONS: Analysis of data from 10 flipped courses provided insight into common patterns of student learning experiences specific to the flipped learning model within a single curriculum. The study points to the challenges associated with scaling the implementation of the flipped classroom across multiple courses. Several core elements critical to the effective design and implementation of the flipped classroom model are identified.

A renaissance in pharmacy education at the University of North Carolina at Chapel Hill.

The UNC Eshelman School of Pharmacy is transforming its doctor of pharmacy program to emphasize active engagement of students in the classroom, foster scientific inquiry and innovation, and immerse students in patient care early in their education. The admissions process is also being reengineered.

Interrogating Consequential Validity Evidence in NAPLEX Studies Involving the Use of Demographic Variables.

OBJECTIVE: to review the purpose, methods, and discussion of student demographics related to North American Pharmacist Licensure Examination (NAPLEX) performance; demographic characteristics, significant findings, and related text were extracted from each reviewed article as evidence of consequential validity. FINDINGS: Nine articles met the inclusion criteria. Prior degree attainment (n = 8, 88.9%), age (n = 6, 66.7%), race/ethnicity (n = 6, 66.7%), and sex (n = 5, 55.6%) were the most common demographic variables included. One study found that prior degree attainment was negatively related to NAPLEX performance and no studies using this variable discussed their findings. Three studies found significant relationships between age and NAPLEX performance, attributing differences to older students for "unique psychosocial challenges and competing responsibilities" "greater maturity" and being more "professional." Measures of race/ethnicity differed in every study, with 3 reporting significant findings and 2 discussing their findings. Studies referenced literature suggesting that "minority groups" tended to score lower on standardized examinations while others referenced literature that suggests "standardized testing may not be predictive of the performance of minority students." Sex was not related to NAPLEX performance nor was it discussed in any studies. SUMMARY: Consequential validity evidence is a critical yet underreported aspect of NAPLEX evaluation in pharmacy education. How demographic variables are selected, utilized, and discussed warrants further exploration and consideration by educators, scholars, and practitioners as these decisions can have important sociocultural and political implications.

Exploring user experience (UX) research methods in health professions education.

OUR ISSUE: Researchers often design interventions or experiences to meet the needs of a specific user. However, the user's perspective is often excluded in the process, which can minimize effectiveness due to a lack of understanding about the user, their perspective, and/or their needs. User experience (UX) research methods offer an opportunity to capture additional information about the user that can inform the design of these solutions. METHODOLOGICAL LITERATURE REVIEW: UX research became prominent during the 1990s to describe the complexity of human interactions with technological solutions. UX research methods emerged in other disciplines as strategies for describing user perspectives, needs, challenges, and potential impact of proposed solutions-these may be useful in health professions education research. OUR RECOMMENDATIONS AND THEIR APPLICATIONS: Those interested in UX research methods should define the user, establish focused research questions, and select applicable strategies cognizant of time and resource constraints. UX research often requires a clear outline of research activities, how they address the questions, and techniques to engage representative users for data collection. Researchers can optimize data collection by creating inclusive spaces that emphasize active listening. Researchers should compile insights regularly and remember UX research emphasizes an iterative approach to design. POTENTIAL IMPACT: UX research can support deeper insights into users, their perspectives, their needs, and offers opportunities to co-construct solutions with their experiences in mind. These methods may help educators design impactful experiences that better achieve targeted outcomes in collaboration with their users (e.g., learners, faculty, teams).

Understanding pathways to health-system pharmacy administration: A journey mapping study.

PURPOSE: Pharmacy administrators play a critical role in the success of health systems, yet pathways to pharmacy administration are incompletely understood. The purpose of this study was to explore and describe pathways to becoming a health-system pharmacy administrator, including challenges experienced and resources needed. METHODS: Participants (N = 21) individually completed one or more journey maps detailing the pathway(s) to pharmacy administration and then engaged in small group discussion to identify common themes. A large group debrief was used to share and identify findings across small groups. Thematic analysis was utilized to identify common ideas shared. RESULTS: There was variation across the maps, illustrating many steps one might follow to become a pharmacy administrator. In the 23 maps completed, pathways most frequently began with pharmacy school (n = 9, 39.1%), high school (n = 6, 26.1%), or undergraduate training (n = 4, 17.4%). Most included residency training or dual master's of science in health-system pharmacy administration/residency training (n = 16, 69.6%). Common challenges included distractions, time constraints, grades/performance, financial constraints, and stress. Common resources needed included exposure to diverse career paths, pipeline and outreach support, mentoring, and leadership. Themes included debate about the definition of a pharmacy administrator, questions regarding the core competencies of the pharmacy administrator, discussion regarding ways to enter pharmacy administration, and reflection on the role of serendipity and networking. CONCLUSION: Understanding the pathways to pharmacy administration is critical to fostering a sustainable and competent workforce. Work must be done to identify strategies and develop processes for identifying, equipping, and retaining talented health-system pharmacy administrators and leaders.

Assessing Cultural Intelligence in PharmD Education Through Art.

OBJECTIVE: This study, conducted in collaboration with the University of North Carolina (UNC)-Chapel Hill's Ackland Art Museum, assessed student experiences in a facilitated visual art experience designed to foster cultural intelligence among 143 first-year Doctor of Pharmacy students at the UNC Eshelman School of Pharmacy. METHODS: A post-event survey was used to collect data on student perceptions of this experience and its implications. Quantitative items were analyzed using descriptive statistics. Qualitative items were deductively coded using the 4 domains of the Cultural Intelligence Framework: cultural awareness, cultural knowledge, cultural practice, and cultural desire. A convergent parallel mixed-methods approach was used to gain a deeper understanding of the data. RESULTS: Of the 143 students who completed the survey (response rate = 99%), nearly all agreed (n = 60, 42%) or strongly agreed (n = 70, 49%) that the art experience was valuable. Students indicated that it increased their confidence in having open dialogue concerning equity, inclusivity, and race, expanded their perspectives about the implications of inequities, and provided knowledge they can apply in their careers as health science professionals. Findings revealed students' acknowledgment of their own backgrounds, enhanced understanding of bias and historical contexts, recognition of relevance to pharmacy practice, and expressed a desire for further cultural understanding. CONCLUSION: This research underscores the potential of visual art and museum partnerships in fostering positive perceptions and beliefs about cultural intelligence among aspiring pharmacists.