Medical Students' General Beliefs and Specific Perceptions about Patient Feedback Before and after Training in a Clinical Context.

Introduction: Despite its high potential, patient feedback does not always result in learning. For feedback to be effective students must engage with it, which partly depends on their perceptions of feedback. To better understand student engagement with patient feedback in a clinical context, this study explored the following research questions: 1) What are medical students' general beliefs about patient feedback and what are their specific perceptions of feedback messages? 2) What is the difference between these general beliefs and feedback message perceptions before and after patient feedback training? Methods: The study context was a 12-week clerkship combining Pediatrics and Gynecology, which included feedback training for students and asking for patient feedback. Ninety 4th-year medical students completed pre- and post-clerkship questionnaires. The questionnaires (Beliefs about Patient Feedback Questionnaire, Feedback Perception Questionnaire) were adapted from validated peer-feedback questionnaires. Questionnaires were quantitatively analyzed. Results: Both pre- and post-clerkship, students had positive general beliefs about patient feedback and positive perceptions of the feedback messages they received. However, paired t-tests showed that students' general beliefs and feedback message perceptions became less positive after feedback training and experience. Discussion: Patient feedback is not an easy means to learn and students do not become feedback literate in terms of patient feedback overnight. We suggest that future researchers further explore reasons for the decline in positive perceptions of patient feedback. We suggest implementing longitudinal feedback training in medical curricula, where students are guided and supported in the complex task of learning from patients through feedback.

Exploring perceptions of pre-clerkship students about workplace learning in the clinical learning environment at Gulf Medical University, UAE.

BACKGROUND: Medical students view clinical workplace placements as an inspiring and motivating learning environment where active student participation is pivotal to development of students' identity. The progress from pre-clerkship to clerkship education harbors many challenges which consist of experiential learning, adjusting to the clinical environment, and understanding roles & responsibilities. Workplace learning is underpinned by various adult learning theories including social theories,constructivism, supported participation and legitimate peripheral participation. Workplace learning course was recently initiated for pre-clerkship students at a medical university in UAE, which will enable their smooth entry into the clerkship phase of the curriculum. OBJECTIVES: The research aims to explore students' perceptions of various domains of their clinical learning environment (CLE), highlight the challenges they face, and extract valuable feedback to improve their environment. METHODS: This study was conducted qualitatively by using focus groups method in order to explore students' perceptions of the clinical learning environment. Two focus group discussions were conducted (n = 8 +/-10) to determine the common challenges of workplace learning and its potential solutions. Data were analyzed using thematic analysis. The approach used to carry out this study was phenomenology, as it helps to understand the learning and behavior of these students who are undergoing this pre-clerkship training in order to transition smoothly to the clerkship phase. RESULT: The focus groups helped to deeply explore the perceptions of students about their clinical learning environment. It helped to reveal the challenges encountered by the students including the significance of proper orientation of staff and students, language barrier, availability of learning opportunities, and supervision quality. The focus groups provided worthwhile suggestions to improve the learning opportunities in the clinical learning environment which include orientation of the staff and students what to expect, improved supervision, mentoring and providing learning opportunities to encourage participation. CONCLUSION: This study attempted to identify the pre-clerkship students' perception of their clinical learning environment and the challenges they face over there. Possible suggestions by the students included a formal orientation for the staff and students to be carried out at the beginning. Efforts should be made by clerkship directors to provide students with learning opportunities by increasing patient exposure, encouraging participation, and providing high-quality supervision.

Reflecting on 12 years of training medical students in rural longitudinal integrated clerkships.

Longitudinal integrated clerkships (LICs) are effective in promoting careers in rural primary health care environments. This model of training medical professionals involves longer clinical placements of medical students and a different approach to learning which better prepares them for primary health care practice. Stellenbosch University created a LIC in 2011 for this purpose and has trained almost 100 doctors in their yearlong LIC since then. The past 12 years have brought about a lot of learning as this model of training was implemented, developed, and refined to suit the needs of students and the clinical environments.Contribution: Countries across the globe face challenges in recruiting and retaining doctors in rural primary health care environments. Longitudinal integrated clerkships have several educational benefits in addition to increase recruitment and retention of rural doctors, and 12 years of experience have led to a greater understanding regarding implementation and outcomes of an LIC in the South African context.

Longitudinal integrated clerkships from start to finish: A medical curriculum innovation.

Stellenbosch University embarked on a renewal of its MBChB programme guided by an updated set of core values developed by the multidisciplinary curriculum task team. These values acknowledged the important role of (among others) context and generalism in the development of our graduates as doctors of the future for South Africa. This report describes the overall direction of the renewed curriculum focusing on two of the innovative educational methods for Family Medicine and Primary Health Care training that enabled us to respond to these considerations. These innovations provide students with both early longitudinal clinical experience (now approximately 72 h per year for each of the first 3 years) and a final longitudinal capstone experience (36 weeks) outside the central tertiary teaching hospital. While the final year experience will run for the first time in 2027 (the first year launched in 2022), the initial experience has got off to a good start with students expressing the value that it brings to their integrated, holistic learning and their identity formation aligned with the mission statement of this renewed curriculum. These two curricular innovations were designed on sound educational principles, utilising contextually appropriate research and by aligning with the goals of the healthcare system in which our students would be trained. The first has created opportunities for students to develop a professional identity that is informed by a substantial and longitudinal primary healthcare experience.Contribution: The intention is to consolidate this in their final district-based experience under the supervision of specialist family physicians and generalist doctors.

Barriers and future improvements of workplace-based learning in Korean medicine clinical clerkship: perspectives of graduates.

BACKGROUND: Workplace-based learning (WPBL) has emerged as an essential practice in healthcare education. However, WPBL is rarely implemented in Korean medicine (KM) due to the passive attitude of teachers and possible violation of medical laws that limit the participation of trainees in medical treatment. In this study, we implemented WPBL in the clinical clerkship of Acupuncture and Moxibustion Medicine at a single College of KM and explored the barriers and future improvements of WPBL. METHODS: The WPBL was implemented from January to July 2019. During the clerkship, each senior student was assigned an inpatient at the university hospital. WPBL was conducted as follows: patient presentation by the supervisor, interaction with the patient at the bedside, preparation of medical records, oral case presentation, and discussion with feedback. The student performed a physical examination and review of systems as a clinical task. In addition, six doctors of KM who are currently practicing after three years of WPBL were interviewed in September 2022 to investigate the real-world effects and unmet needs of WPBL in their workplaces. RESULTS: Two major themes identified from the interview were: "the experience of novice doctors of KM with KM practice" and "Current state of KM clinical education." The five subcategories were: "Clinical competency priorities vary according to the KM workplace," "Difficulties faced by doctors of KM immediately after graduation," "WPBL experience of the interviewees," "Necessary but difficult to implement real patient learning," and "Unmet needs for clinical clerkship in KM." CONCLUSION: It is essential to consider the unique characteristics of KM practice and the duties required in various workplaces for successful WPBL. We anticipate our study to be a starting point for improving the WPBL and addressing the unmet needs in KM clinical education.

Effect of a workplace-based learning program on clerkship students' behaviors and attitudes toward evidence-based medicine practice.

In clinical clerkship (CC), medical students can practice evidence-based medicine (EBM) with their assigned patients. Although CC can be a valuable opportunity for EBM education, the impact of EBM training, including long-term behavioral changes, remains unclear. One hundred and nine fourth- and fifth-year medical students undergoing CC at a medical school in Japan attended a workplace-based learning program for EBM during CC (WB-EBM), which included the practice of the five steps of EBM. The program's effect on the students' attitudes toward EBM in CC was assessed through questionnaires. A total of 88 medical students participated in the program. Responses to the questionnaire indicated high satisfaction with the WB-EBM program. The most common theme in students' clinical problems with their assigned patients was the choice of treatment, followed by its effect. Based on the responses in the post-survey for the long-term effects of the program, the frequency of problem formulation and article reading tended to increase in the 'within six months' group comprising 18 students who participated in the WB-EBM program, compared with the control group comprising 34 students who did not. Additionally, the ability to self-assess problem formulation was significantly higher, compared with the control group. However, among 52 students who participated in the WB-EBM program more than six months later, EBM-related behavioral habits in CC and self-assessments of the five steps of EBM were not significantly different from those in the control group. The WB-EBM program was acceptable for medical students in CC. It motivated them to formulate clinical questions and enhanced their critical thinking. Moreover, the WB-EBM program can improve habits and self-evaluations about EBM. However, as its effects may not last more than six months, it may need to be repeated across departments throughout CC to change behavior in EBM practice.

Situational simulation teaching effectively improves dental students' non-operational clinical competency and objective structured clinical examination performance.

BACKGROUND: Appropriate communication with dental patients enhances treatment outcomes and patient satisfaction. Implementing simulated patient interviews courses can improve patient-centered care and reduce conflict during clerkship training. Therefore, this study explored the relationship among student participation in a situational simulation course (SSC), academic performance, clerkship performance, and objective structured clinical examination (OSCE) performance. METHODS: This study was conducted with a sample of fifth-year dental students undergoing clerkship training. After implementing a situational simulation course to investigate the relationship among participation in SSC, academic performance, clerkship performance, and OSCE performance, a path analysis model was developed and tested. RESULTS: Eighty-seven fifth-year dental students were eligible for the SSC, and most (n = 70, 80.46%) volunteered to participate. The path analysis model revealed that academic performance had a direct effect on OSCE performance (ß = 0.281, P = 0.003) and clerkship performance (ß = 0.441, P < 0.001). In addition, SSC teaching had a direct effect on OSCE performance (ß = 0.356, P < 0.001). CONCLUSIONS: SSCs can enhance dental students' non-operational clinical competency and OSCE performance effectively. Simulated patient encounters with feedback, incorporated into the dental curricula, have led to improved communication. Based on our findings, we suggest implementing SSC teaching before the OSCE to improve communication and cognitive skills.

Student-run free clinics may enhance medical students' self-confidence in their clinical skills and preparedness for clerkships.

INTRODUCTION: Student-run free clinics (SRFCs) offer medical students a unique opportunity to develop their clinical, diagnostic, and social skills while providing care to medically underserved communities. This study aims to evaluate the value of SRFC involvement on students' self-reported confidence in various clinical domains and satisfaction with their medical education. METHODS: We conducted a single-center retrospective pre-post assessment at an urban academic institution among second- to fourth-year medical students. We administered a 25-item questionnaire capturing the scope of clinic involvement and assessing self-reported confidence in multiple clinical domains following a one-year-long participation in student-run free clinics. RESULTS: Fifty-six students completed the survey. Participation in SRFCs significantly increased self-reported confidence in patient history-taking (p < 0.001), performing oral presentations (p < 0.001) and physical exams (p < 0.001). Students also reported significantly greater confidence in working with translators (p < 0.001) or as part of an interprofessional team (p < 0.001) and understanding the needs of the population served (p < 0.001). Students also found SRCs to significantly improve their confidence in preparedness for clerkships (p < 0.001). SRFC involvement can improve medical students' confidence in their clinical and interpersonal skills and enhance preparedness for clerkships and working with diverse patient groups. CONCLUSION: SRFCs are a useful tool in the medical school curriculum that help bridge the gap between classroom learning and clinic and may encourage practice in medically underserved communities. SRFCs also integrate classroom material and clinical practice, although standardized evaluation metrics need to be developed. SRFCs should be incorporated as a learning experience by medical schools nationwide.

Impact of clinical clerkship integrated with clinical ladder on attending physicians' teaching self-efficacy.

BACKGROUND: Self-efficacy plays an important role in enhancing the teaching capabilities of attending physicians (APs). The clinical ladder (CL) is an educational approach developed in the field of nursing education that increases difficulty in an incremental manner. However, no previous study has confirmed the effectiveness of CL in medical education. Therefore, this study aimed to examine the effect of clinical clerkship integrated with clinical ladder (CC-CL) on the self-efficacy of APs. METHODS: Sixth-year medical students participated in CC-CL for 6 months starting from April 2023, and the changes in the self-efficacy of APs were retrospectively evaluated. The students were trained by the APs concurrently, and the achievement levels of each student were shared. The primary outcome measure was the physician teaching self-efficacy questionnaire (PTSQ) score. The PTSQ scores before and after CC-CL were analyzed using the Wilcoxon matched-pair signed-rank test. RESULTS: Fifteen APs from the Department of Pediatric and Child Neurology were included in this study. No significant difference was observed in the total PTSQ scores of the APs before and after CC-CL. However, a significant increase was observed in the PTSQ score of APs who participated for at least 2 h per week over a period of more than 3 months (n = 8) after CC-CL (p = 0.022). Furthermore, APs who had received their pediatrician certification < 10 years ago (n = 8) showed a significant increase in the total PTSQ score after CC-CL (p = 0.022). CONCLUSIONS: CC-CL may play an important role in cultivating the self-efficacy of less experienced APs. Further comparative studies must be conducted in the future to validate the findings of this study.

R.I.M.E. and reason: multi-station OSCE enhancement to neutralize grade inflation.

To offset grade inflation, many clerkships combine faculty evaluations with objective assessments including the Medical Examiners Subject Examination (NBME-SE) or Objective Structured Clinical Examination (OSCE), however, standardized methods are not established. Following a curriculum transition removing faculty clinical evaluations from summative grading, final clerkship designations of fail (F), pass (P), and pass-with-distinction (PD) were determined by combined NBME-SE and OSCE performance, with overall PD for the clerkship requiring meeting this threshold in both. At the time, 90% of students achieved PD on the Internal Medicine (IM) OSCE resulting in overall clerkship grades primarily determined by the NBME-SE. The clerkship sought to enhance the OSCE to provide a more thorough objective clinical skills assessment, offset grade inflation, and reduce the NBME-SE primary determination of the final clerkship grade. The single-station 43-point OSCE was enhanced to a three-station 75-point OSCE using the Reporter-Interpreter-Manager-Educator (RIME) framework to align patient encounters with targeted assessments of progressive skills and competencies related to the clerkship rotation. Student performances were evaluated pre- and post-OSCE enhancement. Student surveys provided feedback about the clinical realism of the OSCE and the difficulty. Pre-intervention OSCE scores were more tightly clustered (SD = 5.65%) around a high average performance with scores being highly negatively skewed. Post-intervention OSCE scores were more dispersed (SD = 6.88%) around a lower average with scores being far less skewed resulting in an approximately normal distribution. This lowered the total number of students achieving PD on the OSCE and PD in the clerkship, thus reducing the relative weight of the NMBE-SE in the overall clerkship grade. Student response was positive, indicating the examination was fair and reflective of their clinical experiences. Through structured development, OSCE assessment can provide a realistic and objective measurement of clinical performance as part of the summative evaluation of students.

Test-Only Learning via Virtual Patients to Improve Surgical Illness Scripts of Preclinical Medical Students as a Preparation for Clinical Clerkships: An Experimental Study.

OBJECTIVE: The aim was to determine whether preclinical medical students can develop their illness scripts to a level comparable to that of clerkship students through test-only learning using repeated formative online testlets. METHODS: In this experimental study, participants were 52 preclinical and 53 clinical medical students. The intervention group consisted of preclinical medical students, and the control group consisted of clinical medical students. The intervention group responded to online testlets containing feedback, an innovative formative assessment method called ContExtended Questions, on general surgery for 8 days by spending no more than 30 minutes each day. The control group completed the general surgery clerkship. The performances were assessed using 20 Key-Feature Question items. The intervention group was assessed twice: immediately after the intervention (the immediate test), and again 1 month later (the delayed test). The control group was assessed once, immediately after the clerkship. All performance tests were identical. RESULTS: The preclinical students had a significantly higher mean score on the immediate test (83.1 ± 9.6) compared to the clinical students (75.4 ± 8.9), P < .001. The effect size (Cohen's d) was .83. However, the mean score in the delayed test (76.9 ± 13.6) was not significantly different from clinical students' mean score (75.4 ± 8.9), P > .05. CONCLUSIONS: Test-only learning as a spaced repetition of online formative testlets is effective in preparing preclinical medical students to the clinical clerkship. Through using this approach in preclinical period, they can prepare themselves for the clinical environment to optimize the benefits derived from clerkships.

Big five personality traits of medical students and workplace performance in the final clerkship year using an EPA framework.

BACKGROUND: The qualities of trainees play a key role in entrustment decisions by clinical supervisors for the assignments of professional tasks and levels of supervision. A recent body of qualitative research has shown that in addition to knowledge and skills, a number of personality traits are relevant in the workplace; however, the relevance of these traits has not been investigated empirically. The aim of this study was to analyse the workplace performance of final-year medical students using an Entrustable Professional Activity (EPA) framework in relation to their personality traits. METHODS: Medical students at the end of their final clerkship year were invited to participate in an online survey-based, cross-sectional field study. In the survey, the workplace performance was captured using a framework consisting of levels of experienced supervision and a defined set of 12 end-of-undergraduate medical training EPAs. The Big Five personality traits (extraversion, agreeableness, conscientiousness, neuroticism, and openness) of the participating medical students were measured using the Big Five Inventory-SOEP (BFI-S), which consists of 15 items that are rated on a seven-point Likert scale. The data were analysed using descriptive and inferential statistics. RESULTS: The study included 880 final-year medical students (mean age: 27.2 years, SD = 3.0; 65% female). The levels of supervision under which the final-year clerkship students carried out the EPAs varied considerably. Significant correlations were found between the levels of experienced supervision and all Big Five dimensions The correlations with the dimensions of extraversion, agreeableness, conscientiousness and openness were positive, and that for the neuroticism dimension was negative (range r = 0.17 to r = - 0.23). Multiple regression analyses showed that the combination of the Big Five personality traits accounted for 0.8-7.5% of the variance in supervision levels on individual EPAs. CONCLUSIONS: Using the BFI-S, we found that the levels of supervision on a set of end-of-undergraduate medical training EPAs were related to the personality traits of final-year medical students. The results of this study confirm the existing body of research on the role of conscientiousness and extraversion in entrustment decision-making and, in particular, add the personality trait of neuroticism as a new and relevant trainee quality to be considered.

Academic performance of students in an accelerated medical pathway.

Accelerated medical school curricula, such as three-year programs, have gained attention in recent years but studies evaluating their impact are still scarce. This study examines the Fully Integrated Readiness for Service Training (FIRST) program, a three-year accelerated pathway, to assess its impact on students' academic performance preparedness for residency. In this observational study, we compared the academic outcomes of FIRST program students to traditional four-year curriculum students from 2018 to 2023. We analyzed multiple metrics, including exam performance (United States Medical Licensing Examination Step scores, shelf exam scores, and pre-clinical course scores) and clinical performance scores during the application and individualization phases. Analysis of Variance was used to examine the effect of accelerated pathway program experience relative to traditional 4-year medical school curriculum on the learning outcomes. FIRST program students were on average 1.5 years younger upon graduation than their traditional peers. While FIRST program students scored slightly lower on Step 2 Clinical Knowledge (CK), they exhibited no significant differences in other exam scores or clinical performance relative to the traditional students. Notably, FIRST students achieved equivalent clinical performance ratings during critical clerkships and rotations. Our findings suggest that a three-year medical school curriculum can effectively prepare students for residency and produce graduates with comparable medical knowledge and clinical skills, offering potential benefits in terms of financial relief and personal well-being for medical students.

La integración de la inteligencia artificial en la educación médica y su impacto en la práctica clínica / The integration of artificial intelligence in medical education and its impact on clinical practice

Introducción: La integración de la inteligencia artificial (IA) en la educación médica redefine paradigmas, optimiza méto-dos y forja una simbiosis tecnológica. Desarrollo: La IA potencia simulaciones clínicas, mejora evaluaciones y desarrolla habilidades blandas, redefiniendo lainteracción médico-paciente. Conclusiones: Aunque persisten desafíos éticos, la colaboración interdisciplinaria y la adaptabilidad son cruciales. La IA marca un hito en la evolución médica al elevar la calidad asistencial y establecer estándares para una colaboración armoniosa entre tecnología y compasión.(AU)

Introduction: The incorporation of artificial intelligence (AI) into medical education redefines paradigms, optimisesmethods and forges a technological symbiosis. Development: AI enhances clinical simulations, improves assessments and develops soft skills, thereby redefining doctor-patient interaction. Conclusions: Although ethical challenges remain, interdisciplinary collaboration and adaptability are crucial. AI marks a milestone in the evolution of medicine by raising the quality of care and setting standards for harmonious collaboration between technology and compassion.(AU)

Percepción de los estudiantes sobre el uso del portafolio digital en prácticas clínicas intermedias de kinesiología / Student’s self-perception on the use of the e-portfolio in intermediate clinical practices of kinesiology

Introducción: El portafolio es un instrumento de aprendizaje y de evaluación que permite a los estudiantes conocer cómo se desarrolla su aprendizaje y autoevaluarse. Objetivo. Describir la percepción de estudiantes de kinesiología respecto al uso de un portafolio digital como instrumento didáctico en el desarrollo de prácticas intermedias. Sujetos y métodos: Estudio observacional, descriptivo, que busca describir la percepción de estudiantes de kinesiología frente al uso de un portafolio digital en el desarrollo y seguimiento de prácticas intermedias de la actividad curricular de geriatría. Resultados: En general, para las dimensiones que evalúan la percepción de los estudiantes en esta metodología docente y evaluativa, un 72% reconoce que los materiales de aprendizaje son muy buenos, seguidos de la dimensión sistema de tutorías, con un 53% de las respuestas de forma satisfactoria, y la de los recursos de la plataforma en línea, con un 42% que la conceptualiza como buena. Conclusiones: La percepción de los estudiantes se describe como positiva en los distintos ítems de evaluación de la estrategia didáctica.(AU)

Introduction: The portfolio is a tool that allows students to account for their learning and assessment processes. Objective: To describe the self-perception of kinesiology students regarding the use of the e-portfolio as a didactic tool for the development of intermediate practices. Subjects and methods. Observational study that aims to describe the self-perception of kinesiology students regarding the use of e-portfolios for the development and monitoring of intermediate practices of the geriatric’s curricular activity. Results: In general, regarding the dimensions that evaluate the self-perception of the students on this learning and assessment tool, a 72% recognize that the learning materials are very good, followed by the tutorial system dimension with a 53% of the responses as satisfactory and the resources of the online platform with a 42% considering the latter as good. Conclusions: The self-perception of the students is described as positive in the different items of evaluation of the didactic strategy.(AU)

HIV Pre-Exposure Prophylaxis Education in Family Medicine Clerkships: A CERA Study.

BACKGROUND AND OBJECTIVES: Little is known about human immunodeficiency virus (HIV) pre-exposure prophylaxis (PrEP) education in family medicine clerkships during medical school. Our study aimed to describe coverage of PrEP education in family medicine clerkships and explore barriers if this education was absent. METHODS: Data were collected through the 2023 Council of Academic Family Medicine (CAFM) Education Research Alliance (CERA) Family Medicine Clerkship Director Survey. We inquired about provision of PrEP to patients, faculty expertise with PrEP, PrEP curriculum in the clerkship, barriers to including PrEP in the clerkship curriculum, and willingness of directors to add PrEP online modules to the clerkship if available. RESULTS: The response rate was 56.8% (96/169). Nine participants did not complete the PrEP questions and were excluded from analyses. Nearly two-thirds of clerkship directors perceived PrEP as an important topic in the family medicine clerkship; however, only one-third of clerkships included PrEP curriculum through clinical experiences (58.5%), didactics (17.1%), or both (14.6%). Barriers to including PrEP were lack of time in the curriculum (63.5%) and having other more important topics to cover (25.7%), but 38.9% said they would include PrEP in the clerkship if free online modules were available. CONCLUSIONS: Clerkships were more likely to include PrEP curriculum in the family medicine clerkship if they had faculty with sufficient expertise or if clerkship directors believed it was important to teach PrEP in the curriculum. Offering accessible educational content can enhance educational opportunities on PrEP for medical students.

Evaluation of bias and gender/racial concordance based on sentiment analysis of narrative evaluations of clinical clerkships using natural language processing.

There is increasing interest in understanding potential bias in medical education. We used natural language processing (NLP) to evaluate potential bias in clinical clerkship evaluations. Data from medical evaluations and administrative databases for medical students enrolled in third-year clinical clerkship rotations across two academic years. We collected demographic information of students and faculty evaluators to determine gender/racial concordance (i.e., whether the student and faculty identified with the same demographic). We used a multinomial log-linear model for final clerkship grades, using predictors such as numerical evaluation scores, gender/racial concordance, and sentiment scores of narrative evaluations using the SentimentIntensityAnalyzer tool in Python. 2037 evaluations from 198 students were analyzed. Statistical significance was defined as P < 0.05. Sentiment scores for evaluations did not vary significantly by student gender, race, or ethnicity (P = 0.88, 0.64, and 0.06, respectively). Word choices were similar across faculty and student demographic groups. Modeling showed narrative evaluation sentiment scores were not predictive of an honors grade (odds ratio [OR] 1.23, P = 0.58). Numerical evaluation average (OR 1.45, P < 0.001) and gender concordance between faculty and student (OR 1.32, P = 0.049) were significant predictors of receiving honors. The lack of disparities in narrative text in our study contrasts with prior findings from other institutions. Ongoing efforts include comparative analyses with other institutions to understand what institutional factors may contribute to bias. NLP enables a systematic approach for investigating bias. The insights gained from the lack of association between word choices, sentiment scores, and final grades show potential opportunities to improve feedback processes for students.

Evaluating The Role of ChatGPT as a Study Aid in Medical Education in Surgery.

OBJECTIVE: Our aim was to assess how ChatGPT compares to Google search in assisting medical students during their surgery clerkships. DESIGN: We conducted a crossover study where participants were asked to complete 2 standardized assessments on different general surgery topics before and after they used either Google search or ChatGPT. SETTING: The study was conducted at the Perelman School of Medicine at the University of Pennsylvania (PSOM) in Philadelphia, Pennsylvania. PARTICIPANTS: 19 third-year medical students participated in our study. RESULTS: The baseline (preintervention) performance of participants on both quizzes did not differ between the Google search and ChatGPT groups (p = 0.728). Students overall performed better postintervention and the difference in test scores was statistically significant for both the Google group (p < 0.001) and the ChatGPT group (p = 0.01). The mean percent increase in test scores pre- and postintervention was higher in the Google group at 11% vs. 10% in the ChatGPT group, but this difference was not statistically significant (p = 0.87). Similarly, there was no statistically significant difference in postintervention scores on both assessments between the 2 groups (p = 0.508). Postassessment surveys revealed that all students (100%) have known about ChatGPT before, and 47% have previously used it for various purposes. On a scale of 1 to 10 with 1 being the lowest and 10 being the highest, the feasibility of ChatGPT and its usefulness in finding answers were rated as 8.4 and 6.6 on average, respectively. When asked to rate the likelihood of using ChatGPT in their surgery rotation, the answers ranged between 1 and 3 ("Unlikely" 47%), 4 to 6 ("intermediate" 26%), and 7 to 10 ("likely" 26%). CONCLUSION: Our results show that even though ChatGPT was comparable to Google search in finding answers pertaining to surgery questions, many students were reluctant to use ChatGPT for learning purposes during their surgery clerkship.