Clinical Reasoning Skills Among Second-Phase Medical Students in West Bengal, India: An Exploratory Study.

Introduction Proper application of clinical reasoning skills is essential to reduce diagnostic and management errors. Explicit inclusion of training and assessment of clinical reasoning skills is the demand of time. The study intended to measure the clinical reasoning skills of second-phase undergraduate students in a medical college in West Bengal, India, and its distribution across several individual variables. Methods The clinical reasoning skills of 105 undergraduate medical students were assessed in a cross-sectional exploratory study using key feature questions (KFQs) with the partial credit scoring system. Six case vignettes aligned to the core competencies in the subject of pharmacology, pathology, and microbiology were designed and validated by the subject material experts for this purpose. The responses of the participants were collected through Google Forms (Google, Mountain View, CA) after obtaining written informed consent. The scores obtained in all KFQs were added and expressed in percentage of the maximum attainable score. Results The mean (±SD) clinical reasoning score of the participants was 42.5 (±12.6). Only 29.6% of respondents scored ≥ 50. Students with higher subjective economic status (p-value = 0.01) and perceived autonomy (p-value < 0.001) were more likely to have higher clinical reasoning scores. The marks obtained in previous summative examinations were significantly correlated with clinical reasoning scores. Conclusion Average score < 50.0 and inability to score ≥ 50.0 by more than two-thirds of the participants reflected the deficit in the clinical reasoning skills of second-phase MBBS students. The association of clinical reasoning skills with economic status, autonomy, and previous academic performances needs further exploration.

Performance of ChatGPT vs. HuggingChat on OB-GYN Topics.

Background While large language models show potential as beneficial tools in medicine, their reliability, especially in the realm of obstetrics and gynecology (OB-GYN), is not fully comprehended. This study seeks to measure and contrast the performance of ChatGPT and HuggingChat in addressing OB-GYN-related medical examination questions, offering insights into their effectiveness in this specialized field. Methods ChatGPT and HuggingChat were subjected to two standardized multiple-choice question banks: Test 1, developed by the National Board of Medical Examiners (NBME), and Test 2, gathered from the Association of Professors of Gynecology & Obstetrics (APGO) Web-Based Interactive Self-Evaluation (uWISE). Responses were analyzed and compared for correctness. Results The two-proportion z-test revealed no statistically significant difference in performance between ChatGPT and HuggingChat on both medical examinations. For Test 1, ChatGPT scored 90%, while HuggingChat scored 85% (p = 0.6). For Test 2, ChatGPT correctly answered 70% of questions, while HuggingChat correctly answered 62% of questions (p = 0.4). Conclusion Awareness of the strengths and weaknesses of artificial intelligence allows for the proper and effective use of its knowledge. Our findings indicate that there is no statistically significant difference in performance between ChatGPT and HuggingChat in addressing medical inquiries. Nonetheless, both platforms demonstrate considerable promise for applications within the medical domain.

Assessing Individual Competency Differences Between Third- and Fourth-Year Medical Students Using the National Clinical Assessment Tool for Medical Students in the Emergency Department.

Medical students rotating through emergency departments as part of their clinical education are typically evaluated using an on-shift evaluation tool. The National Clinical Assessment Tool for Medical Students in the Emergency Department (NCAT-EM) is the current standard of evaluation for medical students in the emergency department, regardless of level of training. This study aims to evaluate whether the NCAT-EM can detect differences in skill levels between third-year medical students (MS3s) and fourth-year medical students (MS4s) rotating at a level 1 trauma center and teaching institution. These authors hypothesized that MS4s should outperform MS3s across all assessment domains given their additional training. A total of 930 performance evaluations were gathered for MS3 and MS4 rotating between May 2022 and June 2023. There were 321 evaluations of MS3s and 609 evaluations of MS4s. Across the six assessment domains, MS4s had statistically significant higher performances in two domains - namely emergency recognition and management (fully entrustable: 37.4% vs. 23.8% (p = 0.03)) and communication (fully entrustable: 46.2% vs. 33.6% (p = 0.03)). These findings indicate that the use of the NCAT-EM at this institution reliably differentiated between MS3s and MS4s in these two assessment domains. There were trends suggesting MS4s outperform MS3s in the other four domains, which did not rise to the level of statistical significance, but are consistent with prior validation studies of the NCAT.

Investigating the Skill Development of Medical Students in Focused Assessment With Sonography for Trauma (FAST) Ultrasound: A Comparative Analysis Across Different Stages of Medical Training.

INTRODUCTION: Focused assessment with sonography for trauma (FAST) ultrasound (US) is a valuable medical examination used in trauma settings, particularly for rapid responses to events such as natural disasters. Although the efficacy and benefits of FAST in patient care have been extensively studied, there is limited research on training medical students in FAST. Previous studies have found that medical students can proficiently perform a FAST US after two days of training. However, these studies exclusively included first-year medical students without considering variations in their medical knowledge. Particularly, the advantage of medical students having US experience before undergoing FAST training has not been previously examined. OBJECTIVES: Assess the performance and knowledge acquisition of medical students with and without prior US experience after completing a FAST training course. METHODS: The study included a total of 71 students, consisting of 33 males and 38 females, who were between the ages of 18 and 31, with an average age of 24.6 and a standard deviation of 2.4. The inclusion criteria targeted first- and second-year medical school students who participated on a volunteer basis. Students were divided into two groups: group A, consisting of those without prior US experience, and group B, made up of those who had previous US experience. All students completed a pre-training survey to share their comfort and confidence in US use and knowledge. A baseline FAST exam was conducted to establish initial performance. A comprehensive three-hour training session was then provided. Post-training, students performed another FAST exam to assess improvement, followed by a post-training survey to evaluate comfort and confidence. RESULTS: Medical students who had prior experience in the US (group B) performed significantly better (p<0.01) in both the pre- and post-training FAST exams when compared to students without previous US experience. Specifically, in locating the liver, right kidney, hepatorenal recess, and left kidney, as well as detecting fluid accumulation when in a supine position. Additionally, medical students with prior US experience (group B) exhibited higher baseline confidence (p<0.005-p<0.01) in their ability to perform a FAST exam, as indicated by the results of the pre-testing survey. CONCLUSION: Previous experience with US significantly boosted confidence and knowledge gains following FAST training. This emphasizes the value of including US training in medical school programs after earlier exposure, offering evident benefits. The study reveals the unexplored benefit of having prior US experience for medical students undergoing FAST training, thus addressing a previously unexplored area in current research. The conclusions stress the necessity of integrating US training into medical school curricula after initial exposure. This understanding can direct medical educators in refining the education process, enabling students to be better equipped for real-world medical situations involving FAST.

Exploring the Effect of Yoga on Exercise Endurance As Assessed by Cardiorespiratory Efficiency Tests in Exercise Physiology Laboratory: A Pilot Study.

Background Today's world of cut-throat competition is boggling with stress as the most common problem among the modern generation, and reduction in stress demands a radical solution. Yoga comes as a rescuer that focuses on improving one's physical and spiritual well-being. It can increase one's strength and flexibility. Yoga practitioners have asserted the effect of physical exercise involved in it on balancing physical and spiritual health for decades, but only recently has there been a move to substantiate these claims through research. This study aimed at assessing the effect of yogic practice on exercise endurance and physical fitness as assessed by important physical fitness parameters through cardiorespiratory efficiency tests in an Exercise Physiology Laboratory. Methodology A total of 60 Bachelor of Medicine, Bachelor of Surgery (MBBS) students from a rural medical college in central India were recruited for the study. Thirty MBBS students who had undergone yogic training for six months comprised the trained or the case group, and another group of 30 students comprising the untrained group were recruited for the study from different levels of the course within the age group of 17-25 years. Body mass index (BMI) and body surface area (BSA) were calculated. Resting pulse rate and blood pressure, resting respiratory rate, maximal oxygen consumption (VO2 max), physical fitness index (PFI), breath holding time (BHT), and 40 mm Hg endurance test time was measured.  Results The mean PFI (%) in males was 88.82±5.56 and 96.05±7.44, and that in females was 82.06±8.95 and 96.55±6.47 in the control and case groups, respectively. The mean 40 mm Hg endurance test (in seconds) in males was 36.47±8.45 and 48.88±8.64 and in females was 29.79±10.30 and 38.4±10.69 in the control and test groups, respectively. The mean BHT (in seconds) in males was 44.80±14.18 and 58.91±12.35, and that in females was 42.29±15.37 and 54.60±13.36 as in control and case groups, respectively. The VO2 max evaluated by the modified Harvard step test was 2.41±0.58 L/min in control males and 3.6±0.90 L/min in the case group of males, and it was 2.14±0.49 L/min in the control group of females, and 3.76±0.69 L/min in case group of females. Conclusion By studying the dynamics of the various cardiorespiratory responses, we have determined the values of fitness parameters in the case group. It was found that the yoga group had statistically significantly higher VO2 max per minute and better PFI, BHT, and 40 mm Hg endurance values (p<0.05).

Assessing Clinical Skills Via Telehealth Objective Standardized Clinical Examination: Feasibility, Acceptability, Comparability, and Educational Value.

Introduction: In March 2020, students' in-person clinical assessments paused due to COVID-19. The authors adapted the June Objective Standardized Clinical Examination (OSCE) to a telehealth OSCE to preserve live faculty observation of students' skills and immediate feedback dialogue between students, standardized patients, and faculty members. The authors assessed students' reactions and comparative performance. Materials and Methods: OSCE and telehealth educators used draft Association of American Medical Colleges (AAMC) telehealth competencies to create educational materials and adapt OSCE cases. Students anonymously answered queries about the challenges of the telehealth encounters, confidence in basic telehealth competencies, and educational value of the experience. Cohort-level performance data were compared between the January in-person and June telehealth OSCEs. Results: One hundred sixty students participated in 29 Zoom® two-case telehealth OSCEs, equaling 58 h of assessment time. Survey response rate: 59%. Students indicated moderate challenge in adapting physical examinations to the telehealth format and indicated it to be cognitively challenging. Confidence in telehealth competencies was rated "moderate" to "very," but was most pronounced for the technical aspects of telehealth, rather than safety engagement with a patient. Although authors found no significant difference in cohort-level performance in total scores and history-taking between the OSCEs, physical examination and communication scores differed between the two assessments. Discussion: It was feasible to adapt a standardized OSCE to a telehealth format when in-person clinical skills assessment was impossible. Students rated this necessary innovation positively, and it adequately assessed foundational clinical skills performance. Conclusion: Given future competency needs in telehealth, we suggest several education and training priorities.

Exames de licenciamento em Medicina - uma boa ideia para a formação médica no Brasil? / Medical licensing examinations - are they a good idea for medical education in Brazil? / Exámenes de licencia en Medicina - ¿Una buena idea para la formación médica en Brasil?

A sociedade brasileira vem discutindo, recentemente, a ideia de implementar um exame de licenciamento em Medicina (ELM) para médicos recém-formados no país. Para avaliar a adequação dessa proposta e sua real necessidade, analisa-se neste trabalho se os ELMs estabelecem eficazmente a aptidão dos recém-formados para exercer a Medicina e se os sistemas de avaliação vigentes no ensino médico brasileiro já o fazem. Usando o modelo baseado em competências como referencial, discute-se a experiência da comunidade internacional com os ELMs e as características das avaliações que se propõem a medir, no Brasil, a aptidão dos recém-formados. Conclui-se que, isoladamente, ambas as alternativas são ineficazes para cumprir esse objetivo. Propõe-se o desenvolvimento de um programa mais amplo de avaliação e enfatiza-se a importância da colaboração entre os atores envolvidos para aprimorar a qualidade das avaliações dos médicos recém-formados no Brasil.(AU)

The introduction a medical licensing examination (MLE) for the country's newly qualified doctors has been the subject of discussion recently in Brazil. To assess the suitability of and real need for this test, this article analyzes whether the MLE provides an effective measure of the aptitude of newly qualified doctors and whether the evaluation system currently in place in medical education already does this. Using a competency-based model, we discuss experiences with MLEs in other countries and the features of the examinations proposed in Brazil to measure the aptitudes of newly qualified doctors. It is concluded that, in isolation, both alternatives are inadequate. We propose the development of a broader assessment program and stress the importance of collaboration between the different actors involved in order to enhance the quality of the examinations proposed to test the aptitude of newly qualified doctors in Brazil.(AU)

La sociedad brasileña ha discutido recientemente la idea de implementar un examen de licencia (ELM) para médicos recién graduados en el país. Para evaluar la adecuación de esta propuesta y su real necesidad, se analiza en este trabajo si los ELMs establecen eficazmente la aptitud de los recién graduados para ejercer la Medicina y si los sistemas de evaluación vigentes en la enseñanza médica brasileña ya lo hacen. Usando el modelo basado en competencias como factor referencial, se discute la experiencia de la comunidad internacional con los ELMs y las características de las evaluaciones que se proponen medir, en Brasil, la aptitud de los recién graduados. Se concluye que, aisladamente, ambas alternativas son ineficaces para cumplir ese objetivo. Se propone el desarrollo de un programa más amplio de evaluación y se enfatiza la importancia de la colaboración entre los actores envueltos para perfeccionar la calidad de las evaluaciones de los recién graduados en Brasil.(AU)

Identifying High-Performing Students in Inpatient Clerkships: A Qualitative Study.

OBJECTIVES: Examine fundamental behaviors and characteristics that attending physicians in inpatient settings utilize to identify high-performing clerkship students. METHODS: We employed written comment data from a cross-sectional survey of Internal Medicine and Pediatrics attending physicians at a single academic medical center in the southern USA. Free-text responses regarding factors that faculty consider when assigning honors grades were analyzed by four trained researchers (interrater agreement 0.87) using conventional content analysis to identify themes. RESULTS: Seventy-nine of 141 (56%) attending physicians who were surveyed provided 90 comments.Four major theme areas for recognizing higher performing clerkship students were identified: Taking Ownership of Patient Care (35%), Medical Knowledge and Clinical Reasoning (20%), Team Orientation (15%), and Awareness of Opportunities for Growth and Progress (13%). CONCLUSION: Internal Medicine and Pediatric attending physicians identified characteristics that contributed to four themes in the determination of a high-performing medical student. These findings are particularly salient, as they highlight that commitment to patients, application of clinical knowledge and skills, teamwork, and awareness of growth and progress are valued by attending physicians for identifying top performing students in inpatient settings.

Surgery Clerkship Evaluations Are Insufficient for Clinical Skills Appraisal: The Value of a Medical Student Surgical Objective Structured Clinical Examination.

OBJECTIVE: Optimal methods for medical student assessment in surgery remain elusive. Faculty- and housestaff-written evaluations constitute the chief means of student assessment in medical education. However, numerous studies show that this approach has poor specificity and a high degree of subjectivity. We hypothesized that an objective structured clinical examination (OSCE) in the surgery clerkship would provide additional data on student performance that would confirm or augment other measures of assessment. DESIGN: We retrospectively reviewed data from OSCEs, National Board of Medical Examiners shelf examinations, oral presentations, and written evaluations for 51 third-year Harvard Medical School students rotating in surgery at Massachusetts General Hospital from 2014 to 2015. We expressed correlations between numeric variables in Pearson coefficients, stratified differences between rater groups by one-way analysis of variance, and compared percentages with 2-sample t-tests. We examined commentary from both OSCE and clinical written evaluations through textual analysis and summarized these results in percentages. RESULTS: OSCE scores and clinical evaluation scores correlated poorly with each other, as well as with shelf examination scores and oral presentation grades. Textual analysis of clinical evaluation comments revealed a heavy emphasis on motivational factors and praise, whereas OSCE written comments focused on cognitive processes, patient management, and methods to improve performance. CONCLUSIONS: In this single-center study, an OSCE provided clinical skills data that were not captured elsewhere in the surgery clerkship. Textual analysis of faculty evaluations reflected an emphasis on interpersonal skills, rather than appraisal of clinical acumen. These findings suggest complementary roles of faculty evaluations and OSCEs in medical student assessment.