Analysis of virtual standardized patients for assessing clinical fundamental skills of medical students: a prospective study.

BACKGROUND: History-taking is an essential clinical competency for qualified doctors. The limitations of the standardized patient (SP) in taking history can be addressed by the virtual standardized patient (VSP). This paper investigates the accuracy of virtual standardized patient simulators and evaluates the applicability of the improved system's accuracy for diagnostic teaching support and performance assessment. METHODS: Data from the application of VSP to medical residents and students were gathered for this prospective study. In a human-machine collaboration mode, students completed exams involving taking SP histories while VSP provided real-time scoring. Every participant had VSP and SP scores. Lastly, using the voice and text records as a guide, the technicians will adjust the system's intention recognition accuracy and speech recognition accuracy. RESULTS: The research revealed significant differences in scoring across several iterations of VSP and SP (p < 0.001). Across various clinical cases, there were differences in application accuracy for different versions of VSP (p < 0.001). Among training groups, the diarrhea case showed significant differences in speech recognition accuracy (Z = -2.719, p = 0.007) and intent recognition accuracy (Z = -2.406, p = 0.016). Scoring and intent recognition accuracy improved significantly after system upgrades. CONCLUSION: VSP has a comprehensive and detailed scoring system and demonstrates good scoring accuracy, which can be a valuable tool for history-taking training.

Physicians' Knowledge, Attitudes, and Practice of Occupational Diseases Diagnosis and Occupational History Taking.

OBJECTIVES: This cross-sectional study assessed physicians' knowledge and attitudes toward occupational diseases, their practice of occupational history taking, and the associated factors and barriers. METHODS: From January 1 to June 30, 2023, Egyptian physicians from different specialties (n = 278) completed a questionnaire including sociodemographic and occupational data, questions measuring knowledge, attitudes, practice, and barriers. RESULTS: The significant predictor of low knowledge was the nonuse of a standard history form. The lack of undergraduate education/postgraduate training in occupational diseases was the predictor of unfavorable attitudes and poor practice. Unfavorable attitudes also predicted poor practice. The main barriers were insufficient knowledge and busy schedules. CONCLUSIONS: Different specialties physicians are essential in recognizing occupational diseases. They need to be knowledgeable about occupational diseases within their specialties. Specialized undergraduate and postgraduate training in this topic can help achieve such needs.

An updated medical history form for people living with diabetes mellitus.

The two-way link between diabetes mellitus and periodontitis is well-recognised, that there is an increased risk of periodontitis for diabetics and is probably related to inflammatory reactions, although further work is required to confirm this hypothesis.Traditionally, dentists have asked their patients if they are diabetic with a simple yes/no question. As more people become diabetic and often have associated complex health problems, this is insufficient information. Glycated haemoglobin levels have been shown to be important in defining diabetic risks. Dentists should be aware of their significance and ask for these results as a matter of routine. More comprehensive questions are suggested.

Assessing the Ability of a Large Language Model to Score Free-Text Medical Student Clinical Notes: Quantitative Study.

Background: Teaching medical students the skills required to acquire, interpret, apply, and communicate clinical information is an integral part of medical education. A crucial aspect of this process involves providing students with feedback regarding the quality of their free-text clinical notes. Objective: The goal of this study was to assess the ability of ChatGPT 3.5, a large language model, to score medical students' free-text history and physical notes. Methods: This is a single-institution, retrospective study. Standardized patients learned a prespecified clinical case and, acting as the patient, interacted with medical students. Each student wrote a free-text history and physical note of their interaction. The students' notes were scored independently by the standardized patients and ChatGPT using a prespecified scoring rubric that consisted of 85 case elements. The measure of accuracy was percent correct. Results: The study population consisted of 168 first-year medical students. There was a total of 14,280 scores. The ChatGPT incorrect scoring rate was 1.0%, and the standardized patient incorrect scoring rate was 7.2%. The ChatGPT error rate was 86%, lower than the standardized patient error rate. The ChatGPT mean incorrect scoring rate of 12 (SD 11) was significantly lower than the standardized patient mean incorrect scoring rate of 85 (SD 74; P=.002). Conclusions: ChatGPT demonstrated a significantly lower error rate compared to standardized patients. This is the first study to assess the ability of a generative pretrained transformer (GPT) program to score medical students' standardized patient-based free-text clinical notes. It is expected that, in the near future, large language models will provide real-time feedback to practicing physicians regarding their free-text notes. GPT artificial intelligence programs represent an important advance in medical education and medical practice.

A Language Model-Powered Simulated Patient With Automated Feedback for History Taking: Prospective Study.

BACKGROUND: Although history taking is fundamental for diagnosing medical conditions, teaching and providing feedback on the skill can be challenging due to resource constraints. Virtual simulated patients and web-based chatbots have thus emerged as educational tools, with recent advancements in artificial intelligence (AI) such as large language models (LLMs) enhancing their realism and potential to provide feedback. OBJECTIVE: In our study, we aimed to evaluate the effectiveness of a Generative Pretrained Transformer (GPT) 4 model to provide structured feedback on medical students' performance in history taking with a simulated patient. METHODS: We conducted a prospective study involving medical students performing history taking with a GPT-powered chatbot. To that end, we designed a chatbot to simulate patients' responses and provide immediate feedback on the comprehensiveness of the students' history taking. Students' interactions with the chatbot were analyzed, and feedback from the chatbot was compared with feedback from a human rater. We measured interrater reliability and performed a descriptive analysis to assess the quality of feedback. RESULTS: Most of the study's participants were in their third year of medical school. A total of 1894 question-answer pairs from 106 conversations were included in our analysis. GPT-4's role-play and responses were medically plausible in more than 99% of cases. Interrater reliability between GPT-4 and the human rater showed "almost perfect" agreement (Cohen κ=0.832). Less agreement (κ<0.6) detected for 8 out of 45 feedback categories highlighted topics about which the model's assessments were overly specific or diverged from human judgement. CONCLUSIONS: The GPT model was effective in providing structured feedback on history-taking dialogs provided by medical students. Although we unraveled some limitations regarding the specificity of feedback for certain feedback categories, the overall high agreement with human raters suggests that LLMs can be a valuable tool for medical education. Our findings, thus, advocate the careful integration of AI-driven feedback mechanisms in medical training and highlight important aspects when LLMs are used in that context.

Elder abuse and neglect: making the diagnosis and devising a treatment plan in the emergency department.

The prevalence of elder abuse and neglect is trending upward among American seniors, but physician reports of suspected maltreatment are not keeping pace. The most important step in management of elder abuse and neglect is making the diagnosis and reporting the suspicions to Adult Protective Services. This review presents a systematic approach for emergency department diagnosis of elder abuse and neglect, including a thorough history and physical examination combined with the use of standardized validated screening tools. To better assess and treat victims of suspected abuse, physicians can also employ a multidisciplinary team or recruit available resources in the hospital and the community, such as case managers, social workers, and primary care providers to create safety plans for at-risk elders.

Impact of Simulation Training on Core Skill Competency of Undergraduate Medical Students.

INTRODUCTION: Simulation based medical training (SBMT) is gaining traction for undergraduate learning and development. We designed, implemented, and independently assessed the impact of an SBMT programme on competency in surgical history taking and clinical examination for senior clinical students. METHODS: With institutional ethical approval and initial pilot study of student volunteers that ensured format appropriateness, we implemented an SBMT programme weekly for ten weeks during the core surgery module of our Medicine degree programme. Groups of 5 students collaboratively undertook an observed focused history and physical examination while simultaneously directing care on a simulated surgical patient (actor) with acute abdominal pain. This was conducted in a nonclinical, standardised, tutor-supervised environment and followed by a group debriefing led by both the simulated patient and tutor discussing student interaction and competency. All students undertook Southampton Medical Assessment Tool (SMAT) on a surgical inpatient prior to (baseline) and within 2 weeks after SBMT. Students without simulation training functioned as a control group and randomized cluster sampling was utilised for group selection. Second assessments were by independent surgical academics blinded to student group. Feedback was collected via anonymous questionnaire from those who undertook SBMT. RESULTS: One hundred students took part, fifty of whom undertook SBMT. Global mean SMAT scores were similar between the control and intervention group at baseline (p > 0.05). Scores on the second assessment were significantly higher (p = 0.0006) for those who had undertaken SBMT vs. controls; 94% of students taking SBMT reported benefit via questionnaire with 85% stating increased confidence in history-taking and 78% reporting improved abdominal examination. CONCLUSIONS: Undergraduate simulation training at scale is feasible and positively impacts undergraduate student core task competency.

Significance of family history of cholelithiasis in a Pakistani population: A single center, descriptive cross-sectional study.

Linkage studies have indicated a potential genetic predisposition to cholelithiasis. This study aims to determine the frequency of positive family history of gallstone disease in patients presenting with gallstones in a Pakistani population. A descriptive, cross-sectional study was conducted at the surgical department of the University of Lahore Teaching Hospital from June 30, 2023 to August 30, 2023. A total of 102 radiologically confirmed cholelithiasis patients were enrolled. Out of 102 participants, 75.5% (n = 77) were females, with a mean age at presentation of 42.1 ±â€…12.1 years. The study found that 32.4% (n = 33) of participants had a single family member with gallstones, 3.9% (n = 4) had 2 family members affected, and 1% (n = 1) had 3 family members affected. The attributable risk of genetics from our study was 37.2%. Additionally, there was no significant association between positive family history and earlier onset of disease. A significant percentage of Pakistani population may have gallstone disease due to genetic factors.

Evaluating a medication history-taking entrustable professional activity and its assessment tool - Survey of a statewide public hospital pharmacy service.

INTRODUCTION: Entrustable Professional Activities (EPAs) are tasks that professionals within a field perform autonomously. EPAs are incorporated in workplace-based assessment tools to assist training and professional development. Few studies have evaluated medication history-taking EPAs use in pharmacy practice and none have sought stakeholder feedback on their use. This study evaluates the quality of the medication history-taking EPA utilized in South Australian public hospitals and the usability of its assessment tool. METHODS: A voluntary online questionnaire was conducted from July 15th to September 2nd 2021 to gather the opinions of stakeholders on the use of the medication history-taking EPA. The questionnaire was developed based on tools identified in the literature and utilized 14 open-text and five-point Likert scale questions. The questionnaire was distributed using Survey Monkey® to a purposive sample of staff and students. RESULTS: 82 responses were received from 218 surveys distributed, yielding a response rate of 38%. Respondents believed the EPA promotes learner development (90.6%) and the provision of useful feedback (83%). 94.3% considered the EPA to be easy to use but only 56.6% indicated that using it fits easily within their workday. Time constraints and the presence of context-specific descriptors were commonly perceived as limitations. Some stakeholders indicated a lack of understanding of entrustment decisions. CONCLUSION: The EPA and its assessment tool were perceived to have good quality and usability. Reducing the length of the tool, broadening its applicability across contexts, and improving user understanding of entrustment decision-making may support better use of the tool.

Genetic analysis and family screening for dilated cardiomyopathy: a retrospective analysis of the stepwise pedigree approach.

AIMS: This study aimed to assess the practicality of using a stepwise pedigree-based approach to differentiate between familial and sporadic Dilated Cardiomyopathy (DCM), while also considering timing of the genetic analysis. The analysis includes an examination of the extent to which complete family investigations were conducted in real-world scenarios as well as the length of the investigation. METHODS: The stepwise pedigree approach involved conducting a comprehensive family history spanning 3 to 4 generations, reviewing medical records of relatives, and conducting clinical screening using echocardiography and electrocardiogram on first-degree relatives. Familial DCM was diagnosed when at least 2 family members were found to have DCM, and genetic analysis was considered as an option. This study involved a manual review of all DCM investigations conducted at the Centre of Cardiovascular Genetics at Umeå University Hospital, where the stepwise pedigree approach has been employed since 2007. RESULTS: The investigation process had a mean duration of 643 days (95% CI 560.5-724.9). Of the investigations preformed, 94 (68%) were complete, 12 (9%) were ongoing, and 33 (24%) were prematurely terminated and thus incomplete. At the conclusion of the investigations, 55 cases (43%) were classified as familial DCM, 50 (39%) as sporadic DCM, and 22 (18%) remained unassessed due to incomplete pedigrees. Among the familial cases, genetic verification was achieved in 40%. CONCLUSION: The stepwise pedigree approach is time consuming, and the investigations are often incomplete which may suggest that a more direct approach to genetic analysis, may be warranted.

Healthcare leaders' experiences of implementing artificial intelligence for medical history-taking and triage in Swedish primary care: an interview study.

BACKGROUND: Artificial intelligence (AI) holds significant promise for enhancing the efficiency and safety of medical history-taking and triage within primary care. However, there remains a dearth of knowledge concerning the practical implementation of AI systems for these purposes, particularly in the context of healthcare leadership. This study explores the experiences of healthcare leaders regarding the barriers to implementing an AI application for automating medical history-taking and triage in Swedish primary care, as well as the actions they took to overcome these barriers. Furthermore, the study seeks to provide insights that can inform the development of AI implementation strategies for healthcare. METHODS: We adopted an inductive qualitative approach, conducting semi-structured interviews with 13 healthcare leaders representing seven primary care units across three regions in Sweden. The collected data were subsequently analysed utilizing thematic analysis. Our study adhered to the Consolidated Criteria for Reporting Qualitative Research to ensure transparent and comprehensive reporting. RESULTS: The study identified implementation barriers encountered by healthcare leaders across three domains: (1) healthcare professionals, (2) organization, and (3) technology. The first domain involved professional scepticism and resistance, the second involved adapting traditional units for digital care, and the third inadequacies in AI application functionality and system integration. To navigate around these barriers, the leaders took steps to (1) address inexperience and fear and reduce professional scepticism, (2) align implementation with digital maturity and guide patients towards digital care, and (3) refine and improve the AI application and adapt to the current state of AI application development. CONCLUSION: The study provides valuable empirical insights into the implementation of AI for automating medical history-taking and triage in primary care as experienced by healthcare leaders. It identifies the barriers to this implementation and how healthcare leaders aligned their actions to overcome them. While progress was evident in overcoming professional-related and organizational-related barriers, unresolved technical complexities highlight the importance of AI implementation strategies that consider how leaders handle AI implementation in situ based on practical wisdom and tacit understanding. This underscores the necessity of a holistic approach for the successful implementation of AI in healthcare.

Assessment and examination of the respiratory system.

This article aims to outline the fundamental principles of consultations with and clinical assessments of patients with symptoms that may be indicative of respiratory system pathology. The article explores how to perform a respiratory system-focused patient history and physical examination. An evaluation of clinical 'red flags' to reduce the risk of omitting serious illness is also considered, alongside the exploration of features of respiratory pathology and evidence-based clinical decision-making tools that may be used to support clinical diagnosis.

Pattern, Clinical Characteristics, and Impact of Family History on Prostate-Specific Antigen in Prostate Cancer: A Multicenter Study.

Prostate cancer (PCa) is a major cause of illness and death in men of Sub-Sahara African origin. The study assessed the pattern of PCa, the effect of family history on PSA at diagnosis, and clinical characteristics of PCa in Nigeria. A cross-sectional survey of 200 participants was performed within a 12-month period in Nigeria. Data were collected through patients' interview and hospital records and analyzed using SPSS version 25. Descriptive and inferential statistics were performed. P values <.05 were significant. Mean age of 68.5 years was observed among the 200 study participants. Only 64 (32.0%) had a positive immediate family history of PCa, and 61 (30.5%) were not aware of their family cancer history. Most patients 140 (70.0%) had lower urinary tract symptom (LUTS)/lower back pain/leg pain, and the average Gleason score was 7.55 (±0.876). Symptoms of LUTS/lower back pain mostly occurred in patients between 58 and 79 years, while LUTS/leg pain was more common in persons between 60 and 84. Average PSA differed among participants; persons with no family cancer history (M = 143.989; 95% confidence interval [CI] = 114.849-173.129), family history of PCa (M = 165.463; 95% CI = 131.435), family history of cervical cancer (M = 133.456; 95% CI = 49.335-217.576), and persons with no knowledge of their family cancer history (M = 121.546; 95% CI = 89.234-153.857). Univariate one-way (F-Tests) showed that family history of cancer had no significant impact on patients' PSA (R2 = 0.017; adjusted R2 = 0.002; df = 3; F = 1.154; p = .329) at diagnosis. PCa mostly occurred in men within 60 to 70 years of age, and family history of cancer did not predict PSA at diagnosis. Patients presented to health facilities at advanced or metastatic stages. These findings highlight the need for policies and strategies that encourage early PCa screening.

User experience of a family health history chatbot: A quantitative analysis.

OBJECTIVE: Family health history (FHx) is an important tool in assessing one's risk towards specific health conditions. However, user experience of FHx collection tools is rarely studied. ItRunsInMyFamily.com (ItRuns) was developed to assess FHx and hereditary cancer risk. This study reports a quantitative user experience analysis of ItRuns. METHODS: We conducted a public health campaign in November 2019 to promote FHx collection using ItRuns. We used software telemetry to quantify abandonment and time spent on ItRuns to identify user behaviors and potential areas of improvement. RESULTS: Of 11,065 users who started the ItRuns assessment, 4305 (38.91%) reached the final step to receive recommendations about hereditary cancer risk. Highest abandonment rates were during Introduction (32.82%), Invite Friends (29.03%), and Family Cancer History (12.03%) subflows. Median time to complete the assessment was 636 s. Users spent the highest median time on Proband Cancer History (124.00 s) and Family Cancer History (119.00 s) subflows. Search list questions took the longest to complete (median 19.50 s), followed by free text email input (15.00 s). CONCLUSION: Knowledge of objective user behaviors at a large scale and factors impacting optimal user experience will help enhance the ItRuns workflow and improve future FHx collection.

Speed and Accuracy of Recording Medication History by Pharmacists in Secondary Emergency Rooms.

In Japan, only few hospitals have pharmacists in their secondary emergency rooms to record medication history and provide drug information in real time. In this study, we investigated the benefits of pharmacist intervention in secondary emergency rooms by comparing the time taken by the pharmacists and non-pharmacists in the emergency room to record the medication history in the electronic medical record and the accuracy of its content. The study period was from September 1 to September 30, 2022, and included patients who were transported to our hospital for emergency care between 9:00 and 16:30. We compared the time taken between the patient's arrival until the recording of their medication history and the accuracy of the record by the emergency room pharmacists and non-pharmacists (paramedics or medical clerks). The study included 58 patients whose medication histories were collected by pharmacists, and 11 patients whose histories were collected by non-pharmacists. For pharmacists, the median time to record medication history in the electronic medical record was 12 min, whereas for non-pharmacists, it was 19 min, which was significantly different (p=0.015). The pharmacists accurately recorded the medication history of 98.3% (57/58) of patients, whereas non-pharmacists accurately recorded it for only 54.5% (6/11) of patients, with a significant difference (p<0.01). We observed that in secondary emergency rooms, when pharmacists were responsible for recording the patients' medication histories, it resulted in rapid and accurate sharing of medication history.

The accuracy of self-reported family history in glaucoma in Brazil.

PURPOSE: To evaluate the accuracy of a positive self-reported glaucoma family history. MATERIAL AND METHODS: Cross-sectional study. Each subject was asked if they had a first-degree relative diagnosed with glaucoma. If their answer was affirmative, the relative was invited to attend on ophthalmic evaluation and underwent complementary exams to confirm or exclude the glaucoma diagnosis. Only one relative was included per subject. RESULTS: We included 204 subjects in the study (102 subjects and their respective relatives). The accuracy of family history of glaucoma was 76.96% of the cases. In the univariable analysis, subjects with college degree had 2.34 [(P = 0.010; 95% confidence interval (CI) 1.18-4.63)], with higher family income 3.72 (P = 0.003; 95% CI 1.57-8.85) and those with health insurance 3.42 (P = 0.001; 95% CI 1.67-6.98) more chances to have a true positive family history for glaucoma. In the multivariable logistic regression analysis, none of the variables presented significant association. CONCLUSION: Around 24% of patients may not provide reliable information about family history for glaucoma. When asking about a glaucoma family history, clinicians should consider the real accuracy of this self-reported data.

Opportunities for Improving Detection of Cancer Predisposition Syndromes in Pediatric Solid Tumor Patients.

BACKGROUND: Detection of cancer predisposition syndromes (CPS) depends on identifying risk factors, including tumor type, family history, and physical findings, to prompt referral for genetic counseling/testing. Whether pediatric oncology providers (POPs) collect adequate family history information is unknown. METHODS: A single-institution retrospective chart review of solid tumor patients <18 years of age referred for a CPS evaluation between January 1, 2017 and January 31, 2019 was performed. POP adherence to American Society of Clinical Oncology (ASCO) family history collection recommendations was measured and compared with genetic counselor performance. Whether sufficient family history was documented to satisfy the criteria of three genetic counseling referral guidelines [American College of Medical Genetics (ACMG), updated Jongmans (UJ), and McGill Interactive Pediatric OncoGenetic Guidelines (MIPOGG)] was evaluated. RESULTS: POPs and genetic counselors achieved all 6 ASCO family history metrics in 3% and 99% of 129 eligible cases, respectively. POPs failed to document sufficient family history to satisfy genetic counseling referral criteria in most cases (74% ACMG, 73% UJ, 79% MIPOGG). CONCLUSIONS: POPs perform poorly in family history collection, raising concern that some patients at risk for a CPS based on their family history may not be referred for genetic counseling/testing. Interventions to improve family history collection are needed to enhance CPS detection.