Decoding the NCCN Guidelines With AI: A Comparative Evaluation of ChatGPT-4.0 and Llama 2 in the Management of Thyroid Carcinoma.

INTRODUCTION: Artificial Intelligence (AI) has emerged as a promising tool in the delivery of health care. ChatGPT-4.0 (OpenAI, San Francisco, California) and Llama 2 (Meta, Menlo Park, CA) have each gained attention for their use in various medical applications. OBJECTIVE: This study aims to evaluate and compare the effectiveness of ChatGPT-4.0 and Llama 2 in assisting with complex clinical decision making in the diagnosis and treatment of thyroid carcinoma. PARTICIPANTS: We reviewed the National Comprehensive Cancer Network® (NCCN) Clinical Practice Guidelines for the management of thyroid carcinoma and formulated up to 3 complex clinical questions for each decision-making page. ChatGPT-4.0 and Llama 2 were queried in a reproducible manner. The answers were scored on a Likert scale: 5) Correct; 4) correct, with missing information requiring clarification; 3) correct, but unable to complete answer; 2) partially incorrect; 1) absolutely incorrect. Score frequencies were compared, and subgroup analysis was conducted on Correctness (defined as scores 1-2 vs 3-5) and Accuracy (scores 1-3 vs 4-5). RESULTS: In total, 58 pages of the NCCN Guidelines® were analyzed, generating 167 unique questions. There was no statistically significant difference between ChatGPT-4.0 and Llama 2 in terms of overall score (Mann-Whitney U-test; Mean Rank = 160.53 vs 174.47, P = 0.123), Correctness (P = 0.177), or Accuracy (P = 0.891).[Formula: see text]. CONCLUSION: ChatGPT-4.0 and Llama 2 demonstrate a limited but substantial capacity to assist with complex clinical decision making relating to the management of thyroid carcinoma, with no significant difference in their effectiveness.

From Bytes to Best Practices: Tracing ChatGPT-3.5's Evolution and Alignment With the National Comprehensive Cancer Network® Guidelines in Pancreatic Adenocarcinoma Management.

INTRODUCTION: Artificial intelligence continues to play an increasingly important role in modern health care. ChatGPT-3.5 (OpenAI, San Francisco, CA) has gained attention for its potential impact in this domain. OBJECTIVE: To explore the role of ChatGPT-3.5 in guiding clinical decision-making specifically in the context of pancreatic adenocarcinoma and to assess its growth over a period of time. PARTICIPANTS: We reviewed the National Comprehensive Cancer Network® (NCCN) Clinical Practice Guidelines for the Management of Pancreatic Adenocarcinoma and formulated a complex clinical question for each decision-making page. ChatGPT-3.5 was queried in a reproducible fashion. We scored answers on the following Likert scale: 5) Correct; 4) Correct, with missing information requiring clarification; 3) Correct, but unable to complete answer; 2) Partially incorrect; 1) Absolutely incorrect. We repeated this protocol at 3-months. Score frequencies were compared, and subgroup analysis was conducted on Correctness (defined as scores 1-2 vs 3-5) and Accuracy (scores 1-3 vs 4-5). RESULTS: In total, 50-pages of the NCCN Guidelines® were analyzed, generating 50 complex clinical questions. On subgroup analysis, the percentage of Acceptable answers improved from 60% to 76%. The score improvement was statistically significant (Mann-Whitney U-test; Mean Rank = 44.52 vs 56.48, P = .027). CONCLUSION: ChatGPT-3.5 represents an interesting but limited tool for assistance in clinical decision-making. We demonstrate that the platform evolved, and its responses to our standardized questions improved over a relatively short period (3-months). Future research is needed to determine the validity of this tool for this clinical application.

Clinical outcomes and learning curve for ERCP during advanced endoscopy training: a comparison of supine versus prone positioning.

BACKGROUND AND AIMS: No studies have evaluated trainees' outcomes when learning ERCP with patients in the supine and prone positions simultaneously. We aimed to assess whether patient position impacts procedural outcomes and learning curve. METHODS: We prospectively evaluated patients undergoing ERCP by a supervised advanced endoscopy trainee (AET) at a tertiary care center. Adult patients with native papillae were included. The AET was universally given 5 attempts per cannulation. Outcomes were evaluated quarterly. RESULTS: Successful cannulation was achieved in 44 supine (69%) and 17 prone (68%) patients (P = .95). Although mean time to reach the papilla was shorter in the supine patient position, time to biliary cannulation (7.8 vs 9.4 minutes, P = .53) and number of attempts were similar. A stepwise increase was seen in cannulation rates throughout the academic year (P < .01) and increased more in supine patients (P = .01). Procedure and total room times were shorter in supine patients. CONCLUSIONS: Shorter procedure and room turnover times and a comparable cannulation rate were found for supine versus prone ERCP.

The mediating role of residents' wellbeing between program leadership and quality of care: A cross-sectional study.

BACKGROUND: Research has shown that organizational leadership and support affect organizational outcomes in several sectors, including healthcare. However, less is known about how organizational leadership might influence the wellbeing of clinical trainees as well as the quality of their patient care practices. OBJECTIVES: This study examined the mediating effects of burnout and engagement between program director-resident relationship quality and residents' reported quality of care, and the moderating effect of perceived departmental support. METHODS: The authors conducted a cross-sectional study in September 2020, using a 41-item questionnaire, among 20 residency programs in an academic medical center in Lebanon. Measures included program director-resident relationship quality, perceived departmental support, burnout subcomponents, engagement, and self-reported quality of care. Ordinary least squares regression was used to conduct parallel mediation and moderated mediation analyses using SPSS macro-PROCESS, to assess the strength and direction of each of the proposed associations. RESULTS: A total of 95/332 (28.6%) residents responded. Results revealed that program director-resident relationship quality had a significant indirect effect on residents' suboptimal patient care practices and attitudes towards patients, through at least one of the wellbeing dimensions (p < .05). Perceived departmental support did not play a dominant role over program director-resident relationship quality, and thus did not influence any of the mediated relationships. CONCLUSION: Our study adds a new dimension to the body of literature suggesting that program director-resident relationship quality plays an important role in promoting residents' wellbeing and achieving important clinical health outcomes. Such findings imply that the quality of program director-resident relationship could be an important component of residents' wellbeing and patient safety. If further research confirms these associations, it will become imperative to determine what interventions might improve the quality of relationships between program directors and residents.

Risk Factors for Symptomatic Atrial Fibrillation-Analysis of an Outpatient Database.

Atrial fibrillation (AF) is the most common sustained arrhythmia encountered in practice and is the leading cause of debilitating strokes with significant economic burden. It is currently not known whether asymptomatic undiagnosed AF should be treated if detected by various screening methods. Currently, United States guidelines have no recommendations for identifying patients with asymptomatic undiagnosed AF due to lack of evidence. The American Heart Association Center for Health Technology & Innovation undertook a plan to identify tools in 3 phases that may be useful in improving outcomes in patients with undiagnosed AF. In phase I we sought to identify AF risk factors that can be used to develop a risk score to identify high-risk patients using a large commercial insurance dataset. The principal findings of this study show that individuals at high risk for AF are those with advanced age, the presence of heart failure, coronary artery disease, hypertension, metabolic disorders, and hyperlipidemia. Our analysis also found that chronic respiratory failure was a significant risk factor for those over 65 years of age and chronic kidney disease for those less than 65 years of age.