The performance of artificial intelligence chatbot large language models to address skeletal biology and bone health queries.

Artificial intelligence (AI) chatbots utilizing large language models (LLMs) have recently garnered significant interest due to their ability to generate humanlike responses to user inquiries in an interactive dialog format. While these models are being increasingly utilized to obtain medical information by patients, scientific and medical providers, and trainees to address biomedical questions, their performance may vary from field to field. The opportunities and risks these chatbots pose to the widespread understanding of skeletal health and science are unknown. Here we assess the performance of 3 high-profile LLM chatbots, Chat Generative Pre-Trained Transformer (ChatGPT) 4.0, BingAI, and Bard, to address 30 questions in 3 categories: basic and translational skeletal biology, clinical practitioner management of skeletal disorders, and patient queries to assess the accuracy and quality of the responses. Thirty questions in each of these categories were posed, and responses were independently graded for their degree of accuracy by four reviewers. While each of the chatbots was often able to provide relevant information about skeletal disorders, the quality and relevance of these responses varied widely, and ChatGPT 4.0 had the highest overall median score in each of the categories. Each of these chatbots displayed distinct limitations that included inconsistent, incomplete, or irrelevant responses, inappropriate utilization of lay sources in a professional context, a failure to take patient demographics or clinical context into account when providing recommendations, and an inability to consistently identify areas of uncertainty in the relevant literature. Careful consideration of both the opportunities and risks of current AI chatbots is needed to formulate guidelines for best practices for their use as source of information about skeletal health and biology.

Artificial intelligence chatbots are increasingly used as a source of information in health care and research settings due to their accessibility and ability to summarize complex topics using conversational language. However, it is still unclear whether they can provide accurate information for questions related to the medicine and biology of the skeleton. Here, we tested the performance of three prominent chatbots­ChatGPT, Bard, and BingAI­by tasking them with a series of prompts based on well-established skeletal biology concepts, realistic physician­patient scenarios, and potential patient questions. Despite their similarities in function, differences in the accuracy of responses were observed across the three different chatbot services. While in some contexts, chatbots performed well, and in other cases, strong limitations were observed, including inconsistent consideration of clinical context and patient demographics, occasionally providing incorrect or out-of-date information, and citation of inappropriate sources. With careful consideration of their current weaknesses, artificial intelligence chatbots offer the potential to transform education on skeletal health and science.

Vitamin D and SARS-CoV-2 Infection: SERVE Study (SARS-CoV-2 Exposure and the Role of Vitamin D among Hospital Employees).

BACKGROUND: Recognition of the role of vitamin D in immune function has led to interest in its relationship with SARS-CoV-2 infection. Although clinical studies to date have had conflicting results, many individuals currently take high doses of vitamin D to prevent infection. OBJECTIVE: The goal of this study was to investigate the relationship between serum 25-hydroxyvitamin D (25OHD) and vitamin D supplement use with incident SARS-CoV-2 infection. METHODS: In this prospective cohort study, 250 health care workers were enrolled at a single institution and observed for 15 mo. Participants completed questionnaires every 3 mo regarding new SARS-CoV-2 infection, vaccination, and supplement use. Serum was drawn at baseline, 6, and 12 mo for 25OHD and SARS-CoV-2 nucleocapsid antibodies. RESULTS: The mean age of the participants was 40 y, BMI 26 kg/m2, 71% were Caucasian, and 78% female. Over 15 mo, 56 participants (22%) developed incident SARS-CoV-2 infections. At baseline, ∼50% reported using vitamin D supplements (mean daily dose 2250 units). Mean serum 25OHD was 38 ng/mL. Baseline 25OHD did not predict incident SARS-CoV-2 infection (OR: 0.98; 95% CI: 0.80, 1.20). Neither the use of vitamin D supplements (OR: 1.18; 95% CI: 0.65, 2.14) or supplement dose was associated with incident infection (OR: 1.01 per 100-units increase; 95% CI: 0.99, 1.02). CONCLUSION: In this prospective study of health care workers, neither serum 25OHD nor the use of vitamin D supplements was associated with the incident SARS-CoV-2 infection. Our findings argue against the common practice of consuming high-dose vitamin D supplements for the presumed prevention of COVID-19.