Your browser doesn't support javascript.
loading
Artificial intelligence chatbots as sources of patient education material for obstructive sleep apnoea: ChatGPT versus Google Bard.
Cheong, Ryan Chin Taw; Unadkat, Samit; Mcneillis, Venkata; Williamson, Andrew; Joseph, Jonathan; Randhawa, Premjit; Andrews, Peter; Paleri, Vinidh.
Afiliação
  • Cheong RCT; Otolaryngology-Head and Neck Surgery Department, The Royal Marsden NHS Foundation Trust, Fulham Road, London, SW3 6JJ, UK. ryan.cheong@nhs.net.
  • Unadkat S; Otolaryngology-Head and Neck Surgery Department, The Royal National ENT and Eastman Dental Hospitals, University College London Hospitals NHS Foundation Trust, London, UK.
  • Mcneillis V; Otolaryngology-Head and Neck Surgery Department, The Royal National ENT and Eastman Dental Hospitals, University College London Hospitals NHS Foundation Trust, London, UK.
  • Williamson A; Otolaryngology-Head and Neck Surgery Department, The Royal Marsden NHS Foundation Trust, Fulham Road, London, SW3 6JJ, UK.
  • Joseph J; Otolaryngology-Head and Neck Surgery Department, The Royal National ENT and Eastman Dental Hospitals, University College London Hospitals NHS Foundation Trust, London, UK.
  • Randhawa P; Otolaryngology-Head and Neck Surgery Department, The Royal National ENT and Eastman Dental Hospitals, University College London Hospitals NHS Foundation Trust, London, UK.
  • Andrews P; Otolaryngology-Head and Neck Surgery Department, The Royal National ENT and Eastman Dental Hospitals, University College London Hospitals NHS Foundation Trust, London, UK.
  • Paleri V; Otolaryngology-Head and Neck Surgery Department, The Royal Marsden NHS Foundation Trust, Fulham Road, London, SW3 6JJ, UK.
Eur Arch Otorhinolaryngol ; 281(2): 985-993, 2024 Feb.
Article em En | MEDLINE | ID: mdl-37917165
PURPOSE: To perform the first head-to-head comparative evaluation of patient education material for obstructive sleep apnoea generated by two artificial intelligence chatbots, ChatGPT and its primary rival Google Bard. METHODS: Fifty frequently asked questions on obstructive sleep apnoea in English were extracted from the patient information webpages of four major sleep organizations and categorized as input prompts. ChatGPT and Google Bard responses were selected and independently rated using the Patient Education Materials Assessment Tool-Printable (PEMAT-P) Auto-Scoring Form by two otolaryngologists, with a Fellowship of the Royal College of Surgeons (FRCS) and a special interest in sleep medicine and surgery. Responses were subjectively screened for any incorrect or dangerous information as a secondary outcome. The Flesch-Kincaid Calculator was used to evaluate the readability of responses for both ChatGPT and Google Bard. RESULTS: A total of 46 questions were curated and categorized into three domains: condition (n = 14), investigation (n = 9) and treatment (n = 23). Understandability scores for ChatGPT versus Google Bard on the various domains were as follows: condition 90.86% vs.76.32% (p < 0.001); investigation 89.94% vs. 71.67% (p < 0.001); treatment 90.78% vs.73.74% (p < 0.001). Actionability scores for ChatGPT versus Google Bard on the various domains were as follows: condition 77.14% vs. 51.43% (p < 0.001); investigation 72.22% vs. 54.44% (p = 0.05); treatment 73.04% vs. 54.78% (p = 0.002). The mean Flesch-Kincaid Grade Level for ChatGPT was 9.0 and Google Bard was 5.9. No incorrect or dangerous information was identified in any of the generated responses from both ChatGPT and Google Bard. CONCLUSION: Evaluation of ChatGPT and Google Bard patient education material for OSA indicates the former to offer superior information across several domains.
Assuntos
Palavras-chave

Texto completo: 1 Base de dados: MEDLINE Assunto principal: Apneia Obstrutiva do Sono / Cirurgiões Idioma: En Ano de publicação: 2024 Tipo de documento: Article

Texto completo: 1 Base de dados: MEDLINE Assunto principal: Apneia Obstrutiva do Sono / Cirurgiões Idioma: En Ano de publicação: 2024 Tipo de documento: Article