Reliability of artificial intelligence chatbot responses to frequently asked questions in breast surgical oncology.
J Surg Oncol
; 130(2): 188-203, 2024 Aug.
Article
em En
| MEDLINE
| ID: mdl-38837375
ABSTRACT
INTRODUCTION:
Artificial intelligence (AI)-driven chatbots, capable of simulating human-like conversations, are becoming more prevalent in healthcare. While this technology offers potential benefits in patient engagement and information accessibility, it raises concerns about potential misuse, misinformation, inaccuracies, and ethical challenges.METHODS:
This study evaluated a publicly available AI chatbot, ChatGPT, in its responses to nine questions related to breast cancer surgery selected from the American Society of Breast Surgeons' frequently asked questions (FAQ) patient education website. Four breast surgical oncologists assessed the responses for accuracy and reliability using a five-point Likert scale and the Patient Education Materials Assessment (PEMAT) Tool.RESULTS:
The average reliability score for ChatGPT in answering breast cancer surgery questions was 3.98 out of 5.00. Surgeons unanimously found the responses understandable and actionable per the PEMAT criteria. The consensus found ChatGPT's overall performance was appropriate, with minor or no inaccuracies.CONCLUSION:
ChatGPT demonstrates good reliability in responding to breast cancer surgery queries, with minor, nonharmful inaccuracies. Its answers are accurate, clear, and easy to comprehend. Notably, ChatGPT acknowledged its informational role and did not attempt to replace medical advice or discourage users from seeking input from a healthcare professional.Palavras-chave
Texto completo:
1
Base de dados:
MEDLINE
Assunto principal:
Neoplasias da Mama
/
Inteligência Artificial
/
Oncologia Cirúrgica
Limite:
Female
/
Humans
Idioma:
En
Revista:
J Surg Oncol
Ano de publicação:
2024
Tipo de documento:
Article
País de afiliação:
Estados Unidos