Evaluating the Diagnostic Accuracy and Management Recommendations of ChatGPT in Uveitis.
Ocul Immunol Inflamm
; : 1-6, 2023 Sep 18.
Article
in En
| MEDLINE
| ID: mdl-37722842
INTRODUCTION: Accurate diagnosis and timely management are vital for favorable uveitis outcomes. Artificial Intelligence (AI) holds promise in medical decision-making, particularly in ophthalmology. Yet, the diagnostic precision and management advice from AI-based uveitis chatbots lack assessment. METHODS: We appraised diagnostic accuracy and management suggestions of an AI-based chatbot, ChatGPT, versus five uveitis-trained ophthalmologists, using 25 standard cases aligned with new Uveitis Nomenclature guidelines. Participants predicted likely diagnoses, two differentials, and next management steps. Comparative success rates were computed. RESULTS: Ophthalmologists excelled (60-92%) in likely diagnosis, exceeding AI (60%). Considering fully and partially accurate diagnoses, ophthalmologists achieved 76-100% success; AI attained 72%. Despite an 8% AI improvement, its overall performance lagged. Ophthalmologists and AI agreed on diagnosis in 48% cases, with 91.6% exhibiting concurrence in management plans. CONCLUSIONS: The study underscores AI chatbots' potential in uveitis diagnosis and management, indicating their value in reducing diagnostic errors. Further research is essential to enhance AI chatbot precision in diagnosis and recommendations.
Full text:
1
Collection:
01-internacional
Database:
MEDLINE
Type of study:
Diagnostic_studies
/
Guideline
/
Prognostic_studies
Language:
En
Journal:
Ocul Immunol Inflamm
Journal subject:
ALERGIA E IMUNOLOGIA
/
OFTALMOLOGIA
Year:
2023
Document type:
Article
Affiliation country:
Singapore
Country of publication:
United kingdom