Your browser doesn't support javascript.
loading
ChatGPT in radiology: A systematic review of performance, pitfalls, and future perspectives.
Keshavarz, Pedram; Bagherieh, Sara; Nabipoorashrafi, Seyed Ali; Chalian, Hamid; Rahsepar, Amir Ali; Kim, Grace Hyun J; Hassani, Cameron; Raman, Steven S; Bedayat, Arash.
Afiliación
  • Keshavarz P; Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles (UCLA), Los Angeles, CA 90095, USA; School of Science and Technology, The University of Georgia, Tbilisi 0171, Georgia.
  • Bagherieh S; Independent Clinical Radiology Researcher, Los Angeles, CA 90024, USA.
  • Nabipoorashrafi SA; Department of Radiology, Cardiothoracic Imaging, University of Washington, Seattle, WA 98195, USA.
  • Chalian H; Department of Radiology, Cardiothoracic Imaging, University of Washington, Seattle, WA 98195, USA.
  • Rahsepar AA; Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles (UCLA), Los Angeles, CA 90095, USA.
  • Kim GHJ; Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles (UCLA), Los Angeles, CA 90095, USA; Department of Radiological Sciences, Center for Computer Vision and Imaging Biomarkers, University of California, Los Angeles (UCLA), Los Angeles, CA 90095,
  • Hassani C; Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles (UCLA), Los Angeles, CA 90095, USA.
  • Raman SS; Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles (UCLA), Los Angeles, CA 90095, USA.
  • Bedayat A; Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles (UCLA), Los Angeles, CA 90095, USA. Electronic address: abedayat@mednet.ucla.edu.
Diagn Interv Imaging ; 105(7-8): 251-265, 2024.
Article en En | MEDLINE | ID: mdl-38679540
ABSTRACT

PURPOSE:

The purpose of this study was to systematically review the reported performances of ChatGPT, identify potential limitations, and explore future directions for its integration, optimization, and ethical considerations in radiology applications. MATERIALS AND

METHODS:

After a comprehensive review of PubMed, Web of Science, Embase, and Google Scholar databases, a cohort of published studies was identified up to January 1, 2024, utilizing ChatGPT for clinical radiology applications.

RESULTS:

Out of 861 studies derived, 44 studies evaluated the performance of ChatGPT; among these, 37 (37/44; 84.1%) demonstrated high performance, and seven (7/44; 15.9%) indicated it had a lower performance in providing information on diagnosis and clinical decision support (6/44; 13.6%) and patient communication and educational content (1/44; 2.3%). Twenty-four (24/44; 54.5%) studies reported the proportion of ChatGPT's performance. Among these, 19 (19/24; 79.2%) studies recorded a median accuracy of 70.5%, and in five (5/24; 20.8%) studies, there was a median agreement of 83.6% between ChatGPT outcomes and reference standards [radiologists' decision or guidelines], generally confirming ChatGPT's high accuracy in these studies. Eleven studies compared two recent ChatGPT versions, and in ten (10/11; 90.9%), ChatGPTv4 outperformed v3.5, showing notable enhancements in addressing higher-order thinking questions, better comprehension of radiology terms, and improved accuracy in describing images. Risks and concerns about using ChatGPT included biased responses, limited originality, and the potential for inaccurate information leading to misinformation, hallucinations, improper citations and fake references, cybersecurity vulnerabilities, and patient privacy risks.

CONCLUSION:

Although ChatGPT's effectiveness has been shown in 84.1% of radiology studies, there are still multiple pitfalls and limitations to address. It is too soon to confirm its complete proficiency and accuracy, and more extensive multicenter studies utilizing diverse datasets and pre-training techniques are required to verify ChatGPT's role in radiology.
Asunto(s)
Palabras clave
Texto completo
Imprimir
XML
PubMed Links
Buscar en Google

Texto completo: 1 Banco de datos: MEDLINE Asunto principal: Radiología Límite: Humans Idioma: En Revista: Diagn Interv Imaging Año: 2024 Tipo del documento: Article País de afiliación: Georgia
Texto completo
Imprimir
XML
PubMed Links
Buscar en Google

Texto completo: 1 Banco de datos: MEDLINE Asunto principal: Radiología Límite: Humans Idioma: En Revista: Diagn Interv Imaging Año: 2024 Tipo del documento: Article País de afiliación: Georgia