Artificial Intelligence Versus Expert Plastic Surgeon: Comparative Study Shows ChatGPT "Wins" Rhinoplasty Consultations: Should We Be Worried?

ABSTRACT

Introduction: Large language models, such as ChatGPT, hold tremendous promise to bridge gaps in patient education and enhance the decision-making resources available online for patients seeking nasal surgery. Objective: To compare the performance of ChatGPT in answering preoperative and postoperative patient questions related to septorhinoplasty. Methods: Two sets of responses were collected for the questions one from an expert rhinoplasty surgeon with over two decades of experience, and the other from ChatGPT-3.5. Seven expert rhinoplasty surgeons, blinded to the source of responses, independently assessed the responses using a 5-point Likert scale in four performance areas empathy, accuracy, completeness, and overall quality. Results: ChatGPT outperformed physician responses in three of the four performance areas, earning significantly higher ratings in accuracy, completeness, and overall quality (p < 0.001). In addition, ChatGPT was overwhelmingly preferred over physician responses (p < 0.001), with evaluators favoring ChatGPT in 80.95% of instances. Conclusions: ChatGPT has demonstrated its remarkable ability to deliver accurate, complete, and high-quality responses to preoperative and postoperative patient questions. Although certain improvements are warranted, this artificial intelligence tool has shown its potential to effectively counsel and educate prospective septorhinoplasty patients at a level comparable with or exceeding that of an expert surgeon.