ABSTRACT
INTRODUCTION: As acceptance of AI platforms increases, more patients will consider these tools as sources of information. The ChatGPT architecture utilizes a neural network to process natural language, thus generating responses based on the context of input text. The accuracy and completeness of ChatGPT3.5 in the context of Inflammatory Bowel Disease remains unclear. METHODS: In this prospective study, 38 questions worded by IBD patients were inputted into ChatGPT3.5. The following topics were covered: 1) CD, UC and malignancy, 2) maternal medicine 3) infection and vaccination 4) complementary medicine. Responses given by Chat GPT were assessed for accuracy (1 - completely incorrect to 5 - completely correct) and completeness (3-point Likert scale; range 1 - incomplete to 3 - complete) by 14 expert gastroenterologists, in comparison with relevant ECCO guidelines. RESULTS: In terms of accuracy, most replies (84.2%) had a median score of ≥4 (IQR:2) and a mean score of 3.87 (SD: +/- 0.6). For completeness, 34.2% of the replies had a median score of 3 and 55.3 % had a median score of between 2 and <3. Overall, the mean rating was 2.24 (SD: +/- 0.4, Median:2 IQR :1). Though group 3 and 4 had a higher mean for both accuracy and completeness, there was no significant scoring variation between the 4 question groups (Kruskal-Wallis test p:>0.05). However, statistical analysis for the different individual questions revealed a significant difference both for accuracy (p<0.001) and completeness (p<0.001). The questions which rated the highest for both accuracy and completeness were related to smoking, while the lowest rating was related to screening for malignancy and vaccinations especially in the context of immunosuppression and family planning. CONCLUSION: This is the first study to demonstrate the capability of an AI-based system to provide accurate and comprehensive answers to real-world patient queries in IBD. AI systems may serve as a useful adjunct for patients, in addition to standard of care in clinic and validated patient information resources. However, responses in specialist areas may deviate from evidence-based guidance and the replies need to give more firm advice.
ABSTRACT
BACKGROUND AND AIMS: There is limited data on the risk of developing diarrhoea in travelling patients with inflammatory bowel disease (IBD). We analysed the rate of developing diarrhoea among travellers suffering from IBD and their healthy controls. METHODS: We performed a retrospective case-controlled study among 78 patients with IBD and their healthy travelling companion controls, thus matching both groups to the same environmental conditions. Data was retrieved through a structured questionnaire, interview and clinical case notes review. RESULTS: Sixteen (20.5%) patients with IBD developed diarrhoea while abroad (p -0.0001) Statistical analysis using a χ2 test for independence (with Yates Continuity Correction). Prior to travelling, they were in clinical remission. Only one healthy control (1.3%) developed diarrhoea while abroad. In 11 patients (14.1%), the duration of diarrhoea was 3â days or less, and resolved on its own without antibiotics, any increase in their IBD medications and without a medical consultation. The other five patients had a flare-up of their disease and needed medications to put them back into remission. There was no statistically significant difference between patients having immunomodulator medications versus those having aminosalicylates only in developing diarrhoea when abroad. CONCLUSIONS: Patients with IBD have a higher rate of developing diarrhoea compared with controls when travelling. Thus, such patients must always seek a pretravel medical consultation.
