Current Strengths and Weaknesses of ChatGPT as a Resource for Radiation Oncology Patients and Providers.

PURPOSE: Chat Generative Pre-Trained Transformer (ChatGPT), an artificial intelligence program that uses natural language processing to generate conversational-style responses to questions or inputs, is increasingly being used by both patients and health care professionals. This study aims to evaluate the accuracy and comprehensiveness of ChatGPT in radiation oncology-related domains, including answering common patient questions, summarizing landmark clinical research studies, and providing literature reviews with specific references supporting current standard-of-care clinical practice in radiation oncology. METHODS AND MATERIALS: We assessed the performance of ChatGPT version 3.5 (ChatGPT3.5) in 3 areas. We evaluated ChatGPT3.5's ability to answer 28 templated patient-centered questions applied across 9 cancer types. We then tested ChatGPT3.5's ability to summarize specific portions of 10 landmark studies in radiation oncology. Next, we used ChatGPT3.5 to identify scientific studies supporting current standard-of-care practice in clinical radiation oncology for 5 different cancer types. Each response was graded independently by 2 reviewers, with discordant grades resolved by a third reviewer. RESULTS: ChatGPT3.5 frequently generated inaccurate or incomplete responses. Only 39.7% of responses to patient-centered questions were considered correct and comprehensive. When summarizing landmark studies in radiation oncology, 35.0% of ChatGPT3.5's responses were accurate and comprehensive, improving to 43.3% when provided the full text of the study. ChatGPT3.5's ability to present a list of studies related to standard-of-care clinical practices was also unsatisfactory, with 50.6% of the provided studies fabricated. CONCLUSIONS: ChatGPT should not be considered a reliable radiation oncology resource for patients or providers at this time, as it frequently generates inaccurate or incomplete responses. However, natural language programming-based artificial intelligence programs are rapidly evolving, and future versions of ChatGPT or similar programs may demonstrate improved performance in this domain.

Determinants of Symptomatic Intracranial Progression After an Initial Stereotactic Radiosurgery Course.

Purpose: Clinical and imaging surveillance of patients with brain metastases is important after stereotactic radiosurgery (SRS) because many will experience intracranial progression (ITCP) requiring multidisciplinary management. The prognostic significance of neurologic symptoms at the time of ITCP is poorly understood. Methods and Materials: This was a multi-institutional, retrospective cohort study from 2015 to 2020, including all patients with brain metastases completing an initial course of SRS. The primary outcome was overall survival (OS) by presence of neurologic symptoms at ITCP. OS, freedom from ITCP (FF-ITCP), and freedom from symptomatic ITCP (FF-SITCP) were assessed via Kaplan-Meier method. Cox proportional hazard models tested parameters impacting FF-ITCP and FF-SITCP. Results: Among 1383 patients, median age was 63.4 years, 55% were female, and common primaries were non-small cell lung (49%), breast (15%), and melanoma (9%). At a median follow-up of 8.72 months, asymptomatic and symptomatic ITCP were observed in 504 (36%) and 194 (14%) patients, respectively. The majority of ITCP were distant ITCP (79.5%). OS was worse with SITCP (median, 10.2 vs 17.9 months, P < .001). SITCP was associated with clinical factors including total treatment volume (P = .012), melanoma histology (P = .001), prior whole brain radiation therapy (P = .003), number of brain metastases (P < .001), interval of 1 to 2 years from primary and brain metastasis diagnosis (P = .012), controlled extracranial disease (P = .042), and receipt of pre-SRS chemotherapy (P = .015). Patients who were younger and received post-SRS chemotherapy (P = .001), immunotherapy (P < .001), and targeted or small-molecule inhibitor therapy (P < .026) had better FF-SITCP. Conclusions: In this cohort study of patients with brain metastases completing SRS, neurologic symptoms at ITCP is prognostic for OS. This data informs post-SRS surveillance in clinical practice as well as future prospective studies needed in the modern management of brain metastases.

Incidence and imaging characteristics of difficult to detect retrospectively identified brain metastases in patients receiving repeat courses of stereotactic radiosurgery.

PURPOSE: During stereotactic radiosurgery (SRS) planning for brain metastases (BM), brain MRIs are reviewed to select appropriate targets based on radiographic characteristics. Some BM are difficult to detect and/or definitively identify and may go untreated initially, only to become apparent on future imaging. We hypothesized that in patients receiving multiple courses of SRS, reviewing the initial planning MRI would reveal early evidence of lesions that developed into metastases requiring SRS. METHODS: Patients undergoing two or more courses of SRS to BM within 6 months between 2016 and 2018 were included in this single-institution, retrospective study. Brain MRIs from the initial course were reviewed for lesions at the same location as subsequently treated metastases; if present, this lesion was classified as a "retrospectively identified metastasis" or RIM. RIMs were subcategorized as meeting or not meeting diagnostic imaging criteria for BM (+ DC or -DC, respectively). RESULTS: Among 683 patients undergoing 923 SRS courses, 98 patients met inclusion criteria. There were 115 repeat courses of SRS, with 345 treated metastases in the subsequent course, 128 of which were associated with RIMs found in a prior MRI. 58% of RIMs were + DC. 17 (15%) of subsequent courses consisted solely of metastases associated with + DC RIMs. CONCLUSION: Radiographic evidence of brain metastases requiring future treatment was occasionally present on brain MRIs from prior SRS treatments. Most RIMs were + DC, and some subsequent SRS courses treated only + DC RIMs. These findings suggest enhanced BM detection might enable earlier treatment and reduce the need for additional SRS.