Exploring the Feasibility of GPT-4 as a Data Extraction Tool for Renal Surgery Operative Notes.

INTRODUCTION: GPT-4 is a large language model with potential for multiple applications in urology. Our study sought to evaluate GPT-4's performance in data extraction from renal surgery operative notes. METHODS: GPT-4 was queried to extract information on laterality, surgery, approach, estimated blood loss, and ischemia time from deidentified operative notes. Match rates were determined by the number of "matched" data points between GPT-4 and human-curated extraction. Accuracy rates were calculated after manually reviewing "not matched" data points. Cohen's kappa and the intraclass coefficient were used to evaluate interrater agreement/reliability. RESULTS: Our cohort consisted of 1498 renal surgeries from 2003 to 2023. Match rates were high for laterality (94.4%), surgery (92.5%), and approach (89.4%), but lower for estimated blood loss (77.1%) and ischemia time (25.6%). GPT-4 was more accurate for estimated blood loss (90.3% vs 85.5% human curated) and similarly accurate for laterality (95.2% vs 95.3% human curated). Human-curated accuracy rates were higher for surgery (99.3% vs 93% GPT-4), approach (97.9% vs 90.8% GPT-4), and ischemia time (95.6% vs 30.7% GPT-4). Cohen's kappa was 0.96 for laterality, 0.83 for approach, and 0.71 for surgery. The intraclass coefficient was 0.62 for estimated blood loss and 0.09 for ischemia time. CONCLUSIONS: Match and accuracy rates were higher for categorical variables. GPT-4 data extraction was particularly error prone for variables with heterogenous documentation styles. The role of a standard operative template to aid data extraction will be explored in the future. GPT-4 can be utilized as a helpful and efficient data extraction tool with manual feedback.

Investigating the clinical reasoning abilities of large language model GPT-4: an analysis of postoperative complications from renal surgeries.

PURPOSE: Large language models, a subset of artificial intelligence, have immense potential to support human tasks. The role of these models in science and medicine is unclear, requiring strong critical thinking and analysis skills. The objective of our study was to evaluate GPT-4's abilities to assess postoperative complications after renal surgeries. MATERIALS AND METHODS: Discharge summaries were compiled, and patient information was deidentified in a Python-based program. Prompts were engineered in GPT-4 to assess for the presence of postoperative complications. GPT-4 was further asked to interpret each complication's Clavien-Dindo classification and institutional-specific category. GPT-4's database was compared to a human-curated database. Discrepancies were manually reviewed to calculate match and accuracy rates. RESULTS: Approximately 944 renal surgeries were conducted from August 2005 to March 2022. There was a 79.6% match rate between GPT-4 and human-curated data in detecting postoperative complications. Accuracy rates were 86.7% for GPT-4 and 92.9% for human-curated. A subgroup of 139 patients had a complication detected by both GPT-4 and human with available Clavien-Dindo classification and category information. There was a 37.4% overall match rate for Clavien-Dindo grade and 55.4% match rate for category. CONCLUSIONS: GPT-4 was able to accurately detect if there were any postoperative complications. It struggled with the complex task of further analyzing complications, especially with Clavien-Dindo classification, which requires more critical thinking and interpretation. While GPT-4 is not yet ready for advanced postoperative complication analysis, it can still be used to support clinicians in this endeavor.

Impact of neoadjuvant relugolix on patient-reported sexual function and bother.

Introduction: Sexual function following local treatment for prostate cancer is an important quality of life concern. Relugolix is a novel oral GnRH receptor antagonist used in combination with radiation therapy in the treatment of unfavorable prostate cancer. It has been shown to achieve rapid and profound testosterone suppression. As a result, these very low testosterone levels may impact both sexual functioning and perceptions. This prospective study sought to assess neoadjuvant relugolix-induced sexual dysfunction prior to stereotactic body radiation therapy (SBRT). Methods: Between March 2021 and September 2023, 87 patients with localized prostate cancer were treated with neoadjuvant relugolix followed by SBRT per an institutional protocol. Sexual function and bother were assessed via the sexual domain of the validated Expanded Prostate Index Composite (EPIC-26) survey. Responses were collected for each patient at pre-treatment baseline and after several months of relugolix. A Utilization of Sexual Medications/Devices questionnaire was administered at the same time points to assess erectile aid usage. Results: The median age was 72 years and 43% of patients were non-white. The median baseline Sexual Health Inventory for Men (SHIM) score was 13 and 41.7% of patients utilized sexual aids prior to relugolix. Patients initiated relugolix at a median of 4.5 months (2-14 months) prior to SBRT. 95% and 87% of patients achieved effective castration (≤ 50 ng/dL) and profound castration (< 20 ng/dl) at SBRT initiation, respectively. Ability to have an erection, ability to reach orgasm, quality of erections, frequency of erections, and overall sexual function significantly declined following relugolix. There was a non- significant increase in sexual bother. Discussion: In concordance with known side effects of androgen deprivation therapy (ADT), neoadjuvant relugolix was associated with a significant decline in self-reported sexual function. However, patients indicated only a minimal and non-significant increase in bother. Future investigations should compare outcomes while on relugolix directly to GnRH agonist-induced sexual dysfunction.

Reducing False-Positives Due to Urinary Stagnation in the Prostatic Urethra on 18 F-DCFPyL PSMA PET/CT With MRI.

PURPOSE: Prostate-specific membrane antigen (PSMA)-targeting PET radiotracers reveal physiologic uptake in the urinary system, potentially misrepresenting activity in the prostatic urethra as an intraprostatic lesion. This study examined the correlation between midline 18 F-DCFPyL activity in the prostate and hyperintensity on T2-weighted (T2W) MRI as an indication of retained urine in the prostatic urethra. PATIENTS AND METHODS: Eighty-five patients who underwent both 18 F-DCFPyL PSMA PET/CT and prostate MRI between July 2017 and September 2023 were retrospectively analyzed for midline radiotracer activity and retained urine on postvoid T2W MRIs. Fisher's exact tests and unpaired t tests were used to compare residual urine presence and prostatic urethra measurements between patients with and without midline radiotracer activity. The influence of anatomical factors including prostate volume and urethral curvature on urinary stagnation was also explored. RESULTS: Midline activity on PSMA PET imaging was seen in 14 patients included in the case group, whereas the remaining 71 with no midline activity constituted the control group. A total of 71.4% (10/14) and 29.6% (21/71) of patients in the case and control groups had urethral hyperintensity on T2W MRI, respectively ( P < 0.01). Patients in the case group had significantly larger mean urethral dimensions, larger prostate volumes, and higher incidence of severe urethral curvature compared with the controls. CONCLUSIONS: Stagnated urine within the prostatic urethra is a potential confounding factor on PSMA PET scans. Integrating PET imaging with T2W MRI can mitigate false-positive calls, especially as PSMA PET/CT continues to gain traction in diagnosing localized prostate cancer.