ChatGPT v4 outperforming v3.5 on cancer treatment recommendations in quality, clinical guideline, and expert opinion concordance.

Objectives: To assess the quality and alignment of ChatGPT's cancer treatment recommendations (RECs) with National Comprehensive Cancer Network (NCCN) guidelines and expert opinions. Methods: Three urologists performed quantitative and qualitative assessments in October 2023 analyzing responses from ChatGPT-4 and ChatGPT-3.5 to 108 prostate, kidney, and bladder cancer prompts using two zero-shot prompt templates. Performance evaluation involved calculating five ratios: expert-approved/expert-disagreed and NCCN-aligned RECs against total ChatGPT RECs plus coverage and adherence rates to NCCN. Experts rated the response's quality on a 1-5 scale considering correctness, comprehensiveness, specificity, and appropriateness. Results: ChatGPT-4 outperformed ChatGPT-3.5 in prostate cancer inquiries, with an average word count of 317.3 versus 124.4 (p < 0.001) and 6.1 versus 3.9 RECs (p < 0.001). Its rater-approved REC ratio (96.1% vs. 89.4%) and alignment with NCCN guidelines (76.8% vs. 49.1%, p = 0.001) were superior and scored significantly better on all quality dimensions. Across 108 prompts covering three cancers, ChatGPT-4 produced an average of 6.0 RECs per case, with an 88.5% approval rate from raters, 86.7% NCCN concordance, and only a 9.5% disagreement rate. It achieved high marks in correctness (4.5), comprehensiveness (4.4), specificity (4.0), and appropriateness (4.4). Subgroup analyses across cancer types, disease statuses, and different prompt templates were reported. Conclusions: ChatGPT-4 demonstrated significant improvement in providing accurate and detailed treatment recommendations for urological cancers in line with clinical guidelines and expert opinion. However, it is vital to recognize that AI tools are not without flaws and should be utilized with caution. ChatGPT could supplement, but not replace, personalized advice from healthcare professionals.

Diagnostic Role of Serum Free-to-Total Prostate Specific Antigen (PSA) Ratio in Prostate Cancer with Serum Total Concentration of PSA below 4 ng/mL.

PURPOSE: To examine the effectiveness of serum free-to-total prostate specific antigen ratio (%fPSA) for the detection of prostate cancer (PCa) in men with different serum total PSA (tPSA) categories. MATERIALS AND METHODS: From January 2010 to December 2013, a total of 225 patients with lower urinary tract symptoms (LUTS) underwent tPSA and %fPSA measurements. Histological examination with calculation of Gleason score and whole body bone scans were performed in identified cases of PCa. RESULTS: PCa was diagnosed in 44 (19.6%) patients and the remaining 181 patients had benign prostate disease. PCa was detected in 5 (23.8%), 13 (8.7%) and 26 (47.3%) cases with tPSA level ranges≤4 ng/ml, 4 to 10 ng/ml and >10 ng/ml, respectively. The average Gleason score was 7.2±0.2. Some 6 (13.6%) out of 44 PCa patients had bone metastases. The sensitivity was 80% and specificity was 81.3% at the cut-off %fPSA of 15% in PCa patients with a tPSA level below 4 ng/ mL. A lower %fPSA was associated with PCa patients with Gleason score≥7 than those with Gleason score≤6 (11.7±0.98 vs. 16.5±2.25%, P=0.029). No obvious relation of %fPSA to the incidence of bone metastasis was apparent in this study. CONCLUSIONS: The clinical application of %fPSA could help to discriminate PCa from benign prostate disease in men with a tPSA concentration below 4 ng/mL.