Potential of ChatGPT and GPT-4 for Data Mining of Free-Text CT Reports on Lung Cancer.

Background The latest large language models (LLMs) solve unseen problems via user-defined text prompts without the need for retraining, offering potentially more efficient information extraction from free-text medical records than manual annotation. Purpose To compare the performance of the LLMs ChatGPT and GPT-4 in data mining and labeling oncologic phenotypes from free-text CT reports on lung cancer by using user-defined prompts. Materials and Methods This retrospective study included patients who underwent lung cancer follow-up CT between September 2021 and March 2023. A subset of 25 reports was reserved for prompt engineering to instruct the LLMs in extracting lesion diameters, labeling metastatic disease, and assessing oncologic progression. This output was fed into a rule-based natural language processing pipeline to match ground truth annotations from four radiologists and derive performance metrics. The oncologic reasoning of LLMs was rated on a five-point Likert scale for factual correctness and accuracy. The occurrence of confabulations was recorded. Statistical analyses included Wilcoxon signed rank and McNemar tests. Results On 424 CT reports from 424 patients (mean age, 65 years ± 11 [SD]; 265 male), GPT-4 outperformed ChatGPT in extracting lesion parameters (98.6% vs 84.0%, P < .001), resulting in 96% correctly mined reports (vs 67% for ChatGPT, P < .001). GPT-4 achieved higher accuracy in identification of metastatic disease (98.1% [95% CI: 97.7, 98.5] vs 90.3% [95% CI: 89.4, 91.0]) and higher performance in generating correct labels for oncologic progression (F1 score, 0.96 [95% CI: 0.94, 0.98] vs 0.91 [95% CI: 0.89, 0.94]) (both P < .001). In oncologic reasoning, GPT-4 had higher Likert scale scores for factual correctness (4.3 vs 3.9) and accuracy (4.4 vs 3.3), with a lower rate of confabulation (1.7% vs 13.7%) than ChatGPT (all P < .001). Conclusion When using user-defined prompts, GPT-4 outperformed ChatGPT in extracting oncologic phenotypes from free-text CT reports on lung cancer and demonstrated better oncologic reasoning with fewer confabulations. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Hafezi-Nejad and Trivedi in this issue.

Quantitative CT analysis of lung parenchyma to improve malignancy risk estimation in incidental pulmonary nodules.

OBJECTIVES: To assess the value of quantitative computed tomography (QCT) of the whole lung and nodule-bearing lobe regarding pulmonary nodule malignancy risk estimation. METHODS: A total of 251 subjects (median [IQR] age, 65 (57-73) years; 37% females) with pulmonary nodules on non-enhanced thin-section CT were retrospectively included. Twenty percent of the nodules were malignant, the remainder benign either histologically or at least 1-year follow-up. CT scans were subjected to in-house software, computing parameters such as mean lung density (MLD) or peripheral emphysema index (pEI). QCT variable selection was performed using logistic regression; selected variables were integrated into the Mayo Clinic and the parsimonious Brock Model. RESULTS: Whole-lung analysis revealed differences between benign vs. malignant nodule groups in several parameters, e.g. the MLD (-766 vs. -790 HU) or the pEI (40.1 vs. 44.7 %). The proposed QCT model had an area-under-the-curve (AUC) of 0.69 (95%-CI, 0.62-0.76) based on all available data. After integrating MLD and pEI into the Mayo Clinic and Brock Model, the AUC of both clinical models improved (AUC, 0.91 to 0.93 and 0.88 to 0.91, respectively). The lobe-specific analysis revealed that the nodule-bearing lobes had less emphysema than the rest of the lung regarding benign (EI, 0.5 vs. 0.7 %; p < 0.001) and malignant nodules (EI, 1.2 vs. 1.7 %; p = 0.001). CONCLUSIONS: Nodules in subjects with higher whole-lung metrics of emphysema and less fibrosis are more likely to be malignant; hereby the nodule-bearing lobes have less emphysema. QCT variables could improve the risk assessment of incidental pulmonary nodules. KEY POINTS: • Nodules in subjects with higher whole-lung metrics of emphysema and less fibrosis are more likely to be malignant. • The nodule-bearing lobes have less emphysema compared to the rest of the lung. • QCT variables could improve the risk assessment of incidental pulmonary nodules.

Imaging Biomarkers in Thoracic Oncology: Current Advances in the Use of Radiomics in Lung Cancer Patients and its Potential Use for Therapy Response Prediction and Monitoring.

BACKGROUND: Non-small cell lung cancer (NSCLC) is the leading cause of cancer-related deaths. The development of therapies targeting molecular alterations has significantly improved the treatment of NSCLC patients. To identify these targets, tumor phenotyping is required, with tissue biopsies and molecular pathology being the gold standard. Some patients do not respond to targeted therapies and many patients suffer from tumor recurrence, which can in part be explained by tumor heterogeneity. This points out the need for new biomarkers allowing for better tumor phenotyping and monitoring during treatment to assess patient outcome. METHOD: The contents of this review are based on a literature search conducted using the PubMed database in March 2021 and the authors' experience. RESULTS AND CONCLUSION: The use of radiomics and artificial intelligence-based approaches allows for the identification of imaging biomarkers in NSCLC patients for tumor phenotyping. Several studies show promising results for models predicting molecular alterations, with the best results being achieved by combining structural and functional imaging. Radiomics could help solve the pressing clinical need for assessing and predicting therapy response. To reach this goal, advanced tumor phenotyping, considering tumor heterogeneity, is required. This could be achieved by integrating structural and functional imaging biomarkers with clinical data sources, such as liquid biopsy results. However, to allow for radiomics-based approaches to be introduced into clinical practice, further standardization using large, multi-center datasets is required. KEY POINTS: · Some NSCLC patients do not benefit from targeted therapies, and many patients suffer from tumor recurrence, pointing out the need for new biomarkers allowing for better tumor phenotyping and monitoring during treatment.. · The use of radiomics-based approaches allows for the identification of imaging biomarkers in NSCLC patients for tumor phenotyping.. · A multi-omics approach integrating not only structural and functional imaging biomarkers but also clinical data sources, such as liquid biopsy results, could further enhance the prediction and assessment of therapy response.. CITATION FORMAT: · Kroschke J, von Stackelberg O, Heußel CP et al. Imaging Biomarkers in Thoracic Oncology: Current Advances in the Use of Radiomics in Lung Cancer Patients and its Potential Use for Therapy Response Prediction and Monitoring. Fortschr Röntgenstr 2022; 194: 720 - 727.

AI-Supported Comprehensive Detection and Quantification of Biomarkers of Subclinical Widespread Diseases at Chest CT for Preventive Medicine.

Automated image analysis plays an increasing role in radiology in detecting and quantifying image features outside of the perception of human eyes. Common AI-based approaches address a single medical problem, although patients often present with multiple interacting, frequently subclinical medical conditions. A holistic imaging diagnostics tool based on artificial intelligence (AI) has the potential of providing an overview of multi-system comorbidities within a single workflow. An interdisciplinary, multicentric team of medical experts and computer scientists designed a pipeline, comprising AI-based tools for the automated detection, quantification and characterization of the most common pulmonary, metabolic, cardiovascular and musculoskeletal comorbidities in chest computed tomography (CT). To provide a comprehensive evaluation of each patient, a multidimensional workflow was established with algorithms operating synchronously on a decentralized Joined Imaging Platform (JIP). The results of each patient are transferred to a dedicated database and summarized as a structured report with reference to available reference values and annotated sample images of detected pathologies. Hence, this tool allows for the comprehensive, large-scale analysis of imaging-biomarkers of comorbidities in chest CT, first in science and then in clinical routine. Moreover, this tool accommodates the quantitative analysis and classification of each pathology, providing integral diagnostic and prognostic value, and subsequently leading to improved preventive patient care and further possibilities for future studies.

Cell Cycle-specific Measurement of γH2AX and Apoptosis After Genotoxic Stress by Flow Cytometry.

The presented method or slightly modified versions have been devised to study specific treatment responses and side effects of various anti-cancer treatments as used in clinical oncology. It enables a quantitative and longitudinal analysis of the DNA damage response after genotoxic stress, as induced by radiotherapy and a multitude of anti-cancer drugs. The method covers all stages of the DNA damage response, providing endpoints for induction and repair of DNA double-strand breaks (DSBs), cell cycle arrest and cell death by apoptosis in case of repair failure. Combining these measurements provides information about cell cycle-dependent treatment effects and thus allows an in-depth study of the interplay between cellular proliferation and coping mechanisms against DNA damage. As the effect of many cancer therapeutics including chemotherapeutic agents and ionizing radiation is limited to or strongly varies according to specific cell cycle phases, correlative analyses rely on a robust and feasible method to assess the treatment effects on the DNA in a cell cycle-specific manner. This is not possible with single-endpoint assays and an important advantage of the presented method. The method is not restricted to any particular cell line and has been thoroughly tested in a multitude of tumor and normal tissue cell lines. It can be widely applied as a comprehensive genotoxicity assay in many fields of oncology besides radio-oncology, including environmental risk factor assessment, drug screening and evaluation of genetic instability in tumor cells.