Empirical evaluation of language modeling to ascertain cancer outcomes from clinical text reports.

BACKGROUND: Longitudinal data on key cancer outcomes for clinical research, such as response to treatment and disease progression, are not captured in standard cancer registry reporting. Manual extraction of such outcomes from unstructured electronic health records is a slow, resource-intensive process. Natural language processing (NLP) methods can accelerate outcome annotation, but they require substantial labeled data. Transfer learning based on language modeling, particularly using the Transformer architecture, has achieved improvements in NLP performance. However, there has been no systematic evaluation of NLP model training strategies on the extraction of cancer outcomes from unstructured text. RESULTS: We evaluated the performance of nine NLP models at the two tasks of identifying cancer response and cancer progression within imaging reports at a single academic center among patients with non-small cell lung cancer. We trained the classification models under different conditions, including training sample size, classification architecture, and language model pre-training. The training involved a labeled dataset of 14,218 imaging reports for 1112 patients with lung cancer. A subset of models was based on a pre-trained language model, DFCI-ImagingBERT, created by further pre-training a BERT-based model using an unlabeled dataset of 662,579 reports from 27,483 patients with cancer from our center. A classifier based on our DFCI-ImagingBERT, trained on more than 200 patients, achieved the best results in most experiments; however, these results were marginally better than simpler "bag of words" or convolutional neural network models. CONCLUSION: When developing AI models to extract outcomes from imaging reports for clinical cancer research, if computational resources are plentiful but labeled training data are limited, large language models can be used for zero- or few-shot learning to achieve reasonable performance. When computational resources are more limited but labeled training data are readily available, even simple machine learning architectures can achieve good performance for such tasks.

Biologically informed deep neural network for prostate cancer discovery.

The determination of molecular features that mediate clinically aggressive phenotypes in prostate cancer remains a major biological and clinical challenge1,2. Recent advances in interpretability of machine learning models as applied to biomedical problems may enable discovery and prediction in clinical cancer genomics3-5. Here we developed P-NET-a biologically informed deep learning model-to stratify patients with prostate cancer by treatment-resistance state and evaluate molecular drivers of treatment resistance for therapeutic targeting through complete model interpretability. We demonstrate that P-NET can predict cancer state using molecular data with a performance that is superior to other modelling approaches. Moreover, the biological interpretability within P-NET revealed established and novel molecularly altered candidates, such as MDM4 and FGFR1, which were implicated in predicting advanced disease and validated in vitro. Broadly, biologically informed fully interpretable neural networks enable preclinical discovery and clinical prediction in prostate cancer and may have general applicability across cancer types.

ATM Loss Confers Greater Sensitivity to ATR Inhibition Than PARP Inhibition in Prostate Cancer.

Alterations in DNA damage response (DDR) genes are common in advanced prostate tumors and are associated with unique genomic and clinical features. ATM is a DDR kinase that has a central role in coordinating DNA repair and cell-cycle response following DNA damage, and ATM alterations are present in approximately 5% of advanced prostate tumors. Recently, inhibitors of PARP have demonstrated activity in advanced prostate tumors harboring DDR gene alterations, particularly in tumors with BRCA1/2 alterations. However, the role of alterations in DDR genes beyond BRCA1/2 in mediating PARP inhibitor sensitivity is poorly understood. To define the role of ATM loss in prostate tumor DDR function and sensitivity to DDR-directed agents, we created a series of ATM-deficient preclinical prostate cancer models and tested the impact of ATM loss on DNA repair function and therapeutic sensitivities. ATM loss altered DDR signaling, but did not directly impact homologous recombination function. Furthermore, ATM loss did not significantly impact sensitivity to PARP inhibition but robustly sensitized to inhibitors of the related DDR kinase ATR. These results have important implications for planned and ongoing prostate cancer clinical trials and suggest that patients with tumor ATM alterations may be more likely to benefit from ATR inhibitor than PARP inhibitor therapy. SIGNIFICANCE: ATM loss occurs in a subset of prostate tumors. This study shows that deleting ATM in prostate cancer models does not significantly increase sensitivity to PARP inhibition but does sensitize to ATR inhibition.See related commentary by Setton and Powell, p. 2085.

Harmonization of Tumor Mutational Burden Quantification and Association With Response to Immune Checkpoint Blockade in Non-Small-Cell Lung Cancer.

PURPOSE: Heterogeneity in tumor mutational burden (TMB) quantification across sequencing platforms limits the application and further study of this potential biomarker of response to immune checkpoint inhibitors (ICI). We hypothesized that harmonization of TMB across platforms would enable integration of distinct clinical datasets to better characterize the association between TMB and ICI response. METHODS: Cohorts of NSCLC patients sequenced by one of three targeted panels or by whole exome sequencing (WES) were compared (total n=7297). TMB was calculated uniformly and compared across cohorts. TMB distributions were harmonized by applying a normal transformation followed by standardization to z-scores. In sub-cohorts of patients treated with ICIs (DFCI n=272; MSKCC n=227), the association between TMB and outcome was assessed. Durable clinical benefit (DCB) was defined as responsive/stable disease lasting ≥6 months. RESULTS: TMB values were higher in the panel cohorts than the WES cohort. Average mutation rates per gene were highly concordant across cohorts (Pearson coefficient 0.842-0.866). Subsetting the WES cohort by gene panels only partially reproduced the observed differences in TMB. Standardization of TMB into z-scores harmonized TMB distributions and enabled integration of the ICI-treated sub-cohorts. Simulations indicated that cohorts >900 are necessary for this approach. TMB did not associate with response in never smokers or patients harboring targetable driver alterations, although these analyses were under-powered. Increasing TMB thresholds increased DCB rate, but DCB rates within deciles varied. Receiver operator curves yielded an area under the curve of 0.614 with no natural inflection point. CONCLUSION: Z-score conversion harmonizes TMB values and enables integration of datasets derived from different sequencing panels. Clinical and biologic features may provide context to the clinical application of TMB, and warrant further study.