Deep learning-based surrogate models for parametrized PDEs: Handling geometric variability through graph neural networks.

Mesh-based simulations play a key role when modeling complex physical systems that, in many disciplines across science and engineering, require the solution to parametrized time-dependent nonlinear partial differential equations (PDEs). In this context, full order models (FOMs), such as those relying on the finite element method, can reach high levels of accuracy, however often yielding intensive simulations to run. For this reason, surrogate models are developed to replace computationally expensive solvers with more efficient ones, which can strike favorable trade-offs between accuracy and efficiency. This work explores the potential usage of graph neural networks (GNNs) for the simulation of time-dependent PDEs in the presence of geometrical variability. In particular, we propose a systematic strategy to build surrogate models based on a data-driven time-stepping scheme where a GNN architecture is used to efficiently evolve the system. With respect to the majority of surrogate models, the proposed approach stands out for its ability of tackling problems with parameter-dependent spatial domains, while simultaneously generalizing to different geometries and mesh resolutions. We assess the effectiveness of the proposed approach through a series of numerical experiments, involving both two- and three-dimensional problems, showing that GNNs can provide a valid alternative to traditional surrogate models in terms of computational efficiency and generalization to new scenarios.

Approximation bounds for convolutional neural networks in operator learning.

Recently, deep Convolutional Neural Networks (CNNs) have proven to be successful when employed in areas such as reduced order modeling of parametrized PDEs. Despite their accuracy and efficiency, the approaches available in the literature still lack a rigorous justification on their mathematical foundations. Motivated by this fact, in this paper we derive rigorous error bounds for the approximation of nonlinear operators by means of CNN models. More precisely, we address the case in which an operator maps a finite dimensional input µ∈Rp onto a functional output uµ:[0,1]d→R, and a neural network model is used to approximate a discretized version of the input-to-output map. The resulting error estimates provide a clear interpretation of the hyperparameters defining the neural network architecture. All the proofs are constructive, and they ultimately reveal a deep connection between CNNs and the Fourier transform. Finally, we complement the derived error bounds by numerical experiments that illustrate their application.

Development of a method for generating SNP interaction-aware polygenic risk scores for radiotherapy toxicity.

AIM: To identify the effect of single nucleotide polymorphism (SNP) interactions on the risk of toxicity following radiotherapy (RT) for prostate cancer (PCa) and propose a new method for polygenic risk score incorporating SNP-SNP interactions (PRSi). MATERIALS AND METHODS: Analysis included the REQUITE PCa cohort that received external beam RT and was followed for 2 years. Late toxicity endpoints were: rectal bleeding, urinary frequency, haematuria, nocturia, decreased urinary stream. Among 43 literature-identified SNPs, the 30% most strongly associated with each toxicity were tested. SNP-SNP combinations (named SNP-allele sets) seen in ≥10% of the cohort were condensed into risk (RS) and protection (PS) scores, respectively indicating increased or decreased toxicity risk. Performance of RS and PS was evaluated by logistic regression. RS and PS were then combined into a single PRSi evaluated by area under the receiver operating characteristic curve (AUC). RESULTS: Among 1,387 analysed patients, toxicity rates were 11.7% (rectal bleeding), 4.0% (urinary frequency), 5.5% (haematuria), 7.8% (nocturia) and 17.1% (decreased urinary stream). RS and PS combined 8 to 15 different SNP-allele sets, depending on the toxicity endpoint. Distributions of PRSi differed significantly in patients with/without toxicity with AUCs ranging from 0.61 to 0.78. PRSi was better than the classical summed PRS, particularly for the urinary frequency, haematuria and decreased urinary stream endpoints. CONCLUSIONS: Our method incorporates SNP-SNP interactions when calculating PRS for radiotherapy toxicity. Our approach is better than classical summation in discriminating patients with toxicity and should enable incorporating genetic information to improve normal tissue complication probability models.

A Deep Learning Approach Validates Genetic Risk Factors for Late Toxicity After Prostate Cancer Radiotherapy in a REQUITE Multi-National Cohort.

Background: REQUITE (validating pREdictive models and biomarkers of radiotherapy toxicity to reduce side effects and improve QUalITy of lifE in cancer survivors) is an international prospective cohort study. The purpose of this project was to analyse a cohort of patients recruited into REQUITE using a deep learning algorithm to identify patient-specific features associated with the development of toxicity, and test the approach by attempting to validate previously published genetic risk factors. Methods: The study involved REQUITE prostate cancer patients treated with external beam radiotherapy who had complete 2-year follow-up. We used five separate late toxicity endpoints: ≥grade 1 late rectal bleeding, ≥grade 2 urinary frequency, ≥grade 1 haematuria, ≥ grade 2 nocturia, ≥ grade 1 decreased urinary stream. Forty-three single nucleotide polymorphisms (SNPs) already reported in the literature to be associated with the toxicity endpoints were included in the analysis. No SNP had been studied before in the REQUITE cohort. Deep Sparse AutoEncoders (DSAE) were trained to recognize features (SNPs) identifying patients with no toxicity and tested on a different independent mixed population including patients without and with toxicity. Results: One thousand, four hundred and one patients were included, and toxicity rates were: rectal bleeding 11.7%, urinary frequency 4%, haematuria 5.5%, nocturia 7.8%, decreased urinary stream 17.1%. Twenty-four of the 43 SNPs that were associated with the toxicity endpoints were validated as identifying patients with toxicity. Twenty of the 24 SNPs were associated with the same toxicity endpoint as reported in the literature: 9 SNPs for urinary symptoms and 11 SNPs for overall toxicity. The other 4 SNPs were associated with a different endpoint. Conclusion: Deep learning algorithms can validate SNPs associated with toxicity after radiotherapy for prostate cancer. The method should be studied further to identify polygenic SNP risk signatures for radiotherapy toxicity. The signatures could then be included in integrated normal tissue complication probability models and tested for their ability to personalize radiotherapy treatment planning.